2022/09/26 10:38:50 - mmengine - INFO - ------------------------------------------------------------ System environment: sys.platform: linux Python: 3.8.13 (default, Mar 28 2022, 11:38:47) [GCC 7.5.0] CUDA available: True numpy_random_seed: 1621050560 GPU 0,1,2,3,4,5,6,7: NVIDIA A100-SXM4-80GB CUDA_HOME: /mnt/lustre/share/cuda-11.3 NVCC: Cuda compilation tools, release 11.3, V11.3.109 GCC: gcc (GCC) 5.4.0 PyTorch: 1.12.1 PyTorch compiling details: PyTorch built with: - GCC 9.3 - C++ Version: 201402 - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications - Intel(R) MKL-DNN v2.6.0 (Git Hash 52b5f107dd9cf10910aaa19cb47f3abf9b349815) - OpenMP 201511 (a.k.a. OpenMP 4.5) - LAPACK is enabled (usually provided by MKL) - NNPACK is enabled - CPU capability usage: AVX2 - CUDA Runtime 11.3 - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_37,code=compute_37 - CuDNN 8.3.2 (built against CUDA 11.5) - Magma 2.5.2 - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.3.2, CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, CXX_FLAGS= -fabi-version=11 -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.12.1, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=OFF, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, TorchVision: 0.13.1 OpenCV: 4.6.0 MMEngine: 0.1.0 Runtime environment: cudnn_benchmark: False mp_cfg: {'mp_start_method': 'fork', 'opencv_num_threads': 0} dist_cfg: {'backend': 'nccl'} seed: None Distributed launcher: slurm Distributed training: True GPU number: 8 ------------------------------------------------------------ 2022/09/26 10:38:52 - mmengine - INFO - Config: default_scope = 'mmpose' default_hooks = dict( timer=dict(type='IterTimerHook'), logger=dict(type='LoggerHook', interval=50), param_scheduler=dict(type='ParamSchedulerHook'), checkpoint=dict( type='CheckpointHook', interval=10, max_keep_ckpts=1, save_best='coco/AP', rule='greater'), sampler_seed=dict(type='DistSamplerSeedHook'), visualization=dict(type='PoseVisualizationHook', enable=False)) custom_hooks = [dict(type='SyncBuffersHook')] env_cfg = dict( cudnn_benchmark=False, mp_cfg=dict(mp_start_method='fork', opencv_num_threads=0), dist_cfg=dict(backend='nccl')) vis_backends = [dict(type='LocalVisBackend')] visualizer = dict( type='PoseLocalVisualizer', vis_backends=[dict(type='LocalVisBackend')], name='visualizer') log_processor = dict( type='LogProcessor', window_size=50, by_epoch=True, num_digits=6) log_level = 'INFO' load_from = None resume = False file_client_args = dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' })) train_cfg = dict(by_epoch=True, max_epochs=210, val_interval=10) val_cfg = dict() test_cfg = dict() optim_wrapper = dict(optimizer=dict(type='Adam', lr=0.0005)) param_scheduler = [ dict( type='LinearLR', begin=0, end=500, start_factor=0.001, by_epoch=False), dict( type='MultiStepLR', begin=0, end=210, milestones=[170, 200], gamma=0.1, by_epoch=True) ] auto_scale_lr = dict(base_batch_size=512) codec = dict( type='MSRAHeatmap', input_size=(288, 384), heatmap_size=(72, 96), sigma=3, unbiased=True) model = dict( type='TopdownPoseEstimator', data_preprocessor=dict( type='PoseDataPreprocessor', mean=[123.675, 116.28, 103.53], std=[58.395, 57.12, 57.375], bgr_to_rgb=True), backbone=dict( type='ResNet', depth=101, init_cfg=dict(type='Pretrained', checkpoint='torchvision://resnet101')), head=dict( type='HeatmapHead', in_channels=2048, out_channels=17, loss=dict(type='KeypointMSELoss', use_target_weight=True), decoder=dict( type='MSRAHeatmap', input_size=(288, 384), heatmap_size=(72, 96), sigma=3, unbiased=True)), test_cfg=dict(flip_test=True, flip_mode='heatmap', shift_heatmap=True)) dataset_type = 'CocoDataset' data_mode = 'topdown' data_root = 'data/coco/' train_pipeline = [ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='RandomFlip', direction='horizontal'), dict(type='RandomHalfBody'), dict(type='RandomBBoxTransform'), dict(type='TopdownAffine', input_size=(288, 384)), dict( type='GenerateTarget', target_type='heatmap', encoder=dict( type='MSRAHeatmap', input_size=(288, 384), heatmap_size=(72, 96), sigma=3, unbiased=True)), dict(type='PackPoseInputs') ] val_pipeline = [ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(288, 384)), dict(type='PackPoseInputs') ] train_dataloader = dict( batch_size=64, num_workers=2, persistent_workers=True, sampler=dict(type='DefaultSampler', shuffle=True), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_train2017.json', data_prefix=dict(img='train2017/'), pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='RandomFlip', direction='horizontal'), dict(type='RandomHalfBody'), dict(type='RandomBBoxTransform'), dict(type='TopdownAffine', input_size=(288, 384)), dict( type='GenerateTarget', target_type='heatmap', encoder=dict( type='MSRAHeatmap', input_size=(288, 384), heatmap_size=(72, 96), sigma=3, unbiased=True)), dict(type='PackPoseInputs') ])) val_dataloader = dict( batch_size=32, num_workers=2, persistent_workers=True, drop_last=False, sampler=dict(type='DefaultSampler', shuffle=False, round_up=False), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_val2017.json', bbox_file= 'data/coco/person_detection_results/COCO_val2017_detections_AP_H_56_person.json', data_prefix=dict(img='val2017/'), test_mode=True, pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(288, 384)), dict(type='PackPoseInputs') ])) test_dataloader = dict( batch_size=32, num_workers=2, persistent_workers=True, drop_last=False, sampler=dict(type='DefaultSampler', shuffle=False, round_up=False), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_val2017.json', bbox_file= 'data/coco/person_detection_results/COCO_val2017_detections_AP_H_56_person.json', data_prefix=dict(img='val2017/'), test_mode=True, pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(288, 384)), dict(type='PackPoseInputs') ])) val_evaluator = dict( type='CocoMetric', ann_file='data/coco/annotations/person_keypoints_val2017.json') test_evaluator = dict( type='CocoMetric', ann_file='data/coco/annotations/person_keypoints_val2017.json') launcher = 'slurm' work_dir = '/mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/' 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "data sampler" registry tree. As a workaround, the current "data sampler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optimizer wrapper constructor" registry tree. As a workaround, the current "optimizer wrapper constructor" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optimizer" registry tree. As a workaround, the current "optimizer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optim_wrapper" registry tree. As a workaround, the current "optim_wrapper" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:34 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:37 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "data sampler" registry tree. As a workaround, the current "data sampler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:40 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:42 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/26 10:39:42 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. Name of parameter - Initialization information backbone.conv1.weight - torch.Size([64, 3, 7, 7]): PretrainedInit: load from torchvision://resnet101 backbone.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.conv1.weight - torch.Size([64, 64, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.downsample.0.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.downsample.1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.0.downsample.1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.conv1.weight - torch.Size([64, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.1.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.conv1.weight - torch.Size([64, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer1.2.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.conv1.weight - torch.Size([128, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.downsample.0.weight - torch.Size([512, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.downsample.1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.0.downsample.1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.1.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.2.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer2.3.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.conv1.weight - torch.Size([256, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.downsample.0.weight - torch.Size([1024, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.downsample.1.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.0.downsample.1.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.1.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.2.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.3.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.4.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.5.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.6.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.7.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.8.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.9.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.10.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.11.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.12.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.13.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.14.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.15.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.16.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.17.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.18.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.19.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.20.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.21.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer3.22.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.conv1.weight - torch.Size([512, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.downsample.0.weight - torch.Size([2048, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.downsample.1.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.0.downsample.1.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.conv1.weight - torch.Size([512, 2048, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.1.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.conv1.weight - torch.Size([512, 2048, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 backbone.layer4.2.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet101 head.deconv_layers.0.weight - torch.Size([2048, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.1.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.1.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.3.weight - torch.Size([256, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.4.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.4.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.6.weight - torch.Size([256, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.7.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.7.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.final_layer.weight - torch.Size([17, 256, 1, 1]): NormalInit: mean=0, std=0.001, bias=0 head.final_layer.bias - torch.Size([17]): NormalInit: mean=0, std=0.001, bias=0 2022/09/26 10:39:42 - mmengine - INFO - Checkpoints will be saved to /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384 by HardDiskBackend. 2022/09/26 10:40:25 - mmengine - INFO - Epoch(train) [1][50/293] lr: 4.954910e-05 eta: 14:32:43 time: 0.851718 data_time: 0.286941 memory: 20140 loss_kpt: 0.002124 acc_pose: 0.162897 loss: 0.002124 2022/09/26 10:40:51 - mmengine - INFO - Epoch(train) [1][100/293] lr: 9.959920e-05 eta: 11:44:21 time: 0.524207 data_time: 0.093074 memory: 20140 loss_kpt: 0.001632 acc_pose: 0.463481 loss: 0.001632 2022/09/26 10:41:19 - mmengine - INFO - Epoch(train) [1][150/293] lr: 1.496493e-04 eta: 11:01:34 time: 0.564169 data_time: 0.113997 memory: 20140 loss_kpt: 0.001361 acc_pose: 0.556963 loss: 0.001361 2022/09/26 10:41:46 - mmengine - INFO - Epoch(train) [1][200/293] lr: 1.996994e-04 eta: 10:32:22 time: 0.534558 data_time: 0.091781 memory: 20140 loss_kpt: 0.001241 acc_pose: 0.629633 loss: 0.001241 2022/09/26 10:42:16 - mmengine - INFO - Epoch(train) [1][250/293] lr: 2.497495e-04 eta: 10:26:06 time: 0.590504 data_time: 0.095272 memory: 20140 loss_kpt: 0.001183 acc_pose: 0.580950 loss: 0.001183 2022/09/26 10:42:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:43:08 - mmengine - INFO - Epoch(train) [2][50/293] lr: 3.428427e-04 eta: 8:57:29 time: 0.550476 data_time: 0.118128 memory: 20140 loss_kpt: 0.001111 acc_pose: 0.627685 loss: 0.001111 2022/09/26 10:43:35 - mmengine - INFO - Epoch(train) [2][100/293] lr: 3.928928e-04 eta: 8:57:44 time: 0.532424 data_time: 0.105000 memory: 20140 loss_kpt: 0.001090 acc_pose: 0.657710 loss: 0.001090 2022/09/26 10:44:01 - mmengine - INFO - Epoch(train) [2][150/293] lr: 4.429429e-04 eta: 8:56:51 time: 0.523811 data_time: 0.100517 memory: 20140 loss_kpt: 0.001074 acc_pose: 0.713843 loss: 0.001074 2022/09/26 10:44:28 - mmengine - INFO - Epoch(train) [2][200/293] lr: 4.929930e-04 eta: 8:57:18 time: 0.536016 data_time: 0.106955 memory: 20140 loss_kpt: 0.001067 acc_pose: 0.657035 loss: 0.001067 2022/09/26 10:44:54 - mmengine - INFO - Epoch(train) [2][250/293] lr: 5.000000e-04 eta: 8:57:34 time: 0.535718 data_time: 0.104766 memory: 20140 loss_kpt: 0.001057 acc_pose: 0.673971 loss: 0.001057 2022/09/26 10:45:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:45:43 - mmengine - INFO - Epoch(train) [3][50/293] lr: 5.000000e-04 eta: 8:20:35 time: 0.530529 data_time: 0.110567 memory: 20140 loss_kpt: 0.001007 acc_pose: 0.679511 loss: 0.001007 2022/09/26 10:46:09 - mmengine - INFO - Epoch(train) [3][100/293] lr: 5.000000e-04 eta: 8:22:55 time: 0.530387 data_time: 0.102997 memory: 20140 loss_kpt: 0.001007 acc_pose: 0.637376 loss: 0.001007 2022/09/26 10:46:35 - mmengine - INFO - Epoch(train) [3][150/293] lr: 5.000000e-04 eta: 8:24:19 time: 0.522277 data_time: 0.096014 memory: 20140 loss_kpt: 0.000996 acc_pose: 0.663184 loss: 0.000996 2022/09/26 10:47:02 - mmengine - INFO - Epoch(train) [3][200/293] lr: 5.000000e-04 eta: 8:26:16 time: 0.534493 data_time: 0.092176 memory: 20140 loss_kpt: 0.000978 acc_pose: 0.687457 loss: 0.000978 2022/09/26 10:47:28 - mmengine - INFO - Epoch(train) [3][250/293] lr: 5.000000e-04 eta: 8:27:19 time: 0.524123 data_time: 0.101134 memory: 20140 loss_kpt: 0.000949 acc_pose: 0.709479 loss: 0.000949 2022/09/26 10:47:50 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:48:19 - mmengine - INFO - Epoch(train) [4][50/293] lr: 5.000000e-04 eta: 8:06:51 time: 0.570672 data_time: 0.122982 memory: 20140 loss_kpt: 0.000930 acc_pose: 0.703814 loss: 0.000930 2022/09/26 10:48:45 - mmengine - INFO - Epoch(train) [4][100/293] lr: 5.000000e-04 eta: 8:08:49 time: 0.528116 data_time: 0.096298 memory: 20140 loss_kpt: 0.000934 acc_pose: 0.660885 loss: 0.000934 2022/09/26 10:48:56 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:49:11 - mmengine - INFO - Epoch(train) [4][150/293] lr: 5.000000e-04 eta: 8:09:36 time: 0.508433 data_time: 0.096727 memory: 20140 loss_kpt: 0.000937 acc_pose: 0.744092 loss: 0.000937 2022/09/26 10:49:38 - mmengine - INFO - Epoch(train) [4][200/293] lr: 5.000000e-04 eta: 8:11:35 time: 0.536842 data_time: 0.092316 memory: 20140 loss_kpt: 0.000941 acc_pose: 0.719004 loss: 0.000941 2022/09/26 10:50:03 - mmengine - INFO - Epoch(train) [4][250/293] lr: 5.000000e-04 eta: 8:12:20 time: 0.513798 data_time: 0.092986 memory: 20140 loss_kpt: 0.000915 acc_pose: 0.685554 loss: 0.000915 2022/09/26 10:50:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:50:52 - mmengine - INFO - Epoch(train) [5][50/293] lr: 5.000000e-04 eta: 7:56:22 time: 0.539802 data_time: 0.113043 memory: 20140 loss_kpt: 0.000933 acc_pose: 0.733464 loss: 0.000933 2022/09/26 10:51:19 - mmengine - INFO - Epoch(train) [5][100/293] lr: 5.000000e-04 eta: 7:58:31 time: 0.538586 data_time: 0.106980 memory: 20140 loss_kpt: 0.000903 acc_pose: 0.738280 loss: 0.000903 2022/09/26 10:51:46 - mmengine - INFO - Epoch(train) [5][150/293] lr: 5.000000e-04 eta: 8:00:28 time: 0.538078 data_time: 0.100520 memory: 20140 loss_kpt: 0.000896 acc_pose: 0.720464 loss: 0.000896 2022/09/26 10:52:13 - mmengine - INFO - Epoch(train) [5][200/293] lr: 5.000000e-04 eta: 8:01:55 time: 0.529580 data_time: 0.101616 memory: 20140 loss_kpt: 0.000906 acc_pose: 0.728876 loss: 0.000906 2022/09/26 10:52:40 - mmengine - INFO - Epoch(train) [5][250/293] lr: 5.000000e-04 eta: 8:03:35 time: 0.539320 data_time: 0.107354 memory: 20140 loss_kpt: 0.000894 acc_pose: 0.729962 loss: 0.000894 2022/09/26 10:53:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:53:29 - mmengine - INFO - Epoch(train) [6][50/293] lr: 5.000000e-04 eta: 7:51:14 time: 0.546428 data_time: 0.099247 memory: 20140 loss_kpt: 0.000875 acc_pose: 0.722793 loss: 0.000875 2022/09/26 10:53:56 - mmengine - INFO - Epoch(train) [6][100/293] lr: 5.000000e-04 eta: 7:53:01 time: 0.539275 data_time: 0.093516 memory: 20140 loss_kpt: 0.000862 acc_pose: 0.691166 loss: 0.000862 2022/09/26 10:54:22 - mmengine - INFO - Epoch(train) [6][150/293] lr: 5.000000e-04 eta: 7:54:04 time: 0.520099 data_time: 0.081678 memory: 20140 loss_kpt: 0.000886 acc_pose: 0.762505 loss: 0.000886 2022/09/26 10:54:48 - mmengine - INFO - Epoch(train) [6][200/293] lr: 5.000000e-04 eta: 7:54:43 time: 0.509513 data_time: 0.106272 memory: 20140 loss_kpt: 0.000870 acc_pose: 0.740036 loss: 0.000870 2022/09/26 10:55:15 - mmengine - INFO - Epoch(train) [6][250/293] lr: 5.000000e-04 eta: 7:56:30 time: 0.551000 data_time: 0.097369 memory: 20140 loss_kpt: 0.000863 acc_pose: 0.697531 loss: 0.000863 2022/09/26 10:55:38 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:56:05 - mmengine - INFO - Epoch(train) [7][50/293] lr: 5.000000e-04 eta: 7:46:18 time: 0.545095 data_time: 0.102649 memory: 20140 loss_kpt: 0.000869 acc_pose: 0.758692 loss: 0.000869 2022/09/26 10:56:32 - mmengine - INFO - Epoch(train) [7][100/293] lr: 5.000000e-04 eta: 7:47:56 time: 0.543960 data_time: 0.113054 memory: 20140 loss_kpt: 0.000837 acc_pose: 0.666746 loss: 0.000837 2022/09/26 10:56:59 - mmengine - INFO - Epoch(train) [7][150/293] lr: 5.000000e-04 eta: 7:49:12 time: 0.534349 data_time: 0.098729 memory: 20140 loss_kpt: 0.000858 acc_pose: 0.731708 loss: 0.000858 2022/09/26 10:57:25 - mmengine - INFO - Epoch(train) [7][200/293] lr: 5.000000e-04 eta: 7:50:05 time: 0.522799 data_time: 0.091932 memory: 20140 loss_kpt: 0.000843 acc_pose: 0.722811 loss: 0.000843 2022/09/26 10:57:46 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:57:50 - mmengine - INFO - Epoch(train) [7][250/293] lr: 5.000000e-04 eta: 7:50:23 time: 0.501643 data_time: 0.079401 memory: 20140 loss_kpt: 0.000834 acc_pose: 0.741616 loss: 0.000834 2022/09/26 10:58:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 10:58:40 - mmengine - INFO - Epoch(train) [8][50/293] lr: 5.000000e-04 eta: 7:41:50 time: 0.550177 data_time: 0.107558 memory: 20140 loss_kpt: 0.000835 acc_pose: 0.665253 loss: 0.000835 2022/09/26 10:59:07 - mmengine - INFO - Epoch(train) [8][100/293] lr: 5.000000e-04 eta: 7:43:03 time: 0.536275 data_time: 0.093901 memory: 20140 loss_kpt: 0.000847 acc_pose: 0.745403 loss: 0.000847 2022/09/26 10:59:33 - mmengine - INFO - Epoch(train) [8][150/293] lr: 5.000000e-04 eta: 7:44:00 time: 0.527528 data_time: 0.094303 memory: 20140 loss_kpt: 0.000833 acc_pose: 0.680217 loss: 0.000833 2022/09/26 11:00:00 - mmengine - INFO - Epoch(train) [8][200/293] lr: 5.000000e-04 eta: 7:44:59 time: 0.531733 data_time: 0.101156 memory: 20140 loss_kpt: 0.000842 acc_pose: 0.695470 loss: 0.000842 2022/09/26 11:00:31 - mmengine - INFO - Epoch(train) [8][250/293] lr: 5.000000e-04 eta: 7:47:41 time: 0.614897 data_time: 0.100745 memory: 20140 loss_kpt: 0.000833 acc_pose: 0.734123 loss: 0.000833 2022/09/26 11:00:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:01:21 - mmengine - INFO - Epoch(train) [9][50/293] lr: 5.000000e-04 eta: 7:40:28 time: 0.566611 data_time: 0.102214 memory: 20140 loss_kpt: 0.000817 acc_pose: 0.721025 loss: 0.000817 2022/09/26 11:01:47 - mmengine - INFO - Epoch(train) [9][100/293] lr: 5.000000e-04 eta: 7:41:13 time: 0.523293 data_time: 0.111373 memory: 20140 loss_kpt: 0.000829 acc_pose: 0.749659 loss: 0.000829 2022/09/26 11:02:14 - mmengine - INFO - Epoch(train) [9][150/293] lr: 5.000000e-04 eta: 7:42:06 time: 0.533409 data_time: 0.098339 memory: 20140 loss_kpt: 0.000826 acc_pose: 0.661309 loss: 0.000826 2022/09/26 11:02:40 - mmengine - INFO - Epoch(train) [9][200/293] lr: 5.000000e-04 eta: 7:42:46 time: 0.523769 data_time: 0.094386 memory: 20140 loss_kpt: 0.000814 acc_pose: 0.751219 loss: 0.000814 2022/09/26 11:03:06 - mmengine - INFO - Epoch(train) [9][250/293] lr: 5.000000e-04 eta: 7:43:07 time: 0.509808 data_time: 0.100978 memory: 20140 loss_kpt: 0.000798 acc_pose: 0.759210 loss: 0.000798 2022/09/26 11:05:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:05:37 - mmengine - INFO - Epoch(train) [10][50/293] lr: 5.000000e-04 eta: 7:37:13 time: 0.593796 data_time: 0.114882 memory: 20140 loss_kpt: 0.000806 acc_pose: 0.765261 loss: 0.000806 2022/09/26 11:06:03 - mmengine - INFO - Epoch(train) [10][100/293] lr: 5.000000e-04 eta: 7:37:49 time: 0.521663 data_time: 0.100596 memory: 20140 loss_kpt: 0.000802 acc_pose: 0.701801 loss: 0.000802 2022/09/26 11:06:29 - mmengine - INFO - Epoch(train) [10][150/293] lr: 5.000000e-04 eta: 7:38:19 time: 0.517663 data_time: 0.090373 memory: 20140 loss_kpt: 0.000801 acc_pose: 0.792093 loss: 0.000801 2022/09/26 11:06:56 - mmengine - INFO - Epoch(train) [10][200/293] lr: 5.000000e-04 eta: 7:39:09 time: 0.539830 data_time: 0.102139 memory: 20140 loss_kpt: 0.000800 acc_pose: 0.805304 loss: 0.000800 2022/09/26 11:07:22 - mmengine - INFO - Epoch(train) [10][250/293] lr: 5.000000e-04 eta: 7:39:40 time: 0.522928 data_time: 0.094602 memory: 20140 loss_kpt: 0.000812 acc_pose: 0.705884 loss: 0.000812 2022/09/26 11:07:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:07:44 - mmengine - INFO - Saving checkpoint at 10 epochs 2022/09/26 11:08:03 - mmengine - INFO - Epoch(val) [10][50/407] eta: 0:01:47 time: 0.302476 data_time: 0.145236 memory: 20140 2022/09/26 11:08:11 - mmengine - INFO - Epoch(val) [10][100/407] eta: 0:00:50 time: 0.166093 data_time: 0.011560 memory: 1830 2022/09/26 11:08:19 - mmengine - INFO - Epoch(val) [10][150/407] eta: 0:00:43 time: 0.167797 data_time: 0.012443 memory: 1830 2022/09/26 11:08:28 - mmengine - INFO - Epoch(val) [10][200/407] eta: 0:00:35 time: 0.172081 data_time: 0.019296 memory: 1830 2022/09/26 11:08:37 - mmengine - INFO - Epoch(val) [10][250/407] eta: 0:00:27 time: 0.173398 data_time: 0.018935 memory: 1830 2022/09/26 11:08:45 - mmengine - INFO - Epoch(val) [10][300/407] eta: 0:00:18 time: 0.173078 data_time: 0.010980 memory: 1830 2022/09/26 11:08:54 - mmengine - INFO - Epoch(val) [10][350/407] eta: 0:00:09 time: 0.170172 data_time: 0.016075 memory: 1830 2022/09/26 11:09:03 - mmengine - INFO - Epoch(val) [10][400/407] eta: 0:00:01 time: 0.173339 data_time: 0.016275 memory: 1830 2022/09/26 11:09:38 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 11:09:51 - mmengine - INFO - Epoch(val) [10][407/407] coco/AP: 0.659414 coco/AP .5: 0.870470 coco/AP .75: 0.728697 coco/AP (M): 0.615774 coco/AP (L): 0.731774 coco/AR: 0.714830 coco/AR .5: 0.909320 coco/AR .75: 0.778180 coco/AR (M): 0.666785 coco/AR (L): 0.783538 2022/09/26 11:09:54 - mmengine - INFO - The best checkpoint with 0.6594 coco/AP at 10 epoch is saved to best_coco/AP_epoch_10.pth. 2022/09/26 11:10:20 - mmengine - INFO - Epoch(train) [11][50/293] lr: 5.000000e-04 eta: 7:33:16 time: 0.527653 data_time: 0.099129 memory: 20140 loss_kpt: 0.000792 acc_pose: 0.728859 loss: 0.000792 2022/09/26 11:10:30 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:10:46 - mmengine - INFO - Epoch(train) [11][100/293] lr: 5.000000e-04 eta: 7:33:43 time: 0.517069 data_time: 0.075299 memory: 20140 loss_kpt: 0.000788 acc_pose: 0.737208 loss: 0.000788 2022/09/26 11:11:12 - mmengine - INFO - Epoch(train) [11][150/293] lr: 5.000000e-04 eta: 7:34:07 time: 0.515298 data_time: 0.092858 memory: 20140 loss_kpt: 0.000775 acc_pose: 0.746625 loss: 0.000775 2022/09/26 11:11:37 - mmengine - INFO - Epoch(train) [11][200/293] lr: 5.000000e-04 eta: 7:34:30 time: 0.515909 data_time: 0.081919 memory: 20140 loss_kpt: 0.000788 acc_pose: 0.788180 loss: 0.000788 2022/09/26 11:12:04 - mmengine - INFO - Epoch(train) [11][250/293] lr: 5.000000e-04 eta: 7:34:58 time: 0.522916 data_time: 0.095653 memory: 20140 loss_kpt: 0.000793 acc_pose: 0.731247 loss: 0.000793 2022/09/26 11:12:26 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:13:00 - mmengine - INFO - Epoch(train) [12][50/293] lr: 5.000000e-04 eta: 7:31:26 time: 0.680504 data_time: 0.123112 memory: 20140 loss_kpt: 0.000791 acc_pose: 0.822385 loss: 0.000791 2022/09/26 11:13:26 - mmengine - INFO - Epoch(train) [12][100/293] lr: 5.000000e-04 eta: 7:31:51 time: 0.520500 data_time: 0.095694 memory: 20140 loss_kpt: 0.000788 acc_pose: 0.773428 loss: 0.000788 2022/09/26 11:13:53 - mmengine - INFO - Epoch(train) [12][150/293] lr: 5.000000e-04 eta: 7:32:24 time: 0.530268 data_time: 0.096377 memory: 20140 loss_kpt: 0.000789 acc_pose: 0.752154 loss: 0.000789 2022/09/26 11:14:20 - mmengine - INFO - Epoch(train) [12][200/293] lr: 5.000000e-04 eta: 7:32:57 time: 0.533386 data_time: 0.101468 memory: 20140 loss_kpt: 0.000776 acc_pose: 0.745105 loss: 0.000776 2022/09/26 11:14:45 - mmengine - INFO - Epoch(train) [12][250/293] lr: 5.000000e-04 eta: 7:33:09 time: 0.510057 data_time: 0.092769 memory: 20140 loss_kpt: 0.000801 acc_pose: 0.782291 loss: 0.000801 2022/09/26 11:15:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:15:35 - mmengine - INFO - Epoch(train) [13][50/293] lr: 5.000000e-04 eta: 7:28:07 time: 0.553379 data_time: 0.105921 memory: 20140 loss_kpt: 0.000775 acc_pose: 0.733224 loss: 0.000775 2022/09/26 11:16:01 - mmengine - INFO - Epoch(train) [13][100/293] lr: 5.000000e-04 eta: 7:28:25 time: 0.514469 data_time: 0.105900 memory: 20140 loss_kpt: 0.000764 acc_pose: 0.779328 loss: 0.000764 2022/09/26 11:16:27 - mmengine - INFO - Epoch(train) [13][150/293] lr: 5.000000e-04 eta: 7:28:50 time: 0.526542 data_time: 0.102357 memory: 20140 loss_kpt: 0.000780 acc_pose: 0.715449 loss: 0.000780 2022/09/26 11:16:54 - mmengine - INFO - Epoch(train) [13][200/293] lr: 5.000000e-04 eta: 7:29:14 time: 0.525636 data_time: 0.091349 memory: 20140 loss_kpt: 0.000775 acc_pose: 0.734665 loss: 0.000775 2022/09/26 11:17:21 - mmengine - INFO - Epoch(train) [13][250/293] lr: 5.000000e-04 eta: 7:29:48 time: 0.541213 data_time: 0.091375 memory: 20140 loss_kpt: 0.000761 acc_pose: 0.747476 loss: 0.000761 2022/09/26 11:17:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:18:10 - mmengine - INFO - Epoch(train) [14][50/293] lr: 5.000000e-04 eta: 7:25:01 time: 0.542713 data_time: 0.116340 memory: 20140 loss_kpt: 0.000773 acc_pose: 0.706923 loss: 0.000773 2022/09/26 11:18:37 - mmengine - INFO - Epoch(train) [14][100/293] lr: 5.000000e-04 eta: 7:25:35 time: 0.540457 data_time: 0.089670 memory: 20140 loss_kpt: 0.000778 acc_pose: 0.770980 loss: 0.000778 2022/09/26 11:19:03 - mmengine - INFO - Epoch(train) [14][150/293] lr: 5.000000e-04 eta: 7:25:49 time: 0.515398 data_time: 0.082358 memory: 20140 loss_kpt: 0.000759 acc_pose: 0.693719 loss: 0.000759 2022/09/26 11:19:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:19:30 - mmengine - INFO - Epoch(train) [14][200/293] lr: 5.000000e-04 eta: 7:26:19 time: 0.538594 data_time: 0.090870 memory: 20140 loss_kpt: 0.000762 acc_pose: 0.707508 loss: 0.000762 2022/09/26 11:19:57 - mmengine - INFO - Epoch(train) [14][250/293] lr: 5.000000e-04 eta: 7:26:53 time: 0.546760 data_time: 0.099910 memory: 20140 loss_kpt: 0.000768 acc_pose: 0.764514 loss: 0.000768 2022/09/26 11:20:20 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:20:52 - mmengine - INFO - Epoch(train) [15][50/293] lr: 5.000000e-04 eta: 7:23:29 time: 0.635346 data_time: 0.131064 memory: 20140 loss_kpt: 0.000751 acc_pose: 0.796324 loss: 0.000751 2022/09/26 11:21:18 - mmengine - INFO - Epoch(train) [15][100/293] lr: 5.000000e-04 eta: 7:23:47 time: 0.523751 data_time: 0.098205 memory: 20140 loss_kpt: 0.000754 acc_pose: 0.758794 loss: 0.000754 2022/09/26 11:21:45 - mmengine - INFO - Epoch(train) [15][150/293] lr: 5.000000e-04 eta: 7:24:15 time: 0.541378 data_time: 0.104480 memory: 20140 loss_kpt: 0.000764 acc_pose: 0.728939 loss: 0.000764 2022/09/26 11:22:10 - mmengine - INFO - Epoch(train) [15][200/293] lr: 5.000000e-04 eta: 7:24:20 time: 0.507017 data_time: 0.084492 memory: 20140 loss_kpt: 0.000757 acc_pose: 0.789783 loss: 0.000757 2022/09/26 11:22:36 - mmengine - INFO - Epoch(train) [15][250/293] lr: 5.000000e-04 eta: 7:24:26 time: 0.511654 data_time: 0.089627 memory: 20140 loss_kpt: 0.000755 acc_pose: 0.755248 loss: 0.000755 2022/09/26 11:22:59 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:23:27 - mmengine - INFO - Epoch(train) [16][50/293] lr: 5.000000e-04 eta: 7:20:20 time: 0.550655 data_time: 0.098172 memory: 20140 loss_kpt: 0.000767 acc_pose: 0.779222 loss: 0.000767 2022/09/26 11:23:53 - mmengine - INFO - Epoch(train) [16][100/293] lr: 5.000000e-04 eta: 7:20:33 time: 0.520680 data_time: 0.101616 memory: 20140 loss_kpt: 0.000750 acc_pose: 0.808359 loss: 0.000750 2022/09/26 11:24:21 - mmengine - INFO - Epoch(train) [16][150/293] lr: 5.000000e-04 eta: 7:21:17 time: 0.569875 data_time: 0.104380 memory: 20140 loss_kpt: 0.000757 acc_pose: 0.749963 loss: 0.000757 2022/09/26 11:24:47 - mmengine - INFO - Epoch(train) [16][200/293] lr: 5.000000e-04 eta: 7:21:25 time: 0.515186 data_time: 0.096306 memory: 20140 loss_kpt: 0.000750 acc_pose: 0.783114 loss: 0.000750 2022/09/26 11:25:12 - mmengine - INFO - Epoch(train) [16][250/293] lr: 5.000000e-04 eta: 7:21:30 time: 0.511812 data_time: 0.087800 memory: 20140 loss_kpt: 0.000744 acc_pose: 0.749364 loss: 0.000744 2022/09/26 11:25:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:26:03 - mmengine - INFO - Epoch(train) [17][50/293] lr: 5.000000e-04 eta: 7:17:31 time: 0.538900 data_time: 0.103059 memory: 20140 loss_kpt: 0.000735 acc_pose: 0.794555 loss: 0.000735 2022/09/26 11:26:29 - mmengine - INFO - Epoch(train) [17][100/293] lr: 5.000000e-04 eta: 7:17:34 time: 0.506486 data_time: 0.085213 memory: 20140 loss_kpt: 0.000740 acc_pose: 0.769898 loss: 0.000740 2022/09/26 11:26:54 - mmengine - INFO - Epoch(train) [17][150/293] lr: 5.000000e-04 eta: 7:17:44 time: 0.519285 data_time: 0.094481 memory: 20140 loss_kpt: 0.000757 acc_pose: 0.771102 loss: 0.000757 2022/09/26 11:27:21 - mmengine - INFO - Epoch(train) [17][200/293] lr: 5.000000e-04 eta: 7:18:01 time: 0.533602 data_time: 0.097237 memory: 20140 loss_kpt: 0.000752 acc_pose: 0.782943 loss: 0.000752 2022/09/26 11:27:50 - mmengine - INFO - Epoch(train) [17][250/293] lr: 5.000000e-04 eta: 7:18:40 time: 0.571812 data_time: 0.107581 memory: 20140 loss_kpt: 0.000729 acc_pose: 0.840936 loss: 0.000729 2022/09/26 11:28:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:28:22 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:28:39 - mmengine - INFO - Epoch(train) [18][50/293] lr: 5.000000e-04 eta: 7:14:53 time: 0.537619 data_time: 0.103346 memory: 20140 loss_kpt: 0.000738 acc_pose: 0.806410 loss: 0.000738 2022/09/26 11:29:04 - mmengine - INFO - Epoch(train) [18][100/293] lr: 5.000000e-04 eta: 7:15:00 time: 0.516136 data_time: 0.089291 memory: 20140 loss_kpt: 0.000739 acc_pose: 0.780476 loss: 0.000739 2022/09/26 11:29:30 - mmengine - INFO - Epoch(train) [18][150/293] lr: 5.000000e-04 eta: 7:15:03 time: 0.509300 data_time: 0.084518 memory: 20140 loss_kpt: 0.000742 acc_pose: 0.788874 loss: 0.000742 2022/09/26 11:29:56 - mmengine - INFO - Epoch(train) [18][200/293] lr: 5.000000e-04 eta: 7:15:13 time: 0.523931 data_time: 0.091116 memory: 20140 loss_kpt: 0.000742 acc_pose: 0.807433 loss: 0.000742 2022/09/26 11:30:22 - mmengine - INFO - Epoch(train) [18][250/293] lr: 5.000000e-04 eta: 7:15:21 time: 0.522297 data_time: 0.108101 memory: 20140 loss_kpt: 0.000746 acc_pose: 0.806500 loss: 0.000746 2022/09/26 11:30:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:31:17 - mmengine - INFO - Epoch(train) [19][50/293] lr: 5.000000e-04 eta: 7:12:46 time: 0.651339 data_time: 0.118123 memory: 20140 loss_kpt: 0.000723 acc_pose: 0.731267 loss: 0.000723 2022/09/26 11:31:43 - mmengine - INFO - Epoch(train) [19][100/293] lr: 5.000000e-04 eta: 7:12:51 time: 0.516106 data_time: 0.095227 memory: 20140 loss_kpt: 0.000721 acc_pose: 0.769451 loss: 0.000721 2022/09/26 11:32:09 - mmengine - INFO - Epoch(train) [19][150/293] lr: 5.000000e-04 eta: 7:12:57 time: 0.518452 data_time: 0.098010 memory: 20140 loss_kpt: 0.000723 acc_pose: 0.732295 loss: 0.000723 2022/09/26 11:32:35 - mmengine - INFO - Epoch(train) [19][200/293] lr: 5.000000e-04 eta: 7:13:10 time: 0.532422 data_time: 0.095124 memory: 20140 loss_kpt: 0.000739 acc_pose: 0.782435 loss: 0.000739 2022/09/26 11:33:01 - mmengine - INFO - Epoch(train) [19][250/293] lr: 5.000000e-04 eta: 7:13:09 time: 0.508914 data_time: 0.092621 memory: 20140 loss_kpt: 0.000732 acc_pose: 0.750313 loss: 0.000732 2022/09/26 11:33:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:33:51 - mmengine - INFO - Epoch(train) [20][50/293] lr: 5.000000e-04 eta: 7:09:45 time: 0.538590 data_time: 0.110102 memory: 20140 loss_kpt: 0.000724 acc_pose: 0.772750 loss: 0.000724 2022/09/26 11:34:17 - mmengine - INFO - Epoch(train) [20][100/293] lr: 5.000000e-04 eta: 7:09:54 time: 0.526238 data_time: 0.087427 memory: 20140 loss_kpt: 0.000735 acc_pose: 0.712507 loss: 0.000735 2022/09/26 11:34:44 - mmengine - INFO - Epoch(train) [20][150/293] lr: 5.000000e-04 eta: 7:10:03 time: 0.527622 data_time: 0.097307 memory: 20140 loss_kpt: 0.000719 acc_pose: 0.771841 loss: 0.000719 2022/09/26 11:35:09 - mmengine - INFO - Epoch(train) [20][200/293] lr: 5.000000e-04 eta: 7:10:07 time: 0.519172 data_time: 0.101559 memory: 20140 loss_kpt: 0.000713 acc_pose: 0.770098 loss: 0.000713 2022/09/26 11:35:36 - mmengine - INFO - Epoch(train) [20][250/293] lr: 5.000000e-04 eta: 7:10:12 time: 0.521880 data_time: 0.087255 memory: 20140 loss_kpt: 0.000732 acc_pose: 0.718748 loss: 0.000732 2022/09/26 11:35:58 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:35:58 - mmengine - INFO - Saving checkpoint at 20 epochs 2022/09/26 11:36:12 - mmengine - INFO - Epoch(val) [20][50/407] eta: 0:01:06 time: 0.186870 data_time: 0.029264 memory: 20140 2022/09/26 11:36:21 - mmengine - INFO - Epoch(val) [20][100/407] eta: 0:00:55 time: 0.181521 data_time: 0.025021 memory: 1830 2022/09/26 11:36:30 - mmengine - INFO - Epoch(val) [20][150/407] eta: 0:00:43 time: 0.170125 data_time: 0.010442 memory: 1830 2022/09/26 11:36:38 - mmengine - INFO - Epoch(val) [20][200/407] eta: 0:00:35 time: 0.172076 data_time: 0.015740 memory: 1830 2022/09/26 11:36:47 - mmengine - INFO - Epoch(val) [20][250/407] eta: 0:00:26 time: 0.170084 data_time: 0.011847 memory: 1830 2022/09/26 11:36:55 - mmengine - INFO - Epoch(val) [20][300/407] eta: 0:00:17 time: 0.167046 data_time: 0.011719 memory: 1830 2022/09/26 11:37:04 - mmengine - INFO - Epoch(val) [20][350/407] eta: 0:00:09 time: 0.167616 data_time: 0.014076 memory: 1830 2022/09/26 11:37:12 - mmengine - INFO - Epoch(val) [20][400/407] eta: 0:00:01 time: 0.163683 data_time: 0.012699 memory: 1830 2022/09/26 11:37:44 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 11:37:57 - mmengine - INFO - Epoch(val) [20][407/407] coco/AP: 0.681691 coco/AP .5: 0.874799 coco/AP .75: 0.745017 coco/AP (M): 0.638647 coco/AP (L): 0.757847 coco/AR: 0.740192 coco/AR .5: 0.919081 coco/AR .75: 0.797859 coco/AR (M): 0.692133 coco/AR (L): 0.808844 2022/09/26 11:37:57 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_10.pth is removed 2022/09/26 11:37:59 - mmengine - INFO - The best checkpoint with 0.6817 coco/AP at 20 epoch is saved to best_coco/AP_epoch_20.pth. 2022/09/26 11:38:28 - mmengine - INFO - Epoch(train) [21][50/293] lr: 5.000000e-04 eta: 7:07:08 time: 0.561744 data_time: 0.114854 memory: 20140 loss_kpt: 0.000718 acc_pose: 0.800218 loss: 0.000718 2022/09/26 11:38:54 - mmengine - INFO - Epoch(train) [21][100/293] lr: 5.000000e-04 eta: 7:07:15 time: 0.524078 data_time: 0.095125 memory: 20140 loss_kpt: 0.000717 acc_pose: 0.761403 loss: 0.000717 2022/09/26 11:39:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:39:21 - mmengine - INFO - Epoch(train) [21][150/293] lr: 5.000000e-04 eta: 7:07:28 time: 0.541233 data_time: 0.102213 memory: 20140 loss_kpt: 0.000731 acc_pose: 0.805631 loss: 0.000731 2022/09/26 11:39:47 - mmengine - INFO - Epoch(train) [21][200/293] lr: 5.000000e-04 eta: 7:07:36 time: 0.529480 data_time: 0.101430 memory: 20140 loss_kpt: 0.000734 acc_pose: 0.773772 loss: 0.000734 2022/09/26 11:40:14 - mmengine - INFO - Epoch(train) [21][250/293] lr: 5.000000e-04 eta: 7:07:46 time: 0.535783 data_time: 0.090927 memory: 20140 loss_kpt: 0.000727 acc_pose: 0.780019 loss: 0.000727 2022/09/26 11:40:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:41:06 - mmengine - INFO - Epoch(train) [22][50/293] lr: 5.000000e-04 eta: 7:04:51 time: 0.564006 data_time: 0.123320 memory: 20140 loss_kpt: 0.000726 acc_pose: 0.750681 loss: 0.000726 2022/09/26 11:41:31 - mmengine - INFO - Epoch(train) [22][100/293] lr: 5.000000e-04 eta: 7:04:51 time: 0.514646 data_time: 0.102397 memory: 20140 loss_kpt: 0.000720 acc_pose: 0.759928 loss: 0.000720 2022/09/26 11:42:03 - mmengine - INFO - Epoch(train) [22][150/293] lr: 5.000000e-04 eta: 7:05:46 time: 0.638747 data_time: 0.106245 memory: 20140 loss_kpt: 0.000721 acc_pose: 0.791803 loss: 0.000721 2022/09/26 11:42:30 - mmengine - INFO - Epoch(train) [22][200/293] lr: 5.000000e-04 eta: 7:05:50 time: 0.524553 data_time: 0.100401 memory: 20140 loss_kpt: 0.000714 acc_pose: 0.775721 loss: 0.000714 2022/09/26 11:42:56 - mmengine - INFO - Epoch(train) [22][250/293] lr: 5.000000e-04 eta: 7:05:51 time: 0.519140 data_time: 0.087902 memory: 20140 loss_kpt: 0.000697 acc_pose: 0.829251 loss: 0.000697 2022/09/26 11:43:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:43:45 - mmengine - INFO - Epoch(train) [23][50/293] lr: 5.000000e-04 eta: 7:02:54 time: 0.545272 data_time: 0.107315 memory: 20140 loss_kpt: 0.000721 acc_pose: 0.770133 loss: 0.000721 2022/09/26 11:44:11 - mmengine - INFO - Epoch(train) [23][100/293] lr: 5.000000e-04 eta: 7:02:55 time: 0.519776 data_time: 0.087071 memory: 20140 loss_kpt: 0.000720 acc_pose: 0.768975 loss: 0.000720 2022/09/26 11:44:38 - mmengine - INFO - Epoch(train) [23][150/293] lr: 5.000000e-04 eta: 7:03:01 time: 0.530543 data_time: 0.103771 memory: 20140 loss_kpt: 0.000699 acc_pose: 0.791570 loss: 0.000699 2022/09/26 11:45:05 - mmengine - INFO - Epoch(train) [23][200/293] lr: 5.000000e-04 eta: 7:03:09 time: 0.536639 data_time: 0.096653 memory: 20140 loss_kpt: 0.000710 acc_pose: 0.840555 loss: 0.000710 2022/09/26 11:45:31 - mmengine - INFO - Epoch(train) [23][250/293] lr: 5.000000e-04 eta: 7:03:11 time: 0.526013 data_time: 0.101971 memory: 20140 loss_kpt: 0.000718 acc_pose: 0.801473 loss: 0.000718 2022/09/26 11:45:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:46:20 - mmengine - INFO - Epoch(train) [24][50/293] lr: 5.000000e-04 eta: 7:00:18 time: 0.538852 data_time: 0.100524 memory: 20140 loss_kpt: 0.000698 acc_pose: 0.774022 loss: 0.000698 2022/09/26 11:46:46 - mmengine - INFO - Epoch(train) [24][100/293] lr: 5.000000e-04 eta: 7:00:19 time: 0.519414 data_time: 0.087090 memory: 20140 loss_kpt: 0.000698 acc_pose: 0.815195 loss: 0.000698 2022/09/26 11:47:11 - mmengine - INFO - Epoch(train) [24][150/293] lr: 5.000000e-04 eta: 7:00:11 time: 0.500294 data_time: 0.087422 memory: 20140 loss_kpt: 0.000706 acc_pose: 0.737845 loss: 0.000706 2022/09/26 11:47:38 - mmengine - INFO - Epoch(train) [24][200/293] lr: 5.000000e-04 eta: 7:00:19 time: 0.539015 data_time: 0.098287 memory: 20140 loss_kpt: 0.000714 acc_pose: 0.748709 loss: 0.000714 2022/09/26 11:48:04 - mmengine - INFO - Epoch(train) [24][250/293] lr: 5.000000e-04 eta: 7:00:17 time: 0.515740 data_time: 0.105546 memory: 20140 loss_kpt: 0.000705 acc_pose: 0.779645 loss: 0.000705 2022/09/26 11:48:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:48:26 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:48:53 - mmengine - INFO - Epoch(train) [25][50/293] lr: 5.000000e-04 eta: 6:57:28 time: 0.532414 data_time: 0.114492 memory: 20140 loss_kpt: 0.000716 acc_pose: 0.745263 loss: 0.000716 2022/09/26 11:49:19 - mmengine - INFO - Epoch(train) [25][100/293] lr: 5.000000e-04 eta: 6:57:32 time: 0.531361 data_time: 0.110027 memory: 20140 loss_kpt: 0.000696 acc_pose: 0.808493 loss: 0.000696 2022/09/26 11:49:50 - mmengine - INFO - Epoch(train) [25][150/293] lr: 5.000000e-04 eta: 6:58:06 time: 0.612658 data_time: 0.142445 memory: 20140 loss_kpt: 0.000703 acc_pose: 0.796619 loss: 0.000703 2022/09/26 11:50:16 - mmengine - INFO - Epoch(train) [25][200/293] lr: 5.000000e-04 eta: 6:58:05 time: 0.520493 data_time: 0.093675 memory: 20140 loss_kpt: 0.000697 acc_pose: 0.772297 loss: 0.000697 2022/09/26 11:50:42 - mmengine - INFO - Epoch(train) [25][250/293] lr: 5.000000e-04 eta: 6:58:02 time: 0.515705 data_time: 0.105416 memory: 20140 loss_kpt: 0.000736 acc_pose: 0.760228 loss: 0.000736 2022/09/26 11:51:05 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:51:33 - mmengine - INFO - Epoch(train) [26][50/293] lr: 5.000000e-04 eta: 6:55:29 time: 0.559559 data_time: 0.108752 memory: 20140 loss_kpt: 0.000688 acc_pose: 0.790870 loss: 0.000688 2022/09/26 11:51:59 - mmengine - INFO - Epoch(train) [26][100/293] lr: 5.000000e-04 eta: 6:55:35 time: 0.538804 data_time: 0.094493 memory: 20140 loss_kpt: 0.000701 acc_pose: 0.750779 loss: 0.000701 2022/09/26 11:52:26 - mmengine - INFO - Epoch(train) [26][150/293] lr: 5.000000e-04 eta: 6:55:36 time: 0.527622 data_time: 0.102632 memory: 20140 loss_kpt: 0.000717 acc_pose: 0.815567 loss: 0.000717 2022/09/26 11:52:52 - mmengine - INFO - Epoch(train) [26][200/293] lr: 5.000000e-04 eta: 6:55:33 time: 0.518418 data_time: 0.092923 memory: 20140 loss_kpt: 0.000707 acc_pose: 0.824984 loss: 0.000707 2022/09/26 11:53:20 - mmengine - INFO - Epoch(train) [26][250/293] lr: 5.000000e-04 eta: 6:55:44 time: 0.558127 data_time: 0.110623 memory: 20140 loss_kpt: 0.000692 acc_pose: 0.791915 loss: 0.000692 2022/09/26 11:53:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:54:09 - mmengine - INFO - Epoch(train) [27][50/293] lr: 5.000000e-04 eta: 6:53:06 time: 0.532737 data_time: 0.099109 memory: 20140 loss_kpt: 0.000695 acc_pose: 0.787350 loss: 0.000695 2022/09/26 11:54:37 - mmengine - INFO - Epoch(train) [27][100/293] lr: 5.000000e-04 eta: 6:53:16 time: 0.553704 data_time: 0.091332 memory: 20140 loss_kpt: 0.000704 acc_pose: 0.783123 loss: 0.000704 2022/09/26 11:55:04 - mmengine - INFO - Epoch(train) [27][150/293] lr: 5.000000e-04 eta: 6:53:18 time: 0.534310 data_time: 0.096432 memory: 20140 loss_kpt: 0.000690 acc_pose: 0.790988 loss: 0.000690 2022/09/26 11:55:31 - mmengine - INFO - Epoch(train) [27][200/293] lr: 5.000000e-04 eta: 6:53:22 time: 0.539576 data_time: 0.095937 memory: 20140 loss_kpt: 0.000688 acc_pose: 0.814201 loss: 0.000688 2022/09/26 11:56:14 - mmengine - INFO - Epoch(train) [27][250/293] lr: 5.000000e-04 eta: 6:55:20 time: 0.873355 data_time: 0.186501 memory: 20140 loss_kpt: 0.000703 acc_pose: 0.787263 loss: 0.000703 2022/09/26 11:56:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:57:04 - mmengine - INFO - Epoch(train) [28][50/293] lr: 5.000000e-04 eta: 6:52:56 time: 0.565238 data_time: 0.102386 memory: 20140 loss_kpt: 0.000685 acc_pose: 0.806654 loss: 0.000685 2022/09/26 11:57:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:57:30 - mmengine - INFO - Epoch(train) [28][100/293] lr: 5.000000e-04 eta: 6:52:55 time: 0.529990 data_time: 0.106883 memory: 20140 loss_kpt: 0.000694 acc_pose: 0.794016 loss: 0.000694 2022/09/26 11:57:57 - mmengine - INFO - Epoch(train) [28][150/293] lr: 5.000000e-04 eta: 6:52:57 time: 0.537208 data_time: 0.092602 memory: 20140 loss_kpt: 0.000685 acc_pose: 0.793397 loss: 0.000685 2022/09/26 11:58:24 - mmengine - INFO - Epoch(train) [28][200/293] lr: 5.000000e-04 eta: 6:52:56 time: 0.532363 data_time: 0.094646 memory: 20140 loss_kpt: 0.000703 acc_pose: 0.729000 loss: 0.000703 2022/09/26 11:58:50 - mmengine - INFO - Epoch(train) [28][250/293] lr: 5.000000e-04 eta: 6:52:53 time: 0.523188 data_time: 0.087179 memory: 20140 loss_kpt: 0.000706 acc_pose: 0.807981 loss: 0.000706 2022/09/26 11:59:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 11:59:39 - mmengine - INFO - Epoch(train) [29][50/293] lr: 5.000000e-04 eta: 6:50:28 time: 0.548006 data_time: 0.114038 memory: 20140 loss_kpt: 0.000669 acc_pose: 0.779680 loss: 0.000669 2022/09/26 12:00:09 - mmengine - INFO - Epoch(train) [29][100/293] lr: 5.000000e-04 eta: 6:50:44 time: 0.584016 data_time: 0.108573 memory: 20140 loss_kpt: 0.000684 acc_pose: 0.749780 loss: 0.000684 2022/09/26 12:00:36 - mmengine - INFO - Epoch(train) [29][150/293] lr: 5.000000e-04 eta: 6:50:43 time: 0.535668 data_time: 0.099667 memory: 20140 loss_kpt: 0.000690 acc_pose: 0.804690 loss: 0.000690 2022/09/26 12:01:02 - mmengine - INFO - Epoch(train) [29][200/293] lr: 5.000000e-04 eta: 6:50:43 time: 0.533806 data_time: 0.097552 memory: 20140 loss_kpt: 0.000683 acc_pose: 0.795983 loss: 0.000683 2022/09/26 12:01:29 - mmengine - INFO - Epoch(train) [29][250/293] lr: 5.000000e-04 eta: 6:50:40 time: 0.529376 data_time: 0.104661 memory: 20140 loss_kpt: 0.000694 acc_pose: 0.757232 loss: 0.000694 2022/09/26 12:01:51 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:02:18 - mmengine - INFO - Epoch(train) [30][50/293] lr: 5.000000e-04 eta: 6:48:18 time: 0.543903 data_time: 0.109679 memory: 20140 loss_kpt: 0.000682 acc_pose: 0.847445 loss: 0.000682 2022/09/26 12:02:44 - mmengine - INFO - Epoch(train) [30][100/293] lr: 5.000000e-04 eta: 6:48:10 time: 0.513770 data_time: 0.095038 memory: 20140 loss_kpt: 0.000679 acc_pose: 0.837403 loss: 0.000679 2022/09/26 12:03:10 - mmengine - INFO - Epoch(train) [30][150/293] lr: 5.000000e-04 eta: 6:48:06 time: 0.524940 data_time: 0.095085 memory: 20140 loss_kpt: 0.000686 acc_pose: 0.767760 loss: 0.000686 2022/09/26 12:03:36 - mmengine - INFO - Epoch(train) [30][200/293] lr: 5.000000e-04 eta: 6:48:02 time: 0.526075 data_time: 0.086558 memory: 20140 loss_kpt: 0.000689 acc_pose: 0.762145 loss: 0.000689 2022/09/26 12:04:03 - mmengine - INFO - Epoch(train) [30][250/293] lr: 5.000000e-04 eta: 6:48:01 time: 0.537451 data_time: 0.094483 memory: 20140 loss_kpt: 0.000708 acc_pose: 0.826167 loss: 0.000708 2022/09/26 12:04:26 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:04:26 - mmengine - INFO - Saving checkpoint at 30 epochs 2022/09/26 12:04:38 - mmengine - INFO - Epoch(val) [30][50/407] eta: 0:01:00 time: 0.170523 data_time: 0.015443 memory: 20140 2022/09/26 12:04:46 - mmengine - INFO - Epoch(val) [30][100/407] eta: 0:00:50 time: 0.163497 data_time: 0.010449 memory: 1830 2022/09/26 12:04:55 - mmengine - INFO - Epoch(val) [30][150/407] eta: 0:00:42 time: 0.164069 data_time: 0.010980 memory: 1830 2022/09/26 12:05:03 - mmengine - INFO - Epoch(val) [30][200/407] eta: 0:00:34 time: 0.166770 data_time: 0.010050 memory: 1830 2022/09/26 12:05:12 - mmengine - INFO - Epoch(val) [30][250/407] eta: 0:00:27 time: 0.177066 data_time: 0.023376 memory: 1830 2022/09/26 12:05:20 - mmengine - INFO - Epoch(val) [30][300/407] eta: 0:00:18 time: 0.171991 data_time: 0.016991 memory: 1830 2022/09/26 12:05:28 - mmengine - INFO - Epoch(val) [30][350/407] eta: 0:00:09 time: 0.163044 data_time: 0.009363 memory: 1830 2022/09/26 12:05:37 - mmengine - INFO - Epoch(val) [30][400/407] eta: 0:00:01 time: 0.162256 data_time: 0.010611 memory: 1830 2022/09/26 12:06:10 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 12:06:23 - mmengine - INFO - Epoch(val) [30][407/407] coco/AP: 0.702977 coco/AP .5: 0.886073 coco/AP .75: 0.770435 coco/AP (M): 0.661471 coco/AP (L): 0.773350 coco/AR: 0.756376 coco/AR .5: 0.922387 coco/AR .75: 0.818325 coco/AR (M): 0.710981 coco/AR (L): 0.821330 2022/09/26 12:06:23 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_20.pth is removed 2022/09/26 12:06:27 - mmengine - INFO - The best checkpoint with 0.7030 coco/AP at 30 epoch is saved to best_coco/AP_epoch_30.pth. 2022/09/26 12:06:54 - mmengine - INFO - Epoch(train) [31][50/293] lr: 5.000000e-04 eta: 6:45:44 time: 0.546591 data_time: 0.113448 memory: 20140 loss_kpt: 0.000684 acc_pose: 0.766760 loss: 0.000684 2022/09/26 12:07:22 - mmengine - INFO - Epoch(train) [31][100/293] lr: 5.000000e-04 eta: 6:45:46 time: 0.545447 data_time: 0.106156 memory: 20140 loss_kpt: 0.000684 acc_pose: 0.811778 loss: 0.000684 2022/09/26 12:07:48 - mmengine - INFO - Epoch(train) [31][150/293] lr: 5.000000e-04 eta: 6:45:39 time: 0.519417 data_time: 0.094634 memory: 20140 loss_kpt: 0.000681 acc_pose: 0.766686 loss: 0.000681 2022/09/26 12:08:14 - mmengine - INFO - Epoch(train) [31][200/293] lr: 5.000000e-04 eta: 6:45:34 time: 0.525483 data_time: 0.109238 memory: 20140 loss_kpt: 0.000678 acc_pose: 0.797043 loss: 0.000678 2022/09/26 12:08:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:08:40 - mmengine - INFO - Epoch(train) [31][250/293] lr: 5.000000e-04 eta: 6:45:29 time: 0.523240 data_time: 0.087750 memory: 20140 loss_kpt: 0.000686 acc_pose: 0.744940 loss: 0.000686 2022/09/26 12:09:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:09:30 - mmengine - INFO - Epoch(train) [32][50/293] lr: 5.000000e-04 eta: 6:43:19 time: 0.559909 data_time: 0.117793 memory: 20140 loss_kpt: 0.000691 acc_pose: 0.779615 loss: 0.000691 2022/09/26 12:10:02 - mmengine - INFO - Epoch(train) [32][100/293] lr: 5.000000e-04 eta: 6:43:45 time: 0.634538 data_time: 0.109790 memory: 20140 loss_kpt: 0.000679 acc_pose: 0.786302 loss: 0.000679 2022/09/26 12:10:29 - mmengine - INFO - Epoch(train) [32][150/293] lr: 5.000000e-04 eta: 6:43:41 time: 0.530926 data_time: 0.086866 memory: 20140 loss_kpt: 0.000679 acc_pose: 0.819435 loss: 0.000679 2022/09/26 12:10:55 - mmengine - INFO - Epoch(train) [32][200/293] lr: 5.000000e-04 eta: 6:43:35 time: 0.521575 data_time: 0.094373 memory: 20140 loss_kpt: 0.000687 acc_pose: 0.771416 loss: 0.000687 2022/09/26 12:11:21 - mmengine - INFO - Epoch(train) [32][250/293] lr: 5.000000e-04 eta: 6:43:28 time: 0.521170 data_time: 0.099826 memory: 20140 loss_kpt: 0.000681 acc_pose: 0.800825 loss: 0.000681 2022/09/26 12:11:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:12:11 - mmengine - INFO - Epoch(train) [33][50/293] lr: 5.000000e-04 eta: 6:41:18 time: 0.549302 data_time: 0.122298 memory: 20140 loss_kpt: 0.000666 acc_pose: 0.789075 loss: 0.000666 2022/09/26 12:12:37 - mmengine - INFO - Epoch(train) [33][100/293] lr: 5.000000e-04 eta: 6:41:15 time: 0.534982 data_time: 0.097272 memory: 20140 loss_kpt: 0.000680 acc_pose: 0.807006 loss: 0.000680 2022/09/26 12:13:04 - mmengine - INFO - Epoch(train) [33][150/293] lr: 5.000000e-04 eta: 6:41:09 time: 0.528104 data_time: 0.107811 memory: 20140 loss_kpt: 0.000694 acc_pose: 0.805457 loss: 0.000694 2022/09/26 12:13:30 - mmengine - INFO - Epoch(train) [33][200/293] lr: 5.000000e-04 eta: 6:41:04 time: 0.528893 data_time: 0.106903 memory: 20140 loss_kpt: 0.000671 acc_pose: 0.773754 loss: 0.000671 2022/09/26 12:13:56 - mmengine - INFO - Epoch(train) [33][250/293] lr: 5.000000e-04 eta: 6:40:54 time: 0.511706 data_time: 0.096641 memory: 20140 loss_kpt: 0.000687 acc_pose: 0.810676 loss: 0.000687 2022/09/26 12:14:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:14:46 - mmengine - INFO - Epoch(train) [34][50/293] lr: 5.000000e-04 eta: 6:38:45 time: 0.540267 data_time: 0.111918 memory: 20140 loss_kpt: 0.000678 acc_pose: 0.856761 loss: 0.000678 2022/09/26 12:15:12 - mmengine - INFO - Epoch(train) [34][100/293] lr: 5.000000e-04 eta: 6:38:37 time: 0.519258 data_time: 0.095253 memory: 20140 loss_kpt: 0.000662 acc_pose: 0.788423 loss: 0.000662 2022/09/26 12:15:38 - mmengine - INFO - Epoch(train) [34][150/293] lr: 5.000000e-04 eta: 6:38:32 time: 0.529195 data_time: 0.098457 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.860803 loss: 0.000660 2022/09/26 12:16:04 - mmengine - INFO - Epoch(train) [34][200/293] lr: 5.000000e-04 eta: 6:38:25 time: 0.523762 data_time: 0.100829 memory: 20140 loss_kpt: 0.000670 acc_pose: 0.792716 loss: 0.000670 2022/09/26 12:16:30 - mmengine - INFO - Epoch(train) [34][250/293] lr: 5.000000e-04 eta: 6:38:15 time: 0.514552 data_time: 0.107699 memory: 20140 loss_kpt: 0.000666 acc_pose: 0.823089 loss: 0.000666 2022/09/26 12:16:52 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:17:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:17:20 - mmengine - INFO - Epoch(train) [35][50/293] lr: 5.000000e-04 eta: 6:36:15 time: 0.560506 data_time: 0.113377 memory: 20140 loss_kpt: 0.000679 acc_pose: 0.821786 loss: 0.000679 2022/09/26 12:17:47 - mmengine - INFO - Epoch(train) [35][100/293] lr: 5.000000e-04 eta: 6:36:11 time: 0.535211 data_time: 0.099311 memory: 20140 loss_kpt: 0.000663 acc_pose: 0.777370 loss: 0.000663 2022/09/26 12:18:13 - mmengine - INFO - Epoch(train) [35][150/293] lr: 5.000000e-04 eta: 6:36:04 time: 0.526304 data_time: 0.094670 memory: 20140 loss_kpt: 0.000654 acc_pose: 0.822324 loss: 0.000654 2022/09/26 12:18:42 - mmengine - INFO - Epoch(train) [35][200/293] lr: 5.000000e-04 eta: 6:36:09 time: 0.574612 data_time: 0.105647 memory: 20140 loss_kpt: 0.000673 acc_pose: 0.811695 loss: 0.000673 2022/09/26 12:19:08 - mmengine - INFO - Epoch(train) [35][250/293] lr: 5.000000e-04 eta: 6:36:02 time: 0.526552 data_time: 0.102970 memory: 20140 loss_kpt: 0.000667 acc_pose: 0.784823 loss: 0.000667 2022/09/26 12:19:30 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:19:57 - mmengine - INFO - Epoch(train) [36][50/293] lr: 5.000000e-04 eta: 6:34:00 time: 0.545075 data_time: 0.109966 memory: 20140 loss_kpt: 0.000670 acc_pose: 0.803093 loss: 0.000670 2022/09/26 12:20:24 - mmengine - INFO - Epoch(train) [36][100/293] lr: 5.000000e-04 eta: 6:33:52 time: 0.522329 data_time: 0.098608 memory: 20140 loss_kpt: 0.000669 acc_pose: 0.715953 loss: 0.000669 2022/09/26 12:20:50 - mmengine - INFO - Epoch(train) [36][150/293] lr: 5.000000e-04 eta: 6:33:44 time: 0.522518 data_time: 0.101284 memory: 20140 loss_kpt: 0.000671 acc_pose: 0.809566 loss: 0.000671 2022/09/26 12:21:16 - mmengine - INFO - Epoch(train) [36][200/293] lr: 5.000000e-04 eta: 6:33:35 time: 0.518531 data_time: 0.098195 memory: 20140 loss_kpt: 0.000665 acc_pose: 0.806875 loss: 0.000665 2022/09/26 12:21:42 - mmengine - INFO - Epoch(train) [36][250/293] lr: 5.000000e-04 eta: 6:33:28 time: 0.527944 data_time: 0.099971 memory: 20140 loss_kpt: 0.000665 acc_pose: 0.759863 loss: 0.000665 2022/09/26 12:22:05 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:22:32 - mmengine - INFO - Epoch(train) [37][50/293] lr: 5.000000e-04 eta: 6:31:29 time: 0.544225 data_time: 0.103870 memory: 20140 loss_kpt: 0.000668 acc_pose: 0.834659 loss: 0.000668 2022/09/26 12:22:58 - mmengine - INFO - Epoch(train) [37][100/293] lr: 5.000000e-04 eta: 6:31:20 time: 0.523263 data_time: 0.103470 memory: 20140 loss_kpt: 0.000642 acc_pose: 0.879754 loss: 0.000642 2022/09/26 12:23:25 - mmengine - INFO - Epoch(train) [37][150/293] lr: 5.000000e-04 eta: 6:31:16 time: 0.539090 data_time: 0.105328 memory: 20140 loss_kpt: 0.000658 acc_pose: 0.781488 loss: 0.000658 2022/09/26 12:23:51 - mmengine - INFO - Epoch(train) [37][200/293] lr: 5.000000e-04 eta: 6:31:07 time: 0.523756 data_time: 0.094434 memory: 20140 loss_kpt: 0.000664 acc_pose: 0.834622 loss: 0.000664 2022/09/26 12:24:18 - mmengine - INFO - Epoch(train) [37][250/293] lr: 5.000000e-04 eta: 6:31:01 time: 0.532218 data_time: 0.095375 memory: 20140 loss_kpt: 0.000666 acc_pose: 0.850796 loss: 0.000666 2022/09/26 12:24:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:25:07 - mmengine - INFO - Epoch(train) [38][50/293] lr: 5.000000e-04 eta: 6:29:03 time: 0.537262 data_time: 0.111097 memory: 20140 loss_kpt: 0.000672 acc_pose: 0.757874 loss: 0.000672 2022/09/26 12:25:34 - mmengine - INFO - Epoch(train) [38][100/293] lr: 5.000000e-04 eta: 6:28:57 time: 0.535785 data_time: 0.094216 memory: 20140 loss_kpt: 0.000671 acc_pose: 0.837746 loss: 0.000671 2022/09/26 12:26:00 - mmengine - INFO - Epoch(train) [38][150/293] lr: 5.000000e-04 eta: 6:28:49 time: 0.526699 data_time: 0.094875 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.827737 loss: 0.000660 2022/09/26 12:26:05 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:26:26 - mmengine - INFO - Epoch(train) [38][200/293] lr: 5.000000e-04 eta: 6:28:38 time: 0.516594 data_time: 0.098741 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.810742 loss: 0.000660 2022/09/26 12:26:53 - mmengine - INFO - Epoch(train) [38][250/293] lr: 5.000000e-04 eta: 6:28:32 time: 0.534064 data_time: 0.097391 memory: 20140 loss_kpt: 0.000652 acc_pose: 0.818126 loss: 0.000652 2022/09/26 12:27:15 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:27:42 - mmengine - INFO - Epoch(train) [39][50/293] lr: 5.000000e-04 eta: 6:26:39 time: 0.550879 data_time: 0.114537 memory: 20140 loss_kpt: 0.000655 acc_pose: 0.777534 loss: 0.000655 2022/09/26 12:28:09 - mmengine - INFO - Epoch(train) [39][100/293] lr: 5.000000e-04 eta: 6:26:33 time: 0.538053 data_time: 0.096418 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.792610 loss: 0.000660 2022/09/26 12:28:35 - mmengine - INFO - Epoch(train) [39][150/293] lr: 5.000000e-04 eta: 6:26:23 time: 0.516351 data_time: 0.102613 memory: 20140 loss_kpt: 0.000654 acc_pose: 0.753720 loss: 0.000654 2022/09/26 12:29:02 - mmengine - INFO - Epoch(train) [39][200/293] lr: 5.000000e-04 eta: 6:26:17 time: 0.538550 data_time: 0.099878 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.804836 loss: 0.000660 2022/09/26 12:29:28 - mmengine - INFO - Epoch(train) [39][250/293] lr: 5.000000e-04 eta: 6:26:06 time: 0.520093 data_time: 0.106212 memory: 20140 loss_kpt: 0.000658 acc_pose: 0.834986 loss: 0.000658 2022/09/26 12:29:50 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:30:18 - mmengine - INFO - Epoch(train) [40][50/293] lr: 5.000000e-04 eta: 6:24:21 time: 0.573634 data_time: 0.115116 memory: 20140 loss_kpt: 0.000670 acc_pose: 0.789471 loss: 0.000670 2022/09/26 12:30:45 - mmengine - INFO - Epoch(train) [40][100/293] lr: 5.000000e-04 eta: 6:24:12 time: 0.525942 data_time: 0.100424 memory: 20140 loss_kpt: 0.000657 acc_pose: 0.779929 loss: 0.000657 2022/09/26 12:31:10 - mmengine - INFO - Epoch(train) [40][150/293] lr: 5.000000e-04 eta: 6:24:00 time: 0.512133 data_time: 0.096995 memory: 20140 loss_kpt: 0.000656 acc_pose: 0.815973 loss: 0.000656 2022/09/26 12:31:36 - mmengine - INFO - Epoch(train) [40][200/293] lr: 5.000000e-04 eta: 6:23:50 time: 0.519610 data_time: 0.088111 memory: 20140 loss_kpt: 0.000671 acc_pose: 0.811101 loss: 0.000671 2022/09/26 12:32:02 - mmengine - INFO - Epoch(train) [40][250/293] lr: 5.000000e-04 eta: 6:23:39 time: 0.521211 data_time: 0.101829 memory: 20140 loss_kpt: 0.000665 acc_pose: 0.779985 loss: 0.000665 2022/09/26 12:32:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:32:24 - mmengine - INFO - Saving checkpoint at 40 epochs 2022/09/26 12:32:38 - mmengine - INFO - Epoch(val) [40][50/407] eta: 0:01:02 time: 0.174234 data_time: 0.019089 memory: 20140 2022/09/26 12:32:47 - mmengine - INFO - Epoch(val) [40][100/407] eta: 0:00:52 time: 0.170009 data_time: 0.010711 memory: 1830 2022/09/26 12:32:56 - mmengine - INFO - Epoch(val) [40][150/407] eta: 0:00:47 time: 0.184294 data_time: 0.030391 memory: 1830 2022/09/26 12:33:04 - mmengine - INFO - Epoch(val) [40][200/407] eta: 0:00:34 time: 0.167751 data_time: 0.012847 memory: 1830 2022/09/26 12:33:13 - mmengine - INFO - Epoch(val) [40][250/407] eta: 0:00:26 time: 0.171703 data_time: 0.013637 memory: 1830 2022/09/26 12:33:21 - mmengine - INFO - Epoch(val) [40][300/407] eta: 0:00:18 time: 0.170354 data_time: 0.012270 memory: 1830 2022/09/26 12:33:30 - mmengine - INFO - Epoch(val) [40][350/407] eta: 0:00:09 time: 0.164858 data_time: 0.010405 memory: 1830 2022/09/26 12:33:38 - mmengine - INFO - Epoch(val) [40][400/407] eta: 0:00:01 time: 0.160412 data_time: 0.011873 memory: 1830 2022/09/26 12:34:11 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 12:34:24 - mmengine - INFO - Epoch(val) [40][407/407] coco/AP: 0.711684 coco/AP .5: 0.889481 coco/AP .75: 0.777162 coco/AP (M): 0.668556 coco/AP (L): 0.784077 coco/AR: 0.763681 coco/AR .5: 0.926165 coco/AR .75: 0.822418 coco/AR (M): 0.716771 coco/AR (L): 0.830844 2022/09/26 12:34:24 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_30.pth is removed 2022/09/26 12:34:26 - mmengine - INFO - The best checkpoint with 0.7117 coco/AP at 40 epoch is saved to best_coco/AP_epoch_40.pth. 2022/09/26 12:34:53 - mmengine - INFO - Epoch(train) [41][50/293] lr: 5.000000e-04 eta: 6:21:47 time: 0.532281 data_time: 0.107632 memory: 20140 loss_kpt: 0.000655 acc_pose: 0.857225 loss: 0.000655 2022/09/26 12:35:19 - mmengine - INFO - Epoch(train) [41][100/293] lr: 5.000000e-04 eta: 6:21:40 time: 0.533767 data_time: 0.097456 memory: 20140 loss_kpt: 0.000665 acc_pose: 0.810186 loss: 0.000665 2022/09/26 12:35:46 - mmengine - INFO - Epoch(train) [41][150/293] lr: 5.000000e-04 eta: 6:21:31 time: 0.526326 data_time: 0.095406 memory: 20140 loss_kpt: 0.000662 acc_pose: 0.780626 loss: 0.000662 2022/09/26 12:36:11 - mmengine - INFO - Epoch(train) [41][200/293] lr: 5.000000e-04 eta: 6:21:17 time: 0.506001 data_time: 0.100275 memory: 20140 loss_kpt: 0.000645 acc_pose: 0.796352 loss: 0.000645 2022/09/26 12:36:37 - mmengine - INFO - Epoch(train) [41][250/293] lr: 5.000000e-04 eta: 6:21:05 time: 0.513500 data_time: 0.101618 memory: 20140 loss_kpt: 0.000651 acc_pose: 0.792480 loss: 0.000651 2022/09/26 12:36:52 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:36:59 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:37:27 - mmengine - INFO - Epoch(train) [42][50/293] lr: 5.000000e-04 eta: 6:19:19 time: 0.554137 data_time: 0.112626 memory: 20140 loss_kpt: 0.000637 acc_pose: 0.852245 loss: 0.000637 2022/09/26 12:37:53 - mmengine - INFO - Epoch(train) [42][100/293] lr: 5.000000e-04 eta: 6:19:11 time: 0.531358 data_time: 0.093781 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.807302 loss: 0.000660 2022/09/26 12:38:20 - mmengine - INFO - Epoch(train) [42][150/293] lr: 5.000000e-04 eta: 6:19:05 time: 0.543301 data_time: 0.097484 memory: 20140 loss_kpt: 0.000657 acc_pose: 0.810001 loss: 0.000657 2022/09/26 12:38:46 - mmengine - INFO - Epoch(train) [42][200/293] lr: 5.000000e-04 eta: 6:18:52 time: 0.510840 data_time: 0.096586 memory: 20140 loss_kpt: 0.000653 acc_pose: 0.770999 loss: 0.000653 2022/09/26 12:39:12 - mmengine - INFO - Epoch(train) [42][250/293] lr: 5.000000e-04 eta: 6:18:43 time: 0.530073 data_time: 0.096085 memory: 20140 loss_kpt: 0.000638 acc_pose: 0.767778 loss: 0.000638 2022/09/26 12:39:34 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:40:01 - mmengine - INFO - Epoch(train) [43][50/293] lr: 5.000000e-04 eta: 6:16:57 time: 0.543638 data_time: 0.117113 memory: 20140 loss_kpt: 0.000637 acc_pose: 0.826784 loss: 0.000637 2022/09/26 12:40:28 - mmengine - INFO - Epoch(train) [43][100/293] lr: 5.000000e-04 eta: 6:16:50 time: 0.540071 data_time: 0.097143 memory: 20140 loss_kpt: 0.000647 acc_pose: 0.802499 loss: 0.000647 2022/09/26 12:40:55 - mmengine - INFO - Epoch(train) [43][150/293] lr: 5.000000e-04 eta: 6:16:42 time: 0.534960 data_time: 0.105416 memory: 20140 loss_kpt: 0.000660 acc_pose: 0.785777 loss: 0.000660 2022/09/26 12:41:22 - mmengine - INFO - Epoch(train) [43][200/293] lr: 5.000000e-04 eta: 6:16:32 time: 0.528946 data_time: 0.102420 memory: 20140 loss_kpt: 0.000656 acc_pose: 0.828567 loss: 0.000656 2022/09/26 12:41:48 - mmengine - INFO - Epoch(train) [43][250/293] lr: 5.000000e-04 eta: 6:16:23 time: 0.529397 data_time: 0.099058 memory: 20140 loss_kpt: 0.000663 acc_pose: 0.776011 loss: 0.000663 2022/09/26 12:42:11 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:42:38 - mmengine - INFO - Epoch(train) [44][50/293] lr: 5.000000e-04 eta: 6:14:39 time: 0.543489 data_time: 0.117399 memory: 20140 loss_kpt: 0.000645 acc_pose: 0.827503 loss: 0.000645 2022/09/26 12:43:04 - mmengine - INFO - Epoch(train) [44][100/293] lr: 5.000000e-04 eta: 6:14:28 time: 0.520349 data_time: 0.099581 memory: 20140 loss_kpt: 0.000647 acc_pose: 0.823597 loss: 0.000647 2022/09/26 12:43:31 - mmengine - INFO - Epoch(train) [44][150/293] lr: 5.000000e-04 eta: 6:14:19 time: 0.537944 data_time: 0.098914 memory: 20140 loss_kpt: 0.000640 acc_pose: 0.778513 loss: 0.000640 2022/09/26 12:43:57 - mmengine - INFO - Epoch(train) [44][200/293] lr: 5.000000e-04 eta: 6:14:10 time: 0.532118 data_time: 0.094383 memory: 20140 loss_kpt: 0.000641 acc_pose: 0.832779 loss: 0.000641 2022/09/26 12:44:24 - mmengine - INFO - Epoch(train) [44][250/293] lr: 5.000000e-04 eta: 6:14:03 time: 0.542755 data_time: 0.098313 memory: 20140 loss_kpt: 0.000644 acc_pose: 0.831812 loss: 0.000644 2022/09/26 12:44:47 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:45:14 - mmengine - INFO - Epoch(train) [45][50/293] lr: 5.000000e-04 eta: 6:12:20 time: 0.538674 data_time: 0.111815 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.834379 loss: 0.000635 2022/09/26 12:45:41 - mmengine - INFO - Epoch(train) [45][100/293] lr: 5.000000e-04 eta: 6:12:11 time: 0.535748 data_time: 0.101579 memory: 20140 loss_kpt: 0.000641 acc_pose: 0.817674 loss: 0.000641 2022/09/26 12:45:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:46:08 - mmengine - INFO - Epoch(train) [45][150/293] lr: 5.000000e-04 eta: 6:12:03 time: 0.540454 data_time: 0.108115 memory: 20140 loss_kpt: 0.000657 acc_pose: 0.841391 loss: 0.000657 2022/09/26 12:46:34 - mmengine - INFO - Epoch(train) [45][200/293] lr: 5.000000e-04 eta: 6:11:53 time: 0.529350 data_time: 0.098232 memory: 20140 loss_kpt: 0.000643 acc_pose: 0.801181 loss: 0.000643 2022/09/26 12:47:00 - mmengine - INFO - Epoch(train) [45][250/293] lr: 5.000000e-04 eta: 6:11:41 time: 0.520784 data_time: 0.097748 memory: 20140 loss_kpt: 0.000644 acc_pose: 0.824570 loss: 0.000644 2022/09/26 12:47:22 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:47:50 - mmengine - INFO - Epoch(train) [46][50/293] lr: 5.000000e-04 eta: 6:10:01 time: 0.545489 data_time: 0.112174 memory: 20140 loss_kpt: 0.000621 acc_pose: 0.834139 loss: 0.000621 2022/09/26 12:48:16 - mmengine - INFO - Epoch(train) [46][100/293] lr: 5.000000e-04 eta: 6:09:51 time: 0.531878 data_time: 0.100237 memory: 20140 loss_kpt: 0.000654 acc_pose: 0.784868 loss: 0.000654 2022/09/26 12:48:42 - mmengine - INFO - Epoch(train) [46][150/293] lr: 5.000000e-04 eta: 6:09:39 time: 0.521662 data_time: 0.097762 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.824751 loss: 0.000635 2022/09/26 12:49:08 - mmengine - INFO - Epoch(train) [46][200/293] lr: 5.000000e-04 eta: 6:09:27 time: 0.521120 data_time: 0.110052 memory: 20140 loss_kpt: 0.000650 acc_pose: 0.828091 loss: 0.000650 2022/09/26 12:49:35 - mmengine - INFO - Epoch(train) [46][250/293] lr: 5.000000e-04 eta: 6:09:16 time: 0.527708 data_time: 0.095729 memory: 20140 loss_kpt: 0.000649 acc_pose: 0.853496 loss: 0.000649 2022/09/26 12:49:57 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:50:25 - mmengine - INFO - Epoch(train) [47][50/293] lr: 5.000000e-04 eta: 6:07:39 time: 0.549535 data_time: 0.114354 memory: 20140 loss_kpt: 0.000642 acc_pose: 0.755307 loss: 0.000642 2022/09/26 12:50:52 - mmengine - INFO - Epoch(train) [47][100/293] lr: 5.000000e-04 eta: 6:07:30 time: 0.541735 data_time: 0.103161 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.806820 loss: 0.000629 2022/09/26 12:51:18 - mmengine - INFO - Epoch(train) [47][150/293] lr: 5.000000e-04 eta: 6:07:20 time: 0.528806 data_time: 0.092728 memory: 20140 loss_kpt: 0.000649 acc_pose: 0.844222 loss: 0.000649 2022/09/26 12:51:45 - mmengine - INFO - Epoch(train) [47][200/293] lr: 5.000000e-04 eta: 6:07:08 time: 0.527571 data_time: 0.100594 memory: 20140 loss_kpt: 0.000639 acc_pose: 0.806563 loss: 0.000639 2022/09/26 12:52:11 - mmengine - INFO - Epoch(train) [47][250/293] lr: 5.000000e-04 eta: 6:06:56 time: 0.522542 data_time: 0.098056 memory: 20140 loss_kpt: 0.000637 acc_pose: 0.788421 loss: 0.000637 2022/09/26 12:52:33 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:53:01 - mmengine - INFO - Epoch(train) [48][50/293] lr: 5.000000e-04 eta: 6:05:20 time: 0.546742 data_time: 0.113772 memory: 20140 loss_kpt: 0.000627 acc_pose: 0.771377 loss: 0.000627 2022/09/26 12:53:27 - mmengine - INFO - Epoch(train) [48][100/293] lr: 5.000000e-04 eta: 6:05:07 time: 0.517452 data_time: 0.098402 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.796703 loss: 0.000635 2022/09/26 12:53:53 - mmengine - INFO - Epoch(train) [48][150/293] lr: 5.000000e-04 eta: 6:04:57 time: 0.534745 data_time: 0.099579 memory: 20140 loss_kpt: 0.000632 acc_pose: 0.837351 loss: 0.000632 2022/09/26 12:54:20 - mmengine - INFO - Epoch(train) [48][200/293] lr: 5.000000e-04 eta: 6:04:45 time: 0.528309 data_time: 0.093107 memory: 20140 loss_kpt: 0.000649 acc_pose: 0.795377 loss: 0.000649 2022/09/26 12:54:35 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:54:46 - mmengine - INFO - Epoch(train) [48][250/293] lr: 5.000000e-04 eta: 6:04:33 time: 0.524580 data_time: 0.099036 memory: 20140 loss_kpt: 0.000645 acc_pose: 0.786769 loss: 0.000645 2022/09/26 12:55:08 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:55:35 - mmengine - INFO - Epoch(train) [49][50/293] lr: 5.000000e-04 eta: 6:02:59 time: 0.550260 data_time: 0.102827 memory: 20140 loss_kpt: 0.000623 acc_pose: 0.764998 loss: 0.000623 2022/09/26 12:56:04 - mmengine - INFO - Epoch(train) [49][100/293] lr: 5.000000e-04 eta: 6:02:56 time: 0.577474 data_time: 0.094901 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.773288 loss: 0.000635 2022/09/26 12:56:30 - mmengine - INFO - Epoch(train) [49][150/293] lr: 5.000000e-04 eta: 6:02:43 time: 0.522744 data_time: 0.093161 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.850869 loss: 0.000625 2022/09/26 12:56:57 - mmengine - INFO - Epoch(train) [49][200/293] lr: 5.000000e-04 eta: 6:02:31 time: 0.526761 data_time: 0.103227 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.813302 loss: 0.000626 2022/09/26 12:57:23 - mmengine - INFO - Epoch(train) [49][250/293] lr: 5.000000e-04 eta: 6:02:18 time: 0.519639 data_time: 0.107449 memory: 20140 loss_kpt: 0.000647 acc_pose: 0.837005 loss: 0.000647 2022/09/26 12:57:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 12:58:12 - mmengine - INFO - Epoch(train) [50][50/293] lr: 5.000000e-04 eta: 6:00:43 time: 0.538844 data_time: 0.110831 memory: 20140 loss_kpt: 0.000620 acc_pose: 0.836620 loss: 0.000620 2022/09/26 12:58:38 - mmengine - INFO - Epoch(train) [50][100/293] lr: 5.000000e-04 eta: 6:00:31 time: 0.522922 data_time: 0.104333 memory: 20140 loss_kpt: 0.000634 acc_pose: 0.843720 loss: 0.000634 2022/09/26 12:59:04 - mmengine - INFO - Epoch(train) [50][150/293] lr: 5.000000e-04 eta: 6:00:18 time: 0.521909 data_time: 0.099319 memory: 20140 loss_kpt: 0.000619 acc_pose: 0.855236 loss: 0.000619 2022/09/26 12:59:31 - mmengine - INFO - Epoch(train) [50][200/293] lr: 5.000000e-04 eta: 6:00:07 time: 0.533037 data_time: 0.098535 memory: 20140 loss_kpt: 0.000636 acc_pose: 0.786878 loss: 0.000636 2022/09/26 12:59:57 - mmengine - INFO - Epoch(train) [50][250/293] lr: 5.000000e-04 eta: 5:59:54 time: 0.521820 data_time: 0.102092 memory: 20140 loss_kpt: 0.000644 acc_pose: 0.781856 loss: 0.000644 2022/09/26 13:00:20 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:00:20 - mmengine - INFO - Saving checkpoint at 50 epochs 2022/09/26 13:00:33 - mmengine - INFO - Epoch(val) [50][50/407] eta: 0:01:01 time: 0.173242 data_time: 0.016506 memory: 20140 2022/09/26 13:00:42 - mmengine - INFO - Epoch(val) [50][100/407] eta: 0:00:50 time: 0.164526 data_time: 0.010965 memory: 1830 2022/09/26 13:00:50 - mmengine - INFO - Epoch(val) [50][150/407] eta: 0:00:42 time: 0.166386 data_time: 0.010500 memory: 1830 2022/09/26 13:00:58 - mmengine - INFO - Epoch(val) [50][200/407] eta: 0:00:34 time: 0.165931 data_time: 0.012376 memory: 1830 2022/09/26 13:01:07 - mmengine - INFO - Epoch(val) [50][250/407] eta: 0:00:27 time: 0.176969 data_time: 0.017148 memory: 1830 2022/09/26 13:01:15 - mmengine - INFO - Epoch(val) [50][300/407] eta: 0:00:18 time: 0.168468 data_time: 0.012026 memory: 1830 2022/09/26 13:01:24 - mmengine - INFO - Epoch(val) [50][350/407] eta: 0:00:10 time: 0.176088 data_time: 0.019511 memory: 1830 2022/09/26 13:01:32 - mmengine - INFO - Epoch(val) [50][400/407] eta: 0:00:01 time: 0.162396 data_time: 0.011184 memory: 1830 2022/09/26 13:03:27 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 13:03:40 - mmengine - INFO - Epoch(val) [50][407/407] coco/AP: 0.718120 coco/AP .5: 0.889204 coco/AP .75: 0.785715 coco/AP (M): 0.677856 coco/AP (L): 0.789879 coco/AR: 0.769836 coco/AR .5: 0.927582 coco/AR .75: 0.831234 coco/AR (M): 0.724665 coco/AR (L): 0.835154 2022/09/26 13:03:40 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_40.pth is removed 2022/09/26 13:03:43 - mmengine - INFO - The best checkpoint with 0.7181 coco/AP at 50 epoch is saved to best_coco/AP_epoch_50.pth. 2022/09/26 13:04:10 - mmengine - INFO - Epoch(train) [51][50/293] lr: 5.000000e-04 eta: 5:58:20 time: 0.537571 data_time: 0.109040 memory: 20140 loss_kpt: 0.000628 acc_pose: 0.818864 loss: 0.000628 2022/09/26 13:04:37 - mmengine - INFO - Epoch(train) [51][100/293] lr: 5.000000e-04 eta: 5:58:09 time: 0.534615 data_time: 0.090660 memory: 20140 loss_kpt: 0.000649 acc_pose: 0.744008 loss: 0.000649 2022/09/26 13:05:02 - mmengine - INFO - Epoch(train) [51][150/293] lr: 5.000000e-04 eta: 5:57:55 time: 0.516870 data_time: 0.090049 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.779769 loss: 0.000626 2022/09/26 13:05:29 - mmengine - INFO - Epoch(train) [51][200/293] lr: 5.000000e-04 eta: 5:57:43 time: 0.525269 data_time: 0.103581 memory: 20140 loss_kpt: 0.000637 acc_pose: 0.798981 loss: 0.000637 2022/09/26 13:05:55 - mmengine - INFO - Epoch(train) [51][250/293] lr: 5.000000e-04 eta: 5:57:30 time: 0.527403 data_time: 0.084589 memory: 20140 loss_kpt: 0.000638 acc_pose: 0.777221 loss: 0.000638 2022/09/26 13:06:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:06:45 - mmengine - INFO - Epoch(train) [52][50/293] lr: 5.000000e-04 eta: 5:55:59 time: 0.540695 data_time: 0.106829 memory: 20140 loss_kpt: 0.000616 acc_pose: 0.833177 loss: 0.000616 2022/09/26 13:06:48 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:07:11 - mmengine - INFO - Epoch(train) [52][100/293] lr: 5.000000e-04 eta: 5:55:46 time: 0.523574 data_time: 0.102837 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.833959 loss: 0.000635 2022/09/26 13:07:38 - mmengine - INFO - Epoch(train) [52][150/293] lr: 5.000000e-04 eta: 5:55:36 time: 0.548390 data_time: 0.102079 memory: 20140 loss_kpt: 0.000642 acc_pose: 0.745718 loss: 0.000642 2022/09/26 13:08:04 - mmengine - INFO - Epoch(train) [52][200/293] lr: 5.000000e-04 eta: 5:55:22 time: 0.513506 data_time: 0.098710 memory: 20140 loss_kpt: 0.000644 acc_pose: 0.819674 loss: 0.000644 2022/09/26 13:08:30 - mmengine - INFO - Epoch(train) [52][250/293] lr: 5.000000e-04 eta: 5:55:08 time: 0.519632 data_time: 0.099747 memory: 20140 loss_kpt: 0.000614 acc_pose: 0.768473 loss: 0.000614 2022/09/26 13:08:52 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:09:20 - mmengine - INFO - Epoch(train) [53][50/293] lr: 5.000000e-04 eta: 5:53:41 time: 0.561143 data_time: 0.123284 memory: 20140 loss_kpt: 0.000630 acc_pose: 0.802816 loss: 0.000630 2022/09/26 13:09:46 - mmengine - INFO - Epoch(train) [53][100/293] lr: 5.000000e-04 eta: 5:53:26 time: 0.517051 data_time: 0.084758 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.815619 loss: 0.000625 2022/09/26 13:10:13 - mmengine - INFO - Epoch(train) [53][150/293] lr: 5.000000e-04 eta: 5:53:15 time: 0.534891 data_time: 0.105449 memory: 20140 loss_kpt: 0.000622 acc_pose: 0.836534 loss: 0.000622 2022/09/26 13:10:39 - mmengine - INFO - Epoch(train) [53][200/293] lr: 5.000000e-04 eta: 5:53:01 time: 0.518554 data_time: 0.093884 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.789237 loss: 0.000625 2022/09/26 13:11:05 - mmengine - INFO - Epoch(train) [53][250/293] lr: 5.000000e-04 eta: 5:52:48 time: 0.531581 data_time: 0.091188 memory: 20140 loss_kpt: 0.000631 acc_pose: 0.797019 loss: 0.000631 2022/09/26 13:11:27 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:11:55 - mmengine - INFO - Epoch(train) [54][50/293] lr: 5.000000e-04 eta: 5:51:23 time: 0.566026 data_time: 0.114663 memory: 20140 loss_kpt: 0.000631 acc_pose: 0.814802 loss: 0.000631 2022/09/26 13:12:21 - mmengine - INFO - Epoch(train) [54][100/293] lr: 5.000000e-04 eta: 5:51:08 time: 0.515349 data_time: 0.092540 memory: 20140 loss_kpt: 0.000640 acc_pose: 0.781427 loss: 0.000640 2022/09/26 13:12:48 - mmengine - INFO - Epoch(train) [54][150/293] lr: 5.000000e-04 eta: 5:50:57 time: 0.536162 data_time: 0.099592 memory: 20140 loss_kpt: 0.000624 acc_pose: 0.833501 loss: 0.000624 2022/09/26 13:13:14 - mmengine - INFO - Epoch(train) [54][200/293] lr: 5.000000e-04 eta: 5:50:41 time: 0.512541 data_time: 0.100043 memory: 20140 loss_kpt: 0.000634 acc_pose: 0.792905 loss: 0.000634 2022/09/26 13:13:39 - mmengine - INFO - Epoch(train) [54][250/293] lr: 5.000000e-04 eta: 5:50:27 time: 0.517265 data_time: 0.085267 memory: 20140 loss_kpt: 0.000633 acc_pose: 0.836635 loss: 0.000633 2022/09/26 13:14:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:14:29 - mmengine - INFO - Epoch(train) [55][50/293] lr: 5.000000e-04 eta: 5:49:00 time: 0.546260 data_time: 0.114846 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.807515 loss: 0.000629 2022/09/26 13:14:55 - mmengine - INFO - Epoch(train) [55][100/293] lr: 5.000000e-04 eta: 5:48:45 time: 0.519202 data_time: 0.102071 memory: 20140 loss_kpt: 0.000617 acc_pose: 0.768748 loss: 0.000617 2022/09/26 13:15:21 - mmengine - INFO - Epoch(train) [55][150/293] lr: 5.000000e-04 eta: 5:48:31 time: 0.521154 data_time: 0.104301 memory: 20140 loss_kpt: 0.000639 acc_pose: 0.821111 loss: 0.000639 2022/09/26 13:15:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:15:47 - mmengine - INFO - Epoch(train) [55][200/293] lr: 5.000000e-04 eta: 5:48:18 time: 0.522869 data_time: 0.093165 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.801480 loss: 0.000625 2022/09/26 13:16:13 - mmengine - INFO - Epoch(train) [55][250/293] lr: 5.000000e-04 eta: 5:48:02 time: 0.514032 data_time: 0.086563 memory: 20140 loss_kpt: 0.000616 acc_pose: 0.826646 loss: 0.000616 2022/09/26 13:16:35 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:17:03 - mmengine - INFO - Epoch(train) [56][50/293] lr: 5.000000e-04 eta: 5:46:37 time: 0.548555 data_time: 0.124860 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.798852 loss: 0.000625 2022/09/26 13:17:29 - mmengine - INFO - Epoch(train) [56][100/293] lr: 5.000000e-04 eta: 5:46:23 time: 0.524287 data_time: 0.098426 memory: 20140 loss_kpt: 0.000621 acc_pose: 0.825488 loss: 0.000621 2022/09/26 13:17:56 - mmengine - INFO - Epoch(train) [56][150/293] lr: 5.000000e-04 eta: 5:46:11 time: 0.538735 data_time: 0.105094 memory: 20140 loss_kpt: 0.000622 acc_pose: 0.869893 loss: 0.000622 2022/09/26 13:18:21 - mmengine - INFO - Epoch(train) [56][200/293] lr: 5.000000e-04 eta: 5:45:55 time: 0.511050 data_time: 0.102347 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.854753 loss: 0.000629 2022/09/26 13:18:47 - mmengine - INFO - Epoch(train) [56][250/293] lr: 5.000000e-04 eta: 5:45:41 time: 0.520639 data_time: 0.095385 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.785610 loss: 0.000629 2022/09/26 13:19:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:19:37 - mmengine - INFO - Epoch(train) [57][50/293] lr: 5.000000e-04 eta: 5:44:15 time: 0.535809 data_time: 0.104125 memory: 20140 loss_kpt: 0.000628 acc_pose: 0.839765 loss: 0.000628 2022/09/26 13:20:03 - mmengine - INFO - Epoch(train) [57][100/293] lr: 5.000000e-04 eta: 5:44:00 time: 0.521014 data_time: 0.107900 memory: 20140 loss_kpt: 0.000624 acc_pose: 0.864991 loss: 0.000624 2022/09/26 13:20:30 - mmengine - INFO - Epoch(train) [57][150/293] lr: 5.000000e-04 eta: 5:43:47 time: 0.530126 data_time: 0.095610 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.870960 loss: 0.000629 2022/09/26 13:20:56 - mmengine - INFO - Epoch(train) [57][200/293] lr: 5.000000e-04 eta: 5:43:33 time: 0.524977 data_time: 0.098519 memory: 20140 loss_kpt: 0.000638 acc_pose: 0.847049 loss: 0.000638 2022/09/26 13:21:22 - mmengine - INFO - Epoch(train) [57][250/293] lr: 5.000000e-04 eta: 5:43:19 time: 0.522457 data_time: 0.091548 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.846571 loss: 0.000626 2022/09/26 13:21:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:22:11 - mmengine - INFO - Epoch(train) [58][50/293] lr: 5.000000e-04 eta: 5:41:54 time: 0.541466 data_time: 0.106480 memory: 20140 loss_kpt: 0.000636 acc_pose: 0.810630 loss: 0.000636 2022/09/26 13:22:37 - mmengine - INFO - Epoch(train) [58][100/293] lr: 5.000000e-04 eta: 5:41:39 time: 0.515570 data_time: 0.089619 memory: 20140 loss_kpt: 0.000610 acc_pose: 0.820325 loss: 0.000610 2022/09/26 13:23:03 - mmengine - INFO - Epoch(train) [58][150/293] lr: 5.000000e-04 eta: 5:41:24 time: 0.514400 data_time: 0.099996 memory: 20140 loss_kpt: 0.000608 acc_pose: 0.819643 loss: 0.000608 2022/09/26 13:23:29 - mmengine - INFO - Epoch(train) [58][200/293] lr: 5.000000e-04 eta: 5:41:10 time: 0.526785 data_time: 0.104185 memory: 20140 loss_kpt: 0.000629 acc_pose: 0.815531 loss: 0.000629 2022/09/26 13:23:56 - mmengine - INFO - Epoch(train) [58][250/293] lr: 5.000000e-04 eta: 5:40:57 time: 0.532701 data_time: 0.105102 memory: 20140 loss_kpt: 0.000622 acc_pose: 0.817288 loss: 0.000622 2022/09/26 13:24:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:24:22 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:24:45 - mmengine - INFO - Epoch(train) [59][50/293] lr: 5.000000e-04 eta: 5:39:30 time: 0.519903 data_time: 0.103122 memory: 20140 loss_kpt: 0.000613 acc_pose: 0.829994 loss: 0.000613 2022/09/26 13:25:11 - mmengine - INFO - Epoch(train) [59][100/293] lr: 5.000000e-04 eta: 5:39:16 time: 0.527169 data_time: 0.103812 memory: 20140 loss_kpt: 0.000623 acc_pose: 0.811668 loss: 0.000623 2022/09/26 13:25:37 - mmengine - INFO - Epoch(train) [59][150/293] lr: 5.000000e-04 eta: 5:39:00 time: 0.511651 data_time: 0.088705 memory: 20140 loss_kpt: 0.000618 acc_pose: 0.814612 loss: 0.000618 2022/09/26 13:26:03 - mmengine - INFO - Epoch(train) [59][200/293] lr: 5.000000e-04 eta: 5:38:46 time: 0.522433 data_time: 0.091718 memory: 20140 loss_kpt: 0.000619 acc_pose: 0.835949 loss: 0.000619 2022/09/26 13:26:29 - mmengine - INFO - Epoch(train) [59][250/293] lr: 5.000000e-04 eta: 5:38:30 time: 0.514862 data_time: 0.100721 memory: 20140 loss_kpt: 0.000621 acc_pose: 0.813666 loss: 0.000621 2022/09/26 13:26:51 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:27:18 - mmengine - INFO - Epoch(train) [60][50/293] lr: 5.000000e-04 eta: 5:37:06 time: 0.529531 data_time: 0.104666 memory: 20140 loss_kpt: 0.000612 acc_pose: 0.860649 loss: 0.000612 2022/09/26 13:27:43 - mmengine - INFO - Epoch(train) [60][100/293] lr: 5.000000e-04 eta: 5:36:49 time: 0.503653 data_time: 0.095495 memory: 20140 loss_kpt: 0.000623 acc_pose: 0.840023 loss: 0.000623 2022/09/26 13:28:09 - mmengine - INFO - Epoch(train) [60][150/293] lr: 5.000000e-04 eta: 5:36:36 time: 0.532917 data_time: 0.095152 memory: 20140 loss_kpt: 0.000620 acc_pose: 0.782168 loss: 0.000620 2022/09/26 13:28:35 - mmengine - INFO - Epoch(train) [60][200/293] lr: 5.000000e-04 eta: 5:36:20 time: 0.513862 data_time: 0.091721 memory: 20140 loss_kpt: 0.000635 acc_pose: 0.792659 loss: 0.000635 2022/09/26 13:29:02 - mmengine - INFO - Epoch(train) [60][250/293] lr: 5.000000e-04 eta: 5:36:06 time: 0.533695 data_time: 0.099260 memory: 20140 loss_kpt: 0.000611 acc_pose: 0.880235 loss: 0.000611 2022/09/26 13:29:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:29:25 - mmengine - INFO - Saving checkpoint at 60 epochs 2022/09/26 13:29:39 - mmengine - INFO - Epoch(val) [60][50/407] eta: 0:01:00 time: 0.168542 data_time: 0.016028 memory: 20140 2022/09/26 13:29:48 - mmengine - INFO - Epoch(val) [60][100/407] eta: 0:00:53 time: 0.174810 data_time: 0.018116 memory: 1830 2022/09/26 13:29:56 - mmengine - INFO - Epoch(val) [60][150/407] eta: 0:00:42 time: 0.163748 data_time: 0.010138 memory: 1830 2022/09/26 13:30:04 - mmengine - INFO - Epoch(val) [60][200/407] eta: 0:00:34 time: 0.167725 data_time: 0.010751 memory: 1830 2022/09/26 13:30:12 - mmengine - INFO - Epoch(val) [60][250/407] eta: 0:00:26 time: 0.165939 data_time: 0.011708 memory: 1830 2022/09/26 13:30:21 - mmengine - INFO - Epoch(val) [60][300/407] eta: 0:00:18 time: 0.171458 data_time: 0.017618 memory: 1830 2022/09/26 13:30:29 - mmengine - INFO - Epoch(val) [60][350/407] eta: 0:00:09 time: 0.163388 data_time: 0.010666 memory: 1830 2022/09/26 13:30:38 - mmengine - INFO - Epoch(val) [60][400/407] eta: 0:00:01 time: 0.171586 data_time: 0.016589 memory: 1830 2022/09/26 13:31:11 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 13:31:24 - mmengine - INFO - Epoch(val) [60][407/407] coco/AP: 0.728175 coco/AP .5: 0.896129 coco/AP .75: 0.798010 coco/AP (M): 0.685902 coco/AP (L): 0.798981 coco/AR: 0.779266 coco/AR .5: 0.931360 coco/AR .75: 0.843042 coco/AR (M): 0.733133 coco/AR (L): 0.845188 2022/09/26 13:31:24 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_50.pth is removed 2022/09/26 13:31:27 - mmengine - INFO - The best checkpoint with 0.7282 coco/AP at 60 epoch is saved to best_coco/AP_epoch_60.pth. 2022/09/26 13:31:54 - mmengine - INFO - Epoch(train) [61][50/293] lr: 5.000000e-04 eta: 5:34:45 time: 0.539739 data_time: 0.105287 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.787333 loss: 0.000605 2022/09/26 13:32:20 - mmengine - INFO - Epoch(train) [61][100/293] lr: 5.000000e-04 eta: 5:34:30 time: 0.520254 data_time: 0.095388 memory: 20140 loss_kpt: 0.000613 acc_pose: 0.814318 loss: 0.000613 2022/09/26 13:32:47 - mmengine - INFO - Epoch(train) [61][150/293] lr: 5.000000e-04 eta: 5:34:19 time: 0.551954 data_time: 0.098583 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.838809 loss: 0.000626 2022/09/26 13:33:13 - mmengine - INFO - Epoch(train) [61][200/293] lr: 5.000000e-04 eta: 5:34:04 time: 0.527099 data_time: 0.100944 memory: 20140 loss_kpt: 0.000625 acc_pose: 0.856891 loss: 0.000625 2022/09/26 13:33:40 - mmengine - INFO - Epoch(train) [61][250/293] lr: 5.000000e-04 eta: 5:33:49 time: 0.525130 data_time: 0.093211 memory: 20140 loss_kpt: 0.000627 acc_pose: 0.840223 loss: 0.000627 2022/09/26 13:34:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:34:29 - mmengine - INFO - Epoch(train) [62][50/293] lr: 5.000000e-04 eta: 5:32:28 time: 0.536278 data_time: 0.111314 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.816466 loss: 0.000626 2022/09/26 13:34:54 - mmengine - INFO - Epoch(train) [62][100/293] lr: 5.000000e-04 eta: 5:32:12 time: 0.513491 data_time: 0.090252 memory: 20140 loss_kpt: 0.000613 acc_pose: 0.824880 loss: 0.000613 2022/09/26 13:35:09 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:35:21 - mmengine - INFO - Epoch(train) [62][150/293] lr: 5.000000e-04 eta: 5:31:58 time: 0.532051 data_time: 0.099950 memory: 20140 loss_kpt: 0.000610 acc_pose: 0.839741 loss: 0.000610 2022/09/26 13:35:47 - mmengine - INFO - Epoch(train) [62][200/293] lr: 5.000000e-04 eta: 5:31:44 time: 0.528096 data_time: 0.102677 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.797024 loss: 0.000609 2022/09/26 13:36:13 - mmengine - INFO - Epoch(train) [62][250/293] lr: 5.000000e-04 eta: 5:31:28 time: 0.519332 data_time: 0.093256 memory: 20140 loss_kpt: 0.000611 acc_pose: 0.825945 loss: 0.000611 2022/09/26 13:36:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:37:02 - mmengine - INFO - Epoch(train) [63][50/293] lr: 5.000000e-04 eta: 5:30:08 time: 0.535180 data_time: 0.114326 memory: 20140 loss_kpt: 0.000626 acc_pose: 0.843992 loss: 0.000626 2022/09/26 13:37:30 - mmengine - INFO - Epoch(train) [63][100/293] lr: 5.000000e-04 eta: 5:29:56 time: 0.548515 data_time: 0.106651 memory: 20140 loss_kpt: 0.000598 acc_pose: 0.840695 loss: 0.000598 2022/09/26 13:37:56 - mmengine - INFO - Epoch(train) [63][150/293] lr: 5.000000e-04 eta: 5:29:41 time: 0.526550 data_time: 0.094733 memory: 20140 loss_kpt: 0.000615 acc_pose: 0.838095 loss: 0.000615 2022/09/26 13:38:23 - mmengine - INFO - Epoch(train) [63][200/293] lr: 5.000000e-04 eta: 5:29:27 time: 0.531258 data_time: 0.095758 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.830500 loss: 0.000609 2022/09/26 13:38:49 - mmengine - INFO - Epoch(train) [63][250/293] lr: 5.000000e-04 eta: 5:29:12 time: 0.525790 data_time: 0.097166 memory: 20140 loss_kpt: 0.000612 acc_pose: 0.817099 loss: 0.000612 2022/09/26 13:39:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:39:39 - mmengine - INFO - Epoch(train) [64][50/293] lr: 5.000000e-04 eta: 5:27:54 time: 0.543693 data_time: 0.120202 memory: 20140 loss_kpt: 0.000614 acc_pose: 0.774709 loss: 0.000614 2022/09/26 13:40:05 - mmengine - INFO - Epoch(train) [64][100/293] lr: 5.000000e-04 eta: 5:27:38 time: 0.521273 data_time: 0.103481 memory: 20140 loss_kpt: 0.000614 acc_pose: 0.824734 loss: 0.000614 2022/09/26 13:40:32 - mmengine - INFO - Epoch(train) [64][150/293] lr: 5.000000e-04 eta: 5:27:25 time: 0.543516 data_time: 0.089552 memory: 20140 loss_kpt: 0.000615 acc_pose: 0.862173 loss: 0.000615 2022/09/26 13:40:59 - mmengine - INFO - Epoch(train) [64][200/293] lr: 5.000000e-04 eta: 5:27:12 time: 0.542981 data_time: 0.105966 memory: 20140 loss_kpt: 0.000604 acc_pose: 0.832496 loss: 0.000604 2022/09/26 13:41:25 - mmengine - INFO - Epoch(train) [64][250/293] lr: 5.000000e-04 eta: 5:26:56 time: 0.521092 data_time: 0.086955 memory: 20140 loss_kpt: 0.000616 acc_pose: 0.811169 loss: 0.000616 2022/09/26 13:41:49 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:42:15 - mmengine - INFO - Epoch(train) [65][50/293] lr: 5.000000e-04 eta: 5:25:37 time: 0.529028 data_time: 0.110136 memory: 20140 loss_kpt: 0.000599 acc_pose: 0.855981 loss: 0.000599 2022/09/26 13:42:42 - mmengine - INFO - Epoch(train) [65][100/293] lr: 5.000000e-04 eta: 5:25:23 time: 0.534931 data_time: 0.102268 memory: 20140 loss_kpt: 0.000594 acc_pose: 0.847906 loss: 0.000594 2022/09/26 13:43:09 - mmengine - INFO - Epoch(train) [65][150/293] lr: 5.000000e-04 eta: 5:25:09 time: 0.534173 data_time: 0.102987 memory: 20140 loss_kpt: 0.000607 acc_pose: 0.852231 loss: 0.000607 2022/09/26 13:43:36 - mmengine - INFO - Epoch(train) [65][200/293] lr: 5.000000e-04 eta: 5:24:55 time: 0.538524 data_time: 0.094236 memory: 20140 loss_kpt: 0.000619 acc_pose: 0.806107 loss: 0.000619 2022/09/26 13:44:01 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:44:02 - mmengine - INFO - Epoch(train) [65][250/293] lr: 5.000000e-04 eta: 5:24:40 time: 0.527590 data_time: 0.105927 memory: 20140 loss_kpt: 0.000616 acc_pose: 0.798219 loss: 0.000616 2022/09/26 13:44:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:44:52 - mmengine - INFO - Epoch(train) [66][50/293] lr: 5.000000e-04 eta: 5:23:25 time: 0.557805 data_time: 0.116271 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.834137 loss: 0.000603 2022/09/26 13:45:19 - mmengine - INFO - Epoch(train) [66][100/293] lr: 5.000000e-04 eta: 5:23:10 time: 0.530686 data_time: 0.102478 memory: 20140 loss_kpt: 0.000597 acc_pose: 0.887538 loss: 0.000597 2022/09/26 13:45:45 - mmengine - INFO - Epoch(train) [66][150/293] lr: 5.000000e-04 eta: 5:22:54 time: 0.524982 data_time: 0.103058 memory: 20140 loss_kpt: 0.000612 acc_pose: 0.807767 loss: 0.000612 2022/09/26 13:46:12 - mmengine - INFO - Epoch(train) [66][200/293] lr: 5.000000e-04 eta: 5:22:39 time: 0.526704 data_time: 0.083665 memory: 20140 loss_kpt: 0.000599 acc_pose: 0.823224 loss: 0.000599 2022/09/26 13:46:38 - mmengine - INFO - Epoch(train) [66][250/293] lr: 5.000000e-04 eta: 5:22:23 time: 0.523348 data_time: 0.097677 memory: 20140 loss_kpt: 0.000604 acc_pose: 0.818574 loss: 0.000604 2022/09/26 13:47:00 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:47:27 - mmengine - INFO - Epoch(train) [67][50/293] lr: 5.000000e-04 eta: 5:21:08 time: 0.548784 data_time: 0.104934 memory: 20140 loss_kpt: 0.000601 acc_pose: 0.861972 loss: 0.000601 2022/09/26 13:47:54 - mmengine - INFO - Epoch(train) [67][100/293] lr: 5.000000e-04 eta: 5:20:54 time: 0.538181 data_time: 0.105921 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.846512 loss: 0.000605 2022/09/26 13:48:21 - mmengine - INFO - Epoch(train) [67][150/293] lr: 5.000000e-04 eta: 5:20:39 time: 0.536541 data_time: 0.097855 memory: 20140 loss_kpt: 0.000602 acc_pose: 0.832016 loss: 0.000602 2022/09/26 13:48:48 - mmengine - INFO - Epoch(train) [67][200/293] lr: 5.000000e-04 eta: 5:20:25 time: 0.537744 data_time: 0.094296 memory: 20140 loss_kpt: 0.000602 acc_pose: 0.837418 loss: 0.000602 2022/09/26 13:49:14 - mmengine - INFO - Epoch(train) [67][250/293] lr: 5.000000e-04 eta: 5:20:09 time: 0.516815 data_time: 0.089416 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.808202 loss: 0.000609 2022/09/26 13:49:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:50:05 - mmengine - INFO - Epoch(train) [68][50/293] lr: 5.000000e-04 eta: 5:18:56 time: 0.566604 data_time: 0.108113 memory: 20140 loss_kpt: 0.000608 acc_pose: 0.792764 loss: 0.000608 2022/09/26 13:50:31 - mmengine - INFO - Epoch(train) [68][100/293] lr: 5.000000e-04 eta: 5:18:40 time: 0.526190 data_time: 0.094089 memory: 20140 loss_kpt: 0.000619 acc_pose: 0.827844 loss: 0.000619 2022/09/26 13:50:57 - mmengine - INFO - Epoch(train) [68][150/293] lr: 5.000000e-04 eta: 5:18:23 time: 0.515436 data_time: 0.091053 memory: 20140 loss_kpt: 0.000598 acc_pose: 0.809157 loss: 0.000598 2022/09/26 13:51:24 - mmengine - INFO - Epoch(train) [68][200/293] lr: 5.000000e-04 eta: 5:18:09 time: 0.534199 data_time: 0.099338 memory: 20140 loss_kpt: 0.000610 acc_pose: 0.822867 loss: 0.000610 2022/09/26 13:51:51 - mmengine - INFO - Epoch(train) [68][250/293] lr: 5.000000e-04 eta: 5:17:54 time: 0.538490 data_time: 0.101726 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.842398 loss: 0.000605 2022/09/26 13:52:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:52:40 - mmengine - INFO - Epoch(train) [69][50/293] lr: 5.000000e-04 eta: 5:16:40 time: 0.546714 data_time: 0.109339 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.810520 loss: 0.000609 2022/09/26 13:52:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:53:07 - mmengine - INFO - Epoch(train) [69][100/293] lr: 5.000000e-04 eta: 5:16:25 time: 0.531084 data_time: 0.102537 memory: 20140 loss_kpt: 0.000595 acc_pose: 0.832014 loss: 0.000595 2022/09/26 13:53:35 - mmengine - INFO - Epoch(train) [69][150/293] lr: 5.000000e-04 eta: 5:16:12 time: 0.553033 data_time: 0.093614 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.805912 loss: 0.000609 2022/09/26 13:54:01 - mmengine - INFO - Epoch(train) [69][200/293] lr: 5.000000e-04 eta: 5:15:56 time: 0.525414 data_time: 0.099502 memory: 20140 loss_kpt: 0.000608 acc_pose: 0.830510 loss: 0.000608 2022/09/26 13:54:28 - mmengine - INFO - Epoch(train) [69][250/293] lr: 5.000000e-04 eta: 5:15:42 time: 0.544425 data_time: 0.100517 memory: 20140 loss_kpt: 0.000590 acc_pose: 0.802267 loss: 0.000590 2022/09/26 13:54:51 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:55:19 - mmengine - INFO - Epoch(train) [70][50/293] lr: 5.000000e-04 eta: 5:14:29 time: 0.557890 data_time: 0.116524 memory: 20140 loss_kpt: 0.000602 acc_pose: 0.846531 loss: 0.000602 2022/09/26 13:55:45 - mmengine - INFO - Epoch(train) [70][100/293] lr: 5.000000e-04 eta: 5:14:12 time: 0.513405 data_time: 0.102137 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.822007 loss: 0.000605 2022/09/26 13:56:12 - mmengine - INFO - Epoch(train) [70][150/293] lr: 5.000000e-04 eta: 5:13:58 time: 0.545342 data_time: 0.093127 memory: 20140 loss_kpt: 0.000606 acc_pose: 0.826725 loss: 0.000606 2022/09/26 13:56:39 - mmengine - INFO - Epoch(train) [70][200/293] lr: 5.000000e-04 eta: 5:13:42 time: 0.529923 data_time: 0.104131 memory: 20140 loss_kpt: 0.000607 acc_pose: 0.834062 loss: 0.000607 2022/09/26 13:57:05 - mmengine - INFO - Epoch(train) [70][250/293] lr: 5.000000e-04 eta: 5:13:26 time: 0.525260 data_time: 0.091641 memory: 20140 loss_kpt: 0.000619 acc_pose: 0.870697 loss: 0.000619 2022/09/26 13:57:28 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 13:57:28 - mmengine - INFO - Saving checkpoint at 70 epochs 2022/09/26 13:57:40 - mmengine - INFO - Epoch(val) [70][50/407] eta: 0:01:00 time: 0.170837 data_time: 0.016649 memory: 20140 2022/09/26 13:57:49 - mmengine - INFO - Epoch(val) [70][100/407] eta: 0:00:51 time: 0.167704 data_time: 0.010924 memory: 1830 2022/09/26 13:57:57 - mmengine - INFO - Epoch(val) [70][150/407] eta: 0:00:41 time: 0.162402 data_time: 0.009364 memory: 1830 2022/09/26 13:58:05 - mmengine - INFO - Epoch(val) [70][200/407] eta: 0:00:34 time: 0.166102 data_time: 0.010498 memory: 1830 2022/09/26 13:58:14 - mmengine - INFO - Epoch(val) [70][250/407] eta: 0:00:26 time: 0.169990 data_time: 0.016173 memory: 1830 2022/09/26 13:58:22 - mmengine - INFO - Epoch(val) [70][300/407] eta: 0:00:17 time: 0.164310 data_time: 0.010275 memory: 1830 2022/09/26 13:58:30 - mmengine - INFO - Epoch(val) [70][350/407] eta: 0:00:09 time: 0.164761 data_time: 0.010508 memory: 1830 2022/09/26 13:58:39 - mmengine - INFO - Epoch(val) [70][400/407] eta: 0:00:01 time: 0.172939 data_time: 0.015452 memory: 1830 2022/09/26 13:59:12 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 13:59:24 - mmengine - INFO - Epoch(val) [70][407/407] coco/AP: 0.724998 coco/AP .5: 0.890406 coco/AP .75: 0.793683 coco/AP (M): 0.684890 coco/AP (L): 0.796100 coco/AR: 0.776622 coco/AR .5: 0.929471 coco/AR .75: 0.838791 coco/AR (M): 0.732532 coco/AR (L): 0.840468 2022/09/26 13:59:53 - mmengine - INFO - Epoch(train) [71][50/293] lr: 5.000000e-04 eta: 5:12:15 time: 0.560365 data_time: 0.107678 memory: 20140 loss_kpt: 0.000608 acc_pose: 0.830959 loss: 0.000608 2022/09/26 14:00:18 - mmengine - INFO - Epoch(train) [71][100/293] lr: 5.000000e-04 eta: 5:11:57 time: 0.514838 data_time: 0.102818 memory: 20140 loss_kpt: 0.000596 acc_pose: 0.833901 loss: 0.000596 2022/09/26 14:00:44 - mmengine - INFO - Epoch(train) [71][150/293] lr: 5.000000e-04 eta: 5:11:40 time: 0.508436 data_time: 0.091031 memory: 20140 loss_kpt: 0.000611 acc_pose: 0.829009 loss: 0.000611 2022/09/26 14:01:10 - mmengine - INFO - Epoch(train) [71][200/293] lr: 5.000000e-04 eta: 5:11:24 time: 0.527251 data_time: 0.087392 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.829015 loss: 0.000593 2022/09/26 14:01:36 - mmengine - INFO - Epoch(train) [71][250/293] lr: 5.000000e-04 eta: 5:11:07 time: 0.521402 data_time: 0.090794 memory: 20140 loss_kpt: 0.000591 acc_pose: 0.827740 loss: 0.000591 2022/09/26 14:02:00 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:02:27 - mmengine - INFO - Epoch(train) [72][50/293] lr: 5.000000e-04 eta: 5:09:54 time: 0.542697 data_time: 0.108381 memory: 20140 loss_kpt: 0.000601 acc_pose: 0.841822 loss: 0.000601 2022/09/26 14:02:53 - mmengine - INFO - Epoch(train) [72][100/293] lr: 5.000000e-04 eta: 5:09:38 time: 0.527591 data_time: 0.098726 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.848707 loss: 0.000603 2022/09/26 14:03:20 - mmengine - INFO - Epoch(train) [72][150/293] lr: 5.000000e-04 eta: 5:09:23 time: 0.534498 data_time: 0.097428 memory: 20140 loss_kpt: 0.000604 acc_pose: 0.816969 loss: 0.000604 2022/09/26 14:03:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:03:47 - mmengine - INFO - Epoch(train) [72][200/293] lr: 5.000000e-04 eta: 5:09:07 time: 0.535363 data_time: 0.101840 memory: 20140 loss_kpt: 0.000601 acc_pose: 0.827795 loss: 0.000601 2022/09/26 14:04:13 - mmengine - INFO - Epoch(train) [72][250/293] lr: 5.000000e-04 eta: 5:08:51 time: 0.523106 data_time: 0.101928 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.816789 loss: 0.000603 2022/09/26 14:04:35 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:05:04 - mmengine - INFO - Epoch(train) [73][50/293] lr: 5.000000e-04 eta: 5:07:41 time: 0.567750 data_time: 0.104546 memory: 20140 loss_kpt: 0.000590 acc_pose: 0.870854 loss: 0.000590 2022/09/26 14:05:29 - mmengine - INFO - Epoch(train) [73][100/293] lr: 5.000000e-04 eta: 5:07:24 time: 0.513149 data_time: 0.102516 memory: 20140 loss_kpt: 0.000598 acc_pose: 0.792779 loss: 0.000598 2022/09/26 14:05:56 - mmengine - INFO - Epoch(train) [73][150/293] lr: 5.000000e-04 eta: 5:07:08 time: 0.533127 data_time: 0.104447 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.852469 loss: 0.000593 2022/09/26 14:06:22 - mmengine - INFO - Epoch(train) [73][200/293] lr: 5.000000e-04 eta: 5:06:51 time: 0.524525 data_time: 0.102244 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.826016 loss: 0.000609 2022/09/26 14:06:48 - mmengine - INFO - Epoch(train) [73][250/293] lr: 5.000000e-04 eta: 5:06:35 time: 0.522002 data_time: 0.093785 memory: 20140 loss_kpt: 0.000597 acc_pose: 0.823460 loss: 0.000597 2022/09/26 14:07:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:07:38 - mmengine - INFO - Epoch(train) [74][50/293] lr: 5.000000e-04 eta: 5:05:24 time: 0.552827 data_time: 0.109399 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.857907 loss: 0.000593 2022/09/26 14:08:04 - mmengine - INFO - Epoch(train) [74][100/293] lr: 5.000000e-04 eta: 5:05:07 time: 0.516980 data_time: 0.102597 memory: 20140 loss_kpt: 0.000589 acc_pose: 0.776310 loss: 0.000589 2022/09/26 14:08:30 - mmengine - INFO - Epoch(train) [74][150/293] lr: 5.000000e-04 eta: 5:04:50 time: 0.523132 data_time: 0.102411 memory: 20140 loss_kpt: 0.000609 acc_pose: 0.839725 loss: 0.000609 2022/09/26 14:08:57 - mmengine - INFO - Epoch(train) [74][200/293] lr: 5.000000e-04 eta: 5:04:34 time: 0.532348 data_time: 0.096937 memory: 20140 loss_kpt: 0.000600 acc_pose: 0.837923 loss: 0.000600 2022/09/26 14:09:23 - mmengine - INFO - Epoch(train) [74][250/293] lr: 5.000000e-04 eta: 5:04:18 time: 0.533091 data_time: 0.100022 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.804366 loss: 0.000603 2022/09/26 14:09:46 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:10:12 - mmengine - INFO - Epoch(train) [75][50/293] lr: 5.000000e-04 eta: 5:03:06 time: 0.531323 data_time: 0.111022 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.890786 loss: 0.000593 2022/09/26 14:10:39 - mmengine - INFO - Epoch(train) [75][100/293] lr: 5.000000e-04 eta: 5:02:50 time: 0.531237 data_time: 0.107138 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.852848 loss: 0.000605 2022/09/26 14:11:06 - mmengine - INFO - Epoch(train) [75][150/293] lr: 5.000000e-04 eta: 5:02:36 time: 0.550557 data_time: 0.106049 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.864058 loss: 0.000603 2022/09/26 14:11:33 - mmengine - INFO - Epoch(train) [75][200/293] lr: 5.000000e-04 eta: 5:02:20 time: 0.537018 data_time: 0.099971 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.831898 loss: 0.000587 2022/09/26 14:12:00 - mmengine - INFO - Epoch(train) [75][250/293] lr: 5.000000e-04 eta: 5:02:04 time: 0.534169 data_time: 0.092726 memory: 20140 loss_kpt: 0.000601 acc_pose: 0.833992 loss: 0.000601 2022/09/26 14:12:22 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:12:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:12:49 - mmengine - INFO - Epoch(train) [76][50/293] lr: 5.000000e-04 eta: 5:00:55 time: 0.548726 data_time: 0.105219 memory: 20140 loss_kpt: 0.000592 acc_pose: 0.835891 loss: 0.000592 2022/09/26 14:13:15 - mmengine - INFO - Epoch(train) [76][100/293] lr: 5.000000e-04 eta: 5:00:38 time: 0.522087 data_time: 0.095187 memory: 20140 loss_kpt: 0.000605 acc_pose: 0.763006 loss: 0.000605 2022/09/26 14:13:42 - mmengine - INFO - Epoch(train) [76][150/293] lr: 5.000000e-04 eta: 5:00:21 time: 0.523724 data_time: 0.096059 memory: 20140 loss_kpt: 0.000595 acc_pose: 0.852101 loss: 0.000595 2022/09/26 14:14:08 - mmengine - INFO - Epoch(train) [76][200/293] lr: 5.000000e-04 eta: 5:00:04 time: 0.526059 data_time: 0.095150 memory: 20140 loss_kpt: 0.000588 acc_pose: 0.863545 loss: 0.000588 2022/09/26 14:14:35 - mmengine - INFO - Epoch(train) [76][250/293] lr: 5.000000e-04 eta: 4:59:48 time: 0.533818 data_time: 0.099302 memory: 20140 loss_kpt: 0.000594 acc_pose: 0.835547 loss: 0.000594 2022/09/26 14:14:57 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:15:25 - mmengine - INFO - Epoch(train) [77][50/293] lr: 5.000000e-04 eta: 4:58:40 time: 0.559103 data_time: 0.107737 memory: 20140 loss_kpt: 0.000596 acc_pose: 0.787829 loss: 0.000596 2022/09/26 14:15:51 - mmengine - INFO - Epoch(train) [77][100/293] lr: 5.000000e-04 eta: 4:58:23 time: 0.531349 data_time: 0.093810 memory: 20140 loss_kpt: 0.000584 acc_pose: 0.826460 loss: 0.000584 2022/09/26 14:16:17 - mmengine - INFO - Epoch(train) [77][150/293] lr: 5.000000e-04 eta: 4:58:06 time: 0.518185 data_time: 0.101748 memory: 20140 loss_kpt: 0.000611 acc_pose: 0.804629 loss: 0.000611 2022/09/26 14:16:44 - mmengine - INFO - Epoch(train) [77][200/293] lr: 5.000000e-04 eta: 4:57:49 time: 0.528241 data_time: 0.092364 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.847609 loss: 0.000585 2022/09/26 14:17:09 - mmengine - INFO - Epoch(train) [77][250/293] lr: 5.000000e-04 eta: 4:57:30 time: 0.507707 data_time: 0.090097 memory: 20140 loss_kpt: 0.000599 acc_pose: 0.818200 loss: 0.000599 2022/09/26 14:17:32 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:18:00 - mmengine - INFO - Epoch(train) [78][50/293] lr: 5.000000e-04 eta: 4:56:23 time: 0.557390 data_time: 0.132451 memory: 20140 loss_kpt: 0.000604 acc_pose: 0.837881 loss: 0.000604 2022/09/26 14:18:26 - mmengine - INFO - Epoch(train) [78][100/293] lr: 5.000000e-04 eta: 4:56:06 time: 0.528963 data_time: 0.109235 memory: 20140 loss_kpt: 0.000588 acc_pose: 0.820318 loss: 0.000588 2022/09/26 14:18:53 - mmengine - INFO - Epoch(train) [78][150/293] lr: 5.000000e-04 eta: 4:55:50 time: 0.536017 data_time: 0.108900 memory: 20140 loss_kpt: 0.000584 acc_pose: 0.844424 loss: 0.000584 2022/09/26 14:19:19 - mmengine - INFO - Epoch(train) [78][200/293] lr: 5.000000e-04 eta: 4:55:33 time: 0.528041 data_time: 0.094096 memory: 20140 loss_kpt: 0.000602 acc_pose: 0.872222 loss: 0.000602 2022/09/26 14:19:46 - mmengine - INFO - Epoch(train) [78][250/293] lr: 5.000000e-04 eta: 4:55:17 time: 0.535501 data_time: 0.096677 memory: 20140 loss_kpt: 0.000608 acc_pose: 0.838033 loss: 0.000608 2022/09/26 14:20:08 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:20:36 - mmengine - INFO - Epoch(train) [79][50/293] lr: 5.000000e-04 eta: 4:54:08 time: 0.542852 data_time: 0.118442 memory: 20140 loss_kpt: 0.000592 acc_pose: 0.841044 loss: 0.000592 2022/09/26 14:21:02 - mmengine - INFO - Epoch(train) [79][100/293] lr: 5.000000e-04 eta: 4:53:52 time: 0.530558 data_time: 0.098563 memory: 20140 loss_kpt: 0.000590 acc_pose: 0.802104 loss: 0.000590 2022/09/26 14:21:27 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:21:29 - mmengine - INFO - Epoch(train) [79][150/293] lr: 5.000000e-04 eta: 4:53:35 time: 0.528012 data_time: 0.096034 memory: 20140 loss_kpt: 0.000594 acc_pose: 0.849694 loss: 0.000594 2022/09/26 14:21:55 - mmengine - INFO - Epoch(train) [79][200/293] lr: 5.000000e-04 eta: 4:53:18 time: 0.532444 data_time: 0.082535 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.804445 loss: 0.000585 2022/09/26 14:22:22 - mmengine - INFO - Epoch(train) [79][250/293] lr: 5.000000e-04 eta: 4:53:02 time: 0.533892 data_time: 0.094709 memory: 20140 loss_kpt: 0.000590 acc_pose: 0.782460 loss: 0.000590 2022/09/26 14:22:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:23:12 - mmengine - INFO - Epoch(train) [80][50/293] lr: 5.000000e-04 eta: 4:51:54 time: 0.553066 data_time: 0.117014 memory: 20140 loss_kpt: 0.000579 acc_pose: 0.833141 loss: 0.000579 2022/09/26 14:23:39 - mmengine - INFO - Epoch(train) [80][100/293] lr: 5.000000e-04 eta: 4:51:38 time: 0.533073 data_time: 0.100661 memory: 20140 loss_kpt: 0.000598 acc_pose: 0.804771 loss: 0.000598 2022/09/26 14:24:06 - mmengine - INFO - Epoch(train) [80][150/293] lr: 5.000000e-04 eta: 4:51:22 time: 0.539104 data_time: 0.104952 memory: 20140 loss_kpt: 0.000599 acc_pose: 0.839166 loss: 0.000599 2022/09/26 14:24:32 - mmengine - INFO - Epoch(train) [80][200/293] lr: 5.000000e-04 eta: 4:51:04 time: 0.520997 data_time: 0.102861 memory: 20140 loss_kpt: 0.000600 acc_pose: 0.827888 loss: 0.000600 2022/09/26 14:24:58 - mmengine - INFO - Epoch(train) [80][250/293] lr: 5.000000e-04 eta: 4:50:47 time: 0.526158 data_time: 0.098697 memory: 20140 loss_kpt: 0.000583 acc_pose: 0.801662 loss: 0.000583 2022/09/26 14:25:21 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:25:21 - mmengine - INFO - Saving checkpoint at 80 epochs 2022/09/26 14:25:33 - mmengine - INFO - Epoch(val) [80][50/407] eta: 0:01:01 time: 0.171573 data_time: 0.016313 memory: 20140 2022/09/26 14:25:42 - mmengine - INFO - Epoch(val) [80][100/407] eta: 0:00:53 time: 0.174542 data_time: 0.016634 memory: 1830 2022/09/26 14:25:51 - mmengine - INFO - Epoch(val) [80][150/407] eta: 0:00:42 time: 0.166498 data_time: 0.013219 memory: 1830 2022/09/26 14:25:59 - mmengine - INFO - Epoch(val) [80][200/407] eta: 0:00:33 time: 0.163773 data_time: 0.009966 memory: 1830 2022/09/26 14:26:07 - mmengine - INFO - Epoch(val) [80][250/407] eta: 0:00:26 time: 0.169270 data_time: 0.011758 memory: 1830 2022/09/26 14:26:16 - mmengine - INFO - Epoch(val) [80][300/407] eta: 0:00:17 time: 0.167522 data_time: 0.010664 memory: 1830 2022/09/26 14:26:24 - mmengine - INFO - Epoch(val) [80][350/407] eta: 0:00:09 time: 0.167340 data_time: 0.010005 memory: 1830 2022/09/26 14:26:32 - mmengine - INFO - Epoch(val) [80][400/407] eta: 0:00:01 time: 0.163021 data_time: 0.010067 memory: 1830 2022/09/26 14:27:04 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 14:27:17 - mmengine - INFO - Epoch(val) [80][407/407] coco/AP: 0.728713 coco/AP .5: 0.896494 coco/AP .75: 0.798062 coco/AP (M): 0.686277 coco/AP (L): 0.801804 coco/AR: 0.780101 coco/AR .5: 0.932147 coco/AR .75: 0.840680 coco/AR (M): 0.733106 coco/AR (L): 0.846860 2022/09/26 14:27:17 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_60.pth is removed 2022/09/26 14:27:19 - mmengine - INFO - The best checkpoint with 0.7287 coco/AP at 80 epoch is saved to best_coco/AP_epoch_80.pth. 2022/09/26 14:27:46 - mmengine - INFO - Epoch(train) [81][50/293] lr: 5.000000e-04 eta: 4:49:38 time: 0.532529 data_time: 0.109184 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.851048 loss: 0.000585 2022/09/26 14:28:13 - mmengine - INFO - Epoch(train) [81][100/293] lr: 5.000000e-04 eta: 4:49:22 time: 0.532737 data_time: 0.103633 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.843818 loss: 0.000587 2022/09/26 14:28:39 - mmengine - INFO - Epoch(train) [81][150/293] lr: 5.000000e-04 eta: 4:49:04 time: 0.526399 data_time: 0.106473 memory: 20140 loss_kpt: 0.000594 acc_pose: 0.825803 loss: 0.000594 2022/09/26 14:29:05 - mmengine - INFO - Epoch(train) [81][200/293] lr: 5.000000e-04 eta: 4:48:46 time: 0.516724 data_time: 0.102345 memory: 20140 loss_kpt: 0.000590 acc_pose: 0.822267 loss: 0.000590 2022/09/26 14:29:31 - mmengine - INFO - Epoch(train) [81][250/293] lr: 5.000000e-04 eta: 4:48:28 time: 0.512741 data_time: 0.090237 memory: 20140 loss_kpt: 0.000604 acc_pose: 0.814877 loss: 0.000604 2022/09/26 14:29:55 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:30:22 - mmengine - INFO - Epoch(train) [82][50/293] lr: 5.000000e-04 eta: 4:47:21 time: 0.548044 data_time: 0.111208 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.854274 loss: 0.000587 2022/09/26 14:30:48 - mmengine - INFO - Epoch(train) [82][100/293] lr: 5.000000e-04 eta: 4:47:04 time: 0.528442 data_time: 0.105829 memory: 20140 loss_kpt: 0.000567 acc_pose: 0.830361 loss: 0.000567 2022/09/26 14:31:15 - mmengine - INFO - Epoch(train) [82][150/293] lr: 5.000000e-04 eta: 4:46:47 time: 0.528206 data_time: 0.102138 memory: 20140 loss_kpt: 0.000584 acc_pose: 0.807921 loss: 0.000584 2022/09/26 14:31:41 - mmengine - INFO - Epoch(train) [82][200/293] lr: 5.000000e-04 eta: 4:46:30 time: 0.528563 data_time: 0.097221 memory: 20140 loss_kpt: 0.000592 acc_pose: 0.868201 loss: 0.000592 2022/09/26 14:32:07 - mmengine - INFO - Epoch(train) [82][250/293] lr: 5.000000e-04 eta: 4:46:12 time: 0.516497 data_time: 0.098610 memory: 20140 loss_kpt: 0.000591 acc_pose: 0.798916 loss: 0.000591 2022/09/26 14:32:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:32:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:32:56 - mmengine - INFO - Epoch(train) [83][50/293] lr: 5.000000e-04 eta: 4:45:05 time: 0.542109 data_time: 0.110810 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.851966 loss: 0.000587 2022/09/26 14:33:23 - mmengine - INFO - Epoch(train) [83][100/293] lr: 5.000000e-04 eta: 4:44:48 time: 0.527989 data_time: 0.107774 memory: 20140 loss_kpt: 0.000586 acc_pose: 0.835071 loss: 0.000586 2022/09/26 14:33:48 - mmengine - INFO - Epoch(train) [83][150/293] lr: 5.000000e-04 eta: 4:44:30 time: 0.519540 data_time: 0.106261 memory: 20140 loss_kpt: 0.000595 acc_pose: 0.812037 loss: 0.000595 2022/09/26 14:34:15 - mmengine - INFO - Epoch(train) [83][200/293] lr: 5.000000e-04 eta: 4:44:12 time: 0.529838 data_time: 0.111445 memory: 20140 loss_kpt: 0.000577 acc_pose: 0.772574 loss: 0.000577 2022/09/26 14:34:41 - mmengine - INFO - Epoch(train) [83][250/293] lr: 5.000000e-04 eta: 4:43:54 time: 0.518926 data_time: 0.102631 memory: 20140 loss_kpt: 0.000582 acc_pose: 0.815484 loss: 0.000582 2022/09/26 14:35:04 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:35:30 - mmengine - INFO - Epoch(train) [84][50/293] lr: 5.000000e-04 eta: 4:42:47 time: 0.527080 data_time: 0.107068 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.858497 loss: 0.000581 2022/09/26 14:35:57 - mmengine - INFO - Epoch(train) [84][100/293] lr: 5.000000e-04 eta: 4:42:30 time: 0.532290 data_time: 0.098750 memory: 20140 loss_kpt: 0.000586 acc_pose: 0.834508 loss: 0.000586 2022/09/26 14:36:23 - mmengine - INFO - Epoch(train) [84][150/293] lr: 5.000000e-04 eta: 4:42:12 time: 0.521627 data_time: 0.097596 memory: 20140 loss_kpt: 0.000603 acc_pose: 0.821568 loss: 0.000603 2022/09/26 14:36:49 - mmengine - INFO - Epoch(train) [84][200/293] lr: 5.000000e-04 eta: 4:41:54 time: 0.522850 data_time: 0.094774 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.843637 loss: 0.000575 2022/09/26 14:37:16 - mmengine - INFO - Epoch(train) [84][250/293] lr: 5.000000e-04 eta: 4:41:37 time: 0.534839 data_time: 0.102521 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.831568 loss: 0.000581 2022/09/26 14:37:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:38:06 - mmengine - INFO - Epoch(train) [85][50/293] lr: 5.000000e-04 eta: 4:40:33 time: 0.553447 data_time: 0.118829 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.852934 loss: 0.000587 2022/09/26 14:38:34 - mmengine - INFO - Epoch(train) [85][100/293] lr: 5.000000e-04 eta: 4:40:17 time: 0.554935 data_time: 0.095124 memory: 20140 loss_kpt: 0.000591 acc_pose: 0.819369 loss: 0.000591 2022/09/26 14:39:01 - mmengine - INFO - Epoch(train) [85][150/293] lr: 5.000000e-04 eta: 4:40:01 time: 0.545099 data_time: 0.110852 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.837917 loss: 0.000576 2022/09/26 14:39:27 - mmengine - INFO - Epoch(train) [85][200/293] lr: 5.000000e-04 eta: 4:39:42 time: 0.513812 data_time: 0.098016 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.836934 loss: 0.000585 2022/09/26 14:39:53 - mmengine - INFO - Epoch(train) [85][250/293] lr: 5.000000e-04 eta: 4:39:24 time: 0.526908 data_time: 0.100539 memory: 20140 loss_kpt: 0.000586 acc_pose: 0.835224 loss: 0.000586 2022/09/26 14:40:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:40:44 - mmengine - INFO - Epoch(train) [86][50/293] lr: 5.000000e-04 eta: 4:38:20 time: 0.555577 data_time: 0.112847 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.857225 loss: 0.000585 2022/09/26 14:41:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:41:10 - mmengine - INFO - Epoch(train) [86][100/293] lr: 5.000000e-04 eta: 4:38:03 time: 0.525928 data_time: 0.101417 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.879506 loss: 0.000569 2022/09/26 14:41:36 - mmengine - INFO - Epoch(train) [86][150/293] lr: 5.000000e-04 eta: 4:37:45 time: 0.528061 data_time: 0.096927 memory: 20140 loss_kpt: 0.000591 acc_pose: 0.749947 loss: 0.000591 2022/09/26 14:42:03 - mmengine - INFO - Epoch(train) [86][200/293] lr: 5.000000e-04 eta: 4:37:28 time: 0.533980 data_time: 0.101091 memory: 20140 loss_kpt: 0.000588 acc_pose: 0.828131 loss: 0.000588 2022/09/26 14:42:30 - mmengine - INFO - Epoch(train) [86][250/293] lr: 5.000000e-04 eta: 4:37:10 time: 0.531769 data_time: 0.102509 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.863614 loss: 0.000593 2022/09/26 14:42:52 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:43:19 - mmengine - INFO - Epoch(train) [87][50/293] lr: 5.000000e-04 eta: 4:36:06 time: 0.550349 data_time: 0.118759 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.819377 loss: 0.000571 2022/09/26 14:43:45 - mmengine - INFO - Epoch(train) [87][100/293] lr: 5.000000e-04 eta: 4:35:47 time: 0.514046 data_time: 0.101773 memory: 20140 loss_kpt: 0.000579 acc_pose: 0.846906 loss: 0.000579 2022/09/26 14:44:11 - mmengine - INFO - Epoch(train) [87][150/293] lr: 5.000000e-04 eta: 4:35:30 time: 0.526784 data_time: 0.101578 memory: 20140 loss_kpt: 0.000593 acc_pose: 0.836990 loss: 0.000593 2022/09/26 14:44:38 - mmengine - INFO - Epoch(train) [87][200/293] lr: 5.000000e-04 eta: 4:35:13 time: 0.541446 data_time: 0.110346 memory: 20140 loss_kpt: 0.000580 acc_pose: 0.835524 loss: 0.000580 2022/09/26 14:45:05 - mmengine - INFO - Epoch(train) [87][250/293] lr: 5.000000e-04 eta: 4:34:55 time: 0.529926 data_time: 0.098566 memory: 20140 loss_kpt: 0.000582 acc_pose: 0.850383 loss: 0.000582 2022/09/26 14:45:27 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:45:54 - mmengine - INFO - Epoch(train) [88][50/293] lr: 5.000000e-04 eta: 4:33:50 time: 0.532355 data_time: 0.103120 memory: 20140 loss_kpt: 0.000584 acc_pose: 0.864524 loss: 0.000584 2022/09/26 14:46:20 - mmengine - INFO - Epoch(train) [88][100/293] lr: 5.000000e-04 eta: 4:33:32 time: 0.530103 data_time: 0.100537 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.833904 loss: 0.000576 2022/09/26 14:46:47 - mmengine - INFO - Epoch(train) [88][150/293] lr: 5.000000e-04 eta: 4:33:15 time: 0.532111 data_time: 0.106247 memory: 20140 loss_kpt: 0.000591 acc_pose: 0.801544 loss: 0.000591 2022/09/26 14:47:13 - mmengine - INFO - Epoch(train) [88][200/293] lr: 5.000000e-04 eta: 4:32:57 time: 0.523935 data_time: 0.096131 memory: 20140 loss_kpt: 0.000577 acc_pose: 0.840236 loss: 0.000577 2022/09/26 14:47:40 - mmengine - INFO - Epoch(train) [88][250/293] lr: 5.000000e-04 eta: 4:32:40 time: 0.546588 data_time: 0.096121 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.834414 loss: 0.000581 2022/09/26 14:48:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:48:30 - mmengine - INFO - Epoch(train) [89][50/293] lr: 5.000000e-04 eta: 4:31:36 time: 0.540499 data_time: 0.111687 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.852339 loss: 0.000569 2022/09/26 14:48:57 - mmengine - INFO - Epoch(train) [89][100/293] lr: 5.000000e-04 eta: 4:31:19 time: 0.533312 data_time: 0.099839 memory: 20140 loss_kpt: 0.000582 acc_pose: 0.852503 loss: 0.000582 2022/09/26 14:49:23 - mmengine - INFO - Epoch(train) [89][150/293] lr: 5.000000e-04 eta: 4:31:01 time: 0.525531 data_time: 0.100809 memory: 20140 loss_kpt: 0.000589 acc_pose: 0.790863 loss: 0.000589 2022/09/26 14:49:50 - mmengine - INFO - Epoch(train) [89][200/293] lr: 5.000000e-04 eta: 4:30:42 time: 0.526582 data_time: 0.098786 memory: 20140 loss_kpt: 0.000574 acc_pose: 0.848854 loss: 0.000574 2022/09/26 14:49:58 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:50:16 - mmengine - INFO - Epoch(train) [89][250/293] lr: 5.000000e-04 eta: 4:30:24 time: 0.520601 data_time: 0.089803 memory: 20140 loss_kpt: 0.000580 acc_pose: 0.809679 loss: 0.000580 2022/09/26 14:50:38 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:51:05 - mmengine - INFO - Epoch(train) [90][50/293] lr: 5.000000e-04 eta: 4:29:20 time: 0.536308 data_time: 0.113159 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.857250 loss: 0.000585 2022/09/26 14:51:31 - mmengine - INFO - Epoch(train) [90][100/293] lr: 5.000000e-04 eta: 4:29:02 time: 0.523331 data_time: 0.099735 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.861395 loss: 0.000581 2022/09/26 14:51:57 - mmengine - INFO - Epoch(train) [90][150/293] lr: 5.000000e-04 eta: 4:28:44 time: 0.526073 data_time: 0.103133 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.852858 loss: 0.000581 2022/09/26 14:52:23 - mmengine - INFO - Epoch(train) [90][200/293] lr: 5.000000e-04 eta: 4:28:25 time: 0.514538 data_time: 0.092590 memory: 20140 loss_kpt: 0.000574 acc_pose: 0.826457 loss: 0.000574 2022/09/26 14:52:50 - mmengine - INFO - Epoch(train) [90][250/293] lr: 5.000000e-04 eta: 4:28:07 time: 0.529225 data_time: 0.090983 memory: 20140 loss_kpt: 0.000592 acc_pose: 0.844319 loss: 0.000592 2022/09/26 14:53:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:53:13 - mmengine - INFO - Saving checkpoint at 90 epochs 2022/09/26 14:53:27 - mmengine - INFO - Epoch(val) [90][50/407] eta: 0:01:03 time: 0.176524 data_time: 0.023805 memory: 20140 2022/09/26 14:53:35 - mmengine - INFO - Epoch(val) [90][100/407] eta: 0:00:51 time: 0.168977 data_time: 0.009993 memory: 1830 2022/09/26 14:53:44 - mmengine - INFO - Epoch(val) [90][150/407] eta: 0:00:47 time: 0.182911 data_time: 0.021785 memory: 1830 2022/09/26 14:53:53 - mmengine - INFO - Epoch(val) [90][200/407] eta: 0:00:35 time: 0.169274 data_time: 0.014967 memory: 1830 2022/09/26 14:54:01 - mmengine - INFO - Epoch(val) [90][250/407] eta: 0:00:25 time: 0.164418 data_time: 0.009718 memory: 1830 2022/09/26 14:54:09 - mmengine - INFO - Epoch(val) [90][300/407] eta: 0:00:17 time: 0.163607 data_time: 0.010262 memory: 1830 2022/09/26 14:54:18 - mmengine - INFO - Epoch(val) [90][350/407] eta: 0:00:09 time: 0.171175 data_time: 0.018422 memory: 1830 2022/09/26 14:54:26 - mmengine - INFO - Epoch(val) [90][400/407] eta: 0:00:01 time: 0.162578 data_time: 0.009306 memory: 1830 2022/09/26 14:54:58 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 14:55:11 - mmengine - INFO - Epoch(val) [90][407/407] coco/AP: 0.731189 coco/AP .5: 0.897017 coco/AP .75: 0.799548 coco/AP (M): 0.689283 coco/AP (L): 0.802661 coco/AR: 0.782053 coco/AR .5: 0.934351 coco/AR .75: 0.843829 coco/AR (M): 0.736984 coco/AR (L): 0.847157 2022/09/26 14:55:11 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_80.pth is removed 2022/09/26 14:55:13 - mmengine - INFO - The best checkpoint with 0.7312 coco/AP at 90 epoch is saved to best_coco/AP_epoch_90.pth. 2022/09/26 14:55:41 - mmengine - INFO - Epoch(train) [91][50/293] lr: 5.000000e-04 eta: 4:27:04 time: 0.545858 data_time: 0.114846 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.833724 loss: 0.000569 2022/09/26 14:56:07 - mmengine - INFO - Epoch(train) [91][100/293] lr: 5.000000e-04 eta: 4:26:46 time: 0.532225 data_time: 0.106207 memory: 20140 loss_kpt: 0.000585 acc_pose: 0.837449 loss: 0.000585 2022/09/26 14:56:35 - mmengine - INFO - Epoch(train) [91][150/293] lr: 5.000000e-04 eta: 4:26:29 time: 0.546221 data_time: 0.096284 memory: 20140 loss_kpt: 0.000583 acc_pose: 0.849070 loss: 0.000583 2022/09/26 14:57:01 - mmengine - INFO - Epoch(train) [91][200/293] lr: 5.000000e-04 eta: 4:26:11 time: 0.527932 data_time: 0.083558 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.781607 loss: 0.000587 2022/09/26 14:57:28 - mmengine - INFO - Epoch(train) [91][250/293] lr: 5.000000e-04 eta: 4:25:54 time: 0.536778 data_time: 0.101835 memory: 20140 loss_kpt: 0.000567 acc_pose: 0.846350 loss: 0.000567 2022/09/26 14:57:49 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 14:58:17 - mmengine - INFO - Epoch(train) [92][50/293] lr: 5.000000e-04 eta: 4:24:52 time: 0.560897 data_time: 0.117667 memory: 20140 loss_kpt: 0.000583 acc_pose: 0.844189 loss: 0.000583 2022/09/26 14:58:44 - mmengine - INFO - Epoch(train) [92][100/293] lr: 5.000000e-04 eta: 4:24:34 time: 0.520622 data_time: 0.108763 memory: 20140 loss_kpt: 0.000580 acc_pose: 0.871232 loss: 0.000580 2022/09/26 14:59:10 - mmengine - INFO - Epoch(train) [92][150/293] lr: 5.000000e-04 eta: 4:24:15 time: 0.521747 data_time: 0.106433 memory: 20140 loss_kpt: 0.000567 acc_pose: 0.850002 loss: 0.000567 2022/09/26 14:59:36 - mmengine - INFO - Epoch(train) [92][200/293] lr: 5.000000e-04 eta: 4:23:57 time: 0.534565 data_time: 0.103450 memory: 20140 loss_kpt: 0.000572 acc_pose: 0.823322 loss: 0.000572 2022/09/26 15:00:03 - mmengine - INFO - Epoch(train) [92][250/293] lr: 5.000000e-04 eta: 4:23:39 time: 0.529035 data_time: 0.104701 memory: 20140 loss_kpt: 0.000582 acc_pose: 0.868108 loss: 0.000582 2022/09/26 15:00:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:00:49 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:00:52 - mmengine - INFO - Epoch(train) [93][50/293] lr: 5.000000e-04 eta: 4:22:37 time: 0.542331 data_time: 0.105053 memory: 20140 loss_kpt: 0.000581 acc_pose: 0.822138 loss: 0.000581 2022/09/26 15:01:19 - mmengine - INFO - Epoch(train) [93][100/293] lr: 5.000000e-04 eta: 4:22:18 time: 0.526726 data_time: 0.105173 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.859948 loss: 0.000556 2022/09/26 15:01:45 - mmengine - INFO - Epoch(train) [93][150/293] lr: 5.000000e-04 eta: 4:22:00 time: 0.521736 data_time: 0.102069 memory: 20140 loss_kpt: 0.000573 acc_pose: 0.795017 loss: 0.000573 2022/09/26 15:02:10 - mmengine - INFO - Epoch(train) [93][200/293] lr: 5.000000e-04 eta: 4:21:40 time: 0.506014 data_time: 0.093774 memory: 20140 loss_kpt: 0.000577 acc_pose: 0.892759 loss: 0.000577 2022/09/26 15:02:37 - mmengine - INFO - Epoch(train) [93][250/293] lr: 5.000000e-04 eta: 4:21:22 time: 0.530716 data_time: 0.106242 memory: 20140 loss_kpt: 0.000586 acc_pose: 0.840461 loss: 0.000586 2022/09/26 15:02:59 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:03:26 - mmengine - INFO - Epoch(train) [94][50/293] lr: 5.000000e-04 eta: 4:20:20 time: 0.535889 data_time: 0.117306 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.824606 loss: 0.000575 2022/09/26 15:03:52 - mmengine - INFO - Epoch(train) [94][100/293] lr: 5.000000e-04 eta: 4:20:01 time: 0.524286 data_time: 0.109691 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.823542 loss: 0.000571 2022/09/26 15:04:18 - mmengine - INFO - Epoch(train) [94][150/293] lr: 5.000000e-04 eta: 4:19:43 time: 0.529705 data_time: 0.097673 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.879753 loss: 0.000571 2022/09/26 15:04:45 - mmengine - INFO - Epoch(train) [94][200/293] lr: 5.000000e-04 eta: 4:19:25 time: 0.534352 data_time: 0.106135 memory: 20140 loss_kpt: 0.000594 acc_pose: 0.856466 loss: 0.000594 2022/09/26 15:05:12 - mmengine - INFO - Epoch(train) [94][250/293] lr: 5.000000e-04 eta: 4:19:07 time: 0.531511 data_time: 0.102769 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.814037 loss: 0.000587 2022/09/26 15:05:34 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:06:01 - mmengine - INFO - Epoch(train) [95][50/293] lr: 5.000000e-04 eta: 4:18:05 time: 0.536746 data_time: 0.103013 memory: 20140 loss_kpt: 0.000565 acc_pose: 0.855253 loss: 0.000565 2022/09/26 15:06:27 - mmengine - INFO - Epoch(train) [95][100/293] lr: 5.000000e-04 eta: 4:17:47 time: 0.528885 data_time: 0.102842 memory: 20140 loss_kpt: 0.000570 acc_pose: 0.869197 loss: 0.000570 2022/09/26 15:06:54 - mmengine - INFO - Epoch(train) [95][150/293] lr: 5.000000e-04 eta: 4:17:28 time: 0.533016 data_time: 0.107740 memory: 20140 loss_kpt: 0.000582 acc_pose: 0.847102 loss: 0.000582 2022/09/26 15:07:20 - mmengine - INFO - Epoch(train) [95][200/293] lr: 5.000000e-04 eta: 4:17:10 time: 0.534276 data_time: 0.102813 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.851902 loss: 0.000576 2022/09/26 15:07:47 - mmengine - INFO - Epoch(train) [95][250/293] lr: 5.000000e-04 eta: 4:16:52 time: 0.529928 data_time: 0.104034 memory: 20140 loss_kpt: 0.000578 acc_pose: 0.869321 loss: 0.000578 2022/09/26 15:08:09 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:08:36 - mmengine - INFO - Epoch(train) [96][50/293] lr: 5.000000e-04 eta: 4:15:51 time: 0.544498 data_time: 0.112654 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.851132 loss: 0.000571 2022/09/26 15:09:02 - mmengine - INFO - Epoch(train) [96][100/293] lr: 5.000000e-04 eta: 4:15:32 time: 0.513772 data_time: 0.097565 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.833813 loss: 0.000576 2022/09/26 15:09:28 - mmengine - INFO - Epoch(train) [96][150/293] lr: 5.000000e-04 eta: 4:15:13 time: 0.532914 data_time: 0.105022 memory: 20140 loss_kpt: 0.000558 acc_pose: 0.844851 loss: 0.000558 2022/09/26 15:09:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:09:55 - mmengine - INFO - Epoch(train) [96][200/293] lr: 5.000000e-04 eta: 4:14:56 time: 0.538841 data_time: 0.105140 memory: 20140 loss_kpt: 0.000578 acc_pose: 0.868320 loss: 0.000578 2022/09/26 15:10:22 - mmengine - INFO - Epoch(train) [96][250/293] lr: 5.000000e-04 eta: 4:14:38 time: 0.537744 data_time: 0.107068 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.883383 loss: 0.000571 2022/09/26 15:10:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:11:11 - mmengine - INFO - Epoch(train) [97][50/293] lr: 5.000000e-04 eta: 4:13:37 time: 0.535849 data_time: 0.111720 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.811117 loss: 0.000560 2022/09/26 15:11:38 - mmengine - INFO - Epoch(train) [97][100/293] lr: 5.000000e-04 eta: 4:13:19 time: 0.542569 data_time: 0.101051 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.849164 loss: 0.000564 2022/09/26 15:12:05 - mmengine - INFO - Epoch(train) [97][150/293] lr: 5.000000e-04 eta: 4:13:00 time: 0.530189 data_time: 0.103628 memory: 20140 loss_kpt: 0.000587 acc_pose: 0.849238 loss: 0.000587 2022/09/26 15:12:31 - mmengine - INFO - Epoch(train) [97][200/293] lr: 5.000000e-04 eta: 4:12:41 time: 0.522543 data_time: 0.103340 memory: 20140 loss_kpt: 0.000579 acc_pose: 0.834754 loss: 0.000579 2022/09/26 15:12:58 - mmengine - INFO - Epoch(train) [97][250/293] lr: 5.000000e-04 eta: 4:12:23 time: 0.538930 data_time: 0.097848 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.835829 loss: 0.000569 2022/09/26 15:13:21 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:13:48 - mmengine - INFO - Epoch(train) [98][50/293] lr: 5.000000e-04 eta: 4:11:23 time: 0.536798 data_time: 0.114148 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.853199 loss: 0.000576 2022/09/26 15:14:14 - mmengine - INFO - Epoch(train) [98][100/293] lr: 5.000000e-04 eta: 4:11:04 time: 0.522930 data_time: 0.097240 memory: 20140 loss_kpt: 0.000572 acc_pose: 0.858355 loss: 0.000572 2022/09/26 15:14:40 - mmengine - INFO - Epoch(train) [98][150/293] lr: 5.000000e-04 eta: 4:10:45 time: 0.534937 data_time: 0.093715 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.899769 loss: 0.000560 2022/09/26 15:15:07 - mmengine - INFO - Epoch(train) [98][200/293] lr: 5.000000e-04 eta: 4:10:27 time: 0.531409 data_time: 0.097794 memory: 20140 loss_kpt: 0.000563 acc_pose: 0.862301 loss: 0.000563 2022/09/26 15:15:34 - mmengine - INFO - Epoch(train) [98][250/293] lr: 5.000000e-04 eta: 4:10:08 time: 0.530935 data_time: 0.101661 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.840778 loss: 0.000575 2022/09/26 15:15:56 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:16:23 - mmengine - INFO - Epoch(train) [99][50/293] lr: 5.000000e-04 eta: 4:09:08 time: 0.538510 data_time: 0.109516 memory: 20140 loss_kpt: 0.000565 acc_pose: 0.855233 loss: 0.000565 2022/09/26 15:16:49 - mmengine - INFO - Epoch(train) [99][100/293] lr: 5.000000e-04 eta: 4:08:49 time: 0.529240 data_time: 0.106889 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.838456 loss: 0.000566 2022/09/26 15:17:16 - mmengine - INFO - Epoch(train) [99][150/293] lr: 5.000000e-04 eta: 4:08:30 time: 0.523615 data_time: 0.104739 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.818430 loss: 0.000571 2022/09/26 15:17:41 - mmengine - INFO - Epoch(train) [99][200/293] lr: 5.000000e-04 eta: 4:08:11 time: 0.516258 data_time: 0.104403 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.830439 loss: 0.000575 2022/09/26 15:18:09 - mmengine - INFO - Epoch(train) [99][250/293] lr: 5.000000e-04 eta: 4:07:54 time: 0.560844 data_time: 0.101919 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.852350 loss: 0.000571 2022/09/26 15:18:28 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:18:31 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:18:59 - mmengine - INFO - Epoch(train) [100][50/293] lr: 5.000000e-04 eta: 4:06:55 time: 0.548236 data_time: 0.107607 memory: 20140 loss_kpt: 0.000573 acc_pose: 0.801552 loss: 0.000573 2022/09/26 15:19:25 - mmengine - INFO - Epoch(train) [100][100/293] lr: 5.000000e-04 eta: 4:06:35 time: 0.517360 data_time: 0.095699 memory: 20140 loss_kpt: 0.000574 acc_pose: 0.863076 loss: 0.000574 2022/09/26 15:19:52 - mmengine - INFO - Epoch(train) [100][150/293] lr: 5.000000e-04 eta: 4:06:18 time: 0.546466 data_time: 0.107520 memory: 20140 loss_kpt: 0.000574 acc_pose: 0.849091 loss: 0.000574 2022/09/26 15:20:19 - mmengine - INFO - Epoch(train) [100][200/293] lr: 5.000000e-04 eta: 4:05:59 time: 0.534114 data_time: 0.108381 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.860914 loss: 0.000575 2022/09/26 15:20:45 - mmengine - INFO - Epoch(train) [100][250/293] lr: 5.000000e-04 eta: 4:05:40 time: 0.522983 data_time: 0.100774 memory: 20140 loss_kpt: 0.000572 acc_pose: 0.859839 loss: 0.000572 2022/09/26 15:21:09 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:21:09 - mmengine - INFO - Saving checkpoint at 100 epochs 2022/09/26 15:21:21 - mmengine - INFO - Epoch(val) [100][50/407] eta: 0:01:04 time: 0.181054 data_time: 0.026675 memory: 20140 2022/09/26 15:21:30 - mmengine - INFO - Epoch(val) [100][100/407] eta: 0:00:52 time: 0.170117 data_time: 0.010815 memory: 1830 2022/09/26 15:21:39 - mmengine - INFO - Epoch(val) [100][150/407] eta: 0:00:46 time: 0.180442 data_time: 0.022623 memory: 1830 2022/09/26 15:21:47 - mmengine - INFO - Epoch(val) [100][200/407] eta: 0:00:35 time: 0.172783 data_time: 0.016641 memory: 1830 2022/09/26 15:21:56 - mmengine - INFO - Epoch(val) [100][250/407] eta: 0:00:25 time: 0.162350 data_time: 0.010648 memory: 1830 2022/09/26 15:22:04 - mmengine - INFO - Epoch(val) [100][300/407] eta: 0:00:17 time: 0.167380 data_time: 0.014420 memory: 1830 2022/09/26 15:22:12 - mmengine - INFO - Epoch(val) [100][350/407] eta: 0:00:09 time: 0.166121 data_time: 0.010729 memory: 1830 2022/09/26 15:22:20 - mmengine - INFO - Epoch(val) [100][400/407] eta: 0:00:01 time: 0.161460 data_time: 0.009227 memory: 1830 2022/09/26 15:22:54 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 15:23:06 - mmengine - INFO - Epoch(val) [100][407/407] coco/AP: 0.732574 coco/AP .5: 0.898168 coco/AP .75: 0.799850 coco/AP (M): 0.692036 coco/AP (L): 0.804421 coco/AR: 0.786193 coco/AR .5: 0.936555 coco/AR .75: 0.846820 coco/AR (M): 0.739771 coco/AR (L): 0.853103 2022/09/26 15:23:07 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_90.pth is removed 2022/09/26 15:23:09 - mmengine - INFO - The best checkpoint with 0.7326 coco/AP at 100 epoch is saved to best_coco/AP_epoch_100.pth. 2022/09/26 15:23:35 - mmengine - INFO - Epoch(train) [101][50/293] lr: 5.000000e-04 eta: 4:04:40 time: 0.533219 data_time: 0.096179 memory: 20140 loss_kpt: 0.000565 acc_pose: 0.852824 loss: 0.000565 2022/09/26 15:24:01 - mmengine - INFO - Epoch(train) [101][100/293] lr: 5.000000e-04 eta: 4:04:20 time: 0.516227 data_time: 0.104504 memory: 20140 loss_kpt: 0.000570 acc_pose: 0.845143 loss: 0.000570 2022/09/26 15:24:28 - mmengine - INFO - Epoch(train) [101][150/293] lr: 5.000000e-04 eta: 4:04:02 time: 0.532840 data_time: 0.103469 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.845294 loss: 0.000569 2022/09/26 15:24:53 - mmengine - INFO - Epoch(train) [101][200/293] lr: 5.000000e-04 eta: 4:03:42 time: 0.511444 data_time: 0.103251 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.868445 loss: 0.000571 2022/09/26 15:25:20 - mmengine - INFO - Epoch(train) [101][250/293] lr: 5.000000e-04 eta: 4:03:23 time: 0.527929 data_time: 0.098882 memory: 20140 loss_kpt: 0.000573 acc_pose: 0.852152 loss: 0.000573 2022/09/26 15:25:42 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:26:10 - mmengine - INFO - Epoch(train) [102][50/293] lr: 5.000000e-04 eta: 4:02:24 time: 0.550126 data_time: 0.108651 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.841532 loss: 0.000561 2022/09/26 15:26:36 - mmengine - INFO - Epoch(train) [102][100/293] lr: 5.000000e-04 eta: 4:02:05 time: 0.523249 data_time: 0.100000 memory: 20140 loss_kpt: 0.000555 acc_pose: 0.884401 loss: 0.000555 2022/09/26 15:27:04 - mmengine - INFO - Epoch(train) [102][150/293] lr: 5.000000e-04 eta: 4:01:48 time: 0.556980 data_time: 0.104376 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.838542 loss: 0.000561 2022/09/26 15:27:31 - mmengine - INFO - Epoch(train) [102][200/293] lr: 5.000000e-04 eta: 4:01:29 time: 0.535629 data_time: 0.101299 memory: 20140 loss_kpt: 0.000568 acc_pose: 0.808083 loss: 0.000568 2022/09/26 15:27:57 - mmengine - INFO - Epoch(train) [102][250/293] lr: 5.000000e-04 eta: 4:01:10 time: 0.526556 data_time: 0.098181 memory: 20140 loss_kpt: 0.000565 acc_pose: 0.887583 loss: 0.000565 2022/09/26 15:28:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:28:47 - mmengine - INFO - Epoch(train) [103][50/293] lr: 5.000000e-04 eta: 4:00:12 time: 0.548321 data_time: 0.117335 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.859167 loss: 0.000549 2022/09/26 15:29:14 - mmengine - INFO - Epoch(train) [103][100/293] lr: 5.000000e-04 eta: 3:59:53 time: 0.534820 data_time: 0.104482 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.851800 loss: 0.000576 2022/09/26 15:29:21 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:29:40 - mmengine - INFO - Epoch(train) [103][150/293] lr: 5.000000e-04 eta: 3:59:34 time: 0.532327 data_time: 0.097487 memory: 20140 loss_kpt: 0.000577 acc_pose: 0.859262 loss: 0.000577 2022/09/26 15:30:07 - mmengine - INFO - Epoch(train) [103][200/293] lr: 5.000000e-04 eta: 3:59:16 time: 0.541886 data_time: 0.100294 memory: 20140 loss_kpt: 0.000568 acc_pose: 0.845933 loss: 0.000568 2022/09/26 15:30:34 - mmengine - INFO - Epoch(train) [103][250/293] lr: 5.000000e-04 eta: 3:58:57 time: 0.534367 data_time: 0.102014 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.839888 loss: 0.000575 2022/09/26 15:30:56 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:31:24 - mmengine - INFO - Epoch(train) [104][50/293] lr: 5.000000e-04 eta: 3:57:59 time: 0.549145 data_time: 0.110010 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.853057 loss: 0.000564 2022/09/26 15:31:50 - mmengine - INFO - Epoch(train) [104][100/293] lr: 5.000000e-04 eta: 3:57:40 time: 0.534178 data_time: 0.093042 memory: 20140 loss_kpt: 0.000574 acc_pose: 0.785360 loss: 0.000574 2022/09/26 15:32:16 - mmengine - INFO - Epoch(train) [104][150/293] lr: 5.000000e-04 eta: 3:57:21 time: 0.520496 data_time: 0.096879 memory: 20140 loss_kpt: 0.000573 acc_pose: 0.861330 loss: 0.000573 2022/09/26 15:32:43 - mmengine - INFO - Epoch(train) [104][200/293] lr: 5.000000e-04 eta: 3:57:02 time: 0.528962 data_time: 0.100381 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.840601 loss: 0.000566 2022/09/26 15:33:09 - mmengine - INFO - Epoch(train) [104][250/293] lr: 5.000000e-04 eta: 3:56:42 time: 0.517359 data_time: 0.100174 memory: 20140 loss_kpt: 0.000565 acc_pose: 0.861461 loss: 0.000565 2022/09/26 15:33:32 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:33:59 - mmengine - INFO - Epoch(train) [105][50/293] lr: 5.000000e-04 eta: 3:55:45 time: 0.555232 data_time: 0.109168 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.849341 loss: 0.000560 2022/09/26 15:34:26 - mmengine - INFO - Epoch(train) [105][100/293] lr: 5.000000e-04 eta: 3:55:25 time: 0.526482 data_time: 0.092844 memory: 20140 loss_kpt: 0.000575 acc_pose: 0.865772 loss: 0.000575 2022/09/26 15:34:52 - mmengine - INFO - Epoch(train) [105][150/293] lr: 5.000000e-04 eta: 3:55:06 time: 0.524489 data_time: 0.098575 memory: 20140 loss_kpt: 0.000576 acc_pose: 0.858824 loss: 0.000576 2022/09/26 15:35:19 - mmengine - INFO - Epoch(train) [105][200/293] lr: 5.000000e-04 eta: 3:54:47 time: 0.532173 data_time: 0.095520 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.816546 loss: 0.000566 2022/09/26 15:35:46 - mmengine - INFO - Epoch(train) [105][250/293] lr: 5.000000e-04 eta: 3:54:28 time: 0.540645 data_time: 0.092266 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.813206 loss: 0.000569 2022/09/26 15:36:08 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:36:35 - mmengine - INFO - Epoch(train) [106][50/293] lr: 5.000000e-04 eta: 3:53:30 time: 0.537586 data_time: 0.119886 memory: 20140 loss_kpt: 0.000569 acc_pose: 0.819868 loss: 0.000569 2022/09/26 15:37:01 - mmengine - INFO - Epoch(train) [106][100/293] lr: 5.000000e-04 eta: 3:53:11 time: 0.526264 data_time: 0.098694 memory: 20140 loss_kpt: 0.000554 acc_pose: 0.879228 loss: 0.000554 2022/09/26 15:37:29 - mmengine - INFO - Epoch(train) [106][150/293] lr: 5.000000e-04 eta: 3:52:52 time: 0.543388 data_time: 0.095698 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.860623 loss: 0.000571 2022/09/26 15:37:55 - mmengine - INFO - Epoch(train) [106][200/293] lr: 5.000000e-04 eta: 3:52:33 time: 0.519228 data_time: 0.103440 memory: 20140 loss_kpt: 0.000559 acc_pose: 0.844175 loss: 0.000559 2022/09/26 15:38:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:38:21 - mmengine - INFO - Epoch(train) [106][250/293] lr: 5.000000e-04 eta: 3:52:13 time: 0.524119 data_time: 0.105858 memory: 20140 loss_kpt: 0.000562 acc_pose: 0.863432 loss: 0.000562 2022/09/26 15:38:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:39:10 - mmengine - INFO - Epoch(train) [107][50/293] lr: 5.000000e-04 eta: 3:51:15 time: 0.522881 data_time: 0.099529 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.820518 loss: 0.000564 2022/09/26 15:39:36 - mmengine - INFO - Epoch(train) [107][100/293] lr: 5.000000e-04 eta: 3:50:55 time: 0.513066 data_time: 0.093835 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.870711 loss: 0.000551 2022/09/26 15:40:01 - mmengine - INFO - Epoch(train) [107][150/293] lr: 5.000000e-04 eta: 3:50:35 time: 0.515844 data_time: 0.094526 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.844289 loss: 0.000560 2022/09/26 15:40:29 - mmengine - INFO - Epoch(train) [107][200/293] lr: 5.000000e-04 eta: 3:50:16 time: 0.543675 data_time: 0.100245 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.845077 loss: 0.000557 2022/09/26 15:40:55 - mmengine - INFO - Epoch(train) [107][250/293] lr: 5.000000e-04 eta: 3:49:57 time: 0.522768 data_time: 0.103202 memory: 20140 loss_kpt: 0.000562 acc_pose: 0.839431 loss: 0.000562 2022/09/26 15:41:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:41:45 - mmengine - INFO - Epoch(train) [108][50/293] lr: 5.000000e-04 eta: 3:48:59 time: 0.534090 data_time: 0.105363 memory: 20140 loss_kpt: 0.000563 acc_pose: 0.817797 loss: 0.000563 2022/09/26 15:42:11 - mmengine - INFO - Epoch(train) [108][100/293] lr: 5.000000e-04 eta: 3:48:40 time: 0.524176 data_time: 0.094371 memory: 20140 loss_kpt: 0.000548 acc_pose: 0.854820 loss: 0.000548 2022/09/26 15:42:38 - mmengine - INFO - Epoch(train) [108][150/293] lr: 5.000000e-04 eta: 3:48:20 time: 0.532028 data_time: 0.103191 memory: 20140 loss_kpt: 0.000550 acc_pose: 0.889187 loss: 0.000550 2022/09/26 15:43:04 - mmengine - INFO - Epoch(train) [108][200/293] lr: 5.000000e-04 eta: 3:48:01 time: 0.518156 data_time: 0.097644 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.862733 loss: 0.000557 2022/09/26 15:43:30 - mmengine - INFO - Epoch(train) [108][250/293] lr: 5.000000e-04 eta: 3:47:41 time: 0.527632 data_time: 0.096262 memory: 20140 loss_kpt: 0.000571 acc_pose: 0.851726 loss: 0.000571 2022/09/26 15:43:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:44:21 - mmengine - INFO - Epoch(train) [109][50/293] lr: 5.000000e-04 eta: 3:46:44 time: 0.540039 data_time: 0.108919 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.868782 loss: 0.000560 2022/09/26 15:44:47 - mmengine - INFO - Epoch(train) [109][100/293] lr: 5.000000e-04 eta: 3:46:24 time: 0.521250 data_time: 0.097513 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.828201 loss: 0.000551 2022/09/26 15:45:13 - mmengine - INFO - Epoch(train) [109][150/293] lr: 5.000000e-04 eta: 3:46:05 time: 0.533810 data_time: 0.110717 memory: 20140 loss_kpt: 0.000577 acc_pose: 0.861574 loss: 0.000577 2022/09/26 15:45:40 - mmengine - INFO - Epoch(train) [109][200/293] lr: 5.000000e-04 eta: 3:45:46 time: 0.528815 data_time: 0.114550 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.829330 loss: 0.000560 2022/09/26 15:46:06 - mmengine - INFO - Epoch(train) [109][250/293] lr: 5.000000e-04 eta: 3:45:26 time: 0.527566 data_time: 0.104609 memory: 20140 loss_kpt: 0.000563 acc_pose: 0.825805 loss: 0.000563 2022/09/26 15:46:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:46:56 - mmengine - INFO - Epoch(train) [110][50/293] lr: 5.000000e-04 eta: 3:44:30 time: 0.540191 data_time: 0.114290 memory: 20140 loss_kpt: 0.000573 acc_pose: 0.866922 loss: 0.000573 2022/09/26 15:47:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:47:22 - mmengine - INFO - Epoch(train) [110][100/293] lr: 5.000000e-04 eta: 3:44:10 time: 0.520898 data_time: 0.098544 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.837874 loss: 0.000557 2022/09/26 15:47:48 - mmengine - INFO - Epoch(train) [110][150/293] lr: 5.000000e-04 eta: 3:43:50 time: 0.524289 data_time: 0.102067 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.852324 loss: 0.000561 2022/09/26 15:48:15 - mmengine - INFO - Epoch(train) [110][200/293] lr: 5.000000e-04 eta: 3:43:31 time: 0.535059 data_time: 0.103171 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.838395 loss: 0.000557 2022/09/26 15:48:41 - mmengine - INFO - Epoch(train) [110][250/293] lr: 5.000000e-04 eta: 3:43:11 time: 0.522885 data_time: 0.110361 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.832402 loss: 0.000560 2022/09/26 15:49:04 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:49:04 - mmengine - INFO - Saving checkpoint at 110 epochs 2022/09/26 15:49:16 - mmengine - INFO - Epoch(val) [110][50/407] eta: 0:01:00 time: 0.169461 data_time: 0.015580 memory: 20140 2022/09/26 15:49:24 - mmengine - INFO - Epoch(val) [110][100/407] eta: 0:00:51 time: 0.168473 data_time: 0.012823 memory: 1830 2022/09/26 15:49:33 - mmengine - INFO - Epoch(val) [110][150/407] eta: 0:00:42 time: 0.164240 data_time: 0.009870 memory: 1830 2022/09/26 15:49:41 - mmengine - INFO - Epoch(val) [110][200/407] eta: 0:00:35 time: 0.169931 data_time: 0.011891 memory: 1830 2022/09/26 15:49:50 - mmengine - INFO - Epoch(val) [110][250/407] eta: 0:00:26 time: 0.168494 data_time: 0.011364 memory: 1830 2022/09/26 15:49:58 - mmengine - INFO - Epoch(val) [110][300/407] eta: 0:00:17 time: 0.164675 data_time: 0.010707 memory: 1830 2022/09/26 15:50:06 - mmengine - INFO - Epoch(val) [110][350/407] eta: 0:00:09 time: 0.165099 data_time: 0.010310 memory: 1830 2022/09/26 15:50:15 - mmengine - INFO - Epoch(val) [110][400/407] eta: 0:00:01 time: 0.180922 data_time: 0.022302 memory: 1830 2022/09/26 15:50:47 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 15:51:00 - mmengine - INFO - Epoch(val) [110][407/407] coco/AP: 0.732595 coco/AP .5: 0.896564 coco/AP .75: 0.799907 coco/AP (M): 0.692177 coco/AP (L): 0.804526 coco/AR: 0.784147 coco/AR .5: 0.933564 coco/AR .75: 0.843829 coco/AR (M): 0.737940 coco/AR (L): 0.850465 2022/09/26 15:51:00 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_100.pth is removed 2022/09/26 15:51:03 - mmengine - INFO - The best checkpoint with 0.7326 coco/AP at 110 epoch is saved to best_coco/AP_epoch_110.pth. 2022/09/26 15:51:30 - mmengine - INFO - Epoch(train) [111][50/293] lr: 5.000000e-04 eta: 3:42:15 time: 0.538282 data_time: 0.105055 memory: 20140 loss_kpt: 0.000558 acc_pose: 0.876734 loss: 0.000558 2022/09/26 15:51:57 - mmengine - INFO - Epoch(train) [111][100/293] lr: 5.000000e-04 eta: 3:41:56 time: 0.538579 data_time: 0.106634 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.833538 loss: 0.000556 2022/09/26 15:52:23 - mmengine - INFO - Epoch(train) [111][150/293] lr: 5.000000e-04 eta: 3:41:36 time: 0.525364 data_time: 0.083752 memory: 20140 loss_kpt: 0.000558 acc_pose: 0.859290 loss: 0.000558 2022/09/26 15:52:50 - mmengine - INFO - Epoch(train) [111][200/293] lr: 5.000000e-04 eta: 3:41:17 time: 0.536402 data_time: 0.105571 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.862000 loss: 0.000561 2022/09/26 15:53:16 - mmengine - INFO - Epoch(train) [111][250/293] lr: 5.000000e-04 eta: 3:40:57 time: 0.528252 data_time: 0.102849 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.823855 loss: 0.000560 2022/09/26 15:53:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:54:07 - mmengine - INFO - Epoch(train) [112][50/293] lr: 5.000000e-04 eta: 3:40:02 time: 0.574049 data_time: 0.117525 memory: 20140 loss_kpt: 0.000547 acc_pose: 0.874897 loss: 0.000547 2022/09/26 15:54:33 - mmengine - INFO - Epoch(train) [112][100/293] lr: 5.000000e-04 eta: 3:39:42 time: 0.521321 data_time: 0.099013 memory: 20140 loss_kpt: 0.000548 acc_pose: 0.841887 loss: 0.000548 2022/09/26 15:55:00 - mmengine - INFO - Epoch(train) [112][150/293] lr: 5.000000e-04 eta: 3:39:23 time: 0.527417 data_time: 0.102834 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.814462 loss: 0.000564 2022/09/26 15:55:26 - mmengine - INFO - Epoch(train) [112][200/293] lr: 5.000000e-04 eta: 3:39:03 time: 0.526600 data_time: 0.108212 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.821233 loss: 0.000556 2022/09/26 15:55:53 - mmengine - INFO - Epoch(train) [112][250/293] lr: 5.000000e-04 eta: 3:38:43 time: 0.528481 data_time: 0.110819 memory: 20140 loss_kpt: 0.000548 acc_pose: 0.844552 loss: 0.000548 2022/09/26 15:56:15 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:56:43 - mmengine - INFO - Epoch(train) [113][50/293] lr: 5.000000e-04 eta: 3:37:48 time: 0.558151 data_time: 0.106428 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.832005 loss: 0.000549 2022/09/26 15:57:09 - mmengine - INFO - Epoch(train) [113][100/293] lr: 5.000000e-04 eta: 3:37:28 time: 0.522371 data_time: 0.097689 memory: 20140 loss_kpt: 0.000555 acc_pose: 0.868500 loss: 0.000555 2022/09/26 15:57:35 - mmengine - INFO - Epoch(train) [113][150/293] lr: 5.000000e-04 eta: 3:37:09 time: 0.532382 data_time: 0.106123 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.861610 loss: 0.000566 2022/09/26 15:57:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:58:02 - mmengine - INFO - Epoch(train) [113][200/293] lr: 5.000000e-04 eta: 3:36:49 time: 0.523447 data_time: 0.090714 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.867514 loss: 0.000556 2022/09/26 15:58:28 - mmengine - INFO - Epoch(train) [113][250/293] lr: 5.000000e-04 eta: 3:36:29 time: 0.524643 data_time: 0.099040 memory: 20140 loss_kpt: 0.000562 acc_pose: 0.842854 loss: 0.000562 2022/09/26 15:58:51 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 15:59:18 - mmengine - INFO - Epoch(train) [114][50/293] lr: 5.000000e-04 eta: 3:35:34 time: 0.545857 data_time: 0.114977 memory: 20140 loss_kpt: 0.000555 acc_pose: 0.855299 loss: 0.000555 2022/09/26 15:59:45 - mmengine - INFO - Epoch(train) [114][100/293] lr: 5.000000e-04 eta: 3:35:14 time: 0.536942 data_time: 0.106436 memory: 20140 loss_kpt: 0.000568 acc_pose: 0.891406 loss: 0.000568 2022/09/26 16:00:11 - mmengine - INFO - Epoch(train) [114][150/293] lr: 5.000000e-04 eta: 3:34:54 time: 0.522464 data_time: 0.101485 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.884555 loss: 0.000551 2022/09/26 16:00:37 - mmengine - INFO - Epoch(train) [114][200/293] lr: 5.000000e-04 eta: 3:34:34 time: 0.511613 data_time: 0.107839 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.819049 loss: 0.000564 2022/09/26 16:01:03 - mmengine - INFO - Epoch(train) [114][250/293] lr: 5.000000e-04 eta: 3:34:14 time: 0.531701 data_time: 0.098715 memory: 20140 loss_kpt: 0.000554 acc_pose: 0.825834 loss: 0.000554 2022/09/26 16:01:26 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:01:53 - mmengine - INFO - Epoch(train) [115][50/293] lr: 5.000000e-04 eta: 3:33:19 time: 0.546522 data_time: 0.117993 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.837234 loss: 0.000561 2022/09/26 16:02:20 - mmengine - INFO - Epoch(train) [115][100/293] lr: 5.000000e-04 eta: 3:32:59 time: 0.523194 data_time: 0.095355 memory: 20140 loss_kpt: 0.000555 acc_pose: 0.867032 loss: 0.000555 2022/09/26 16:02:46 - mmengine - INFO - Epoch(train) [115][150/293] lr: 5.000000e-04 eta: 3:32:40 time: 0.528811 data_time: 0.109703 memory: 20140 loss_kpt: 0.000562 acc_pose: 0.872574 loss: 0.000562 2022/09/26 16:03:12 - mmengine - INFO - Epoch(train) [115][200/293] lr: 5.000000e-04 eta: 3:32:19 time: 0.517994 data_time: 0.100430 memory: 20140 loss_kpt: 0.000568 acc_pose: 0.855753 loss: 0.000568 2022/09/26 16:03:38 - mmengine - INFO - Epoch(train) [115][250/293] lr: 5.000000e-04 eta: 3:31:59 time: 0.523328 data_time: 0.104648 memory: 20140 loss_kpt: 0.000562 acc_pose: 0.851339 loss: 0.000562 2022/09/26 16:04:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:04:29 - mmengine - INFO - Epoch(train) [116][50/293] lr: 5.000000e-04 eta: 3:31:04 time: 0.546970 data_time: 0.112468 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.862503 loss: 0.000560 2022/09/26 16:05:29 - mmengine - INFO - Epoch(train) [116][100/293] lr: 5.000000e-04 eta: 3:31:12 time: 1.203910 data_time: 0.087485 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.886421 loss: 0.000540 2022/09/26 16:07:42 - mmengine - INFO - Epoch(train) [116][150/293] lr: 5.000000e-04 eta: 3:32:20 time: 2.659682 data_time: 1.440041 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.843260 loss: 0.000560 2022/09/26 16:08:36 - mmengine - INFO - Epoch(train) [116][200/293] lr: 5.000000e-04 eta: 3:32:22 time: 1.072466 data_time: 0.127236 memory: 20140 loss_kpt: 0.000550 acc_pose: 0.885303 loss: 0.000550 2022/09/26 16:09:05 - mmengine - INFO - Epoch(train) [116][250/293] lr: 5.000000e-04 eta: 3:32:03 time: 0.583014 data_time: 0.142077 memory: 20140 loss_kpt: 0.000567 acc_pose: 0.865249 loss: 0.000567 2022/09/26 16:09:32 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:09:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:09:59 - mmengine - INFO - Epoch(train) [117][50/293] lr: 5.000000e-04 eta: 3:31:08 time: 0.548017 data_time: 0.118390 memory: 20140 loss_kpt: 0.000554 acc_pose: 0.870587 loss: 0.000554 2022/09/26 16:10:27 - mmengine - INFO - Epoch(train) [117][100/293] lr: 5.000000e-04 eta: 3:30:49 time: 0.564521 data_time: 0.116227 memory: 20140 loss_kpt: 0.000568 acc_pose: 0.863545 loss: 0.000568 2022/09/26 16:10:54 - mmengine - INFO - Epoch(train) [117][150/293] lr: 5.000000e-04 eta: 3:30:29 time: 0.525268 data_time: 0.105585 memory: 20140 loss_kpt: 0.000563 acc_pose: 0.839107 loss: 0.000563 2022/09/26 16:11:20 - mmengine - INFO - Epoch(train) [117][200/293] lr: 5.000000e-04 eta: 3:30:08 time: 0.519482 data_time: 0.106879 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.924130 loss: 0.000540 2022/09/26 16:11:47 - mmengine - INFO - Epoch(train) [117][250/293] lr: 5.000000e-04 eta: 3:29:48 time: 0.550336 data_time: 0.099949 memory: 20140 loss_kpt: 0.000564 acc_pose: 0.866130 loss: 0.000564 2022/09/26 16:12:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:12:38 - mmengine - INFO - Epoch(train) [118][50/293] lr: 5.000000e-04 eta: 3:28:54 time: 0.555441 data_time: 0.106358 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.876378 loss: 0.000561 2022/09/26 16:13:04 - mmengine - INFO - Epoch(train) [118][100/293] lr: 5.000000e-04 eta: 3:28:33 time: 0.532524 data_time: 0.102484 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.893011 loss: 0.000552 2022/09/26 16:13:30 - mmengine - INFO - Epoch(train) [118][150/293] lr: 5.000000e-04 eta: 3:28:13 time: 0.516674 data_time: 0.102464 memory: 20140 loss_kpt: 0.000560 acc_pose: 0.865285 loss: 0.000560 2022/09/26 16:13:57 - mmengine - INFO - Epoch(train) [118][200/293] lr: 5.000000e-04 eta: 3:27:52 time: 0.534710 data_time: 0.112454 memory: 20140 loss_kpt: 0.000541 acc_pose: 0.881673 loss: 0.000541 2022/09/26 16:14:25 - mmengine - INFO - Epoch(train) [118][250/293] lr: 5.000000e-04 eta: 3:27:33 time: 0.557284 data_time: 0.108667 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.827265 loss: 0.000543 2022/09/26 16:14:48 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:15:15 - mmengine - INFO - Epoch(train) [119][50/293] lr: 5.000000e-04 eta: 3:26:38 time: 0.549625 data_time: 0.112304 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.887024 loss: 0.000552 2022/09/26 16:15:42 - mmengine - INFO - Epoch(train) [119][100/293] lr: 5.000000e-04 eta: 3:26:18 time: 0.546420 data_time: 0.113028 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.826459 loss: 0.000543 2022/09/26 16:16:09 - mmengine - INFO - Epoch(train) [119][150/293] lr: 5.000000e-04 eta: 3:25:58 time: 0.529249 data_time: 0.101489 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.857628 loss: 0.000535 2022/09/26 16:16:35 - mmengine - INFO - Epoch(train) [119][200/293] lr: 5.000000e-04 eta: 3:25:38 time: 0.532364 data_time: 0.102179 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.839683 loss: 0.000551 2022/09/26 16:17:03 - mmengine - INFO - Epoch(train) [119][250/293] lr: 5.000000e-04 eta: 3:25:18 time: 0.540809 data_time: 0.105764 memory: 20140 loss_kpt: 0.000541 acc_pose: 0.858068 loss: 0.000541 2022/09/26 16:17:26 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:17:53 - mmengine - INFO - Epoch(train) [120][50/293] lr: 5.000000e-04 eta: 3:24:23 time: 0.546608 data_time: 0.118929 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.846106 loss: 0.000549 2022/09/26 16:18:20 - mmengine - INFO - Epoch(train) [120][100/293] lr: 5.000000e-04 eta: 3:24:03 time: 0.532380 data_time: 0.103464 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.841847 loss: 0.000556 2022/09/26 16:18:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:18:46 - mmengine - INFO - Epoch(train) [120][150/293] lr: 5.000000e-04 eta: 3:23:42 time: 0.517736 data_time: 0.096411 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.866757 loss: 0.000566 2022/09/26 16:19:12 - mmengine - INFO - Epoch(train) [120][200/293] lr: 5.000000e-04 eta: 3:23:22 time: 0.537905 data_time: 0.113430 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.834277 loss: 0.000549 2022/09/26 16:19:39 - mmengine - INFO - Epoch(train) [120][250/293] lr: 5.000000e-04 eta: 3:23:01 time: 0.532319 data_time: 0.106580 memory: 20140 loss_kpt: 0.000556 acc_pose: 0.874004 loss: 0.000556 2022/09/26 16:20:01 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:20:01 - mmengine - INFO - Saving checkpoint at 120 epochs 2022/09/26 16:20:17 - mmengine - INFO - Epoch(val) [120][50/407] eta: 0:01:01 time: 0.172095 data_time: 0.016953 memory: 20140 2022/09/26 16:20:25 - mmengine - INFO - Epoch(val) [120][100/407] eta: 0:00:52 time: 0.170992 data_time: 0.013680 memory: 1830 2022/09/26 16:20:34 - mmengine - INFO - Epoch(val) [120][150/407] eta: 0:00:43 time: 0.167424 data_time: 0.012542 memory: 1830 2022/09/26 16:20:42 - mmengine - INFO - Epoch(val) [120][200/407] eta: 0:00:35 time: 0.169854 data_time: 0.011655 memory: 1830 2022/09/26 16:20:50 - mmengine - INFO - Epoch(val) [120][250/407] eta: 0:00:25 time: 0.164512 data_time: 0.010486 memory: 1830 2022/09/26 16:20:59 - mmengine - INFO - Epoch(val) [120][300/407] eta: 0:00:18 time: 0.169910 data_time: 0.010344 memory: 1830 2022/09/26 16:21:07 - mmengine - INFO - Epoch(val) [120][350/407] eta: 0:00:09 time: 0.168077 data_time: 0.010827 memory: 1830 2022/09/26 16:21:15 - mmengine - INFO - Epoch(val) [120][400/407] eta: 0:00:01 time: 0.161460 data_time: 0.009725 memory: 1830 2022/09/26 16:21:48 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 16:22:01 - mmengine - INFO - Epoch(val) [120][407/407] coco/AP: 0.732453 coco/AP .5: 0.895324 coco/AP .75: 0.798311 coco/AP (M): 0.690620 coco/AP (L): 0.806003 coco/AR: 0.784257 coco/AR .5: 0.933879 coco/AR .75: 0.844301 coco/AR (M): 0.737230 coco/AR (L): 0.852025 2022/09/26 16:22:29 - mmengine - INFO - Epoch(train) [121][50/293] lr: 5.000000e-04 eta: 3:22:07 time: 0.554891 data_time: 0.115126 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.863240 loss: 0.000549 2022/09/26 16:22:55 - mmengine - INFO - Epoch(train) [121][100/293] lr: 5.000000e-04 eta: 3:21:46 time: 0.524639 data_time: 0.109880 memory: 20140 loss_kpt: 0.000547 acc_pose: 0.870674 loss: 0.000547 2022/09/26 16:23:22 - mmengine - INFO - Epoch(train) [121][150/293] lr: 5.000000e-04 eta: 3:21:26 time: 0.528327 data_time: 0.101532 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.824825 loss: 0.000532 2022/09/26 16:23:48 - mmengine - INFO - Epoch(train) [121][200/293] lr: 5.000000e-04 eta: 3:21:06 time: 0.536441 data_time: 0.101191 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.886292 loss: 0.000540 2022/09/26 16:24:14 - mmengine - INFO - Epoch(train) [121][250/293] lr: 5.000000e-04 eta: 3:20:45 time: 0.520440 data_time: 0.102288 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.860152 loss: 0.000552 2022/09/26 16:24:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:25:04 - mmengine - INFO - Epoch(train) [122][50/293] lr: 5.000000e-04 eta: 3:19:50 time: 0.538387 data_time: 0.111462 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.848954 loss: 0.000535 2022/09/26 16:25:30 - mmengine - INFO - Epoch(train) [122][100/293] lr: 5.000000e-04 eta: 3:19:29 time: 0.517190 data_time: 0.098985 memory: 20140 loss_kpt: 0.000550 acc_pose: 0.868123 loss: 0.000550 2022/09/26 16:25:57 - mmengine - INFO - Epoch(train) [122][150/293] lr: 5.000000e-04 eta: 3:19:09 time: 0.534068 data_time: 0.086894 memory: 20140 loss_kpt: 0.000553 acc_pose: 0.876739 loss: 0.000553 2022/09/26 16:26:24 - mmengine - INFO - Epoch(train) [122][200/293] lr: 5.000000e-04 eta: 3:18:49 time: 0.543534 data_time: 0.107423 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.864843 loss: 0.000557 2022/09/26 16:26:50 - mmengine - INFO - Epoch(train) [122][250/293] lr: 5.000000e-04 eta: 3:18:28 time: 0.522803 data_time: 0.104450 memory: 20140 loss_kpt: 0.000566 acc_pose: 0.897311 loss: 0.000566 2022/09/26 16:27:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:27:39 - mmengine - INFO - Epoch(train) [123][50/293] lr: 5.000000e-04 eta: 3:17:34 time: 0.543491 data_time: 0.105797 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.851819 loss: 0.000549 2022/09/26 16:28:06 - mmengine - INFO - Epoch(train) [123][100/293] lr: 5.000000e-04 eta: 3:17:13 time: 0.529839 data_time: 0.102609 memory: 20140 loss_kpt: 0.000546 acc_pose: 0.868655 loss: 0.000546 2022/09/26 16:28:33 - mmengine - INFO - Epoch(train) [123][150/293] lr: 5.000000e-04 eta: 3:16:53 time: 0.531762 data_time: 0.098655 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.837729 loss: 0.000551 2022/09/26 16:28:59 - mmengine - INFO - Epoch(train) [123][200/293] lr: 5.000000e-04 eta: 3:16:32 time: 0.522262 data_time: 0.103425 memory: 20140 loss_kpt: 0.000546 acc_pose: 0.846818 loss: 0.000546 2022/09/26 16:29:25 - mmengine - INFO - Epoch(train) [123][250/293] lr: 5.000000e-04 eta: 3:16:11 time: 0.533997 data_time: 0.101903 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.844097 loss: 0.000551 2022/09/26 16:29:27 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:29:48 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:30:15 - mmengine - INFO - Epoch(train) [124][50/293] lr: 5.000000e-04 eta: 3:15:18 time: 0.546970 data_time: 0.119229 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.860698 loss: 0.000543 2022/09/26 16:30:41 - mmengine - INFO - Epoch(train) [124][100/293] lr: 5.000000e-04 eta: 3:14:57 time: 0.517474 data_time: 0.101041 memory: 20140 loss_kpt: 0.000546 acc_pose: 0.869888 loss: 0.000546 2022/09/26 16:31:08 - mmengine - INFO - Epoch(train) [124][150/293] lr: 5.000000e-04 eta: 3:14:36 time: 0.545268 data_time: 0.108124 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.886393 loss: 0.000561 2022/09/26 16:31:35 - mmengine - INFO - Epoch(train) [124][200/293] lr: 5.000000e-04 eta: 3:14:16 time: 0.523261 data_time: 0.099134 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.860959 loss: 0.000542 2022/09/26 16:32:01 - mmengine - INFO - Epoch(train) [124][250/293] lr: 5.000000e-04 eta: 3:13:55 time: 0.526914 data_time: 0.091412 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.870760 loss: 0.000552 2022/09/26 16:32:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:32:52 - mmengine - INFO - Epoch(train) [125][50/293] lr: 5.000000e-04 eta: 3:13:02 time: 0.561897 data_time: 0.123312 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.855037 loss: 0.000549 2022/09/26 16:33:18 - mmengine - INFO - Epoch(train) [125][100/293] lr: 5.000000e-04 eta: 3:12:41 time: 0.518006 data_time: 0.097608 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.898146 loss: 0.000552 2022/09/26 16:33:44 - mmengine - INFO - Epoch(train) [125][150/293] lr: 5.000000e-04 eta: 3:12:20 time: 0.533849 data_time: 0.111170 memory: 20140 loss_kpt: 0.000546 acc_pose: 0.860104 loss: 0.000546 2022/09/26 16:34:14 - mmengine - INFO - Epoch(train) [125][200/293] lr: 5.000000e-04 eta: 3:12:02 time: 0.594958 data_time: 0.128058 memory: 20140 loss_kpt: 0.000559 acc_pose: 0.894297 loss: 0.000559 2022/09/26 16:34:41 - mmengine - INFO - Epoch(train) [125][250/293] lr: 5.000000e-04 eta: 3:11:41 time: 0.531863 data_time: 0.093412 memory: 20140 loss_kpt: 0.000558 acc_pose: 0.853273 loss: 0.000558 2022/09/26 16:35:04 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:35:31 - mmengine - INFO - Epoch(train) [126][50/293] lr: 5.000000e-04 eta: 3:10:47 time: 0.534613 data_time: 0.116929 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.845310 loss: 0.000538 2022/09/26 16:35:57 - mmengine - INFO - Epoch(train) [126][100/293] lr: 5.000000e-04 eta: 3:10:26 time: 0.524023 data_time: 0.108417 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.794972 loss: 0.000549 2022/09/26 16:36:24 - mmengine - INFO - Epoch(train) [126][150/293] lr: 5.000000e-04 eta: 3:10:06 time: 0.541056 data_time: 0.102043 memory: 20140 loss_kpt: 0.000557 acc_pose: 0.870849 loss: 0.000557 2022/09/26 16:36:51 - mmengine - INFO - Epoch(train) [126][200/293] lr: 5.000000e-04 eta: 3:09:46 time: 0.536362 data_time: 0.103422 memory: 20140 loss_kpt: 0.000561 acc_pose: 0.847648 loss: 0.000561 2022/09/26 16:37:18 - mmengine - INFO - Epoch(train) [126][250/293] lr: 5.000000e-04 eta: 3:09:25 time: 0.534412 data_time: 0.104352 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.836047 loss: 0.000549 2022/09/26 16:37:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:38:08 - mmengine - INFO - Epoch(train) [127][50/293] lr: 5.000000e-04 eta: 3:08:32 time: 0.553390 data_time: 0.114774 memory: 20140 loss_kpt: 0.000547 acc_pose: 0.874364 loss: 0.000547 2022/09/26 16:38:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:38:35 - mmengine - INFO - Epoch(train) [127][100/293] lr: 5.000000e-04 eta: 3:08:11 time: 0.534781 data_time: 0.110359 memory: 20140 loss_kpt: 0.000553 acc_pose: 0.843983 loss: 0.000553 2022/09/26 16:39:01 - mmengine - INFO - Epoch(train) [127][150/293] lr: 5.000000e-04 eta: 3:07:50 time: 0.523577 data_time: 0.106349 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.882495 loss: 0.000543 2022/09/26 16:39:27 - mmengine - INFO - Epoch(train) [127][200/293] lr: 5.000000e-04 eta: 3:07:29 time: 0.522752 data_time: 0.099987 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.829669 loss: 0.000540 2022/09/26 16:39:53 - mmengine - INFO - Epoch(train) [127][250/293] lr: 5.000000e-04 eta: 3:07:09 time: 0.531397 data_time: 0.097173 memory: 20140 loss_kpt: 0.000541 acc_pose: 0.841508 loss: 0.000541 2022/09/26 16:40:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:40:42 - mmengine - INFO - Epoch(train) [128][50/293] lr: 5.000000e-04 eta: 3:06:15 time: 0.526557 data_time: 0.115506 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.858164 loss: 0.000536 2022/09/26 16:41:09 - mmengine - INFO - Epoch(train) [128][100/293] lr: 5.000000e-04 eta: 3:05:55 time: 0.536855 data_time: 0.099343 memory: 20140 loss_kpt: 0.000548 acc_pose: 0.895671 loss: 0.000548 2022/09/26 16:41:35 - mmengine - INFO - Epoch(train) [128][150/293] lr: 5.000000e-04 eta: 3:05:34 time: 0.527414 data_time: 0.101013 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.880558 loss: 0.000543 2022/09/26 16:42:02 - mmengine - INFO - Epoch(train) [128][200/293] lr: 5.000000e-04 eta: 3:05:13 time: 0.541970 data_time: 0.113101 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.839695 loss: 0.000551 2022/09/26 16:42:29 - mmengine - INFO - Epoch(train) [128][250/293] lr: 5.000000e-04 eta: 3:04:53 time: 0.531902 data_time: 0.099961 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.887245 loss: 0.000542 2022/09/26 16:42:52 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:43:19 - mmengine - INFO - Epoch(train) [129][50/293] lr: 5.000000e-04 eta: 3:04:00 time: 0.541850 data_time: 0.110873 memory: 20140 loss_kpt: 0.000539 acc_pose: 0.834224 loss: 0.000539 2022/09/26 16:43:45 - mmengine - INFO - Epoch(train) [129][100/293] lr: 5.000000e-04 eta: 3:03:39 time: 0.530681 data_time: 0.112556 memory: 20140 loss_kpt: 0.000543 acc_pose: 0.889238 loss: 0.000543 2022/09/26 16:44:12 - mmengine - INFO - Epoch(train) [129][150/293] lr: 5.000000e-04 eta: 3:03:18 time: 0.533144 data_time: 0.104837 memory: 20140 loss_kpt: 0.000539 acc_pose: 0.866878 loss: 0.000539 2022/09/26 16:44:38 - mmengine - INFO - Epoch(train) [129][200/293] lr: 5.000000e-04 eta: 3:02:57 time: 0.518585 data_time: 0.100886 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.839543 loss: 0.000540 2022/09/26 16:45:05 - mmengine - INFO - Epoch(train) [129][250/293] lr: 5.000000e-04 eta: 3:02:36 time: 0.533846 data_time: 0.097938 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.838575 loss: 0.000536 2022/09/26 16:45:28 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:45:55 - mmengine - INFO - Epoch(train) [130][50/293] lr: 5.000000e-04 eta: 3:01:44 time: 0.547796 data_time: 0.113135 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.862461 loss: 0.000542 2022/09/26 16:46:22 - mmengine - INFO - Epoch(train) [130][100/293] lr: 5.000000e-04 eta: 3:01:23 time: 0.537019 data_time: 0.105848 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.892144 loss: 0.000536 2022/09/26 16:46:49 - mmengine - INFO - Epoch(train) [130][150/293] lr: 5.000000e-04 eta: 3:01:02 time: 0.524454 data_time: 0.103395 memory: 20140 loss_kpt: 0.000554 acc_pose: 0.821401 loss: 0.000554 2022/09/26 16:47:15 - mmengine - INFO - Epoch(train) [130][200/293] lr: 5.000000e-04 eta: 3:00:41 time: 0.534854 data_time: 0.107867 memory: 20140 loss_kpt: 0.000552 acc_pose: 0.851799 loss: 0.000552 2022/09/26 16:47:17 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:47:42 - mmengine - INFO - Epoch(train) [130][250/293] lr: 5.000000e-04 eta: 3:00:20 time: 0.532053 data_time: 0.088915 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.822633 loss: 0.000540 2022/09/26 16:48:05 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:48:05 - mmengine - INFO - Saving checkpoint at 130 epochs 2022/09/26 16:48:17 - mmengine - INFO - Epoch(val) [130][50/407] eta: 0:01:01 time: 0.172060 data_time: 0.016456 memory: 20140 2022/09/26 16:48:26 - mmengine - INFO - Epoch(val) [130][100/407] eta: 0:00:56 time: 0.184965 data_time: 0.028662 memory: 1830 2022/09/26 16:48:34 - mmengine - INFO - Epoch(val) [130][150/407] eta: 0:00:42 time: 0.164375 data_time: 0.010110 memory: 1830 2022/09/26 16:48:43 - mmengine - INFO - Epoch(val) [130][200/407] eta: 0:00:34 time: 0.167325 data_time: 0.010367 memory: 1830 2022/09/26 16:48:51 - mmengine - INFO - Epoch(val) [130][250/407] eta: 0:00:26 time: 0.166504 data_time: 0.012014 memory: 1830 2022/09/26 16:48:59 - mmengine - INFO - Epoch(val) [130][300/407] eta: 0:00:17 time: 0.166608 data_time: 0.010635 memory: 1830 2022/09/26 16:49:08 - mmengine - INFO - Epoch(val) [130][350/407] eta: 0:00:09 time: 0.170547 data_time: 0.010637 memory: 1830 2022/09/26 16:49:16 - mmengine - INFO - Epoch(val) [130][400/407] eta: 0:00:01 time: 0.163577 data_time: 0.009499 memory: 1830 2022/09/26 16:49:49 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 16:50:02 - mmengine - INFO - Epoch(val) [130][407/407] coco/AP: 0.738685 coco/AP .5: 0.898934 coco/AP .75: 0.807804 coco/AP (M): 0.695831 coco/AP (L): 0.811828 coco/AR: 0.789830 coco/AR .5: 0.937972 coco/AR .75: 0.851385 coco/AR (M): 0.742966 coco/AR (L): 0.857191 2022/09/26 16:50:02 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_110.pth is removed 2022/09/26 16:50:04 - mmengine - INFO - The best checkpoint with 0.7387 coco/AP at 130 epoch is saved to best_coco/AP_epoch_130.pth. 2022/09/26 16:50:31 - mmengine - INFO - Epoch(train) [131][50/293] lr: 5.000000e-04 eta: 2:59:28 time: 0.541769 data_time: 0.112229 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.851380 loss: 0.000537 2022/09/26 16:50:58 - mmengine - INFO - Epoch(train) [131][100/293] lr: 5.000000e-04 eta: 2:59:07 time: 0.534716 data_time: 0.102138 memory: 20140 loss_kpt: 0.000547 acc_pose: 0.840874 loss: 0.000547 2022/09/26 16:51:24 - mmengine - INFO - Epoch(train) [131][150/293] lr: 5.000000e-04 eta: 2:58:46 time: 0.521265 data_time: 0.099064 memory: 20140 loss_kpt: 0.000544 acc_pose: 0.839644 loss: 0.000544 2022/09/26 16:51:50 - mmengine - INFO - Epoch(train) [131][200/293] lr: 5.000000e-04 eta: 2:58:25 time: 0.521321 data_time: 0.109272 memory: 20140 loss_kpt: 0.000544 acc_pose: 0.842909 loss: 0.000544 2022/09/26 16:52:17 - mmengine - INFO - Epoch(train) [131][250/293] lr: 5.000000e-04 eta: 2:58:04 time: 0.535406 data_time: 0.103458 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.838913 loss: 0.000535 2022/09/26 16:52:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:53:07 - mmengine - INFO - Epoch(train) [132][50/293] lr: 5.000000e-04 eta: 2:57:12 time: 0.556054 data_time: 0.113536 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.875624 loss: 0.000532 2022/09/26 16:53:34 - mmengine - INFO - Epoch(train) [132][100/293] lr: 5.000000e-04 eta: 2:56:51 time: 0.530516 data_time: 0.099223 memory: 20140 loss_kpt: 0.000545 acc_pose: 0.792115 loss: 0.000545 2022/09/26 16:54:01 - mmengine - INFO - Epoch(train) [132][150/293] lr: 5.000000e-04 eta: 2:56:31 time: 0.542906 data_time: 0.105664 memory: 20140 loss_kpt: 0.000554 acc_pose: 0.798732 loss: 0.000554 2022/09/26 16:54:28 - mmengine - INFO - Epoch(train) [132][200/293] lr: 5.000000e-04 eta: 2:56:10 time: 0.541899 data_time: 0.105475 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.893842 loss: 0.000536 2022/09/26 16:54:55 - mmengine - INFO - Epoch(train) [132][250/293] lr: 5.000000e-04 eta: 2:55:49 time: 0.533712 data_time: 0.104316 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.879779 loss: 0.000538 2022/09/26 16:55:17 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:55:46 - mmengine - INFO - Epoch(train) [133][50/293] lr: 5.000000e-04 eta: 2:54:58 time: 0.565784 data_time: 0.118330 memory: 20140 loss_kpt: 0.000546 acc_pose: 0.851183 loss: 0.000546 2022/09/26 16:56:12 - mmengine - INFO - Epoch(train) [133][100/293] lr: 5.000000e-04 eta: 2:54:36 time: 0.521426 data_time: 0.106802 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.852167 loss: 0.000533 2022/09/26 16:56:38 - mmengine - INFO - Epoch(train) [133][150/293] lr: 5.000000e-04 eta: 2:54:15 time: 0.525595 data_time: 0.108343 memory: 20140 loss_kpt: 0.000553 acc_pose: 0.869999 loss: 0.000553 2022/09/26 16:57:04 - mmengine - INFO - Epoch(train) [133][200/293] lr: 5.000000e-04 eta: 2:53:54 time: 0.530569 data_time: 0.102398 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.880344 loss: 0.000532 2022/09/26 16:57:31 - mmengine - INFO - Epoch(train) [133][250/293] lr: 5.000000e-04 eta: 2:53:33 time: 0.521297 data_time: 0.104533 memory: 20140 loss_kpt: 0.000548 acc_pose: 0.861080 loss: 0.000548 2022/09/26 16:57:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:58:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 16:58:20 - mmengine - INFO - Epoch(train) [134][50/293] lr: 5.000000e-04 eta: 2:52:41 time: 0.545008 data_time: 0.114869 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.835945 loss: 0.000535 2022/09/26 16:58:47 - mmengine - INFO - Epoch(train) [134][100/293] lr: 5.000000e-04 eta: 2:52:20 time: 0.531809 data_time: 0.103652 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.828530 loss: 0.000542 2022/09/26 16:59:13 - mmengine - INFO - Epoch(train) [134][150/293] lr: 5.000000e-04 eta: 2:51:59 time: 0.520912 data_time: 0.109325 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.858964 loss: 0.000531 2022/09/26 16:59:40 - mmengine - INFO - Epoch(train) [134][200/293] lr: 5.000000e-04 eta: 2:51:38 time: 0.547025 data_time: 0.108193 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.890135 loss: 0.000535 2022/09/26 17:00:06 - mmengine - INFO - Epoch(train) [134][250/293] lr: 5.000000e-04 eta: 2:51:17 time: 0.511427 data_time: 0.099885 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.872882 loss: 0.000542 2022/09/26 17:00:28 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:00:55 - mmengine - INFO - Epoch(train) [135][50/293] lr: 5.000000e-04 eta: 2:50:25 time: 0.540569 data_time: 0.112104 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.818733 loss: 0.000538 2022/09/26 17:01:21 - mmengine - INFO - Epoch(train) [135][100/293] lr: 5.000000e-04 eta: 2:50:04 time: 0.513799 data_time: 0.104086 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.878903 loss: 0.000538 2022/09/26 17:01:47 - mmengine - INFO - Epoch(train) [135][150/293] lr: 5.000000e-04 eta: 2:49:42 time: 0.518280 data_time: 0.093425 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.792453 loss: 0.000538 2022/09/26 17:02:13 - mmengine - INFO - Epoch(train) [135][200/293] lr: 5.000000e-04 eta: 2:49:21 time: 0.516974 data_time: 0.101717 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.859179 loss: 0.000524 2022/09/26 17:02:40 - mmengine - INFO - Epoch(train) [135][250/293] lr: 5.000000e-04 eta: 2:49:00 time: 0.542070 data_time: 0.113153 memory: 20140 loss_kpt: 0.000551 acc_pose: 0.823999 loss: 0.000551 2022/09/26 17:03:02 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:03:29 - mmengine - INFO - Epoch(train) [136][50/293] lr: 5.000000e-04 eta: 2:48:08 time: 0.536963 data_time: 0.107492 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.846969 loss: 0.000542 2022/09/26 17:03:55 - mmengine - INFO - Epoch(train) [136][100/293] lr: 5.000000e-04 eta: 2:47:47 time: 0.527427 data_time: 0.106929 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.887228 loss: 0.000535 2022/09/26 17:04:22 - mmengine - INFO - Epoch(train) [136][150/293] lr: 5.000000e-04 eta: 2:47:26 time: 0.533035 data_time: 0.106466 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.878897 loss: 0.000529 2022/09/26 17:04:49 - mmengine - INFO - Epoch(train) [136][200/293] lr: 5.000000e-04 eta: 2:47:05 time: 0.543991 data_time: 0.106891 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.849505 loss: 0.000526 2022/09/26 17:05:15 - mmengine - INFO - Epoch(train) [136][250/293] lr: 5.000000e-04 eta: 2:46:44 time: 0.516287 data_time: 0.106941 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.863810 loss: 0.000536 2022/09/26 17:05:38 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:06:04 - mmengine - INFO - Epoch(train) [137][50/293] lr: 5.000000e-04 eta: 2:45:52 time: 0.526942 data_time: 0.107237 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.891523 loss: 0.000531 2022/09/26 17:06:30 - mmengine - INFO - Epoch(train) [137][100/293] lr: 5.000000e-04 eta: 2:45:31 time: 0.525557 data_time: 0.098858 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.800603 loss: 0.000549 2022/09/26 17:06:57 - mmengine - INFO - Epoch(train) [137][150/293] lr: 5.000000e-04 eta: 2:45:10 time: 0.537061 data_time: 0.107652 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.801109 loss: 0.000538 2022/09/26 17:06:58 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:07:23 - mmengine - INFO - Epoch(train) [137][200/293] lr: 5.000000e-04 eta: 2:44:49 time: 0.521154 data_time: 0.101417 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.833562 loss: 0.000529 2022/09/26 17:07:49 - mmengine - INFO - Epoch(train) [137][250/293] lr: 5.000000e-04 eta: 2:44:27 time: 0.517449 data_time: 0.090259 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.868545 loss: 0.000538 2022/09/26 17:08:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:08:39 - mmengine - INFO - Epoch(train) [138][50/293] lr: 5.000000e-04 eta: 2:43:36 time: 0.543319 data_time: 0.109952 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.802801 loss: 0.000528 2022/09/26 17:09:06 - mmengine - INFO - Epoch(train) [138][100/293] lr: 5.000000e-04 eta: 2:43:15 time: 0.533675 data_time: 0.109697 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.836027 loss: 0.000538 2022/09/26 17:09:32 - mmengine - INFO - Epoch(train) [138][150/293] lr: 5.000000e-04 eta: 2:42:54 time: 0.523896 data_time: 0.110316 memory: 20140 loss_kpt: 0.000544 acc_pose: 0.882048 loss: 0.000544 2022/09/26 17:09:59 - mmengine - INFO - Epoch(train) [138][200/293] lr: 5.000000e-04 eta: 2:42:33 time: 0.537789 data_time: 0.104949 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.871160 loss: 0.000542 2022/09/26 17:10:26 - mmengine - INFO - Epoch(train) [138][250/293] lr: 5.000000e-04 eta: 2:42:12 time: 0.538201 data_time: 0.101319 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.855303 loss: 0.000536 2022/09/26 17:10:48 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:11:15 - mmengine - INFO - Epoch(train) [139][50/293] lr: 5.000000e-04 eta: 2:41:21 time: 0.544123 data_time: 0.117073 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.829594 loss: 0.000528 2022/09/26 17:11:41 - mmengine - INFO - Epoch(train) [139][100/293] lr: 5.000000e-04 eta: 2:41:00 time: 0.527989 data_time: 0.105886 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.891903 loss: 0.000536 2022/09/26 17:12:07 - mmengine - INFO - Epoch(train) [139][150/293] lr: 5.000000e-04 eta: 2:40:38 time: 0.521048 data_time: 0.103135 memory: 20140 loss_kpt: 0.000541 acc_pose: 0.845401 loss: 0.000541 2022/09/26 17:12:34 - mmengine - INFO - Epoch(train) [139][200/293] lr: 5.000000e-04 eta: 2:40:17 time: 0.532737 data_time: 0.108492 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.874946 loss: 0.000537 2022/09/26 17:13:01 - mmengine - INFO - Epoch(train) [139][250/293] lr: 5.000000e-04 eta: 2:39:56 time: 0.533628 data_time: 0.103330 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.809604 loss: 0.000531 2022/09/26 17:13:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:13:52 - mmengine - INFO - Epoch(train) [140][50/293] lr: 5.000000e-04 eta: 2:39:05 time: 0.553808 data_time: 0.117564 memory: 20140 loss_kpt: 0.000549 acc_pose: 0.839614 loss: 0.000549 2022/09/26 17:14:18 - mmengine - INFO - Epoch(train) [140][100/293] lr: 5.000000e-04 eta: 2:38:44 time: 0.521407 data_time: 0.099634 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.852978 loss: 0.000533 2022/09/26 17:14:45 - mmengine - INFO - Epoch(train) [140][150/293] lr: 5.000000e-04 eta: 2:38:23 time: 0.540342 data_time: 0.105722 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.886780 loss: 0.000528 2022/09/26 17:15:11 - mmengine - INFO - Epoch(train) [140][200/293] lr: 5.000000e-04 eta: 2:38:01 time: 0.520529 data_time: 0.099113 memory: 20140 loss_kpt: 0.000539 acc_pose: 0.865640 loss: 0.000539 2022/09/26 17:15:38 - mmengine - INFO - Epoch(train) [140][250/293] lr: 5.000000e-04 eta: 2:37:40 time: 0.539066 data_time: 0.108681 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.881928 loss: 0.000537 2022/09/26 17:15:50 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:16:00 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:16:00 - mmengine - INFO - Saving checkpoint at 140 epochs 2022/09/26 17:16:13 - mmengine - INFO - Epoch(val) [140][50/407] eta: 0:01:01 time: 0.173563 data_time: 0.016813 memory: 20140 2022/09/26 17:16:21 - mmengine - INFO - Epoch(val) [140][100/407] eta: 0:00:51 time: 0.168086 data_time: 0.011008 memory: 1830 2022/09/26 17:16:29 - mmengine - INFO - Epoch(val) [140][150/407] eta: 0:00:42 time: 0.163754 data_time: 0.010836 memory: 1830 2022/09/26 17:16:38 - mmengine - INFO - Epoch(val) [140][200/407] eta: 0:00:35 time: 0.169257 data_time: 0.011281 memory: 1830 2022/09/26 17:16:46 - mmengine - INFO - Epoch(val) [140][250/407] eta: 0:00:25 time: 0.165550 data_time: 0.011032 memory: 1830 2022/09/26 17:16:54 - mmengine - INFO - Epoch(val) [140][300/407] eta: 0:00:18 time: 0.170270 data_time: 0.013633 memory: 1830 2022/09/26 17:17:03 - mmengine - INFO - Epoch(val) [140][350/407] eta: 0:00:10 time: 0.177699 data_time: 0.017286 memory: 1830 2022/09/26 17:17:12 - mmengine - INFO - Epoch(val) [140][400/407] eta: 0:00:01 time: 0.167043 data_time: 0.013425 memory: 1830 2022/09/26 17:17:45 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 17:17:57 - mmengine - INFO - Epoch(val) [140][407/407] coco/AP: 0.740984 coco/AP .5: 0.900393 coco/AP .75: 0.805542 coco/AP (M): 0.697998 coco/AP (L): 0.812829 coco/AR: 0.790995 coco/AR .5: 0.936713 coco/AR .75: 0.849811 coco/AR (M): 0.745152 coco/AR (L): 0.856893 2022/09/26 17:17:57 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_130.pth is removed 2022/09/26 17:18:01 - mmengine - INFO - The best checkpoint with 0.7410 coco/AP at 140 epoch is saved to best_coco/AP_epoch_140.pth. 2022/09/26 17:18:28 - mmengine - INFO - Epoch(train) [141][50/293] lr: 5.000000e-04 eta: 2:36:50 time: 0.547511 data_time: 0.111960 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.857704 loss: 0.000530 2022/09/26 17:18:54 - mmengine - INFO - Epoch(train) [141][100/293] lr: 5.000000e-04 eta: 2:36:28 time: 0.522686 data_time: 0.107145 memory: 20140 loss_kpt: 0.000539 acc_pose: 0.857798 loss: 0.000539 2022/09/26 17:19:21 - mmengine - INFO - Epoch(train) [141][150/293] lr: 5.000000e-04 eta: 2:36:07 time: 0.539956 data_time: 0.101085 memory: 20140 loss_kpt: 0.000522 acc_pose: 0.864971 loss: 0.000522 2022/09/26 17:19:48 - mmengine - INFO - Epoch(train) [141][200/293] lr: 5.000000e-04 eta: 2:35:46 time: 0.535627 data_time: 0.106748 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.812636 loss: 0.000542 2022/09/26 17:20:17 - mmengine - INFO - Epoch(train) [141][250/293] lr: 5.000000e-04 eta: 2:35:26 time: 0.583556 data_time: 0.097586 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.854969 loss: 0.000530 2022/09/26 17:20:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:21:07 - mmengine - INFO - Epoch(train) [142][50/293] lr: 5.000000e-04 eta: 2:34:36 time: 0.544838 data_time: 0.109996 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.832666 loss: 0.000537 2022/09/26 17:21:34 - mmengine - INFO - Epoch(train) [142][100/293] lr: 5.000000e-04 eta: 2:34:15 time: 0.539918 data_time: 0.093450 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.886341 loss: 0.000527 2022/09/26 17:22:00 - mmengine - INFO - Epoch(train) [142][150/293] lr: 5.000000e-04 eta: 2:33:53 time: 0.519917 data_time: 0.101824 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.851714 loss: 0.000537 2022/09/26 17:22:26 - mmengine - INFO - Epoch(train) [142][200/293] lr: 5.000000e-04 eta: 2:33:32 time: 0.527558 data_time: 0.104962 memory: 20140 loss_kpt: 0.000541 acc_pose: 0.888380 loss: 0.000541 2022/09/26 17:22:52 - mmengine - INFO - Epoch(train) [142][250/293] lr: 5.000000e-04 eta: 2:33:10 time: 0.525734 data_time: 0.101279 memory: 20140 loss_kpt: 0.000535 acc_pose: 0.868205 loss: 0.000535 2022/09/26 17:23:15 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:23:42 - mmengine - INFO - Epoch(train) [143][50/293] lr: 5.000000e-04 eta: 2:32:20 time: 0.547135 data_time: 0.108576 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.844075 loss: 0.000524 2022/09/26 17:24:08 - mmengine - INFO - Epoch(train) [143][100/293] lr: 5.000000e-04 eta: 2:31:59 time: 0.524162 data_time: 0.096427 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.855808 loss: 0.000523 2022/09/26 17:24:36 - mmengine - INFO - Epoch(train) [143][150/293] lr: 5.000000e-04 eta: 2:31:38 time: 0.557754 data_time: 0.107583 memory: 20140 loss_kpt: 0.000544 acc_pose: 0.842674 loss: 0.000544 2022/09/26 17:25:04 - mmengine - INFO - Epoch(train) [143][200/293] lr: 5.000000e-04 eta: 2:31:17 time: 0.556211 data_time: 0.106823 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.813814 loss: 0.000528 2022/09/26 17:25:31 - mmengine - INFO - Epoch(train) [143][250/293] lr: 5.000000e-04 eta: 2:30:56 time: 0.530095 data_time: 0.098774 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.818746 loss: 0.000538 2022/09/26 17:25:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:26:21 - mmengine - INFO - Epoch(train) [144][50/293] lr: 5.000000e-04 eta: 2:30:06 time: 0.557901 data_time: 0.115637 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.872989 loss: 0.000526 2022/09/26 17:26:48 - mmengine - INFO - Epoch(train) [144][100/293] lr: 5.000000e-04 eta: 2:29:45 time: 0.530366 data_time: 0.102201 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.827664 loss: 0.000533 2022/09/26 17:26:49 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:27:14 - mmengine - INFO - Epoch(train) [144][150/293] lr: 5.000000e-04 eta: 2:29:23 time: 0.525612 data_time: 0.106122 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.863198 loss: 0.000530 2022/09/26 17:27:41 - mmengine - INFO - Epoch(train) [144][200/293] lr: 5.000000e-04 eta: 2:29:02 time: 0.532203 data_time: 0.110150 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.878367 loss: 0.000530 2022/09/26 17:28:07 - mmengine - INFO - Epoch(train) [144][250/293] lr: 5.000000e-04 eta: 2:28:41 time: 0.530187 data_time: 0.100201 memory: 20140 loss_kpt: 0.000519 acc_pose: 0.846914 loss: 0.000519 2022/09/26 17:28:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:28:57 - mmengine - INFO - Epoch(train) [145][50/293] lr: 5.000000e-04 eta: 2:27:51 time: 0.557502 data_time: 0.114865 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.831049 loss: 0.000530 2022/09/26 17:29:24 - mmengine - INFO - Epoch(train) [145][100/293] lr: 5.000000e-04 eta: 2:27:30 time: 0.542898 data_time: 0.106177 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.809598 loss: 0.000533 2022/09/26 17:29:51 - mmengine - INFO - Epoch(train) [145][150/293] lr: 5.000000e-04 eta: 2:27:09 time: 0.539699 data_time: 0.110998 memory: 20140 loss_kpt: 0.000520 acc_pose: 0.866124 loss: 0.000520 2022/09/26 17:30:18 - mmengine - INFO - Epoch(train) [145][200/293] lr: 5.000000e-04 eta: 2:26:47 time: 0.528422 data_time: 0.100113 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.892067 loss: 0.000532 2022/09/26 17:30:44 - mmengine - INFO - Epoch(train) [145][250/293] lr: 5.000000e-04 eta: 2:26:26 time: 0.526233 data_time: 0.096907 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.807623 loss: 0.000531 2022/09/26 17:31:06 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:31:34 - mmengine - INFO - Epoch(train) [146][50/293] lr: 5.000000e-04 eta: 2:25:36 time: 0.543286 data_time: 0.118781 memory: 20140 loss_kpt: 0.000534 acc_pose: 0.880841 loss: 0.000534 2022/09/26 17:32:00 - mmengine - INFO - Epoch(train) [146][100/293] lr: 5.000000e-04 eta: 2:25:14 time: 0.530433 data_time: 0.096044 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.880824 loss: 0.000529 2022/09/26 17:32:26 - mmengine - INFO - Epoch(train) [146][150/293] lr: 5.000000e-04 eta: 2:24:53 time: 0.520702 data_time: 0.101290 memory: 20140 loss_kpt: 0.000515 acc_pose: 0.856210 loss: 0.000515 2022/09/26 17:32:53 - mmengine - INFO - Epoch(train) [146][200/293] lr: 5.000000e-04 eta: 2:24:32 time: 0.538930 data_time: 0.110635 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.855417 loss: 0.000529 2022/09/26 17:33:19 - mmengine - INFO - Epoch(train) [146][250/293] lr: 5.000000e-04 eta: 2:24:10 time: 0.521235 data_time: 0.096065 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.889044 loss: 0.000527 2022/09/26 17:33:41 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:34:08 - mmengine - INFO - Epoch(train) [147][50/293] lr: 5.000000e-04 eta: 2:23:20 time: 0.533886 data_time: 0.107599 memory: 20140 loss_kpt: 0.000542 acc_pose: 0.824034 loss: 0.000542 2022/09/26 17:34:35 - mmengine - INFO - Epoch(train) [147][100/293] lr: 5.000000e-04 eta: 2:22:59 time: 0.533839 data_time: 0.114001 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.857132 loss: 0.000525 2022/09/26 17:35:02 - mmengine - INFO - Epoch(train) [147][150/293] lr: 5.000000e-04 eta: 2:22:37 time: 0.534385 data_time: 0.101072 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.853041 loss: 0.000532 2022/09/26 17:35:28 - mmengine - INFO - Epoch(train) [147][200/293] lr: 5.000000e-04 eta: 2:22:16 time: 0.536762 data_time: 0.105152 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.850043 loss: 0.000538 2022/09/26 17:35:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:35:56 - mmengine - INFO - Epoch(train) [147][250/293] lr: 5.000000e-04 eta: 2:21:55 time: 0.543853 data_time: 0.109559 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.849969 loss: 0.000525 2022/09/26 17:36:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:36:45 - mmengine - INFO - Epoch(train) [148][50/293] lr: 5.000000e-04 eta: 2:21:05 time: 0.543366 data_time: 0.108470 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.860075 loss: 0.000524 2022/09/26 17:37:12 - mmengine - INFO - Epoch(train) [148][100/293] lr: 5.000000e-04 eta: 2:20:44 time: 0.536359 data_time: 0.101519 memory: 20140 loss_kpt: 0.000534 acc_pose: 0.790060 loss: 0.000534 2022/09/26 17:37:39 - mmengine - INFO - Epoch(train) [148][150/293] lr: 5.000000e-04 eta: 2:20:22 time: 0.534428 data_time: 0.108504 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.840959 loss: 0.000531 2022/09/26 17:38:05 - mmengine - INFO - Epoch(train) [148][200/293] lr: 5.000000e-04 eta: 2:20:01 time: 0.523036 data_time: 0.103219 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.861847 loss: 0.000526 2022/09/26 17:38:31 - mmengine - INFO - Epoch(train) [148][250/293] lr: 5.000000e-04 eta: 2:19:39 time: 0.520341 data_time: 0.096661 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.867727 loss: 0.000532 2022/09/26 17:38:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:39:21 - mmengine - INFO - Epoch(train) [149][50/293] lr: 5.000000e-04 eta: 2:18:50 time: 0.556354 data_time: 0.127147 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.897547 loss: 0.000527 2022/09/26 17:39:47 - mmengine - INFO - Epoch(train) [149][100/293] lr: 5.000000e-04 eta: 2:18:28 time: 0.520315 data_time: 0.102960 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.914390 loss: 0.000528 2022/09/26 17:40:15 - mmengine - INFO - Epoch(train) [149][150/293] lr: 5.000000e-04 eta: 2:18:07 time: 0.544484 data_time: 0.102119 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.882944 loss: 0.000537 2022/09/26 17:40:41 - mmengine - INFO - Epoch(train) [149][200/293] lr: 5.000000e-04 eta: 2:17:45 time: 0.525015 data_time: 0.108464 memory: 20140 loss_kpt: 0.000534 acc_pose: 0.890340 loss: 0.000534 2022/09/26 17:41:07 - mmengine - INFO - Epoch(train) [149][250/293] lr: 5.000000e-04 eta: 2:17:24 time: 0.527190 data_time: 0.100156 memory: 20140 loss_kpt: 0.000534 acc_pose: 0.861441 loss: 0.000534 2022/09/26 17:41:30 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:41:57 - mmengine - INFO - Epoch(train) [150][50/293] lr: 5.000000e-04 eta: 2:16:35 time: 0.541696 data_time: 0.111811 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.854608 loss: 0.000527 2022/09/26 17:42:24 - mmengine - INFO - Epoch(train) [150][100/293] lr: 5.000000e-04 eta: 2:16:13 time: 0.524902 data_time: 0.110900 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.875514 loss: 0.000524 2022/09/26 17:42:51 - mmengine - INFO - Epoch(train) [150][150/293] lr: 5.000000e-04 eta: 2:15:51 time: 0.539263 data_time: 0.112536 memory: 20140 loss_kpt: 0.000522 acc_pose: 0.883563 loss: 0.000522 2022/09/26 17:43:17 - mmengine - INFO - Epoch(train) [150][200/293] lr: 5.000000e-04 eta: 2:15:30 time: 0.536779 data_time: 0.109634 memory: 20140 loss_kpt: 0.000514 acc_pose: 0.860179 loss: 0.000514 2022/09/26 17:43:44 - mmengine - INFO - Epoch(train) [150][250/293] lr: 5.000000e-04 eta: 2:15:09 time: 0.533304 data_time: 0.104011 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.885033 loss: 0.000536 2022/09/26 17:44:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:44:07 - mmengine - INFO - Saving checkpoint at 150 epochs 2022/09/26 17:44:19 - mmengine - INFO - Epoch(val) [150][50/407] eta: 0:01:01 time: 0.172190 data_time: 0.016265 memory: 20140 2022/09/26 17:44:27 - mmengine - INFO - Epoch(val) [150][100/407] eta: 0:00:51 time: 0.169333 data_time: 0.010556 memory: 1830 2022/09/26 17:44:36 - mmengine - INFO - Epoch(val) [150][150/407] eta: 0:00:45 time: 0.177021 data_time: 0.019236 memory: 1830 2022/09/26 17:44:44 - mmengine - INFO - Epoch(val) [150][200/407] eta: 0:00:34 time: 0.165253 data_time: 0.011125 memory: 1830 2022/09/26 17:44:53 - mmengine - INFO - Epoch(val) [150][250/407] eta: 0:00:25 time: 0.163202 data_time: 0.010112 memory: 1830 2022/09/26 17:45:01 - mmengine - INFO - Epoch(val) [150][300/407] eta: 0:00:17 time: 0.165374 data_time: 0.010617 memory: 1830 2022/09/26 17:45:09 - mmengine - INFO - Epoch(val) [150][350/407] eta: 0:00:09 time: 0.165453 data_time: 0.010480 memory: 1830 2022/09/26 17:45:18 - mmengine - INFO - Epoch(val) [150][400/407] eta: 0:00:01 time: 0.167230 data_time: 0.016437 memory: 1830 2022/09/26 17:45:50 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 17:46:03 - mmengine - INFO - Epoch(val) [150][407/407] coco/AP: 0.737769 coco/AP .5: 0.898874 coco/AP .75: 0.806212 coco/AP (M): 0.695042 coco/AP (L): 0.809502 coco/AR: 0.788555 coco/AR .5: 0.935139 coco/AR .75: 0.850126 coco/AR (M): 0.742311 coco/AR (L): 0.855295 2022/09/26 17:46:30 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:46:30 - mmengine - INFO - Epoch(train) [151][50/293] lr: 5.000000e-04 eta: 2:14:20 time: 0.547210 data_time: 0.110301 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.860579 loss: 0.000518 2022/09/26 17:46:56 - mmengine - INFO - Epoch(train) [151][100/293] lr: 5.000000e-04 eta: 2:13:58 time: 0.518227 data_time: 0.098353 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.872312 loss: 0.000532 2022/09/26 17:47:23 - mmengine - INFO - Epoch(train) [151][150/293] lr: 5.000000e-04 eta: 2:13:36 time: 0.539510 data_time: 0.107936 memory: 20140 loss_kpt: 0.000512 acc_pose: 0.851404 loss: 0.000512 2022/09/26 17:47:50 - mmengine - INFO - Epoch(train) [151][200/293] lr: 5.000000e-04 eta: 2:13:15 time: 0.531058 data_time: 0.101593 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.852337 loss: 0.000536 2022/09/26 17:48:17 - mmengine - INFO - Epoch(train) [151][250/293] lr: 5.000000e-04 eta: 2:12:53 time: 0.532149 data_time: 0.106581 memory: 20140 loss_kpt: 0.000522 acc_pose: 0.886041 loss: 0.000522 2022/09/26 17:48:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:49:05 - mmengine - INFO - Epoch(train) [152][50/293] lr: 5.000000e-04 eta: 2:12:04 time: 0.531264 data_time: 0.098930 memory: 20140 loss_kpt: 0.000520 acc_pose: 0.867673 loss: 0.000520 2022/09/26 17:49:32 - mmengine - INFO - Epoch(train) [152][100/293] lr: 5.000000e-04 eta: 2:11:42 time: 0.524678 data_time: 0.111304 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.856192 loss: 0.000523 2022/09/26 17:49:58 - mmengine - INFO - Epoch(train) [152][150/293] lr: 5.000000e-04 eta: 2:11:21 time: 0.533526 data_time: 0.103126 memory: 20140 loss_kpt: 0.000536 acc_pose: 0.852785 loss: 0.000536 2022/09/26 17:50:25 - mmengine - INFO - Epoch(train) [152][200/293] lr: 5.000000e-04 eta: 2:10:59 time: 0.537269 data_time: 0.099247 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.878866 loss: 0.000525 2022/09/26 17:50:51 - mmengine - INFO - Epoch(train) [152][250/293] lr: 5.000000e-04 eta: 2:10:37 time: 0.517873 data_time: 0.106600 memory: 20140 loss_kpt: 0.000540 acc_pose: 0.869071 loss: 0.000540 2022/09/26 17:51:14 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:51:41 - mmengine - INFO - Epoch(train) [153][50/293] lr: 5.000000e-04 eta: 2:09:49 time: 0.542356 data_time: 0.107053 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.895053 loss: 0.000525 2022/09/26 17:52:07 - mmengine - INFO - Epoch(train) [153][100/293] lr: 5.000000e-04 eta: 2:09:27 time: 0.518207 data_time: 0.100127 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.856784 loss: 0.000518 2022/09/26 17:52:33 - mmengine - INFO - Epoch(train) [153][150/293] lr: 5.000000e-04 eta: 2:09:05 time: 0.528599 data_time: 0.100431 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.868230 loss: 0.000528 2022/09/26 17:53:00 - mmengine - INFO - Epoch(train) [153][200/293] lr: 5.000000e-04 eta: 2:08:44 time: 0.540298 data_time: 0.095892 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.846200 loss: 0.000533 2022/09/26 17:53:27 - mmengine - INFO - Epoch(train) [153][250/293] lr: 5.000000e-04 eta: 2:08:22 time: 0.530856 data_time: 0.107780 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.860402 loss: 0.000510 2022/09/26 17:53:50 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:54:16 - mmengine - INFO - Epoch(train) [154][50/293] lr: 5.000000e-04 eta: 2:07:33 time: 0.526906 data_time: 0.104207 memory: 20140 loss_kpt: 0.000513 acc_pose: 0.895764 loss: 0.000513 2022/09/26 17:54:42 - mmengine - INFO - Epoch(train) [154][100/293] lr: 5.000000e-04 eta: 2:07:11 time: 0.522311 data_time: 0.104148 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.862749 loss: 0.000533 2022/09/26 17:55:08 - mmengine - INFO - Epoch(train) [154][150/293] lr: 5.000000e-04 eta: 2:06:49 time: 0.521408 data_time: 0.101762 memory: 20140 loss_kpt: 0.000531 acc_pose: 0.872460 loss: 0.000531 2022/09/26 17:55:20 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:55:35 - mmengine - INFO - Epoch(train) [154][200/293] lr: 5.000000e-04 eta: 2:06:28 time: 0.530508 data_time: 0.107733 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.842134 loss: 0.000523 2022/09/26 17:56:01 - mmengine - INFO - Epoch(train) [154][250/293] lr: 5.000000e-04 eta: 2:06:06 time: 0.528726 data_time: 0.108990 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.833719 loss: 0.000523 2022/09/26 17:56:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:56:51 - mmengine - INFO - Epoch(train) [155][50/293] lr: 5.000000e-04 eta: 2:05:18 time: 0.554173 data_time: 0.108605 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.858711 loss: 0.000529 2022/09/26 17:57:18 - mmengine - INFO - Epoch(train) [155][100/293] lr: 5.000000e-04 eta: 2:04:56 time: 0.525915 data_time: 0.106132 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.854589 loss: 0.000527 2022/09/26 17:57:43 - mmengine - INFO - Epoch(train) [155][150/293] lr: 5.000000e-04 eta: 2:04:34 time: 0.507449 data_time: 0.097298 memory: 20140 loss_kpt: 0.000521 acc_pose: 0.845683 loss: 0.000521 2022/09/26 17:58:09 - mmengine - INFO - Epoch(train) [155][200/293] lr: 5.000000e-04 eta: 2:04:12 time: 0.520065 data_time: 0.107298 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.852758 loss: 0.000523 2022/09/26 17:58:36 - mmengine - INFO - Epoch(train) [155][250/293] lr: 5.000000e-04 eta: 2:03:50 time: 0.537696 data_time: 0.105303 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.853752 loss: 0.000525 2022/09/26 17:58:58 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 17:59:24 - mmengine - INFO - Epoch(train) [156][50/293] lr: 5.000000e-04 eta: 2:03:02 time: 0.531311 data_time: 0.104712 memory: 20140 loss_kpt: 0.000539 acc_pose: 0.825321 loss: 0.000539 2022/09/26 17:59:50 - mmengine - INFO - Epoch(train) [156][100/293] lr: 5.000000e-04 eta: 2:02:40 time: 0.519226 data_time: 0.102945 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.861278 loss: 0.000516 2022/09/26 18:00:18 - mmengine - INFO - Epoch(train) [156][150/293] lr: 5.000000e-04 eta: 2:02:18 time: 0.550964 data_time: 0.098594 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.836432 loss: 0.000524 2022/09/26 18:00:44 - mmengine - INFO - Epoch(train) [156][200/293] lr: 5.000000e-04 eta: 2:01:57 time: 0.532062 data_time: 0.105211 memory: 20140 loss_kpt: 0.000533 acc_pose: 0.846265 loss: 0.000533 2022/09/26 18:01:10 - mmengine - INFO - Epoch(train) [156][250/293] lr: 5.000000e-04 eta: 2:01:35 time: 0.516688 data_time: 0.100137 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.883970 loss: 0.000525 2022/09/26 18:01:33 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:02:00 - mmengine - INFO - Epoch(train) [157][50/293] lr: 5.000000e-04 eta: 2:00:46 time: 0.529575 data_time: 0.101962 memory: 20140 loss_kpt: 0.000512 acc_pose: 0.890371 loss: 0.000512 2022/09/26 18:02:26 - mmengine - INFO - Epoch(train) [157][100/293] lr: 5.000000e-04 eta: 2:00:25 time: 0.528568 data_time: 0.101119 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.843404 loss: 0.000518 2022/09/26 18:02:53 - mmengine - INFO - Epoch(train) [157][150/293] lr: 5.000000e-04 eta: 2:00:03 time: 0.536728 data_time: 0.104564 memory: 20140 loss_kpt: 0.000515 acc_pose: 0.820595 loss: 0.000515 2022/09/26 18:03:19 - mmengine - INFO - Epoch(train) [157][200/293] lr: 5.000000e-04 eta: 1:59:41 time: 0.524484 data_time: 0.099118 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.782584 loss: 0.000525 2022/09/26 18:03:46 - mmengine - INFO - Epoch(train) [157][250/293] lr: 5.000000e-04 eta: 1:59:19 time: 0.529317 data_time: 0.091785 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.877043 loss: 0.000529 2022/09/26 18:04:08 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:04:08 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:04:36 - mmengine - INFO - Epoch(train) [158][50/293] lr: 5.000000e-04 eta: 1:58:31 time: 0.554203 data_time: 0.107120 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.828713 loss: 0.000529 2022/09/26 18:05:02 - mmengine - INFO - Epoch(train) [158][100/293] lr: 5.000000e-04 eta: 1:58:09 time: 0.521372 data_time: 0.095121 memory: 20140 loss_kpt: 0.000520 acc_pose: 0.888387 loss: 0.000520 2022/09/26 18:05:29 - mmengine - INFO - Epoch(train) [158][150/293] lr: 5.000000e-04 eta: 1:57:48 time: 0.534535 data_time: 0.104999 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.862903 loss: 0.000524 2022/09/26 18:05:55 - mmengine - INFO - Epoch(train) [158][200/293] lr: 5.000000e-04 eta: 1:57:26 time: 0.527000 data_time: 0.112860 memory: 20140 loss_kpt: 0.000517 acc_pose: 0.857672 loss: 0.000517 2022/09/26 18:06:21 - mmengine - INFO - Epoch(train) [158][250/293] lr: 5.000000e-04 eta: 1:57:04 time: 0.522618 data_time: 0.106339 memory: 20140 loss_kpt: 0.000517 acc_pose: 0.849027 loss: 0.000517 2022/09/26 18:06:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:07:10 - mmengine - INFO - Epoch(train) [159][50/293] lr: 5.000000e-04 eta: 1:56:16 time: 0.534822 data_time: 0.120540 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.870987 loss: 0.000525 2022/09/26 18:07:37 - mmengine - INFO - Epoch(train) [159][100/293] lr: 5.000000e-04 eta: 1:55:54 time: 0.526470 data_time: 0.106408 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.881756 loss: 0.000510 2022/09/26 18:08:03 - mmengine - INFO - Epoch(train) [159][150/293] lr: 5.000000e-04 eta: 1:55:32 time: 0.536414 data_time: 0.110695 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.868113 loss: 0.000524 2022/09/26 18:08:30 - mmengine - INFO - Epoch(train) [159][200/293] lr: 5.000000e-04 eta: 1:55:10 time: 0.522691 data_time: 0.103128 memory: 20140 loss_kpt: 0.000528 acc_pose: 0.895170 loss: 0.000528 2022/09/26 18:08:57 - mmengine - INFO - Epoch(train) [159][250/293] lr: 5.000000e-04 eta: 1:54:49 time: 0.545082 data_time: 0.112325 memory: 20140 loss_kpt: 0.000538 acc_pose: 0.894548 loss: 0.000538 2022/09/26 18:09:20 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:09:46 - mmengine - INFO - Epoch(train) [160][50/293] lr: 5.000000e-04 eta: 1:54:01 time: 0.537207 data_time: 0.107247 memory: 20140 loss_kpt: 0.000515 acc_pose: 0.888138 loss: 0.000515 2022/09/26 18:10:13 - mmengine - INFO - Epoch(train) [160][100/293] lr: 5.000000e-04 eta: 1:53:39 time: 0.532936 data_time: 0.102298 memory: 20140 loss_kpt: 0.000530 acc_pose: 0.836490 loss: 0.000530 2022/09/26 18:10:40 - mmengine - INFO - Epoch(train) [160][150/293] lr: 5.000000e-04 eta: 1:53:17 time: 0.530466 data_time: 0.115339 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.838261 loss: 0.000518 2022/09/26 18:11:06 - mmengine - INFO - Epoch(train) [160][200/293] lr: 5.000000e-04 eta: 1:52:55 time: 0.527413 data_time: 0.106594 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.862827 loss: 0.000524 2022/09/26 18:11:33 - mmengine - INFO - Epoch(train) [160][250/293] lr: 5.000000e-04 eta: 1:52:34 time: 0.542712 data_time: 0.104706 memory: 20140 loss_kpt: 0.000520 acc_pose: 0.880989 loss: 0.000520 2022/09/26 18:11:55 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:11:55 - mmengine - INFO - Saving checkpoint at 160 epochs 2022/09/26 18:12:08 - mmengine - INFO - Epoch(val) [160][50/407] eta: 0:01:02 time: 0.175108 data_time: 0.017535 memory: 20140 2022/09/26 18:12:16 - mmengine - INFO - Epoch(val) [160][100/407] eta: 0:00:52 time: 0.171530 data_time: 0.013469 memory: 1830 2022/09/26 18:12:25 - mmengine - INFO - Epoch(val) [160][150/407] eta: 0:00:43 time: 0.168310 data_time: 0.012878 memory: 1830 2022/09/26 18:12:33 - mmengine - INFO - Epoch(val) [160][200/407] eta: 0:00:35 time: 0.169927 data_time: 0.011774 memory: 1830 2022/09/26 18:12:41 - mmengine - INFO - Epoch(val) [160][250/407] eta: 0:00:25 time: 0.164002 data_time: 0.010444 memory: 1830 2022/09/26 18:12:50 - mmengine - INFO - Epoch(val) [160][300/407] eta: 0:00:18 time: 0.169807 data_time: 0.015288 memory: 1830 2022/09/26 18:12:58 - mmengine - INFO - Epoch(val) [160][350/407] eta: 0:00:09 time: 0.167232 data_time: 0.011008 memory: 1830 2022/09/26 18:13:06 - mmengine - INFO - Epoch(val) [160][400/407] eta: 0:00:01 time: 0.161762 data_time: 0.009511 memory: 1830 2022/09/26 18:13:39 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 18:13:52 - mmengine - INFO - Epoch(val) [160][407/407] coco/AP: 0.737705 coco/AP .5: 0.899107 coco/AP .75: 0.801106 coco/AP (M): 0.696170 coco/AP (L): 0.810087 coco/AR: 0.788681 coco/AR .5: 0.935611 coco/AR .75: 0.846662 coco/AR (M): 0.742611 coco/AR (L): 0.855035 2022/09/26 18:14:20 - mmengine - INFO - Epoch(train) [161][50/293] lr: 5.000000e-04 eta: 1:51:46 time: 0.561945 data_time: 0.118632 memory: 20140 loss_kpt: 0.000514 acc_pose: 0.905190 loss: 0.000514 2022/09/26 18:14:46 - mmengine - INFO - Epoch(train) [161][100/293] lr: 5.000000e-04 eta: 1:51:25 time: 0.529672 data_time: 0.098217 memory: 20140 loss_kpt: 0.000520 acc_pose: 0.893410 loss: 0.000520 2022/09/26 18:14:57 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:15:13 - mmengine - INFO - Epoch(train) [161][150/293] lr: 5.000000e-04 eta: 1:51:03 time: 0.538411 data_time: 0.100588 memory: 20140 loss_kpt: 0.000514 acc_pose: 0.870689 loss: 0.000514 2022/09/26 18:15:40 - mmengine - INFO - Epoch(train) [161][200/293] lr: 5.000000e-04 eta: 1:50:41 time: 0.529627 data_time: 0.097477 memory: 20140 loss_kpt: 0.000529 acc_pose: 0.872783 loss: 0.000529 2022/09/26 18:16:06 - mmengine - INFO - Epoch(train) [161][250/293] lr: 5.000000e-04 eta: 1:50:19 time: 0.526798 data_time: 0.099144 memory: 20140 loss_kpt: 0.000521 acc_pose: 0.865960 loss: 0.000521 2022/09/26 18:16:28 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:16:55 - mmengine - INFO - Epoch(train) [162][50/293] lr: 5.000000e-04 eta: 1:49:31 time: 0.540341 data_time: 0.113771 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.850775 loss: 0.000526 2022/09/26 18:17:22 - mmengine - INFO - Epoch(train) [162][100/293] lr: 5.000000e-04 eta: 1:49:09 time: 0.525968 data_time: 0.105516 memory: 20140 loss_kpt: 0.000517 acc_pose: 0.892275 loss: 0.000517 2022/09/26 18:17:48 - mmengine - INFO - Epoch(train) [162][150/293] lr: 5.000000e-04 eta: 1:48:47 time: 0.523464 data_time: 0.101796 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.870998 loss: 0.000523 2022/09/26 18:18:14 - mmengine - INFO - Epoch(train) [162][200/293] lr: 5.000000e-04 eta: 1:48:26 time: 0.531936 data_time: 0.097260 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.846338 loss: 0.000518 2022/09/26 18:18:40 - mmengine - INFO - Epoch(train) [162][250/293] lr: 5.000000e-04 eta: 1:48:03 time: 0.520044 data_time: 0.104998 memory: 20140 loss_kpt: 0.000532 acc_pose: 0.873872 loss: 0.000532 2022/09/26 18:19:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:19:30 - mmengine - INFO - Epoch(train) [163][50/293] lr: 5.000000e-04 eta: 1:47:16 time: 0.537688 data_time: 0.109828 memory: 20140 loss_kpt: 0.000504 acc_pose: 0.882822 loss: 0.000504 2022/09/26 18:19:56 - mmengine - INFO - Epoch(train) [163][100/293] lr: 5.000000e-04 eta: 1:46:54 time: 0.515164 data_time: 0.095161 memory: 20140 loss_kpt: 0.000527 acc_pose: 0.814534 loss: 0.000527 2022/09/26 18:20:22 - mmengine - INFO - Epoch(train) [163][150/293] lr: 5.000000e-04 eta: 1:46:32 time: 0.522761 data_time: 0.105826 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.831696 loss: 0.000516 2022/09/26 18:20:48 - mmengine - INFO - Epoch(train) [163][200/293] lr: 5.000000e-04 eta: 1:46:10 time: 0.522580 data_time: 0.101552 memory: 20140 loss_kpt: 0.000517 acc_pose: 0.841141 loss: 0.000517 2022/09/26 18:21:14 - mmengine - INFO - Epoch(train) [163][250/293] lr: 5.000000e-04 eta: 1:45:48 time: 0.522516 data_time: 0.104953 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.827994 loss: 0.000516 2022/09/26 18:21:37 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:22:04 - mmengine - INFO - Epoch(train) [164][50/293] lr: 5.000000e-04 eta: 1:45:01 time: 0.547857 data_time: 0.107262 memory: 20140 loss_kpt: 0.000503 acc_pose: 0.890331 loss: 0.000503 2022/09/26 18:22:30 - mmengine - INFO - Epoch(train) [164][100/293] lr: 5.000000e-04 eta: 1:44:38 time: 0.508076 data_time: 0.099091 memory: 20140 loss_kpt: 0.000506 acc_pose: 0.879322 loss: 0.000506 2022/09/26 18:22:56 - mmengine - INFO - Epoch(train) [164][150/293] lr: 5.000000e-04 eta: 1:44:16 time: 0.537698 data_time: 0.103307 memory: 20140 loss_kpt: 0.000508 acc_pose: 0.892190 loss: 0.000508 2022/09/26 18:23:23 - mmengine - INFO - Epoch(train) [164][200/293] lr: 5.000000e-04 eta: 1:43:54 time: 0.525132 data_time: 0.111398 memory: 20140 loss_kpt: 0.000525 acc_pose: 0.875806 loss: 0.000525 2022/09/26 18:23:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:23:49 - mmengine - INFO - Epoch(train) [164][250/293] lr: 5.000000e-04 eta: 1:43:33 time: 0.534805 data_time: 0.106556 memory: 20140 loss_kpt: 0.000514 acc_pose: 0.878779 loss: 0.000514 2022/09/26 18:24:12 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:24:40 - mmengine - INFO - Epoch(train) [165][50/293] lr: 5.000000e-04 eta: 1:42:46 time: 0.559061 data_time: 0.109158 memory: 20140 loss_kpt: 0.000519 acc_pose: 0.872423 loss: 0.000519 2022/09/26 18:25:06 - mmengine - INFO - Epoch(train) [165][100/293] lr: 5.000000e-04 eta: 1:42:24 time: 0.524582 data_time: 0.103414 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.885068 loss: 0.000526 2022/09/26 18:25:32 - mmengine - INFO - Epoch(train) [165][150/293] lr: 5.000000e-04 eta: 1:42:02 time: 0.527431 data_time: 0.102037 memory: 20140 loss_kpt: 0.000517 acc_pose: 0.890699 loss: 0.000517 2022/09/26 18:25:59 - mmengine - INFO - Epoch(train) [165][200/293] lr: 5.000000e-04 eta: 1:41:39 time: 0.521608 data_time: 0.099149 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.847829 loss: 0.000516 2022/09/26 18:26:25 - mmengine - INFO - Epoch(train) [165][250/293] lr: 5.000000e-04 eta: 1:41:17 time: 0.531376 data_time: 0.108032 memory: 20140 loss_kpt: 0.000519 acc_pose: 0.901621 loss: 0.000519 2022/09/26 18:26:47 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:27:14 - mmengine - INFO - Epoch(train) [166][50/293] lr: 5.000000e-04 eta: 1:40:31 time: 0.543203 data_time: 0.112402 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.865007 loss: 0.000510 2022/09/26 18:27:41 - mmengine - INFO - Epoch(train) [166][100/293] lr: 5.000000e-04 eta: 1:40:08 time: 0.520923 data_time: 0.100223 memory: 20140 loss_kpt: 0.000512 acc_pose: 0.834932 loss: 0.000512 2022/09/26 18:28:07 - mmengine - INFO - Epoch(train) [166][150/293] lr: 5.000000e-04 eta: 1:39:47 time: 0.537844 data_time: 0.104130 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.870594 loss: 0.000510 2022/09/26 18:28:34 - mmengine - INFO - Epoch(train) [166][200/293] lr: 5.000000e-04 eta: 1:39:24 time: 0.521628 data_time: 0.095040 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.839888 loss: 0.000524 2022/09/26 18:29:00 - mmengine - INFO - Epoch(train) [166][250/293] lr: 5.000000e-04 eta: 1:39:02 time: 0.520819 data_time: 0.098981 memory: 20140 loss_kpt: 0.000514 acc_pose: 0.861745 loss: 0.000514 2022/09/26 18:29:22 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:29:49 - mmengine - INFO - Epoch(train) [167][50/293] lr: 5.000000e-04 eta: 1:38:15 time: 0.540455 data_time: 0.111217 memory: 20140 loss_kpt: 0.000524 acc_pose: 0.839008 loss: 0.000524 2022/09/26 18:30:16 - mmengine - INFO - Epoch(train) [167][100/293] lr: 5.000000e-04 eta: 1:37:53 time: 0.530994 data_time: 0.089979 memory: 20140 loss_kpt: 0.000512 acc_pose: 0.854772 loss: 0.000512 2022/09/26 18:30:42 - mmengine - INFO - Epoch(train) [167][150/293] lr: 5.000000e-04 eta: 1:37:31 time: 0.526126 data_time: 0.097021 memory: 20140 loss_kpt: 0.000515 acc_pose: 0.910381 loss: 0.000515 2022/09/26 18:31:10 - mmengine - INFO - Epoch(train) [167][200/293] lr: 5.000000e-04 eta: 1:37:10 time: 0.552146 data_time: 0.109041 memory: 20140 loss_kpt: 0.000537 acc_pose: 0.809472 loss: 0.000537 2022/09/26 18:31:36 - mmengine - INFO - Epoch(train) [167][250/293] lr: 5.000000e-04 eta: 1:36:47 time: 0.523644 data_time: 0.111913 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.848170 loss: 0.000526 2022/09/26 18:31:58 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:32:26 - mmengine - INFO - Epoch(train) [168][50/293] lr: 5.000000e-04 eta: 1:36:01 time: 0.545279 data_time: 0.111800 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.878939 loss: 0.000516 2022/09/26 18:32:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:32:52 - mmengine - INFO - Epoch(train) [168][100/293] lr: 5.000000e-04 eta: 1:35:39 time: 0.525754 data_time: 0.108962 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.873076 loss: 0.000510 2022/09/26 18:33:18 - mmengine - INFO - Epoch(train) [168][150/293] lr: 5.000000e-04 eta: 1:35:17 time: 0.529140 data_time: 0.096729 memory: 20140 loss_kpt: 0.000519 acc_pose: 0.866894 loss: 0.000519 2022/09/26 18:33:45 - mmengine - INFO - Epoch(train) [168][200/293] lr: 5.000000e-04 eta: 1:34:55 time: 0.541380 data_time: 0.097455 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.865540 loss: 0.000526 2022/09/26 18:34:13 - mmengine - INFO - Epoch(train) [168][250/293] lr: 5.000000e-04 eta: 1:34:33 time: 0.546054 data_time: 0.105473 memory: 20140 loss_kpt: 0.000526 acc_pose: 0.851887 loss: 0.000526 2022/09/26 18:34:35 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:35:02 - mmengine - INFO - Epoch(train) [169][50/293] lr: 5.000000e-04 eta: 1:33:46 time: 0.527898 data_time: 0.106666 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.853784 loss: 0.000510 2022/09/26 18:35:28 - mmengine - INFO - Epoch(train) [169][100/293] lr: 5.000000e-04 eta: 1:33:24 time: 0.520172 data_time: 0.097003 memory: 20140 loss_kpt: 0.000506 acc_pose: 0.889622 loss: 0.000506 2022/09/26 18:35:54 - mmengine - INFO - Epoch(train) [169][150/293] lr: 5.000000e-04 eta: 1:33:02 time: 0.532558 data_time: 0.093911 memory: 20140 loss_kpt: 0.000502 acc_pose: 0.824387 loss: 0.000502 2022/09/26 18:36:21 - mmengine - INFO - Epoch(train) [169][200/293] lr: 5.000000e-04 eta: 1:32:40 time: 0.528671 data_time: 0.103929 memory: 20140 loss_kpt: 0.000505 acc_pose: 0.863104 loss: 0.000505 2022/09/26 18:36:47 - mmengine - INFO - Epoch(train) [169][250/293] lr: 5.000000e-04 eta: 1:32:17 time: 0.523471 data_time: 0.107559 memory: 20140 loss_kpt: 0.000515 acc_pose: 0.844934 loss: 0.000515 2022/09/26 18:37:09 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:37:36 - mmengine - INFO - Epoch(train) [170][50/293] lr: 5.000000e-04 eta: 1:31:31 time: 0.542032 data_time: 0.107976 memory: 20140 loss_kpt: 0.000510 acc_pose: 0.850638 loss: 0.000510 2022/09/26 18:38:03 - mmengine - INFO - Epoch(train) [170][100/293] lr: 5.000000e-04 eta: 1:31:09 time: 0.530613 data_time: 0.100285 memory: 20140 loss_kpt: 0.000518 acc_pose: 0.883261 loss: 0.000518 2022/09/26 18:38:28 - mmengine - INFO - Epoch(train) [170][150/293] lr: 5.000000e-04 eta: 1:30:47 time: 0.516864 data_time: 0.105117 memory: 20140 loss_kpt: 0.000523 acc_pose: 0.858883 loss: 0.000523 2022/09/26 18:38:54 - mmengine - INFO - Epoch(train) [170][200/293] lr: 5.000000e-04 eta: 1:30:24 time: 0.517901 data_time: 0.100263 memory: 20140 loss_kpt: 0.000505 acc_pose: 0.898978 loss: 0.000505 2022/09/26 18:39:21 - mmengine - INFO - Epoch(train) [170][250/293] lr: 5.000000e-04 eta: 1:30:02 time: 0.530384 data_time: 0.108066 memory: 20140 loss_kpt: 0.000507 acc_pose: 0.855608 loss: 0.000507 2022/09/26 18:39:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:39:43 - mmengine - INFO - Saving checkpoint at 170 epochs 2022/09/26 18:39:56 - mmengine - INFO - Epoch(val) [170][50/407] eta: 0:01:09 time: 0.194130 data_time: 0.033719 memory: 20140 2022/09/26 18:40:04 - mmengine - INFO - Epoch(val) [170][100/407] eta: 0:00:50 time: 0.164044 data_time: 0.011083 memory: 1830 2022/09/26 18:40:13 - mmengine - INFO - Epoch(val) [170][150/407] eta: 0:00:44 time: 0.174705 data_time: 0.014869 memory: 1830 2022/09/26 18:40:22 - mmengine - INFO - Epoch(val) [170][200/407] eta: 0:00:34 time: 0.166642 data_time: 0.010455 memory: 1830 2022/09/26 18:40:30 - mmengine - INFO - Epoch(val) [170][250/407] eta: 0:00:27 time: 0.172298 data_time: 0.015785 memory: 1830 2022/09/26 18:40:39 - mmengine - INFO - Epoch(val) [170][300/407] eta: 0:00:17 time: 0.167932 data_time: 0.012588 memory: 1830 2022/09/26 18:40:47 - mmengine - INFO - Epoch(val) [170][350/407] eta: 0:00:09 time: 0.168692 data_time: 0.011211 memory: 1830 2022/09/26 18:40:55 - mmengine - INFO - Epoch(val) [170][400/407] eta: 0:00:01 time: 0.163716 data_time: 0.010238 memory: 1830 2022/09/26 18:41:28 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 18:41:41 - mmengine - INFO - Epoch(val) [170][407/407] coco/AP: 0.737836 coco/AP .5: 0.900435 coco/AP .75: 0.806371 coco/AP (M): 0.695929 coco/AP (L): 0.807980 coco/AR: 0.788885 coco/AR .5: 0.938287 coco/AR .75: 0.850126 coco/AR (M): 0.743048 coco/AR (L): 0.854106 2022/09/26 18:42:09 - mmengine - INFO - Epoch(train) [171][50/293] lr: 5.000000e-05 eta: 1:29:16 time: 0.568136 data_time: 0.123014 memory: 20140 loss_kpt: 0.000516 acc_pose: 0.870167 loss: 0.000516 2022/09/26 18:42:36 - mmengine - INFO - Epoch(train) [171][100/293] lr: 5.000000e-05 eta: 1:28:54 time: 0.534695 data_time: 0.099360 memory: 20140 loss_kpt: 0.000495 acc_pose: 0.898650 loss: 0.000495 2022/09/26 18:43:02 - mmengine - INFO - Epoch(train) [171][150/293] lr: 5.000000e-05 eta: 1:28:32 time: 0.529264 data_time: 0.101248 memory: 20140 loss_kpt: 0.000488 acc_pose: 0.875029 loss: 0.000488 2022/09/26 18:43:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:43:29 - mmengine - INFO - Epoch(train) [171][200/293] lr: 5.000000e-05 eta: 1:28:10 time: 0.529875 data_time: 0.107712 memory: 20140 loss_kpt: 0.000490 acc_pose: 0.858985 loss: 0.000490 2022/09/26 18:43:55 - mmengine - INFO - Epoch(train) [171][250/293] lr: 5.000000e-05 eta: 1:27:47 time: 0.521761 data_time: 0.096761 memory: 20140 loss_kpt: 0.000504 acc_pose: 0.856927 loss: 0.000504 2022/09/26 18:44:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:44:45 - mmengine - INFO - Epoch(train) [172][50/293] lr: 5.000000e-05 eta: 1:27:01 time: 0.538478 data_time: 0.114961 memory: 20140 loss_kpt: 0.000483 acc_pose: 0.912167 loss: 0.000483 2022/09/26 18:45:12 - mmengine - INFO - Epoch(train) [172][100/293] lr: 5.000000e-05 eta: 1:26:39 time: 0.529364 data_time: 0.097200 memory: 20140 loss_kpt: 0.000500 acc_pose: 0.845869 loss: 0.000500 2022/09/26 18:45:39 - mmengine - INFO - Epoch(train) [172][150/293] lr: 5.000000e-05 eta: 1:26:17 time: 0.534733 data_time: 0.099773 memory: 20140 loss_kpt: 0.000474 acc_pose: 0.877886 loss: 0.000474 2022/09/26 18:46:05 - mmengine - INFO - Epoch(train) [172][200/293] lr: 5.000000e-05 eta: 1:25:55 time: 0.529384 data_time: 0.106199 memory: 20140 loss_kpt: 0.000499 acc_pose: 0.863919 loss: 0.000499 2022/09/26 18:46:32 - mmengine - INFO - Epoch(train) [172][250/293] lr: 5.000000e-05 eta: 1:25:33 time: 0.539995 data_time: 0.111723 memory: 20140 loss_kpt: 0.000489 acc_pose: 0.875567 loss: 0.000489 2022/09/26 18:46:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:47:21 - mmengine - INFO - Epoch(train) [173][50/293] lr: 5.000000e-05 eta: 1:24:46 time: 0.527760 data_time: 0.110337 memory: 20140 loss_kpt: 0.000483 acc_pose: 0.859979 loss: 0.000483 2022/09/26 18:47:47 - mmengine - INFO - Epoch(train) [173][100/293] lr: 5.000000e-05 eta: 1:24:24 time: 0.530289 data_time: 0.101122 memory: 20140 loss_kpt: 0.000477 acc_pose: 0.857956 loss: 0.000477 2022/09/26 18:48:14 - mmengine - INFO - Epoch(train) [173][150/293] lr: 5.000000e-05 eta: 1:24:02 time: 0.533248 data_time: 0.109123 memory: 20140 loss_kpt: 0.000486 acc_pose: 0.878417 loss: 0.000486 2022/09/26 18:48:41 - mmengine - INFO - Epoch(train) [173][200/293] lr: 5.000000e-05 eta: 1:23:40 time: 0.528056 data_time: 0.099700 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.931329 loss: 0.000479 2022/09/26 18:49:07 - mmengine - INFO - Epoch(train) [173][250/293] lr: 5.000000e-05 eta: 1:23:18 time: 0.525491 data_time: 0.100846 memory: 20140 loss_kpt: 0.000492 acc_pose: 0.856799 loss: 0.000492 2022/09/26 18:49:30 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:49:56 - mmengine - INFO - Epoch(train) [174][50/293] lr: 5.000000e-05 eta: 1:22:32 time: 0.534926 data_time: 0.105318 memory: 20140 loss_kpt: 0.000481 acc_pose: 0.862652 loss: 0.000481 2022/09/26 18:50:22 - mmengine - INFO - Epoch(train) [174][100/293] lr: 5.000000e-05 eta: 1:22:09 time: 0.520244 data_time: 0.102250 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.902269 loss: 0.000479 2022/09/26 18:50:49 - mmengine - INFO - Epoch(train) [174][150/293] lr: 5.000000e-05 eta: 1:21:47 time: 0.538430 data_time: 0.099126 memory: 20140 loss_kpt: 0.000483 acc_pose: 0.917433 loss: 0.000483 2022/09/26 18:51:15 - mmengine - INFO - Epoch(train) [174][200/293] lr: 5.000000e-05 eta: 1:21:25 time: 0.521565 data_time: 0.099918 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.905276 loss: 0.000479 2022/09/26 18:51:42 - mmengine - INFO - Epoch(train) [174][250/293] lr: 5.000000e-05 eta: 1:21:03 time: 0.528063 data_time: 0.091594 memory: 20140 loss_kpt: 0.000483 acc_pose: 0.904071 loss: 0.000483 2022/09/26 18:52:04 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:52:14 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:52:31 - mmengine - INFO - Epoch(train) [175][50/293] lr: 5.000000e-05 eta: 1:20:17 time: 0.533975 data_time: 0.115383 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.893478 loss: 0.000471 2022/09/26 18:52:58 - mmengine - INFO - Epoch(train) [175][100/293] lr: 5.000000e-05 eta: 1:19:54 time: 0.536499 data_time: 0.111127 memory: 20140 loss_kpt: 0.000469 acc_pose: 0.902572 loss: 0.000469 2022/09/26 18:53:24 - mmengine - INFO - Epoch(train) [175][150/293] lr: 5.000000e-05 eta: 1:19:32 time: 0.524818 data_time: 0.104715 memory: 20140 loss_kpt: 0.000489 acc_pose: 0.896244 loss: 0.000489 2022/09/26 18:53:50 - mmengine - INFO - Epoch(train) [175][200/293] lr: 5.000000e-05 eta: 1:19:10 time: 0.522381 data_time: 0.104883 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.871497 loss: 0.000471 2022/09/26 18:54:18 - mmengine - INFO - Epoch(train) [175][250/293] lr: 5.000000e-05 eta: 1:18:48 time: 0.546825 data_time: 0.110949 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.912162 loss: 0.000473 2022/09/26 18:54:40 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:55:08 - mmengine - INFO - Epoch(train) [176][50/293] lr: 5.000000e-05 eta: 1:18:02 time: 0.551564 data_time: 0.110438 memory: 20140 loss_kpt: 0.000483 acc_pose: 0.874259 loss: 0.000483 2022/09/26 18:55:34 - mmengine - INFO - Epoch(train) [176][100/293] lr: 5.000000e-05 eta: 1:17:40 time: 0.522977 data_time: 0.092334 memory: 20140 loss_kpt: 0.000484 acc_pose: 0.875449 loss: 0.000484 2022/09/26 18:56:01 - mmengine - INFO - Epoch(train) [176][150/293] lr: 5.000000e-05 eta: 1:17:18 time: 0.544181 data_time: 0.103745 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.896329 loss: 0.000471 2022/09/26 18:56:28 - mmengine - INFO - Epoch(train) [176][200/293] lr: 5.000000e-05 eta: 1:16:55 time: 0.532396 data_time: 0.111870 memory: 20140 loss_kpt: 0.000484 acc_pose: 0.883542 loss: 0.000484 2022/09/26 18:56:54 - mmengine - INFO - Epoch(train) [176][250/293] lr: 5.000000e-05 eta: 1:16:33 time: 0.525361 data_time: 0.099138 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.918797 loss: 0.000471 2022/09/26 18:57:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 18:57:45 - mmengine - INFO - Epoch(train) [177][50/293] lr: 5.000000e-05 eta: 1:15:47 time: 0.538492 data_time: 0.115152 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.857735 loss: 0.000472 2022/09/26 18:58:11 - mmengine - INFO - Epoch(train) [177][100/293] lr: 5.000000e-05 eta: 1:15:25 time: 0.531866 data_time: 0.109315 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.887899 loss: 0.000473 2022/09/26 18:58:38 - mmengine - INFO - Epoch(train) [177][150/293] lr: 5.000000e-05 eta: 1:15:03 time: 0.531730 data_time: 0.106063 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.838881 loss: 0.000472 2022/09/26 18:59:04 - mmengine - INFO - Epoch(train) [177][200/293] lr: 5.000000e-05 eta: 1:14:41 time: 0.531768 data_time: 0.101908 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.906331 loss: 0.000468 2022/09/26 18:59:31 - mmengine - INFO - Epoch(train) [177][250/293] lr: 5.000000e-05 eta: 1:14:18 time: 0.532177 data_time: 0.104595 memory: 20140 loss_kpt: 0.000480 acc_pose: 0.910206 loss: 0.000480 2022/09/26 18:59:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:00:21 - mmengine - INFO - Epoch(train) [178][50/293] lr: 5.000000e-05 eta: 1:13:33 time: 0.550355 data_time: 0.114938 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.873431 loss: 0.000472 2022/09/26 19:00:47 - mmengine - INFO - Epoch(train) [178][100/293] lr: 5.000000e-05 eta: 1:13:10 time: 0.516062 data_time: 0.089332 memory: 20140 loss_kpt: 0.000475 acc_pose: 0.942581 loss: 0.000475 2022/09/26 19:01:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:01:13 - mmengine - INFO - Epoch(train) [178][150/293] lr: 5.000000e-05 eta: 1:12:48 time: 0.524972 data_time: 0.091392 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.845869 loss: 0.000472 2022/09/26 19:01:39 - mmengine - INFO - Epoch(train) [178][200/293] lr: 5.000000e-05 eta: 1:12:26 time: 0.527243 data_time: 0.108572 memory: 20140 loss_kpt: 0.000474 acc_pose: 0.874490 loss: 0.000474 2022/09/26 19:02:06 - mmengine - INFO - Epoch(train) [178][250/293] lr: 5.000000e-05 eta: 1:12:04 time: 0.533379 data_time: 0.103966 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.888163 loss: 0.000471 2022/09/26 19:02:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:02:56 - mmengine - INFO - Epoch(train) [179][50/293] lr: 5.000000e-05 eta: 1:11:18 time: 0.541519 data_time: 0.115885 memory: 20140 loss_kpt: 0.000486 acc_pose: 0.915034 loss: 0.000486 2022/09/26 19:03:22 - mmengine - INFO - Epoch(train) [179][100/293] lr: 5.000000e-05 eta: 1:10:56 time: 0.515506 data_time: 0.099670 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.861156 loss: 0.000464 2022/09/26 19:03:48 - mmengine - INFO - Epoch(train) [179][150/293] lr: 5.000000e-05 eta: 1:10:33 time: 0.522600 data_time: 0.096097 memory: 20140 loss_kpt: 0.000478 acc_pose: 0.857742 loss: 0.000478 2022/09/26 19:04:15 - mmengine - INFO - Epoch(train) [179][200/293] lr: 5.000000e-05 eta: 1:10:11 time: 0.534623 data_time: 0.106485 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.880560 loss: 0.000466 2022/09/26 19:04:41 - mmengine - INFO - Epoch(train) [179][250/293] lr: 5.000000e-05 eta: 1:09:49 time: 0.525183 data_time: 0.086457 memory: 20140 loss_kpt: 0.000481 acc_pose: 0.912316 loss: 0.000481 2022/09/26 19:05:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:05:30 - mmengine - INFO - Epoch(train) [180][50/293] lr: 5.000000e-05 eta: 1:09:03 time: 0.540499 data_time: 0.111798 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.830764 loss: 0.000479 2022/09/26 19:05:57 - mmengine - INFO - Epoch(train) [180][100/293] lr: 5.000000e-05 eta: 1:08:41 time: 0.529476 data_time: 0.105921 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.848240 loss: 0.000471 2022/09/26 19:06:23 - mmengine - INFO - Epoch(train) [180][150/293] lr: 5.000000e-05 eta: 1:08:18 time: 0.526134 data_time: 0.104655 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.809559 loss: 0.000472 2022/09/26 19:06:49 - mmengine - INFO - Epoch(train) [180][200/293] lr: 5.000000e-05 eta: 1:07:56 time: 0.514099 data_time: 0.099911 memory: 20140 loss_kpt: 0.000477 acc_pose: 0.915346 loss: 0.000477 2022/09/26 19:07:15 - mmengine - INFO - Epoch(train) [180][250/293] lr: 5.000000e-05 eta: 1:07:34 time: 0.530227 data_time: 0.100356 memory: 20140 loss_kpt: 0.000474 acc_pose: 0.883358 loss: 0.000474 2022/09/26 19:07:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:07:39 - mmengine - INFO - Saving checkpoint at 180 epochs 2022/09/26 19:07:53 - mmengine - INFO - Epoch(val) [180][50/407] eta: 0:01:02 time: 0.174052 data_time: 0.017099 memory: 20140 2022/09/26 19:08:01 - mmengine - INFO - Epoch(val) [180][100/407] eta: 0:00:51 time: 0.167870 data_time: 0.011519 memory: 1830 2022/09/26 19:08:10 - mmengine - INFO - Epoch(val) [180][150/407] eta: 0:00:44 time: 0.172546 data_time: 0.013085 memory: 1830 2022/09/26 19:08:18 - mmengine - INFO - Epoch(val) [180][200/407] eta: 0:00:35 time: 0.172795 data_time: 0.014002 memory: 1830 2022/09/26 19:08:27 - mmengine - INFO - Epoch(val) [180][250/407] eta: 0:00:27 time: 0.173482 data_time: 0.019380 memory: 1830 2022/09/26 19:08:35 - mmengine - INFO - Epoch(val) [180][300/407] eta: 0:00:17 time: 0.164929 data_time: 0.010431 memory: 1830 2022/09/26 19:08:44 - mmengine - INFO - Epoch(val) [180][350/407] eta: 0:00:09 time: 0.167018 data_time: 0.011943 memory: 1830 2022/09/26 19:08:52 - mmengine - INFO - Epoch(val) [180][400/407] eta: 0:00:01 time: 0.160732 data_time: 0.010817 memory: 1830 2022/09/26 19:09:24 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 19:09:37 - mmengine - INFO - Epoch(val) [180][407/407] coco/AP: 0.746858 coco/AP .5: 0.902183 coco/AP .75: 0.813606 coco/AP (M): 0.704790 coco/AP (L): 0.819098 coco/AR: 0.798064 coco/AR .5: 0.938602 coco/AR .75: 0.859099 coco/AR (M): 0.751653 coco/AR (L): 0.864771 2022/09/26 19:09:37 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_140.pth is removed 2022/09/26 19:09:39 - mmengine - INFO - The best checkpoint with 0.7469 coco/AP at 180 epoch is saved to best_coco/AP_epoch_180.pth. 2022/09/26 19:10:07 - mmengine - INFO - Epoch(train) [181][50/293] lr: 5.000000e-05 eta: 1:06:48 time: 0.548993 data_time: 0.111207 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.866054 loss: 0.000471 2022/09/26 19:10:33 - mmengine - INFO - Epoch(train) [181][100/293] lr: 5.000000e-05 eta: 1:06:26 time: 0.529562 data_time: 0.099703 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.900499 loss: 0.000467 2022/09/26 19:11:00 - mmengine - INFO - Epoch(train) [181][150/293] lr: 5.000000e-05 eta: 1:06:04 time: 0.540133 data_time: 0.103247 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.867038 loss: 0.000479 2022/09/26 19:11:27 - mmengine - INFO - Epoch(train) [181][200/293] lr: 5.000000e-05 eta: 1:05:41 time: 0.526889 data_time: 0.114786 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.877046 loss: 0.000472 2022/09/26 19:11:53 - mmengine - INFO - Epoch(train) [181][250/293] lr: 5.000000e-05 eta: 1:05:19 time: 0.529139 data_time: 0.107717 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.893101 loss: 0.000470 2022/09/26 19:11:59 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:12:16 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:12:42 - mmengine - INFO - Epoch(train) [182][50/293] lr: 5.000000e-05 eta: 1:04:34 time: 0.530907 data_time: 0.114442 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.839098 loss: 0.000479 2022/09/26 19:13:09 - mmengine - INFO - Epoch(train) [182][100/293] lr: 5.000000e-05 eta: 1:04:11 time: 0.533667 data_time: 0.105611 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.902255 loss: 0.000467 2022/09/26 19:13:35 - mmengine - INFO - Epoch(train) [182][150/293] lr: 5.000000e-05 eta: 1:03:49 time: 0.516859 data_time: 0.092910 memory: 20140 loss_kpt: 0.000478 acc_pose: 0.897465 loss: 0.000478 2022/09/26 19:14:02 - mmengine - INFO - Epoch(train) [182][200/293] lr: 5.000000e-05 eta: 1:03:27 time: 0.545956 data_time: 0.098428 memory: 20140 loss_kpt: 0.000474 acc_pose: 0.917505 loss: 0.000474 2022/09/26 19:14:29 - mmengine - INFO - Epoch(train) [182][250/293] lr: 5.000000e-05 eta: 1:03:04 time: 0.534588 data_time: 0.103509 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.850169 loss: 0.000471 2022/09/26 19:14:51 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:15:17 - mmengine - INFO - Epoch(train) [183][50/293] lr: 5.000000e-05 eta: 1:02:19 time: 0.529319 data_time: 0.106482 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.883988 loss: 0.000461 2022/09/26 19:15:44 - mmengine - INFO - Epoch(train) [183][100/293] lr: 5.000000e-05 eta: 1:01:57 time: 0.528426 data_time: 0.093728 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.855965 loss: 0.000455 2022/09/26 19:16:10 - mmengine - INFO - Epoch(train) [183][150/293] lr: 5.000000e-05 eta: 1:01:34 time: 0.524419 data_time: 0.097581 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.883430 loss: 0.000471 2022/09/26 19:16:37 - mmengine - INFO - Epoch(train) [183][200/293] lr: 5.000000e-05 eta: 1:01:12 time: 0.529439 data_time: 0.104530 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.917357 loss: 0.000467 2022/09/26 19:17:03 - mmengine - INFO - Epoch(train) [183][250/293] lr: 5.000000e-05 eta: 1:00:49 time: 0.522405 data_time: 0.099961 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.851250 loss: 0.000466 2022/09/26 19:17:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:17:53 - mmengine - INFO - Epoch(train) [184][50/293] lr: 5.000000e-05 eta: 1:00:05 time: 0.558039 data_time: 0.119131 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.883503 loss: 0.000464 2022/09/26 19:18:19 - mmengine - INFO - Epoch(train) [184][100/293] lr: 5.000000e-05 eta: 0:59:42 time: 0.526119 data_time: 0.105850 memory: 20140 loss_kpt: 0.000480 acc_pose: 0.888111 loss: 0.000480 2022/09/26 19:18:44 - mmengine - INFO - Epoch(train) [184][150/293] lr: 5.000000e-05 eta: 0:59:20 time: 0.507698 data_time: 0.093258 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.891730 loss: 0.000464 2022/09/26 19:19:10 - mmengine - INFO - Epoch(train) [184][200/293] lr: 5.000000e-05 eta: 0:58:57 time: 0.520931 data_time: 0.104212 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.876466 loss: 0.000470 2022/09/26 19:19:36 - mmengine - INFO - Epoch(train) [184][250/293] lr: 5.000000e-05 eta: 0:58:35 time: 0.520008 data_time: 0.099889 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.850443 loss: 0.000473 2022/09/26 19:19:59 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:20:26 - mmengine - INFO - Epoch(train) [185][50/293] lr: 5.000000e-05 eta: 0:57:50 time: 0.534284 data_time: 0.103846 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.919857 loss: 0.000466 2022/09/26 19:20:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:20:52 - mmengine - INFO - Epoch(train) [185][100/293] lr: 5.000000e-05 eta: 0:57:27 time: 0.527676 data_time: 0.087692 memory: 20140 loss_kpt: 0.000478 acc_pose: 0.895686 loss: 0.000478 2022/09/26 19:21:17 - mmengine - INFO - Epoch(train) [185][150/293] lr: 5.000000e-05 eta: 0:57:05 time: 0.505990 data_time: 0.099239 memory: 20140 loss_kpt: 0.000477 acc_pose: 0.844081 loss: 0.000477 2022/09/26 19:21:43 - mmengine - INFO - Epoch(train) [185][200/293] lr: 5.000000e-05 eta: 0:56:42 time: 0.524082 data_time: 0.103811 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.910312 loss: 0.000473 2022/09/26 19:22:09 - mmengine - INFO - Epoch(train) [185][250/293] lr: 5.000000e-05 eta: 0:56:20 time: 0.519902 data_time: 0.093028 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.900036 loss: 0.000460 2022/09/26 19:22:31 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:22:58 - mmengine - INFO - Epoch(train) [186][50/293] lr: 5.000000e-05 eta: 0:55:35 time: 0.533551 data_time: 0.115534 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.886663 loss: 0.000467 2022/09/26 19:23:24 - mmengine - INFO - Epoch(train) [186][100/293] lr: 5.000000e-05 eta: 0:55:12 time: 0.526135 data_time: 0.110534 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.908275 loss: 0.000455 2022/09/26 19:23:51 - mmengine - INFO - Epoch(train) [186][150/293] lr: 5.000000e-05 eta: 0:54:50 time: 0.534592 data_time: 0.110075 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.872551 loss: 0.000471 2022/09/26 19:24:17 - mmengine - INFO - Epoch(train) [186][200/293] lr: 5.000000e-05 eta: 0:54:27 time: 0.516472 data_time: 0.095220 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.872943 loss: 0.000467 2022/09/26 19:24:43 - mmengine - INFO - Epoch(train) [186][250/293] lr: 5.000000e-05 eta: 0:54:05 time: 0.531771 data_time: 0.098395 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.901850 loss: 0.000461 2022/09/26 19:25:06 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:25:33 - mmengine - INFO - Epoch(train) [187][50/293] lr: 5.000000e-05 eta: 0:53:20 time: 0.549035 data_time: 0.109245 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.862606 loss: 0.000466 2022/09/26 19:26:00 - mmengine - INFO - Epoch(train) [187][100/293] lr: 5.000000e-05 eta: 0:52:58 time: 0.542538 data_time: 0.104582 memory: 20140 loss_kpt: 0.000479 acc_pose: 0.875771 loss: 0.000479 2022/09/26 19:26:27 - mmengine - INFO - Epoch(train) [187][150/293] lr: 5.000000e-05 eta: 0:52:35 time: 0.522174 data_time: 0.098795 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.842311 loss: 0.000465 2022/09/26 19:26:53 - mmengine - INFO - Epoch(train) [187][200/293] lr: 5.000000e-05 eta: 0:52:13 time: 0.539170 data_time: 0.111934 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.861048 loss: 0.000461 2022/09/26 19:27:20 - mmengine - INFO - Epoch(train) [187][250/293] lr: 5.000000e-05 eta: 0:51:51 time: 0.535448 data_time: 0.103106 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.881631 loss: 0.000468 2022/09/26 19:27:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:28:10 - mmengine - INFO - Epoch(train) [188][50/293] lr: 5.000000e-05 eta: 0:51:06 time: 0.540311 data_time: 0.112001 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.900254 loss: 0.000464 2022/09/26 19:28:36 - mmengine - INFO - Epoch(train) [188][100/293] lr: 5.000000e-05 eta: 0:50:43 time: 0.516007 data_time: 0.102802 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.888835 loss: 0.000460 2022/09/26 19:29:03 - mmengine - INFO - Epoch(train) [188][150/293] lr: 5.000000e-05 eta: 0:50:21 time: 0.540257 data_time: 0.111374 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.869756 loss: 0.000467 2022/09/26 19:29:29 - mmengine - INFO - Epoch(train) [188][200/293] lr: 5.000000e-05 eta: 0:49:58 time: 0.515433 data_time: 0.100068 memory: 20140 loss_kpt: 0.000459 acc_pose: 0.888690 loss: 0.000459 2022/09/26 19:29:34 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:29:56 - mmengine - INFO - Epoch(train) [188][250/293] lr: 5.000000e-05 eta: 0:49:36 time: 0.539969 data_time: 0.111538 memory: 20140 loss_kpt: 0.000475 acc_pose: 0.901304 loss: 0.000475 2022/09/26 19:30:19 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:30:46 - mmengine - INFO - Epoch(train) [189][50/293] lr: 5.000000e-05 eta: 0:48:51 time: 0.547424 data_time: 0.118798 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.844196 loss: 0.000467 2022/09/26 19:31:13 - mmengine - INFO - Epoch(train) [189][100/293] lr: 5.000000e-05 eta: 0:48:29 time: 0.531955 data_time: 0.109354 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.912395 loss: 0.000470 2022/09/26 19:31:39 - mmengine - INFO - Epoch(train) [189][150/293] lr: 5.000000e-05 eta: 0:48:06 time: 0.519228 data_time: 0.095901 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.884058 loss: 0.000460 2022/09/26 19:32:05 - mmengine - INFO - Epoch(train) [189][200/293] lr: 5.000000e-05 eta: 0:47:44 time: 0.525813 data_time: 0.099498 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.910345 loss: 0.000465 2022/09/26 19:32:31 - mmengine - INFO - Epoch(train) [189][250/293] lr: 5.000000e-05 eta: 0:47:21 time: 0.531570 data_time: 0.105950 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.892489 loss: 0.000466 2022/09/26 19:32:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:33:21 - mmengine - INFO - Epoch(train) [190][50/293] lr: 5.000000e-05 eta: 0:46:37 time: 0.542728 data_time: 0.110388 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.891716 loss: 0.000464 2022/09/26 19:33:48 - mmengine - INFO - Epoch(train) [190][100/293] lr: 5.000000e-05 eta: 0:46:14 time: 0.522043 data_time: 0.100780 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.877105 loss: 0.000466 2022/09/26 19:34:14 - mmengine - INFO - Epoch(train) [190][150/293] lr: 5.000000e-05 eta: 0:45:52 time: 0.533724 data_time: 0.104335 memory: 20140 loss_kpt: 0.000477 acc_pose: 0.908099 loss: 0.000477 2022/09/26 19:34:41 - mmengine - INFO - Epoch(train) [190][200/293] lr: 5.000000e-05 eta: 0:45:29 time: 0.533182 data_time: 0.101072 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.913777 loss: 0.000466 2022/09/26 19:35:07 - mmengine - INFO - Epoch(train) [190][250/293] lr: 5.000000e-05 eta: 0:45:07 time: 0.522780 data_time: 0.104159 memory: 20140 loss_kpt: 0.000452 acc_pose: 0.851806 loss: 0.000452 2022/09/26 19:35:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:35:29 - mmengine - INFO - Saving checkpoint at 190 epochs 2022/09/26 19:35:42 - mmengine - INFO - Epoch(val) [190][50/407] eta: 0:01:02 time: 0.174981 data_time: 0.018588 memory: 20140 2022/09/26 19:35:50 - mmengine - INFO - Epoch(val) [190][100/407] eta: 0:00:50 time: 0.165939 data_time: 0.011237 memory: 1830 2022/09/26 19:35:59 - mmengine - INFO - Epoch(val) [190][150/407] eta: 0:00:44 time: 0.172006 data_time: 0.014013 memory: 1830 2022/09/26 19:36:07 - mmengine - INFO - Epoch(val) [190][200/407] eta: 0:00:34 time: 0.167200 data_time: 0.010884 memory: 1830 2022/09/26 19:36:16 - mmengine - INFO - Epoch(val) [190][250/407] eta: 0:00:26 time: 0.171092 data_time: 0.012533 memory: 1830 2022/09/26 19:36:24 - mmengine - INFO - Epoch(val) [190][300/407] eta: 0:00:17 time: 0.165162 data_time: 0.011131 memory: 1830 2022/09/26 19:36:32 - mmengine - INFO - Epoch(val) [190][350/407] eta: 0:00:09 time: 0.170811 data_time: 0.012395 memory: 1830 2022/09/26 19:36:41 - mmengine - INFO - Epoch(val) [190][400/407] eta: 0:00:01 time: 0.164721 data_time: 0.012253 memory: 1830 2022/09/26 19:37:13 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 19:37:26 - mmengine - INFO - Epoch(val) [190][407/407] coco/AP: 0.748418 coco/AP .5: 0.905267 coco/AP .75: 0.815580 coco/AP (M): 0.706687 coco/AP (L): 0.820178 coco/AR: 0.799323 coco/AR .5: 0.940649 coco/AR .75: 0.860831 coco/AR (M): 0.753046 coco/AR (L): 0.866184 2022/09/26 19:37:26 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_180.pth is removed 2022/09/26 19:37:28 - mmengine - INFO - The best checkpoint with 0.7484 coco/AP at 190 epoch is saved to best_coco/AP_epoch_190.pth. 2022/09/26 19:37:56 - mmengine - INFO - Epoch(train) [191][50/293] lr: 5.000000e-05 eta: 0:44:23 time: 0.540770 data_time: 0.115905 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.888873 loss: 0.000472 2022/09/26 19:38:22 - mmengine - INFO - Epoch(train) [191][100/293] lr: 5.000000e-05 eta: 0:44:00 time: 0.522135 data_time: 0.089855 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.898272 loss: 0.000470 2022/09/26 19:38:48 - mmengine - INFO - Epoch(train) [191][150/293] lr: 5.000000e-05 eta: 0:43:37 time: 0.523341 data_time: 0.097849 memory: 20140 loss_kpt: 0.000469 acc_pose: 0.853610 loss: 0.000469 2022/09/26 19:39:15 - mmengine - INFO - Epoch(train) [191][200/293] lr: 5.000000e-05 eta: 0:43:15 time: 0.534728 data_time: 0.100664 memory: 20140 loss_kpt: 0.000457 acc_pose: 0.911462 loss: 0.000457 2022/09/26 19:39:41 - mmengine - INFO - Epoch(train) [191][250/293] lr: 5.000000e-05 eta: 0:42:52 time: 0.535317 data_time: 0.093405 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.862762 loss: 0.000465 2022/09/26 19:40:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:40:24 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:40:30 - mmengine - INFO - Epoch(train) [192][50/293] lr: 5.000000e-05 eta: 0:42:08 time: 0.540062 data_time: 0.103393 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.898189 loss: 0.000464 2022/09/26 19:40:56 - mmengine - INFO - Epoch(train) [192][100/293] lr: 5.000000e-05 eta: 0:41:45 time: 0.524035 data_time: 0.094277 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.859623 loss: 0.000466 2022/09/26 19:41:23 - mmengine - INFO - Epoch(train) [192][150/293] lr: 5.000000e-05 eta: 0:41:23 time: 0.527144 data_time: 0.102802 memory: 20140 loss_kpt: 0.000477 acc_pose: 0.858681 loss: 0.000477 2022/09/26 19:41:49 - mmengine - INFO - Epoch(train) [192][200/293] lr: 5.000000e-05 eta: 0:41:00 time: 0.528643 data_time: 0.094471 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.892892 loss: 0.000465 2022/09/26 19:42:16 - mmengine - INFO - Epoch(train) [192][250/293] lr: 5.000000e-05 eta: 0:40:38 time: 0.536604 data_time: 0.092181 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.890509 loss: 0.000468 2022/09/26 19:42:39 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:43:06 - mmengine - INFO - Epoch(train) [193][50/293] lr: 5.000000e-05 eta: 0:39:54 time: 0.535545 data_time: 0.110001 memory: 20140 loss_kpt: 0.000469 acc_pose: 0.908418 loss: 0.000469 2022/09/26 19:43:32 - mmengine - INFO - Epoch(train) [193][100/293] lr: 5.000000e-05 eta: 0:39:31 time: 0.515935 data_time: 0.088910 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.882882 loss: 0.000460 2022/09/26 19:43:58 - mmengine - INFO - Epoch(train) [193][150/293] lr: 5.000000e-05 eta: 0:39:08 time: 0.528141 data_time: 0.099316 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.885452 loss: 0.000465 2022/09/26 19:44:25 - mmengine - INFO - Epoch(train) [193][200/293] lr: 5.000000e-05 eta: 0:38:46 time: 0.530993 data_time: 0.107911 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.877943 loss: 0.000464 2022/09/26 19:44:51 - mmengine - INFO - Epoch(train) [193][250/293] lr: 5.000000e-05 eta: 0:38:23 time: 0.522058 data_time: 0.107760 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.854512 loss: 0.000468 2022/09/26 19:45:13 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:45:39 - mmengine - INFO - Epoch(train) [194][50/293] lr: 5.000000e-05 eta: 0:37:39 time: 0.525463 data_time: 0.111897 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.889617 loss: 0.000467 2022/09/26 19:46:06 - mmengine - INFO - Epoch(train) [194][100/293] lr: 5.000000e-05 eta: 0:37:16 time: 0.528306 data_time: 0.110450 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.928498 loss: 0.000461 2022/09/26 19:46:32 - mmengine - INFO - Epoch(train) [194][150/293] lr: 5.000000e-05 eta: 0:36:54 time: 0.515759 data_time: 0.095447 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.894179 loss: 0.000464 2022/09/26 19:46:58 - mmengine - INFO - Epoch(train) [194][200/293] lr: 5.000000e-05 eta: 0:36:31 time: 0.534218 data_time: 0.102912 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.875047 loss: 0.000473 2022/09/26 19:47:25 - mmengine - INFO - Epoch(train) [194][250/293] lr: 5.000000e-05 eta: 0:36:09 time: 0.542241 data_time: 0.099366 memory: 20140 loss_kpt: 0.000456 acc_pose: 0.906189 loss: 0.000456 2022/09/26 19:47:48 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:48:16 - mmengine - INFO - Epoch(train) [195][50/293] lr: 5.000000e-05 eta: 0:35:25 time: 0.561027 data_time: 0.113525 memory: 20140 loss_kpt: 0.000469 acc_pose: 0.868364 loss: 0.000469 2022/09/26 19:48:43 - mmengine - INFO - Epoch(train) [195][100/293] lr: 5.000000e-05 eta: 0:35:02 time: 0.544511 data_time: 0.105032 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.865811 loss: 0.000466 2022/09/26 19:49:10 - mmengine - INFO - Epoch(train) [195][150/293] lr: 5.000000e-05 eta: 0:34:40 time: 0.525524 data_time: 0.103113 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.895806 loss: 0.000453 2022/09/26 19:49:14 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:49:36 - mmengine - INFO - Epoch(train) [195][200/293] lr: 5.000000e-05 eta: 0:34:17 time: 0.527129 data_time: 0.104569 memory: 20140 loss_kpt: 0.000475 acc_pose: 0.864311 loss: 0.000475 2022/09/26 19:50:02 - mmengine - INFO - Epoch(train) [195][250/293] lr: 5.000000e-05 eta: 0:33:54 time: 0.525271 data_time: 0.101621 memory: 20140 loss_kpt: 0.000457 acc_pose: 0.875821 loss: 0.000457 2022/09/26 19:50:25 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:50:52 - mmengine - INFO - Epoch(train) [196][50/293] lr: 5.000000e-05 eta: 0:33:10 time: 0.540990 data_time: 0.112077 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.918591 loss: 0.000467 2022/09/26 19:51:19 - mmengine - INFO - Epoch(train) [196][100/293] lr: 5.000000e-05 eta: 0:32:48 time: 0.528038 data_time: 0.104323 memory: 20140 loss_kpt: 0.000456 acc_pose: 0.871412 loss: 0.000456 2022/09/26 19:51:45 - mmengine - INFO - Epoch(train) [196][150/293] lr: 5.000000e-05 eta: 0:32:25 time: 0.536384 data_time: 0.107625 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.917293 loss: 0.000460 2022/09/26 19:52:12 - mmengine - INFO - Epoch(train) [196][200/293] lr: 5.000000e-05 eta: 0:32:02 time: 0.527183 data_time: 0.104150 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.900174 loss: 0.000471 2022/09/26 19:52:38 - mmengine - INFO - Epoch(train) [196][250/293] lr: 5.000000e-05 eta: 0:31:40 time: 0.530917 data_time: 0.106542 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.861067 loss: 0.000464 2022/09/26 19:53:00 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:53:28 - mmengine - INFO - Epoch(train) [197][50/293] lr: 5.000000e-05 eta: 0:30:56 time: 0.545995 data_time: 0.104530 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.878168 loss: 0.000455 2022/09/26 19:53:54 - mmengine - INFO - Epoch(train) [197][100/293] lr: 5.000000e-05 eta: 0:30:33 time: 0.525011 data_time: 0.104468 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.878541 loss: 0.000466 2022/09/26 19:54:20 - mmengine - INFO - Epoch(train) [197][150/293] lr: 5.000000e-05 eta: 0:30:11 time: 0.528692 data_time: 0.106131 memory: 20140 loss_kpt: 0.000476 acc_pose: 0.810472 loss: 0.000476 2022/09/26 19:54:47 - mmengine - INFO - Epoch(train) [197][200/293] lr: 5.000000e-05 eta: 0:29:48 time: 0.536939 data_time: 0.108000 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.890926 loss: 0.000455 2022/09/26 19:55:13 - mmengine - INFO - Epoch(train) [197][250/293] lr: 5.000000e-05 eta: 0:29:25 time: 0.525360 data_time: 0.097509 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.855090 loss: 0.000460 2022/09/26 19:55:35 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:56:02 - mmengine - INFO - Epoch(train) [198][50/293] lr: 5.000000e-05 eta: 0:28:42 time: 0.537627 data_time: 0.115620 memory: 20140 loss_kpt: 0.000447 acc_pose: 0.855091 loss: 0.000447 2022/09/26 19:56:29 - mmengine - INFO - Epoch(train) [198][100/293] lr: 5.000000e-05 eta: 0:28:19 time: 0.533916 data_time: 0.100115 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.889929 loss: 0.000467 2022/09/26 19:56:55 - mmengine - INFO - Epoch(train) [198][150/293] lr: 5.000000e-05 eta: 0:27:56 time: 0.517589 data_time: 0.101840 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.899490 loss: 0.000453 2022/09/26 19:57:21 - mmengine - INFO - Epoch(train) [198][200/293] lr: 5.000000e-05 eta: 0:27:34 time: 0.529591 data_time: 0.107475 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.884549 loss: 0.000466 2022/09/26 19:57:48 - mmengine - INFO - Epoch(train) [198][250/293] lr: 5.000000e-05 eta: 0:27:11 time: 0.527590 data_time: 0.104380 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.895263 loss: 0.000465 2022/09/26 19:58:03 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:58:10 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 19:58:37 - mmengine - INFO - Epoch(train) [199][50/293] lr: 5.000000e-05 eta: 0:26:27 time: 0.536921 data_time: 0.118963 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.901253 loss: 0.000461 2022/09/26 19:59:04 - mmengine - INFO - Epoch(train) [199][100/293] lr: 5.000000e-05 eta: 0:26:05 time: 0.545220 data_time: 0.099983 memory: 20140 loss_kpt: 0.000471 acc_pose: 0.896416 loss: 0.000471 2022/09/26 19:59:30 - mmengine - INFO - Epoch(train) [199][150/293] lr: 5.000000e-05 eta: 0:25:42 time: 0.523351 data_time: 0.099268 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.921913 loss: 0.000468 2022/09/26 19:59:57 - mmengine - INFO - Epoch(train) [199][200/293] lr: 5.000000e-05 eta: 0:25:19 time: 0.532425 data_time: 0.105765 memory: 20140 loss_kpt: 0.000462 acc_pose: 0.884382 loss: 0.000462 2022/09/26 20:00:23 - mmengine - INFO - Epoch(train) [199][250/293] lr: 5.000000e-05 eta: 0:24:57 time: 0.524484 data_time: 0.096177 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.901321 loss: 0.000464 2022/09/26 20:00:45 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:01:12 - mmengine - INFO - Epoch(train) [200][50/293] lr: 5.000000e-05 eta: 0:24:13 time: 0.526083 data_time: 0.113075 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.862729 loss: 0.000455 2022/09/26 20:01:38 - mmengine - INFO - Epoch(train) [200][100/293] lr: 5.000000e-05 eta: 0:23:50 time: 0.530964 data_time: 0.106564 memory: 20140 loss_kpt: 0.000459 acc_pose: 0.893389 loss: 0.000459 2022/09/26 20:02:05 - mmengine - INFO - Epoch(train) [200][150/293] lr: 5.000000e-05 eta: 0:23:28 time: 0.532623 data_time: 0.105099 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.899589 loss: 0.000467 2022/09/26 20:02:31 - mmengine - INFO - Epoch(train) [200][200/293] lr: 5.000000e-05 eta: 0:23:05 time: 0.529657 data_time: 0.101327 memory: 20140 loss_kpt: 0.000463 acc_pose: 0.877117 loss: 0.000463 2022/09/26 20:02:58 - mmengine - INFO - Epoch(train) [200][250/293] lr: 5.000000e-05 eta: 0:22:42 time: 0.532663 data_time: 0.098563 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.877280 loss: 0.000465 2022/09/26 20:03:20 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:03:20 - mmengine - INFO - Saving checkpoint at 200 epochs 2022/09/26 20:03:35 - mmengine - INFO - Epoch(val) [200][50/407] eta: 0:01:05 time: 0.182342 data_time: 0.019530 memory: 20140 2022/09/26 20:03:43 - mmengine - INFO - Epoch(val) [200][100/407] eta: 0:00:54 time: 0.176142 data_time: 0.021154 memory: 1830 2022/09/26 20:03:52 - mmengine - INFO - Epoch(val) [200][150/407] eta: 0:00:42 time: 0.163829 data_time: 0.009887 memory: 1830 2022/09/26 20:04:00 - mmengine - INFO - Epoch(val) [200][200/407] eta: 0:00:34 time: 0.164752 data_time: 0.010347 memory: 1830 2022/09/26 20:04:08 - mmengine - INFO - Epoch(val) [200][250/407] eta: 0:00:26 time: 0.166738 data_time: 0.011212 memory: 1830 2022/09/26 20:04:17 - mmengine - INFO - Epoch(val) [200][300/407] eta: 0:00:18 time: 0.169457 data_time: 0.015240 memory: 1830 2022/09/26 20:04:25 - mmengine - INFO - Epoch(val) [200][350/407] eta: 0:00:09 time: 0.173902 data_time: 0.017053 memory: 1830 2022/09/26 20:04:33 - mmengine - INFO - Epoch(val) [200][400/407] eta: 0:00:01 time: 0.161016 data_time: 0.009705 memory: 1830 2022/09/26 20:05:06 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 20:05:19 - mmengine - INFO - Epoch(val) [200][407/407] coco/AP: 0.748899 coco/AP .5: 0.905310 coco/AP .75: 0.818200 coco/AP (M): 0.707498 coco/AP (L): 0.819668 coco/AR: 0.799449 coco/AR .5: 0.940334 coco/AR .75: 0.862091 coco/AR (M): 0.754575 coco/AR (L): 0.864214 2022/09/26 20:05:19 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220926/res101_dark_384/best_coco/AP_epoch_190.pth is removed 2022/09/26 20:05:21 - mmengine - INFO - The best checkpoint with 0.7489 coco/AP at 200 epoch is saved to best_coco/AP_epoch_200.pth. 2022/09/26 20:05:48 - mmengine - INFO - Epoch(train) [201][50/293] lr: 5.000000e-06 eta: 0:21:59 time: 0.541937 data_time: 0.100301 memory: 20140 loss_kpt: 0.000457 acc_pose: 0.905450 loss: 0.000457 2022/09/26 20:06:15 - mmengine - INFO - Epoch(train) [201][100/293] lr: 5.000000e-06 eta: 0:21:36 time: 0.541027 data_time: 0.104891 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.912214 loss: 0.000470 2022/09/26 20:06:41 - mmengine - INFO - Epoch(train) [201][150/293] lr: 5.000000e-06 eta: 0:21:13 time: 0.518217 data_time: 0.100778 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.870910 loss: 0.000464 2022/09/26 20:07:08 - mmengine - INFO - Epoch(train) [201][200/293] lr: 5.000000e-06 eta: 0:20:51 time: 0.537803 data_time: 0.092790 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.861959 loss: 0.000466 2022/09/26 20:07:35 - mmengine - INFO - Epoch(train) [201][250/293] lr: 5.000000e-06 eta: 0:20:28 time: 0.539848 data_time: 0.100914 memory: 20140 loss_kpt: 0.000456 acc_pose: 0.892124 loss: 0.000456 2022/09/26 20:07:57 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:08:24 - mmengine - INFO - Epoch(train) [202][50/293] lr: 5.000000e-06 eta: 0:19:45 time: 0.539490 data_time: 0.103427 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.909553 loss: 0.000468 2022/09/26 20:08:50 - mmengine - INFO - Epoch(train) [202][100/293] lr: 5.000000e-06 eta: 0:19:22 time: 0.524986 data_time: 0.099262 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.908047 loss: 0.000460 2022/09/26 20:08:54 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:09:17 - mmengine - INFO - Epoch(train) [202][150/293] lr: 5.000000e-06 eta: 0:18:59 time: 0.536270 data_time: 0.102215 memory: 20140 loss_kpt: 0.000458 acc_pose: 0.921338 loss: 0.000458 2022/09/26 20:09:43 - mmengine - INFO - Epoch(train) [202][200/293] lr: 5.000000e-06 eta: 0:18:36 time: 0.516114 data_time: 0.094987 memory: 20140 loss_kpt: 0.000466 acc_pose: 0.879044 loss: 0.000466 2022/09/26 20:10:09 - mmengine - INFO - Epoch(train) [202][250/293] lr: 5.000000e-06 eta: 0:18:14 time: 0.529407 data_time: 0.102320 memory: 20140 loss_kpt: 0.000458 acc_pose: 0.883524 loss: 0.000458 2022/09/26 20:10:31 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:10:58 - mmengine - INFO - Epoch(train) [203][50/293] lr: 5.000000e-06 eta: 0:17:30 time: 0.556925 data_time: 0.129478 memory: 20140 loss_kpt: 0.000463 acc_pose: 0.882229 loss: 0.000463 2022/09/26 20:11:25 - mmengine - INFO - Epoch(train) [203][100/293] lr: 5.000000e-06 eta: 0:17:08 time: 0.529133 data_time: 0.103173 memory: 20140 loss_kpt: 0.000461 acc_pose: 0.903258 loss: 0.000461 2022/09/26 20:11:51 - mmengine - INFO - Epoch(train) [203][150/293] lr: 5.000000e-06 eta: 0:16:45 time: 0.525873 data_time: 0.099147 memory: 20140 loss_kpt: 0.000454 acc_pose: 0.905242 loss: 0.000454 2022/09/26 20:12:17 - mmengine - INFO - Epoch(train) [203][200/293] lr: 5.000000e-06 eta: 0:16:22 time: 0.519327 data_time: 0.099418 memory: 20140 loss_kpt: 0.000468 acc_pose: 0.881178 loss: 0.000468 2022/09/26 20:12:44 - mmengine - INFO - Epoch(train) [203][250/293] lr: 5.000000e-06 eta: 0:15:59 time: 0.542775 data_time: 0.110357 memory: 20140 loss_kpt: 0.000459 acc_pose: 0.884756 loss: 0.000459 2022/09/26 20:13:07 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:13:34 - mmengine - INFO - Epoch(train) [204][50/293] lr: 5.000000e-06 eta: 0:15:16 time: 0.544825 data_time: 0.105982 memory: 20140 loss_kpt: 0.000459 acc_pose: 0.879586 loss: 0.000459 2022/09/26 20:14:01 - mmengine - INFO - Epoch(train) [204][100/293] lr: 5.000000e-06 eta: 0:14:53 time: 0.533740 data_time: 0.096837 memory: 20140 loss_kpt: 0.000452 acc_pose: 0.904277 loss: 0.000452 2022/09/26 20:14:28 - mmengine - INFO - Epoch(train) [204][150/293] lr: 5.000000e-06 eta: 0:14:30 time: 0.532907 data_time: 0.105660 memory: 20140 loss_kpt: 0.000456 acc_pose: 0.849658 loss: 0.000456 2022/09/26 20:14:54 - mmengine - INFO - Epoch(train) [204][200/293] lr: 5.000000e-06 eta: 0:14:08 time: 0.518819 data_time: 0.096691 memory: 20140 loss_kpt: 0.000473 acc_pose: 0.854338 loss: 0.000473 2022/09/26 20:15:21 - mmengine - INFO - Epoch(train) [204][250/293] lr: 5.000000e-06 eta: 0:13:45 time: 0.547675 data_time: 0.106052 memory: 20140 loss_kpt: 0.000454 acc_pose: 0.909410 loss: 0.000454 2022/09/26 20:15:44 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:16:10 - mmengine - INFO - Epoch(train) [205][50/293] lr: 5.000000e-06 eta: 0:13:02 time: 0.525067 data_time: 0.104445 memory: 20140 loss_kpt: 0.000454 acc_pose: 0.857303 loss: 0.000454 2022/09/26 20:16:36 - mmengine - INFO - Epoch(train) [205][100/293] lr: 5.000000e-06 eta: 0:12:39 time: 0.521119 data_time: 0.100766 memory: 20140 loss_kpt: 0.000457 acc_pose: 0.872361 loss: 0.000457 2022/09/26 20:17:03 - mmengine - INFO - Epoch(train) [205][150/293] lr: 5.000000e-06 eta: 0:12:16 time: 0.531414 data_time: 0.100943 memory: 20140 loss_kpt: 0.000448 acc_pose: 0.857464 loss: 0.000448 2022/09/26 20:17:29 - mmengine - INFO - Epoch(train) [205][200/293] lr: 5.000000e-06 eta: 0:11:53 time: 0.533301 data_time: 0.108203 memory: 20140 loss_kpt: 0.000472 acc_pose: 0.886065 loss: 0.000472 2022/09/26 20:17:43 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:17:55 - mmengine - INFO - Epoch(train) [205][250/293] lr: 5.000000e-06 eta: 0:11:31 time: 0.514700 data_time: 0.099462 memory: 20140 loss_kpt: 0.000451 acc_pose: 0.862561 loss: 0.000451 2022/09/26 20:18:17 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:18:45 - mmengine - INFO - Epoch(train) [206][50/293] lr: 5.000000e-06 eta: 0:10:48 time: 0.556575 data_time: 0.108391 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.887000 loss: 0.000453 2022/09/26 20:19:12 - mmengine - INFO - Epoch(train) [206][100/293] lr: 5.000000e-06 eta: 0:10:25 time: 0.534035 data_time: 0.104447 memory: 20140 loss_kpt: 0.000454 acc_pose: 0.888856 loss: 0.000454 2022/09/26 20:19:39 - mmengine - INFO - Epoch(train) [206][150/293] lr: 5.000000e-06 eta: 0:10:02 time: 0.547440 data_time: 0.108749 memory: 20140 loss_kpt: 0.000458 acc_pose: 0.848207 loss: 0.000458 2022/09/26 20:20:05 - mmengine - INFO - Epoch(train) [206][200/293] lr: 5.000000e-06 eta: 0:09:39 time: 0.515149 data_time: 0.101777 memory: 20140 loss_kpt: 0.000462 acc_pose: 0.897166 loss: 0.000462 2022/09/26 20:20:32 - mmengine - INFO - Epoch(train) [206][250/293] lr: 5.000000e-06 eta: 0:09:16 time: 0.532970 data_time: 0.107089 memory: 20140 loss_kpt: 0.000463 acc_pose: 0.926837 loss: 0.000463 2022/09/26 20:20:53 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:21:21 - mmengine - INFO - Epoch(train) [207][50/293] lr: 5.000000e-06 eta: 0:08:33 time: 0.548852 data_time: 0.115090 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.882889 loss: 0.000453 2022/09/26 20:21:48 - mmengine - INFO - Epoch(train) [207][100/293] lr: 5.000000e-06 eta: 0:08:11 time: 0.537669 data_time: 0.099870 memory: 20140 loss_kpt: 0.000440 acc_pose: 0.916653 loss: 0.000440 2022/09/26 20:22:14 - mmengine - INFO - Epoch(train) [207][150/293] lr: 5.000000e-06 eta: 0:07:48 time: 0.527005 data_time: 0.099267 memory: 20140 loss_kpt: 0.000450 acc_pose: 0.928869 loss: 0.000450 2022/09/26 20:22:40 - mmengine - INFO - Epoch(train) [207][200/293] lr: 5.000000e-06 eta: 0:07:25 time: 0.523955 data_time: 0.105879 memory: 20140 loss_kpt: 0.000455 acc_pose: 0.900947 loss: 0.000455 2022/09/26 20:23:07 - mmengine - INFO - Epoch(train) [207][250/293] lr: 5.000000e-06 eta: 0:07:02 time: 0.524649 data_time: 0.103463 memory: 20140 loss_kpt: 0.000445 acc_pose: 0.912999 loss: 0.000445 2022/09/26 20:23:29 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:23:57 - mmengine - INFO - Epoch(train) [208][50/293] lr: 5.000000e-06 eta: 0:06:19 time: 0.563068 data_time: 0.115772 memory: 20140 loss_kpt: 0.000452 acc_pose: 0.885561 loss: 0.000452 2022/09/26 20:24:24 - mmengine - INFO - Epoch(train) [208][100/293] lr: 5.000000e-06 eta: 0:05:56 time: 0.529610 data_time: 0.102863 memory: 20140 loss_kpt: 0.000457 acc_pose: 0.873873 loss: 0.000457 2022/09/26 20:24:50 - mmengine - INFO - Epoch(train) [208][150/293] lr: 5.000000e-06 eta: 0:05:33 time: 0.525593 data_time: 0.101195 memory: 20140 loss_kpt: 0.000470 acc_pose: 0.922694 loss: 0.000470 2022/09/26 20:25:17 - mmengine - INFO - Epoch(train) [208][200/293] lr: 5.000000e-06 eta: 0:05:11 time: 0.529470 data_time: 0.101074 memory: 20140 loss_kpt: 0.000459 acc_pose: 0.883540 loss: 0.000459 2022/09/26 20:25:43 - mmengine - INFO - Epoch(train) [208][250/293] lr: 5.000000e-06 eta: 0:04:48 time: 0.522094 data_time: 0.090455 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.869480 loss: 0.000464 2022/09/26 20:26:05 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:26:32 - mmengine - INFO - Epoch(train) [209][50/293] lr: 5.000000e-06 eta: 0:04:05 time: 0.548592 data_time: 0.112919 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.890378 loss: 0.000465 2022/09/26 20:26:36 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:27:00 - mmengine - INFO - Epoch(train) [209][100/293] lr: 5.000000e-06 eta: 0:03:42 time: 0.550314 data_time: 0.096405 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.887774 loss: 0.000453 2022/09/26 20:27:27 - mmengine - INFO - Epoch(train) [209][150/293] lr: 5.000000e-06 eta: 0:03:19 time: 0.550847 data_time: 0.103590 memory: 20140 loss_kpt: 0.000460 acc_pose: 0.885805 loss: 0.000460 2022/09/26 20:27:54 - mmengine - INFO - Epoch(train) [209][200/293] lr: 5.000000e-06 eta: 0:02:56 time: 0.532863 data_time: 0.105775 memory: 20140 loss_kpt: 0.000453 acc_pose: 0.905668 loss: 0.000453 2022/09/26 20:28:20 - mmengine - INFO - Epoch(train) [209][250/293] lr: 5.000000e-06 eta: 0:02:33 time: 0.517768 data_time: 0.110631 memory: 20140 loss_kpt: 0.000467 acc_pose: 0.884782 loss: 0.000467 2022/09/26 20:28:42 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:29:09 - mmengine - INFO - Epoch(train) [210][50/293] lr: 5.000000e-06 eta: 0:01:51 time: 0.540095 data_time: 0.097802 memory: 20140 loss_kpt: 0.000464 acc_pose: 0.898339 loss: 0.000464 2022/09/26 20:29:36 - mmengine - INFO - Epoch(train) [210][100/293] lr: 5.000000e-06 eta: 0:01:28 time: 0.524749 data_time: 0.103692 memory: 20140 loss_kpt: 0.000458 acc_pose: 0.898498 loss: 0.000458 2022/09/26 20:30:03 - mmengine - INFO - Epoch(train) [210][150/293] lr: 5.000000e-06 eta: 0:01:05 time: 0.542670 data_time: 0.107820 memory: 20140 loss_kpt: 0.000450 acc_pose: 0.870594 loss: 0.000450 2022/09/26 20:30:30 - mmengine - INFO - Epoch(train) [210][200/293] lr: 5.000000e-06 eta: 0:00:42 time: 0.538401 data_time: 0.100129 memory: 20140 loss_kpt: 0.000465 acc_pose: 0.871921 loss: 0.000465 2022/09/26 20:30:55 - mmengine - INFO - Epoch(train) [210][250/293] lr: 5.000000e-06 eta: 0:00:19 time: 0.513032 data_time: 0.099332 memory: 20140 loss_kpt: 0.000448 acc_pose: 0.910433 loss: 0.000448 2022/09/26 20:31:18 - mmengine - INFO - Exp name: td-hm_res101_dark-8xb64-210e_coco-384x288_20220926_103845 2022/09/26 20:31:18 - mmengine - INFO - Saving checkpoint at 210 epochs 2022/09/26 20:31:31 - mmengine - INFO - Epoch(val) [210][50/407] eta: 0:01:08 time: 0.192589 data_time: 0.033473 memory: 20140 2022/09/26 20:31:40 - mmengine - INFO - Epoch(val) [210][100/407] eta: 0:00:53 time: 0.175409 data_time: 0.015346 memory: 1830 2022/09/26 20:31:49 - mmengine - INFO - Epoch(val) [210][150/407] eta: 0:00:43 time: 0.169701 data_time: 0.009849 memory: 1830 2022/09/26 20:31:57 - mmengine - INFO - Epoch(val) [210][200/407] eta: 0:00:34 time: 0.167778 data_time: 0.010385 memory: 1830 2022/09/26 20:32:05 - mmengine - INFO - Epoch(val) [210][250/407] eta: 0:00:25 time: 0.164163 data_time: 0.010671 memory: 1830 2022/09/26 20:32:14 - mmengine - INFO - Epoch(val) [210][300/407] eta: 0:00:18 time: 0.170231 data_time: 0.015367 memory: 1830 2022/09/26 20:32:22 - mmengine - INFO - Epoch(val) [210][350/407] eta: 0:00:09 time: 0.164792 data_time: 0.010076 memory: 1830 2022/09/26 20:32:31 - mmengine - INFO - Epoch(val) [210][400/407] eta: 0:00:01 time: 0.169393 data_time: 0.009745 memory: 1830 2022/09/26 20:33:03 - mmengine - INFO - Evaluating CocoMetric... 2022/09/26 20:33:16 - mmengine - INFO - Epoch(val) [210][407/407] coco/AP: 0.748290 coco/AP .5: 0.905294 coco/AP .75: 0.816217 coco/AP (M): 0.706871 coco/AP (L): 0.819865 coco/AR: 0.798693 coco/AR .5: 0.940176 coco/AR .75: 0.860831 coco/AR (M): 0.752745 coco/AR (L): 0.865069