2022/09/23 12:17:49 - mmengine - INFO - ------------------------------------------------------------ System environment: sys.platform: linux Python: 3.8.13 (default, Mar 28 2022, 11:38:47) [GCC 7.5.0] CUDA available: True numpy_random_seed: 298975444 GPU 0,1,2,3,4,5,6,7: NVIDIA A100-SXM4-80GB CUDA_HOME: /mnt/lustre/share/cuda-11.3 NVCC: Cuda compilation tools, release 11.3, V11.3.109 GCC: gcc (GCC) 5.4.0 PyTorch: 1.12.1 PyTorch compiling details: PyTorch built with: - GCC 9.3 - C++ Version: 201402 - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications - Intel(R) MKL-DNN v2.6.0 (Git Hash 52b5f107dd9cf10910aaa19cb47f3abf9b349815) - OpenMP 201511 (a.k.a. OpenMP 4.5) - LAPACK is enabled (usually provided by MKL) - NNPACK is enabled - CPU capability usage: AVX2 - CUDA Runtime 11.3 - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_37,code=compute_37 - CuDNN 8.3.2 (built against CUDA 11.5) - Magma 2.5.2 - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.3.2, CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, CXX_FLAGS= -fabi-version=11 -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.12.1, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=OFF, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, TorchVision: 0.13.1 OpenCV: 4.6.0 MMEngine: 0.1.0 Runtime environment: cudnn_benchmark: False mp_cfg: {'mp_start_method': 'fork', 'opencv_num_threads': 0} dist_cfg: {'backend': 'nccl'} seed: None Distributed launcher: slurm Distributed training: True GPU number: 8 ------------------------------------------------------------ 2022/09/23 12:17:50 - mmengine - INFO - Config: default_scope = 'mmpose' default_hooks = dict( timer=dict(type='IterTimerHook'), logger=dict(type='LoggerHook', interval=50), param_scheduler=dict(type='ParamSchedulerHook'), checkpoint=dict( type='CheckpointHook', interval=10, max_keep_ckpts=1, save_best='coco/AP', rule='greater'), sampler_seed=dict(type='DistSamplerSeedHook'), visualization=dict(type='PoseVisualizationHook', enable=False)) custom_hooks = [dict(type='SyncBuffersHook')] env_cfg = dict( cudnn_benchmark=False, mp_cfg=dict(mp_start_method='fork', opencv_num_threads=0), dist_cfg=dict(backend='nccl')) vis_backends = [dict(type='LocalVisBackend')] visualizer = dict( type='PoseLocalVisualizer', vis_backends=[dict(type='LocalVisBackend')], name='visualizer') log_processor = dict( type='LogProcessor', window_size=50, by_epoch=True, num_digits=6) log_level = 'INFO' load_from = None resume = False file_client_args = dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' })) train_cfg = dict(by_epoch=True, max_epochs=210, val_interval=10) val_cfg = dict() test_cfg = dict() optim_wrapper = dict(optimizer=dict(type='Adam', lr=0.0005)) param_scheduler = [ dict( type='LinearLR', begin=0, end=500, start_factor=0.001, by_epoch=False), dict( type='MultiStepLR', begin=0, end=210, milestones=[170, 200], gamma=0.1, by_epoch=True) ] auto_scale_lr = dict(base_batch_size=512) codec = dict( type='MSRAHeatmap', input_size=(192, 256), heatmap_size=(48, 64), sigma=2, unbiased=True) model = dict( type='TopdownPoseEstimator', data_preprocessor=dict( type='PoseDataPreprocessor', mean=[123.675, 116.28, 103.53], std=[58.395, 57.12, 57.375], bgr_to_rgb=True), backbone=dict( type='ResNet', depth=50, init_cfg=dict(type='Pretrained', checkpoint='torchvision://resnet50')), head=dict( type='HeatmapHead', in_channels=2048, out_channels=17, loss=dict(type='KeypointMSELoss', use_target_weight=True), decoder=dict( type='MSRAHeatmap', input_size=(192, 256), heatmap_size=(48, 64), sigma=2, unbiased=True)), test_cfg=dict(flip_test=True, flip_mode='heatmap', shift_heatmap=True)) dataset_type = 'CocoDataset' data_mode = 'topdown' data_root = 'data/coco/' train_pipeline = [ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='RandomFlip', direction='horizontal'), dict(type='RandomHalfBody'), dict(type='RandomBBoxTransform'), dict(type='TopdownAffine', input_size=(192, 256)), dict( type='GenerateTarget', target_type='heatmap', encoder=dict( type='MSRAHeatmap', input_size=(192, 256), heatmap_size=(48, 64), sigma=2, unbiased=True)), dict(type='PackPoseInputs') ] val_pipeline = [ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(192, 256)), dict(type='PackPoseInputs') ] train_dataloader = dict( batch_size=64, num_workers=2, persistent_workers=True, sampler=dict(type='DefaultSampler', shuffle=True), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_train2017.json', data_prefix=dict(img='train2017/'), pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='RandomFlip', direction='horizontal'), dict(type='RandomHalfBody'), dict(type='RandomBBoxTransform'), dict(type='TopdownAffine', input_size=(192, 256)), dict( type='GenerateTarget', target_type='heatmap', encoder=dict( type='MSRAHeatmap', input_size=(192, 256), heatmap_size=(48, 64), sigma=2, unbiased=True)), dict(type='PackPoseInputs') ])) val_dataloader = dict( batch_size=32, num_workers=2, persistent_workers=True, drop_last=False, sampler=dict(type='DefaultSampler', shuffle=False, round_up=False), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_val2017.json', bbox_file= 'data/coco/person_detection_results/COCO_val2017_detections_AP_H_56_person.json', data_prefix=dict(img='val2017/'), test_mode=True, pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(192, 256)), dict(type='PackPoseInputs') ])) test_dataloader = dict( batch_size=32, num_workers=2, persistent_workers=True, drop_last=False, sampler=dict(type='DefaultSampler', shuffle=False, round_up=False), dataset=dict( type='CocoDataset', data_root='data/coco/', data_mode='topdown', ann_file='annotations/person_keypoints_val2017.json', bbox_file= 'data/coco/person_detection_results/COCO_val2017_detections_AP_H_56_person.json', data_prefix=dict(img='val2017/'), test_mode=True, pipeline=[ dict( type='LoadImage', file_client_args=dict( backend='petrel', path_mapping=dict({ './data/': 's3://openmmlab/datasets/detection/', 'data/': 's3://openmmlab/datasets/detection/' }))), dict(type='GetBBoxCenterScale'), dict(type='TopdownAffine', input_size=(192, 256)), dict(type='PackPoseInputs') ])) val_evaluator = dict( type='CocoMetric', ann_file='data/coco/annotations/person_keypoints_val2017.json') test_evaluator = dict( type='CocoMetric', ann_file='data/coco/annotations/person_keypoints_val2017.json') launcher = 'slurm' work_dir = '/mnt/lustre/liqikai/work_dirs/20220923/res50_dark/' 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "data sampler" registry tree. As a workaround, the current "data sampler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optimizer wrapper constructor" registry tree. As a workaround, the current "optimizer wrapper constructor" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optimizer" registry tree. As a workaround, the current "optimizer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "optim_wrapper" registry tree. As a workaround, the current "optim_wrapper" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:26 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "parameter scheduler" registry tree. As a workaround, the current "parameter scheduler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:29 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "data sampler" registry tree. As a workaround, the current "data sampler" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:31 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:33 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. 2022/09/23 12:18:33 - mmengine - WARNING - Failed to search registry with scope "mmpose" in the "weight initializer" registry tree. As a workaround, the current "weight initializer" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmpose" is a correct scope, or whether the registry is initialized. Name of parameter - Initialization information backbone.conv1.weight - torch.Size([64, 3, 7, 7]): PretrainedInit: load from torchvision://resnet50 backbone.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.conv1.weight - torch.Size([64, 64, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.downsample.0.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.downsample.1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.0.downsample.1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.conv1.weight - torch.Size([64, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.1.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.conv1.weight - torch.Size([64, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn1.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn1.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.conv2.weight - torch.Size([64, 64, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn2.weight - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn2.bias - torch.Size([64]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.conv3.weight - torch.Size([256, 64, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn3.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer1.2.bn3.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.conv1.weight - torch.Size([128, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.downsample.0.weight - torch.Size([512, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.downsample.1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.0.downsample.1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.1.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.2.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.conv1.weight - torch.Size([128, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn1.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn1.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.conv2.weight - torch.Size([128, 128, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn2.weight - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn2.bias - torch.Size([128]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.conv3.weight - torch.Size([512, 128, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn3.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer2.3.bn3.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.conv1.weight - torch.Size([256, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.downsample.0.weight - torch.Size([1024, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.downsample.1.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.0.downsample.1.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.1.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.2.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.3.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.4.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.conv1.weight - torch.Size([256, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn1.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn1.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.conv2.weight - torch.Size([256, 256, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn2.weight - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn2.bias - torch.Size([256]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.conv3.weight - torch.Size([1024, 256, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn3.weight - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer3.5.bn3.bias - torch.Size([1024]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.conv1.weight - torch.Size([512, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.downsample.0.weight - torch.Size([2048, 1024, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.downsample.1.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.0.downsample.1.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.conv1.weight - torch.Size([512, 2048, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.1.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.conv1.weight - torch.Size([512, 2048, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn1.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn1.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.conv2.weight - torch.Size([512, 512, 3, 3]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn2.weight - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn2.bias - torch.Size([512]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.conv3.weight - torch.Size([2048, 512, 1, 1]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn3.weight - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 backbone.layer4.2.bn3.bias - torch.Size([2048]): PretrainedInit: load from torchvision://resnet50 head.deconv_layers.0.weight - torch.Size([2048, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.1.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.1.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.3.weight - torch.Size([256, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.4.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.4.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.6.weight - torch.Size([256, 256, 4, 4]): NormalInit: mean=0, std=0.001, bias=0 head.deconv_layers.7.weight - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.deconv_layers.7.bias - torch.Size([256]): The value is the same before and after calling `init_weights` of TopdownPoseEstimator head.final_layer.weight - torch.Size([17, 256, 1, 1]): NormalInit: mean=0, std=0.001, bias=0 head.final_layer.bias - torch.Size([17]): NormalInit: mean=0, std=0.001, bias=0 2022/09/23 12:18:33 - mmengine - INFO - Checkpoints will be saved to /mnt/lustre/liqikai/work_dirs/20220923/res50_dark by HardDiskBackend. 2022/09/23 12:19:14 - mmengine - INFO - Epoch(train) [1][50/293] lr: 4.954910e-05 eta: 14:07:00 time: 0.826626 data_time: 0.315983 memory: 6691 loss_kpt: 0.002182 acc_pose: 0.175664 loss: 0.002182 2022/09/23 12:19:42 - mmengine - INFO - Epoch(train) [1][100/293] lr: 9.959920e-05 eta: 11:48:11 time: 0.556778 data_time: 0.082591 memory: 6691 loss_kpt: 0.001826 acc_pose: 0.302785 loss: 0.001826 2022/09/23 12:20:11 - mmengine - INFO - Epoch(train) [1][150/293] lr: 1.496493e-04 eta: 11:10:09 time: 0.581878 data_time: 0.093759 memory: 6691 loss_kpt: 0.001578 acc_pose: 0.392764 loss: 0.001578 2022/09/23 12:20:39 - mmengine - INFO - Epoch(train) [1][200/293] lr: 1.996994e-04 eta: 10:43:47 time: 0.554051 data_time: 0.095073 memory: 6691 loss_kpt: 0.001427 acc_pose: 0.534312 loss: 0.001427 2022/09/23 12:21:08 - mmengine - INFO - Epoch(train) [1][250/293] lr: 2.497495e-04 eta: 10:32:05 time: 0.575081 data_time: 0.111571 memory: 6691 loss_kpt: 0.001348 acc_pose: 0.547956 loss: 0.001348 2022/09/23 12:21:32 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:22:01 - mmengine - INFO - Epoch(train) [2][50/293] lr: 3.428427e-04 eta: 9:06:15 time: 0.580262 data_time: 0.139156 memory: 6691 loss_kpt: 0.001240 acc_pose: 0.527006 loss: 0.001240 2022/09/23 12:22:31 - mmengine - INFO - Epoch(train) [2][100/293] lr: 3.928928e-04 eta: 9:12:11 time: 0.584826 data_time: 0.162526 memory: 6691 loss_kpt: 0.001226 acc_pose: 0.636909 loss: 0.001226 2022/09/23 12:22:59 - mmengine - INFO - Epoch(train) [2][150/293] lr: 4.429429e-04 eta: 9:15:29 time: 0.574536 data_time: 0.210387 memory: 6691 loss_kpt: 0.001191 acc_pose: 0.586379 loss: 0.001191 2022/09/23 12:23:29 - mmengine - INFO - Epoch(train) [2][200/293] lr: 4.929930e-04 eta: 9:19:17 time: 0.586952 data_time: 0.127667 memory: 6691 loss_kpt: 0.001186 acc_pose: 0.545458 loss: 0.001186 2022/09/23 12:23:58 - mmengine - INFO - Epoch(train) [2][250/293] lr: 5.000000e-04 eta: 9:22:14 time: 0.586111 data_time: 0.099166 memory: 6691 loss_kpt: 0.001177 acc_pose: 0.582432 loss: 0.001177 2022/09/23 12:24:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:24:52 - mmengine - INFO - Epoch(train) [3][50/293] lr: 5.000000e-04 eta: 8:47:15 time: 0.601266 data_time: 0.120203 memory: 6691 loss_kpt: 0.001117 acc_pose: 0.636034 loss: 0.001117 2022/09/23 12:25:20 - mmengine - INFO - Epoch(train) [3][100/293] lr: 5.000000e-04 eta: 8:49:42 time: 0.558346 data_time: 0.076968 memory: 6691 loss_kpt: 0.001105 acc_pose: 0.605690 loss: 0.001105 2022/09/23 12:25:48 - mmengine - INFO - Epoch(train) [3][150/293] lr: 5.000000e-04 eta: 8:52:01 time: 0.562466 data_time: 0.085991 memory: 6691 loss_kpt: 0.001091 acc_pose: 0.620288 loss: 0.001091 2022/09/23 12:26:17 - mmengine - INFO - Epoch(train) [3][200/293] lr: 5.000000e-04 eta: 8:54:19 time: 0.567403 data_time: 0.184238 memory: 6691 loss_kpt: 0.001070 acc_pose: 0.560056 loss: 0.001070 2022/09/23 12:26:46 - mmengine - INFO - Epoch(train) [3][250/293] lr: 5.000000e-04 eta: 8:57:40 time: 0.590658 data_time: 0.079798 memory: 6691 loss_kpt: 0.001084 acc_pose: 0.592835 loss: 0.001084 2022/09/23 12:27:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:27:41 - mmengine - INFO - Epoch(train) [4][50/293] lr: 5.000000e-04 eta: 8:35:20 time: 0.592881 data_time: 0.132845 memory: 6691 loss_kpt: 0.001037 acc_pose: 0.637247 loss: 0.001037 2022/09/23 12:28:10 - mmengine - INFO - Epoch(train) [4][100/293] lr: 5.000000e-04 eta: 8:38:27 time: 0.579078 data_time: 0.084866 memory: 6691 loss_kpt: 0.001042 acc_pose: 0.673530 loss: 0.001042 2022/09/23 12:28:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:28:38 - mmengine - INFO - Epoch(train) [4][150/293] lr: 5.000000e-04 eta: 8:40:29 time: 0.563716 data_time: 0.095573 memory: 6691 loss_kpt: 0.001026 acc_pose: 0.638886 loss: 0.001026 2022/09/23 12:29:07 - mmengine - INFO - Epoch(train) [4][200/293] lr: 5.000000e-04 eta: 8:42:44 time: 0.573709 data_time: 0.257184 memory: 6691 loss_kpt: 0.001026 acc_pose: 0.613768 loss: 0.001026 2022/09/23 12:29:36 - mmengine - INFO - Epoch(train) [4][250/293] lr: 5.000000e-04 eta: 8:45:08 time: 0.582516 data_time: 0.187617 memory: 6691 loss_kpt: 0.001022 acc_pose: 0.658055 loss: 0.001022 2022/09/23 12:30:00 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:30:30 - mmengine - INFO - Epoch(train) [5][50/293] lr: 5.000000e-04 eta: 8:29:03 time: 0.598776 data_time: 0.163719 memory: 6691 loss_kpt: 0.001032 acc_pose: 0.690025 loss: 0.001032 2022/09/23 12:30:59 - mmengine - INFO - Epoch(train) [5][100/293] lr: 5.000000e-04 eta: 8:31:05 time: 0.568410 data_time: 0.089443 memory: 6691 loss_kpt: 0.001014 acc_pose: 0.676654 loss: 0.001014 2022/09/23 12:31:27 - mmengine - INFO - Epoch(train) [5][150/293] lr: 5.000000e-04 eta: 8:32:50 time: 0.566393 data_time: 0.098849 memory: 6691 loss_kpt: 0.000980 acc_pose: 0.707873 loss: 0.000980 2022/09/23 12:31:55 - mmengine - INFO - Epoch(train) [5][200/293] lr: 5.000000e-04 eta: 8:34:35 time: 0.570507 data_time: 0.084325 memory: 6691 loss_kpt: 0.000984 acc_pose: 0.690294 loss: 0.000984 2022/09/23 12:32:24 - mmengine - INFO - Epoch(train) [5][250/293] lr: 5.000000e-04 eta: 8:36:02 time: 0.566747 data_time: 0.092598 memory: 6691 loss_kpt: 0.000997 acc_pose: 0.638625 loss: 0.000997 2022/09/23 12:32:47 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:33:16 - mmengine - INFO - Epoch(train) [6][50/293] lr: 5.000000e-04 eta: 8:22:53 time: 0.583931 data_time: 0.291940 memory: 6691 loss_kpt: 0.000978 acc_pose: 0.661206 loss: 0.000978 2022/09/23 12:33:43 - mmengine - INFO - Epoch(train) [6][100/293] lr: 5.000000e-04 eta: 8:23:49 time: 0.545082 data_time: 0.251025 memory: 6691 loss_kpt: 0.000981 acc_pose: 0.707484 loss: 0.000981 2022/09/23 12:34:12 - mmengine - INFO - Epoch(train) [6][150/293] lr: 5.000000e-04 eta: 8:25:34 time: 0.574214 data_time: 0.110887 memory: 6691 loss_kpt: 0.000973 acc_pose: 0.723981 loss: 0.000973 2022/09/23 12:34:41 - mmengine - INFO - Epoch(train) [6][200/293] lr: 5.000000e-04 eta: 8:27:04 time: 0.570673 data_time: 0.074985 memory: 6691 loss_kpt: 0.000971 acc_pose: 0.635818 loss: 0.000971 2022/09/23 12:35:10 - mmengine - INFO - Epoch(train) [6][250/293] lr: 5.000000e-04 eta: 8:28:42 time: 0.578945 data_time: 0.112319 memory: 6691 loss_kpt: 0.000970 acc_pose: 0.648020 loss: 0.000970 2022/09/23 12:35:35 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:36:05 - mmengine - INFO - Epoch(train) [7][50/293] lr: 5.000000e-04 eta: 8:18:12 time: 0.596025 data_time: 0.120688 memory: 6691 loss_kpt: 0.000942 acc_pose: 0.734937 loss: 0.000942 2022/09/23 12:36:34 - mmengine - INFO - Epoch(train) [7][100/293] lr: 5.000000e-04 eta: 8:19:55 time: 0.580592 data_time: 0.075762 memory: 6691 loss_kpt: 0.000954 acc_pose: 0.678438 loss: 0.000954 2022/09/23 12:37:01 - mmengine - INFO - Epoch(train) [7][150/293] lr: 5.000000e-04 eta: 8:20:43 time: 0.549125 data_time: 0.072348 memory: 6691 loss_kpt: 0.000935 acc_pose: 0.735074 loss: 0.000935 2022/09/23 12:37:29 - mmengine - INFO - Epoch(train) [7][200/293] lr: 5.000000e-04 eta: 8:21:40 time: 0.558254 data_time: 0.079117 memory: 6691 loss_kpt: 0.000944 acc_pose: 0.638690 loss: 0.000944 2022/09/23 12:37:53 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:37:58 - mmengine - INFO - Epoch(train) [7][250/293] lr: 5.000000e-04 eta: 8:22:51 time: 0.570091 data_time: 0.084592 memory: 6691 loss_kpt: 0.000938 acc_pose: 0.700527 loss: 0.000938 2022/09/23 12:38:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:38:50 - mmengine - INFO - Epoch(train) [8][50/293] lr: 5.000000e-04 eta: 8:13:23 time: 0.574261 data_time: 0.093313 memory: 6691 loss_kpt: 0.000922 acc_pose: 0.673477 loss: 0.000922 2022/09/23 12:39:18 - mmengine - INFO - Epoch(train) [8][100/293] lr: 5.000000e-04 eta: 8:14:22 time: 0.559529 data_time: 0.072813 memory: 6691 loss_kpt: 0.000934 acc_pose: 0.724605 loss: 0.000934 2022/09/23 12:39:47 - mmengine - INFO - Epoch(train) [8][150/293] lr: 5.000000e-04 eta: 8:15:46 time: 0.579873 data_time: 0.098298 memory: 6691 loss_kpt: 0.000923 acc_pose: 0.658895 loss: 0.000923 2022/09/23 12:40:15 - mmengine - INFO - Epoch(train) [8][200/293] lr: 5.000000e-04 eta: 8:16:35 time: 0.558119 data_time: 0.092393 memory: 6691 loss_kpt: 0.000934 acc_pose: 0.730626 loss: 0.000934 2022/09/23 12:40:43 - mmengine - INFO - Epoch(train) [8][250/293] lr: 5.000000e-04 eta: 8:17:29 time: 0.564235 data_time: 0.117267 memory: 6691 loss_kpt: 0.000906 acc_pose: 0.681055 loss: 0.000906 2022/09/23 12:41:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:41:38 - mmengine - INFO - Epoch(train) [9][50/293] lr: 5.000000e-04 eta: 8:09:47 time: 0.601072 data_time: 0.170354 memory: 6691 loss_kpt: 0.000897 acc_pose: 0.698232 loss: 0.000897 2022/09/23 12:42:07 - mmengine - INFO - Epoch(train) [9][100/293] lr: 5.000000e-04 eta: 8:11:03 time: 0.580441 data_time: 0.106554 memory: 6691 loss_kpt: 0.000908 acc_pose: 0.729601 loss: 0.000908 2022/09/23 12:42:36 - mmengine - INFO - Epoch(train) [9][150/293] lr: 5.000000e-04 eta: 8:12:04 time: 0.570831 data_time: 0.210372 memory: 6691 loss_kpt: 0.000909 acc_pose: 0.690152 loss: 0.000909 2022/09/23 12:43:04 - mmengine - INFO - Epoch(train) [9][200/293] lr: 5.000000e-04 eta: 8:13:05 time: 0.574470 data_time: 0.102356 memory: 6691 loss_kpt: 0.000908 acc_pose: 0.707813 loss: 0.000908 2022/09/23 12:43:34 - mmengine - INFO - Epoch(train) [9][250/293] lr: 5.000000e-04 eta: 8:14:18 time: 0.587540 data_time: 0.112964 memory: 6691 loss_kpt: 0.000889 acc_pose: 0.731314 loss: 0.000889 2022/09/23 12:43:59 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:44:29 - mmengine - INFO - Epoch(train) [10][50/293] lr: 5.000000e-04 eta: 8:07:33 time: 0.609197 data_time: 0.137033 memory: 6691 loss_kpt: 0.000897 acc_pose: 0.701735 loss: 0.000897 2022/09/23 12:44:57 - mmengine - INFO - Epoch(train) [10][100/293] lr: 5.000000e-04 eta: 8:08:18 time: 0.562360 data_time: 0.087772 memory: 6691 loss_kpt: 0.000898 acc_pose: 0.747553 loss: 0.000898 2022/09/23 12:45:25 - mmengine - INFO - Epoch(train) [10][150/293] lr: 5.000000e-04 eta: 8:08:59 time: 0.561163 data_time: 0.103110 memory: 6691 loss_kpt: 0.000893 acc_pose: 0.674082 loss: 0.000893 2022/09/23 12:45:54 - mmengine - INFO - Epoch(train) [10][200/293] lr: 5.000000e-04 eta: 8:09:55 time: 0.577255 data_time: 0.123080 memory: 6691 loss_kpt: 0.000903 acc_pose: 0.728805 loss: 0.000903 2022/09/23 12:46:23 - mmengine - INFO - Epoch(train) [10][250/293] lr: 5.000000e-04 eta: 8:10:42 time: 0.572222 data_time: 0.104970 memory: 6691 loss_kpt: 0.000894 acc_pose: 0.759170 loss: 0.000894 2022/09/23 12:46:48 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:46:48 - mmengine - INFO - Saving checkpoint at 10 epochs 2022/09/23 12:47:15 - mmengine - INFO - Epoch(val) [10][50/407] eta: 0:02:52 time: 0.484526 data_time: 0.238916 memory: 6691 2022/09/23 12:47:32 - mmengine - INFO - Epoch(val) [10][100/407] eta: 0:01:43 time: 0.336416 data_time: 0.071221 memory: 1014 2022/09/23 12:47:49 - mmengine - INFO - Epoch(val) [10][150/407] eta: 0:01:25 time: 0.332730 data_time: 0.073702 memory: 1014 2022/09/23 12:48:05 - mmengine - INFO - Epoch(val) [10][200/407] eta: 0:01:08 time: 0.331628 data_time: 0.067573 memory: 1014 2022/09/23 12:48:21 - mmengine - INFO - Epoch(val) [10][250/407] eta: 0:00:50 time: 0.320898 data_time: 0.072590 memory: 1014 2022/09/23 12:48:37 - mmengine - INFO - Epoch(val) [10][300/407] eta: 0:00:32 time: 0.307010 data_time: 0.058582 memory: 1014 2022/09/23 12:48:53 - mmengine - INFO - Epoch(val) [10][350/407] eta: 0:00:18 time: 0.326428 data_time: 0.062100 memory: 1014 2022/09/23 12:49:08 - mmengine - INFO - Epoch(val) [10][400/407] eta: 0:00:02 time: 0.293355 data_time: 0.050365 memory: 1014 2022/09/23 12:49:41 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 12:49:55 - mmengine - INFO - Epoch(val) [10][407/407] coco/AP: 0.604054 coco/AP .5: 0.850435 coco/AP .75: 0.673174 coco/AP (M): 0.566682 coco/AP (L): 0.671033 coco/AR: 0.669254 coco/AR .5: 0.898142 coco/AR .75: 0.735674 coco/AR (M): 0.623190 coco/AR (L): 0.733333 2022/09/23 12:49:58 - mmengine - INFO - The best checkpoint with 0.6041 coco/AP at 10 epoch is saved to best_coco/AP_epoch_10.pth. 2022/09/23 12:50:26 - mmengine - INFO - Epoch(train) [11][50/293] lr: 5.000000e-04 eta: 8:03:50 time: 0.561405 data_time: 0.249167 memory: 6691 loss_kpt: 0.000881 acc_pose: 0.765170 loss: 0.000881 2022/09/23 12:50:37 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:50:54 - mmengine - INFO - Epoch(train) [11][100/293] lr: 5.000000e-04 eta: 8:04:31 time: 0.563958 data_time: 0.076254 memory: 6691 loss_kpt: 0.000867 acc_pose: 0.757113 loss: 0.000867 2022/09/23 12:51:24 - mmengine - INFO - Epoch(train) [11][150/293] lr: 5.000000e-04 eta: 8:05:38 time: 0.593629 data_time: 0.092784 memory: 6691 loss_kpt: 0.000882 acc_pose: 0.748756 loss: 0.000882 2022/09/23 12:51:52 - mmengine - INFO - Epoch(train) [11][200/293] lr: 5.000000e-04 eta: 8:06:19 time: 0.569369 data_time: 0.080445 memory: 6691 loss_kpt: 0.000885 acc_pose: 0.734052 loss: 0.000885 2022/09/23 12:52:21 - mmengine - INFO - Epoch(train) [11][250/293] lr: 5.000000e-04 eta: 8:07:08 time: 0.580880 data_time: 0.089264 memory: 6691 loss_kpt: 0.000870 acc_pose: 0.680119 loss: 0.000870 2022/09/23 12:52:45 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:53:15 - mmengine - INFO - Epoch(train) [12][50/293] lr: 5.000000e-04 eta: 8:01:26 time: 0.599539 data_time: 0.087705 memory: 6691 loss_kpt: 0.000887 acc_pose: 0.682134 loss: 0.000887 2022/09/23 12:53:44 - mmengine - INFO - Epoch(train) [12][100/293] lr: 5.000000e-04 eta: 8:02:22 time: 0.588279 data_time: 0.154900 memory: 6691 loss_kpt: 0.000866 acc_pose: 0.604852 loss: 0.000866 2022/09/23 12:54:12 - mmengine - INFO - Epoch(train) [12][150/293] lr: 5.000000e-04 eta: 8:02:54 time: 0.562541 data_time: 0.106734 memory: 6691 loss_kpt: 0.000863 acc_pose: 0.751874 loss: 0.000863 2022/09/23 12:54:41 - mmengine - INFO - Epoch(train) [12][200/293] lr: 5.000000e-04 eta: 8:03:29 time: 0.569198 data_time: 0.083848 memory: 6691 loss_kpt: 0.000872 acc_pose: 0.748319 loss: 0.000872 2022/09/23 12:55:09 - mmengine - INFO - Epoch(train) [12][250/293] lr: 5.000000e-04 eta: 8:04:00 time: 0.566516 data_time: 0.083742 memory: 6691 loss_kpt: 0.000881 acc_pose: 0.681768 loss: 0.000881 2022/09/23 12:55:33 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:56:02 - mmengine - INFO - Epoch(train) [13][50/293] lr: 5.000000e-04 eta: 7:58:33 time: 0.584508 data_time: 0.247196 memory: 6691 loss_kpt: 0.000883 acc_pose: 0.774040 loss: 0.000883 2022/09/23 12:56:31 - mmengine - INFO - Epoch(train) [13][100/293] lr: 5.000000e-04 eta: 7:59:07 time: 0.569341 data_time: 0.169800 memory: 6691 loss_kpt: 0.000864 acc_pose: 0.766944 loss: 0.000864 2022/09/23 12:57:00 - mmengine - INFO - Epoch(train) [13][150/293] lr: 5.000000e-04 eta: 7:59:58 time: 0.592518 data_time: 0.092681 memory: 6691 loss_kpt: 0.000853 acc_pose: 0.725890 loss: 0.000853 2022/09/23 12:57:28 - mmengine - INFO - Epoch(train) [13][200/293] lr: 5.000000e-04 eta: 8:00:14 time: 0.549724 data_time: 0.076338 memory: 6691 loss_kpt: 0.000854 acc_pose: 0.708272 loss: 0.000854 2022/09/23 12:57:56 - mmengine - INFO - Epoch(train) [13][250/293] lr: 5.000000e-04 eta: 8:00:40 time: 0.564533 data_time: 0.081522 memory: 6691 loss_kpt: 0.000851 acc_pose: 0.653572 loss: 0.000851 2022/09/23 12:58:20 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 12:58:50 - mmengine - INFO - Epoch(train) [14][50/293] lr: 5.000000e-04 eta: 7:55:41 time: 0.591536 data_time: 0.135663 memory: 6691 loss_kpt: 0.000867 acc_pose: 0.735373 loss: 0.000867 2022/09/23 12:59:17 - mmengine - INFO - Epoch(train) [14][100/293] lr: 5.000000e-04 eta: 7:55:53 time: 0.543822 data_time: 0.080879 memory: 6691 loss_kpt: 0.000839 acc_pose: 0.752089 loss: 0.000839 2022/09/23 12:59:45 - mmengine - INFO - Epoch(train) [14][150/293] lr: 5.000000e-04 eta: 7:56:16 time: 0.561933 data_time: 0.091081 memory: 6691 loss_kpt: 0.000851 acc_pose: 0.671433 loss: 0.000851 2022/09/23 13:00:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:00:14 - mmengine - INFO - Epoch(train) [14][200/293] lr: 5.000000e-04 eta: 7:56:50 time: 0.577927 data_time: 0.098363 memory: 6691 loss_kpt: 0.000858 acc_pose: 0.737552 loss: 0.000858 2022/09/23 13:00:43 - mmengine - INFO - Epoch(train) [14][250/293] lr: 5.000000e-04 eta: 7:57:20 time: 0.575137 data_time: 0.087492 memory: 6691 loss_kpt: 0.000865 acc_pose: 0.776185 loss: 0.000865 2022/09/23 13:01:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:01:36 - mmengine - INFO - Epoch(train) [15][50/293] lr: 5.000000e-04 eta: 7:52:40 time: 0.588746 data_time: 0.096806 memory: 6691 loss_kpt: 0.000836 acc_pose: 0.739295 loss: 0.000836 2022/09/23 13:02:04 - mmengine - INFO - Epoch(train) [15][100/293] lr: 5.000000e-04 eta: 7:52:57 time: 0.555076 data_time: 0.096960 memory: 6691 loss_kpt: 0.000837 acc_pose: 0.714897 loss: 0.000837 2022/09/23 13:02:34 - mmengine - INFO - Epoch(train) [15][150/293] lr: 5.000000e-04 eta: 7:53:36 time: 0.590534 data_time: 0.101658 memory: 6691 loss_kpt: 0.000847 acc_pose: 0.710233 loss: 0.000847 2022/09/23 13:03:03 - mmengine - INFO - Epoch(train) [15][200/293] lr: 5.000000e-04 eta: 7:54:17 time: 0.594998 data_time: 0.100961 memory: 6691 loss_kpt: 0.000844 acc_pose: 0.731739 loss: 0.000844 2022/09/23 13:03:31 - mmengine - INFO - Epoch(train) [15][250/293] lr: 5.000000e-04 eta: 7:54:34 time: 0.560501 data_time: 0.090010 memory: 6691 loss_kpt: 0.000840 acc_pose: 0.708369 loss: 0.000840 2022/09/23 13:03:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:04:25 - mmengine - INFO - Epoch(train) [16][50/293] lr: 5.000000e-04 eta: 7:50:12 time: 0.590787 data_time: 0.104590 memory: 6691 loss_kpt: 0.000835 acc_pose: 0.720714 loss: 0.000835 2022/09/23 13:04:54 - mmengine - INFO - Epoch(train) [16][100/293] lr: 5.000000e-04 eta: 7:50:43 time: 0.581305 data_time: 0.089506 memory: 6691 loss_kpt: 0.000847 acc_pose: 0.728022 loss: 0.000847 2022/09/23 13:05:23 - mmengine - INFO - Epoch(train) [16][150/293] lr: 5.000000e-04 eta: 7:51:03 time: 0.567583 data_time: 0.083487 memory: 6691 loss_kpt: 0.000829 acc_pose: 0.732259 loss: 0.000829 2022/09/23 13:05:51 - mmengine - INFO - Epoch(train) [16][200/293] lr: 5.000000e-04 eta: 7:51:22 time: 0.565778 data_time: 0.088607 memory: 6691 loss_kpt: 0.000840 acc_pose: 0.683046 loss: 0.000840 2022/09/23 13:06:19 - mmengine - INFO - Epoch(train) [16][250/293] lr: 5.000000e-04 eta: 7:51:32 time: 0.553877 data_time: 0.106815 memory: 6691 loss_kpt: 0.000833 acc_pose: 0.726824 loss: 0.000833 2022/09/23 13:06:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:07:10 - mmengine - INFO - Epoch(train) [17][50/293] lr: 5.000000e-04 eta: 7:47:13 time: 0.569960 data_time: 0.209975 memory: 6691 loss_kpt: 0.000842 acc_pose: 0.792312 loss: 0.000842 2022/09/23 13:07:38 - mmengine - INFO - Epoch(train) [17][100/293] lr: 5.000000e-04 eta: 7:47:19 time: 0.546215 data_time: 0.254896 memory: 6691 loss_kpt: 0.000839 acc_pose: 0.762102 loss: 0.000839 2022/09/23 13:08:05 - mmengine - INFO - Epoch(train) [17][150/293] lr: 5.000000e-04 eta: 7:47:21 time: 0.538995 data_time: 0.259023 memory: 6691 loss_kpt: 0.000821 acc_pose: 0.754782 loss: 0.000821 2022/09/23 13:08:32 - mmengine - INFO - Epoch(train) [17][200/293] lr: 5.000000e-04 eta: 7:47:26 time: 0.545535 data_time: 0.264041 memory: 6691 loss_kpt: 0.000830 acc_pose: 0.755462 loss: 0.000830 2022/09/23 13:09:01 - mmengine - INFO - Epoch(train) [17][250/293] lr: 5.000000e-04 eta: 7:47:45 time: 0.572130 data_time: 0.201331 memory: 6691 loss_kpt: 0.000834 acc_pose: 0.738751 loss: 0.000834 2022/09/23 13:09:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:09:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:09:54 - mmengine - INFO - Epoch(train) [18][50/293] lr: 5.000000e-04 eta: 7:43:47 time: 0.580533 data_time: 0.109316 memory: 6691 loss_kpt: 0.000824 acc_pose: 0.759047 loss: 0.000824 2022/09/23 13:10:23 - mmengine - INFO - Epoch(train) [18][100/293] lr: 5.000000e-04 eta: 7:44:10 time: 0.577559 data_time: 0.077730 memory: 6691 loss_kpt: 0.000837 acc_pose: 0.721541 loss: 0.000837 2022/09/23 13:10:51 - mmengine - INFO - Epoch(train) [18][150/293] lr: 5.000000e-04 eta: 7:44:19 time: 0.555144 data_time: 0.193317 memory: 6691 loss_kpt: 0.000830 acc_pose: 0.728578 loss: 0.000830 2022/09/23 13:11:20 - mmengine - INFO - Epoch(train) [18][200/293] lr: 5.000000e-04 eta: 7:44:44 time: 0.586609 data_time: 0.095763 memory: 6691 loss_kpt: 0.000808 acc_pose: 0.672071 loss: 0.000808 2022/09/23 13:11:49 - mmengine - INFO - Epoch(train) [18][250/293] lr: 5.000000e-04 eta: 7:45:04 time: 0.576243 data_time: 0.087385 memory: 6691 loss_kpt: 0.000813 acc_pose: 0.757932 loss: 0.000813 2022/09/23 13:12:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:12:42 - mmengine - INFO - Epoch(train) [19][50/293] lr: 5.000000e-04 eta: 7:41:25 time: 0.595896 data_time: 0.112404 memory: 6691 loss_kpt: 0.000824 acc_pose: 0.746016 loss: 0.000824 2022/09/23 13:13:11 - mmengine - INFO - Epoch(train) [19][100/293] lr: 5.000000e-04 eta: 7:41:44 time: 0.575675 data_time: 0.091255 memory: 6691 loss_kpt: 0.000818 acc_pose: 0.758553 loss: 0.000818 2022/09/23 13:13:40 - mmengine - INFO - Epoch(train) [19][150/293] lr: 5.000000e-04 eta: 7:42:08 time: 0.587508 data_time: 0.092916 memory: 6691 loss_kpt: 0.000833 acc_pose: 0.768467 loss: 0.000833 2022/09/23 13:14:08 - mmengine - INFO - Epoch(train) [19][200/293] lr: 5.000000e-04 eta: 7:42:18 time: 0.562466 data_time: 0.186625 memory: 6691 loss_kpt: 0.000801 acc_pose: 0.803697 loss: 0.000801 2022/09/23 13:14:38 - mmengine - INFO - Epoch(train) [19][250/293] lr: 5.000000e-04 eta: 7:42:42 time: 0.589203 data_time: 0.091873 memory: 6691 loss_kpt: 0.000813 acc_pose: 0.789312 loss: 0.000813 2022/09/23 13:15:02 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:15:32 - mmengine - INFO - Epoch(train) [20][50/293] lr: 5.000000e-04 eta: 7:39:14 time: 0.596941 data_time: 0.248237 memory: 6691 loss_kpt: 0.000834 acc_pose: 0.794978 loss: 0.000834 2022/09/23 13:16:00 - mmengine - INFO - Epoch(train) [20][100/293] lr: 5.000000e-04 eta: 7:39:28 time: 0.571610 data_time: 0.159780 memory: 6691 loss_kpt: 0.000812 acc_pose: 0.752597 loss: 0.000812 2022/09/23 13:16:30 - mmengine - INFO - Epoch(train) [20][150/293] lr: 5.000000e-04 eta: 7:39:49 time: 0.587443 data_time: 0.095836 memory: 6691 loss_kpt: 0.000829 acc_pose: 0.738764 loss: 0.000829 2022/09/23 13:16:59 - mmengine - INFO - Epoch(train) [20][200/293] lr: 5.000000e-04 eta: 7:40:09 time: 0.586961 data_time: 0.134337 memory: 6691 loss_kpt: 0.000808 acc_pose: 0.819961 loss: 0.000808 2022/09/23 13:17:28 - mmengine - INFO - Epoch(train) [20][250/293] lr: 5.000000e-04 eta: 7:40:24 time: 0.577408 data_time: 0.092831 memory: 6691 loss_kpt: 0.000818 acc_pose: 0.717886 loss: 0.000818 2022/09/23 13:17:52 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:17:52 - mmengine - INFO - Saving checkpoint at 20 epochs 2022/09/23 13:18:15 - mmengine - INFO - Epoch(val) [20][50/407] eta: 0:02:03 time: 0.345837 data_time: 0.088757 memory: 6691 2022/09/23 13:18:31 - mmengine - INFO - Epoch(val) [20][100/407] eta: 0:01:38 time: 0.321149 data_time: 0.069436 memory: 1014 2022/09/23 13:18:48 - mmengine - INFO - Epoch(val) [20][150/407] eta: 0:01:24 time: 0.329300 data_time: 0.077813 memory: 1014 2022/09/23 13:19:04 - mmengine - INFO - Epoch(val) [20][200/407] eta: 0:01:08 time: 0.331166 data_time: 0.064519 memory: 1014 2022/09/23 13:19:20 - mmengine - INFO - Epoch(val) [20][250/407] eta: 0:00:49 time: 0.315648 data_time: 0.068499 memory: 1014 2022/09/23 13:19:37 - mmengine - INFO - Epoch(val) [20][300/407] eta: 0:00:36 time: 0.345545 data_time: 0.081502 memory: 1014 2022/09/23 13:19:54 - mmengine - INFO - Epoch(val) [20][350/407] eta: 0:00:18 time: 0.332455 data_time: 0.077551 memory: 1014 2022/09/23 13:20:05 - mmengine - INFO - Epoch(val) [20][400/407] eta: 0:00:01 time: 0.225439 data_time: 0.042405 memory: 1014 2022/09/23 13:20:38 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 13:20:51 - mmengine - INFO - Epoch(val) [20][407/407] coco/AP: 0.642773 coco/AP .5: 0.869719 coco/AP .75: 0.716614 coco/AP (M): 0.605141 coco/AP (L): 0.708813 coco/AR: 0.703463 coco/AR .5: 0.912469 coco/AR .75: 0.771253 coco/AR (M): 0.659219 coco/AR (L): 0.766035 2022/09/23 13:20:51 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_10.pth is removed 2022/09/23 13:20:54 - mmengine - INFO - The best checkpoint with 0.6428 coco/AP at 20 epoch is saved to best_coco/AP_epoch_20.pth. 2022/09/23 13:21:21 - mmengine - INFO - Epoch(train) [21][50/293] lr: 5.000000e-04 eta: 7:36:42 time: 0.548055 data_time: 0.266847 memory: 6691 loss_kpt: 0.000804 acc_pose: 0.775478 loss: 0.000804 2022/09/23 13:21:49 - mmengine - INFO - Epoch(train) [21][100/293] lr: 5.000000e-04 eta: 7:36:42 time: 0.546535 data_time: 0.251204 memory: 6691 loss_kpt: 0.000801 acc_pose: 0.731976 loss: 0.000801 2022/09/23 13:22:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:22:17 - mmengine - INFO - Epoch(train) [21][150/293] lr: 5.000000e-04 eta: 7:36:52 time: 0.568030 data_time: 0.268261 memory: 6691 loss_kpt: 0.000819 acc_pose: 0.691697 loss: 0.000819 2022/09/23 13:22:45 - mmengine - INFO - Epoch(train) [21][200/293] lr: 5.000000e-04 eta: 7:36:55 time: 0.554663 data_time: 0.157394 memory: 6691 loss_kpt: 0.000810 acc_pose: 0.803517 loss: 0.000810 2022/09/23 13:23:14 - mmengine - INFO - Epoch(train) [21][250/293] lr: 5.000000e-04 eta: 7:37:08 time: 0.577650 data_time: 0.234941 memory: 6691 loss_kpt: 0.000809 acc_pose: 0.771139 loss: 0.000809 2022/09/23 13:23:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:24:07 - mmengine - INFO - Epoch(train) [22][50/293] lr: 5.000000e-04 eta: 7:33:52 time: 0.583869 data_time: 0.116923 memory: 6691 loss_kpt: 0.000828 acc_pose: 0.717957 loss: 0.000828 2022/09/23 13:24:35 - mmengine - INFO - Epoch(train) [22][100/293] lr: 5.000000e-04 eta: 7:34:00 time: 0.565984 data_time: 0.088101 memory: 6691 loss_kpt: 0.000785 acc_pose: 0.774955 loss: 0.000785 2022/09/23 13:25:04 - mmengine - INFO - Epoch(train) [22][150/293] lr: 5.000000e-04 eta: 7:34:09 time: 0.569437 data_time: 0.104959 memory: 6691 loss_kpt: 0.000807 acc_pose: 0.667842 loss: 0.000807 2022/09/23 13:25:32 - mmengine - INFO - Epoch(train) [22][200/293] lr: 5.000000e-04 eta: 7:34:18 time: 0.570880 data_time: 0.080649 memory: 6691 loss_kpt: 0.000790 acc_pose: 0.763758 loss: 0.000790 2022/09/23 13:26:01 - mmengine - INFO - Epoch(train) [22][250/293] lr: 5.000000e-04 eta: 7:34:30 time: 0.578603 data_time: 0.086982 memory: 6691 loss_kpt: 0.000792 acc_pose: 0.757422 loss: 0.000792 2022/09/23 13:26:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:26:55 - mmengine - INFO - Epoch(train) [23][50/293] lr: 5.000000e-04 eta: 7:31:24 time: 0.589288 data_time: 0.146235 memory: 6691 loss_kpt: 0.000779 acc_pose: 0.793989 loss: 0.000779 2022/09/23 13:27:23 - mmengine - INFO - Epoch(train) [23][100/293] lr: 5.000000e-04 eta: 7:31:29 time: 0.564399 data_time: 0.085451 memory: 6691 loss_kpt: 0.000808 acc_pose: 0.777125 loss: 0.000808 2022/09/23 13:27:52 - mmengine - INFO - Epoch(train) [23][150/293] lr: 5.000000e-04 eta: 7:31:42 time: 0.582489 data_time: 0.084252 memory: 6691 loss_kpt: 0.000797 acc_pose: 0.768596 loss: 0.000797 2022/09/23 13:28:20 - mmengine - INFO - Epoch(train) [23][200/293] lr: 5.000000e-04 eta: 7:31:48 time: 0.567368 data_time: 0.083064 memory: 6691 loss_kpt: 0.000789 acc_pose: 0.750000 loss: 0.000789 2022/09/23 13:28:48 - mmengine - INFO - Epoch(train) [23][250/293] lr: 5.000000e-04 eta: 7:31:49 time: 0.556166 data_time: 0.077120 memory: 6691 loss_kpt: 0.000790 acc_pose: 0.759131 loss: 0.000790 2022/09/23 13:29:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:29:41 - mmengine - INFO - Epoch(train) [24][50/293] lr: 5.000000e-04 eta: 7:28:54 time: 0.600272 data_time: 0.157835 memory: 6691 loss_kpt: 0.000787 acc_pose: 0.786248 loss: 0.000787 2022/09/23 13:30:09 - mmengine - INFO - Epoch(train) [24][100/293] lr: 5.000000e-04 eta: 7:28:52 time: 0.547876 data_time: 0.076716 memory: 6691 loss_kpt: 0.000776 acc_pose: 0.695097 loss: 0.000776 2022/09/23 13:30:36 - mmengine - INFO - Epoch(train) [24][150/293] lr: 5.000000e-04 eta: 7:28:47 time: 0.543665 data_time: 0.075335 memory: 6691 loss_kpt: 0.000807 acc_pose: 0.685985 loss: 0.000807 2022/09/23 13:31:03 - mmengine - INFO - Epoch(train) [24][200/293] lr: 5.000000e-04 eta: 7:28:43 time: 0.545019 data_time: 0.215384 memory: 6691 loss_kpt: 0.000793 acc_pose: 0.783283 loss: 0.000793 2022/09/23 13:31:33 - mmengine - INFO - Epoch(train) [24][250/293] lr: 5.000000e-04 eta: 7:28:57 time: 0.592113 data_time: 0.210187 memory: 6691 loss_kpt: 0.000794 acc_pose: 0.739673 loss: 0.000794 2022/09/23 13:31:39 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:31:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:32:27 - mmengine - INFO - Epoch(train) [25][50/293] lr: 5.000000e-04 eta: 7:26:05 time: 0.589149 data_time: 0.151830 memory: 6691 loss_kpt: 0.000789 acc_pose: 0.758894 loss: 0.000789 2022/09/23 13:32:56 - mmengine - INFO - Epoch(train) [25][100/293] lr: 5.000000e-04 eta: 7:26:13 time: 0.576769 data_time: 0.119513 memory: 6691 loss_kpt: 0.000776 acc_pose: 0.720471 loss: 0.000776 2022/09/23 13:33:25 - mmengine - INFO - Epoch(train) [25][150/293] lr: 5.000000e-04 eta: 7:26:24 time: 0.586622 data_time: 0.105728 memory: 6691 loss_kpt: 0.000796 acc_pose: 0.765734 loss: 0.000796 2022/09/23 13:33:54 - mmengine - INFO - Epoch(train) [25][200/293] lr: 5.000000e-04 eta: 7:26:32 time: 0.580317 data_time: 0.135146 memory: 6691 loss_kpt: 0.000794 acc_pose: 0.723123 loss: 0.000794 2022/09/23 13:34:23 - mmengine - INFO - Epoch(train) [25][250/293] lr: 5.000000e-04 eta: 7:26:42 time: 0.586157 data_time: 0.130786 memory: 6691 loss_kpt: 0.000795 acc_pose: 0.774728 loss: 0.000795 2022/09/23 13:34:47 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:35:17 - mmengine - INFO - Epoch(train) [26][50/293] lr: 5.000000e-04 eta: 7:23:54 time: 0.585966 data_time: 0.158506 memory: 6691 loss_kpt: 0.000786 acc_pose: 0.714119 loss: 0.000786 2022/09/23 13:35:46 - mmengine - INFO - Epoch(train) [26][100/293] lr: 5.000000e-04 eta: 7:24:01 time: 0.580114 data_time: 0.143235 memory: 6691 loss_kpt: 0.000782 acc_pose: 0.757026 loss: 0.000782 2022/09/23 13:36:14 - mmengine - INFO - Epoch(train) [26][150/293] lr: 5.000000e-04 eta: 7:24:05 time: 0.570137 data_time: 0.080222 memory: 6691 loss_kpt: 0.000778 acc_pose: 0.771098 loss: 0.000778 2022/09/23 13:36:43 - mmengine - INFO - Epoch(train) [26][200/293] lr: 5.000000e-04 eta: 7:24:09 time: 0.573056 data_time: 0.113000 memory: 6691 loss_kpt: 0.000805 acc_pose: 0.726355 loss: 0.000805 2022/09/23 13:37:12 - mmengine - INFO - Epoch(train) [26][250/293] lr: 5.000000e-04 eta: 7:24:14 time: 0.578466 data_time: 0.165375 memory: 6691 loss_kpt: 0.000780 acc_pose: 0.755625 loss: 0.000780 2022/09/23 13:37:36 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:38:06 - mmengine - INFO - Epoch(train) [27][50/293] lr: 5.000000e-04 eta: 7:21:31 time: 0.585376 data_time: 0.281548 memory: 6691 loss_kpt: 0.000780 acc_pose: 0.735115 loss: 0.000780 2022/09/23 13:38:33 - mmengine - INFO - Epoch(train) [27][100/293] lr: 5.000000e-04 eta: 7:21:26 time: 0.545834 data_time: 0.257633 memory: 6691 loss_kpt: 0.000786 acc_pose: 0.838400 loss: 0.000786 2022/09/23 13:39:01 - mmengine - INFO - Epoch(train) [27][150/293] lr: 5.000000e-04 eta: 7:21:28 time: 0.571305 data_time: 0.228153 memory: 6691 loss_kpt: 0.000785 acc_pose: 0.714994 loss: 0.000785 2022/09/23 13:39:30 - mmengine - INFO - Epoch(train) [27][200/293] lr: 5.000000e-04 eta: 7:21:27 time: 0.561886 data_time: 0.116856 memory: 6691 loss_kpt: 0.000767 acc_pose: 0.781680 loss: 0.000767 2022/09/23 13:39:58 - mmengine - INFO - Epoch(train) [27][250/293] lr: 5.000000e-04 eta: 7:21:30 time: 0.572420 data_time: 0.081285 memory: 6691 loss_kpt: 0.000774 acc_pose: 0.794022 loss: 0.000774 2022/09/23 13:40:23 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:40:53 - mmengine - INFO - Epoch(train) [28][50/293] lr: 5.000000e-04 eta: 7:18:57 time: 0.600038 data_time: 0.258007 memory: 6691 loss_kpt: 0.000767 acc_pose: 0.748358 loss: 0.000767 2022/09/23 13:41:15 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:41:21 - mmengine - INFO - Epoch(train) [28][100/293] lr: 5.000000e-04 eta: 7:18:55 time: 0.558223 data_time: 0.261289 memory: 6691 loss_kpt: 0.000767 acc_pose: 0.765215 loss: 0.000767 2022/09/23 13:41:49 - mmengine - INFO - Epoch(train) [28][150/293] lr: 5.000000e-04 eta: 7:18:53 time: 0.561850 data_time: 0.125081 memory: 6691 loss_kpt: 0.000763 acc_pose: 0.777461 loss: 0.000763 2022/09/23 13:42:16 - mmengine - INFO - Epoch(train) [28][200/293] lr: 5.000000e-04 eta: 7:18:43 time: 0.538121 data_time: 0.076990 memory: 6691 loss_kpt: 0.000790 acc_pose: 0.730807 loss: 0.000790 2022/09/23 13:42:45 - mmengine - INFO - Epoch(train) [28][250/293] lr: 5.000000e-04 eta: 7:18:46 time: 0.576160 data_time: 0.080654 memory: 6691 loss_kpt: 0.000774 acc_pose: 0.792416 loss: 0.000774 2022/09/23 13:43:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:43:37 - mmengine - INFO - Epoch(train) [29][50/293] lr: 5.000000e-04 eta: 7:16:13 time: 0.585839 data_time: 0.099592 memory: 6691 loss_kpt: 0.000781 acc_pose: 0.723991 loss: 0.000781 2022/09/23 13:44:05 - mmengine - INFO - Epoch(train) [29][100/293] lr: 5.000000e-04 eta: 7:16:13 time: 0.566805 data_time: 0.136177 memory: 6691 loss_kpt: 0.000788 acc_pose: 0.810459 loss: 0.000788 2022/09/23 13:44:34 - mmengine - INFO - Epoch(train) [29][150/293] lr: 5.000000e-04 eta: 7:16:12 time: 0.566884 data_time: 0.073258 memory: 6691 loss_kpt: 0.000778 acc_pose: 0.735339 loss: 0.000778 2022/09/23 13:45:02 - mmengine - INFO - Epoch(train) [29][200/293] lr: 5.000000e-04 eta: 7:16:14 time: 0.576920 data_time: 0.078537 memory: 6691 loss_kpt: 0.000773 acc_pose: 0.720893 loss: 0.000773 2022/09/23 13:45:30 - mmengine - INFO - Epoch(train) [29][250/293] lr: 5.000000e-04 eta: 7:16:09 time: 0.554956 data_time: 0.086890 memory: 6691 loss_kpt: 0.000782 acc_pose: 0.830000 loss: 0.000782 2022/09/23 13:45:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:46:23 - mmengine - INFO - Epoch(train) [30][50/293] lr: 5.000000e-04 eta: 7:13:41 time: 0.585606 data_time: 0.108910 memory: 6691 loss_kpt: 0.000765 acc_pose: 0.755800 loss: 0.000765 2022/09/23 13:46:52 - mmengine - INFO - Epoch(train) [30][100/293] lr: 5.000000e-04 eta: 7:13:38 time: 0.563942 data_time: 0.073169 memory: 6691 loss_kpt: 0.000772 acc_pose: 0.717771 loss: 0.000772 2022/09/23 13:47:19 - mmengine - INFO - Epoch(train) [30][150/293] lr: 5.000000e-04 eta: 7:13:33 time: 0.554040 data_time: 0.082316 memory: 6691 loss_kpt: 0.000785 acc_pose: 0.710681 loss: 0.000785 2022/09/23 13:47:48 - mmengine - INFO - Epoch(train) [30][200/293] lr: 5.000000e-04 eta: 7:13:32 time: 0.571188 data_time: 0.169997 memory: 6691 loss_kpt: 0.000767 acc_pose: 0.819233 loss: 0.000767 2022/09/23 13:48:17 - mmengine - INFO - Epoch(train) [30][250/293] lr: 5.000000e-04 eta: 7:13:37 time: 0.587787 data_time: 0.117045 memory: 6691 loss_kpt: 0.000762 acc_pose: 0.823308 loss: 0.000762 2022/09/23 13:48:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:48:42 - mmengine - INFO - Saving checkpoint at 30 epochs 2022/09/23 13:49:06 - mmengine - INFO - Epoch(val) [30][50/407] eta: 0:01:58 time: 0.333102 data_time: 0.080331 memory: 6691 2022/09/23 13:49:21 - mmengine - INFO - Epoch(val) [30][100/407] eta: 0:01:35 time: 0.310134 data_time: 0.053311 memory: 1014 2022/09/23 13:49:38 - mmengine - INFO - Epoch(val) [30][150/407] eta: 0:01:23 time: 0.323152 data_time: 0.051180 memory: 1014 2022/09/23 13:49:55 - mmengine - INFO - Epoch(val) [30][200/407] eta: 0:01:10 time: 0.338411 data_time: 0.072550 memory: 1014 2022/09/23 13:50:10 - mmengine - INFO - Epoch(val) [30][250/407] eta: 0:00:50 time: 0.318867 data_time: 0.039331 memory: 1014 2022/09/23 13:50:26 - mmengine - INFO - Epoch(val) [30][300/407] eta: 0:00:33 time: 0.317158 data_time: 0.048708 memory: 1014 2022/09/23 13:50:43 - mmengine - INFO - Epoch(val) [30][350/407] eta: 0:00:18 time: 0.331151 data_time: 0.067476 memory: 1014 2022/09/23 13:50:55 - mmengine - INFO - Epoch(val) [30][400/407] eta: 0:00:01 time: 0.236334 data_time: 0.053180 memory: 1014 2022/09/23 13:51:28 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 13:51:42 - mmengine - INFO - Epoch(val) [30][407/407] coco/AP: 0.654654 coco/AP .5: 0.871097 coco/AP .75: 0.727716 coco/AP (M): 0.618339 coco/AP (L): 0.721224 coco/AR: 0.714673 coco/AR .5: 0.913885 coco/AR .75: 0.782431 coco/AR (M): 0.670418 coco/AR (L): 0.777406 2022/09/23 13:51:42 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_20.pth is removed 2022/09/23 13:51:44 - mmengine - INFO - The best checkpoint with 0.6547 coco/AP at 30 epoch is saved to best_coco/AP_epoch_30.pth. 2022/09/23 13:52:12 - mmengine - INFO - Epoch(train) [31][50/293] lr: 5.000000e-04 eta: 7:11:04 time: 0.557818 data_time: 0.290750 memory: 6691 loss_kpt: 0.000780 acc_pose: 0.706294 loss: 0.000780 2022/09/23 13:52:40 - mmengine - INFO - Epoch(train) [31][100/293] lr: 5.000000e-04 eta: 7:11:00 time: 0.560080 data_time: 0.252676 memory: 6691 loss_kpt: 0.000759 acc_pose: 0.790434 loss: 0.000759 2022/09/23 13:53:08 - mmengine - INFO - Epoch(train) [31][150/293] lr: 5.000000e-04 eta: 7:10:59 time: 0.573325 data_time: 0.210179 memory: 6691 loss_kpt: 0.000774 acc_pose: 0.774291 loss: 0.000774 2022/09/23 13:53:36 - mmengine - INFO - Epoch(train) [31][200/293] lr: 5.000000e-04 eta: 7:10:53 time: 0.552649 data_time: 0.095887 memory: 6691 loss_kpt: 0.000768 acc_pose: 0.770255 loss: 0.000768 2022/09/23 13:53:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:54:04 - mmengine - INFO - Epoch(train) [31][250/293] lr: 5.000000e-04 eta: 7:10:50 time: 0.566859 data_time: 0.192695 memory: 6691 loss_kpt: 0.000763 acc_pose: 0.707218 loss: 0.000763 2022/09/23 13:54:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:54:59 - mmengine - INFO - Epoch(train) [32][50/293] lr: 5.000000e-04 eta: 7:08:30 time: 0.587317 data_time: 0.134537 memory: 6691 loss_kpt: 0.000764 acc_pose: 0.750701 loss: 0.000764 2022/09/23 13:55:28 - mmengine - INFO - Epoch(train) [32][100/293] lr: 5.000000e-04 eta: 7:08:30 time: 0.577515 data_time: 0.121506 memory: 6691 loss_kpt: 0.000769 acc_pose: 0.780849 loss: 0.000769 2022/09/23 13:55:56 - mmengine - INFO - Epoch(train) [32][150/293] lr: 5.000000e-04 eta: 7:08:24 time: 0.557277 data_time: 0.096559 memory: 6691 loss_kpt: 0.000768 acc_pose: 0.778509 loss: 0.000768 2022/09/23 13:56:24 - mmengine - INFO - Epoch(train) [32][200/293] lr: 5.000000e-04 eta: 7:08:18 time: 0.558778 data_time: 0.085964 memory: 6691 loss_kpt: 0.000746 acc_pose: 0.750923 loss: 0.000746 2022/09/23 13:56:52 - mmengine - INFO - Epoch(train) [32][250/293] lr: 5.000000e-04 eta: 7:08:13 time: 0.561278 data_time: 0.092103 memory: 6691 loss_kpt: 0.000769 acc_pose: 0.786114 loss: 0.000769 2022/09/23 13:57:17 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 13:57:46 - mmengine - INFO - Epoch(train) [33][50/293] lr: 5.000000e-04 eta: 7:05:57 time: 0.588308 data_time: 0.151316 memory: 6691 loss_kpt: 0.000753 acc_pose: 0.787234 loss: 0.000753 2022/09/23 13:58:15 - mmengine - INFO - Epoch(train) [33][100/293] lr: 5.000000e-04 eta: 7:05:59 time: 0.586970 data_time: 0.372163 memory: 6691 loss_kpt: 0.000772 acc_pose: 0.744882 loss: 0.000772 2022/09/23 13:58:44 - mmengine - INFO - Epoch(train) [33][150/293] lr: 5.000000e-04 eta: 7:05:56 time: 0.571583 data_time: 0.218086 memory: 6691 loss_kpt: 0.000745 acc_pose: 0.786292 loss: 0.000745 2022/09/23 13:59:13 - mmengine - INFO - Epoch(train) [33][200/293] lr: 5.000000e-04 eta: 7:05:58 time: 0.587107 data_time: 0.137725 memory: 6691 loss_kpt: 0.000756 acc_pose: 0.737398 loss: 0.000756 2022/09/23 13:59:41 - mmengine - INFO - Epoch(train) [33][250/293] lr: 5.000000e-04 eta: 7:05:52 time: 0.563192 data_time: 0.076561 memory: 6691 loss_kpt: 0.000761 acc_pose: 0.753933 loss: 0.000761 2022/09/23 14:00:05 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:00:34 - mmengine - INFO - Epoch(train) [34][50/293] lr: 5.000000e-04 eta: 7:03:38 time: 0.583321 data_time: 0.286218 memory: 6691 loss_kpt: 0.000760 acc_pose: 0.767588 loss: 0.000760 2022/09/23 14:01:02 - mmengine - INFO - Epoch(train) [34][100/293] lr: 5.000000e-04 eta: 7:03:35 time: 0.571895 data_time: 0.229318 memory: 6691 loss_kpt: 0.000764 acc_pose: 0.741280 loss: 0.000764 2022/09/23 14:01:32 - mmengine - INFO - Epoch(train) [34][150/293] lr: 5.000000e-04 eta: 7:03:35 time: 0.585610 data_time: 0.107357 memory: 6691 loss_kpt: 0.000759 acc_pose: 0.775954 loss: 0.000759 2022/09/23 14:02:00 - mmengine - INFO - Epoch(train) [34][200/293] lr: 5.000000e-04 eta: 7:03:32 time: 0.572042 data_time: 0.081640 memory: 6691 loss_kpt: 0.000746 acc_pose: 0.746621 loss: 0.000746 2022/09/23 14:02:29 - mmengine - INFO - Epoch(train) [34][250/293] lr: 5.000000e-04 eta: 7:03:28 time: 0.572206 data_time: 0.097627 memory: 6691 loss_kpt: 0.000766 acc_pose: 0.752254 loss: 0.000766 2022/09/23 14:02:53 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:03:16 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:03:22 - mmengine - INFO - Epoch(train) [35][50/293] lr: 5.000000e-04 eta: 7:01:17 time: 0.583538 data_time: 0.233509 memory: 6691 loss_kpt: 0.000747 acc_pose: 0.743403 loss: 0.000747 2022/09/23 14:03:51 - mmengine - INFO - Epoch(train) [35][100/293] lr: 5.000000e-04 eta: 7:01:12 time: 0.568431 data_time: 0.277887 memory: 6691 loss_kpt: 0.000761 acc_pose: 0.734132 loss: 0.000761 2022/09/23 14:04:19 - mmengine - INFO - Epoch(train) [35][150/293] lr: 5.000000e-04 eta: 7:01:07 time: 0.567625 data_time: 0.102270 memory: 6691 loss_kpt: 0.000762 acc_pose: 0.783822 loss: 0.000762 2022/09/23 14:04:48 - mmengine - INFO - Epoch(train) [35][200/293] lr: 5.000000e-04 eta: 7:01:06 time: 0.585090 data_time: 0.119900 memory: 6691 loss_kpt: 0.000762 acc_pose: 0.749906 loss: 0.000762 2022/09/23 14:05:17 - mmengine - INFO - Epoch(train) [35][250/293] lr: 5.000000e-04 eta: 7:01:04 time: 0.579523 data_time: 0.082292 memory: 6691 loss_kpt: 0.000752 acc_pose: 0.781001 loss: 0.000752 2022/09/23 14:05:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:06:12 - mmengine - INFO - Epoch(train) [36][50/293] lr: 5.000000e-04 eta: 6:58:59 time: 0.597799 data_time: 0.101611 memory: 6691 loss_kpt: 0.000743 acc_pose: 0.794178 loss: 0.000743 2022/09/23 14:06:40 - mmengine - INFO - Epoch(train) [36][100/293] lr: 5.000000e-04 eta: 6:58:52 time: 0.563755 data_time: 0.084998 memory: 6691 loss_kpt: 0.000759 acc_pose: 0.734580 loss: 0.000759 2022/09/23 14:07:07 - mmengine - INFO - Epoch(train) [36][150/293] lr: 5.000000e-04 eta: 6:58:39 time: 0.537870 data_time: 0.104966 memory: 6691 loss_kpt: 0.000762 acc_pose: 0.801524 loss: 0.000762 2022/09/23 14:07:36 - mmengine - INFO - Epoch(train) [36][200/293] lr: 5.000000e-04 eta: 6:58:37 time: 0.580572 data_time: 0.245087 memory: 6691 loss_kpt: 0.000761 acc_pose: 0.780955 loss: 0.000761 2022/09/23 14:08:04 - mmengine - INFO - Epoch(train) [36][250/293] lr: 5.000000e-04 eta: 6:58:27 time: 0.552031 data_time: 0.082094 memory: 6691 loss_kpt: 0.000754 acc_pose: 0.795058 loss: 0.000754 2022/09/23 14:08:29 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:08:58 - mmengine - INFO - Epoch(train) [37][50/293] lr: 5.000000e-04 eta: 6:56:21 time: 0.583122 data_time: 0.108627 memory: 6691 loss_kpt: 0.000734 acc_pose: 0.758880 loss: 0.000734 2022/09/23 14:09:27 - mmengine - INFO - Epoch(train) [37][100/293] lr: 5.000000e-04 eta: 6:56:18 time: 0.580455 data_time: 0.093617 memory: 6691 loss_kpt: 0.000757 acc_pose: 0.777539 loss: 0.000757 2022/09/23 14:09:55 - mmengine - INFO - Epoch(train) [37][150/293] lr: 5.000000e-04 eta: 6:56:09 time: 0.558372 data_time: 0.076200 memory: 6691 loss_kpt: 0.000772 acc_pose: 0.746379 loss: 0.000772 2022/09/23 14:10:23 - mmengine - INFO - Epoch(train) [37][200/293] lr: 5.000000e-04 eta: 6:56:04 time: 0.573095 data_time: 0.084062 memory: 6691 loss_kpt: 0.000743 acc_pose: 0.724724 loss: 0.000743 2022/09/23 14:10:52 - mmengine - INFO - Epoch(train) [37][250/293] lr: 5.000000e-04 eta: 6:55:58 time: 0.570011 data_time: 0.090130 memory: 6691 loss_kpt: 0.000748 acc_pose: 0.731494 loss: 0.000748 2022/09/23 14:11:16 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:11:45 - mmengine - INFO - Epoch(train) [38][50/293] lr: 5.000000e-04 eta: 6:53:56 time: 0.587226 data_time: 0.109331 memory: 6691 loss_kpt: 0.000747 acc_pose: 0.800161 loss: 0.000747 2022/09/23 14:12:14 - mmengine - INFO - Epoch(train) [38][100/293] lr: 5.000000e-04 eta: 6:53:51 time: 0.574426 data_time: 0.094372 memory: 6691 loss_kpt: 0.000747 acc_pose: 0.754981 loss: 0.000747 2022/09/23 14:12:42 - mmengine - INFO - Epoch(train) [38][150/293] lr: 5.000000e-04 eta: 6:53:42 time: 0.560221 data_time: 0.087787 memory: 6691 loss_kpt: 0.000748 acc_pose: 0.769280 loss: 0.000748 2022/09/23 14:12:48 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:13:10 - mmengine - INFO - Epoch(train) [38][200/293] lr: 5.000000e-04 eta: 6:53:36 time: 0.569513 data_time: 0.092882 memory: 6691 loss_kpt: 0.000752 acc_pose: 0.785992 loss: 0.000752 2022/09/23 14:13:39 - mmengine - INFO - Epoch(train) [38][250/293] lr: 5.000000e-04 eta: 6:53:31 time: 0.578587 data_time: 0.095355 memory: 6691 loss_kpt: 0.000741 acc_pose: 0.775180 loss: 0.000741 2022/09/23 14:14:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:14:33 - mmengine - INFO - Epoch(train) [39][50/293] lr: 5.000000e-04 eta: 6:51:34 time: 0.596362 data_time: 0.137830 memory: 6691 loss_kpt: 0.000731 acc_pose: 0.765446 loss: 0.000731 2022/09/23 14:15:03 - mmengine - INFO - Epoch(train) [39][100/293] lr: 5.000000e-04 eta: 6:51:32 time: 0.594328 data_time: 0.078144 memory: 6691 loss_kpt: 0.000748 acc_pose: 0.708197 loss: 0.000748 2022/09/23 14:15:31 - mmengine - INFO - Epoch(train) [39][150/293] lr: 5.000000e-04 eta: 6:51:27 time: 0.578368 data_time: 0.085023 memory: 6691 loss_kpt: 0.000745 acc_pose: 0.796819 loss: 0.000745 2022/09/23 14:15:59 - mmengine - INFO - Epoch(train) [39][200/293] lr: 5.000000e-04 eta: 6:51:16 time: 0.550732 data_time: 0.132385 memory: 6691 loss_kpt: 0.000737 acc_pose: 0.777616 loss: 0.000737 2022/09/23 14:16:27 - mmengine - INFO - Epoch(train) [39][250/293] lr: 5.000000e-04 eta: 6:51:08 time: 0.568213 data_time: 0.098972 memory: 6691 loss_kpt: 0.000748 acc_pose: 0.757389 loss: 0.000748 2022/09/23 14:16:51 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:17:21 - mmengine - INFO - Epoch(train) [40][50/293] lr: 5.000000e-04 eta: 6:49:13 time: 0.598042 data_time: 0.090003 memory: 6691 loss_kpt: 0.000728 acc_pose: 0.803893 loss: 0.000728 2022/09/23 14:17:49 - mmengine - INFO - Epoch(train) [40][100/293] lr: 5.000000e-04 eta: 6:49:04 time: 0.561158 data_time: 0.082915 memory: 6691 loss_kpt: 0.000756 acc_pose: 0.765269 loss: 0.000756 2022/09/23 14:18:19 - mmengine - INFO - Epoch(train) [40][150/293] lr: 5.000000e-04 eta: 6:49:00 time: 0.585046 data_time: 0.111795 memory: 6691 loss_kpt: 0.000729 acc_pose: 0.799543 loss: 0.000729 2022/09/23 14:18:47 - mmengine - INFO - Epoch(train) [40][200/293] lr: 5.000000e-04 eta: 6:48:53 time: 0.572994 data_time: 0.103642 memory: 6691 loss_kpt: 0.000750 acc_pose: 0.765034 loss: 0.000750 2022/09/23 14:19:16 - mmengine - INFO - Epoch(train) [40][250/293] lr: 5.000000e-04 eta: 6:48:44 time: 0.565189 data_time: 0.076367 memory: 6691 loss_kpt: 0.000751 acc_pose: 0.766075 loss: 0.000751 2022/09/23 14:19:39 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:19:39 - mmengine - INFO - Saving checkpoint at 40 epochs 2022/09/23 14:20:03 - mmengine - INFO - Epoch(val) [40][50/407] eta: 0:02:02 time: 0.342741 data_time: 0.082783 memory: 6691 2022/09/23 14:20:18 - mmengine - INFO - Epoch(val) [40][100/407] eta: 0:01:35 time: 0.312023 data_time: 0.049927 memory: 1014 2022/09/23 14:20:35 - mmengine - INFO - Epoch(val) [40][150/407] eta: 0:01:26 time: 0.337136 data_time: 0.065477 memory: 1014 2022/09/23 14:20:51 - mmengine - INFO - Epoch(val) [40][200/407] eta: 0:01:04 time: 0.312839 data_time: 0.064391 memory: 1014 2022/09/23 14:21:07 - mmengine - INFO - Epoch(val) [40][250/407] eta: 0:00:51 time: 0.328719 data_time: 0.057566 memory: 1014 2022/09/23 14:21:23 - mmengine - INFO - Epoch(val) [40][300/407] eta: 0:00:34 time: 0.320041 data_time: 0.071875 memory: 1014 2022/09/23 14:21:39 - mmengine - INFO - Epoch(val) [40][350/407] eta: 0:00:18 time: 0.320429 data_time: 0.076136 memory: 1014 2022/09/23 14:21:52 - mmengine - INFO - Epoch(val) [40][400/407] eta: 0:00:01 time: 0.246173 data_time: 0.065512 memory: 1014 2022/09/23 14:22:24 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 14:22:37 - mmengine - INFO - Epoch(val) [40][407/407] coco/AP: 0.671644 coco/AP .5: 0.876979 coco/AP .75: 0.747810 coco/AP (M): 0.636231 coco/AP (L): 0.738525 coco/AR: 0.731518 coco/AR .5: 0.919710 coco/AR .75: 0.802267 coco/AR (M): 0.687954 coco/AR (L): 0.793571 2022/09/23 14:22:37 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_30.pth is removed 2022/09/23 14:22:39 - mmengine - INFO - The best checkpoint with 0.6716 coco/AP at 40 epoch is saved to best_coco/AP_epoch_40.pth. 2022/09/23 14:23:07 - mmengine - INFO - Epoch(train) [41][50/293] lr: 5.000000e-04 eta: 6:46:42 time: 0.553112 data_time: 0.260398 memory: 6691 loss_kpt: 0.000749 acc_pose: 0.768377 loss: 0.000749 2022/09/23 14:23:35 - mmengine - INFO - Epoch(train) [41][100/293] lr: 5.000000e-04 eta: 6:46:31 time: 0.555325 data_time: 0.094208 memory: 6691 loss_kpt: 0.000731 acc_pose: 0.790241 loss: 0.000731 2022/09/23 14:24:04 - mmengine - INFO - Epoch(train) [41][150/293] lr: 5.000000e-04 eta: 6:46:24 time: 0.575004 data_time: 0.107967 memory: 6691 loss_kpt: 0.000759 acc_pose: 0.729783 loss: 0.000759 2022/09/23 14:24:33 - mmengine - INFO - Epoch(train) [41][200/293] lr: 5.000000e-04 eta: 6:46:18 time: 0.582149 data_time: 0.119714 memory: 6691 loss_kpt: 0.000726 acc_pose: 0.808025 loss: 0.000726 2022/09/23 14:25:01 - mmengine - INFO - Epoch(train) [41][250/293] lr: 5.000000e-04 eta: 6:46:11 time: 0.576339 data_time: 0.086062 memory: 6691 loss_kpt: 0.000726 acc_pose: 0.737420 loss: 0.000726 2022/09/23 14:25:19 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:25:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:25:56 - mmengine - INFO - Epoch(train) [42][50/293] lr: 5.000000e-04 eta: 6:44:22 time: 0.604766 data_time: 0.210829 memory: 6691 loss_kpt: 0.000738 acc_pose: 0.751233 loss: 0.000738 2022/09/23 14:26:24 - mmengine - INFO - Epoch(train) [42][100/293] lr: 5.000000e-04 eta: 6:44:13 time: 0.565929 data_time: 0.083478 memory: 6691 loss_kpt: 0.000745 acc_pose: 0.765932 loss: 0.000745 2022/09/23 14:26:53 - mmengine - INFO - Epoch(train) [42][150/293] lr: 5.000000e-04 eta: 6:44:04 time: 0.568947 data_time: 0.126943 memory: 6691 loss_kpt: 0.000723 acc_pose: 0.822336 loss: 0.000723 2022/09/23 14:27:23 - mmengine - INFO - Epoch(train) [42][200/293] lr: 5.000000e-04 eta: 6:44:01 time: 0.595197 data_time: 0.236105 memory: 6691 loss_kpt: 0.000737 acc_pose: 0.759197 loss: 0.000737 2022/09/23 14:27:51 - mmengine - INFO - Epoch(train) [42][250/293] lr: 5.000000e-04 eta: 6:43:52 time: 0.568890 data_time: 0.123800 memory: 6691 loss_kpt: 0.000745 acc_pose: 0.749811 loss: 0.000745 2022/09/23 14:28:16 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:28:47 - mmengine - INFO - Epoch(train) [43][50/293] lr: 5.000000e-04 eta: 6:42:04 time: 0.604068 data_time: 0.163668 memory: 6691 loss_kpt: 0.000726 acc_pose: 0.802201 loss: 0.000726 2022/09/23 14:29:15 - mmengine - INFO - Epoch(train) [43][100/293] lr: 5.000000e-04 eta: 6:41:56 time: 0.576407 data_time: 0.077304 memory: 6691 loss_kpt: 0.000736 acc_pose: 0.785358 loss: 0.000736 2022/09/23 14:29:45 - mmengine - INFO - Epoch(train) [43][150/293] lr: 5.000000e-04 eta: 6:41:52 time: 0.591088 data_time: 0.099574 memory: 6691 loss_kpt: 0.000739 acc_pose: 0.801995 loss: 0.000739 2022/09/23 14:30:14 - mmengine - INFO - Epoch(train) [43][200/293] lr: 5.000000e-04 eta: 6:41:44 time: 0.576390 data_time: 0.085229 memory: 6691 loss_kpt: 0.000736 acc_pose: 0.755740 loss: 0.000736 2022/09/23 14:30:42 - mmengine - INFO - Epoch(train) [43][250/293] lr: 5.000000e-04 eta: 6:41:33 time: 0.560258 data_time: 0.089892 memory: 6691 loss_kpt: 0.000723 acc_pose: 0.793223 loss: 0.000723 2022/09/23 14:31:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:31:37 - mmengine - INFO - Epoch(train) [44][50/293] lr: 5.000000e-04 eta: 6:39:47 time: 0.604248 data_time: 0.184939 memory: 6691 loss_kpt: 0.000737 acc_pose: 0.804624 loss: 0.000737 2022/09/23 14:32:05 - mmengine - INFO - Epoch(train) [44][100/293] lr: 5.000000e-04 eta: 6:39:37 time: 0.565836 data_time: 0.086397 memory: 6691 loss_kpt: 0.000731 acc_pose: 0.760760 loss: 0.000731 2022/09/23 14:32:33 - mmengine - INFO - Epoch(train) [44][150/293] lr: 5.000000e-04 eta: 6:39:23 time: 0.549572 data_time: 0.089025 memory: 6691 loss_kpt: 0.000730 acc_pose: 0.774476 loss: 0.000730 2022/09/23 14:33:01 - mmengine - INFO - Epoch(train) [44][200/293] lr: 5.000000e-04 eta: 6:39:14 time: 0.569594 data_time: 0.106769 memory: 6691 loss_kpt: 0.000742 acc_pose: 0.785078 loss: 0.000742 2022/09/23 14:33:31 - mmengine - INFO - Epoch(train) [44][250/293] lr: 5.000000e-04 eta: 6:39:06 time: 0.582815 data_time: 0.106561 memory: 6691 loss_kpt: 0.000741 acc_pose: 0.816952 loss: 0.000741 2022/09/23 14:33:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:34:25 - mmengine - INFO - Epoch(train) [45][50/293] lr: 5.000000e-04 eta: 6:37:21 time: 0.596179 data_time: 0.216104 memory: 6691 loss_kpt: 0.000722 acc_pose: 0.784168 loss: 0.000722 2022/09/23 14:34:54 - mmengine - INFO - Epoch(train) [45][100/293] lr: 5.000000e-04 eta: 6:37:11 time: 0.569780 data_time: 0.082205 memory: 6691 loss_kpt: 0.000733 acc_pose: 0.755656 loss: 0.000733 2022/09/23 14:34:58 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:35:22 - mmengine - INFO - Epoch(train) [45][150/293] lr: 5.000000e-04 eta: 6:37:01 time: 0.570753 data_time: 0.126275 memory: 6691 loss_kpt: 0.000734 acc_pose: 0.827946 loss: 0.000734 2022/09/23 14:35:52 - mmengine - INFO - Epoch(train) [45][200/293] lr: 5.000000e-04 eta: 6:36:54 time: 0.584800 data_time: 0.083739 memory: 6691 loss_kpt: 0.000735 acc_pose: 0.828385 loss: 0.000735 2022/09/23 14:36:19 - mmengine - INFO - Epoch(train) [45][250/293] lr: 5.000000e-04 eta: 6:36:41 time: 0.555852 data_time: 0.080360 memory: 6691 loss_kpt: 0.000726 acc_pose: 0.769439 loss: 0.000726 2022/09/23 14:36:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:37:14 - mmengine - INFO - Epoch(train) [46][50/293] lr: 5.000000e-04 eta: 6:34:56 time: 0.591353 data_time: 0.288838 memory: 6691 loss_kpt: 0.000731 acc_pose: 0.832110 loss: 0.000731 2022/09/23 14:37:43 - mmengine - INFO - Epoch(train) [46][100/293] lr: 5.000000e-04 eta: 6:34:48 time: 0.579394 data_time: 0.261092 memory: 6691 loss_kpt: 0.000733 acc_pose: 0.772313 loss: 0.000733 2022/09/23 14:38:12 - mmengine - INFO - Epoch(train) [46][150/293] lr: 5.000000e-04 eta: 6:34:40 time: 0.582299 data_time: 0.166375 memory: 6691 loss_kpt: 0.000730 acc_pose: 0.788447 loss: 0.000730 2022/09/23 14:38:40 - mmengine - INFO - Epoch(train) [46][200/293] lr: 5.000000e-04 eta: 6:34:28 time: 0.560261 data_time: 0.182670 memory: 6691 loss_kpt: 0.000733 acc_pose: 0.780355 loss: 0.000733 2022/09/23 14:39:09 - mmengine - INFO - Epoch(train) [46][250/293] lr: 5.000000e-04 eta: 6:34:19 time: 0.578875 data_time: 0.101800 memory: 6691 loss_kpt: 0.000717 acc_pose: 0.699957 loss: 0.000717 2022/09/23 14:39:32 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:40:02 - mmengine - INFO - Epoch(train) [47][50/293] lr: 5.000000e-04 eta: 6:32:36 time: 0.590473 data_time: 0.115849 memory: 6691 loss_kpt: 0.000723 acc_pose: 0.753975 loss: 0.000723 2022/09/23 14:40:30 - mmengine - INFO - Epoch(train) [47][100/293] lr: 5.000000e-04 eta: 6:32:25 time: 0.569230 data_time: 0.104996 memory: 6691 loss_kpt: 0.000725 acc_pose: 0.783148 loss: 0.000725 2022/09/23 14:40:59 - mmengine - INFO - Epoch(train) [47][150/293] lr: 5.000000e-04 eta: 6:32:16 time: 0.577419 data_time: 0.079626 memory: 6691 loss_kpt: 0.000725 acc_pose: 0.739971 loss: 0.000725 2022/09/23 14:41:28 - mmengine - INFO - Epoch(train) [47][200/293] lr: 5.000000e-04 eta: 6:32:06 time: 0.576857 data_time: 0.083777 memory: 6691 loss_kpt: 0.000730 acc_pose: 0.770022 loss: 0.000730 2022/09/23 14:41:57 - mmengine - INFO - Epoch(train) [47][250/293] lr: 5.000000e-04 eta: 6:31:55 time: 0.571768 data_time: 0.081612 memory: 6691 loss_kpt: 0.000722 acc_pose: 0.757396 loss: 0.000722 2022/09/23 14:42:21 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:42:50 - mmengine - INFO - Epoch(train) [48][50/293] lr: 5.000000e-04 eta: 6:30:13 time: 0.589892 data_time: 0.133982 memory: 6691 loss_kpt: 0.000728 acc_pose: 0.742794 loss: 0.000728 2022/09/23 14:43:18 - mmengine - INFO - Epoch(train) [48][100/293] lr: 5.000000e-04 eta: 6:29:59 time: 0.551626 data_time: 0.073442 memory: 6691 loss_kpt: 0.000713 acc_pose: 0.789489 loss: 0.000713 2022/09/23 14:43:46 - mmengine - INFO - Epoch(train) [48][150/293] lr: 5.000000e-04 eta: 6:29:45 time: 0.553496 data_time: 0.075814 memory: 6691 loss_kpt: 0.000724 acc_pose: 0.753165 loss: 0.000724 2022/09/23 14:44:13 - mmengine - INFO - Epoch(train) [48][200/293] lr: 5.000000e-04 eta: 6:29:29 time: 0.540267 data_time: 0.076255 memory: 6691 loss_kpt: 0.000728 acc_pose: 0.801095 loss: 0.000728 2022/09/23 14:44:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:44:41 - mmengine - INFO - Epoch(train) [48][250/293] lr: 5.000000e-04 eta: 6:29:19 time: 0.574069 data_time: 0.078964 memory: 6691 loss_kpt: 0.000741 acc_pose: 0.775026 loss: 0.000741 2022/09/23 14:45:05 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:45:35 - mmengine - INFO - Epoch(train) [49][50/293] lr: 5.000000e-04 eta: 6:27:38 time: 0.587475 data_time: 0.101525 memory: 6691 loss_kpt: 0.000728 acc_pose: 0.794736 loss: 0.000728 2022/09/23 14:46:03 - mmengine - INFO - Epoch(train) [49][100/293] lr: 5.000000e-04 eta: 6:27:27 time: 0.568586 data_time: 0.077557 memory: 6691 loss_kpt: 0.000708 acc_pose: 0.753081 loss: 0.000708 2022/09/23 14:46:32 - mmengine - INFO - Epoch(train) [49][150/293] lr: 5.000000e-04 eta: 6:27:16 time: 0.572485 data_time: 0.101108 memory: 6691 loss_kpt: 0.000721 acc_pose: 0.767714 loss: 0.000721 2022/09/23 14:47:01 - mmengine - INFO - Epoch(train) [49][200/293] lr: 5.000000e-04 eta: 6:27:08 time: 0.590941 data_time: 0.090093 memory: 6691 loss_kpt: 0.000729 acc_pose: 0.740251 loss: 0.000729 2022/09/23 14:47:29 - mmengine - INFO - Epoch(train) [49][250/293] lr: 5.000000e-04 eta: 6:26:54 time: 0.556773 data_time: 0.089892 memory: 6691 loss_kpt: 0.000731 acc_pose: 0.771439 loss: 0.000731 2022/09/23 14:47:53 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:48:23 - mmengine - INFO - Epoch(train) [50][50/293] lr: 5.000000e-04 eta: 6:25:16 time: 0.595307 data_time: 0.106253 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.820543 loss: 0.000715 2022/09/23 14:48:51 - mmengine - INFO - Epoch(train) [50][100/293] lr: 5.000000e-04 eta: 6:25:04 time: 0.570550 data_time: 0.082883 memory: 6691 loss_kpt: 0.000711 acc_pose: 0.869039 loss: 0.000711 2022/09/23 14:49:21 - mmengine - INFO - Epoch(train) [50][150/293] lr: 5.000000e-04 eta: 6:24:57 time: 0.595838 data_time: 0.098719 memory: 6691 loss_kpt: 0.000724 acc_pose: 0.772914 loss: 0.000724 2022/09/23 14:49:51 - mmengine - INFO - Epoch(train) [50][200/293] lr: 5.000000e-04 eta: 6:24:48 time: 0.587039 data_time: 0.208316 memory: 6691 loss_kpt: 0.000740 acc_pose: 0.796596 loss: 0.000740 2022/09/23 14:50:19 - mmengine - INFO - Epoch(train) [50][250/293] lr: 5.000000e-04 eta: 6:24:35 time: 0.568140 data_time: 0.269363 memory: 6691 loss_kpt: 0.000720 acc_pose: 0.796635 loss: 0.000720 2022/09/23 14:50:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:50:43 - mmengine - INFO - Saving checkpoint at 50 epochs 2022/09/23 14:51:05 - mmengine - INFO - Epoch(val) [50][50/407] eta: 0:01:57 time: 0.330434 data_time: 0.085154 memory: 6691 2022/09/23 14:51:22 - mmengine - INFO - Epoch(val) [50][100/407] eta: 0:01:40 time: 0.328445 data_time: 0.070574 memory: 1014 2022/09/23 14:51:38 - mmengine - INFO - Epoch(val) [50][150/407] eta: 0:01:23 time: 0.324675 data_time: 0.068293 memory: 1014 2022/09/23 14:51:54 - mmengine - INFO - Epoch(val) [50][200/407] eta: 0:01:05 time: 0.316476 data_time: 0.045312 memory: 1014 2022/09/23 14:52:11 - mmengine - INFO - Epoch(val) [50][250/407] eta: 0:00:53 time: 0.340890 data_time: 0.079100 memory: 1014 2022/09/23 14:52:27 - mmengine - INFO - Epoch(val) [50][300/407] eta: 0:00:33 time: 0.316743 data_time: 0.057144 memory: 1014 2022/09/23 14:52:43 - mmengine - INFO - Epoch(val) [50][350/407] eta: 0:00:18 time: 0.332393 data_time: 0.083529 memory: 1014 2022/09/23 14:52:56 - mmengine - INFO - Epoch(val) [50][400/407] eta: 0:00:01 time: 0.248428 data_time: 0.059795 memory: 1014 2022/09/23 14:53:28 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 14:53:41 - mmengine - INFO - Epoch(val) [50][407/407] coco/AP: 0.680116 coco/AP .5: 0.876830 coco/AP .75: 0.755570 coco/AP (M): 0.645293 coco/AP (L): 0.745995 coco/AR: 0.738161 coco/AR .5: 0.918766 coco/AR .75: 0.806832 coco/AR (M): 0.695247 coco/AR (L): 0.799591 2022/09/23 14:53:41 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_40.pth is removed 2022/09/23 14:53:44 - mmengine - INFO - The best checkpoint with 0.6801 coco/AP at 50 epoch is saved to best_coco/AP_epoch_50.pth. 2022/09/23 14:54:11 - mmengine - INFO - Epoch(train) [51][50/293] lr: 5.000000e-04 eta: 6:22:52 time: 0.549830 data_time: 0.283886 memory: 6691 loss_kpt: 0.000716 acc_pose: 0.760976 loss: 0.000716 2022/09/23 14:54:40 - mmengine - INFO - Epoch(train) [51][100/293] lr: 5.000000e-04 eta: 6:22:40 time: 0.570564 data_time: 0.195621 memory: 6691 loss_kpt: 0.000729 acc_pose: 0.755403 loss: 0.000729 2022/09/23 14:55:08 - mmengine - INFO - Epoch(train) [51][150/293] lr: 5.000000e-04 eta: 6:22:27 time: 0.564478 data_time: 0.248142 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.816006 loss: 0.000718 2022/09/23 14:55:37 - mmengine - INFO - Epoch(train) [51][200/293] lr: 5.000000e-04 eta: 6:22:16 time: 0.577140 data_time: 0.276201 memory: 6691 loss_kpt: 0.000728 acc_pose: 0.768980 loss: 0.000728 2022/09/23 14:56:06 - mmengine - INFO - Epoch(train) [51][250/293] lr: 5.000000e-04 eta: 6:22:05 time: 0.580383 data_time: 0.184120 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.780548 loss: 0.000718 2022/09/23 14:56:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:56:59 - mmengine - INFO - Epoch(train) [52][50/293] lr: 5.000000e-04 eta: 6:20:29 time: 0.591955 data_time: 0.299654 memory: 6691 loss_kpt: 0.000711 acc_pose: 0.733539 loss: 0.000711 2022/09/23 14:57:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:57:28 - mmengine - INFO - Epoch(train) [52][100/293] lr: 5.000000e-04 eta: 6:20:18 time: 0.575720 data_time: 0.219850 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.810073 loss: 0.000718 2022/09/23 14:57:57 - mmengine - INFO - Epoch(train) [52][150/293] lr: 5.000000e-04 eta: 6:20:07 time: 0.577899 data_time: 0.228784 memory: 6691 loss_kpt: 0.000706 acc_pose: 0.792144 loss: 0.000706 2022/09/23 14:58:26 - mmengine - INFO - Epoch(train) [52][200/293] lr: 5.000000e-04 eta: 6:19:56 time: 0.582527 data_time: 0.147634 memory: 6691 loss_kpt: 0.000714 acc_pose: 0.807864 loss: 0.000714 2022/09/23 14:58:54 - mmengine - INFO - Epoch(train) [52][250/293] lr: 5.000000e-04 eta: 6:19:43 time: 0.564715 data_time: 0.086944 memory: 6691 loss_kpt: 0.000723 acc_pose: 0.806326 loss: 0.000723 2022/09/23 14:59:19 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 14:59:48 - mmengine - INFO - Epoch(train) [53][50/293] lr: 5.000000e-04 eta: 6:18:07 time: 0.583253 data_time: 0.118559 memory: 6691 loss_kpt: 0.000723 acc_pose: 0.760361 loss: 0.000723 2022/09/23 15:00:17 - mmengine - INFO - Epoch(train) [53][100/293] lr: 5.000000e-04 eta: 6:17:56 time: 0.579408 data_time: 0.112099 memory: 6691 loss_kpt: 0.000710 acc_pose: 0.832309 loss: 0.000710 2022/09/23 15:00:44 - mmengine - INFO - Epoch(train) [53][150/293] lr: 5.000000e-04 eta: 6:17:39 time: 0.544138 data_time: 0.139030 memory: 6691 loss_kpt: 0.000736 acc_pose: 0.761379 loss: 0.000736 2022/09/23 15:01:14 - mmengine - INFO - Epoch(train) [53][200/293] lr: 5.000000e-04 eta: 6:17:30 time: 0.589546 data_time: 0.155699 memory: 6691 loss_kpt: 0.000717 acc_pose: 0.778016 loss: 0.000717 2022/09/23 15:01:41 - mmengine - INFO - Epoch(train) [53][250/293] lr: 5.000000e-04 eta: 6:17:13 time: 0.546744 data_time: 0.076526 memory: 6691 loss_kpt: 0.000717 acc_pose: 0.747719 loss: 0.000717 2022/09/23 15:02:05 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:02:36 - mmengine - INFO - Epoch(train) [54][50/293] lr: 5.000000e-04 eta: 6:15:42 time: 0.608388 data_time: 0.178908 memory: 6691 loss_kpt: 0.000713 acc_pose: 0.789886 loss: 0.000713 2022/09/23 15:03:05 - mmengine - INFO - Epoch(train) [54][100/293] lr: 5.000000e-04 eta: 6:15:30 time: 0.576489 data_time: 0.100660 memory: 6691 loss_kpt: 0.000724 acc_pose: 0.779228 loss: 0.000724 2022/09/23 15:03:33 - mmengine - INFO - Epoch(train) [54][150/293] lr: 5.000000e-04 eta: 6:15:18 time: 0.574100 data_time: 0.094516 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.771750 loss: 0.000715 2022/09/23 15:04:02 - mmengine - INFO - Epoch(train) [54][200/293] lr: 5.000000e-04 eta: 6:15:06 time: 0.577899 data_time: 0.115830 memory: 6691 loss_kpt: 0.000722 acc_pose: 0.836682 loss: 0.000722 2022/09/23 15:04:30 - mmengine - INFO - Epoch(train) [54][250/293] lr: 5.000000e-04 eta: 6:14:51 time: 0.553015 data_time: 0.090091 memory: 6691 loss_kpt: 0.000711 acc_pose: 0.783328 loss: 0.000711 2022/09/23 15:04:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:05:24 - mmengine - INFO - Epoch(train) [55][50/293] lr: 5.000000e-04 eta: 6:13:19 time: 0.595203 data_time: 0.115766 memory: 6691 loss_kpt: 0.000719 acc_pose: 0.767750 loss: 0.000719 2022/09/23 15:05:53 - mmengine - INFO - Epoch(train) [55][100/293] lr: 5.000000e-04 eta: 6:13:06 time: 0.574425 data_time: 0.193909 memory: 6691 loss_kpt: 0.000697 acc_pose: 0.805695 loss: 0.000697 2022/09/23 15:06:22 - mmengine - INFO - Epoch(train) [55][150/293] lr: 5.000000e-04 eta: 6:12:54 time: 0.574018 data_time: 0.243942 memory: 6691 loss_kpt: 0.000720 acc_pose: 0.808488 loss: 0.000720 2022/09/23 15:06:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:06:50 - mmengine - INFO - Epoch(train) [55][200/293] lr: 5.000000e-04 eta: 6:12:41 time: 0.573847 data_time: 0.093700 memory: 6691 loss_kpt: 0.000714 acc_pose: 0.775468 loss: 0.000714 2022/09/23 15:07:20 - mmengine - INFO - Epoch(train) [55][250/293] lr: 5.000000e-04 eta: 6:12:29 time: 0.582491 data_time: 0.102740 memory: 6691 loss_kpt: 0.000711 acc_pose: 0.797592 loss: 0.000711 2022/09/23 15:07:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:08:13 - mmengine - INFO - Epoch(train) [56][50/293] lr: 5.000000e-04 eta: 6:10:57 time: 0.586054 data_time: 0.161649 memory: 6691 loss_kpt: 0.000722 acc_pose: 0.786956 loss: 0.000722 2022/09/23 15:08:42 - mmengine - INFO - Epoch(train) [56][100/293] lr: 5.000000e-04 eta: 6:10:45 time: 0.576936 data_time: 0.100189 memory: 6691 loss_kpt: 0.000713 acc_pose: 0.814916 loss: 0.000713 2022/09/23 15:09:10 - mmengine - INFO - Epoch(train) [56][150/293] lr: 5.000000e-04 eta: 6:10:30 time: 0.561305 data_time: 0.089922 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.816397 loss: 0.000718 2022/09/23 15:09:40 - mmengine - INFO - Epoch(train) [56][200/293] lr: 5.000000e-04 eta: 6:10:20 time: 0.593359 data_time: 0.101373 memory: 6691 loss_kpt: 0.000710 acc_pose: 0.799530 loss: 0.000710 2022/09/23 15:10:08 - mmengine - INFO - Epoch(train) [56][250/293] lr: 5.000000e-04 eta: 6:10:06 time: 0.571122 data_time: 0.095934 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.704563 loss: 0.000718 2022/09/23 15:10:32 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:11:02 - mmengine - INFO - Epoch(train) [57][50/293] lr: 5.000000e-04 eta: 6:08:35 time: 0.584815 data_time: 0.169417 memory: 6691 loss_kpt: 0.000718 acc_pose: 0.800931 loss: 0.000718 2022/09/23 15:11:30 - mmengine - INFO - Epoch(train) [57][100/293] lr: 5.000000e-04 eta: 6:08:21 time: 0.565251 data_time: 0.092726 memory: 6691 loss_kpt: 0.000708 acc_pose: 0.802805 loss: 0.000708 2022/09/23 15:11:58 - mmengine - INFO - Epoch(train) [57][150/293] lr: 5.000000e-04 eta: 6:08:06 time: 0.561508 data_time: 0.116904 memory: 6691 loss_kpt: 0.000705 acc_pose: 0.770050 loss: 0.000705 2022/09/23 15:12:27 - mmengine - INFO - Epoch(train) [57][200/293] lr: 5.000000e-04 eta: 6:07:52 time: 0.571918 data_time: 0.078458 memory: 6691 loss_kpt: 0.000719 acc_pose: 0.762572 loss: 0.000719 2022/09/23 15:12:54 - mmengine - INFO - Epoch(train) [57][250/293] lr: 5.000000e-04 eta: 6:07:35 time: 0.542982 data_time: 0.095276 memory: 6691 loss_kpt: 0.000714 acc_pose: 0.742819 loss: 0.000714 2022/09/23 15:13:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:13:47 - mmengine - INFO - Epoch(train) [58][50/293] lr: 5.000000e-04 eta: 6:06:06 time: 0.593437 data_time: 0.198063 memory: 6691 loss_kpt: 0.000712 acc_pose: 0.795417 loss: 0.000712 2022/09/23 15:14:16 - mmengine - INFO - Epoch(train) [58][100/293] lr: 5.000000e-04 eta: 6:05:53 time: 0.577946 data_time: 0.098223 memory: 6691 loss_kpt: 0.000701 acc_pose: 0.739009 loss: 0.000701 2022/09/23 15:14:45 - mmengine - INFO - Epoch(train) [58][150/293] lr: 5.000000e-04 eta: 6:05:40 time: 0.575619 data_time: 0.094957 memory: 6691 loss_kpt: 0.000711 acc_pose: 0.792695 loss: 0.000711 2022/09/23 15:15:14 - mmengine - INFO - Epoch(train) [58][200/293] lr: 5.000000e-04 eta: 6:05:26 time: 0.571842 data_time: 0.098239 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.782406 loss: 0.000691 2022/09/23 15:15:42 - mmengine - INFO - Epoch(train) [58][250/293] lr: 5.000000e-04 eta: 6:05:12 time: 0.568136 data_time: 0.094016 memory: 6691 loss_kpt: 0.000710 acc_pose: 0.767598 loss: 0.000710 2022/09/23 15:16:06 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:16:10 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:16:36 - mmengine - INFO - Epoch(train) [59][50/293] lr: 5.000000e-04 eta: 6:03:45 time: 0.601178 data_time: 0.125758 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.794728 loss: 0.000715 2022/09/23 15:17:06 - mmengine - INFO - Epoch(train) [59][100/293] lr: 5.000000e-04 eta: 6:03:32 time: 0.580301 data_time: 0.116191 memory: 6691 loss_kpt: 0.000708 acc_pose: 0.823253 loss: 0.000708 2022/09/23 15:17:34 - mmengine - INFO - Epoch(train) [59][150/293] lr: 5.000000e-04 eta: 6:03:18 time: 0.573200 data_time: 0.105568 memory: 6691 loss_kpt: 0.000701 acc_pose: 0.806542 loss: 0.000701 2022/09/23 15:18:02 - mmengine - INFO - Epoch(train) [59][200/293] lr: 5.000000e-04 eta: 6:03:03 time: 0.558985 data_time: 0.085943 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.761733 loss: 0.000691 2022/09/23 15:18:29 - mmengine - INFO - Epoch(train) [59][250/293] lr: 5.000000e-04 eta: 6:02:45 time: 0.546177 data_time: 0.091159 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.788348 loss: 0.000715 2022/09/23 15:18:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:19:23 - mmengine - INFO - Epoch(train) [60][50/293] lr: 5.000000e-04 eta: 6:01:18 time: 0.591046 data_time: 0.197479 memory: 6691 loss_kpt: 0.000714 acc_pose: 0.760242 loss: 0.000714 2022/09/23 15:19:51 - mmengine - INFO - Epoch(train) [60][100/293] lr: 5.000000e-04 eta: 6:01:02 time: 0.553500 data_time: 0.090153 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.830098 loss: 0.000715 2022/09/23 15:20:18 - mmengine - INFO - Epoch(train) [60][150/293] lr: 5.000000e-04 eta: 6:00:45 time: 0.551860 data_time: 0.085486 memory: 6691 loss_kpt: 0.000697 acc_pose: 0.830468 loss: 0.000697 2022/09/23 15:20:47 - mmengine - INFO - Epoch(train) [60][200/293] lr: 5.000000e-04 eta: 6:00:30 time: 0.569376 data_time: 0.110604 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.862630 loss: 0.000715 2022/09/23 15:21:16 - mmengine - INFO - Epoch(train) [60][250/293] lr: 5.000000e-04 eta: 6:00:17 time: 0.585627 data_time: 0.109075 memory: 6691 loss_kpt: 0.000692 acc_pose: 0.799892 loss: 0.000692 2022/09/23 15:21:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:21:41 - mmengine - INFO - Saving checkpoint at 60 epochs 2022/09/23 15:22:04 - mmengine - INFO - Epoch(val) [60][50/407] eta: 0:02:01 time: 0.340077 data_time: 0.077606 memory: 6691 2022/09/23 15:22:19 - mmengine - INFO - Epoch(val) [60][100/407] eta: 0:01:36 time: 0.314626 data_time: 0.061648 memory: 1014 2022/09/23 15:22:37 - mmengine - INFO - Epoch(val) [60][150/407] eta: 0:01:28 time: 0.344144 data_time: 0.084338 memory: 1014 2022/09/23 15:22:52 - mmengine - INFO - Epoch(val) [60][200/407] eta: 0:01:05 time: 0.316571 data_time: 0.052563 memory: 1014 2022/09/23 15:23:08 - mmengine - INFO - Epoch(val) [60][250/407] eta: 0:00:50 time: 0.321546 data_time: 0.072947 memory: 1014 2022/09/23 15:23:25 - mmengine - INFO - Epoch(val) [60][300/407] eta: 0:00:34 time: 0.322749 data_time: 0.042323 memory: 1014 2022/09/23 15:23:40 - mmengine - INFO - Epoch(val) [60][350/407] eta: 0:00:17 time: 0.312493 data_time: 0.033213 memory: 1014 2022/09/23 15:23:53 - mmengine - INFO - Epoch(val) [60][400/407] eta: 0:00:01 time: 0.253541 data_time: 0.054639 memory: 1014 2022/09/23 15:24:25 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 15:24:39 - mmengine - INFO - Epoch(val) [60][407/407] coco/AP: 0.683175 coco/AP .5: 0.882465 coco/AP .75: 0.762011 coco/AP (M): 0.645123 coco/AP (L): 0.749901 coco/AR: 0.741483 coco/AR .5: 0.923804 coco/AR .75: 0.811241 coco/AR (M): 0.696231 coco/AR (L): 0.806429 2022/09/23 15:24:39 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_50.pth is removed 2022/09/23 15:24:41 - mmengine - INFO - The best checkpoint with 0.6832 coco/AP at 60 epoch is saved to best_coco/AP_epoch_60.pth. 2022/09/23 15:25:09 - mmengine - INFO - Epoch(train) [61][50/293] lr: 5.000000e-04 eta: 5:58:46 time: 0.546974 data_time: 0.265919 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.815454 loss: 0.000696 2022/09/23 15:25:36 - mmengine - INFO - Epoch(train) [61][100/293] lr: 5.000000e-04 eta: 5:58:29 time: 0.547207 data_time: 0.258995 memory: 6691 loss_kpt: 0.000705 acc_pose: 0.790869 loss: 0.000705 2022/09/23 15:26:04 - mmengine - INFO - Epoch(train) [61][150/293] lr: 5.000000e-04 eta: 5:58:12 time: 0.559000 data_time: 0.100970 memory: 6691 loss_kpt: 0.000689 acc_pose: 0.757029 loss: 0.000689 2022/09/23 15:26:32 - mmengine - INFO - Epoch(train) [61][200/293] lr: 5.000000e-04 eta: 5:57:57 time: 0.561702 data_time: 0.080389 memory: 6691 loss_kpt: 0.000719 acc_pose: 0.770774 loss: 0.000719 2022/09/23 15:27:00 - mmengine - INFO - Epoch(train) [61][250/293] lr: 5.000000e-04 eta: 5:57:40 time: 0.556684 data_time: 0.137997 memory: 6691 loss_kpt: 0.000724 acc_pose: 0.796662 loss: 0.000724 2022/09/23 15:27:24 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:27:54 - mmengine - INFO - Epoch(train) [62][50/293] lr: 5.000000e-04 eta: 5:56:15 time: 0.592235 data_time: 0.151935 memory: 6691 loss_kpt: 0.000705 acc_pose: 0.800392 loss: 0.000705 2022/09/23 15:28:21 - mmengine - INFO - Epoch(train) [62][100/293] lr: 5.000000e-04 eta: 5:55:58 time: 0.545002 data_time: 0.079124 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.794742 loss: 0.000696 2022/09/23 15:28:36 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:28:48 - mmengine - INFO - Epoch(train) [62][150/293] lr: 5.000000e-04 eta: 5:55:39 time: 0.539289 data_time: 0.073060 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.764285 loss: 0.000690 2022/09/23 15:29:15 - mmengine - INFO - Epoch(train) [62][200/293] lr: 5.000000e-04 eta: 5:55:21 time: 0.547911 data_time: 0.077592 memory: 6691 loss_kpt: 0.000706 acc_pose: 0.788306 loss: 0.000706 2022/09/23 15:29:44 - mmengine - INFO - Epoch(train) [62][250/293] lr: 5.000000e-04 eta: 5:55:07 time: 0.572431 data_time: 0.107917 memory: 6691 loss_kpt: 0.000685 acc_pose: 0.769087 loss: 0.000685 2022/09/23 15:30:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:30:37 - mmengine - INFO - Epoch(train) [63][50/293] lr: 5.000000e-04 eta: 5:53:41 time: 0.575766 data_time: 0.125289 memory: 6691 loss_kpt: 0.000707 acc_pose: 0.744912 loss: 0.000707 2022/09/23 15:31:05 - mmengine - INFO - Epoch(train) [63][100/293] lr: 5.000000e-04 eta: 5:53:24 time: 0.554624 data_time: 0.158997 memory: 6691 loss_kpt: 0.000703 acc_pose: 0.806880 loss: 0.000703 2022/09/23 15:31:33 - mmengine - INFO - Epoch(train) [63][150/293] lr: 5.000000e-04 eta: 5:53:09 time: 0.571294 data_time: 0.122777 memory: 6691 loss_kpt: 0.000700 acc_pose: 0.824143 loss: 0.000700 2022/09/23 15:32:02 - mmengine - INFO - Epoch(train) [63][200/293] lr: 5.000000e-04 eta: 5:52:55 time: 0.576780 data_time: 0.123400 memory: 6691 loss_kpt: 0.000715 acc_pose: 0.826686 loss: 0.000715 2022/09/23 15:32:30 - mmengine - INFO - Epoch(train) [63][250/293] lr: 5.000000e-04 eta: 5:52:39 time: 0.567310 data_time: 0.100223 memory: 6691 loss_kpt: 0.000708 acc_pose: 0.798985 loss: 0.000708 2022/09/23 15:32:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:33:23 - mmengine - INFO - Epoch(train) [64][50/293] lr: 5.000000e-04 eta: 5:51:15 time: 0.580430 data_time: 0.209399 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.784333 loss: 0.000690 2022/09/23 15:33:51 - mmengine - INFO - Epoch(train) [64][100/293] lr: 5.000000e-04 eta: 5:50:58 time: 0.557848 data_time: 0.113628 memory: 6691 loss_kpt: 0.000713 acc_pose: 0.794344 loss: 0.000713 2022/09/23 15:34:18 - mmengine - INFO - Epoch(train) [64][150/293] lr: 5.000000e-04 eta: 5:50:40 time: 0.545887 data_time: 0.073759 memory: 6691 loss_kpt: 0.000693 acc_pose: 0.782732 loss: 0.000693 2022/09/23 15:34:47 - mmengine - INFO - Epoch(train) [64][200/293] lr: 5.000000e-04 eta: 5:50:25 time: 0.572754 data_time: 0.080396 memory: 6691 loss_kpt: 0.000700 acc_pose: 0.790212 loss: 0.000700 2022/09/23 15:35:15 - mmengine - INFO - Epoch(train) [64][250/293] lr: 5.000000e-04 eta: 5:50:09 time: 0.564689 data_time: 0.099666 memory: 6691 loss_kpt: 0.000705 acc_pose: 0.829438 loss: 0.000705 2022/09/23 15:35:39 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:36:08 - mmengine - INFO - Epoch(train) [65][50/293] lr: 5.000000e-04 eta: 5:48:47 time: 0.592978 data_time: 0.139826 memory: 6691 loss_kpt: 0.000700 acc_pose: 0.781439 loss: 0.000700 2022/09/23 15:36:37 - mmengine - INFO - Epoch(train) [65][100/293] lr: 5.000000e-04 eta: 5:48:32 time: 0.575741 data_time: 0.108856 memory: 6691 loss_kpt: 0.000698 acc_pose: 0.762793 loss: 0.000698 2022/09/23 15:37:05 - mmengine - INFO - Epoch(train) [65][150/293] lr: 5.000000e-04 eta: 5:48:16 time: 0.559456 data_time: 0.113153 memory: 6691 loss_kpt: 0.000699 acc_pose: 0.787814 loss: 0.000699 2022/09/23 15:37:33 - mmengine - INFO - Epoch(train) [65][200/293] lr: 5.000000e-04 eta: 5:47:59 time: 0.555659 data_time: 0.098018 memory: 6691 loss_kpt: 0.000683 acc_pose: 0.813005 loss: 0.000683 2022/09/23 15:38:00 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:38:01 - mmengine - INFO - Epoch(train) [65][250/293] lr: 5.000000e-04 eta: 5:47:42 time: 0.564243 data_time: 0.073628 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.803819 loss: 0.000690 2022/09/23 15:38:24 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:38:54 - mmengine - INFO - Epoch(train) [66][50/293] lr: 5.000000e-04 eta: 5:46:22 time: 0.596133 data_time: 0.113724 memory: 6691 loss_kpt: 0.000701 acc_pose: 0.792214 loss: 0.000701 2022/09/23 15:39:23 - mmengine - INFO - Epoch(train) [66][100/293] lr: 5.000000e-04 eta: 5:46:08 time: 0.588884 data_time: 0.090318 memory: 6691 loss_kpt: 0.000694 acc_pose: 0.827736 loss: 0.000694 2022/09/23 15:39:52 - mmengine - INFO - Epoch(train) [66][150/293] lr: 5.000000e-04 eta: 5:45:53 time: 0.571409 data_time: 0.184336 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.776996 loss: 0.000691 2022/09/23 15:40:21 - mmengine - INFO - Epoch(train) [66][200/293] lr: 5.000000e-04 eta: 5:45:38 time: 0.578095 data_time: 0.092656 memory: 6691 loss_kpt: 0.000689 acc_pose: 0.790910 loss: 0.000689 2022/09/23 15:40:49 - mmengine - INFO - Epoch(train) [66][250/293] lr: 5.000000e-04 eta: 5:45:21 time: 0.564717 data_time: 0.075842 memory: 6691 loss_kpt: 0.000693 acc_pose: 0.786990 loss: 0.000693 2022/09/23 15:41:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:41:42 - mmengine - INFO - Epoch(train) [67][50/293] lr: 5.000000e-04 eta: 5:44:01 time: 0.594959 data_time: 0.302536 memory: 6691 loss_kpt: 0.000708 acc_pose: 0.719325 loss: 0.000708 2022/09/23 15:42:10 - mmengine - INFO - Epoch(train) [67][100/293] lr: 5.000000e-04 eta: 5:43:44 time: 0.556729 data_time: 0.235180 memory: 6691 loss_kpt: 0.000703 acc_pose: 0.800136 loss: 0.000703 2022/09/23 15:42:37 - mmengine - INFO - Epoch(train) [67][150/293] lr: 5.000000e-04 eta: 5:43:25 time: 0.541242 data_time: 0.250719 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.807747 loss: 0.000691 2022/09/23 15:43:06 - mmengine - INFO - Epoch(train) [67][200/293] lr: 5.000000e-04 eta: 5:43:09 time: 0.570110 data_time: 0.136074 memory: 6691 loss_kpt: 0.000700 acc_pose: 0.799935 loss: 0.000700 2022/09/23 15:43:33 - mmengine - INFO - Epoch(train) [67][250/293] lr: 5.000000e-04 eta: 5:42:50 time: 0.539422 data_time: 0.074259 memory: 6691 loss_kpt: 0.000702 acc_pose: 0.817311 loss: 0.000702 2022/09/23 15:43:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:44:26 - mmengine - INFO - Epoch(train) [68][50/293] lr: 5.000000e-04 eta: 5:41:31 time: 0.595979 data_time: 0.248182 memory: 6691 loss_kpt: 0.000685 acc_pose: 0.827224 loss: 0.000685 2022/09/23 15:44:55 - mmengine - INFO - Epoch(train) [68][100/293] lr: 5.000000e-04 eta: 5:41:16 time: 0.581305 data_time: 0.261814 memory: 6691 loss_kpt: 0.000693 acc_pose: 0.817226 loss: 0.000693 2022/09/23 15:45:23 - mmengine - INFO - Epoch(train) [68][150/293] lr: 5.000000e-04 eta: 5:40:59 time: 0.560197 data_time: 0.234620 memory: 6691 loss_kpt: 0.000692 acc_pose: 0.748081 loss: 0.000692 2022/09/23 15:45:50 - mmengine - INFO - Epoch(train) [68][200/293] lr: 5.000000e-04 eta: 5:40:39 time: 0.536978 data_time: 0.121865 memory: 6691 loss_kpt: 0.000693 acc_pose: 0.779571 loss: 0.000693 2022/09/23 15:46:18 - mmengine - INFO - Epoch(train) [68][250/293] lr: 5.000000e-04 eta: 5:40:22 time: 0.557294 data_time: 0.174186 memory: 6691 loss_kpt: 0.000700 acc_pose: 0.814240 loss: 0.000700 2022/09/23 15:46:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:47:11 - mmengine - INFO - Epoch(train) [69][50/293] lr: 5.000000e-04 eta: 5:39:02 time: 0.588332 data_time: 0.120722 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.748895 loss: 0.000696 2022/09/23 15:47:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:47:39 - mmengine - INFO - Epoch(train) [69][100/293] lr: 5.000000e-04 eta: 5:38:45 time: 0.558304 data_time: 0.093739 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.815443 loss: 0.000682 2022/09/23 15:48:08 - mmengine - INFO - Epoch(train) [69][150/293] lr: 5.000000e-04 eta: 5:38:29 time: 0.574731 data_time: 0.101348 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.755277 loss: 0.000696 2022/09/23 15:48:36 - mmengine - INFO - Epoch(train) [69][200/293] lr: 5.000000e-04 eta: 5:38:13 time: 0.571544 data_time: 0.102871 memory: 6691 loss_kpt: 0.000683 acc_pose: 0.762047 loss: 0.000683 2022/09/23 15:49:05 - mmengine - INFO - Epoch(train) [69][250/293] lr: 5.000000e-04 eta: 5:37:57 time: 0.575358 data_time: 0.137725 memory: 6691 loss_kpt: 0.000714 acc_pose: 0.786798 loss: 0.000714 2022/09/23 15:49:27 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:49:57 - mmengine - INFO - Epoch(train) [70][50/293] lr: 5.000000e-04 eta: 5:36:39 time: 0.593206 data_time: 0.152859 memory: 6691 loss_kpt: 0.000699 acc_pose: 0.741090 loss: 0.000699 2022/09/23 15:50:25 - mmengine - INFO - Epoch(train) [70][100/293] lr: 5.000000e-04 eta: 5:36:21 time: 0.548192 data_time: 0.117051 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.752993 loss: 0.000691 2022/09/23 15:50:53 - mmengine - INFO - Epoch(train) [70][150/293] lr: 5.000000e-04 eta: 5:36:04 time: 0.562742 data_time: 0.147666 memory: 6691 loss_kpt: 0.000694 acc_pose: 0.767285 loss: 0.000694 2022/09/23 15:51:21 - mmengine - INFO - Epoch(train) [70][200/293] lr: 5.000000e-04 eta: 5:35:46 time: 0.559763 data_time: 0.200061 memory: 6691 loss_kpt: 0.000702 acc_pose: 0.746990 loss: 0.000702 2022/09/23 15:51:48 - mmengine - INFO - Epoch(train) [70][250/293] lr: 5.000000e-04 eta: 5:35:28 time: 0.550152 data_time: 0.231668 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.747421 loss: 0.000696 2022/09/23 15:52:13 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:52:13 - mmengine - INFO - Saving checkpoint at 70 epochs 2022/09/23 15:52:37 - mmengine - INFO - Epoch(val) [70][50/407] eta: 0:02:00 time: 0.336653 data_time: 0.064117 memory: 6691 2022/09/23 15:52:53 - mmengine - INFO - Epoch(val) [70][100/407] eta: 0:01:39 time: 0.324417 data_time: 0.074652 memory: 1014 2022/09/23 15:53:09 - mmengine - INFO - Epoch(val) [70][150/407] eta: 0:01:23 time: 0.325872 data_time: 0.068447 memory: 1014 2022/09/23 15:53:25 - mmengine - INFO - Epoch(val) [70][200/407] eta: 0:01:05 time: 0.316883 data_time: 0.064422 memory: 1014 2022/09/23 15:53:41 - mmengine - INFO - Epoch(val) [70][250/407] eta: 0:00:50 time: 0.324154 data_time: 0.073461 memory: 1014 2022/09/23 15:53:57 - mmengine - INFO - Epoch(val) [70][300/407] eta: 0:00:33 time: 0.317473 data_time: 0.053831 memory: 1014 2022/09/23 15:54:14 - mmengine - INFO - Epoch(val) [70][350/407] eta: 0:00:18 time: 0.327266 data_time: 0.068909 memory: 1014 2022/09/23 15:54:25 - mmengine - INFO - Epoch(val) [70][400/407] eta: 0:00:01 time: 0.232466 data_time: 0.054643 memory: 1014 2022/09/23 15:54:58 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 15:55:11 - mmengine - INFO - Epoch(val) [70][407/407] coco/AP: 0.688270 coco/AP .5: 0.883723 coco/AP .75: 0.763639 coco/AP (M): 0.651391 coco/AP (L): 0.754798 coco/AR: 0.744710 coco/AR .5: 0.924118 coco/AR .75: 0.812028 coco/AR (M): 0.699973 coco/AR (L): 0.808287 2022/09/23 15:55:11 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_60.pth is removed 2022/09/23 15:55:14 - mmengine - INFO - The best checkpoint with 0.6883 coco/AP at 70 epoch is saved to best_coco/AP_epoch_70.pth. 2022/09/23 15:55:41 - mmengine - INFO - Epoch(train) [71][50/293] lr: 5.000000e-04 eta: 5:34:06 time: 0.546241 data_time: 0.299920 memory: 6691 loss_kpt: 0.000680 acc_pose: 0.811590 loss: 0.000680 2022/09/23 15:56:09 - mmengine - INFO - Epoch(train) [71][100/293] lr: 5.000000e-04 eta: 5:33:49 time: 0.569343 data_time: 0.162559 memory: 6691 loss_kpt: 0.000699 acc_pose: 0.810491 loss: 0.000699 2022/09/23 15:56:38 - mmengine - INFO - Epoch(train) [71][150/293] lr: 5.000000e-04 eta: 5:33:34 time: 0.578994 data_time: 0.114462 memory: 6691 loss_kpt: 0.000692 acc_pose: 0.723774 loss: 0.000692 2022/09/23 15:57:07 - mmengine - INFO - Epoch(train) [71][200/293] lr: 5.000000e-04 eta: 5:33:17 time: 0.566592 data_time: 0.091707 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.811723 loss: 0.000690 2022/09/23 15:57:34 - mmengine - INFO - Epoch(train) [71][250/293] lr: 5.000000e-04 eta: 5:32:59 time: 0.554706 data_time: 0.095533 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.768403 loss: 0.000691 2022/09/23 15:57:58 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:58:27 - mmengine - INFO - Epoch(train) [72][50/293] lr: 5.000000e-04 eta: 5:31:41 time: 0.578123 data_time: 0.105370 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.775499 loss: 0.000691 2022/09/23 15:58:54 - mmengine - INFO - Epoch(train) [72][100/293] lr: 5.000000e-04 eta: 5:31:22 time: 0.546730 data_time: 0.078030 memory: 6691 loss_kpt: 0.000695 acc_pose: 0.831099 loss: 0.000695 2022/09/23 15:59:23 - mmengine - INFO - Epoch(train) [72][150/293] lr: 5.000000e-04 eta: 5:31:05 time: 0.564774 data_time: 0.084155 memory: 6691 loss_kpt: 0.000689 acc_pose: 0.812412 loss: 0.000689 2022/09/23 15:59:50 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 15:59:51 - mmengine - INFO - Epoch(train) [72][200/293] lr: 5.000000e-04 eta: 5:30:48 time: 0.573583 data_time: 0.090587 memory: 6691 loss_kpt: 0.000680 acc_pose: 0.811489 loss: 0.000680 2022/09/23 16:00:19 - mmengine - INFO - Epoch(train) [72][250/293] lr: 5.000000e-04 eta: 5:30:31 time: 0.561809 data_time: 0.084599 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.810399 loss: 0.000691 2022/09/23 16:00:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:01:12 - mmengine - INFO - Epoch(train) [73][50/293] lr: 5.000000e-04 eta: 5:29:14 time: 0.584165 data_time: 0.215225 memory: 6691 loss_kpt: 0.000687 acc_pose: 0.749494 loss: 0.000687 2022/09/23 16:01:41 - mmengine - INFO - Epoch(train) [73][100/293] lr: 5.000000e-04 eta: 5:28:58 time: 0.577252 data_time: 0.167909 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.785846 loss: 0.000678 2022/09/23 16:02:09 - mmengine - INFO - Epoch(train) [73][150/293] lr: 5.000000e-04 eta: 5:28:39 time: 0.548394 data_time: 0.085569 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.800199 loss: 0.000690 2022/09/23 16:02:37 - mmengine - INFO - Epoch(train) [73][200/293] lr: 5.000000e-04 eta: 5:28:22 time: 0.568903 data_time: 0.093824 memory: 6691 loss_kpt: 0.000679 acc_pose: 0.764053 loss: 0.000679 2022/09/23 16:03:05 - mmengine - INFO - Epoch(train) [73][250/293] lr: 5.000000e-04 eta: 5:28:04 time: 0.559766 data_time: 0.091492 memory: 6691 loss_kpt: 0.000670 acc_pose: 0.836367 loss: 0.000670 2022/09/23 16:03:28 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:03:57 - mmengine - INFO - Epoch(train) [74][50/293] lr: 5.000000e-04 eta: 5:26:48 time: 0.583927 data_time: 0.110854 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.774359 loss: 0.000690 2022/09/23 16:04:26 - mmengine - INFO - Epoch(train) [74][100/293] lr: 5.000000e-04 eta: 5:26:31 time: 0.574645 data_time: 0.104025 memory: 6691 loss_kpt: 0.000689 acc_pose: 0.846026 loss: 0.000689 2022/09/23 16:04:54 - mmengine - INFO - Epoch(train) [74][150/293] lr: 5.000000e-04 eta: 5:26:13 time: 0.558896 data_time: 0.098428 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.801310 loss: 0.000691 2022/09/23 16:05:23 - mmengine - INFO - Epoch(train) [74][200/293] lr: 5.000000e-04 eta: 5:25:58 time: 0.582770 data_time: 0.107171 memory: 6691 loss_kpt: 0.000674 acc_pose: 0.795028 loss: 0.000674 2022/09/23 16:05:51 - mmengine - INFO - Epoch(train) [74][250/293] lr: 5.000000e-04 eta: 5:25:39 time: 0.559248 data_time: 0.089527 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.834903 loss: 0.000682 2022/09/23 16:06:15 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:06:45 - mmengine - INFO - Epoch(train) [75][50/293] lr: 5.000000e-04 eta: 5:24:25 time: 0.595728 data_time: 0.248304 memory: 6691 loss_kpt: 0.000703 acc_pose: 0.746223 loss: 0.000703 2022/09/23 16:07:13 - mmengine - INFO - Epoch(train) [75][100/293] lr: 5.000000e-04 eta: 5:24:06 time: 0.549958 data_time: 0.093424 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.845213 loss: 0.000666 2022/09/23 16:07:42 - mmengine - INFO - Epoch(train) [75][150/293] lr: 5.000000e-04 eta: 5:23:50 time: 0.586153 data_time: 0.110011 memory: 6691 loss_kpt: 0.000695 acc_pose: 0.755715 loss: 0.000695 2022/09/23 16:08:11 - mmengine - INFO - Epoch(train) [75][200/293] lr: 5.000000e-04 eta: 5:23:34 time: 0.578311 data_time: 0.127952 memory: 6691 loss_kpt: 0.000696 acc_pose: 0.813486 loss: 0.000696 2022/09/23 16:08:40 - mmengine - INFO - Epoch(train) [75][250/293] lr: 5.000000e-04 eta: 5:23:17 time: 0.574244 data_time: 0.108854 memory: 6691 loss_kpt: 0.000684 acc_pose: 0.791259 loss: 0.000684 2022/09/23 16:09:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:09:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:09:33 - mmengine - INFO - Epoch(train) [76][50/293] lr: 5.000000e-04 eta: 5:22:03 time: 0.590752 data_time: 0.154175 memory: 6691 loss_kpt: 0.000675 acc_pose: 0.828173 loss: 0.000675 2022/09/23 16:10:01 - mmengine - INFO - Epoch(train) [76][100/293] lr: 5.000000e-04 eta: 5:21:45 time: 0.565208 data_time: 0.098639 memory: 6691 loss_kpt: 0.000699 acc_pose: 0.771895 loss: 0.000699 2022/09/23 16:10:29 - mmengine - INFO - Epoch(train) [76][150/293] lr: 5.000000e-04 eta: 5:21:28 time: 0.566408 data_time: 0.097264 memory: 6691 loss_kpt: 0.000687 acc_pose: 0.843206 loss: 0.000687 2022/09/23 16:10:58 - mmengine - INFO - Epoch(train) [76][200/293] lr: 5.000000e-04 eta: 5:21:11 time: 0.573293 data_time: 0.150398 memory: 6691 loss_kpt: 0.000702 acc_pose: 0.821292 loss: 0.000702 2022/09/23 16:11:27 - mmengine - INFO - Epoch(train) [76][250/293] lr: 5.000000e-04 eta: 5:20:54 time: 0.580238 data_time: 0.181280 memory: 6691 loss_kpt: 0.000677 acc_pose: 0.811870 loss: 0.000677 2022/09/23 16:11:52 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:12:21 - mmengine - INFO - Epoch(train) [77][50/293] lr: 5.000000e-04 eta: 5:19:40 time: 0.591395 data_time: 0.173972 memory: 6691 loss_kpt: 0.000684 acc_pose: 0.802103 loss: 0.000684 2022/09/23 16:12:50 - mmengine - INFO - Epoch(train) [77][100/293] lr: 5.000000e-04 eta: 5:19:24 time: 0.583434 data_time: 0.244681 memory: 6691 loss_kpt: 0.000689 acc_pose: 0.755980 loss: 0.000689 2022/09/23 16:13:18 - mmengine - INFO - Epoch(train) [77][150/293] lr: 5.000000e-04 eta: 5:19:05 time: 0.548175 data_time: 0.226959 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.780131 loss: 0.000676 2022/09/23 16:13:45 - mmengine - INFO - Epoch(train) [77][200/293] lr: 5.000000e-04 eta: 5:18:45 time: 0.541380 data_time: 0.226351 memory: 6691 loss_kpt: 0.000679 acc_pose: 0.811829 loss: 0.000679 2022/09/23 16:14:13 - mmengine - INFO - Epoch(train) [77][250/293] lr: 5.000000e-04 eta: 5:18:26 time: 0.558060 data_time: 0.270723 memory: 6691 loss_kpt: 0.000685 acc_pose: 0.822839 loss: 0.000685 2022/09/23 16:14:37 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:15:07 - mmengine - INFO - Epoch(train) [78][50/293] lr: 5.000000e-04 eta: 5:17:14 time: 0.595747 data_time: 0.188438 memory: 6691 loss_kpt: 0.000675 acc_pose: 0.790783 loss: 0.000675 2022/09/23 16:15:36 - mmengine - INFO - Epoch(train) [78][100/293] lr: 5.000000e-04 eta: 5:16:57 time: 0.582688 data_time: 0.153975 memory: 6691 loss_kpt: 0.000675 acc_pose: 0.797775 loss: 0.000675 2022/09/23 16:16:05 - mmengine - INFO - Epoch(train) [78][150/293] lr: 5.000000e-04 eta: 5:16:41 time: 0.581879 data_time: 0.211202 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.718947 loss: 0.000676 2022/09/23 16:16:33 - mmengine - INFO - Epoch(train) [78][200/293] lr: 5.000000e-04 eta: 5:16:23 time: 0.572507 data_time: 0.100501 memory: 6691 loss_kpt: 0.000684 acc_pose: 0.782556 loss: 0.000684 2022/09/23 16:17:01 - mmengine - INFO - Epoch(train) [78][250/293] lr: 5.000000e-04 eta: 5:16:05 time: 0.557672 data_time: 0.123394 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.758675 loss: 0.000690 2022/09/23 16:17:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:17:55 - mmengine - INFO - Epoch(train) [79][50/293] lr: 5.000000e-04 eta: 5:14:52 time: 0.594006 data_time: 0.157702 memory: 6691 loss_kpt: 0.000683 acc_pose: 0.776324 loss: 0.000683 2022/09/23 16:18:24 - mmengine - INFO - Epoch(train) [79][100/293] lr: 5.000000e-04 eta: 5:14:36 time: 0.580469 data_time: 0.146502 memory: 6691 loss_kpt: 0.000679 acc_pose: 0.784893 loss: 0.000679 2022/09/23 16:18:49 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:18:52 - mmengine - INFO - Epoch(train) [79][150/293] lr: 5.000000e-04 eta: 5:14:17 time: 0.562125 data_time: 0.090135 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.747541 loss: 0.000668 2022/09/23 16:19:20 - mmengine - INFO - Epoch(train) [79][200/293] lr: 5.000000e-04 eta: 5:13:58 time: 0.557733 data_time: 0.093719 memory: 6691 loss_kpt: 0.000693 acc_pose: 0.794113 loss: 0.000693 2022/09/23 16:19:48 - mmengine - INFO - Epoch(train) [79][250/293] lr: 5.000000e-04 eta: 5:13:40 time: 0.559663 data_time: 0.084961 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.828153 loss: 0.000661 2022/09/23 16:20:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:20:40 - mmengine - INFO - Epoch(train) [80][50/293] lr: 5.000000e-04 eta: 5:12:28 time: 0.594212 data_time: 0.199770 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.824563 loss: 0.000676 2022/09/23 16:21:09 - mmengine - INFO - Epoch(train) [80][100/293] lr: 5.000000e-04 eta: 5:12:10 time: 0.567919 data_time: 0.100953 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.836036 loss: 0.000668 2022/09/23 16:21:37 - mmengine - INFO - Epoch(train) [80][150/293] lr: 5.000000e-04 eta: 5:11:51 time: 0.554189 data_time: 0.088397 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.816745 loss: 0.000668 2022/09/23 16:22:05 - mmengine - INFO - Epoch(train) [80][200/293] lr: 5.000000e-04 eta: 5:11:32 time: 0.559940 data_time: 0.131869 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.824536 loss: 0.000659 2022/09/23 16:22:32 - mmengine - INFO - Epoch(train) [80][250/293] lr: 5.000000e-04 eta: 5:11:12 time: 0.545501 data_time: 0.079775 memory: 6691 loss_kpt: 0.000687 acc_pose: 0.759426 loss: 0.000687 2022/09/23 16:22:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:22:55 - mmengine - INFO - Saving checkpoint at 80 epochs 2022/09/23 16:23:19 - mmengine - INFO - Epoch(val) [80][50/407] eta: 0:02:02 time: 0.344341 data_time: 0.074040 memory: 6691 2022/09/23 16:23:35 - mmengine - INFO - Epoch(val) [80][100/407] eta: 0:01:40 time: 0.328488 data_time: 0.077689 memory: 1014 2022/09/23 16:23:52 - mmengine - INFO - Epoch(val) [80][150/407] eta: 0:01:24 time: 0.328156 data_time: 0.078324 memory: 1014 2022/09/23 16:24:09 - mmengine - INFO - Epoch(val) [80][200/407] eta: 0:01:10 time: 0.339757 data_time: 0.071874 memory: 1014 2022/09/23 16:24:24 - mmengine - INFO - Epoch(val) [80][250/407] eta: 0:00:49 time: 0.313709 data_time: 0.071492 memory: 1014 2022/09/23 16:24:40 - mmengine - INFO - Epoch(val) [80][300/407] eta: 0:00:33 time: 0.315485 data_time: 0.043013 memory: 1014 2022/09/23 16:24:56 - mmengine - INFO - Epoch(val) [80][350/407] eta: 0:00:18 time: 0.325852 data_time: 0.064809 memory: 1014 2022/09/23 16:25:08 - mmengine - INFO - Epoch(val) [80][400/407] eta: 0:00:01 time: 0.231820 data_time: 0.052134 memory: 1014 2022/09/23 16:25:40 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 16:25:54 - mmengine - INFO - Epoch(val) [80][407/407] coco/AP: 0.692987 coco/AP .5: 0.885002 coco/AP .75: 0.766757 coco/AP (M): 0.656378 coco/AP (L): 0.761415 coco/AR: 0.750268 coco/AR .5: 0.925535 coco/AR .75: 0.818010 coco/AR (M): 0.705326 coco/AR (L): 0.814827 2022/09/23 16:25:54 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_70.pth is removed 2022/09/23 16:25:56 - mmengine - INFO - The best checkpoint with 0.6930 coco/AP at 80 epoch is saved to best_coco/AP_epoch_80.pth. 2022/09/23 16:26:23 - mmengine - INFO - Epoch(train) [81][50/293] lr: 5.000000e-04 eta: 5:09:58 time: 0.550620 data_time: 0.270495 memory: 6691 loss_kpt: 0.000685 acc_pose: 0.802801 loss: 0.000685 2022/09/23 16:26:50 - mmengine - INFO - Epoch(train) [81][100/293] lr: 5.000000e-04 eta: 5:09:37 time: 0.539598 data_time: 0.263942 memory: 6691 loss_kpt: 0.000673 acc_pose: 0.791488 loss: 0.000673 2022/09/23 16:27:18 - mmengine - INFO - Epoch(train) [81][150/293] lr: 5.000000e-04 eta: 5:09:18 time: 0.557903 data_time: 0.262974 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.813775 loss: 0.000676 2022/09/23 16:27:45 - mmengine - INFO - Epoch(train) [81][200/293] lr: 5.000000e-04 eta: 5:08:57 time: 0.531325 data_time: 0.240639 memory: 6691 loss_kpt: 0.000697 acc_pose: 0.813679 loss: 0.000697 2022/09/23 16:28:13 - mmengine - INFO - Epoch(train) [81][250/293] lr: 5.000000e-04 eta: 5:08:39 time: 0.564687 data_time: 0.254838 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.793556 loss: 0.000682 2022/09/23 16:28:36 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:29:06 - mmengine - INFO - Epoch(train) [82][50/293] lr: 5.000000e-04 eta: 5:07:28 time: 0.595518 data_time: 0.127595 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.802134 loss: 0.000678 2022/09/23 16:29:34 - mmengine - INFO - Epoch(train) [82][100/293] lr: 5.000000e-04 eta: 5:07:10 time: 0.568161 data_time: 0.095118 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.837528 loss: 0.000663 2022/09/23 16:30:03 - mmengine - INFO - Epoch(train) [82][150/293] lr: 5.000000e-04 eta: 5:06:53 time: 0.577763 data_time: 0.084681 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.823226 loss: 0.000682 2022/09/23 16:30:32 - mmengine - INFO - Epoch(train) [82][200/293] lr: 5.000000e-04 eta: 5:06:35 time: 0.568469 data_time: 0.080961 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.824750 loss: 0.000659 2022/09/23 16:30:59 - mmengine - INFO - Epoch(train) [82][250/293] lr: 5.000000e-04 eta: 5:06:15 time: 0.549092 data_time: 0.084080 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.789161 loss: 0.000682 2022/09/23 16:31:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:31:23 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:31:53 - mmengine - INFO - Epoch(train) [83][50/293] lr: 5.000000e-04 eta: 5:05:05 time: 0.592937 data_time: 0.211982 memory: 6691 loss_kpt: 0.000675 acc_pose: 0.804385 loss: 0.000675 2022/09/23 16:32:22 - mmengine - INFO - Epoch(train) [83][100/293] lr: 5.000000e-04 eta: 5:04:47 time: 0.575722 data_time: 0.087112 memory: 6691 loss_kpt: 0.000672 acc_pose: 0.804294 loss: 0.000672 2022/09/23 16:32:49 - mmengine - INFO - Epoch(train) [83][150/293] lr: 5.000000e-04 eta: 5:04:27 time: 0.548401 data_time: 0.091759 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.818144 loss: 0.000665 2022/09/23 16:33:16 - mmengine - INFO - Epoch(train) [83][200/293] lr: 5.000000e-04 eta: 5:04:07 time: 0.549814 data_time: 0.088723 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.841165 loss: 0.000668 2022/09/23 16:33:44 - mmengine - INFO - Epoch(train) [83][250/293] lr: 5.000000e-04 eta: 5:03:48 time: 0.551289 data_time: 0.205684 memory: 6691 loss_kpt: 0.000671 acc_pose: 0.816304 loss: 0.000671 2022/09/23 16:34:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:34:38 - mmengine - INFO - Epoch(train) [84][50/293] lr: 5.000000e-04 eta: 5:02:37 time: 0.581497 data_time: 0.121584 memory: 6691 loss_kpt: 0.000674 acc_pose: 0.776760 loss: 0.000674 2022/09/23 16:35:07 - mmengine - INFO - Epoch(train) [84][100/293] lr: 5.000000e-04 eta: 5:02:19 time: 0.572415 data_time: 0.084409 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.789308 loss: 0.000668 2022/09/23 16:35:34 - mmengine - INFO - Epoch(train) [84][150/293] lr: 5.000000e-04 eta: 5:01:59 time: 0.552093 data_time: 0.089137 memory: 6691 loss_kpt: 0.000680 acc_pose: 0.787268 loss: 0.000680 2022/09/23 16:36:03 - mmengine - INFO - Epoch(train) [84][200/293] lr: 5.000000e-04 eta: 5:01:41 time: 0.576424 data_time: 0.174762 memory: 6691 loss_kpt: 0.000687 acc_pose: 0.785128 loss: 0.000687 2022/09/23 16:36:31 - mmengine - INFO - Epoch(train) [84][250/293] lr: 5.000000e-04 eta: 5:01:23 time: 0.567887 data_time: 0.167372 memory: 6691 loss_kpt: 0.000677 acc_pose: 0.806685 loss: 0.000677 2022/09/23 16:36:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:37:25 - mmengine - INFO - Epoch(train) [85][50/293] lr: 5.000000e-04 eta: 5:00:14 time: 0.594005 data_time: 0.134150 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.837151 loss: 0.000666 2022/09/23 16:37:53 - mmengine - INFO - Epoch(train) [85][100/293] lr: 5.000000e-04 eta: 4:59:54 time: 0.552517 data_time: 0.091434 memory: 6691 loss_kpt: 0.000681 acc_pose: 0.824539 loss: 0.000681 2022/09/23 16:38:21 - mmengine - INFO - Epoch(train) [85][150/293] lr: 5.000000e-04 eta: 4:59:36 time: 0.575372 data_time: 0.092344 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.721027 loss: 0.000663 2022/09/23 16:38:49 - mmengine - INFO - Epoch(train) [85][200/293] lr: 5.000000e-04 eta: 4:59:16 time: 0.554230 data_time: 0.091050 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.804519 loss: 0.000669 2022/09/23 16:39:18 - mmengine - INFO - Epoch(train) [85][250/293] lr: 5.000000e-04 eta: 4:58:58 time: 0.570431 data_time: 0.086198 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.825878 loss: 0.000662 2022/09/23 16:39:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:40:11 - mmengine - INFO - Epoch(train) [86][50/293] lr: 5.000000e-04 eta: 4:57:50 time: 0.600694 data_time: 0.241244 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.847984 loss: 0.000661 2022/09/23 16:40:37 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:40:40 - mmengine - INFO - Epoch(train) [86][100/293] lr: 5.000000e-04 eta: 4:57:32 time: 0.581041 data_time: 0.230205 memory: 6691 loss_kpt: 0.000690 acc_pose: 0.821719 loss: 0.000690 2022/09/23 16:41:08 - mmengine - INFO - Epoch(train) [86][150/293] lr: 5.000000e-04 eta: 4:57:13 time: 0.566238 data_time: 0.265837 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.792244 loss: 0.000666 2022/09/23 16:41:38 - mmengine - INFO - Epoch(train) [86][200/293] lr: 5.000000e-04 eta: 4:56:56 time: 0.586246 data_time: 0.200484 memory: 6691 loss_kpt: 0.000675 acc_pose: 0.795745 loss: 0.000675 2022/09/23 16:42:06 - mmengine - INFO - Epoch(train) [86][250/293] lr: 5.000000e-04 eta: 4:56:38 time: 0.571787 data_time: 0.095024 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.822389 loss: 0.000668 2022/09/23 16:42:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:43:00 - mmengine - INFO - Epoch(train) [87][50/293] lr: 5.000000e-04 eta: 4:55:29 time: 0.592696 data_time: 0.152866 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.761781 loss: 0.000663 2022/09/23 16:43:28 - mmengine - INFO - Epoch(train) [87][100/293] lr: 5.000000e-04 eta: 4:55:10 time: 0.568299 data_time: 0.093980 memory: 6691 loss_kpt: 0.000680 acc_pose: 0.769992 loss: 0.000680 2022/09/23 16:43:56 - mmengine - INFO - Epoch(train) [87][150/293] lr: 5.000000e-04 eta: 4:54:51 time: 0.556231 data_time: 0.099257 memory: 6691 loss_kpt: 0.000681 acc_pose: 0.811247 loss: 0.000681 2022/09/23 16:44:25 - mmengine - INFO - Epoch(train) [87][200/293] lr: 5.000000e-04 eta: 4:54:33 time: 0.575143 data_time: 0.096765 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.827452 loss: 0.000678 2022/09/23 16:44:55 - mmengine - INFO - Epoch(train) [87][250/293] lr: 5.000000e-04 eta: 4:54:15 time: 0.590511 data_time: 0.139616 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.791689 loss: 0.000668 2022/09/23 16:45:19 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:45:49 - mmengine - INFO - Epoch(train) [88][50/293] lr: 5.000000e-04 eta: 4:53:08 time: 0.602392 data_time: 0.296519 memory: 6691 loss_kpt: 0.000671 acc_pose: 0.777417 loss: 0.000671 2022/09/23 16:46:18 - mmengine - INFO - Epoch(train) [88][100/293] lr: 5.000000e-04 eta: 4:52:49 time: 0.568139 data_time: 0.296041 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.806465 loss: 0.000660 2022/09/23 16:46:46 - mmengine - INFO - Epoch(train) [88][150/293] lr: 5.000000e-04 eta: 4:52:30 time: 0.565221 data_time: 0.108525 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.793454 loss: 0.000678 2022/09/23 16:47:15 - mmengine - INFO - Epoch(train) [88][200/293] lr: 5.000000e-04 eta: 4:52:12 time: 0.573040 data_time: 0.095366 memory: 6691 loss_kpt: 0.000688 acc_pose: 0.826638 loss: 0.000688 2022/09/23 16:47:42 - mmengine - INFO - Epoch(train) [88][250/293] lr: 5.000000e-04 eta: 4:51:52 time: 0.552994 data_time: 0.089912 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.787155 loss: 0.000668 2022/09/23 16:48:06 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:48:36 - mmengine - INFO - Epoch(train) [89][50/293] lr: 5.000000e-04 eta: 4:50:44 time: 0.591887 data_time: 0.132348 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.781035 loss: 0.000682 2022/09/23 16:49:04 - mmengine - INFO - Epoch(train) [89][100/293] lr: 5.000000e-04 eta: 4:50:25 time: 0.570977 data_time: 0.100543 memory: 6691 loss_kpt: 0.000685 acc_pose: 0.830838 loss: 0.000685 2022/09/23 16:49:33 - mmengine - INFO - Epoch(train) [89][150/293] lr: 5.000000e-04 eta: 4:50:06 time: 0.563603 data_time: 0.096041 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.796585 loss: 0.000678 2022/09/23 16:49:59 - mmengine - INFO - Epoch(train) [89][200/293] lr: 5.000000e-04 eta: 4:49:44 time: 0.531551 data_time: 0.091348 memory: 6691 loss_kpt: 0.000677 acc_pose: 0.823826 loss: 0.000677 2022/09/23 16:50:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:50:27 - mmengine - INFO - Epoch(train) [89][250/293] lr: 5.000000e-04 eta: 4:49:25 time: 0.556528 data_time: 0.083399 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.802543 loss: 0.000660 2022/09/23 16:50:51 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:51:20 - mmengine - INFO - Epoch(train) [90][50/293] lr: 5.000000e-04 eta: 4:48:17 time: 0.587952 data_time: 0.110421 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.786336 loss: 0.000658 2022/09/23 16:51:48 - mmengine - INFO - Epoch(train) [90][100/293] lr: 5.000000e-04 eta: 4:47:56 time: 0.542459 data_time: 0.094049 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.823336 loss: 0.000676 2022/09/23 16:52:15 - mmengine - INFO - Epoch(train) [90][150/293] lr: 5.000000e-04 eta: 4:47:35 time: 0.540529 data_time: 0.090465 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.812057 loss: 0.000666 2022/09/23 16:52:43 - mmengine - INFO - Epoch(train) [90][200/293] lr: 5.000000e-04 eta: 4:47:16 time: 0.558285 data_time: 0.086385 memory: 6691 loss_kpt: 0.000673 acc_pose: 0.815893 loss: 0.000673 2022/09/23 16:53:11 - mmengine - INFO - Epoch(train) [90][250/293] lr: 5.000000e-04 eta: 4:46:56 time: 0.562705 data_time: 0.102935 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.818271 loss: 0.000661 2022/09/23 16:53:34 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:53:34 - mmengine - INFO - Saving checkpoint at 90 epochs 2022/09/23 16:53:57 - mmengine - INFO - Epoch(val) [90][50/407] eta: 0:01:54 time: 0.320851 data_time: 0.070066 memory: 6691 2022/09/23 16:54:14 - mmengine - INFO - Epoch(val) [90][100/407] eta: 0:01:42 time: 0.333577 data_time: 0.082504 memory: 1014 2022/09/23 16:54:30 - mmengine - INFO - Epoch(val) [90][150/407] eta: 0:01:22 time: 0.320971 data_time: 0.052425 memory: 1014 2022/09/23 16:54:46 - mmengine - INFO - Epoch(val) [90][200/407] eta: 0:01:05 time: 0.317263 data_time: 0.068242 memory: 1014 2022/09/23 16:55:02 - mmengine - INFO - Epoch(val) [90][250/407] eta: 0:00:52 time: 0.331928 data_time: 0.094895 memory: 1014 2022/09/23 16:55:18 - mmengine - INFO - Epoch(val) [90][300/407] eta: 0:00:34 time: 0.324399 data_time: 0.047337 memory: 1014 2022/09/23 16:55:35 - mmengine - INFO - Epoch(val) [90][350/407] eta: 0:00:18 time: 0.322994 data_time: 0.054177 memory: 1014 2022/09/23 16:55:47 - mmengine - INFO - Epoch(val) [90][400/407] eta: 0:00:01 time: 0.242167 data_time: 0.054167 memory: 1014 2022/09/23 16:56:19 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 16:56:32 - mmengine - INFO - Epoch(val) [90][407/407] coco/AP: 0.696604 coco/AP .5: 0.886310 coco/AP .75: 0.771798 coco/AP (M): 0.659387 coco/AP (L): 0.763654 coco/AR: 0.752220 coco/AR .5: 0.924591 coco/AR .75: 0.820057 coco/AR (M): 0.709205 coco/AR (L): 0.813304 2022/09/23 16:56:32 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_80.pth is removed 2022/09/23 16:56:34 - mmengine - INFO - The best checkpoint with 0.6966 coco/AP at 90 epoch is saved to best_coco/AP_epoch_90.pth. 2022/09/23 16:57:02 - mmengine - INFO - Epoch(train) [91][50/293] lr: 5.000000e-04 eta: 4:45:47 time: 0.558870 data_time: 0.240250 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.819211 loss: 0.000648 2022/09/23 16:57:30 - mmengine - INFO - Epoch(train) [91][100/293] lr: 5.000000e-04 eta: 4:45:28 time: 0.564340 data_time: 0.115931 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.835089 loss: 0.000660 2022/09/23 16:57:59 - mmengine - INFO - Epoch(train) [91][150/293] lr: 5.000000e-04 eta: 4:45:09 time: 0.569176 data_time: 0.089481 memory: 6691 loss_kpt: 0.000671 acc_pose: 0.808265 loss: 0.000671 2022/09/23 16:58:26 - mmengine - INFO - Epoch(train) [91][200/293] lr: 5.000000e-04 eta: 4:44:48 time: 0.544086 data_time: 0.081564 memory: 6691 loss_kpt: 0.000672 acc_pose: 0.730198 loss: 0.000672 2022/09/23 16:58:54 - mmengine - INFO - Epoch(train) [91][250/293] lr: 5.000000e-04 eta: 4:44:28 time: 0.560147 data_time: 0.116137 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.858157 loss: 0.000660 2022/09/23 16:59:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 16:59:47 - mmengine - INFO - Epoch(train) [92][50/293] lr: 5.000000e-04 eta: 4:43:22 time: 0.589543 data_time: 0.209981 memory: 6691 loss_kpt: 0.000670 acc_pose: 0.840371 loss: 0.000670 2022/09/23 17:00:16 - mmengine - INFO - Epoch(train) [92][100/293] lr: 5.000000e-04 eta: 4:43:03 time: 0.568295 data_time: 0.206346 memory: 6691 loss_kpt: 0.000667 acc_pose: 0.826250 loss: 0.000667 2022/09/23 17:00:42 - mmengine - INFO - Epoch(train) [92][150/293] lr: 5.000000e-04 eta: 4:42:41 time: 0.531884 data_time: 0.085555 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.798551 loss: 0.000665 2022/09/23 17:01:12 - mmengine - INFO - Epoch(train) [92][200/293] lr: 5.000000e-04 eta: 4:42:24 time: 0.593544 data_time: 0.106450 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.816384 loss: 0.000662 2022/09/23 17:01:40 - mmengine - INFO - Epoch(train) [92][250/293] lr: 5.000000e-04 eta: 4:42:04 time: 0.557572 data_time: 0.200146 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.807823 loss: 0.000668 2022/09/23 17:02:02 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:02:29 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:02:32 - mmengine - INFO - Epoch(train) [93][50/293] lr: 5.000000e-04 eta: 4:40:58 time: 0.592651 data_time: 0.143802 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.824023 loss: 0.000661 2022/09/23 17:03:01 - mmengine - INFO - Epoch(train) [93][100/293] lr: 5.000000e-04 eta: 4:40:39 time: 0.570227 data_time: 0.096590 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.804685 loss: 0.000658 2022/09/23 17:03:29 - mmengine - INFO - Epoch(train) [93][150/293] lr: 5.000000e-04 eta: 4:40:19 time: 0.562839 data_time: 0.106973 memory: 6691 loss_kpt: 0.000674 acc_pose: 0.836737 loss: 0.000674 2022/09/23 17:03:57 - mmengine - INFO - Epoch(train) [93][200/293] lr: 5.000000e-04 eta: 4:40:00 time: 0.574193 data_time: 0.118510 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.817809 loss: 0.000661 2022/09/23 17:04:25 - mmengine - INFO - Epoch(train) [93][250/293] lr: 5.000000e-04 eta: 4:39:40 time: 0.553653 data_time: 0.089832 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.828267 loss: 0.000666 2022/09/23 17:04:49 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:05:18 - mmengine - INFO - Epoch(train) [94][50/293] lr: 5.000000e-04 eta: 4:38:34 time: 0.584783 data_time: 0.145811 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.823572 loss: 0.000660 2022/09/23 17:05:47 - mmengine - INFO - Epoch(train) [94][100/293] lr: 5.000000e-04 eta: 4:38:15 time: 0.582474 data_time: 0.229520 memory: 6691 loss_kpt: 0.000682 acc_pose: 0.762181 loss: 0.000682 2022/09/23 17:06:15 - mmengine - INFO - Epoch(train) [94][150/293] lr: 5.000000e-04 eta: 4:37:56 time: 0.565800 data_time: 0.244060 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.795692 loss: 0.000661 2022/09/23 17:06:44 - mmengine - INFO - Epoch(train) [94][200/293] lr: 5.000000e-04 eta: 4:37:36 time: 0.563669 data_time: 0.241947 memory: 6691 loss_kpt: 0.000691 acc_pose: 0.805023 loss: 0.000691 2022/09/23 17:07:13 - mmengine - INFO - Epoch(train) [94][250/293] lr: 5.000000e-04 eta: 4:37:17 time: 0.578958 data_time: 0.100546 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.791167 loss: 0.000660 2022/09/23 17:07:37 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:08:06 - mmengine - INFO - Epoch(train) [95][50/293] lr: 5.000000e-04 eta: 4:36:11 time: 0.583407 data_time: 0.111784 memory: 6691 loss_kpt: 0.000656 acc_pose: 0.810092 loss: 0.000656 2022/09/23 17:08:35 - mmengine - INFO - Epoch(train) [95][100/293] lr: 5.000000e-04 eta: 4:35:53 time: 0.579709 data_time: 0.125699 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.820861 loss: 0.000663 2022/09/23 17:09:03 - mmengine - INFO - Epoch(train) [95][150/293] lr: 5.000000e-04 eta: 4:35:33 time: 0.565222 data_time: 0.106427 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.815611 loss: 0.000662 2022/09/23 17:09:32 - mmengine - INFO - Epoch(train) [95][200/293] lr: 5.000000e-04 eta: 4:35:14 time: 0.581125 data_time: 0.203585 memory: 6691 loss_kpt: 0.000673 acc_pose: 0.784791 loss: 0.000673 2022/09/23 17:10:00 - mmengine - INFO - Epoch(train) [95][250/293] lr: 5.000000e-04 eta: 4:34:54 time: 0.564881 data_time: 0.098975 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.832722 loss: 0.000669 2022/09/23 17:10:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:10:55 - mmengine - INFO - Epoch(train) [96][50/293] lr: 5.000000e-04 eta: 4:33:50 time: 0.591770 data_time: 0.112385 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.801844 loss: 0.000669 2022/09/23 17:11:23 - mmengine - INFO - Epoch(train) [96][100/293] lr: 5.000000e-04 eta: 4:33:30 time: 0.562389 data_time: 0.084550 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.803269 loss: 0.000655 2022/09/23 17:11:51 - mmengine - INFO - Epoch(train) [96][150/293] lr: 5.000000e-04 eta: 4:33:09 time: 0.553834 data_time: 0.110177 memory: 6691 loss_kpt: 0.000667 acc_pose: 0.800257 loss: 0.000667 2022/09/23 17:11:58 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:12:17 - mmengine - INFO - Epoch(train) [96][200/293] lr: 5.000000e-04 eta: 4:32:47 time: 0.526743 data_time: 0.087785 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.803063 loss: 0.000665 2022/09/23 17:12:45 - mmengine - INFO - Epoch(train) [96][250/293] lr: 5.000000e-04 eta: 4:32:27 time: 0.563589 data_time: 0.169026 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.769018 loss: 0.000666 2022/09/23 17:13:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:13:39 - mmengine - INFO - Epoch(train) [97][50/293] lr: 5.000000e-04 eta: 4:31:23 time: 0.597079 data_time: 0.181230 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.848410 loss: 0.000658 2022/09/23 17:14:07 - mmengine - INFO - Epoch(train) [97][100/293] lr: 5.000000e-04 eta: 4:31:03 time: 0.558058 data_time: 0.259856 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.826549 loss: 0.000659 2022/09/23 17:14:35 - mmengine - INFO - Epoch(train) [97][150/293] lr: 5.000000e-04 eta: 4:30:43 time: 0.565730 data_time: 0.251816 memory: 6691 loss_kpt: 0.000678 acc_pose: 0.848461 loss: 0.000678 2022/09/23 17:15:05 - mmengine - INFO - Epoch(train) [97][200/293] lr: 5.000000e-04 eta: 4:30:24 time: 0.584338 data_time: 0.161932 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.819068 loss: 0.000654 2022/09/23 17:15:33 - mmengine - INFO - Epoch(train) [97][250/293] lr: 5.000000e-04 eta: 4:30:04 time: 0.562244 data_time: 0.099262 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.810645 loss: 0.000663 2022/09/23 17:15:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:16:26 - mmengine - INFO - Epoch(train) [98][50/293] lr: 5.000000e-04 eta: 4:28:59 time: 0.570752 data_time: 0.179609 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.840765 loss: 0.000651 2022/09/23 17:16:55 - mmengine - INFO - Epoch(train) [98][100/293] lr: 5.000000e-04 eta: 4:28:40 time: 0.581140 data_time: 0.172701 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.819214 loss: 0.000668 2022/09/23 17:17:23 - mmengine - INFO - Epoch(train) [98][150/293] lr: 5.000000e-04 eta: 4:28:20 time: 0.562630 data_time: 0.087464 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.761265 loss: 0.000669 2022/09/23 17:17:51 - mmengine - INFO - Epoch(train) [98][200/293] lr: 5.000000e-04 eta: 4:28:00 time: 0.564570 data_time: 0.077248 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.833642 loss: 0.000665 2022/09/23 17:18:20 - mmengine - INFO - Epoch(train) [98][250/293] lr: 5.000000e-04 eta: 4:27:40 time: 0.569335 data_time: 0.079532 memory: 6691 loss_kpt: 0.000676 acc_pose: 0.802063 loss: 0.000676 2022/09/23 17:18:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:19:13 - mmengine - INFO - Epoch(train) [99][50/293] lr: 5.000000e-04 eta: 4:26:37 time: 0.596969 data_time: 0.231716 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.777870 loss: 0.000665 2022/09/23 17:19:42 - mmengine - INFO - Epoch(train) [99][100/293] lr: 5.000000e-04 eta: 4:26:18 time: 0.580208 data_time: 0.092664 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.751941 loss: 0.000668 2022/09/23 17:20:10 - mmengine - INFO - Epoch(train) [99][150/293] lr: 5.000000e-04 eta: 4:25:57 time: 0.561847 data_time: 0.089333 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.810474 loss: 0.000654 2022/09/23 17:20:38 - mmengine - INFO - Epoch(train) [99][200/293] lr: 5.000000e-04 eta: 4:25:37 time: 0.569330 data_time: 0.103051 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.830460 loss: 0.000646 2022/09/23 17:21:06 - mmengine - INFO - Epoch(train) [99][250/293] lr: 5.000000e-04 eta: 4:25:17 time: 0.557466 data_time: 0.095242 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.832678 loss: 0.000665 2022/09/23 17:21:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:21:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:21:59 - mmengine - INFO - Epoch(train) [100][50/293] lr: 5.000000e-04 eta: 4:24:13 time: 0.577730 data_time: 0.156308 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.828845 loss: 0.000665 2022/09/23 17:22:27 - mmengine - INFO - Epoch(train) [100][100/293] lr: 5.000000e-04 eta: 4:23:53 time: 0.566436 data_time: 0.112345 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.800659 loss: 0.000662 2022/09/23 17:22:55 - mmengine - INFO - Epoch(train) [100][150/293] lr: 5.000000e-04 eta: 4:23:32 time: 0.554014 data_time: 0.160911 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.871091 loss: 0.000666 2022/09/23 17:23:24 - mmengine - INFO - Epoch(train) [100][200/293] lr: 5.000000e-04 eta: 4:23:13 time: 0.577897 data_time: 0.261057 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.797470 loss: 0.000645 2022/09/23 17:23:52 - mmengine - INFO - Epoch(train) [100][250/293] lr: 5.000000e-04 eta: 4:22:53 time: 0.570152 data_time: 0.194708 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.836819 loss: 0.000660 2022/09/23 17:24:16 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:24:16 - mmengine - INFO - Saving checkpoint at 100 epochs 2022/09/23 17:24:38 - mmengine - INFO - Epoch(val) [100][50/407] eta: 0:01:57 time: 0.328703 data_time: 0.082948 memory: 6691 2022/09/23 17:24:55 - mmengine - INFO - Epoch(val) [100][100/407] eta: 0:01:40 time: 0.327429 data_time: 0.077392 memory: 1014 2022/09/23 17:25:10 - mmengine - INFO - Epoch(val) [100][150/407] eta: 0:01:18 time: 0.306360 data_time: 0.049340 memory: 1014 2022/09/23 17:25:25 - mmengine - INFO - Epoch(val) [100][200/407] eta: 0:01:04 time: 0.312229 data_time: 0.041659 memory: 1014 2022/09/23 17:25:41 - mmengine - INFO - Epoch(val) [100][250/407] eta: 0:00:48 time: 0.309974 data_time: 0.057381 memory: 1014 2022/09/23 17:25:57 - mmengine - INFO - Epoch(val) [100][300/407] eta: 0:00:34 time: 0.324769 data_time: 0.078527 memory: 1014 2022/09/23 17:26:14 - mmengine - INFO - Epoch(val) [100][350/407] eta: 0:00:18 time: 0.332287 data_time: 0.089905 memory: 1014 2022/09/23 17:26:27 - mmengine - INFO - Epoch(val) [100][400/407] eta: 0:00:01 time: 0.257991 data_time: 0.056707 memory: 1014 2022/09/23 17:26:59 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 17:27:12 - mmengine - INFO - Epoch(val) [100][407/407] coco/AP: 0.699157 coco/AP .5: 0.888236 coco/AP .75: 0.776170 coco/AP (M): 0.664820 coco/AP (L): 0.764073 coco/AR: 0.756250 coco/AR .5: 0.928054 coco/AR .75: 0.825252 coco/AR (M): 0.714149 coco/AR (L): 0.816871 2022/09/23 17:27:12 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_90.pth is removed 2022/09/23 17:27:15 - mmengine - INFO - The best checkpoint with 0.6992 coco/AP at 100 epoch is saved to best_coco/AP_epoch_100.pth. 2022/09/23 17:27:42 - mmengine - INFO - Epoch(train) [101][50/293] lr: 5.000000e-04 eta: 4:21:47 time: 0.542861 data_time: 0.316539 memory: 6691 loss_kpt: 0.000657 acc_pose: 0.792721 loss: 0.000657 2022/09/23 17:28:09 - mmengine - INFO - Epoch(train) [101][100/293] lr: 5.000000e-04 eta: 4:21:26 time: 0.551567 data_time: 0.150987 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.779767 loss: 0.000648 2022/09/23 17:28:37 - mmengine - INFO - Epoch(train) [101][150/293] lr: 5.000000e-04 eta: 4:21:05 time: 0.555494 data_time: 0.082547 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.844446 loss: 0.000650 2022/09/23 17:29:05 - mmengine - INFO - Epoch(train) [101][200/293] lr: 5.000000e-04 eta: 4:20:45 time: 0.560365 data_time: 0.087536 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.823170 loss: 0.000669 2022/09/23 17:29:33 - mmengine - INFO - Epoch(train) [101][250/293] lr: 5.000000e-04 eta: 4:20:24 time: 0.558766 data_time: 0.087426 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.809044 loss: 0.000659 2022/09/23 17:29:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:30:27 - mmengine - INFO - Epoch(train) [102][50/293] lr: 5.000000e-04 eta: 4:19:22 time: 0.589348 data_time: 0.168983 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.827423 loss: 0.000658 2022/09/23 17:30:55 - mmengine - INFO - Epoch(train) [102][100/293] lr: 5.000000e-04 eta: 4:19:01 time: 0.555977 data_time: 0.091397 memory: 6691 loss_kpt: 0.000656 acc_pose: 0.815726 loss: 0.000656 2022/09/23 17:31:22 - mmengine - INFO - Epoch(train) [102][150/293] lr: 5.000000e-04 eta: 4:18:40 time: 0.551692 data_time: 0.092579 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.796526 loss: 0.000663 2022/09/23 17:31:50 - mmengine - INFO - Epoch(train) [102][200/293] lr: 5.000000e-04 eta: 4:18:19 time: 0.556972 data_time: 0.098417 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.799349 loss: 0.000661 2022/09/23 17:32:18 - mmengine - INFO - Epoch(train) [102][250/293] lr: 5.000000e-04 eta: 4:17:59 time: 0.566323 data_time: 0.234208 memory: 6691 loss_kpt: 0.000653 acc_pose: 0.799835 loss: 0.000653 2022/09/23 17:32:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:33:11 - mmengine - INFO - Epoch(train) [103][50/293] lr: 5.000000e-04 eta: 4:16:56 time: 0.579970 data_time: 0.118316 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.850442 loss: 0.000658 2022/09/23 17:33:38 - mmengine - INFO - Epoch(train) [103][100/293] lr: 5.000000e-04 eta: 4:16:35 time: 0.552709 data_time: 0.134501 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.813449 loss: 0.000650 2022/09/23 17:33:46 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:34:06 - mmengine - INFO - Epoch(train) [103][150/293] lr: 5.000000e-04 eta: 4:16:14 time: 0.556379 data_time: 0.096565 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.786716 loss: 0.000650 2022/09/23 17:34:34 - mmengine - INFO - Epoch(train) [103][200/293] lr: 5.000000e-04 eta: 4:15:53 time: 0.556902 data_time: 0.209552 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.789205 loss: 0.000658 2022/09/23 17:35:03 - mmengine - INFO - Epoch(train) [103][250/293] lr: 5.000000e-04 eta: 4:15:33 time: 0.572706 data_time: 0.114810 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.784599 loss: 0.000645 2022/09/23 17:35:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:35:55 - mmengine - INFO - Epoch(train) [104][50/293] lr: 5.000000e-04 eta: 4:14:32 time: 0.591163 data_time: 0.131184 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.801626 loss: 0.000655 2022/09/23 17:36:23 - mmengine - INFO - Epoch(train) [104][100/293] lr: 5.000000e-04 eta: 4:14:11 time: 0.560330 data_time: 0.082271 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.829133 loss: 0.000651 2022/09/23 17:36:51 - mmengine - INFO - Epoch(train) [104][150/293] lr: 5.000000e-04 eta: 4:13:50 time: 0.546482 data_time: 0.090567 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.786260 loss: 0.000641 2022/09/23 17:37:18 - mmengine - INFO - Epoch(train) [104][200/293] lr: 5.000000e-04 eta: 4:13:28 time: 0.553194 data_time: 0.087565 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.769523 loss: 0.000655 2022/09/23 17:37:45 - mmengine - INFO - Epoch(train) [104][250/293] lr: 5.000000e-04 eta: 4:13:06 time: 0.535098 data_time: 0.092047 memory: 6691 loss_kpt: 0.000665 acc_pose: 0.786562 loss: 0.000665 2022/09/23 17:38:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:38:38 - mmengine - INFO - Epoch(train) [105][50/293] lr: 5.000000e-04 eta: 4:12:04 time: 0.581039 data_time: 0.108756 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.839613 loss: 0.000651 2022/09/23 17:39:05 - mmengine - INFO - Epoch(train) [105][100/293] lr: 5.000000e-04 eta: 4:11:43 time: 0.544452 data_time: 0.109486 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.839651 loss: 0.000649 2022/09/23 17:39:34 - mmengine - INFO - Epoch(train) [105][150/293] lr: 5.000000e-04 eta: 4:11:23 time: 0.571033 data_time: 0.101773 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.860056 loss: 0.000660 2022/09/23 17:40:03 - mmengine - INFO - Epoch(train) [105][200/293] lr: 5.000000e-04 eta: 4:11:03 time: 0.585891 data_time: 0.085729 memory: 6691 loss_kpt: 0.000668 acc_pose: 0.834623 loss: 0.000668 2022/09/23 17:40:31 - mmengine - INFO - Epoch(train) [105][250/293] lr: 5.000000e-04 eta: 4:10:42 time: 0.561625 data_time: 0.110799 memory: 6691 loss_kpt: 0.000667 acc_pose: 0.844516 loss: 0.000667 2022/09/23 17:40:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:41:25 - mmengine - INFO - Epoch(train) [106][50/293] lr: 5.000000e-04 eta: 4:09:40 time: 0.571508 data_time: 0.226437 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.777195 loss: 0.000662 2022/09/23 17:41:54 - mmengine - INFO - Epoch(train) [106][100/293] lr: 5.000000e-04 eta: 4:09:21 time: 0.589396 data_time: 0.126910 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.797222 loss: 0.000647 2022/09/23 17:42:22 - mmengine - INFO - Epoch(train) [106][150/293] lr: 5.000000e-04 eta: 4:09:01 time: 0.568288 data_time: 0.111181 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.823254 loss: 0.000658 2022/09/23 17:42:50 - mmengine - INFO - Epoch(train) [106][200/293] lr: 5.000000e-04 eta: 4:08:40 time: 0.558012 data_time: 0.104066 memory: 6691 loss_kpt: 0.000657 acc_pose: 0.779745 loss: 0.000657 2022/09/23 17:43:10 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:43:19 - mmengine - INFO - Epoch(train) [106][250/293] lr: 5.000000e-04 eta: 4:08:19 time: 0.566197 data_time: 0.090647 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.778045 loss: 0.000651 2022/09/23 17:43:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:44:11 - mmengine - INFO - Epoch(train) [107][50/293] lr: 5.000000e-04 eta: 4:07:17 time: 0.569082 data_time: 0.256277 memory: 6691 loss_kpt: 0.000664 acc_pose: 0.807182 loss: 0.000664 2022/09/23 17:44:40 - mmengine - INFO - Epoch(train) [107][100/293] lr: 5.000000e-04 eta: 4:06:57 time: 0.578959 data_time: 0.125278 memory: 6691 loss_kpt: 0.000666 acc_pose: 0.797540 loss: 0.000666 2022/09/23 17:45:08 - mmengine - INFO - Epoch(train) [107][150/293] lr: 5.000000e-04 eta: 4:06:36 time: 0.551617 data_time: 0.112868 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.823000 loss: 0.000647 2022/09/23 17:45:36 - mmengine - INFO - Epoch(train) [107][200/293] lr: 5.000000e-04 eta: 4:06:15 time: 0.570415 data_time: 0.157546 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.795174 loss: 0.000648 2022/09/23 17:46:05 - mmengine - INFO - Epoch(train) [107][250/293] lr: 5.000000e-04 eta: 4:05:55 time: 0.575564 data_time: 0.219299 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.802622 loss: 0.000650 2022/09/23 17:46:29 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:46:59 - mmengine - INFO - Epoch(train) [108][50/293] lr: 5.000000e-04 eta: 4:04:55 time: 0.599472 data_time: 0.141753 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.838445 loss: 0.000654 2022/09/23 17:47:27 - mmengine - INFO - Epoch(train) [108][100/293] lr: 5.000000e-04 eta: 4:04:34 time: 0.566215 data_time: 0.119580 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.781658 loss: 0.000652 2022/09/23 17:47:56 - mmengine - INFO - Epoch(train) [108][150/293] lr: 5.000000e-04 eta: 4:04:14 time: 0.575637 data_time: 0.110377 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.740674 loss: 0.000660 2022/09/23 17:48:22 - mmengine - INFO - Epoch(train) [108][200/293] lr: 5.000000e-04 eta: 4:03:52 time: 0.525628 data_time: 0.119167 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.796376 loss: 0.000659 2022/09/23 17:48:50 - mmengine - INFO - Epoch(train) [108][250/293] lr: 5.000000e-04 eta: 4:03:31 time: 0.562709 data_time: 0.102025 memory: 6691 loss_kpt: 0.000657 acc_pose: 0.838510 loss: 0.000657 2022/09/23 17:49:15 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:49:44 - mmengine - INFO - Epoch(train) [109][50/293] lr: 5.000000e-04 eta: 4:02:30 time: 0.583119 data_time: 0.226060 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.820772 loss: 0.000659 2022/09/23 17:50:13 - mmengine - INFO - Epoch(train) [109][100/293] lr: 5.000000e-04 eta: 4:02:10 time: 0.571414 data_time: 0.222701 memory: 6691 loss_kpt: 0.000656 acc_pose: 0.817367 loss: 0.000656 2022/09/23 17:50:41 - mmengine - INFO - Epoch(train) [109][150/293] lr: 5.000000e-04 eta: 4:01:49 time: 0.561127 data_time: 0.201971 memory: 6691 loss_kpt: 0.000663 acc_pose: 0.790354 loss: 0.000663 2022/09/23 17:51:10 - mmengine - INFO - Epoch(train) [109][200/293] lr: 5.000000e-04 eta: 4:01:28 time: 0.573511 data_time: 0.150316 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.836470 loss: 0.000658 2022/09/23 17:51:38 - mmengine - INFO - Epoch(train) [109][250/293] lr: 5.000000e-04 eta: 4:01:08 time: 0.570261 data_time: 0.093996 memory: 6691 loss_kpt: 0.000661 acc_pose: 0.843470 loss: 0.000661 2022/09/23 17:52:02 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:52:31 - mmengine - INFO - Epoch(train) [110][50/293] lr: 5.000000e-04 eta: 4:00:07 time: 0.581946 data_time: 0.180431 memory: 6691 loss_kpt: 0.000669 acc_pose: 0.817817 loss: 0.000669 2022/09/23 17:52:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:52:59 - mmengine - INFO - Epoch(train) [110][100/293] lr: 5.000000e-04 eta: 3:59:46 time: 0.566980 data_time: 0.109853 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.784075 loss: 0.000645 2022/09/23 17:53:27 - mmengine - INFO - Epoch(train) [110][150/293] lr: 5.000000e-04 eta: 3:59:25 time: 0.549825 data_time: 0.106024 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.786883 loss: 0.000658 2022/09/23 17:53:56 - mmengine - INFO - Epoch(train) [110][200/293] lr: 5.000000e-04 eta: 3:59:05 time: 0.584398 data_time: 0.129831 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.823376 loss: 0.000649 2022/09/23 17:54:25 - mmengine - INFO - Epoch(train) [110][250/293] lr: 5.000000e-04 eta: 3:58:45 time: 0.589179 data_time: 0.119266 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.837726 loss: 0.000652 2022/09/23 17:54:50 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 17:54:50 - mmengine - INFO - Saving checkpoint at 110 epochs 2022/09/23 17:55:14 - mmengine - INFO - Epoch(val) [110][50/407] eta: 0:01:58 time: 0.333101 data_time: 0.083940 memory: 6691 2022/09/23 17:55:30 - mmengine - INFO - Epoch(val) [110][100/407] eta: 0:01:40 time: 0.326454 data_time: 0.058806 memory: 1014 2022/09/23 17:55:46 - mmengine - INFO - Epoch(val) [110][150/407] eta: 0:01:21 time: 0.315926 data_time: 0.044883 memory: 1014 2022/09/23 17:56:02 - mmengine - INFO - Epoch(val) [110][200/407] eta: 0:01:06 time: 0.322209 data_time: 0.078418 memory: 1014 2022/09/23 17:56:19 - mmengine - INFO - Epoch(val) [110][250/407] eta: 0:00:51 time: 0.330743 data_time: 0.081439 memory: 1014 2022/09/23 17:56:36 - mmengine - INFO - Epoch(val) [110][300/407] eta: 0:00:36 time: 0.339376 data_time: 0.099953 memory: 1014 2022/09/23 17:56:52 - mmengine - INFO - Epoch(val) [110][350/407] eta: 0:00:18 time: 0.323402 data_time: 0.078321 memory: 1014 2022/09/23 17:57:03 - mmengine - INFO - Epoch(val) [110][400/407] eta: 0:00:01 time: 0.214533 data_time: 0.066564 memory: 1014 2022/09/23 17:57:35 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 17:57:49 - mmengine - INFO - Epoch(val) [110][407/407] coco/AP: 0.697708 coco/AP .5: 0.886650 coco/AP .75: 0.770552 coco/AP (M): 0.663096 coco/AP (L): 0.763146 coco/AR: 0.754408 coco/AR .5: 0.928369 coco/AR .75: 0.820529 coco/AR (M): 0.712128 coco/AR (L): 0.814902 2022/09/23 17:58:18 - mmengine - INFO - Epoch(train) [111][50/293] lr: 5.000000e-04 eta: 3:57:45 time: 0.579056 data_time: 0.096395 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.795464 loss: 0.000652 2022/09/23 17:58:46 - mmengine - INFO - Epoch(train) [111][100/293] lr: 5.000000e-04 eta: 3:57:24 time: 0.576494 data_time: 0.137536 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.806069 loss: 0.000652 2022/09/23 17:59:14 - mmengine - INFO - Epoch(train) [111][150/293] lr: 5.000000e-04 eta: 3:57:03 time: 0.560396 data_time: 0.202204 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.834950 loss: 0.000654 2022/09/23 17:59:42 - mmengine - INFO - Epoch(train) [111][200/293] lr: 5.000000e-04 eta: 3:56:41 time: 0.543456 data_time: 0.113122 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.774096 loss: 0.000660 2022/09/23 18:00:11 - mmengine - INFO - Epoch(train) [111][250/293] lr: 5.000000e-04 eta: 3:56:21 time: 0.586564 data_time: 0.107305 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.809190 loss: 0.000637 2022/09/23 18:00:34 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:01:03 - mmengine - INFO - Epoch(train) [112][50/293] lr: 5.000000e-04 eta: 3:55:21 time: 0.574240 data_time: 0.129029 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.832772 loss: 0.000650 2022/09/23 18:01:31 - mmengine - INFO - Epoch(train) [112][100/293] lr: 5.000000e-04 eta: 3:55:00 time: 0.566059 data_time: 0.080426 memory: 6691 loss_kpt: 0.000662 acc_pose: 0.864177 loss: 0.000662 2022/09/23 18:01:59 - mmengine - INFO - Epoch(train) [112][150/293] lr: 5.000000e-04 eta: 3:54:39 time: 0.558485 data_time: 0.084208 memory: 6691 loss_kpt: 0.000653 acc_pose: 0.794506 loss: 0.000653 2022/09/23 18:02:28 - mmengine - INFO - Epoch(train) [112][200/293] lr: 5.000000e-04 eta: 3:54:18 time: 0.571924 data_time: 0.089746 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.787236 loss: 0.000648 2022/09/23 18:02:57 - mmengine - INFO - Epoch(train) [112][250/293] lr: 5.000000e-04 eta: 3:53:58 time: 0.578417 data_time: 0.102098 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.791377 loss: 0.000647 2022/09/23 18:03:21 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:03:51 - mmengine - INFO - Epoch(train) [113][50/293] lr: 5.000000e-04 eta: 3:52:59 time: 0.596876 data_time: 0.198248 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.848369 loss: 0.000642 2022/09/23 18:04:19 - mmengine - INFO - Epoch(train) [113][100/293] lr: 5.000000e-04 eta: 3:52:37 time: 0.548667 data_time: 0.085437 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.805576 loss: 0.000646 2022/09/23 18:04:47 - mmengine - INFO - Epoch(train) [113][150/293] lr: 5.000000e-04 eta: 3:52:17 time: 0.575707 data_time: 0.123854 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.837452 loss: 0.000641 2022/09/23 18:05:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:05:16 - mmengine - INFO - Epoch(train) [113][200/293] lr: 5.000000e-04 eta: 3:51:56 time: 0.575799 data_time: 0.096608 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.775270 loss: 0.000655 2022/09/23 18:05:44 - mmengine - INFO - Epoch(train) [113][250/293] lr: 5.000000e-04 eta: 3:51:35 time: 0.560232 data_time: 0.104499 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.839606 loss: 0.000654 2022/09/23 18:06:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:06:39 - mmengine - INFO - Epoch(train) [114][50/293] lr: 5.000000e-04 eta: 3:50:35 time: 0.585509 data_time: 0.119882 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.782005 loss: 0.000640 2022/09/23 18:07:07 - mmengine - INFO - Epoch(train) [114][100/293] lr: 5.000000e-04 eta: 3:50:15 time: 0.572015 data_time: 0.097618 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.886932 loss: 0.000642 2022/09/23 18:07:35 - mmengine - INFO - Epoch(train) [114][150/293] lr: 5.000000e-04 eta: 3:49:53 time: 0.557372 data_time: 0.101315 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.805522 loss: 0.000643 2022/09/23 18:08:03 - mmengine - INFO - Epoch(train) [114][200/293] lr: 5.000000e-04 eta: 3:49:32 time: 0.561805 data_time: 0.094383 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.822033 loss: 0.000634 2022/09/23 18:08:31 - mmengine - INFO - Epoch(train) [114][250/293] lr: 5.000000e-04 eta: 3:49:10 time: 0.547222 data_time: 0.088785 memory: 6691 loss_kpt: 0.000657 acc_pose: 0.825205 loss: 0.000657 2022/09/23 18:08:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:09:24 - mmengine - INFO - Epoch(train) [115][50/293] lr: 5.000000e-04 eta: 3:48:12 time: 0.596521 data_time: 0.104913 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.809900 loss: 0.000648 2022/09/23 18:09:52 - mmengine - INFO - Epoch(train) [115][100/293] lr: 5.000000e-04 eta: 3:47:51 time: 0.578110 data_time: 0.141359 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.822743 loss: 0.000651 2022/09/23 18:10:21 - mmengine - INFO - Epoch(train) [115][150/293] lr: 5.000000e-04 eta: 3:47:30 time: 0.565097 data_time: 0.114337 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.822390 loss: 0.000650 2022/09/23 18:10:48 - mmengine - INFO - Epoch(train) [115][200/293] lr: 5.000000e-04 eta: 3:47:08 time: 0.546197 data_time: 0.139557 memory: 6691 loss_kpt: 0.000659 acc_pose: 0.769216 loss: 0.000659 2022/09/23 18:11:17 - mmengine - INFO - Epoch(train) [115][250/293] lr: 5.000000e-04 eta: 3:46:47 time: 0.572843 data_time: 0.275979 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.779141 loss: 0.000646 2022/09/23 18:11:40 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:12:09 - mmengine - INFO - Epoch(train) [116][50/293] lr: 5.000000e-04 eta: 3:45:48 time: 0.586726 data_time: 0.119688 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.809446 loss: 0.000648 2022/09/23 18:12:37 - mmengine - INFO - Epoch(train) [116][100/293] lr: 5.000000e-04 eta: 3:45:27 time: 0.567927 data_time: 0.105261 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.816757 loss: 0.000649 2022/09/23 18:13:06 - mmengine - INFO - Epoch(train) [116][150/293] lr: 5.000000e-04 eta: 3:45:06 time: 0.567763 data_time: 0.087740 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.822242 loss: 0.000655 2022/09/23 18:13:34 - mmengine - INFO - Epoch(train) [116][200/293] lr: 5.000000e-04 eta: 3:44:44 time: 0.555665 data_time: 0.092990 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.818857 loss: 0.000635 2022/09/23 18:14:03 - mmengine - INFO - Epoch(train) [116][250/293] lr: 5.000000e-04 eta: 3:44:24 time: 0.583487 data_time: 0.091543 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.801854 loss: 0.000648 2022/09/23 18:14:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:14:33 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:14:54 - mmengine - INFO - Epoch(train) [117][50/293] lr: 5.000000e-04 eta: 3:43:26 time: 0.584285 data_time: 0.131491 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.816288 loss: 0.000631 2022/09/23 18:15:22 - mmengine - INFO - Epoch(train) [117][100/293] lr: 5.000000e-04 eta: 3:43:04 time: 0.550517 data_time: 0.087078 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.819199 loss: 0.000645 2022/09/23 18:15:50 - mmengine - INFO - Epoch(train) [117][150/293] lr: 5.000000e-04 eta: 3:42:42 time: 0.564477 data_time: 0.092663 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.794109 loss: 0.000645 2022/09/23 18:16:19 - mmengine - INFO - Epoch(train) [117][200/293] lr: 5.000000e-04 eta: 3:42:22 time: 0.580580 data_time: 0.097604 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.780474 loss: 0.000644 2022/09/23 18:16:47 - mmengine - INFO - Epoch(train) [117][250/293] lr: 5.000000e-04 eta: 3:42:00 time: 0.554927 data_time: 0.124097 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.796361 loss: 0.000649 2022/09/23 18:17:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:17:41 - mmengine - INFO - Epoch(train) [118][50/293] lr: 5.000000e-04 eta: 3:41:02 time: 0.585783 data_time: 0.322089 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.795958 loss: 0.000640 2022/09/23 18:18:08 - mmengine - INFO - Epoch(train) [118][100/293] lr: 5.000000e-04 eta: 3:40:40 time: 0.545260 data_time: 0.255161 memory: 6691 loss_kpt: 0.000658 acc_pose: 0.771018 loss: 0.000658 2022/09/23 18:18:35 - mmengine - INFO - Epoch(train) [118][150/293] lr: 5.000000e-04 eta: 3:40:18 time: 0.544022 data_time: 0.267246 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.833169 loss: 0.000630 2022/09/23 18:19:04 - mmengine - INFO - Epoch(train) [118][200/293] lr: 5.000000e-04 eta: 3:39:56 time: 0.564038 data_time: 0.133864 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.829273 loss: 0.000635 2022/09/23 18:19:31 - mmengine - INFO - Epoch(train) [118][250/293] lr: 5.000000e-04 eta: 3:39:34 time: 0.554966 data_time: 0.221678 memory: 6691 loss_kpt: 0.000660 acc_pose: 0.804977 loss: 0.000660 2022/09/23 18:19:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:20:25 - mmengine - INFO - Epoch(train) [119][50/293] lr: 5.000000e-04 eta: 3:38:37 time: 0.588887 data_time: 0.198063 memory: 6691 loss_kpt: 0.000654 acc_pose: 0.811745 loss: 0.000654 2022/09/23 18:20:54 - mmengine - INFO - Epoch(train) [119][100/293] lr: 5.000000e-04 eta: 3:38:15 time: 0.563066 data_time: 0.095273 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.843441 loss: 0.000649 2022/09/23 18:21:21 - mmengine - INFO - Epoch(train) [119][150/293] lr: 5.000000e-04 eta: 3:37:53 time: 0.553412 data_time: 0.083094 memory: 6691 loss_kpt: 0.000656 acc_pose: 0.810745 loss: 0.000656 2022/09/23 18:21:50 - mmengine - INFO - Epoch(train) [119][200/293] lr: 5.000000e-04 eta: 3:37:32 time: 0.567685 data_time: 0.133003 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.835053 loss: 0.000632 2022/09/23 18:22:18 - mmengine - INFO - Epoch(train) [119][250/293] lr: 5.000000e-04 eta: 3:37:11 time: 0.576358 data_time: 0.162054 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.809946 loss: 0.000637 2022/09/23 18:22:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:23:12 - mmengine - INFO - Epoch(train) [120][50/293] lr: 5.000000e-04 eta: 3:36:13 time: 0.585981 data_time: 0.246771 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.865273 loss: 0.000647 2022/09/23 18:23:39 - mmengine - INFO - Epoch(train) [120][100/293] lr: 5.000000e-04 eta: 3:35:51 time: 0.549591 data_time: 0.247692 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.828501 loss: 0.000646 2022/09/23 18:23:58 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:24:07 - mmengine - INFO - Epoch(train) [120][150/293] lr: 5.000000e-04 eta: 3:35:30 time: 0.555362 data_time: 0.200294 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.793957 loss: 0.000640 2022/09/23 18:24:35 - mmengine - INFO - Epoch(train) [120][200/293] lr: 5.000000e-04 eta: 3:35:07 time: 0.545717 data_time: 0.146484 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.833154 loss: 0.000637 2022/09/23 18:25:02 - mmengine - INFO - Epoch(train) [120][250/293] lr: 5.000000e-04 eta: 3:34:45 time: 0.554757 data_time: 0.298572 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.788313 loss: 0.000652 2022/09/23 18:25:27 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:25:27 - mmengine - INFO - Saving checkpoint at 120 epochs 2022/09/23 18:25:50 - mmengine - INFO - Epoch(val) [120][50/407] eta: 0:02:00 time: 0.337210 data_time: 0.076609 memory: 6691 2022/09/23 18:26:06 - mmengine - INFO - Epoch(val) [120][100/407] eta: 0:01:34 time: 0.307753 data_time: 0.045801 memory: 1014 2022/09/23 18:26:22 - mmengine - INFO - Epoch(val) [120][150/407] eta: 0:01:22 time: 0.319791 data_time: 0.059437 memory: 1014 2022/09/23 18:26:38 - mmengine - INFO - Epoch(val) [120][200/407] eta: 0:01:05 time: 0.317933 data_time: 0.060231 memory: 1014 2022/09/23 18:26:54 - mmengine - INFO - Epoch(val) [120][250/407] eta: 0:00:51 time: 0.325230 data_time: 0.071310 memory: 1014 2022/09/23 18:27:10 - mmengine - INFO - Epoch(val) [120][300/407] eta: 0:00:34 time: 0.318637 data_time: 0.053606 memory: 1014 2022/09/23 18:27:26 - mmengine - INFO - Epoch(val) [120][350/407] eta: 0:00:18 time: 0.324358 data_time: 0.071073 memory: 1014 2022/09/23 18:27:38 - mmengine - INFO - Epoch(val) [120][400/407] eta: 0:00:01 time: 0.240383 data_time: 0.049385 memory: 1014 2022/09/23 18:28:10 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 18:28:23 - mmengine - INFO - Epoch(val) [120][407/407] coco/AP: 0.704665 coco/AP .5: 0.888225 coco/AP .75: 0.777752 coco/AP (M): 0.668910 coco/AP (L): 0.771540 coco/AR: 0.761146 coco/AR .5: 0.928684 coco/AR .75: 0.827613 coco/AR (M): 0.718055 coco/AR (L): 0.822668 2022/09/23 18:28:23 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_100.pth is removed 2022/09/23 18:28:25 - mmengine - INFO - The best checkpoint with 0.7047 coco/AP at 120 epoch is saved to best_coco/AP_epoch_120.pth. 2022/09/23 18:28:53 - mmengine - INFO - Epoch(train) [121][50/293] lr: 5.000000e-04 eta: 3:33:47 time: 0.553025 data_time: 0.212018 memory: 6691 loss_kpt: 0.000639 acc_pose: 0.799911 loss: 0.000639 2022/09/23 18:29:21 - mmengine - INFO - Epoch(train) [121][100/293] lr: 5.000000e-04 eta: 3:33:26 time: 0.569830 data_time: 0.189954 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.815776 loss: 0.000650 2022/09/23 18:29:49 - mmengine - INFO - Epoch(train) [121][150/293] lr: 5.000000e-04 eta: 3:33:03 time: 0.547528 data_time: 0.086082 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.852037 loss: 0.000634 2022/09/23 18:30:17 - mmengine - INFO - Epoch(train) [121][200/293] lr: 5.000000e-04 eta: 3:32:42 time: 0.555595 data_time: 0.102144 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.814493 loss: 0.000645 2022/09/23 18:30:45 - mmengine - INFO - Epoch(train) [121][250/293] lr: 5.000000e-04 eta: 3:32:20 time: 0.567580 data_time: 0.141845 memory: 6691 loss_kpt: 0.000655 acc_pose: 0.756251 loss: 0.000655 2022/09/23 18:31:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:31:38 - mmengine - INFO - Epoch(train) [122][50/293] lr: 5.000000e-04 eta: 3:31:23 time: 0.589862 data_time: 0.202832 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.853642 loss: 0.000633 2022/09/23 18:32:07 - mmengine - INFO - Epoch(train) [122][100/293] lr: 5.000000e-04 eta: 3:31:02 time: 0.569897 data_time: 0.097745 memory: 6691 loss_kpt: 0.000652 acc_pose: 0.830745 loss: 0.000652 2022/09/23 18:32:36 - mmengine - INFO - Epoch(train) [122][150/293] lr: 5.000000e-04 eta: 3:30:41 time: 0.575146 data_time: 0.087462 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.785505 loss: 0.000644 2022/09/23 18:33:04 - mmengine - INFO - Epoch(train) [122][200/293] lr: 5.000000e-04 eta: 3:30:19 time: 0.571764 data_time: 0.098692 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.797736 loss: 0.000637 2022/09/23 18:33:32 - mmengine - INFO - Epoch(train) [122][250/293] lr: 5.000000e-04 eta: 3:29:58 time: 0.561656 data_time: 0.115341 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.825587 loss: 0.000643 2022/09/23 18:33:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:34:26 - mmengine - INFO - Epoch(train) [123][50/293] lr: 5.000000e-04 eta: 3:29:01 time: 0.583324 data_time: 0.107941 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.827963 loss: 0.000646 2022/09/23 18:34:55 - mmengine - INFO - Epoch(train) [123][100/293] lr: 5.000000e-04 eta: 3:28:39 time: 0.573199 data_time: 0.101170 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.823358 loss: 0.000646 2022/09/23 18:35:23 - mmengine - INFO - Epoch(train) [123][150/293] lr: 5.000000e-04 eta: 3:28:17 time: 0.557413 data_time: 0.129075 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.793332 loss: 0.000634 2022/09/23 18:35:51 - mmengine - INFO - Epoch(train) [123][200/293] lr: 5.000000e-04 eta: 3:27:55 time: 0.555818 data_time: 0.295506 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.795609 loss: 0.000641 2022/09/23 18:36:19 - mmengine - INFO - Epoch(train) [123][250/293] lr: 5.000000e-04 eta: 3:27:34 time: 0.575980 data_time: 0.125436 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.794391 loss: 0.000649 2022/09/23 18:36:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:36:43 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:37:13 - mmengine - INFO - Epoch(train) [124][50/293] lr: 5.000000e-04 eta: 3:26:38 time: 0.597839 data_time: 0.235295 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.842947 loss: 0.000645 2022/09/23 18:37:41 - mmengine - INFO - Epoch(train) [124][100/293] lr: 5.000000e-04 eta: 3:26:16 time: 0.562644 data_time: 0.254927 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.760004 loss: 0.000641 2022/09/23 18:38:09 - mmengine - INFO - Epoch(train) [124][150/293] lr: 5.000000e-04 eta: 3:25:54 time: 0.553595 data_time: 0.092626 memory: 6691 loss_kpt: 0.000653 acc_pose: 0.782693 loss: 0.000653 2022/09/23 18:38:36 - mmengine - INFO - Epoch(train) [124][200/293] lr: 5.000000e-04 eta: 3:25:32 time: 0.546028 data_time: 0.098545 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.806268 loss: 0.000637 2022/09/23 18:39:05 - mmengine - INFO - Epoch(train) [124][250/293] lr: 5.000000e-04 eta: 3:25:10 time: 0.570113 data_time: 0.084544 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.839598 loss: 0.000646 2022/09/23 18:39:29 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:39:58 - mmengine - INFO - Epoch(train) [125][50/293] lr: 5.000000e-04 eta: 3:24:14 time: 0.579759 data_time: 0.119733 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.813118 loss: 0.000628 2022/09/23 18:40:27 - mmengine - INFO - Epoch(train) [125][100/293] lr: 5.000000e-04 eta: 3:23:52 time: 0.574286 data_time: 0.121537 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.786694 loss: 0.000638 2022/09/23 18:40:54 - mmengine - INFO - Epoch(train) [125][150/293] lr: 5.000000e-04 eta: 3:23:30 time: 0.551307 data_time: 0.094750 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.769222 loss: 0.000648 2022/09/23 18:41:22 - mmengine - INFO - Epoch(train) [125][200/293] lr: 5.000000e-04 eta: 3:23:08 time: 0.551522 data_time: 0.093831 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.826083 loss: 0.000635 2022/09/23 18:41:50 - mmengine - INFO - Epoch(train) [125][250/293] lr: 5.000000e-04 eta: 3:22:46 time: 0.567059 data_time: 0.091554 memory: 6691 loss_kpt: 0.000653 acc_pose: 0.848866 loss: 0.000653 2022/09/23 18:42:14 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:42:43 - mmengine - INFO - Epoch(train) [126][50/293] lr: 5.000000e-04 eta: 3:21:50 time: 0.575877 data_time: 0.261015 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.805301 loss: 0.000624 2022/09/23 18:43:11 - mmengine - INFO - Epoch(train) [126][100/293] lr: 5.000000e-04 eta: 3:21:28 time: 0.560677 data_time: 0.143813 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.792102 loss: 0.000645 2022/09/23 18:43:39 - mmengine - INFO - Epoch(train) [126][150/293] lr: 5.000000e-04 eta: 3:21:06 time: 0.552190 data_time: 0.105646 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.812159 loss: 0.000631 2022/09/23 18:44:06 - mmengine - INFO - Epoch(train) [126][200/293] lr: 5.000000e-04 eta: 3:20:43 time: 0.537279 data_time: 0.081144 memory: 6691 loss_kpt: 0.000639 acc_pose: 0.797422 loss: 0.000639 2022/09/23 18:44:34 - mmengine - INFO - Epoch(train) [126][250/293] lr: 5.000000e-04 eta: 3:20:21 time: 0.568673 data_time: 0.092849 memory: 6691 loss_kpt: 0.000645 acc_pose: 0.763260 loss: 0.000645 2022/09/23 18:44:58 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:45:27 - mmengine - INFO - Epoch(train) [127][50/293] lr: 5.000000e-04 eta: 3:19:25 time: 0.576824 data_time: 0.117959 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.853363 loss: 0.000626 2022/09/23 18:45:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:45:54 - mmengine - INFO - Epoch(train) [127][100/293] lr: 5.000000e-04 eta: 3:19:03 time: 0.558462 data_time: 0.171710 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.789839 loss: 0.000642 2022/09/23 18:46:23 - mmengine - INFO - Epoch(train) [127][150/293] lr: 5.000000e-04 eta: 3:18:41 time: 0.562642 data_time: 0.116672 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.794381 loss: 0.000641 2022/09/23 18:46:50 - mmengine - INFO - Epoch(train) [127][200/293] lr: 5.000000e-04 eta: 3:18:19 time: 0.556691 data_time: 0.083376 memory: 6691 loss_kpt: 0.000653 acc_pose: 0.782957 loss: 0.000653 2022/09/23 18:47:18 - mmengine - INFO - Epoch(train) [127][250/293] lr: 5.000000e-04 eta: 3:17:57 time: 0.551684 data_time: 0.090289 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.810722 loss: 0.000644 2022/09/23 18:47:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:48:11 - mmengine - INFO - Epoch(train) [128][50/293] lr: 5.000000e-04 eta: 3:17:01 time: 0.579744 data_time: 0.148002 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.804862 loss: 0.000632 2022/09/23 18:48:39 - mmengine - INFO - Epoch(train) [128][100/293] lr: 5.000000e-04 eta: 3:16:39 time: 0.561644 data_time: 0.160463 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.826383 loss: 0.000638 2022/09/23 18:49:07 - mmengine - INFO - Epoch(train) [128][150/293] lr: 5.000000e-04 eta: 3:16:17 time: 0.566892 data_time: 0.089440 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.827945 loss: 0.000643 2022/09/23 18:49:36 - mmengine - INFO - Epoch(train) [128][200/293] lr: 5.000000e-04 eta: 3:15:55 time: 0.566894 data_time: 0.090304 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.829504 loss: 0.000643 2022/09/23 18:50:04 - mmengine - INFO - Epoch(train) [128][250/293] lr: 5.000000e-04 eta: 3:15:33 time: 0.566777 data_time: 0.095757 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.820859 loss: 0.000636 2022/09/23 18:50:27 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:50:57 - mmengine - INFO - Epoch(train) [129][50/293] lr: 5.000000e-04 eta: 3:14:38 time: 0.589102 data_time: 0.122958 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.840307 loss: 0.000642 2022/09/23 18:51:25 - mmengine - INFO - Epoch(train) [129][100/293] lr: 5.000000e-04 eta: 3:14:16 time: 0.571961 data_time: 0.101404 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.822419 loss: 0.000630 2022/09/23 18:51:53 - mmengine - INFO - Epoch(train) [129][150/293] lr: 5.000000e-04 eta: 3:13:54 time: 0.552118 data_time: 0.089451 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.797210 loss: 0.000624 2022/09/23 18:52:22 - mmengine - INFO - Epoch(train) [129][200/293] lr: 5.000000e-04 eta: 3:13:32 time: 0.573245 data_time: 0.135022 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.798030 loss: 0.000642 2022/09/23 18:52:51 - mmengine - INFO - Epoch(train) [129][250/293] lr: 5.000000e-04 eta: 3:13:11 time: 0.588525 data_time: 0.117162 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.862209 loss: 0.000640 2022/09/23 18:53:15 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:53:45 - mmengine - INFO - Epoch(train) [130][50/293] lr: 5.000000e-04 eta: 3:12:16 time: 0.595569 data_time: 0.283089 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.809675 loss: 0.000626 2022/09/23 18:54:14 - mmengine - INFO - Epoch(train) [130][100/293] lr: 5.000000e-04 eta: 3:11:54 time: 0.577340 data_time: 0.186958 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.792943 loss: 0.000638 2022/09/23 18:54:42 - mmengine - INFO - Epoch(train) [130][150/293] lr: 5.000000e-04 eta: 3:11:32 time: 0.552353 data_time: 0.103746 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.796008 loss: 0.000636 2022/09/23 18:55:10 - mmengine - INFO - Epoch(train) [130][200/293] lr: 5.000000e-04 eta: 3:11:10 time: 0.560441 data_time: 0.087953 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.817608 loss: 0.000647 2022/09/23 18:55:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:55:38 - mmengine - INFO - Epoch(train) [130][250/293] lr: 5.000000e-04 eta: 3:10:48 time: 0.574803 data_time: 0.146193 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.817474 loss: 0.000646 2022/09/23 18:56:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 18:56:03 - mmengine - INFO - Saving checkpoint at 130 epochs 2022/09/23 18:56:27 - mmengine - INFO - Epoch(val) [130][50/407] eta: 0:02:05 time: 0.351690 data_time: 0.094102 memory: 6691 2022/09/23 18:56:43 - mmengine - INFO - Epoch(val) [130][100/407] eta: 0:01:40 time: 0.328767 data_time: 0.056919 memory: 1014 2022/09/23 18:56:59 - mmengine - INFO - Epoch(val) [130][150/407] eta: 0:01:21 time: 0.316567 data_time: 0.057150 memory: 1014 2022/09/23 18:57:16 - mmengine - INFO - Epoch(val) [130][200/407] eta: 0:01:11 time: 0.345030 data_time: 0.066934 memory: 1014 2022/09/23 18:57:32 - mmengine - INFO - Epoch(val) [130][250/407] eta: 0:00:49 time: 0.312795 data_time: 0.053943 memory: 1014 2022/09/23 18:57:48 - mmengine - INFO - Epoch(val) [130][300/407] eta: 0:00:34 time: 0.321638 data_time: 0.061821 memory: 1014 2022/09/23 18:58:04 - mmengine - INFO - Epoch(val) [130][350/407] eta: 0:00:18 time: 0.322392 data_time: 0.072629 memory: 1014 2022/09/23 18:58:17 - mmengine - INFO - Epoch(val) [130][400/407] eta: 0:00:01 time: 0.251422 data_time: 0.071408 memory: 1014 2022/09/23 18:58:49 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 18:59:01 - mmengine - INFO - Epoch(val) [130][407/407] coco/AP: 0.708994 coco/AP .5: 0.893174 coco/AP .75: 0.782767 coco/AP (M): 0.674431 coco/AP (L): 0.774367 coco/AR: 0.764200 coco/AR .5: 0.930888 coco/AR .75: 0.831392 coco/AR (M): 0.722125 coco/AR (L): 0.824823 2022/09/23 18:59:02 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_120.pth is removed 2022/09/23 18:59:04 - mmengine - INFO - The best checkpoint with 0.7090 coco/AP at 130 epoch is saved to best_coco/AP_epoch_130.pth. 2022/09/23 18:59:32 - mmengine - INFO - Epoch(train) [131][50/293] lr: 5.000000e-04 eta: 3:09:52 time: 0.550933 data_time: 0.243715 memory: 6691 loss_kpt: 0.000629 acc_pose: 0.813135 loss: 0.000629 2022/09/23 18:59:59 - mmengine - INFO - Epoch(train) [131][100/293] lr: 5.000000e-04 eta: 3:09:30 time: 0.547650 data_time: 0.088451 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.832665 loss: 0.000632 2022/09/23 19:00:27 - mmengine - INFO - Epoch(train) [131][150/293] lr: 5.000000e-04 eta: 3:09:07 time: 0.552970 data_time: 0.084537 memory: 6691 loss_kpt: 0.000657 acc_pose: 0.820423 loss: 0.000657 2022/09/23 19:00:56 - mmengine - INFO - Epoch(train) [131][200/293] lr: 5.000000e-04 eta: 3:08:45 time: 0.571234 data_time: 0.088287 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.859463 loss: 0.000637 2022/09/23 19:01:23 - mmengine - INFO - Epoch(train) [131][250/293] lr: 5.000000e-04 eta: 3:08:23 time: 0.550662 data_time: 0.120843 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.817928 loss: 0.000641 2022/09/23 19:01:47 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:02:17 - mmengine - INFO - Epoch(train) [132][50/293] lr: 5.000000e-04 eta: 3:07:28 time: 0.591625 data_time: 0.179317 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.856633 loss: 0.000643 2022/09/23 19:02:46 - mmengine - INFO - Epoch(train) [132][100/293] lr: 5.000000e-04 eta: 3:07:07 time: 0.585222 data_time: 0.204070 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.863637 loss: 0.000633 2022/09/23 19:03:15 - mmengine - INFO - Epoch(train) [132][150/293] lr: 5.000000e-04 eta: 3:06:45 time: 0.579631 data_time: 0.105645 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.832588 loss: 0.000637 2022/09/23 19:03:42 - mmengine - INFO - Epoch(train) [132][200/293] lr: 5.000000e-04 eta: 3:06:23 time: 0.549655 data_time: 0.102978 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.804889 loss: 0.000649 2022/09/23 19:04:11 - mmengine - INFO - Epoch(train) [132][250/293] lr: 5.000000e-04 eta: 3:06:01 time: 0.571850 data_time: 0.090645 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.815923 loss: 0.000644 2022/09/23 19:04:34 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:05:03 - mmengine - INFO - Epoch(train) [133][50/293] lr: 5.000000e-04 eta: 3:05:06 time: 0.587337 data_time: 0.115951 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.837718 loss: 0.000630 2022/09/23 19:05:32 - mmengine - INFO - Epoch(train) [133][100/293] lr: 5.000000e-04 eta: 3:04:44 time: 0.569097 data_time: 0.145153 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.822836 loss: 0.000638 2022/09/23 19:06:00 - mmengine - INFO - Epoch(train) [133][150/293] lr: 5.000000e-04 eta: 3:04:22 time: 0.575169 data_time: 0.089814 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.826678 loss: 0.000633 2022/09/23 19:06:28 - mmengine - INFO - Epoch(train) [133][200/293] lr: 5.000000e-04 eta: 3:04:00 time: 0.561983 data_time: 0.164489 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.806565 loss: 0.000638 2022/09/23 19:06:56 - mmengine - INFO - Epoch(train) [133][250/293] lr: 5.000000e-04 eta: 3:03:38 time: 0.555302 data_time: 0.114595 memory: 6691 loss_kpt: 0.000643 acc_pose: 0.846280 loss: 0.000643 2022/09/23 19:07:20 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:07:40 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:07:51 - mmengine - INFO - Epoch(train) [134][50/293] lr: 5.000000e-04 eta: 3:02:44 time: 0.605768 data_time: 0.161870 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.788586 loss: 0.000636 2022/09/23 19:08:20 - mmengine - INFO - Epoch(train) [134][100/293] lr: 5.000000e-04 eta: 3:02:22 time: 0.576577 data_time: 0.136912 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.829410 loss: 0.000619 2022/09/23 19:08:49 - mmengine - INFO - Epoch(train) [134][150/293] lr: 5.000000e-04 eta: 3:02:00 time: 0.583062 data_time: 0.104504 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.807176 loss: 0.000641 2022/09/23 19:09:16 - mmengine - INFO - Epoch(train) [134][200/293] lr: 5.000000e-04 eta: 3:01:37 time: 0.539037 data_time: 0.094018 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.840484 loss: 0.000630 2022/09/23 19:09:44 - mmengine - INFO - Epoch(train) [134][250/293] lr: 5.000000e-04 eta: 3:01:16 time: 0.574900 data_time: 0.136907 memory: 6691 loss_kpt: 0.000649 acc_pose: 0.806084 loss: 0.000649 2022/09/23 19:10:09 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:10:38 - mmengine - INFO - Epoch(train) [135][50/293] lr: 5.000000e-04 eta: 3:00:21 time: 0.580675 data_time: 0.217247 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.774615 loss: 0.000626 2022/09/23 19:11:07 - mmengine - INFO - Epoch(train) [135][100/293] lr: 5.000000e-04 eta: 2:59:59 time: 0.580624 data_time: 0.282302 memory: 6691 loss_kpt: 0.000648 acc_pose: 0.860295 loss: 0.000648 2022/09/23 19:11:36 - mmengine - INFO - Epoch(train) [135][150/293] lr: 5.000000e-04 eta: 2:59:37 time: 0.564498 data_time: 0.219296 memory: 6691 loss_kpt: 0.000647 acc_pose: 0.809562 loss: 0.000647 2022/09/23 19:12:04 - mmengine - INFO - Epoch(train) [135][200/293] lr: 5.000000e-04 eta: 2:59:15 time: 0.558093 data_time: 0.090142 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.835407 loss: 0.000623 2022/09/23 19:12:33 - mmengine - INFO - Epoch(train) [135][250/293] lr: 5.000000e-04 eta: 2:58:53 time: 0.584527 data_time: 0.131146 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.826371 loss: 0.000636 2022/09/23 19:12:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:13:24 - mmengine - INFO - Epoch(train) [136][50/293] lr: 5.000000e-04 eta: 2:57:59 time: 0.582870 data_time: 0.100568 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.854372 loss: 0.000624 2022/09/23 19:13:53 - mmengine - INFO - Epoch(train) [136][100/293] lr: 5.000000e-04 eta: 2:57:37 time: 0.567002 data_time: 0.089852 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.855745 loss: 0.000630 2022/09/23 19:14:20 - mmengine - INFO - Epoch(train) [136][150/293] lr: 5.000000e-04 eta: 2:57:14 time: 0.548736 data_time: 0.091669 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.831808 loss: 0.000623 2022/09/23 19:14:49 - mmengine - INFO - Epoch(train) [136][200/293] lr: 5.000000e-04 eta: 2:56:52 time: 0.572155 data_time: 0.100345 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.812557 loss: 0.000636 2022/09/23 19:15:17 - mmengine - INFO - Epoch(train) [136][250/293] lr: 5.000000e-04 eta: 2:56:30 time: 0.563098 data_time: 0.091070 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.813751 loss: 0.000635 2022/09/23 19:15:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:16:10 - mmengine - INFO - Epoch(train) [137][50/293] lr: 5.000000e-04 eta: 2:55:35 time: 0.577170 data_time: 0.115444 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.842052 loss: 0.000640 2022/09/23 19:16:37 - mmengine - INFO - Epoch(train) [137][100/293] lr: 5.000000e-04 eta: 2:55:13 time: 0.553021 data_time: 0.080847 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.836645 loss: 0.000628 2022/09/23 19:17:06 - mmengine - INFO - Epoch(train) [137][150/293] lr: 5.000000e-04 eta: 2:54:51 time: 0.570357 data_time: 0.139188 memory: 6691 loss_kpt: 0.000639 acc_pose: 0.810851 loss: 0.000639 2022/09/23 19:17:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:17:34 - mmengine - INFO - Epoch(train) [137][200/293] lr: 5.000000e-04 eta: 2:54:28 time: 0.561484 data_time: 0.100229 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.766729 loss: 0.000646 2022/09/23 19:18:01 - mmengine - INFO - Epoch(train) [137][250/293] lr: 5.000000e-04 eta: 2:54:05 time: 0.542666 data_time: 0.106029 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.822273 loss: 0.000644 2022/09/23 19:18:24 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:18:53 - mmengine - INFO - Epoch(train) [138][50/293] lr: 5.000000e-04 eta: 2:53:11 time: 0.575048 data_time: 0.278660 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.829684 loss: 0.000617 2022/09/23 19:19:21 - mmengine - INFO - Epoch(train) [138][100/293] lr: 5.000000e-04 eta: 2:52:49 time: 0.557234 data_time: 0.282112 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.847633 loss: 0.000622 2022/09/23 19:19:48 - mmengine - INFO - Epoch(train) [138][150/293] lr: 5.000000e-04 eta: 2:52:26 time: 0.535359 data_time: 0.208678 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.816130 loss: 0.000619 2022/09/23 19:20:17 - mmengine - INFO - Epoch(train) [138][200/293] lr: 5.000000e-04 eta: 2:52:04 time: 0.578577 data_time: 0.142879 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.850737 loss: 0.000632 2022/09/23 19:20:44 - mmengine - INFO - Epoch(train) [138][250/293] lr: 5.000000e-04 eta: 2:51:41 time: 0.541803 data_time: 0.084549 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.830976 loss: 0.000619 2022/09/23 19:21:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:21:37 - mmengine - INFO - Epoch(train) [139][50/293] lr: 5.000000e-04 eta: 2:50:47 time: 0.594403 data_time: 0.113049 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.800827 loss: 0.000631 2022/09/23 19:22:06 - mmengine - INFO - Epoch(train) [139][100/293] lr: 5.000000e-04 eta: 2:50:25 time: 0.574086 data_time: 0.114936 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.832557 loss: 0.000635 2022/09/23 19:22:35 - mmengine - INFO - Epoch(train) [139][150/293] lr: 5.000000e-04 eta: 2:50:03 time: 0.574075 data_time: 0.096304 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.841476 loss: 0.000634 2022/09/23 19:23:02 - mmengine - INFO - Epoch(train) [139][200/293] lr: 5.000000e-04 eta: 2:49:41 time: 0.553039 data_time: 0.085736 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.819473 loss: 0.000627 2022/09/23 19:23:31 - mmengine - INFO - Epoch(train) [139][250/293] lr: 5.000000e-04 eta: 2:49:18 time: 0.565455 data_time: 0.089393 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.838957 loss: 0.000632 2022/09/23 19:23:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:24:24 - mmengine - INFO - Epoch(train) [140][50/293] lr: 5.000000e-04 eta: 2:48:25 time: 0.585158 data_time: 0.134553 memory: 6691 loss_kpt: 0.000641 acc_pose: 0.814047 loss: 0.000641 2022/09/23 19:24:52 - mmengine - INFO - Epoch(train) [140][100/293] lr: 5.000000e-04 eta: 2:48:02 time: 0.571947 data_time: 0.132759 memory: 6691 loss_kpt: 0.000629 acc_pose: 0.852242 loss: 0.000629 2022/09/23 19:25:21 - mmengine - INFO - Epoch(train) [140][150/293] lr: 5.000000e-04 eta: 2:47:40 time: 0.564585 data_time: 0.231839 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.827537 loss: 0.000630 2022/09/23 19:25:49 - mmengine - INFO - Epoch(train) [140][200/293] lr: 5.000000e-04 eta: 2:47:18 time: 0.558897 data_time: 0.093489 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.822763 loss: 0.000642 2022/09/23 19:26:16 - mmengine - INFO - Epoch(train) [140][250/293] lr: 5.000000e-04 eta: 2:46:55 time: 0.542732 data_time: 0.092654 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.798598 loss: 0.000626 2022/09/23 19:26:29 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:26:39 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:26:39 - mmengine - INFO - Saving checkpoint at 140 epochs 2022/09/23 19:27:04 - mmengine - INFO - Epoch(val) [140][50/407] eta: 0:02:03 time: 0.345348 data_time: 0.097251 memory: 6691 2022/09/23 19:27:20 - mmengine - INFO - Epoch(val) [140][100/407] eta: 0:01:43 time: 0.336844 data_time: 0.066166 memory: 1014 2022/09/23 19:27:37 - mmengine - INFO - Epoch(val) [140][150/407] eta: 0:01:23 time: 0.325012 data_time: 0.070273 memory: 1014 2022/09/23 19:27:53 - mmengine - INFO - Epoch(val) [140][200/407] eta: 0:01:06 time: 0.321703 data_time: 0.055608 memory: 1014 2022/09/23 19:28:09 - mmengine - INFO - Epoch(val) [140][250/407] eta: 0:00:51 time: 0.325762 data_time: 0.084751 memory: 1014 2022/09/23 19:28:25 - mmengine - INFO - Epoch(val) [140][300/407] eta: 0:00:34 time: 0.318749 data_time: 0.074890 memory: 1014 2022/09/23 19:28:42 - mmengine - INFO - Epoch(val) [140][350/407] eta: 0:00:18 time: 0.332900 data_time: 0.061271 memory: 1014 2022/09/23 19:28:53 - mmengine - INFO - Epoch(val) [140][400/407] eta: 0:00:01 time: 0.221213 data_time: 0.051107 memory: 1014 2022/09/23 19:29:25 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 19:29:38 - mmengine - INFO - Epoch(val) [140][407/407] coco/AP: 0.702138 coco/AP .5: 0.887828 coco/AP .75: 0.777021 coco/AP (M): 0.664903 coco/AP (L): 0.769967 coco/AR: 0.758344 coco/AR .5: 0.927424 coco/AR .75: 0.826669 coco/AR (M): 0.714586 coco/AR (L): 0.821256 2022/09/23 19:30:06 - mmengine - INFO - Epoch(train) [141][50/293] lr: 5.000000e-04 eta: 2:46:01 time: 0.558762 data_time: 0.094631 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.808846 loss: 0.000620 2022/09/23 19:30:34 - mmengine - INFO - Epoch(train) [141][100/293] lr: 5.000000e-04 eta: 2:45:38 time: 0.566498 data_time: 0.239315 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.818969 loss: 0.000623 2022/09/23 19:31:02 - mmengine - INFO - Epoch(train) [141][150/293] lr: 5.000000e-04 eta: 2:45:16 time: 0.553810 data_time: 0.134171 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.829106 loss: 0.000619 2022/09/23 19:31:30 - mmengine - INFO - Epoch(train) [141][200/293] lr: 5.000000e-04 eta: 2:44:53 time: 0.566340 data_time: 0.105750 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.819268 loss: 0.000633 2022/09/23 19:31:58 - mmengine - INFO - Epoch(train) [141][250/293] lr: 5.000000e-04 eta: 2:44:30 time: 0.545473 data_time: 0.094252 memory: 6691 loss_kpt: 0.000640 acc_pose: 0.845440 loss: 0.000640 2022/09/23 19:32:21 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:32:50 - mmengine - INFO - Epoch(train) [142][50/293] lr: 5.000000e-04 eta: 2:43:37 time: 0.578591 data_time: 0.114610 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.821945 loss: 0.000625 2022/09/23 19:33:18 - mmengine - INFO - Epoch(train) [142][100/293] lr: 5.000000e-04 eta: 2:43:14 time: 0.557958 data_time: 0.089043 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.806711 loss: 0.000622 2022/09/23 19:33:47 - mmengine - INFO - Epoch(train) [142][150/293] lr: 5.000000e-04 eta: 2:42:52 time: 0.579310 data_time: 0.088961 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.828115 loss: 0.000628 2022/09/23 19:34:13 - mmengine - INFO - Epoch(train) [142][200/293] lr: 5.000000e-04 eta: 2:42:29 time: 0.531153 data_time: 0.165783 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.800524 loss: 0.000637 2022/09/23 19:34:40 - mmengine - INFO - Epoch(train) [142][250/293] lr: 5.000000e-04 eta: 2:42:06 time: 0.538572 data_time: 0.216950 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.843247 loss: 0.000636 2022/09/23 19:35:04 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:35:34 - mmengine - INFO - Epoch(train) [143][50/293] lr: 5.000000e-04 eta: 2:41:13 time: 0.598186 data_time: 0.176834 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.818877 loss: 0.000627 2022/09/23 19:36:02 - mmengine - INFO - Epoch(train) [143][100/293] lr: 5.000000e-04 eta: 2:40:51 time: 0.557841 data_time: 0.188379 memory: 6691 loss_kpt: 0.000644 acc_pose: 0.805939 loss: 0.000644 2022/09/23 19:36:30 - mmengine - INFO - Epoch(train) [143][150/293] lr: 5.000000e-04 eta: 2:40:28 time: 0.562510 data_time: 0.271979 memory: 6691 loss_kpt: 0.000616 acc_pose: 0.834175 loss: 0.000616 2022/09/23 19:36:58 - mmengine - INFO - Epoch(train) [143][200/293] lr: 5.000000e-04 eta: 2:40:06 time: 0.568314 data_time: 0.279985 memory: 6691 loss_kpt: 0.000642 acc_pose: 0.795865 loss: 0.000642 2022/09/23 19:37:27 - mmengine - INFO - Epoch(train) [143][250/293] lr: 5.000000e-04 eta: 2:39:43 time: 0.584659 data_time: 0.156263 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.834045 loss: 0.000622 2022/09/23 19:37:52 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:38:21 - mmengine - INFO - Epoch(train) [144][50/293] lr: 5.000000e-04 eta: 2:38:51 time: 0.578598 data_time: 0.174769 memory: 6691 loss_kpt: 0.000638 acc_pose: 0.847501 loss: 0.000638 2022/09/23 19:38:49 - mmengine - INFO - Epoch(train) [144][100/293] lr: 5.000000e-04 eta: 2:38:28 time: 0.567192 data_time: 0.106692 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.780208 loss: 0.000626 2022/09/23 19:38:50 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:39:18 - mmengine - INFO - Epoch(train) [144][150/293] lr: 5.000000e-04 eta: 2:38:06 time: 0.575382 data_time: 0.090103 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.826172 loss: 0.000627 2022/09/23 19:39:47 - mmengine - INFO - Epoch(train) [144][200/293] lr: 5.000000e-04 eta: 2:37:44 time: 0.579206 data_time: 0.100298 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.836082 loss: 0.000627 2022/09/23 19:40:15 - mmengine - INFO - Epoch(train) [144][250/293] lr: 5.000000e-04 eta: 2:37:21 time: 0.571712 data_time: 0.084935 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.773402 loss: 0.000622 2022/09/23 19:40:39 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:41:09 - mmengine - INFO - Epoch(train) [145][50/293] lr: 5.000000e-04 eta: 2:36:29 time: 0.588537 data_time: 0.148946 memory: 6691 loss_kpt: 0.000611 acc_pose: 0.802614 loss: 0.000611 2022/09/23 19:41:37 - mmengine - INFO - Epoch(train) [145][100/293] lr: 5.000000e-04 eta: 2:36:06 time: 0.565740 data_time: 0.103035 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.806152 loss: 0.000634 2022/09/23 19:42:05 - mmengine - INFO - Epoch(train) [145][150/293] lr: 5.000000e-04 eta: 2:35:44 time: 0.567239 data_time: 0.126203 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.834742 loss: 0.000620 2022/09/23 19:42:34 - mmengine - INFO - Epoch(train) [145][200/293] lr: 5.000000e-04 eta: 2:35:21 time: 0.567417 data_time: 0.088648 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.859933 loss: 0.000624 2022/09/23 19:43:02 - mmengine - INFO - Epoch(train) [145][250/293] lr: 5.000000e-04 eta: 2:34:58 time: 0.564480 data_time: 0.091500 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.857497 loss: 0.000634 2022/09/23 19:43:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:43:54 - mmengine - INFO - Epoch(train) [146][50/293] lr: 5.000000e-04 eta: 2:34:06 time: 0.583264 data_time: 0.122243 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.803429 loss: 0.000627 2022/09/23 19:44:22 - mmengine - INFO - Epoch(train) [146][100/293] lr: 5.000000e-04 eta: 2:33:43 time: 0.562335 data_time: 0.185209 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.832715 loss: 0.000634 2022/09/23 19:44:51 - mmengine - INFO - Epoch(train) [146][150/293] lr: 5.000000e-04 eta: 2:33:21 time: 0.565722 data_time: 0.263522 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.833752 loss: 0.000620 2022/09/23 19:45:19 - mmengine - INFO - Epoch(train) [146][200/293] lr: 5.000000e-04 eta: 2:32:58 time: 0.564557 data_time: 0.258190 memory: 6691 loss_kpt: 0.000613 acc_pose: 0.814791 loss: 0.000613 2022/09/23 19:45:46 - mmengine - INFO - Epoch(train) [146][250/293] lr: 5.000000e-04 eta: 2:32:35 time: 0.548320 data_time: 0.179516 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.809628 loss: 0.000622 2022/09/23 19:46:10 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:46:40 - mmengine - INFO - Epoch(train) [147][50/293] lr: 5.000000e-04 eta: 2:31:43 time: 0.585260 data_time: 0.149673 memory: 6691 loss_kpt: 0.000639 acc_pose: 0.778783 loss: 0.000639 2022/09/23 19:47:08 - mmengine - INFO - Epoch(train) [147][100/293] lr: 5.000000e-04 eta: 2:31:20 time: 0.575133 data_time: 0.109786 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.801651 loss: 0.000626 2022/09/23 19:47:37 - mmengine - INFO - Epoch(train) [147][150/293] lr: 5.000000e-04 eta: 2:30:58 time: 0.565139 data_time: 0.146764 memory: 6691 loss_kpt: 0.000651 acc_pose: 0.845008 loss: 0.000651 2022/09/23 19:48:05 - mmengine - INFO - Epoch(train) [147][200/293] lr: 5.000000e-04 eta: 2:30:35 time: 0.567944 data_time: 0.091616 memory: 6691 loss_kpt: 0.000635 acc_pose: 0.800028 loss: 0.000635 2022/09/23 19:48:17 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:48:32 - mmengine - INFO - Epoch(train) [147][250/293] lr: 5.000000e-04 eta: 2:30:12 time: 0.547798 data_time: 0.114262 memory: 6691 loss_kpt: 0.000650 acc_pose: 0.849248 loss: 0.000650 2022/09/23 19:48:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:49:25 - mmengine - INFO - Epoch(train) [148][50/293] lr: 5.000000e-04 eta: 2:29:19 time: 0.569928 data_time: 0.108183 memory: 6691 loss_kpt: 0.000607 acc_pose: 0.803039 loss: 0.000607 2022/09/23 19:49:54 - mmengine - INFO - Epoch(train) [148][100/293] lr: 5.000000e-04 eta: 2:28:57 time: 0.577155 data_time: 0.096956 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.871655 loss: 0.000622 2022/09/23 19:50:23 - mmengine - INFO - Epoch(train) [148][150/293] lr: 5.000000e-04 eta: 2:28:34 time: 0.567451 data_time: 0.110057 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.811020 loss: 0.000615 2022/09/23 19:50:50 - mmengine - INFO - Epoch(train) [148][200/293] lr: 5.000000e-04 eta: 2:28:11 time: 0.545155 data_time: 0.082807 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.838374 loss: 0.000624 2022/09/23 19:51:18 - mmengine - INFO - Epoch(train) [148][250/293] lr: 5.000000e-04 eta: 2:27:48 time: 0.552052 data_time: 0.091691 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.816317 loss: 0.000624 2022/09/23 19:51:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:52:11 - mmengine - INFO - Epoch(train) [149][50/293] lr: 5.000000e-04 eta: 2:26:56 time: 0.592448 data_time: 0.205348 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.813559 loss: 0.000630 2022/09/23 19:52:40 - mmengine - INFO - Epoch(train) [149][100/293] lr: 5.000000e-04 eta: 2:26:34 time: 0.569613 data_time: 0.165744 memory: 6691 loss_kpt: 0.000646 acc_pose: 0.795110 loss: 0.000646 2022/09/23 19:53:08 - mmengine - INFO - Epoch(train) [149][150/293] lr: 5.000000e-04 eta: 2:26:11 time: 0.561401 data_time: 0.103602 memory: 6691 loss_kpt: 0.000613 acc_pose: 0.833620 loss: 0.000613 2022/09/23 19:53:36 - mmengine - INFO - Epoch(train) [149][200/293] lr: 5.000000e-04 eta: 2:25:48 time: 0.562172 data_time: 0.088297 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.827295 loss: 0.000610 2022/09/23 19:54:04 - mmengine - INFO - Epoch(train) [149][250/293] lr: 5.000000e-04 eta: 2:25:25 time: 0.557122 data_time: 0.085703 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.762318 loss: 0.000623 2022/09/23 19:54:28 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:54:57 - mmengine - INFO - Epoch(train) [150][50/293] lr: 5.000000e-04 eta: 2:24:33 time: 0.581617 data_time: 0.107928 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.839570 loss: 0.000621 2022/09/23 19:55:25 - mmengine - INFO - Epoch(train) [150][100/293] lr: 5.000000e-04 eta: 2:24:11 time: 0.568168 data_time: 0.227112 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.855511 loss: 0.000625 2022/09/23 19:55:55 - mmengine - INFO - Epoch(train) [150][150/293] lr: 5.000000e-04 eta: 2:23:48 time: 0.586374 data_time: 0.118172 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.856823 loss: 0.000630 2022/09/23 19:56:23 - mmengine - INFO - Epoch(train) [150][200/293] lr: 5.000000e-04 eta: 2:23:26 time: 0.566356 data_time: 0.090370 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.839913 loss: 0.000619 2022/09/23 19:56:53 - mmengine - INFO - Epoch(train) [150][250/293] lr: 5.000000e-04 eta: 2:23:04 time: 0.597136 data_time: 0.128229 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.837352 loss: 0.000627 2022/09/23 19:57:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 19:57:18 - mmengine - INFO - Saving checkpoint at 150 epochs 2022/09/23 19:57:41 - mmengine - INFO - Epoch(val) [150][50/407] eta: 0:01:58 time: 0.333037 data_time: 0.067124 memory: 6691 2022/09/23 19:57:57 - mmengine - INFO - Epoch(val) [150][100/407] eta: 0:01:38 time: 0.320417 data_time: 0.058258 memory: 1014 2022/09/23 19:58:13 - mmengine - INFO - Epoch(val) [150][150/407] eta: 0:01:22 time: 0.322078 data_time: 0.072493 memory: 1014 2022/09/23 19:58:29 - mmengine - INFO - Epoch(val) [150][200/407] eta: 0:01:05 time: 0.317362 data_time: 0.053339 memory: 1014 2022/09/23 19:58:45 - mmengine - INFO - Epoch(val) [150][250/407] eta: 0:00:48 time: 0.311607 data_time: 0.048370 memory: 1014 2022/09/23 19:59:01 - mmengine - INFO - Epoch(val) [150][300/407] eta: 0:00:34 time: 0.324586 data_time: 0.067111 memory: 1014 2022/09/23 19:59:17 - mmengine - INFO - Epoch(val) [150][350/407] eta: 0:00:18 time: 0.319308 data_time: 0.047254 memory: 1014 2022/09/23 19:59:28 - mmengine - INFO - Epoch(val) [150][400/407] eta: 0:00:01 time: 0.228464 data_time: 0.044781 memory: 1014 2022/09/23 20:00:00 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 20:00:13 - mmengine - INFO - Epoch(val) [150][407/407] coco/AP: 0.704822 coco/AP .5: 0.886521 coco/AP .75: 0.780306 coco/AP (M): 0.669005 coco/AP (L): 0.771714 coco/AR: 0.761744 coco/AR .5: 0.928369 coco/AR .75: 0.830132 coco/AR (M): 0.719312 coco/AR (L): 0.822854 2022/09/23 20:00:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:00:42 - mmengine - INFO - Epoch(train) [151][50/293] lr: 5.000000e-04 eta: 2:22:12 time: 0.578778 data_time: 0.104975 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.798127 loss: 0.000634 2022/09/23 20:01:10 - mmengine - INFO - Epoch(train) [151][100/293] lr: 5.000000e-04 eta: 2:21:49 time: 0.565974 data_time: 0.096952 memory: 6691 loss_kpt: 0.000614 acc_pose: 0.782198 loss: 0.000614 2022/09/23 20:01:40 - mmengine - INFO - Epoch(train) [151][150/293] lr: 5.000000e-04 eta: 2:21:27 time: 0.585098 data_time: 0.093604 memory: 6691 loss_kpt: 0.000630 acc_pose: 0.836394 loss: 0.000630 2022/09/23 20:02:08 - mmengine - INFO - Epoch(train) [151][200/293] lr: 5.000000e-04 eta: 2:21:04 time: 0.558730 data_time: 0.094918 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.798198 loss: 0.000622 2022/09/23 20:02:36 - mmengine - INFO - Epoch(train) [151][250/293] lr: 5.000000e-04 eta: 2:20:41 time: 0.570511 data_time: 0.092170 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.823723 loss: 0.000633 2022/09/23 20:03:00 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:03:29 - mmengine - INFO - Epoch(train) [152][50/293] lr: 5.000000e-04 eta: 2:19:50 time: 0.594254 data_time: 0.109815 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.770462 loss: 0.000625 2022/09/23 20:03:58 - mmengine - INFO - Epoch(train) [152][100/293] lr: 5.000000e-04 eta: 2:19:27 time: 0.580339 data_time: 0.090533 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.777026 loss: 0.000623 2022/09/23 20:04:26 - mmengine - INFO - Epoch(train) [152][150/293] lr: 5.000000e-04 eta: 2:19:04 time: 0.555992 data_time: 0.091316 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.782474 loss: 0.000624 2022/09/23 20:04:55 - mmengine - INFO - Epoch(train) [152][200/293] lr: 5.000000e-04 eta: 2:18:41 time: 0.571913 data_time: 0.101149 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.815918 loss: 0.000624 2022/09/23 20:05:22 - mmengine - INFO - Epoch(train) [152][250/293] lr: 5.000000e-04 eta: 2:18:18 time: 0.550321 data_time: 0.094404 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.839263 loss: 0.000622 2022/09/23 20:05:46 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:06:17 - mmengine - INFO - Epoch(train) [153][50/293] lr: 5.000000e-04 eta: 2:17:27 time: 0.609904 data_time: 0.300835 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.818816 loss: 0.000610 2022/09/23 20:06:45 - mmengine - INFO - Epoch(train) [153][100/293] lr: 5.000000e-04 eta: 2:17:05 time: 0.572347 data_time: 0.191128 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.847954 loss: 0.000625 2022/09/23 20:07:13 - mmengine - INFO - Epoch(train) [153][150/293] lr: 5.000000e-04 eta: 2:16:42 time: 0.561769 data_time: 0.104463 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.778198 loss: 0.000632 2022/09/23 20:07:43 - mmengine - INFO - Epoch(train) [153][200/293] lr: 5.000000e-04 eta: 2:16:19 time: 0.585967 data_time: 0.222099 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.795845 loss: 0.000623 2022/09/23 20:08:12 - mmengine - INFO - Epoch(train) [153][250/293] lr: 5.000000e-04 eta: 2:15:57 time: 0.580541 data_time: 0.190160 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.828701 loss: 0.000622 2022/09/23 20:08:36 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:09:05 - mmengine - INFO - Epoch(train) [154][50/293] lr: 5.000000e-04 eta: 2:15:05 time: 0.580996 data_time: 0.192635 memory: 6691 loss_kpt: 0.000613 acc_pose: 0.853556 loss: 0.000613 2022/09/23 20:09:33 - mmengine - INFO - Epoch(train) [154][100/293] lr: 5.000000e-04 eta: 2:14:42 time: 0.564047 data_time: 0.110643 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.825329 loss: 0.000619 2022/09/23 20:10:01 - mmengine - INFO - Epoch(train) [154][150/293] lr: 5.000000e-04 eta: 2:14:19 time: 0.558578 data_time: 0.161770 memory: 6691 loss_kpt: 0.000614 acc_pose: 0.839797 loss: 0.000614 2022/09/23 20:10:13 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:10:30 - mmengine - INFO - Epoch(train) [154][200/293] lr: 5.000000e-04 eta: 2:13:56 time: 0.567612 data_time: 0.271718 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.834116 loss: 0.000620 2022/09/23 20:10:58 - mmengine - INFO - Epoch(train) [154][250/293] lr: 5.000000e-04 eta: 2:13:33 time: 0.558170 data_time: 0.227479 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.828015 loss: 0.000619 2022/09/23 20:11:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:11:52 - mmengine - INFO - Epoch(train) [155][50/293] lr: 5.000000e-04 eta: 2:12:43 time: 0.607842 data_time: 0.127572 memory: 6691 loss_kpt: 0.000616 acc_pose: 0.833455 loss: 0.000616 2022/09/23 20:12:21 - mmengine - INFO - Epoch(train) [155][100/293] lr: 5.000000e-04 eta: 2:12:20 time: 0.568717 data_time: 0.100946 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.796643 loss: 0.000626 2022/09/23 20:12:50 - mmengine - INFO - Epoch(train) [155][150/293] lr: 5.000000e-04 eta: 2:11:57 time: 0.580180 data_time: 0.114723 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.789668 loss: 0.000622 2022/09/23 20:13:19 - mmengine - INFO - Epoch(train) [155][200/293] lr: 5.000000e-04 eta: 2:11:35 time: 0.593853 data_time: 0.102690 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.853242 loss: 0.000627 2022/09/23 20:13:48 - mmengine - INFO - Epoch(train) [155][250/293] lr: 5.000000e-04 eta: 2:11:12 time: 0.579452 data_time: 0.099911 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.813074 loss: 0.000623 2022/09/23 20:14:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:14:40 - mmengine - INFO - Epoch(train) [156][50/293] lr: 5.000000e-04 eta: 2:10:21 time: 0.585659 data_time: 0.109978 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.816222 loss: 0.000625 2022/09/23 20:15:09 - mmengine - INFO - Epoch(train) [156][100/293] lr: 5.000000e-04 eta: 2:09:58 time: 0.579384 data_time: 0.088845 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.831964 loss: 0.000615 2022/09/23 20:15:37 - mmengine - INFO - Epoch(train) [156][150/293] lr: 5.000000e-04 eta: 2:09:35 time: 0.565645 data_time: 0.092441 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.881882 loss: 0.000628 2022/09/23 20:16:05 - mmengine - INFO - Epoch(train) [156][200/293] lr: 5.000000e-04 eta: 2:09:12 time: 0.552641 data_time: 0.092311 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.834013 loss: 0.000627 2022/09/23 20:16:33 - mmengine - INFO - Epoch(train) [156][250/293] lr: 5.000000e-04 eta: 2:08:49 time: 0.561767 data_time: 0.096750 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.827691 loss: 0.000617 2022/09/23 20:16:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:17:27 - mmengine - INFO - Epoch(train) [157][50/293] lr: 5.000000e-04 eta: 2:07:58 time: 0.595246 data_time: 0.145073 memory: 6691 loss_kpt: 0.000629 acc_pose: 0.838421 loss: 0.000629 2022/09/23 20:17:56 - mmengine - INFO - Epoch(train) [157][100/293] lr: 5.000000e-04 eta: 2:07:36 time: 0.576013 data_time: 0.092241 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.815807 loss: 0.000628 2022/09/23 20:18:25 - mmengine - INFO - Epoch(train) [157][150/293] lr: 5.000000e-04 eta: 2:07:13 time: 0.578196 data_time: 0.107361 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.815250 loss: 0.000631 2022/09/23 20:18:54 - mmengine - INFO - Epoch(train) [157][200/293] lr: 5.000000e-04 eta: 2:06:50 time: 0.573124 data_time: 0.138118 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.833879 loss: 0.000623 2022/09/23 20:19:23 - mmengine - INFO - Epoch(train) [157][250/293] lr: 5.000000e-04 eta: 2:06:27 time: 0.588110 data_time: 0.229073 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.762902 loss: 0.000617 2022/09/23 20:19:47 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:19:47 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:20:17 - mmengine - INFO - Epoch(train) [158][50/293] lr: 5.000000e-04 eta: 2:05:37 time: 0.595698 data_time: 0.139554 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.853405 loss: 0.000615 2022/09/23 20:20:45 - mmengine - INFO - Epoch(train) [158][100/293] lr: 5.000000e-04 eta: 2:05:14 time: 0.566827 data_time: 0.097811 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.827687 loss: 0.000617 2022/09/23 20:21:13 - mmengine - INFO - Epoch(train) [158][150/293] lr: 5.000000e-04 eta: 2:04:50 time: 0.552939 data_time: 0.081018 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.862940 loss: 0.000621 2022/09/23 20:21:42 - mmengine - INFO - Epoch(train) [158][200/293] lr: 5.000000e-04 eta: 2:04:28 time: 0.580872 data_time: 0.110825 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.808503 loss: 0.000636 2022/09/23 20:22:10 - mmengine - INFO - Epoch(train) [158][250/293] lr: 5.000000e-04 eta: 2:04:04 time: 0.558847 data_time: 0.128459 memory: 6691 loss_kpt: 0.000634 acc_pose: 0.780276 loss: 0.000634 2022/09/23 20:22:34 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:23:05 - mmengine - INFO - Epoch(train) [159][50/293] lr: 5.000000e-04 eta: 2:03:14 time: 0.605584 data_time: 0.155692 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.827116 loss: 0.000615 2022/09/23 20:23:33 - mmengine - INFO - Epoch(train) [159][100/293] lr: 5.000000e-04 eta: 2:02:51 time: 0.571164 data_time: 0.098540 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.769269 loss: 0.000610 2022/09/23 20:24:01 - mmengine - INFO - Epoch(train) [159][150/293] lr: 5.000000e-04 eta: 2:02:28 time: 0.563346 data_time: 0.098604 memory: 6691 loss_kpt: 0.000611 acc_pose: 0.832447 loss: 0.000611 2022/09/23 20:24:30 - mmengine - INFO - Epoch(train) [159][200/293] lr: 5.000000e-04 eta: 2:02:05 time: 0.579892 data_time: 0.215208 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.804779 loss: 0.000631 2022/09/23 20:24:58 - mmengine - INFO - Epoch(train) [159][250/293] lr: 5.000000e-04 eta: 2:01:42 time: 0.552371 data_time: 0.255747 memory: 6691 loss_kpt: 0.000624 acc_pose: 0.809322 loss: 0.000624 2022/09/23 20:25:23 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:25:53 - mmengine - INFO - Epoch(train) [160][50/293] lr: 5.000000e-04 eta: 2:00:52 time: 0.600863 data_time: 0.106991 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.833396 loss: 0.000623 2022/09/23 20:26:21 - mmengine - INFO - Epoch(train) [160][100/293] lr: 5.000000e-04 eta: 2:00:29 time: 0.555706 data_time: 0.092701 memory: 6691 loss_kpt: 0.000612 acc_pose: 0.848847 loss: 0.000612 2022/09/23 20:26:48 - mmengine - INFO - Epoch(train) [160][150/293] lr: 5.000000e-04 eta: 2:00:05 time: 0.543598 data_time: 0.083098 memory: 6691 loss_kpt: 0.000637 acc_pose: 0.823514 loss: 0.000637 2022/09/23 20:27:18 - mmengine - INFO - Epoch(train) [160][200/293] lr: 5.000000e-04 eta: 1:59:42 time: 0.590075 data_time: 0.101227 memory: 6691 loss_kpt: 0.000602 acc_pose: 0.829128 loss: 0.000602 2022/09/23 20:27:47 - mmengine - INFO - Epoch(train) [160][250/293] lr: 5.000000e-04 eta: 1:59:20 time: 0.588954 data_time: 0.157563 memory: 6691 loss_kpt: 0.000611 acc_pose: 0.825593 loss: 0.000611 2022/09/23 20:28:11 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:28:11 - mmengine - INFO - Saving checkpoint at 160 epochs 2022/09/23 20:28:35 - mmengine - INFO - Epoch(val) [160][50/407] eta: 0:02:00 time: 0.337075 data_time: 0.112268 memory: 6691 2022/09/23 20:28:51 - mmengine - INFO - Epoch(val) [160][100/407] eta: 0:01:40 time: 0.327073 data_time: 0.069736 memory: 1014 2022/09/23 20:29:08 - mmengine - INFO - Epoch(val) [160][150/407] eta: 0:01:26 time: 0.336490 data_time: 0.080039 memory: 1014 2022/09/23 20:29:24 - mmengine - INFO - Epoch(val) [160][200/407] eta: 0:01:07 time: 0.327534 data_time: 0.069005 memory: 1014 2022/09/23 20:29:40 - mmengine - INFO - Epoch(val) [160][250/407] eta: 0:00:49 time: 0.317737 data_time: 0.059464 memory: 1014 2022/09/23 20:29:57 - mmengine - INFO - Epoch(val) [160][300/407] eta: 0:00:35 time: 0.331707 data_time: 0.064388 memory: 1014 2022/09/23 20:30:13 - mmengine - INFO - Epoch(val) [160][350/407] eta: 0:00:18 time: 0.319112 data_time: 0.056515 memory: 1014 2022/09/23 20:30:25 - mmengine - INFO - Epoch(val) [160][400/407] eta: 0:00:01 time: 0.244359 data_time: 0.047413 memory: 1014 2022/09/23 20:30:57 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 20:31:10 - mmengine - INFO - Epoch(val) [160][407/407] coco/AP: 0.708786 coco/AP .5: 0.890956 coco/AP .75: 0.783781 coco/AP (M): 0.671437 coco/AP (L): 0.777115 coco/AR: 0.764641 coco/AR .5: 0.930730 coco/AR .75: 0.832021 coco/AR (M): 0.720896 coco/AR (L): 0.827982 2022/09/23 20:31:40 - mmengine - INFO - Epoch(train) [161][50/293] lr: 5.000000e-04 eta: 1:58:29 time: 0.587236 data_time: 0.110875 memory: 6691 loss_kpt: 0.000639 acc_pose: 0.781227 loss: 0.000639 2022/09/23 20:32:08 - mmengine - INFO - Epoch(train) [161][100/293] lr: 5.000000e-04 eta: 1:58:06 time: 0.560018 data_time: 0.095211 memory: 6691 loss_kpt: 0.000609 acc_pose: 0.831447 loss: 0.000609 2022/09/23 20:32:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:32:36 - mmengine - INFO - Epoch(train) [161][150/293] lr: 5.000000e-04 eta: 1:57:43 time: 0.566194 data_time: 0.095531 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.908591 loss: 0.000617 2022/09/23 20:33:03 - mmengine - INFO - Epoch(train) [161][200/293] lr: 5.000000e-04 eta: 1:57:19 time: 0.543608 data_time: 0.094241 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.791302 loss: 0.000621 2022/09/23 20:33:32 - mmengine - INFO - Epoch(train) [161][250/293] lr: 5.000000e-04 eta: 1:56:56 time: 0.578066 data_time: 0.097170 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.813960 loss: 0.000621 2022/09/23 20:33:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:34:25 - mmengine - INFO - Epoch(train) [162][50/293] lr: 5.000000e-04 eta: 1:56:06 time: 0.586212 data_time: 0.146461 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.824258 loss: 0.000622 2022/09/23 20:34:53 - mmengine - INFO - Epoch(train) [162][100/293] lr: 5.000000e-04 eta: 1:55:43 time: 0.564078 data_time: 0.088451 memory: 6691 loss_kpt: 0.000597 acc_pose: 0.814597 loss: 0.000597 2022/09/23 20:35:21 - mmengine - INFO - Epoch(train) [162][150/293] lr: 5.000000e-04 eta: 1:55:20 time: 0.546467 data_time: 0.083798 memory: 6691 loss_kpt: 0.000618 acc_pose: 0.862446 loss: 0.000618 2022/09/23 20:35:48 - mmengine - INFO - Epoch(train) [162][200/293] lr: 5.000000e-04 eta: 1:54:56 time: 0.553226 data_time: 0.097035 memory: 6691 loss_kpt: 0.000607 acc_pose: 0.823472 loss: 0.000607 2022/09/23 20:36:17 - mmengine - INFO - Epoch(train) [162][250/293] lr: 5.000000e-04 eta: 1:54:33 time: 0.563717 data_time: 0.188636 memory: 6691 loss_kpt: 0.000632 acc_pose: 0.824054 loss: 0.000632 2022/09/23 20:36:40 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:37:10 - mmengine - INFO - Epoch(train) [163][50/293] lr: 5.000000e-04 eta: 1:53:43 time: 0.598019 data_time: 0.096173 memory: 6691 loss_kpt: 0.000616 acc_pose: 0.828561 loss: 0.000616 2022/09/23 20:37:38 - mmengine - INFO - Epoch(train) [163][100/293] lr: 5.000000e-04 eta: 1:53:20 time: 0.556506 data_time: 0.211078 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.798519 loss: 0.000617 2022/09/23 20:38:06 - mmengine - INFO - Epoch(train) [163][150/293] lr: 5.000000e-04 eta: 1:52:57 time: 0.559628 data_time: 0.107467 memory: 6691 loss_kpt: 0.000616 acc_pose: 0.840083 loss: 0.000616 2022/09/23 20:38:33 - mmengine - INFO - Epoch(train) [163][200/293] lr: 5.000000e-04 eta: 1:52:33 time: 0.550390 data_time: 0.083870 memory: 6691 loss_kpt: 0.000616 acc_pose: 0.877185 loss: 0.000616 2022/09/23 20:39:02 - mmengine - INFO - Epoch(train) [163][250/293] lr: 5.000000e-04 eta: 1:52:10 time: 0.572555 data_time: 0.095289 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.834740 loss: 0.000615 2022/09/23 20:39:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:39:56 - mmengine - INFO - Epoch(train) [164][50/293] lr: 5.000000e-04 eta: 1:51:20 time: 0.587977 data_time: 0.144830 memory: 6691 loss_kpt: 0.000631 acc_pose: 0.805475 loss: 0.000631 2022/09/23 20:40:25 - mmengine - INFO - Epoch(train) [164][100/293] lr: 5.000000e-04 eta: 1:50:57 time: 0.575215 data_time: 0.109690 memory: 6691 loss_kpt: 0.000604 acc_pose: 0.829729 loss: 0.000604 2022/09/23 20:40:54 - mmengine - INFO - Epoch(train) [164][150/293] lr: 5.000000e-04 eta: 1:50:34 time: 0.589370 data_time: 0.131428 memory: 6691 loss_kpt: 0.000629 acc_pose: 0.859605 loss: 0.000629 2022/09/23 20:41:23 - mmengine - INFO - Epoch(train) [164][200/293] lr: 5.000000e-04 eta: 1:50:11 time: 0.575864 data_time: 0.104026 memory: 6691 loss_kpt: 0.000626 acc_pose: 0.817548 loss: 0.000626 2022/09/23 20:41:46 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:41:51 - mmengine - INFO - Epoch(train) [164][250/293] lr: 5.000000e-04 eta: 1:49:48 time: 0.552457 data_time: 0.115679 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.776339 loss: 0.000620 2022/09/23 20:42:15 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:42:44 - mmengine - INFO - Epoch(train) [165][50/293] lr: 5.000000e-04 eta: 1:48:58 time: 0.582589 data_time: 0.119080 memory: 6691 loss_kpt: 0.000613 acc_pose: 0.800298 loss: 0.000613 2022/09/23 20:43:13 - mmengine - INFO - Epoch(train) [165][100/293] lr: 5.000000e-04 eta: 1:48:35 time: 0.572818 data_time: 0.090817 memory: 6691 loss_kpt: 0.000633 acc_pose: 0.848899 loss: 0.000633 2022/09/23 20:43:40 - mmengine - INFO - Epoch(train) [165][150/293] lr: 5.000000e-04 eta: 1:48:11 time: 0.545838 data_time: 0.222725 memory: 6691 loss_kpt: 0.000609 acc_pose: 0.825992 loss: 0.000609 2022/09/23 20:44:08 - mmengine - INFO - Epoch(train) [165][200/293] lr: 5.000000e-04 eta: 1:47:48 time: 0.568912 data_time: 0.102910 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.811890 loss: 0.000621 2022/09/23 20:44:37 - mmengine - INFO - Epoch(train) [165][250/293] lr: 5.000000e-04 eta: 1:47:25 time: 0.580189 data_time: 0.106005 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.821308 loss: 0.000623 2022/09/23 20:45:02 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:45:30 - mmengine - INFO - Epoch(train) [166][50/293] lr: 5.000000e-04 eta: 1:46:35 time: 0.570132 data_time: 0.141695 memory: 6691 loss_kpt: 0.000611 acc_pose: 0.829890 loss: 0.000611 2022/09/23 20:45:57 - mmengine - INFO - Epoch(train) [166][100/293] lr: 5.000000e-04 eta: 1:46:11 time: 0.543652 data_time: 0.087129 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.818067 loss: 0.000610 2022/09/23 20:46:26 - mmengine - INFO - Epoch(train) [166][150/293] lr: 5.000000e-04 eta: 1:45:48 time: 0.573493 data_time: 0.097881 memory: 6691 loss_kpt: 0.000605 acc_pose: 0.814129 loss: 0.000605 2022/09/23 20:46:55 - mmengine - INFO - Epoch(train) [166][200/293] lr: 5.000000e-04 eta: 1:45:25 time: 0.585746 data_time: 0.101539 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.803132 loss: 0.000610 2022/09/23 20:47:23 - mmengine - INFO - Epoch(train) [166][250/293] lr: 5.000000e-04 eta: 1:45:02 time: 0.548370 data_time: 0.087687 memory: 6691 loss_kpt: 0.000612 acc_pose: 0.849665 loss: 0.000612 2022/09/23 20:47:46 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:48:16 - mmengine - INFO - Epoch(train) [167][50/293] lr: 5.000000e-04 eta: 1:44:12 time: 0.591674 data_time: 0.219555 memory: 6691 loss_kpt: 0.000595 acc_pose: 0.825704 loss: 0.000595 2022/09/23 20:48:43 - mmengine - INFO - Epoch(train) [167][100/293] lr: 5.000000e-04 eta: 1:43:49 time: 0.554175 data_time: 0.184905 memory: 6691 loss_kpt: 0.000621 acc_pose: 0.830160 loss: 0.000621 2022/09/23 20:49:12 - mmengine - INFO - Epoch(train) [167][150/293] lr: 5.000000e-04 eta: 1:43:26 time: 0.579883 data_time: 0.205695 memory: 6691 loss_kpt: 0.000627 acc_pose: 0.813126 loss: 0.000627 2022/09/23 20:49:41 - mmengine - INFO - Epoch(train) [167][200/293] lr: 5.000000e-04 eta: 1:43:02 time: 0.563495 data_time: 0.102011 memory: 6691 loss_kpt: 0.000622 acc_pose: 0.811586 loss: 0.000622 2022/09/23 20:50:09 - mmengine - INFO - Epoch(train) [167][250/293] lr: 5.000000e-04 eta: 1:42:39 time: 0.561172 data_time: 0.116072 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.845641 loss: 0.000615 2022/09/23 20:50:33 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:51:03 - mmengine - INFO - Epoch(train) [168][50/293] lr: 5.000000e-04 eta: 1:41:49 time: 0.593576 data_time: 0.166830 memory: 6691 loss_kpt: 0.000615 acc_pose: 0.844197 loss: 0.000615 2022/09/23 20:51:14 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:51:31 - mmengine - INFO - Epoch(train) [168][100/293] lr: 5.000000e-04 eta: 1:41:26 time: 0.565815 data_time: 0.201803 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.804539 loss: 0.000620 2022/09/23 20:51:59 - mmengine - INFO - Epoch(train) [168][150/293] lr: 5.000000e-04 eta: 1:41:03 time: 0.555370 data_time: 0.122545 memory: 6691 loss_kpt: 0.000623 acc_pose: 0.814280 loss: 0.000623 2022/09/23 20:52:28 - mmengine - INFO - Epoch(train) [168][200/293] lr: 5.000000e-04 eta: 1:40:40 time: 0.582836 data_time: 0.210102 memory: 6691 loss_kpt: 0.000618 acc_pose: 0.839192 loss: 0.000618 2022/09/23 20:52:57 - mmengine - INFO - Epoch(train) [168][250/293] lr: 5.000000e-04 eta: 1:40:16 time: 0.587984 data_time: 0.112953 memory: 6691 loss_kpt: 0.000619 acc_pose: 0.862760 loss: 0.000619 2022/09/23 20:53:21 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:53:50 - mmengine - INFO - Epoch(train) [169][50/293] lr: 5.000000e-04 eta: 1:39:27 time: 0.568696 data_time: 0.148396 memory: 6691 loss_kpt: 0.000636 acc_pose: 0.863465 loss: 0.000636 2022/09/23 20:54:19 - mmengine - INFO - Epoch(train) [169][100/293] lr: 5.000000e-04 eta: 1:39:04 time: 0.584603 data_time: 0.098228 memory: 6691 loss_kpt: 0.000625 acc_pose: 0.829267 loss: 0.000625 2022/09/23 20:54:47 - mmengine - INFO - Epoch(train) [169][150/293] lr: 5.000000e-04 eta: 1:38:40 time: 0.567638 data_time: 0.090194 memory: 6691 loss_kpt: 0.000608 acc_pose: 0.789500 loss: 0.000608 2022/09/23 20:55:15 - mmengine - INFO - Epoch(train) [169][200/293] lr: 5.000000e-04 eta: 1:38:17 time: 0.558547 data_time: 0.098662 memory: 6691 loss_kpt: 0.000628 acc_pose: 0.839493 loss: 0.000628 2022/09/23 20:55:43 - mmengine - INFO - Epoch(train) [169][250/293] lr: 5.000000e-04 eta: 1:37:53 time: 0.561693 data_time: 0.131122 memory: 6691 loss_kpt: 0.000600 acc_pose: 0.875932 loss: 0.000600 2022/09/23 20:56:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:56:38 - mmengine - INFO - Epoch(train) [170][50/293] lr: 5.000000e-04 eta: 1:37:04 time: 0.599247 data_time: 0.106221 memory: 6691 loss_kpt: 0.000618 acc_pose: 0.804853 loss: 0.000618 2022/09/23 20:57:06 - mmengine - INFO - Epoch(train) [170][100/293] lr: 5.000000e-04 eta: 1:36:41 time: 0.566278 data_time: 0.113628 memory: 6691 loss_kpt: 0.000614 acc_pose: 0.861157 loss: 0.000614 2022/09/23 20:57:36 - mmengine - INFO - Epoch(train) [170][150/293] lr: 5.000000e-04 eta: 1:36:18 time: 0.587689 data_time: 0.200354 memory: 6691 loss_kpt: 0.000620 acc_pose: 0.837414 loss: 0.000620 2022/09/23 20:58:04 - mmengine - INFO - Epoch(train) [170][200/293] lr: 5.000000e-04 eta: 1:35:55 time: 0.571865 data_time: 0.266600 memory: 6691 loss_kpt: 0.000603 acc_pose: 0.829783 loss: 0.000603 2022/09/23 20:58:33 - mmengine - INFO - Epoch(train) [170][250/293] lr: 5.000000e-04 eta: 1:35:31 time: 0.568739 data_time: 0.249113 memory: 6691 loss_kpt: 0.000610 acc_pose: 0.802227 loss: 0.000610 2022/09/23 20:58:56 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 20:58:56 - mmengine - INFO - Saving checkpoint at 170 epochs 2022/09/23 20:59:21 - mmengine - INFO - Epoch(val) [170][50/407] eta: 0:02:04 time: 0.348997 data_time: 0.085866 memory: 6691 2022/09/23 20:59:37 - mmengine - INFO - Epoch(val) [170][100/407] eta: 0:01:36 time: 0.315209 data_time: 0.052865 memory: 1014 2022/09/23 20:59:52 - mmengine - INFO - Epoch(val) [170][150/407] eta: 0:01:20 time: 0.312365 data_time: 0.059181 memory: 1014 2022/09/23 21:00:08 - mmengine - INFO - Epoch(val) [170][200/407] eta: 0:01:06 time: 0.320383 data_time: 0.064578 memory: 1014 2022/09/23 21:00:24 - mmengine - INFO - Epoch(val) [170][250/407] eta: 0:00:49 time: 0.316854 data_time: 0.054335 memory: 1014 2022/09/23 21:00:40 - mmengine - INFO - Epoch(val) [170][300/407] eta: 0:00:34 time: 0.322418 data_time: 0.076479 memory: 1014 2022/09/23 21:00:56 - mmengine - INFO - Epoch(val) [170][350/407] eta: 0:00:18 time: 0.323460 data_time: 0.071497 memory: 1014 2022/09/23 21:01:10 - mmengine - INFO - Epoch(val) [170][400/407] eta: 0:00:01 time: 0.267035 data_time: 0.073269 memory: 1014 2022/09/23 21:01:42 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 21:01:55 - mmengine - INFO - Epoch(val) [170][407/407] coco/AP: 0.710428 coco/AP .5: 0.892047 coco/AP .75: 0.786177 coco/AP (M): 0.671680 coco/AP (L): 0.778821 coco/AR: 0.764830 coco/AR .5: 0.929786 coco/AR .75: 0.834225 coco/AR (M): 0.721470 coco/AR (L): 0.827648 2022/09/23 21:01:55 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_130.pth is removed 2022/09/23 21:01:58 - mmengine - INFO - The best checkpoint with 0.7104 coco/AP at 170 epoch is saved to best_coco/AP_epoch_170.pth. 2022/09/23 21:02:26 - mmengine - INFO - Epoch(train) [171][50/293] lr: 5.000000e-05 eta: 1:34:42 time: 0.557326 data_time: 0.262848 memory: 6691 loss_kpt: 0.000609 acc_pose: 0.832457 loss: 0.000609 2022/09/23 21:02:54 - mmengine - INFO - Epoch(train) [171][100/293] lr: 5.000000e-05 eta: 1:34:18 time: 0.557864 data_time: 0.268935 memory: 6691 loss_kpt: 0.000609 acc_pose: 0.849862 loss: 0.000609 2022/09/23 21:03:22 - mmengine - INFO - Epoch(train) [171][150/293] lr: 5.000000e-05 eta: 1:33:55 time: 0.558734 data_time: 0.271764 memory: 6691 loss_kpt: 0.000617 acc_pose: 0.805290 loss: 0.000617 2022/09/23 21:03:45 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:03:50 - mmengine - INFO - Epoch(train) [171][200/293] lr: 5.000000e-05 eta: 1:33:31 time: 0.571582 data_time: 0.159924 memory: 6691 loss_kpt: 0.000602 acc_pose: 0.789377 loss: 0.000602 2022/09/23 21:04:18 - mmengine - INFO - Epoch(train) [171][250/293] lr: 5.000000e-05 eta: 1:33:08 time: 0.558670 data_time: 0.105917 memory: 6691 loss_kpt: 0.000596 acc_pose: 0.859949 loss: 0.000596 2022/09/23 21:04:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:05:13 - mmengine - INFO - Epoch(train) [172][50/293] lr: 5.000000e-05 eta: 1:32:19 time: 0.589396 data_time: 0.273869 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.822118 loss: 0.000589 2022/09/23 21:05:41 - mmengine - INFO - Epoch(train) [172][100/293] lr: 5.000000e-05 eta: 1:31:55 time: 0.561365 data_time: 0.192044 memory: 6691 loss_kpt: 0.000594 acc_pose: 0.854050 loss: 0.000594 2022/09/23 21:06:10 - mmengine - INFO - Epoch(train) [172][150/293] lr: 5.000000e-05 eta: 1:31:32 time: 0.566607 data_time: 0.105100 memory: 6691 loss_kpt: 0.000602 acc_pose: 0.826708 loss: 0.000602 2022/09/23 21:06:38 - mmengine - INFO - Epoch(train) [172][200/293] lr: 5.000000e-05 eta: 1:31:09 time: 0.569135 data_time: 0.213924 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.806197 loss: 0.000575 2022/09/23 21:07:07 - mmengine - INFO - Epoch(train) [172][250/293] lr: 5.000000e-05 eta: 1:30:45 time: 0.584596 data_time: 0.158911 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.768391 loss: 0.000578 2022/09/23 21:07:31 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:08:01 - mmengine - INFO - Epoch(train) [173][50/293] lr: 5.000000e-05 eta: 1:29:57 time: 0.594010 data_time: 0.122379 memory: 6691 loss_kpt: 0.000588 acc_pose: 0.850470 loss: 0.000588 2022/09/23 21:08:30 - mmengine - INFO - Epoch(train) [173][100/293] lr: 5.000000e-05 eta: 1:29:33 time: 0.584075 data_time: 0.101181 memory: 6691 loss_kpt: 0.000592 acc_pose: 0.823358 loss: 0.000592 2022/09/23 21:08:59 - mmengine - INFO - Epoch(train) [173][150/293] lr: 5.000000e-05 eta: 1:29:10 time: 0.568694 data_time: 0.097843 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.823614 loss: 0.000580 2022/09/23 21:09:28 - mmengine - INFO - Epoch(train) [173][200/293] lr: 5.000000e-05 eta: 1:28:46 time: 0.579416 data_time: 0.090278 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.853737 loss: 0.000589 2022/09/23 21:09:56 - mmengine - INFO - Epoch(train) [173][250/293] lr: 5.000000e-05 eta: 1:28:23 time: 0.561341 data_time: 0.094371 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.798107 loss: 0.000575 2022/09/23 21:10:20 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:10:49 - mmengine - INFO - Epoch(train) [174][50/293] lr: 5.000000e-05 eta: 1:27:34 time: 0.583314 data_time: 0.164350 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.852444 loss: 0.000586 2022/09/23 21:11:17 - mmengine - INFO - Epoch(train) [174][100/293] lr: 5.000000e-05 eta: 1:27:11 time: 0.573947 data_time: 0.094079 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.837977 loss: 0.000586 2022/09/23 21:11:45 - mmengine - INFO - Epoch(train) [174][150/293] lr: 5.000000e-05 eta: 1:26:47 time: 0.558794 data_time: 0.099565 memory: 6691 loss_kpt: 0.000598 acc_pose: 0.845111 loss: 0.000598 2022/09/23 21:12:15 - mmengine - INFO - Epoch(train) [174][200/293] lr: 5.000000e-05 eta: 1:26:24 time: 0.590732 data_time: 0.193507 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.896289 loss: 0.000577 2022/09/23 21:12:44 - mmengine - INFO - Epoch(train) [174][250/293] lr: 5.000000e-05 eta: 1:26:00 time: 0.586177 data_time: 0.118490 memory: 6691 loss_kpt: 0.000607 acc_pose: 0.802654 loss: 0.000607 2022/09/23 21:13:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:13:19 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:13:37 - mmengine - INFO - Epoch(train) [175][50/293] lr: 5.000000e-05 eta: 1:25:12 time: 0.577642 data_time: 0.106043 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.785348 loss: 0.000584 2022/09/23 21:14:06 - mmengine - INFO - Epoch(train) [175][100/293] lr: 5.000000e-05 eta: 1:24:48 time: 0.577301 data_time: 0.079650 memory: 6691 loss_kpt: 0.000592 acc_pose: 0.854246 loss: 0.000592 2022/09/23 21:14:34 - mmengine - INFO - Epoch(train) [175][150/293] lr: 5.000000e-05 eta: 1:24:25 time: 0.569507 data_time: 0.144715 memory: 6691 loss_kpt: 0.000588 acc_pose: 0.800400 loss: 0.000588 2022/09/23 21:15:03 - mmengine - INFO - Epoch(train) [175][200/293] lr: 5.000000e-05 eta: 1:24:01 time: 0.575043 data_time: 0.235466 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.839230 loss: 0.000589 2022/09/23 21:15:31 - mmengine - INFO - Epoch(train) [175][250/293] lr: 5.000000e-05 eta: 1:23:38 time: 0.560564 data_time: 0.243939 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.856345 loss: 0.000575 2022/09/23 21:15:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:16:25 - mmengine - INFO - Epoch(train) [176][50/293] lr: 5.000000e-05 eta: 1:22:49 time: 0.602595 data_time: 0.154120 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.867170 loss: 0.000580 2022/09/23 21:16:54 - mmengine - INFO - Epoch(train) [176][100/293] lr: 5.000000e-05 eta: 1:22:26 time: 0.573817 data_time: 0.092497 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.824031 loss: 0.000586 2022/09/23 21:17:22 - mmengine - INFO - Epoch(train) [176][150/293] lr: 5.000000e-05 eta: 1:22:02 time: 0.571109 data_time: 0.095543 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.839494 loss: 0.000584 2022/09/23 21:17:51 - mmengine - INFO - Epoch(train) [176][200/293] lr: 5.000000e-05 eta: 1:21:39 time: 0.567244 data_time: 0.090585 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.865995 loss: 0.000585 2022/09/23 21:18:20 - mmengine - INFO - Epoch(train) [176][250/293] lr: 5.000000e-05 eta: 1:21:15 time: 0.575699 data_time: 0.141460 memory: 6691 loss_kpt: 0.000602 acc_pose: 0.832177 loss: 0.000602 2022/09/23 21:18:45 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:19:14 - mmengine - INFO - Epoch(train) [177][50/293] lr: 5.000000e-05 eta: 1:20:27 time: 0.594129 data_time: 0.191322 memory: 6691 loss_kpt: 0.000583 acc_pose: 0.814666 loss: 0.000583 2022/09/23 21:19:43 - mmengine - INFO - Epoch(train) [177][100/293] lr: 5.000000e-05 eta: 1:20:03 time: 0.563843 data_time: 0.140415 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.839304 loss: 0.000584 2022/09/23 21:20:12 - mmengine - INFO - Epoch(train) [177][150/293] lr: 5.000000e-05 eta: 1:19:40 time: 0.578894 data_time: 0.136658 memory: 6691 loss_kpt: 0.000587 acc_pose: 0.804433 loss: 0.000587 2022/09/23 21:20:41 - mmengine - INFO - Epoch(train) [177][200/293] lr: 5.000000e-05 eta: 1:19:16 time: 0.590059 data_time: 0.092651 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.846663 loss: 0.000567 2022/09/23 21:21:08 - mmengine - INFO - Epoch(train) [177][250/293] lr: 5.000000e-05 eta: 1:18:53 time: 0.538593 data_time: 0.080982 memory: 6691 loss_kpt: 0.000579 acc_pose: 0.831146 loss: 0.000579 2022/09/23 21:21:32 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:22:01 - mmengine - INFO - Epoch(train) [178][50/293] lr: 5.000000e-05 eta: 1:18:04 time: 0.582680 data_time: 0.130954 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.873329 loss: 0.000585 2022/09/23 21:22:31 - mmengine - INFO - Epoch(train) [178][100/293] lr: 5.000000e-05 eta: 1:17:41 time: 0.602930 data_time: 0.142102 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.851230 loss: 0.000589 2022/09/23 21:22:53 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:22:59 - mmengine - INFO - Epoch(train) [178][150/293] lr: 5.000000e-05 eta: 1:17:17 time: 0.564338 data_time: 0.101831 memory: 6691 loss_kpt: 0.000596 acc_pose: 0.863637 loss: 0.000596 2022/09/23 21:23:28 - mmengine - INFO - Epoch(train) [178][200/293] lr: 5.000000e-05 eta: 1:16:54 time: 0.568881 data_time: 0.088905 memory: 6691 loss_kpt: 0.000591 acc_pose: 0.817392 loss: 0.000591 2022/09/23 21:23:56 - mmengine - INFO - Epoch(train) [178][250/293] lr: 5.000000e-05 eta: 1:16:30 time: 0.575975 data_time: 0.102560 memory: 6691 loss_kpt: 0.000587 acc_pose: 0.865403 loss: 0.000587 2022/09/23 21:24:20 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:24:49 - mmengine - INFO - Epoch(train) [179][50/293] lr: 5.000000e-05 eta: 1:15:42 time: 0.581506 data_time: 0.177843 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.827227 loss: 0.000584 2022/09/23 21:25:18 - mmengine - INFO - Epoch(train) [179][100/293] lr: 5.000000e-05 eta: 1:15:18 time: 0.575056 data_time: 0.115948 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.830662 loss: 0.000589 2022/09/23 21:25:46 - mmengine - INFO - Epoch(train) [179][150/293] lr: 5.000000e-05 eta: 1:14:55 time: 0.570165 data_time: 0.079591 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.840877 loss: 0.000578 2022/09/23 21:26:14 - mmengine - INFO - Epoch(train) [179][200/293] lr: 5.000000e-05 eta: 1:14:31 time: 0.542711 data_time: 0.088115 memory: 6691 loss_kpt: 0.000591 acc_pose: 0.805155 loss: 0.000591 2022/09/23 21:26:42 - mmengine - INFO - Epoch(train) [179][250/293] lr: 5.000000e-05 eta: 1:14:07 time: 0.572159 data_time: 0.093484 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.825711 loss: 0.000574 2022/09/23 21:27:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:27:36 - mmengine - INFO - Epoch(train) [180][50/293] lr: 5.000000e-05 eta: 1:13:19 time: 0.584835 data_time: 0.128893 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.859857 loss: 0.000585 2022/09/23 21:28:04 - mmengine - INFO - Epoch(train) [180][100/293] lr: 5.000000e-05 eta: 1:12:55 time: 0.557288 data_time: 0.080463 memory: 6691 loss_kpt: 0.000587 acc_pose: 0.790210 loss: 0.000587 2022/09/23 21:28:32 - mmengine - INFO - Epoch(train) [180][150/293] lr: 5.000000e-05 eta: 1:12:32 time: 0.558504 data_time: 0.102564 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.851138 loss: 0.000584 2022/09/23 21:29:01 - mmengine - INFO - Epoch(train) [180][200/293] lr: 5.000000e-05 eta: 1:12:08 time: 0.578073 data_time: 0.102829 memory: 6691 loss_kpt: 0.000588 acc_pose: 0.872263 loss: 0.000588 2022/09/23 21:29:30 - mmengine - INFO - Epoch(train) [180][250/293] lr: 5.000000e-05 eta: 1:11:45 time: 0.588302 data_time: 0.147226 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.854726 loss: 0.000586 2022/09/23 21:29:55 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:29:55 - mmengine - INFO - Saving checkpoint at 180 epochs 2022/09/23 21:30:18 - mmengine - INFO - Epoch(val) [180][50/407] eta: 0:02:04 time: 0.347886 data_time: 0.111911 memory: 6691 2022/09/23 21:30:34 - mmengine - INFO - Epoch(val) [180][100/407] eta: 0:01:36 time: 0.315653 data_time: 0.059881 memory: 1014 2022/09/23 21:30:51 - mmengine - INFO - Epoch(val) [180][150/407] eta: 0:01:26 time: 0.337505 data_time: 0.108574 memory: 1014 2022/09/23 21:31:07 - mmengine - INFO - Epoch(val) [180][200/407] eta: 0:01:06 time: 0.319739 data_time: 0.072716 memory: 1014 2022/09/23 21:31:24 - mmengine - INFO - Epoch(val) [180][250/407] eta: 0:00:52 time: 0.334711 data_time: 0.108633 memory: 1014 2022/09/23 21:31:40 - mmengine - INFO - Epoch(val) [180][300/407] eta: 0:00:35 time: 0.328690 data_time: 0.095998 memory: 1014 2022/09/23 21:31:57 - mmengine - INFO - Epoch(val) [180][350/407] eta: 0:00:19 time: 0.338243 data_time: 0.108818 memory: 1014 2022/09/23 21:32:09 - mmengine - INFO - Epoch(val) [180][400/407] eta: 0:00:01 time: 0.232324 data_time: 0.058777 memory: 1014 2022/09/23 21:32:41 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 21:32:54 - mmengine - INFO - Epoch(val) [180][407/407] coco/AP: 0.721870 coco/AP .5: 0.896797 coco/AP .75: 0.795444 coco/AP (M): 0.683584 coco/AP (L): 0.789874 coco/AR: 0.774213 coco/AR .5: 0.933879 coco/AR .75: 0.840365 coco/AR (M): 0.731822 coco/AR (L): 0.835637 2022/09/23 21:32:55 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_170.pth is removed 2022/09/23 21:32:57 - mmengine - INFO - The best checkpoint with 0.7219 coco/AP at 180 epoch is saved to best_coco/AP_epoch_180.pth. 2022/09/23 21:33:25 - mmengine - INFO - Epoch(train) [181][50/293] lr: 5.000000e-05 eta: 1:10:56 time: 0.566356 data_time: 0.230886 memory: 6691 loss_kpt: 0.000592 acc_pose: 0.879188 loss: 0.000592 2022/09/23 21:33:54 - mmengine - INFO - Epoch(train) [181][100/293] lr: 5.000000e-05 eta: 1:10:33 time: 0.568077 data_time: 0.187909 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.848099 loss: 0.000584 2022/09/23 21:34:22 - mmengine - INFO - Epoch(train) [181][150/293] lr: 5.000000e-05 eta: 1:10:09 time: 0.568682 data_time: 0.077382 memory: 6691 loss_kpt: 0.000568 acc_pose: 0.828944 loss: 0.000568 2022/09/23 21:34:51 - mmengine - INFO - Epoch(train) [181][200/293] lr: 5.000000e-05 eta: 1:09:45 time: 0.577701 data_time: 0.101987 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.821834 loss: 0.000580 2022/09/23 21:35:20 - mmengine - INFO - Epoch(train) [181][250/293] lr: 5.000000e-05 eta: 1:09:22 time: 0.573964 data_time: 0.218919 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.796537 loss: 0.000589 2022/09/23 21:35:26 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:35:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:36:12 - mmengine - INFO - Epoch(train) [182][50/293] lr: 5.000000e-05 eta: 1:08:34 time: 0.566670 data_time: 0.104237 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.819626 loss: 0.000589 2022/09/23 21:36:40 - mmengine - INFO - Epoch(train) [182][100/293] lr: 5.000000e-05 eta: 1:08:10 time: 0.552298 data_time: 0.079293 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.760515 loss: 0.000580 2022/09/23 21:37:07 - mmengine - INFO - Epoch(train) [182][150/293] lr: 5.000000e-05 eta: 1:07:46 time: 0.551765 data_time: 0.160646 memory: 6691 loss_kpt: 0.000576 acc_pose: 0.791842 loss: 0.000576 2022/09/23 21:37:38 - mmengine - INFO - Epoch(train) [182][200/293] lr: 5.000000e-05 eta: 1:07:23 time: 0.617472 data_time: 0.095085 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.831273 loss: 0.000572 2022/09/23 21:38:06 - mmengine - INFO - Epoch(train) [182][250/293] lr: 5.000000e-05 eta: 1:06:59 time: 0.565339 data_time: 0.138008 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.853542 loss: 0.000580 2022/09/23 21:38:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:39:00 - mmengine - INFO - Epoch(train) [183][50/293] lr: 5.000000e-05 eta: 1:06:11 time: 0.586577 data_time: 0.107537 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.830184 loss: 0.000585 2022/09/23 21:39:28 - mmengine - INFO - Epoch(train) [183][100/293] lr: 5.000000e-05 eta: 1:05:47 time: 0.564489 data_time: 0.091944 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.828844 loss: 0.000567 2022/09/23 21:39:56 - mmengine - INFO - Epoch(train) [183][150/293] lr: 5.000000e-05 eta: 1:05:24 time: 0.572353 data_time: 0.120583 memory: 6691 loss_kpt: 0.000590 acc_pose: 0.868658 loss: 0.000590 2022/09/23 21:40:26 - mmengine - INFO - Epoch(train) [183][200/293] lr: 5.000000e-05 eta: 1:05:00 time: 0.594882 data_time: 0.087926 memory: 6691 loss_kpt: 0.000592 acc_pose: 0.824654 loss: 0.000592 2022/09/23 21:40:54 - mmengine - INFO - Epoch(train) [183][250/293] lr: 5.000000e-05 eta: 1:04:36 time: 0.546003 data_time: 0.092510 memory: 6691 loss_kpt: 0.000570 acc_pose: 0.841640 loss: 0.000570 2022/09/23 21:41:18 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:41:47 - mmengine - INFO - Epoch(train) [184][50/293] lr: 5.000000e-05 eta: 1:03:48 time: 0.578347 data_time: 0.099533 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.834749 loss: 0.000577 2022/09/23 21:42:16 - mmengine - INFO - Epoch(train) [184][100/293] lr: 5.000000e-05 eta: 1:03:25 time: 0.566090 data_time: 0.096610 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.823130 loss: 0.000575 2022/09/23 21:42:43 - mmengine - INFO - Epoch(train) [184][150/293] lr: 5.000000e-05 eta: 1:03:01 time: 0.549711 data_time: 0.224517 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.808342 loss: 0.000572 2022/09/23 21:43:10 - mmengine - INFO - Epoch(train) [184][200/293] lr: 5.000000e-05 eta: 1:02:37 time: 0.540938 data_time: 0.317179 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.800089 loss: 0.000571 2022/09/23 21:43:39 - mmengine - INFO - Epoch(train) [184][250/293] lr: 5.000000e-05 eta: 1:02:13 time: 0.564943 data_time: 0.200277 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.837127 loss: 0.000578 2022/09/23 21:44:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:44:32 - mmengine - INFO - Epoch(train) [185][50/293] lr: 5.000000e-05 eta: 1:01:25 time: 0.581873 data_time: 0.108821 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.827298 loss: 0.000578 2022/09/23 21:44:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:45:01 - mmengine - INFO - Epoch(train) [185][100/293] lr: 5.000000e-05 eta: 1:01:02 time: 0.569750 data_time: 0.135102 memory: 6691 loss_kpt: 0.000576 acc_pose: 0.847626 loss: 0.000576 2022/09/23 21:45:30 - mmengine - INFO - Epoch(train) [185][150/293] lr: 5.000000e-05 eta: 1:00:38 time: 0.589478 data_time: 0.097541 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.835194 loss: 0.000571 2022/09/23 21:45:58 - mmengine - INFO - Epoch(train) [185][200/293] lr: 5.000000e-05 eta: 1:00:14 time: 0.556236 data_time: 0.102806 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.831531 loss: 0.000586 2022/09/23 21:46:27 - mmengine - INFO - Epoch(train) [185][250/293] lr: 5.000000e-05 eta: 0:59:50 time: 0.580121 data_time: 0.199415 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.809136 loss: 0.000578 2022/09/23 21:46:51 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:47:21 - mmengine - INFO - Epoch(train) [186][50/293] lr: 5.000000e-05 eta: 0:59:03 time: 0.607989 data_time: 0.126458 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.825097 loss: 0.000564 2022/09/23 21:47:51 - mmengine - INFO - Epoch(train) [186][100/293] lr: 5.000000e-05 eta: 0:58:39 time: 0.602000 data_time: 0.100670 memory: 6691 loss_kpt: 0.000576 acc_pose: 0.834220 loss: 0.000576 2022/09/23 21:48:21 - mmengine - INFO - Epoch(train) [186][150/293] lr: 5.000000e-05 eta: 0:58:16 time: 0.583338 data_time: 0.123486 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.852953 loss: 0.000572 2022/09/23 21:48:48 - mmengine - INFO - Epoch(train) [186][200/293] lr: 5.000000e-05 eta: 0:57:52 time: 0.557791 data_time: 0.109857 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.855312 loss: 0.000575 2022/09/23 21:49:17 - mmengine - INFO - Epoch(train) [186][250/293] lr: 5.000000e-05 eta: 0:57:28 time: 0.574410 data_time: 0.115182 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.871141 loss: 0.000577 2022/09/23 21:49:42 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:50:10 - mmengine - INFO - Epoch(train) [187][50/293] lr: 5.000000e-05 eta: 0:56:40 time: 0.567069 data_time: 0.135994 memory: 6691 loss_kpt: 0.000583 acc_pose: 0.820322 loss: 0.000583 2022/09/23 21:50:38 - mmengine - INFO - Epoch(train) [187][100/293] lr: 5.000000e-05 eta: 0:56:17 time: 0.556663 data_time: 0.126817 memory: 6691 loss_kpt: 0.000579 acc_pose: 0.811220 loss: 0.000579 2022/09/23 21:51:06 - mmengine - INFO - Epoch(train) [187][150/293] lr: 5.000000e-05 eta: 0:55:53 time: 0.559976 data_time: 0.124334 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.840892 loss: 0.000585 2022/09/23 21:51:33 - mmengine - INFO - Epoch(train) [187][200/293] lr: 5.000000e-05 eta: 0:55:29 time: 0.541010 data_time: 0.098303 memory: 6691 loss_kpt: 0.000590 acc_pose: 0.822492 loss: 0.000590 2022/09/23 21:52:01 - mmengine - INFO - Epoch(train) [187][250/293] lr: 5.000000e-05 eta: 0:55:05 time: 0.565428 data_time: 0.276206 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.833627 loss: 0.000580 2022/09/23 21:52:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:52:55 - mmengine - INFO - Epoch(train) [188][50/293] lr: 5.000000e-05 eta: 0:54:17 time: 0.584827 data_time: 0.197627 memory: 6691 loss_kpt: 0.000561 acc_pose: 0.878429 loss: 0.000561 2022/09/23 21:53:23 - mmengine - INFO - Epoch(train) [188][100/293] lr: 5.000000e-05 eta: 0:53:54 time: 0.561991 data_time: 0.188417 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.820424 loss: 0.000578 2022/09/23 21:53:50 - mmengine - INFO - Epoch(train) [188][150/293] lr: 5.000000e-05 eta: 0:53:30 time: 0.541865 data_time: 0.088372 memory: 6691 loss_kpt: 0.000561 acc_pose: 0.817102 loss: 0.000561 2022/09/23 21:54:19 - mmengine - INFO - Epoch(train) [188][200/293] lr: 5.000000e-05 eta: 0:53:06 time: 0.576252 data_time: 0.120399 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.851360 loss: 0.000575 2022/09/23 21:54:24 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:54:48 - mmengine - INFO - Epoch(train) [188][250/293] lr: 5.000000e-05 eta: 0:52:42 time: 0.579623 data_time: 0.098787 memory: 6691 loss_kpt: 0.000579 acc_pose: 0.827642 loss: 0.000579 2022/09/23 21:55:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:55:41 - mmengine - INFO - Epoch(train) [189][50/293] lr: 5.000000e-05 eta: 0:51:55 time: 0.595096 data_time: 0.148591 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.778306 loss: 0.000574 2022/09/23 21:56:11 - mmengine - INFO - Epoch(train) [189][100/293] lr: 5.000000e-05 eta: 0:51:31 time: 0.595009 data_time: 0.103605 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.836001 loss: 0.000586 2022/09/23 21:56:39 - mmengine - INFO - Epoch(train) [189][150/293] lr: 5.000000e-05 eta: 0:51:07 time: 0.562600 data_time: 0.090613 memory: 6691 loss_kpt: 0.000576 acc_pose: 0.865180 loss: 0.000576 2022/09/23 21:57:09 - mmengine - INFO - Epoch(train) [189][200/293] lr: 5.000000e-05 eta: 0:50:43 time: 0.587182 data_time: 0.144675 memory: 6691 loss_kpt: 0.000582 acc_pose: 0.831144 loss: 0.000582 2022/09/23 21:57:38 - mmengine - INFO - Epoch(train) [189][250/293] lr: 5.000000e-05 eta: 0:50:19 time: 0.577448 data_time: 0.110796 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.817599 loss: 0.000574 2022/09/23 21:58:01 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 21:58:31 - mmengine - INFO - Epoch(train) [190][50/293] lr: 5.000000e-05 eta: 0:49:32 time: 0.599595 data_time: 0.145039 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.852083 loss: 0.000577 2022/09/23 21:59:01 - mmengine - INFO - Epoch(train) [190][100/293] lr: 5.000000e-05 eta: 0:49:09 time: 0.592566 data_time: 0.096774 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.835580 loss: 0.000572 2022/09/23 21:59:28 - mmengine - INFO - Epoch(train) [190][150/293] lr: 5.000000e-05 eta: 0:48:45 time: 0.544198 data_time: 0.083465 memory: 6691 loss_kpt: 0.000555 acc_pose: 0.838176 loss: 0.000555 2022/09/23 21:59:57 - mmengine - INFO - Epoch(train) [190][200/293] lr: 5.000000e-05 eta: 0:48:21 time: 0.566579 data_time: 0.088852 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.829804 loss: 0.000574 2022/09/23 22:00:26 - mmengine - INFO - Epoch(train) [190][250/293] lr: 5.000000e-05 eta: 0:47:57 time: 0.584071 data_time: 0.109106 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.899934 loss: 0.000574 2022/09/23 22:00:50 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:00:50 - mmengine - INFO - Saving checkpoint at 190 epochs 2022/09/23 22:01:15 - mmengine - INFO - Epoch(val) [190][50/407] eta: 0:02:04 time: 0.347434 data_time: 0.090118 memory: 6691 2022/09/23 22:01:31 - mmengine - INFO - Epoch(val) [190][100/407] eta: 0:01:38 time: 0.320037 data_time: 0.066355 memory: 1014 2022/09/23 22:01:47 - mmengine - INFO - Epoch(val) [190][150/407] eta: 0:01:23 time: 0.326613 data_time: 0.077464 memory: 1014 2022/09/23 22:02:03 - mmengine - INFO - Epoch(val) [190][200/407] eta: 0:01:04 time: 0.312666 data_time: 0.058879 memory: 1014 2022/09/23 22:02:19 - mmengine - INFO - Epoch(val) [190][250/407] eta: 0:00:52 time: 0.333996 data_time: 0.071251 memory: 1014 2022/09/23 22:02:35 - mmengine - INFO - Epoch(val) [190][300/407] eta: 0:00:32 time: 0.304054 data_time: 0.052678 memory: 1014 2022/09/23 22:02:52 - mmengine - INFO - Epoch(val) [190][350/407] eta: 0:00:19 time: 0.345578 data_time: 0.085356 memory: 1014 2022/09/23 22:03:03 - mmengine - INFO - Epoch(val) [190][400/407] eta: 0:00:01 time: 0.212406 data_time: 0.044979 memory: 1014 2022/09/23 22:03:35 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 22:03:48 - mmengine - INFO - Epoch(val) [190][407/407] coco/AP: 0.722526 coco/AP .5: 0.896478 coco/AP .75: 0.796664 coco/AP (M): 0.684310 coco/AP (L): 0.790109 coco/AR: 0.775220 coco/AR .5: 0.932620 coco/AR .75: 0.841467 coco/AR (M): 0.732396 coco/AR (L): 0.837495 2022/09/23 22:03:48 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_180.pth is removed 2022/09/23 22:03:51 - mmengine - INFO - The best checkpoint with 0.7225 coco/AP at 190 epoch is saved to best_coco/AP_epoch_190.pth. 2022/09/23 22:04:19 - mmengine - INFO - Epoch(train) [191][50/293] lr: 5.000000e-05 eta: 0:47:10 time: 0.560860 data_time: 0.200320 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.837357 loss: 0.000564 2022/09/23 22:04:47 - mmengine - INFO - Epoch(train) [191][100/293] lr: 5.000000e-05 eta: 0:46:46 time: 0.567819 data_time: 0.122915 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.823491 loss: 0.000573 2022/09/23 22:05:15 - mmengine - INFO - Epoch(train) [191][150/293] lr: 5.000000e-05 eta: 0:46:22 time: 0.568907 data_time: 0.118584 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.858993 loss: 0.000580 2022/09/23 22:05:44 - mmengine - INFO - Epoch(train) [191][200/293] lr: 5.000000e-05 eta: 0:45:58 time: 0.568706 data_time: 0.095829 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.802493 loss: 0.000573 2022/09/23 22:06:11 - mmengine - INFO - Epoch(train) [191][250/293] lr: 5.000000e-05 eta: 0:45:34 time: 0.539894 data_time: 0.084262 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.814846 loss: 0.000575 2022/09/23 22:06:35 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:06:57 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:07:04 - mmengine - INFO - Epoch(train) [192][50/293] lr: 5.000000e-05 eta: 0:44:47 time: 0.587635 data_time: 0.278128 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.822042 loss: 0.000573 2022/09/23 22:07:32 - mmengine - INFO - Epoch(train) [192][100/293] lr: 5.000000e-05 eta: 0:44:23 time: 0.554841 data_time: 0.208955 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.879145 loss: 0.000571 2022/09/23 22:08:00 - mmengine - INFO - Epoch(train) [192][150/293] lr: 5.000000e-05 eta: 0:43:59 time: 0.557254 data_time: 0.104677 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.861454 loss: 0.000577 2022/09/23 22:08:28 - mmengine - INFO - Epoch(train) [192][200/293] lr: 5.000000e-05 eta: 0:43:35 time: 0.564185 data_time: 0.136655 memory: 6691 loss_kpt: 0.000581 acc_pose: 0.835492 loss: 0.000581 2022/09/23 22:08:56 - mmengine - INFO - Epoch(train) [192][250/293] lr: 5.000000e-05 eta: 0:43:11 time: 0.568133 data_time: 0.099053 memory: 6691 loss_kpt: 0.000576 acc_pose: 0.823862 loss: 0.000576 2022/09/23 22:09:21 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:09:50 - mmengine - INFO - Epoch(train) [193][50/293] lr: 5.000000e-05 eta: 0:42:24 time: 0.588830 data_time: 0.122013 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.782814 loss: 0.000585 2022/09/23 22:10:19 - mmengine - INFO - Epoch(train) [193][100/293] lr: 5.000000e-05 eta: 0:42:00 time: 0.564845 data_time: 0.134358 memory: 6691 loss_kpt: 0.000570 acc_pose: 0.858607 loss: 0.000570 2022/09/23 22:10:46 - mmengine - INFO - Epoch(train) [193][150/293] lr: 5.000000e-05 eta: 0:41:36 time: 0.549660 data_time: 0.143501 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.808782 loss: 0.000578 2022/09/23 22:11:14 - mmengine - INFO - Epoch(train) [193][200/293] lr: 5.000000e-05 eta: 0:41:12 time: 0.557802 data_time: 0.106184 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.876771 loss: 0.000578 2022/09/23 22:11:42 - mmengine - INFO - Epoch(train) [193][250/293] lr: 5.000000e-05 eta: 0:40:48 time: 0.555323 data_time: 0.092842 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.846945 loss: 0.000577 2022/09/23 22:12:06 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:12:36 - mmengine - INFO - Epoch(train) [194][50/293] lr: 5.000000e-05 eta: 0:40:01 time: 0.608158 data_time: 0.178872 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.811276 loss: 0.000571 2022/09/23 22:13:04 - mmengine - INFO - Epoch(train) [194][100/293] lr: 5.000000e-05 eta: 0:39:37 time: 0.563137 data_time: 0.175366 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.852431 loss: 0.000573 2022/09/23 22:13:33 - mmengine - INFO - Epoch(train) [194][150/293] lr: 5.000000e-05 eta: 0:39:13 time: 0.563987 data_time: 0.103963 memory: 6691 loss_kpt: 0.000570 acc_pose: 0.830793 loss: 0.000570 2022/09/23 22:14:00 - mmengine - INFO - Epoch(train) [194][200/293] lr: 5.000000e-05 eta: 0:38:49 time: 0.554100 data_time: 0.127460 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.856144 loss: 0.000575 2022/09/23 22:14:28 - mmengine - INFO - Epoch(train) [194][250/293] lr: 5.000000e-05 eta: 0:38:25 time: 0.551237 data_time: 0.200925 memory: 6691 loss_kpt: 0.000582 acc_pose: 0.858360 loss: 0.000582 2022/09/23 22:14:53 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:15:21 - mmengine - INFO - Epoch(train) [195][50/293] lr: 5.000000e-05 eta: 0:37:38 time: 0.576207 data_time: 0.204011 memory: 6691 loss_kpt: 0.000561 acc_pose: 0.831887 loss: 0.000561 2022/09/23 22:15:49 - mmengine - INFO - Epoch(train) [195][100/293] lr: 5.000000e-05 eta: 0:37:14 time: 0.542024 data_time: 0.100074 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.832700 loss: 0.000566 2022/09/23 22:16:17 - mmengine - INFO - Epoch(train) [195][150/293] lr: 5.000000e-05 eta: 0:36:50 time: 0.572951 data_time: 0.114991 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.890573 loss: 0.000566 2022/09/23 22:16:22 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:16:46 - mmengine - INFO - Epoch(train) [195][200/293] lr: 5.000000e-05 eta: 0:36:26 time: 0.566258 data_time: 0.089619 memory: 6691 loss_kpt: 0.000555 acc_pose: 0.839586 loss: 0.000555 2022/09/23 22:17:14 - mmengine - INFO - Epoch(train) [195][250/293] lr: 5.000000e-05 eta: 0:36:02 time: 0.571756 data_time: 0.097371 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.857608 loss: 0.000567 2022/09/23 22:17:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:18:07 - mmengine - INFO - Epoch(train) [196][50/293] lr: 5.000000e-05 eta: 0:35:16 time: 0.582153 data_time: 0.206786 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.871051 loss: 0.000567 2022/09/23 22:18:36 - mmengine - INFO - Epoch(train) [196][100/293] lr: 5.000000e-05 eta: 0:34:52 time: 0.580322 data_time: 0.291504 memory: 6691 loss_kpt: 0.000585 acc_pose: 0.797633 loss: 0.000585 2022/09/23 22:19:04 - mmengine - INFO - Epoch(train) [196][150/293] lr: 5.000000e-05 eta: 0:34:28 time: 0.573382 data_time: 0.127308 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.860731 loss: 0.000577 2022/09/23 22:19:32 - mmengine - INFO - Epoch(train) [196][200/293] lr: 5.000000e-05 eta: 0:34:03 time: 0.557852 data_time: 0.078589 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.815983 loss: 0.000567 2022/09/23 22:20:01 - mmengine - INFO - Epoch(train) [196][250/293] lr: 5.000000e-05 eta: 0:33:39 time: 0.562960 data_time: 0.095735 memory: 6691 loss_kpt: 0.000568 acc_pose: 0.850761 loss: 0.000568 2022/09/23 22:20:24 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:20:53 - mmengine - INFO - Epoch(train) [197][50/293] lr: 5.000000e-05 eta: 0:32:53 time: 0.585430 data_time: 0.146453 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.839233 loss: 0.000580 2022/09/23 22:21:21 - mmengine - INFO - Epoch(train) [197][100/293] lr: 5.000000e-05 eta: 0:32:29 time: 0.548176 data_time: 0.097282 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.871108 loss: 0.000580 2022/09/23 22:21:48 - mmengine - INFO - Epoch(train) [197][150/293] lr: 5.000000e-05 eta: 0:32:05 time: 0.549484 data_time: 0.208974 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.839926 loss: 0.000578 2022/09/23 22:22:16 - mmengine - INFO - Epoch(train) [197][200/293] lr: 5.000000e-05 eta: 0:31:40 time: 0.553468 data_time: 0.182460 memory: 6691 loss_kpt: 0.000552 acc_pose: 0.864637 loss: 0.000552 2022/09/23 22:22:45 - mmengine - INFO - Epoch(train) [197][250/293] lr: 5.000000e-05 eta: 0:31:16 time: 0.574303 data_time: 0.159280 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.818946 loss: 0.000573 2022/09/23 22:23:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:23:37 - mmengine - INFO - Epoch(train) [198][50/293] lr: 5.000000e-05 eta: 0:30:30 time: 0.589852 data_time: 0.142831 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.857305 loss: 0.000575 2022/09/23 22:24:05 - mmengine - INFO - Epoch(train) [198][100/293] lr: 5.000000e-05 eta: 0:30:06 time: 0.557308 data_time: 0.138357 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.844221 loss: 0.000575 2022/09/23 22:24:32 - mmengine - INFO - Epoch(train) [198][150/293] lr: 5.000000e-05 eta: 0:29:42 time: 0.542235 data_time: 0.133618 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.793554 loss: 0.000566 2022/09/23 22:25:01 - mmengine - INFO - Epoch(train) [198][200/293] lr: 5.000000e-05 eta: 0:29:18 time: 0.588232 data_time: 0.128560 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.840803 loss: 0.000567 2022/09/23 22:25:29 - mmengine - INFO - Epoch(train) [198][250/293] lr: 5.000000e-05 eta: 0:28:54 time: 0.558541 data_time: 0.096863 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.807297 loss: 0.000577 2022/09/23 22:25:46 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:25:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:26:24 - mmengine - INFO - Epoch(train) [199][50/293] lr: 5.000000e-05 eta: 0:28:07 time: 0.592753 data_time: 0.192053 memory: 6691 loss_kpt: 0.000581 acc_pose: 0.865153 loss: 0.000581 2022/09/23 22:26:52 - mmengine - INFO - Epoch(train) [199][100/293] lr: 5.000000e-05 eta: 0:27:43 time: 0.565392 data_time: 0.147137 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.826270 loss: 0.000571 2022/09/23 22:27:20 - mmengine - INFO - Epoch(train) [199][150/293] lr: 5.000000e-05 eta: 0:27:19 time: 0.560071 data_time: 0.251769 memory: 6691 loss_kpt: 0.000579 acc_pose: 0.887831 loss: 0.000579 2022/09/23 22:27:48 - mmengine - INFO - Epoch(train) [199][200/293] lr: 5.000000e-05 eta: 0:26:55 time: 0.571659 data_time: 0.253795 memory: 6691 loss_kpt: 0.000571 acc_pose: 0.853602 loss: 0.000571 2022/09/23 22:28:16 - mmengine - INFO - Epoch(train) [199][250/293] lr: 5.000000e-05 eta: 0:26:31 time: 0.557606 data_time: 0.260077 memory: 6691 loss_kpt: 0.000563 acc_pose: 0.876645 loss: 0.000563 2022/09/23 22:28:40 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:29:09 - mmengine - INFO - Epoch(train) [200][50/293] lr: 5.000000e-05 eta: 0:25:45 time: 0.588220 data_time: 0.112305 memory: 6691 loss_kpt: 0.000569 acc_pose: 0.820960 loss: 0.000569 2022/09/23 22:29:38 - mmengine - INFO - Epoch(train) [200][100/293] lr: 5.000000e-05 eta: 0:25:20 time: 0.567273 data_time: 0.130158 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.851693 loss: 0.000566 2022/09/23 22:30:05 - mmengine - INFO - Epoch(train) [200][150/293] lr: 5.000000e-05 eta: 0:24:56 time: 0.539598 data_time: 0.091007 memory: 6691 loss_kpt: 0.000562 acc_pose: 0.892889 loss: 0.000562 2022/09/23 22:30:33 - mmengine - INFO - Epoch(train) [200][200/293] lr: 5.000000e-05 eta: 0:24:32 time: 0.554651 data_time: 0.146443 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.842677 loss: 0.000573 2022/09/23 22:31:01 - mmengine - INFO - Epoch(train) [200][250/293] lr: 5.000000e-05 eta: 0:24:08 time: 0.576048 data_time: 0.108386 memory: 6691 loss_kpt: 0.000581 acc_pose: 0.830241 loss: 0.000581 2022/09/23 22:31:25 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:31:25 - mmengine - INFO - Saving checkpoint at 200 epochs 2022/09/23 22:31:48 - mmengine - INFO - Epoch(val) [200][50/407] eta: 0:02:01 time: 0.341267 data_time: 0.101075 memory: 6691 2022/09/23 22:32:05 - mmengine - INFO - Epoch(val) [200][100/407] eta: 0:01:39 time: 0.325038 data_time: 0.063112 memory: 1014 2022/09/23 22:32:20 - mmengine - INFO - Epoch(val) [200][150/407] eta: 0:01:20 time: 0.311833 data_time: 0.050894 memory: 1014 2022/09/23 22:32:37 - mmengine - INFO - Epoch(val) [200][200/407] eta: 0:01:07 time: 0.326736 data_time: 0.062917 memory: 1014 2022/09/23 22:32:52 - mmengine - INFO - Epoch(val) [200][250/407] eta: 0:00:48 time: 0.307548 data_time: 0.059502 memory: 1014 2022/09/23 22:33:08 - mmengine - INFO - Epoch(val) [200][300/407] eta: 0:00:33 time: 0.310374 data_time: 0.047544 memory: 1014 2022/09/23 22:33:25 - mmengine - INFO - Epoch(val) [200][350/407] eta: 0:00:19 time: 0.338780 data_time: 0.097303 memory: 1014 2022/09/23 22:33:36 - mmengine - INFO - Epoch(val) [200][400/407] eta: 0:00:01 time: 0.236471 data_time: 0.052734 memory: 1014 2022/09/23 22:34:09 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 22:34:21 - mmengine - INFO - Epoch(val) [200][407/407] coco/AP: 0.723826 coco/AP .5: 0.896708 coco/AP .75: 0.797311 coco/AP (M): 0.685808 coco/AP (L): 0.791498 coco/AR: 0.776559 coco/AR .5: 0.933722 coco/AR .75: 0.842569 coco/AR (M): 0.733952 coco/AR (L): 0.838239 2022/09/23 22:34:22 - mmengine - INFO - The previous best checkpoint /mnt/lustre/liqikai/work_dirs/20220923/res50_dark/best_coco/AP_epoch_190.pth is removed 2022/09/23 22:34:24 - mmengine - INFO - The best checkpoint with 0.7238 coco/AP at 200 epoch is saved to best_coco/AP_epoch_200.pth. 2022/09/23 22:34:51 - mmengine - INFO - Epoch(train) [201][50/293] lr: 5.000000e-06 eta: 0:23:22 time: 0.537858 data_time: 0.251342 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.795991 loss: 0.000575 2022/09/23 22:35:20 - mmengine - INFO - Epoch(train) [201][100/293] lr: 5.000000e-06 eta: 0:22:58 time: 0.568042 data_time: 0.178528 memory: 6691 loss_kpt: 0.000559 acc_pose: 0.858649 loss: 0.000559 2022/09/23 22:35:47 - mmengine - INFO - Epoch(train) [201][150/293] lr: 5.000000e-06 eta: 0:22:33 time: 0.546511 data_time: 0.081179 memory: 6691 loss_kpt: 0.000560 acc_pose: 0.827286 loss: 0.000560 2022/09/23 22:36:14 - mmengine - INFO - Epoch(train) [201][200/293] lr: 5.000000e-06 eta: 0:22:09 time: 0.549368 data_time: 0.086564 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.839966 loss: 0.000572 2022/09/23 22:36:43 - mmengine - INFO - Epoch(train) [201][250/293] lr: 5.000000e-06 eta: 0:21:45 time: 0.570071 data_time: 0.095963 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.801295 loss: 0.000564 2022/09/23 22:37:07 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:37:36 - mmengine - INFO - Epoch(train) [202][50/293] lr: 5.000000e-06 eta: 0:20:59 time: 0.585116 data_time: 0.131063 memory: 6691 loss_kpt: 0.000561 acc_pose: 0.830516 loss: 0.000561 2022/09/23 22:38:04 - mmengine - INFO - Epoch(train) [202][100/293] lr: 5.000000e-06 eta: 0:20:35 time: 0.573074 data_time: 0.116232 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.868061 loss: 0.000589 2022/09/23 22:38:08 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:38:33 - mmengine - INFO - Epoch(train) [202][150/293] lr: 5.000000e-06 eta: 0:20:11 time: 0.568353 data_time: 0.145849 memory: 6691 loss_kpt: 0.000558 acc_pose: 0.816249 loss: 0.000558 2022/09/23 22:39:00 - mmengine - INFO - Epoch(train) [202][200/293] lr: 5.000000e-06 eta: 0:19:46 time: 0.547268 data_time: 0.125137 memory: 6691 loss_kpt: 0.000570 acc_pose: 0.822479 loss: 0.000570 2022/09/23 22:39:29 - mmengine - INFO - Epoch(train) [202][250/293] lr: 5.000000e-06 eta: 0:19:22 time: 0.580923 data_time: 0.119720 memory: 6691 loss_kpt: 0.000558 acc_pose: 0.822297 loss: 0.000558 2022/09/23 22:39:54 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:40:23 - mmengine - INFO - Epoch(train) [203][50/293] lr: 5.000000e-06 eta: 0:18:36 time: 0.589545 data_time: 0.211287 memory: 6691 loss_kpt: 0.000557 acc_pose: 0.860288 loss: 0.000557 2022/09/23 22:40:52 - mmengine - INFO - Epoch(train) [203][100/293] lr: 5.000000e-06 eta: 0:18:12 time: 0.570484 data_time: 0.193627 memory: 6691 loss_kpt: 0.000587 acc_pose: 0.837916 loss: 0.000587 2022/09/23 22:41:20 - mmengine - INFO - Epoch(train) [203][150/293] lr: 5.000000e-06 eta: 0:17:48 time: 0.563273 data_time: 0.096038 memory: 6691 loss_kpt: 0.000560 acc_pose: 0.870846 loss: 0.000560 2022/09/23 22:41:49 - mmengine - INFO - Epoch(train) [203][200/293] lr: 5.000000e-06 eta: 0:17:24 time: 0.577973 data_time: 0.122274 memory: 6691 loss_kpt: 0.000570 acc_pose: 0.831148 loss: 0.000570 2022/09/23 22:42:17 - mmengine - INFO - Epoch(train) [203][250/293] lr: 5.000000e-06 eta: 0:17:00 time: 0.562119 data_time: 0.103513 memory: 6691 loss_kpt: 0.000569 acc_pose: 0.844382 loss: 0.000569 2022/09/23 22:42:41 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:43:11 - mmengine - INFO - Epoch(train) [204][50/293] lr: 5.000000e-06 eta: 0:16:14 time: 0.596028 data_time: 0.227069 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.876882 loss: 0.000564 2022/09/23 22:43:39 - mmengine - INFO - Epoch(train) [204][100/293] lr: 5.000000e-06 eta: 0:15:50 time: 0.563138 data_time: 0.113553 memory: 6691 loss_kpt: 0.000561 acc_pose: 0.830213 loss: 0.000561 2022/09/23 22:44:08 - mmengine - INFO - Epoch(train) [204][150/293] lr: 5.000000e-06 eta: 0:15:25 time: 0.566617 data_time: 0.144503 memory: 6691 loss_kpt: 0.000586 acc_pose: 0.841677 loss: 0.000586 2022/09/23 22:44:35 - mmengine - INFO - Epoch(train) [204][200/293] lr: 5.000000e-06 eta: 0:15:01 time: 0.555034 data_time: 0.099479 memory: 6691 loss_kpt: 0.000584 acc_pose: 0.794839 loss: 0.000584 2022/09/23 22:45:04 - mmengine - INFO - Epoch(train) [204][250/293] lr: 5.000000e-06 eta: 0:14:37 time: 0.567773 data_time: 0.086681 memory: 6691 loss_kpt: 0.000556 acc_pose: 0.810569 loss: 0.000556 2022/09/23 22:45:28 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:45:58 - mmengine - INFO - Epoch(train) [205][50/293] lr: 5.000000e-06 eta: 0:13:51 time: 0.590786 data_time: 0.145168 memory: 6691 loss_kpt: 0.000563 acc_pose: 0.854642 loss: 0.000563 2022/09/23 22:46:26 - mmengine - INFO - Epoch(train) [205][100/293] lr: 5.000000e-06 eta: 0:13:27 time: 0.562970 data_time: 0.086369 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.846870 loss: 0.000578 2022/09/23 22:46:54 - mmengine - INFO - Epoch(train) [205][150/293] lr: 5.000000e-06 eta: 0:13:03 time: 0.559824 data_time: 0.090603 memory: 6691 loss_kpt: 0.000553 acc_pose: 0.842515 loss: 0.000553 2022/09/23 22:47:21 - mmengine - INFO - Epoch(train) [205][200/293] lr: 5.000000e-06 eta: 0:12:38 time: 0.545725 data_time: 0.085522 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.815283 loss: 0.000567 2022/09/23 22:47:38 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:47:49 - mmengine - INFO - Epoch(train) [205][250/293] lr: 5.000000e-06 eta: 0:12:14 time: 0.563888 data_time: 0.097077 memory: 6691 loss_kpt: 0.000563 acc_pose: 0.859264 loss: 0.000563 2022/09/23 22:48:12 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:48:41 - mmengine - INFO - Epoch(train) [206][50/293] lr: 5.000000e-06 eta: 0:11:28 time: 0.581884 data_time: 0.105998 memory: 6691 loss_kpt: 0.000569 acc_pose: 0.867641 loss: 0.000569 2022/09/23 22:49:09 - mmengine - INFO - Epoch(train) [206][100/293] lr: 5.000000e-06 eta: 0:11:04 time: 0.556879 data_time: 0.093829 memory: 6691 loss_kpt: 0.000578 acc_pose: 0.871149 loss: 0.000578 2022/09/23 22:49:38 - mmengine - INFO - Epoch(train) [206][150/293] lr: 5.000000e-06 eta: 0:10:40 time: 0.568740 data_time: 0.107769 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.809845 loss: 0.000572 2022/09/23 22:50:06 - mmengine - INFO - Epoch(train) [206][200/293] lr: 5.000000e-06 eta: 0:10:16 time: 0.562897 data_time: 0.083684 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.870762 loss: 0.000567 2022/09/23 22:50:34 - mmengine - INFO - Epoch(train) [206][250/293] lr: 5.000000e-06 eta: 0:09:51 time: 0.565551 data_time: 0.126280 memory: 6691 loss_kpt: 0.000568 acc_pose: 0.874663 loss: 0.000568 2022/09/23 22:50:59 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:51:28 - mmengine - INFO - Epoch(train) [207][50/293] lr: 5.000000e-06 eta: 0:09:06 time: 0.580335 data_time: 0.102580 memory: 6691 loss_kpt: 0.000567 acc_pose: 0.817430 loss: 0.000567 2022/09/23 22:51:56 - mmengine - INFO - Epoch(train) [207][100/293] lr: 5.000000e-06 eta: 0:08:41 time: 0.575590 data_time: 0.089980 memory: 6691 loss_kpt: 0.000575 acc_pose: 0.845119 loss: 0.000575 2022/09/23 22:52:24 - mmengine - INFO - Epoch(train) [207][150/293] lr: 5.000000e-06 eta: 0:08:17 time: 0.549141 data_time: 0.098859 memory: 6691 loss_kpt: 0.000569 acc_pose: 0.850308 loss: 0.000569 2022/09/23 22:52:52 - mmengine - INFO - Epoch(train) [207][200/293] lr: 5.000000e-06 eta: 0:07:53 time: 0.564298 data_time: 0.096274 memory: 6691 loss_kpt: 0.000574 acc_pose: 0.839739 loss: 0.000574 2022/09/23 22:53:20 - mmengine - INFO - Epoch(train) [207][250/293] lr: 5.000000e-06 eta: 0:07:29 time: 0.562395 data_time: 0.103150 memory: 6691 loss_kpt: 0.000580 acc_pose: 0.838998 loss: 0.000580 2022/09/23 22:53:44 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:54:14 - mmengine - INFO - Epoch(train) [208][50/293] lr: 5.000000e-06 eta: 0:06:43 time: 0.601999 data_time: 0.127774 memory: 6691 loss_kpt: 0.000579 acc_pose: 0.862181 loss: 0.000579 2022/09/23 22:54:43 - mmengine - INFO - Epoch(train) [208][100/293] lr: 5.000000e-06 eta: 0:06:19 time: 0.566472 data_time: 0.086765 memory: 6691 loss_kpt: 0.000565 acc_pose: 0.857323 loss: 0.000565 2022/09/23 22:55:10 - mmengine - INFO - Epoch(train) [208][150/293] lr: 5.000000e-06 eta: 0:05:54 time: 0.557872 data_time: 0.096974 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.858786 loss: 0.000564 2022/09/23 22:55:39 - mmengine - INFO - Epoch(train) [208][200/293] lr: 5.000000e-06 eta: 0:05:30 time: 0.565483 data_time: 0.225293 memory: 6691 loss_kpt: 0.000568 acc_pose: 0.828533 loss: 0.000568 2022/09/23 22:56:07 - mmengine - INFO - Epoch(train) [208][250/293] lr: 5.000000e-06 eta: 0:05:06 time: 0.560245 data_time: 0.261405 memory: 6691 loss_kpt: 0.000562 acc_pose: 0.834835 loss: 0.000562 2022/09/23 22:56:30 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:57:00 - mmengine - INFO - Epoch(train) [209][50/293] lr: 5.000000e-06 eta: 0:04:20 time: 0.588022 data_time: 0.207933 memory: 6691 loss_kpt: 0.000560 acc_pose: 0.855291 loss: 0.000560 2022/09/23 22:57:03 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:57:29 - mmengine - INFO - Epoch(train) [209][100/293] lr: 5.000000e-06 eta: 0:03:56 time: 0.575723 data_time: 0.260802 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.866095 loss: 0.000566 2022/09/23 22:57:56 - mmengine - INFO - Epoch(train) [209][150/293] lr: 5.000000e-06 eta: 0:03:32 time: 0.556505 data_time: 0.188567 memory: 6691 loss_kpt: 0.000577 acc_pose: 0.842160 loss: 0.000577 2022/09/23 22:58:24 - mmengine - INFO - Epoch(train) [209][200/293] lr: 5.000000e-06 eta: 0:03:07 time: 0.552926 data_time: 0.089459 memory: 6691 loss_kpt: 0.000563 acc_pose: 0.805240 loss: 0.000563 2022/09/23 22:58:52 - mmengine - INFO - Epoch(train) [209][250/293] lr: 5.000000e-06 eta: 0:02:43 time: 0.566286 data_time: 0.119993 memory: 6691 loss_kpt: 0.000572 acc_pose: 0.830642 loss: 0.000572 2022/09/23 22:59:16 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 22:59:46 - mmengine - INFO - Epoch(train) [210][50/293] lr: 5.000000e-06 eta: 0:01:58 time: 0.590598 data_time: 0.121888 memory: 6691 loss_kpt: 0.000566 acc_pose: 0.826478 loss: 0.000566 2022/09/23 23:00:15 - mmengine - INFO - Epoch(train) [210][100/293] lr: 5.000000e-06 eta: 0:01:33 time: 0.589281 data_time: 0.155278 memory: 6691 loss_kpt: 0.000589 acc_pose: 0.783794 loss: 0.000589 2022/09/23 23:00:44 - mmengine - INFO - Epoch(train) [210][150/293] lr: 5.000000e-06 eta: 0:01:09 time: 0.575802 data_time: 0.253651 memory: 6691 loss_kpt: 0.000573 acc_pose: 0.850457 loss: 0.000573 2022/09/23 23:01:13 - mmengine - INFO - Epoch(train) [210][200/293] lr: 5.000000e-06 eta: 0:00:45 time: 0.567399 data_time: 0.146909 memory: 6691 loss_kpt: 0.000563 acc_pose: 0.833980 loss: 0.000563 2022/09/23 23:01:42 - mmengine - INFO - Epoch(train) [210][250/293] lr: 5.000000e-06 eta: 0:00:20 time: 0.580673 data_time: 0.100058 memory: 6691 loss_kpt: 0.000564 acc_pose: 0.872110 loss: 0.000564 2022/09/23 23:02:05 - mmengine - INFO - Exp name: td-hm_res50_dark-8xb64-210e_coco-256x192_20220923_121744 2022/09/23 23:02:05 - mmengine - INFO - Saving checkpoint at 210 epochs 2022/09/23 23:02:29 - mmengine - INFO - Epoch(val) [210][50/407] eta: 0:02:02 time: 0.342451 data_time: 0.092270 memory: 6691 2022/09/23 23:02:46 - mmengine - INFO - Epoch(val) [210][100/407] eta: 0:01:40 time: 0.327775 data_time: 0.072090 memory: 1014 2022/09/23 23:03:02 - mmengine - INFO - Epoch(val) [210][150/407] eta: 0:01:24 time: 0.327342 data_time: 0.083160 memory: 1014 2022/09/23 23:03:18 - mmengine - INFO - Epoch(val) [210][200/407] eta: 0:01:05 time: 0.318388 data_time: 0.055981 memory: 1014 2022/09/23 23:03:34 - mmengine - INFO - Epoch(val) [210][250/407] eta: 0:00:49 time: 0.312747 data_time: 0.065882 memory: 1014 2022/09/23 23:03:49 - mmengine - INFO - Epoch(val) [210][300/407] eta: 0:00:32 time: 0.300818 data_time: 0.041854 memory: 1014 2022/09/23 23:04:04 - mmengine - INFO - Epoch(val) [210][350/407] eta: 0:00:18 time: 0.316487 data_time: 0.076596 memory: 1014 2022/09/23 23:04:15 - mmengine - INFO - Epoch(val) [210][400/407] eta: 0:00:01 time: 0.220428 data_time: 0.047122 memory: 1014 2022/09/23 23:04:47 - mmengine - INFO - Evaluating CocoMetric... 2022/09/23 23:05:00 - mmengine - INFO - Epoch(val) [210][407/407] coco/AP: 0.723594 coco/AP .5: 0.897113 coco/AP .75: 0.798881 coco/AP (M): 0.686169 coco/AP (L): 0.791309 coco/AR: 0.776448 coco/AR .5: 0.934194 coco/AR .75: 0.843829 coco/AR (M): 0.734007 coco/AR (L): 0.838201