2021-02-02 13:31:49,389 - mmaction - INFO - Environment info: ------------------------------------------------------------ sys.platform: linux Python: 3.7.9 | packaged by conda-forge | (default, Dec 9 2020, 21:08:20) [GCC 9.3.0] CUDA available: True GPU 0: Tesla V100-PCIE-16GB CUDA_HOME: /mnt/lustre/share/cuda-9.2/ NVCC: Cuda compilation tools, release 9.2, V9.2.148 GCC: gcc (GCC) 7.3.0 PyTorch: 1.5.1 PyTorch compiling details: PyTorch built with: - GCC 7.3 - C++ Version: 201402 - Intel(R) Math Kernel Library Version 2019.0.4 Product Build 20190411 for Intel(R) 64 architecture applications - Intel(R) MKL-DNN v0.21.1 (Git Hash 7d2fd500bc78936d1d648ca713b901012f470dbc) - OpenMP 201511 (a.k.a. OpenMP 4.5) - NNPACK is enabled - CPU capability usage: AVX2 - CUDA Runtime 10.1 - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_37,code=compute_37 - CuDNN 7.6.3 - Magma 2.5.2 - Build settings: BLAS=MKL, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DUSE_INTERNAL_THREADPOOL_IMPL -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_STATIC_DISPATCH=OFF, TorchVision: 0.6.0a0+35d732a OpenCV: 4.5.1 MMCV: 1.2.4 MMCV Compiler: GCC 7.3 MMCV CUDA Compiler: 10.1 MMAction2: 0.9.0+3aff7fc ------------------------------------------------------------ 2021-02-02 13:31:49,390 - mmaction - INFO - Distributed training: False 2021-02-02 13:31:49,390 - mmaction - INFO - Config: /mnt/lustre/xusu/refactor/debug_vit/mmaction2/configs/localization/bsn/bsn_pem_400x100_1x16_20e_activitynet_feature.py # model settings model = dict( type='PEM', pem_feat_dim=32, pem_hidden_dim=256, pem_u_ratio_m=1, pem_u_ratio_l=2, pem_high_temporal_iou_threshold=0.6, pem_low_temporal_iou_threshold=2.2, soft_nms_alpha=0.75, soft_nms_low_threshold=0.65, soft_nms_high_threshold=0.9, post_process_top_k=100) # model training and testing settings train_cfg = None test_cfg = dict(average_clips='score') # dataset settings dataset_type = 'ActivityNetDataset' data_root = 'data/ActivityNet/activitynet_feature_cuhk/csv_mean_100/' data_root_val = 'data/ActivityNet/activitynet_feature_cuhk/csv_mean_100/' ann_file_train = 'data/ActivityNet/anet_anno_train.json' ann_file_val = 'data/ActivityNet/anet_anno_val.json' ann_file_test = 'data/ActivityNet/anet_anno_val.json' work_dir = 'work_dirs/bsn_400x100_20e_1x16_activitynet_feature/' pgm_proposals_dir = f'{work_dir}/pgm_proposals/' pgm_features_dir = f'{work_dir}/pgm_features/' test_pipeline = [ dict( type='LoadProposals', top_k=1000, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'tmin', 'tmax', 'tmin_score', 'tmax_score'], meta_name='video_meta', meta_keys=[ 'video_name', 'duration_second', 'duration_frame', 'annotations', 'feature_frame' ]), dict(type='ToTensor', keys=['bsp_feature']) ] train_pipeline = [ dict( type='LoadProposals', top_k=500, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'reference_temporal_iou'], meta_name='video_meta', meta_keys=[]), dict(type='ToTensor', keys=['bsp_feature', 'reference_temporal_iou']), dict( type='ToDataContainer', fields=(dict(key='bsp_feature', stack=False), dict(key='reference_temporal_iou', stack=False))) ] val_pipeline = [ dict( type='LoadProposals', top_k=1000, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'tmin', 'tmax', 'tmin_score', 'tmax_score'], meta_name='video_meta', meta_keys=[ 'video_name', 'duration_second', 'duration_frame', 'annotations', 'feature_frame' ]), dict(type='ToTensor', keys=['bsp_feature']) ] data = dict( videos_per_gpu=16, workers_per_gpu=8, train_dataloader=dict(drop_last=True), val_dataloader=dict(videos_per_gpu=1), test_dataloader=dict(videos_per_gpu=1), test=dict( type=dataset_type, ann_file=ann_file_test, pipeline=test_pipeline, data_prefix=data_root_val), val=dict( type=dataset_type, ann_file=ann_file_val, pipeline=val_pipeline, data_prefix=data_root_val), train=dict( type=dataset_type, ann_file=ann_file_train, pipeline=train_pipeline, data_prefix=data_root)) # optimizer optimizer = dict( type='Adam', lr=0.01, weight_decay=0.00001) # this lr is used for 1 gpus optimizer_config = dict(grad_clip=None) # learning policy lr_config = dict(policy='step', step=10) total_epochs = 20 checkpoint_config = dict(interval=1, filename_tmpl='pem_epoch_{}.pth') evaluation = dict(interval=1, metrics=['AR@AN']) log_config = dict(interval=50, hooks=[dict(type='TextLoggerHook')]) # runtime settings dist_params = dict(backend='nccl') log_level = 'INFO' load_from = None resume_from = None workflow = [('train', 1)] output_config = dict(out=f'{work_dir}/results.json', output_format='json') 2021-02-02 13:31:49,390 - mmaction - INFO - Set random seed to 0, deterministic: True 2021-02-02 13:31:53,203 - mmaction - INFO - Start running, host: xusu@SH-IDC1-10-5-37-42, work_dir: /mnt/lustre/xusu/refactor/debug_vit/mmaction2/work_dirs/bsn_400x100_20e_1x16_activitynet_feature 2021-02-02 13:31:53,203 - mmaction - INFO - workflow: [('train', 1)], max: 20 epochs 2021-02-02 13:31:59,263 - mmaction - INFO - Epoch [1][50/603] lr: 1.000e-02, eta: 0:24:14, time: 0.121, data_time: 0.105, memory: 24, temporal_iou_loss: 0.0409, loss: 0.0409 2021-02-02 13:32:02,500 - mmaction - INFO - Epoch [1][100/603] lr: 1.000e-02, eta: 0:18:31, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0308, loss: 0.0308 2021-02-02 13:32:05,598 - mmaction - INFO - Epoch [1][150/603] lr: 1.000e-02, eta: 0:16:23, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0265, loss: 0.0265 2021-02-02 13:32:08,642 - mmaction - INFO - Epoch [1][200/603] lr: 1.000e-02, eta: 0:15:15, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0261, loss: 0.0261 2021-02-02 13:32:11,920 - mmaction - INFO - Epoch [1][250/603] lr: 1.000e-02, eta: 0:14:43, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:32:15,246 - mmaction - INFO - Epoch [1][300/603] lr: 1.000e-02, eta: 0:14:23, time: 0.067, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:32:18,521 - mmaction - INFO - Epoch [1][350/603] lr: 1.000e-02, eta: 0:14:06, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:32:21,559 - mmaction - INFO - Epoch [1][400/603] lr: 1.000e-02, eta: 0:13:46, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:32:24,804 - mmaction - INFO - Epoch [1][450/603] lr: 1.000e-02, eta: 0:13:35, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:32:28,277 - mmaction - INFO - Epoch [1][500/603] lr: 1.000e-02, eta: 0:13:30, time: 0.069, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:32:31,257 - mmaction - INFO - Epoch [1][550/603] lr: 1.000e-02, eta: 0:13:16, time: 0.060, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:32:34,165 - mmaction - INFO - Epoch [1][600/603] lr: 1.000e-02, eta: 0:13:02, time: 0.058, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:32:34,263 - mmaction - INFO - Saving checkpoint at 1 epochs 2021-02-02 13:32:40,535 - mmaction - INFO - Epoch [2][50/603] lr: 1.000e-02, eta: 0:13:44, time: 0.124, data_time: 0.117, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:32:43,652 - mmaction - INFO - Epoch [2][100/603] lr: 1.000e-02, eta: 0:13:32, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:32:46,867 - mmaction - INFO - Epoch [2][150/603] lr: 1.000e-02, eta: 0:13:23, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:32:49,989 - mmaction - INFO - Epoch [2][200/603] lr: 1.000e-02, eta: 0:13:13, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:32:53,452 - mmaction - INFO - Epoch [2][250/603] lr: 1.000e-02, eta: 0:13:09, time: 0.069, data_time: 0.062, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:32:56,503 - mmaction - INFO - Epoch [2][300/603] lr: 1.000e-02, eta: 0:13:00, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:32:59,598 - mmaction - INFO - Epoch [2][350/603] lr: 1.000e-02, eta: 0:12:52, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:33:02,662 - mmaction - INFO - Epoch [2][400/603] lr: 1.000e-02, eta: 0:12:44, time: 0.061, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:33:06,125 - mmaction - INFO - Epoch [2][450/603] lr: 1.000e-02, eta: 0:12:40, time: 0.069, data_time: 0.062, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:33:09,258 - mmaction - INFO - Epoch [2][500/603] lr: 1.000e-02, eta: 0:12:33, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:33:12,447 - mmaction - INFO - Epoch [2][550/603] lr: 1.000e-02, eta: 0:12:28, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:33:15,356 - mmaction - INFO - Epoch [2][600/603] lr: 1.000e-02, eta: 0:12:20, time: 0.058, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:33:15,690 - mmaction - INFO - Saving checkpoint at 2 epochs 2021-02-02 13:33:21,848 - mmaction - INFO - Epoch [3][50/603] lr: 1.000e-02, eta: 0:12:37, time: 0.122, data_time: 0.115, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:33:24,953 - mmaction - INFO - Epoch [3][100/603] lr: 1.000e-02, eta: 0:12:31, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:33:28,061 - mmaction - INFO - Epoch [3][150/603] lr: 1.000e-02, eta: 0:12:24, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:33:31,179 - mmaction - INFO - Epoch [3][200/603] lr: 1.000e-02, eta: 0:12:18, time: 0.062, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:33:34,468 - mmaction - INFO - Epoch [3][250/603] lr: 1.000e-02, eta: 0:12:13, time: 0.066, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:33:37,543 - mmaction - INFO - Epoch [3][300/603] lr: 1.000e-02, eta: 0:12:07, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:33:40,653 - mmaction - INFO - Epoch [3][350/603] lr: 1.000e-02, eta: 0:12:01, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:33:43,823 - mmaction - INFO - Epoch [3][400/603] lr: 1.000e-02, eta: 0:11:56, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:33:47,120 - mmaction - INFO - Epoch [3][450/603] lr: 1.000e-02, eta: 0:11:52, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0257, loss: 0.0257 2021-02-02 13:33:50,169 - mmaction - INFO - Epoch [3][500/603] lr: 1.000e-02, eta: 0:11:46, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:33:53,355 - mmaction - INFO - Epoch [3][550/603] lr: 1.000e-02, eta: 0:11:41, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:33:56,351 - mmaction - INFO - Epoch [3][600/603] lr: 1.000e-02, eta: 0:11:36, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:33:56,571 - mmaction - INFO - Saving checkpoint at 3 epochs 2021-02-02 13:34:02,669 - mmaction - INFO - Epoch [4][50/603] lr: 1.000e-02, eta: 0:11:45, time: 0.121, data_time: 0.113, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:34:05,805 - mmaction - INFO - Epoch [4][100/603] lr: 1.000e-02, eta: 0:11:40, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:34:08,926 - mmaction - INFO - Epoch [4][150/603] lr: 1.000e-02, eta: 0:11:35, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:34:12,059 - mmaction - INFO - Epoch [4][200/603] lr: 1.000e-02, eta: 0:11:30, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:34:15,239 - mmaction - INFO - Epoch [4][250/603] lr: 1.000e-02, eta: 0:11:25, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:34:18,450 - mmaction - INFO - Epoch [4][300/603] lr: 1.000e-02, eta: 0:11:21, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:34:21,958 - mmaction - INFO - Epoch [4][350/603] lr: 1.000e-02, eta: 0:11:18, time: 0.070, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:34:24,987 - mmaction - INFO - Epoch [4][400/603] lr: 1.000e-02, eta: 0:11:13, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:34:28,165 - mmaction - INFO - Epoch [4][450/603] lr: 1.000e-02, eta: 0:11:08, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:34:31,254 - mmaction - INFO - Epoch [4][500/603] lr: 1.000e-02, eta: 0:11:03, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:34:34,654 - mmaction - INFO - Epoch [4][550/603] lr: 1.000e-02, eta: 0:11:00, time: 0.068, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:34:37,511 - mmaction - INFO - Epoch [4][600/603] lr: 1.000e-02, eta: 0:10:54, time: 0.057, data_time: 0.050, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:34:37,613 - mmaction - INFO - Saving checkpoint at 4 epochs 2021-02-02 13:34:43,682 - mmaction - INFO - Epoch [5][50/603] lr: 1.000e-02, eta: 0:11:00, time: 0.120, data_time: 0.112, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:34:46,842 - mmaction - INFO - Epoch [5][100/603] lr: 1.000e-02, eta: 0:10:56, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:34:50,022 - mmaction - INFO - Epoch [5][150/603] lr: 1.000e-02, eta: 0:10:51, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:34:53,154 - mmaction - INFO - Epoch [5][200/603] lr: 1.000e-02, eta: 0:10:47, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:34:56,392 - mmaction - INFO - Epoch [5][250/603] lr: 1.000e-02, eta: 0:10:43, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:34:59,603 - mmaction - INFO - Epoch [5][300/603] lr: 1.000e-02, eta: 0:10:39, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:35:02,740 - mmaction - INFO - Epoch [5][350/603] lr: 1.000e-02, eta: 0:10:34, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:35:05,819 - mmaction - INFO - Epoch [5][400/603] lr: 1.000e-02, eta: 0:10:30, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:35:09,254 - mmaction - INFO - Epoch [5][450/603] lr: 1.000e-02, eta: 0:10:26, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:35:12,607 - mmaction - INFO - Epoch [5][500/603] lr: 1.000e-02, eta: 0:10:23, time: 0.067, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:35:15,647 - mmaction - INFO - Epoch [5][550/603] lr: 1.000e-02, eta: 0:10:18, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:35:18,474 - mmaction - INFO - Epoch [5][600/603] lr: 1.000e-02, eta: 0:10:13, time: 0.057, data_time: 0.049, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:35:18,783 - mmaction - INFO - Saving checkpoint at 5 epochs 2021-02-02 13:35:24,920 - mmaction - INFO - Epoch [6][50/603] lr: 1.000e-02, eta: 0:10:17, time: 0.122, data_time: 0.114, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:35:28,108 - mmaction - INFO - Epoch [6][100/603] lr: 1.000e-02, eta: 0:10:13, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:35:31,065 - mmaction - INFO - Epoch [6][150/603] lr: 1.000e-02, eta: 0:10:08, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:35:34,237 - mmaction - INFO - Epoch [6][200/603] lr: 1.000e-02, eta: 0:10:04, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:35:37,521 - mmaction - INFO - Epoch [6][250/603] lr: 1.000e-02, eta: 0:10:00, time: 0.066, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:35:40,698 - mmaction - INFO - Epoch [6][300/603] lr: 1.000e-02, eta: 0:09:56, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:35:43,762 - mmaction - INFO - Epoch [6][350/603] lr: 1.000e-02, eta: 0:09:52, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:35:47,212 - mmaction - INFO - Epoch [6][400/603] lr: 1.000e-02, eta: 0:09:48, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0257, loss: 0.0257 2021-02-02 13:35:50,361 - mmaction - INFO - Epoch [6][450/603] lr: 1.000e-02, eta: 0:09:44, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:35:53,330 - mmaction - INFO - Epoch [6][500/603] lr: 1.000e-02, eta: 0:09:40, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:35:56,464 - mmaction - INFO - Epoch [6][550/603] lr: 1.000e-02, eta: 0:09:36, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:35:59,595 - mmaction - INFO - Epoch [6][600/603] lr: 1.000e-02, eta: 0:09:32, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:35:59,769 - mmaction - INFO - Saving checkpoint at 6 epochs 2021-02-02 13:36:05,928 - mmaction - INFO - Epoch [7][50/603] lr: 1.000e-02, eta: 0:09:34, time: 0.122, data_time: 0.114, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:36:09,064 - mmaction - INFO - Epoch [7][100/603] lr: 1.000e-02, eta: 0:09:30, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:36:12,179 - mmaction - INFO - Epoch [7][150/603] lr: 1.000e-02, eta: 0:09:26, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:36:15,393 - mmaction - INFO - Epoch [7][200/603] lr: 1.000e-02, eta: 0:09:22, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:36:18,509 - mmaction - INFO - Epoch [7][250/603] lr: 1.000e-02, eta: 0:09:18, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:36:21,806 - mmaction - INFO - Epoch [7][300/603] lr: 1.000e-02, eta: 0:09:14, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:36:24,759 - mmaction - INFO - Epoch [7][350/603] lr: 1.000e-02, eta: 0:09:10, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:36:28,216 - mmaction - INFO - Epoch [7][400/603] lr: 1.000e-02, eta: 0:09:07, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:36:31,286 - mmaction - INFO - Epoch [7][450/603] lr: 1.000e-02, eta: 0:09:03, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:36:34,397 - mmaction - INFO - Epoch [7][500/603] lr: 1.000e-02, eta: 0:08:59, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:36:37,394 - mmaction - INFO - Epoch [7][550/603] lr: 1.000e-02, eta: 0:08:55, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:36:40,522 - mmaction - INFO - Epoch [7][600/603] lr: 1.000e-02, eta: 0:08:51, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:36:40,722 - mmaction - INFO - Saving checkpoint at 7 epochs 2021-02-02 13:36:46,768 - mmaction - INFO - Epoch [8][50/603] lr: 1.000e-02, eta: 0:08:52, time: 0.120, data_time: 0.112, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:36:49,874 - mmaction - INFO - Epoch [8][100/603] lr: 1.000e-02, eta: 0:08:48, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:36:53,341 - mmaction - INFO - Epoch [8][150/603] lr: 1.000e-02, eta: 0:08:44, time: 0.069, data_time: 0.062, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:36:56,266 - mmaction - INFO - Epoch [8][200/603] lr: 1.000e-02, eta: 0:08:40, time: 0.059, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:36:59,409 - mmaction - INFO - Epoch [8][250/603] lr: 1.000e-02, eta: 0:08:36, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:37:02,842 - mmaction - INFO - Epoch [8][300/603] lr: 1.000e-02, eta: 0:08:33, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:37:06,194 - mmaction - INFO - Epoch [8][350/603] lr: 1.000e-02, eta: 0:08:29, time: 0.067, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:37:09,203 - mmaction - INFO - Epoch [8][400/603] lr: 1.000e-02, eta: 0:08:25, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:37:12,287 - mmaction - INFO - Epoch [8][450/603] lr: 1.000e-02, eta: 0:08:21, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:37:15,950 - mmaction - INFO - Epoch [8][500/603] lr: 1.000e-02, eta: 0:08:18, time: 0.073, data_time: 0.065, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:37:18,969 - mmaction - INFO - Epoch [8][550/603] lr: 1.000e-02, eta: 0:08:14, time: 0.060, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:37:21,892 - mmaction - INFO - Epoch [8][600/603] lr: 1.000e-02, eta: 0:08:10, time: 0.058, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:37:21,999 - mmaction - INFO - Saving checkpoint at 8 epochs 2021-02-02 13:37:28,412 - mmaction - INFO - Epoch [9][50/603] lr: 1.000e-02, eta: 0:08:11, time: 0.127, data_time: 0.119, memory: 24, temporal_iou_loss: 0.0238, loss: 0.0238 2021-02-02 13:37:31,568 - mmaction - INFO - Epoch [9][100/603] lr: 1.000e-02, eta: 0:08:07, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:37:34,705 - mmaction - INFO - Epoch [9][150/603] lr: 1.000e-02, eta: 0:08:03, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:37:37,815 - mmaction - INFO - Epoch [9][200/603] lr: 1.000e-02, eta: 0:07:59, time: 0.062, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:37:41,371 - mmaction - INFO - Epoch [9][250/603] lr: 1.000e-02, eta: 0:07:56, time: 0.071, data_time: 0.064, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:37:44,395 - mmaction - INFO - Epoch [9][300/603] lr: 1.000e-02, eta: 0:07:52, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:37:47,466 - mmaction - INFO - Epoch [9][350/603] lr: 1.000e-02, eta: 0:07:48, time: 0.061, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:37:50,507 - mmaction - INFO - Epoch [9][400/603] lr: 1.000e-02, eta: 0:07:44, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:37:53,933 - mmaction - INFO - Epoch [9][450/603] lr: 1.000e-02, eta: 0:07:41, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:37:57,178 - mmaction - INFO - Epoch [9][500/603] lr: 1.000e-02, eta: 0:07:37, time: 0.065, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0257, loss: 0.0257 2021-02-02 13:38:00,365 - mmaction - INFO - Epoch [9][550/603] lr: 1.000e-02, eta: 0:07:34, time: 0.064, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:38:03,299 - mmaction - INFO - Epoch [9][600/603] lr: 1.000e-02, eta: 0:07:30, time: 0.059, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:38:03,559 - mmaction - INFO - Saving checkpoint at 9 epochs 2021-02-02 13:38:09,824 - mmaction - INFO - Epoch [10][50/603] lr: 1.000e-02, eta: 0:07:29, time: 0.124, data_time: 0.116, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:38:12,920 - mmaction - INFO - Epoch [10][100/603] lr: 1.000e-02, eta: 0:07:26, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:38:15,992 - mmaction - INFO - Epoch [10][150/603] lr: 1.000e-02, eta: 0:07:22, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:38:19,162 - mmaction - INFO - Epoch [10][200/603] lr: 1.000e-02, eta: 0:07:18, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0258, loss: 0.0258 2021-02-02 13:38:22,575 - mmaction - INFO - Epoch [10][250/603] lr: 1.000e-02, eta: 0:07:15, time: 0.068, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:38:25,783 - mmaction - INFO - Epoch [10][300/603] lr: 1.000e-02, eta: 0:07:11, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:38:28,931 - mmaction - INFO - Epoch [10][350/603] lr: 1.000e-02, eta: 0:07:07, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:38:31,953 - mmaction - INFO - Epoch [10][400/603] lr: 1.000e-02, eta: 0:07:04, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:38:35,542 - mmaction - INFO - Epoch [10][450/603] lr: 1.000e-02, eta: 0:07:00, time: 0.072, data_time: 0.065, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:38:38,504 - mmaction - INFO - Epoch [10][500/603] lr: 1.000e-02, eta: 0:06:56, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:38:41,541 - mmaction - INFO - Epoch [10][550/603] lr: 1.000e-02, eta: 0:06:53, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:38:44,527 - mmaction - INFO - Epoch [10][600/603] lr: 1.000e-02, eta: 0:06:49, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:38:44,812 - mmaction - INFO - Saving checkpoint at 10 epochs 2021-02-02 13:38:50,905 - mmaction - INFO - Epoch [11][50/603] lr: 1.000e-03, eta: 0:06:48, time: 0.121, data_time: 0.113, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:38:54,084 - mmaction - INFO - Epoch [11][100/603] lr: 1.000e-03, eta: 0:06:44, time: 0.064, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:38:57,197 - mmaction - INFO - Epoch [11][150/603] lr: 1.000e-03, eta: 0:06:40, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:39:00,287 - mmaction - INFO - Epoch [11][200/603] lr: 1.000e-03, eta: 0:06:37, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:39:03,786 - mmaction - INFO - Epoch [11][250/603] lr: 1.000e-03, eta: 0:06:33, time: 0.070, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:39:06,875 - mmaction - INFO - Epoch [11][300/603] lr: 1.000e-03, eta: 0:06:30, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0257, loss: 0.0257 2021-02-02 13:39:09,985 - mmaction - INFO - Epoch [11][350/603] lr: 1.000e-03, eta: 0:06:26, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:39:13,111 - mmaction - INFO - Epoch [11][400/603] lr: 1.000e-03, eta: 0:06:22, time: 0.063, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:39:16,607 - mmaction - INFO - Epoch [11][450/603] lr: 1.000e-03, eta: 0:06:19, time: 0.070, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:39:19,614 - mmaction - INFO - Epoch [11][500/603] lr: 1.000e-03, eta: 0:06:15, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:39:22,627 - mmaction - INFO - Epoch [11][550/603] lr: 1.000e-03, eta: 0:06:12, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:39:25,653 - mmaction - INFO - Epoch [11][600/603] lr: 1.000e-03, eta: 0:06:08, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:39:25,898 - mmaction - INFO - Saving checkpoint at 11 epochs 2021-02-02 13:39:32,171 - mmaction - INFO - Epoch [12][50/603] lr: 1.000e-03, eta: 0:06:06, time: 0.124, data_time: 0.117, memory: 24, temporal_iou_loss: 0.0257, loss: 0.0257 2021-02-02 13:39:35,238 - mmaction - INFO - Epoch [12][100/603] lr: 1.000e-03, eta: 0:06:03, time: 0.061, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:39:38,254 - mmaction - INFO - Epoch [12][150/603] lr: 1.000e-03, eta: 0:05:59, time: 0.060, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:39:41,495 - mmaction - INFO - Epoch [12][200/603] lr: 1.000e-03, eta: 0:05:55, time: 0.065, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0241, loss: 0.0241 2021-02-02 13:39:44,827 - mmaction - INFO - Epoch [12][250/603] lr: 1.000e-03, eta: 0:05:52, time: 0.067, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:39:47,915 - mmaction - INFO - Epoch [12][300/603] lr: 1.000e-03, eta: 0:05:48, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:39:50,919 - mmaction - INFO - Epoch [12][350/603] lr: 1.000e-03, eta: 0:05:45, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:39:54,282 - mmaction - INFO - Epoch [12][400/603] lr: 1.000e-03, eta: 0:05:41, time: 0.067, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0254, loss: 0.0254 2021-02-02 13:39:57,344 - mmaction - INFO - Epoch [12][450/603] lr: 1.000e-03, eta: 0:05:38, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:40:00,511 - mmaction - INFO - Epoch [12][500/603] lr: 1.000e-03, eta: 0:05:34, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:40:03,657 - mmaction - INFO - Epoch [12][550/603] lr: 1.000e-03, eta: 0:05:30, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:40:06,790 - mmaction - INFO - Epoch [12][600/603] lr: 1.000e-03, eta: 0:05:27, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:40:06,907 - mmaction - INFO - Saving checkpoint at 12 epochs 2021-02-02 13:40:13,125 - mmaction - INFO - Epoch [13][50/603] lr: 1.000e-03, eta: 0:05:25, time: 0.123, data_time: 0.115, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:40:16,209 - mmaction - INFO - Epoch [13][100/603] lr: 1.000e-03, eta: 0:05:21, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:40:19,243 - mmaction - INFO - Epoch [13][150/603] lr: 1.000e-03, eta: 0:05:18, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0240, loss: 0.0240 2021-02-02 13:40:22,356 - mmaction - INFO - Epoch [13][200/603] lr: 1.000e-03, eta: 0:05:14, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:40:25,672 - mmaction - INFO - Epoch [13][250/603] lr: 1.000e-03, eta: 0:05:11, time: 0.066, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:40:28,885 - mmaction - INFO - Epoch [13][300/603] lr: 1.000e-03, eta: 0:05:07, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:40:31,924 - mmaction - INFO - Epoch [13][350/603] lr: 1.000e-03, eta: 0:05:04, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:40:35,146 - mmaction - INFO - Epoch [13][400/603] lr: 1.000e-03, eta: 0:05:00, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:40:38,310 - mmaction - INFO - Epoch [13][450/603] lr: 1.000e-03, eta: 0:04:57, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:40:41,756 - mmaction - INFO - Epoch [13][500/603] lr: 1.000e-03, eta: 0:04:53, time: 0.069, data_time: 0.062, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:40:44,808 - mmaction - INFO - Epoch [13][550/603] lr: 1.000e-03, eta: 0:04:50, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:40:47,792 - mmaction - INFO - Epoch [13][600/603] lr: 1.000e-03, eta: 0:04:46, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:40:47,922 - mmaction - INFO - Saving checkpoint at 13 epochs 2021-02-02 13:40:54,128 - mmaction - INFO - Epoch [14][50/603] lr: 1.000e-03, eta: 0:04:44, time: 0.123, data_time: 0.115, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:40:57,174 - mmaction - INFO - Epoch [14][100/603] lr: 1.000e-03, eta: 0:04:40, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:41:00,291 - mmaction - INFO - Epoch [14][150/603] lr: 1.000e-03, eta: 0:04:37, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:41:03,315 - mmaction - INFO - Epoch [14][200/603] lr: 1.000e-03, eta: 0:04:33, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0240, loss: 0.0240 2021-02-02 13:41:06,884 - mmaction - INFO - Epoch [14][250/603] lr: 1.000e-03, eta: 0:04:30, time: 0.071, data_time: 0.064, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:41:09,959 - mmaction - INFO - Epoch [14][300/603] lr: 1.000e-03, eta: 0:04:26, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:41:13,018 - mmaction - INFO - Epoch [14][350/603] lr: 1.000e-03, eta: 0:04:23, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:41:16,197 - mmaction - INFO - Epoch [14][400/603] lr: 1.000e-03, eta: 0:04:19, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:41:19,329 - mmaction - INFO - Epoch [14][450/603] lr: 1.000e-03, eta: 0:04:16, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0255, loss: 0.0255 2021-02-02 13:41:22,759 - mmaction - INFO - Epoch [14][500/603] lr: 1.000e-03, eta: 0:04:12, time: 0.069, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:41:25,785 - mmaction - INFO - Epoch [14][550/603] lr: 1.000e-03, eta: 0:04:09, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:41:28,711 - mmaction - INFO - Epoch [14][600/603] lr: 1.000e-03, eta: 0:04:05, time: 0.059, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0240, loss: 0.0240 2021-02-02 13:41:28,995 - mmaction - INFO - Saving checkpoint at 14 epochs 2021-02-02 13:41:35,231 - mmaction - INFO - Epoch [15][50/603] lr: 1.000e-03, eta: 0:04:02, time: 0.124, data_time: 0.116, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:41:38,360 - mmaction - INFO - Epoch [15][100/603] lr: 1.000e-03, eta: 0:03:59, time: 0.063, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:41:41,466 - mmaction - INFO - Epoch [15][150/603] lr: 1.000e-03, eta: 0:03:55, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:41:44,638 - mmaction - INFO - Epoch [15][200/603] lr: 1.000e-03, eta: 0:03:52, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:41:47,938 - mmaction - INFO - Epoch [15][250/603] lr: 1.000e-03, eta: 0:03:49, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:41:51,336 - mmaction - INFO - Epoch [15][300/603] lr: 1.000e-03, eta: 0:03:45, time: 0.068, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:41:54,519 - mmaction - INFO - Epoch [15][350/603] lr: 1.000e-03, eta: 0:03:42, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:41:57,484 - mmaction - INFO - Epoch [15][400/603] lr: 1.000e-03, eta: 0:03:38, time: 0.059, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:42:00,712 - mmaction - INFO - Epoch [15][450/603] lr: 1.000e-03, eta: 0:03:35, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0240, loss: 0.0240 2021-02-02 13:42:04,275 - mmaction - INFO - Epoch [15][500/603] lr: 1.000e-03, eta: 0:03:31, time: 0.071, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:42:07,239 - mmaction - INFO - Epoch [15][550/603] lr: 1.000e-03, eta: 0:03:28, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0241, loss: 0.0241 2021-02-02 13:42:10,339 - mmaction - INFO - Epoch [15][600/603] lr: 1.000e-03, eta: 0:03:24, time: 0.062, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:42:10,602 - mmaction - INFO - Saving checkpoint at 15 epochs 2021-02-02 13:42:16,995 - mmaction - INFO - Epoch [16][50/603] lr: 1.000e-03, eta: 0:03:22, time: 0.127, data_time: 0.119, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:42:20,032 - mmaction - INFO - Epoch [16][100/603] lr: 1.000e-03, eta: 0:03:18, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:42:23,113 - mmaction - INFO - Epoch [16][150/603] lr: 1.000e-03, eta: 0:03:15, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:42:26,270 - mmaction - INFO - Epoch [16][200/603] lr: 1.000e-03, eta: 0:03:11, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:42:29,875 - mmaction - INFO - Epoch [16][250/603] lr: 1.000e-03, eta: 0:03:08, time: 0.072, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:42:32,823 - mmaction - INFO - Epoch [16][300/603] lr: 1.000e-03, eta: 0:03:04, time: 0.059, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:42:35,962 - mmaction - INFO - Epoch [16][350/603] lr: 1.000e-03, eta: 0:03:01, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:42:38,906 - mmaction - INFO - Epoch [16][400/603] lr: 1.000e-03, eta: 0:02:57, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:42:42,493 - mmaction - INFO - Epoch [16][450/603] lr: 1.000e-03, eta: 0:02:54, time: 0.072, data_time: 0.064, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:42:45,613 - mmaction - INFO - Epoch [16][500/603] lr: 1.000e-03, eta: 0:02:50, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:42:48,631 - mmaction - INFO - Epoch [16][550/603] lr: 1.000e-03, eta: 0:02:47, time: 0.060, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:42:51,605 - mmaction - INFO - Epoch [16][600/603] lr: 1.000e-03, eta: 0:02:43, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:42:51,876 - mmaction - INFO - Saving checkpoint at 16 epochs 2021-02-02 13:42:58,016 - mmaction - INFO - Epoch [17][50/603] lr: 1.000e-03, eta: 0:02:40, time: 0.122, data_time: 0.114, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:43:01,194 - mmaction - INFO - Epoch [17][100/603] lr: 1.000e-03, eta: 0:02:37, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:43:04,376 - mmaction - INFO - Epoch [17][150/603] lr: 1.000e-03, eta: 0:02:33, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:43:07,428 - mmaction - INFO - Epoch [17][200/603] lr: 1.000e-03, eta: 0:02:30, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:43:10,832 - mmaction - INFO - Epoch [17][250/603] lr: 1.000e-03, eta: 0:02:27, time: 0.068, data_time: 0.061, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:43:13,906 - mmaction - INFO - Epoch [17][300/603] lr: 1.000e-03, eta: 0:02:23, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:43:17,028 - mmaction - INFO - Epoch [17][350/603] lr: 1.000e-03, eta: 0:02:20, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:43:20,136 - mmaction - INFO - Epoch [17][400/603] lr: 1.000e-03, eta: 0:02:16, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:43:23,268 - mmaction - INFO - Epoch [17][450/603] lr: 1.000e-03, eta: 0:02:13, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:43:26,652 - mmaction - INFO - Epoch [17][500/603] lr: 1.000e-03, eta: 0:02:09, time: 0.068, data_time: 0.060, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:43:29,683 - mmaction - INFO - Epoch [17][550/603] lr: 1.000e-03, eta: 0:02:06, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:43:32,659 - mmaction - INFO - Epoch [17][600/603] lr: 1.000e-03, eta: 0:02:02, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:43:32,954 - mmaction - INFO - Saving checkpoint at 17 epochs 2021-02-02 13:43:39,032 - mmaction - INFO - Epoch [18][50/603] lr: 1.000e-03, eta: 0:01:59, time: 0.120, data_time: 0.112, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:43:42,201 - mmaction - INFO - Epoch [18][100/603] lr: 1.000e-03, eta: 0:01:56, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:43:45,245 - mmaction - INFO - Epoch [18][150/603] lr: 1.000e-03, eta: 0:01:52, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:43:48,493 - mmaction - INFO - Epoch [18][200/603] lr: 1.000e-03, eta: 0:01:49, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:43:51,728 - mmaction - INFO - Epoch [18][250/603] lr: 1.000e-03, eta: 0:01:45, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:43:54,759 - mmaction - INFO - Epoch [18][300/603] lr: 1.000e-03, eta: 0:01:42, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:43:58,001 - mmaction - INFO - Epoch [18][350/603] lr: 1.000e-03, eta: 0:01:39, time: 0.065, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:44:01,081 - mmaction - INFO - Epoch [18][400/603] lr: 1.000e-03, eta: 0:01:35, time: 0.062, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0242, loss: 0.0242 2021-02-02 13:44:04,266 - mmaction - INFO - Epoch [18][450/603] lr: 1.000e-03, eta: 0:01:32, time: 0.064, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:44:07,516 - mmaction - INFO - Epoch [18][500/603] lr: 1.000e-03, eta: 0:01:28, time: 0.065, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:44:10,797 - mmaction - INFO - Epoch [18][550/603] lr: 1.000e-03, eta: 0:01:25, time: 0.066, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:44:13,721 - mmaction - INFO - Epoch [18][600/603] lr: 1.000e-03, eta: 0:01:21, time: 0.058, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:44:13,856 - mmaction - INFO - Saving checkpoint at 18 epochs 2021-02-02 13:44:20,031 - mmaction - INFO - Epoch [19][50/603] lr: 1.000e-03, eta: 0:01:18, time: 0.123, data_time: 0.115, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:44:23,214 - mmaction - INFO - Epoch [19][100/603] lr: 1.000e-03, eta: 0:01:15, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:44:26,274 - mmaction - INFO - Epoch [19][150/603] lr: 1.000e-03, eta: 0:01:11, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0249, loss: 0.0249 2021-02-02 13:44:29,421 - mmaction - INFO - Epoch [19][200/603] lr: 1.000e-03, eta: 0:01:08, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:44:32,995 - mmaction - INFO - Epoch [19][250/603] lr: 1.000e-03, eta: 0:01:04, time: 0.071, data_time: 0.064, memory: 24, temporal_iou_loss: 0.0239, loss: 0.0239 2021-02-02 13:44:36,098 - mmaction - INFO - Epoch [19][300/603] lr: 1.000e-03, eta: 0:01:01, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:44:39,084 - mmaction - INFO - Epoch [19][350/603] lr: 1.000e-03, eta: 0:00:58, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0241, loss: 0.0241 2021-02-02 13:44:42,153 - mmaction - INFO - Epoch [19][400/603] lr: 1.000e-03, eta: 0:00:54, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0245, loss: 0.0245 2021-02-02 13:44:45,697 - mmaction - INFO - Epoch [19][450/603] lr: 1.000e-03, eta: 0:00:51, time: 0.071, data_time: 0.063, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:44:48,672 - mmaction - INFO - Epoch [19][500/603] lr: 1.000e-03, eta: 0:00:47, time: 0.060, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0248, loss: 0.0248 2021-02-02 13:44:51,606 - mmaction - INFO - Epoch [19][550/603] lr: 1.000e-03, eta: 0:00:44, time: 0.059, data_time: 0.052, memory: 24, temporal_iou_loss: 0.0253, loss: 0.0253 2021-02-02 13:44:54,636 - mmaction - INFO - Epoch [19][600/603] lr: 1.000e-03, eta: 0:00:41, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0252, loss: 0.0252 2021-02-02 13:44:54,944 - mmaction - INFO - Saving checkpoint at 19 epochs 2021-02-02 13:45:01,180 - mmaction - INFO - Epoch [20][50/603] lr: 1.000e-03, eta: 0:00:37, time: 0.124, data_time: 0.117, memory: 24, temporal_iou_loss: 0.0256, loss: 0.0256 2021-02-02 13:45:04,211 - mmaction - INFO - Epoch [20][100/603] lr: 1.000e-03, eta: 0:00:34, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0243, loss: 0.0243 2021-02-02 13:45:07,259 - mmaction - INFO - Epoch [20][150/603] lr: 1.000e-03, eta: 0:00:30, time: 0.061, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:45:10,405 - mmaction - INFO - Epoch [20][200/603] lr: 1.000e-03, eta: 0:00:27, time: 0.063, data_time: 0.056, memory: 24, temporal_iou_loss: 0.0251, loss: 0.0251 2021-02-02 13:45:13,764 - mmaction - INFO - Epoch [20][250/603] lr: 1.000e-03, eta: 0:00:23, time: 0.067, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0244, loss: 0.0244 2021-02-02 13:45:17,147 - mmaction - INFO - Epoch [20][300/603] lr: 1.000e-03, eta: 0:00:20, time: 0.068, data_time: 0.059, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:45:20,231 - mmaction - INFO - Epoch [20][350/603] lr: 1.000e-03, eta: 0:00:17, time: 0.062, data_time: 0.054, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:45:23,259 - mmaction - INFO - Epoch [20][400/603] lr: 1.000e-03, eta: 0:00:13, time: 0.061, data_time: 0.053, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:45:26,441 - mmaction - INFO - Epoch [20][450/603] lr: 1.000e-03, eta: 0:00:10, time: 0.064, data_time: 0.057, memory: 24, temporal_iou_loss: 0.0247, loss: 0.0247 2021-02-02 13:45:29,661 - mmaction - INFO - Epoch [20][500/603] lr: 1.000e-03, eta: 0:00:06, time: 0.064, data_time: 0.058, memory: 24, temporal_iou_loss: 0.0241, loss: 0.0241 2021-02-02 13:45:32,810 - mmaction - INFO - Epoch [20][550/603] lr: 1.000e-03, eta: 0:00:03, time: 0.063, data_time: 0.055, memory: 24, temporal_iou_loss: 0.0246, loss: 0.0246 2021-02-02 13:45:35,715 - mmaction - INFO - Epoch [20][600/603] lr: 1.000e-03, eta: 0:00:00, time: 0.058, data_time: 0.051, memory: 24, temporal_iou_loss: 0.0250, loss: 0.0250 2021-02-02 13:45:35,974 - mmaction - INFO - Saving checkpoint at 20 epochs