2020-08-07 09:34:52,623 - mmaction - INFO - Environment info: ------------------------------------------------------------ sys.platform: linux Python: 3.6.9 |Anaconda, Inc.| (default, Jul 30 2019, 19:07:31) [GCC 7.3.0] CUDA available: True CUDA_HOME: /mnt/lustre/share/cuda-9.0/ NVCC: Cuda compilation tools, release 9.0, V9.0.176 GPU 0: GeForce GTX 1080 Ti GCC: gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4) PyTorch: 1.1.0+cuda90_cudnn7.6.3_lms PyTorch compiling details: PyTorch built with: - GCC 5.3 - Intel(R) Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel(R) 64 architecture applications - Intel(R) MKL-DNN v0.18.1 (Git Hash 7de7e5d02bf687f971e7668963649728356e0c20) - OpenMP 201307 (a.k.a. OpenMP 4.0) - NNPACK is enabled - CUDA Runtime 9.0 - NVCC architecture flags: -gencode;arch=compute_35,code=sm_35;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_50,code=compute_50 - CuDNN 7.6.3 - Build settings: BLAS=MKL, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -fopenmp -DUSE_FBGEMM -O2 -fPIC -Wno-narrowing -Wall -Wextra -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math, DISABLE_NUMA=1, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=True, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=True, USE_NNPACK=True, USE_OPENMP=ON, TorchVision: 0.2.2 OpenCV: 4.2.0 MMCV: 1.0.3 MMAction2: 0.5.0+7457e5f ------------------------------------------------------------ 2020-08-07 09:34:52,624 - mmaction - INFO - Distributed training: False 2020-08-07 09:34:52,624 - mmaction - INFO - Config: /mnt/lustre/duanhaodong/mmaction2/configs/kennyloc/bsn/bsn_pem_coarse.py # model settings model = dict( type='PEM', pem_feat_dim=32, pem_hidden_dim=256, pem_u_ratio_m=1, pem_u_ratio_l=2, pem_high_temporal_iou_threshold=0.6, pem_low_temporal_iou_threshold=2.2, soft_nms_alpha=0.75, soft_nms_low_threshold=0.65, soft_nms_high_threshold=0.9, post_process_top_k=100) # model training and testing settings train_cfg = None test_cfg = dict(average_clips='score') # dataset settings dataset_type = 'ActivityNetDataset' data_root = 'data/ActivityNet/feat_kenny/' data_root_val = 'data/ActivityNet/feat_kenny/' ann_file_train = 'data/ActivityNet/anet_anno_train.json' ann_file_val = 'data/ActivityNet/anet_anno_val_kenny.json' ann_file_test = 'data/ActivityNet/anet_anno_val_kenny.json' work_dir = 'work_dirs/bsn_coarse_feat/' pgm_proposals_dir = f'{work_dir}/pgm_proposals/' pgm_features_dir = f'{work_dir}/pgm_features/' test_pipeline = [ dict( type='LoadProposals', top_k=1000, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'tmin', 'tmax', 'tmin_score', 'tmax_score'], meta_name='video_meta', meta_keys=[ 'video_name', 'duration_second', 'duration_frame', 'annotations', 'feature_frame' ]), dict(type='ToTensor', keys=['bsp_feature']) ] train_pipeline = [ dict( type='LoadProposals', top_k=500, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'reference_temporal_iou'], meta_name='video_meta', meta_keys=[]), dict(type='ToTensor', keys=['bsp_feature', 'reference_temporal_iou']), dict( type='ToDataContainer', fields=(dict(key='bsp_feature', stack=False), dict(key='reference_temporal_iou', stack=False))) ] val_pipeline = [ dict( type='LoadProposals', top_k=1000, pgm_proposals_dir=pgm_proposals_dir, pgm_features_dir=pgm_features_dir), dict( type='Collect', keys=['bsp_feature', 'tmin', 'tmax', 'tmin_score', 'tmax_score'], meta_name='video_meta', meta_keys=[ 'video_name', 'duration_second', 'duration_frame', 'annotations', 'feature_frame' ]), dict(type='ToTensor', keys=['bsp_feature']) ] data = dict( videos_per_gpu=16, workers_per_gpu=8, train_dataloader=dict(drop_last=True), val_dataloader=dict(videos_per_gpu=1), test=dict( type=dataset_type, ann_file=ann_file_test, pipeline=test_pipeline, data_prefix=data_root_val), val=dict( type=dataset_type, ann_file=ann_file_val, pipeline=val_pipeline, data_prefix=data_root_val), train=dict( type=dataset_type, ann_file=ann_file_train, pipeline=train_pipeline, data_prefix=data_root)) # optimizer optimizer = dict( type='Adam', lr=0.01, weight_decay=0.00001) # this lr is used for 1 gpus optimizer_config = dict(grad_clip=None) # learning policy lr_config = dict(policy='step', step=10) total_epochs = 20 checkpoint_config = dict(interval=1, filename_tmpl='pem_epoch_{}.pth') evaluation = dict(interval=1, metrics=['AR@AN']) log_config = dict(interval=50, hooks=[dict(type='TextLoggerHook')]) # runtime settings dist_params = dict(backend='nccl') log_level = 'INFO' load_from = None resume_from = None workflow = [('train', 1)] output_config = dict(out=f'{work_dir}/results.json', output_format='json') 2020-08-07 09:34:57,682 - mmaction - INFO - Start running, host: duanhaodong@SH-IDC1-10-5-30-140, work_dir: /mnt/lustre/duanhaodong/mmaction2/work_dirs/bsn_coarse_feat 2020-08-07 09:34:57,682 - mmaction - INFO - workflow: [('train', 1)], max: 20 epochs 2020-08-07 09:35:13,457 - mmaction - INFO - Epoch [1][50/603] lr: 1.000e-02, eta: 1:03:07, time: 0.315, data_time: 0.306, memory: 25, temporal_iou_loss: 0.0391, loss: 0.0391 2020-08-07 09:35:24,666 - mmaction - INFO - Epoch [1][100/603] lr: 1.000e-02, eta: 0:53:46, time: 0.224, data_time: 0.218, memory: 25, temporal_iou_loss: 0.0297, loss: 0.0297 2020-08-07 09:35:35,178 - mmaction - INFO - Epoch [1][150/603] lr: 1.000e-02, eta: 0:49:36, time: 0.210, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0268, loss: 0.0268 2020-08-07 09:35:45,329 - mmaction - INFO - Epoch [1][200/603] lr: 1.000e-02, eta: 0:47:04, time: 0.203, data_time: 0.197, memory: 25, temporal_iou_loss: 0.0273, loss: 0.0273 2020-08-07 09:35:57,243 - mmaction - INFO - Epoch [1][250/603] lr: 1.000e-02, eta: 0:46:53, time: 0.238, data_time: 0.232, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:36:08,145 - mmaction - INFO - Epoch [1][300/603] lr: 1.000e-02, eta: 0:46:01, time: 0.218, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:36:18,683 - mmaction - INFO - Epoch [1][350/603] lr: 1.000e-02, eta: 0:45:09, time: 0.211, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:36:29,837 - mmaction - INFO - Epoch [1][400/603] lr: 1.000e-02, eta: 0:44:46, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0270, loss: 0.0270 2020-08-07 09:36:41,141 - mmaction - INFO - Epoch [1][450/603] lr: 1.000e-02, eta: 0:44:28, time: 0.226, data_time: 0.220, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:36:52,017 - mmaction - INFO - Epoch [1][500/603] lr: 1.000e-02, eta: 0:44:03, time: 0.218, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:37:03,444 - mmaction - INFO - Epoch [1][550/603] lr: 1.000e-02, eta: 0:43:51, time: 0.229, data_time: 0.222, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:37:13,981 - mmaction - INFO - Epoch [1][600/603] lr: 1.000e-02, eta: 0:43:23, time: 0.211, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:37:15,124 - mmaction - INFO - Saving checkpoint at 1 epochs 2020-08-07 09:37:30,005 - mmaction - INFO - Epoch [2][50/603] lr: 1.000e-02, eta: 0:43:56, time: 0.293, data_time: 0.286, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:37:41,544 - mmaction - INFO - Epoch [2][100/603] lr: 1.000e-02, eta: 0:43:44, time: 0.231, data_time: 0.224, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:37:52,277 - mmaction - INFO - Epoch [2][150/603] lr: 1.000e-02, eta: 0:43:20, time: 0.215, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:38:03,014 - mmaction - INFO - Epoch [2][200/603] lr: 1.000e-02, eta: 0:42:58, time: 0.215, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 09:38:13,643 - mmaction - INFO - Epoch [2][250/603] lr: 1.000e-02, eta: 0:42:36, time: 0.213, data_time: 0.206, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:38:25,877 - mmaction - INFO - Epoch [2][300/603] lr: 1.000e-02, eta: 0:42:35, time: 0.245, data_time: 0.238, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:38:36,700 - mmaction - INFO - Epoch [2][350/603] lr: 1.000e-02, eta: 0:42:16, time: 0.216, data_time: 0.210, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:38:47,243 - mmaction - INFO - Epoch [2][400/603] lr: 1.000e-02, eta: 0:41:55, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:38:57,879 - mmaction - INFO - Epoch [2][450/603] lr: 1.000e-02, eta: 0:41:36, time: 0.213, data_time: 0.206, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:39:09,898 - mmaction - INFO - Epoch [2][500/603] lr: 1.000e-02, eta: 0:41:31, time: 0.240, data_time: 0.234, memory: 25, temporal_iou_loss: 0.0264, loss: 0.0264 2020-08-07 09:39:20,960 - mmaction - INFO - Epoch [2][550/603] lr: 1.000e-02, eta: 0:41:17, time: 0.221, data_time: 0.215, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:39:31,129 - mmaction - INFO - Epoch [2][600/603] lr: 1.000e-02, eta: 0:40:55, time: 0.203, data_time: 0.197, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:39:31,848 - mmaction - INFO - Saving checkpoint at 2 epochs 2020-08-07 09:39:47,255 - mmaction - INFO - Epoch [3][50/603] lr: 1.000e-02, eta: 0:41:11, time: 0.304, data_time: 0.297, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:39:58,031 - mmaction - INFO - Epoch [3][100/603] lr: 1.000e-02, eta: 0:40:54, time: 0.216, data_time: 0.210, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 09:40:09,084 - mmaction - INFO - Epoch [3][150/603] lr: 1.000e-02, eta: 0:40:39, time: 0.221, data_time: 0.215, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:40:19,809 - mmaction - INFO - Epoch [3][200/603] lr: 1.000e-02, eta: 0:40:23, time: 0.215, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 09:40:30,968 - mmaction - INFO - Epoch [3][250/603] lr: 1.000e-02, eta: 0:40:10, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:40:43,698 - mmaction - INFO - Epoch [3][300/603] lr: 1.000e-02, eta: 0:40:08, time: 0.255, data_time: 0.248, memory: 25, temporal_iou_loss: 0.0264, loss: 0.0264 2020-08-07 09:40:53,662 - mmaction - INFO - Epoch [3][350/603] lr: 1.000e-02, eta: 0:39:47, time: 0.199, data_time: 0.193, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:41:04,008 - mmaction - INFO - Epoch [3][400/603] lr: 1.000e-02, eta: 0:39:29, time: 0.207, data_time: 0.200, memory: 25, temporal_iou_loss: 0.0266, loss: 0.0266 2020-08-07 09:41:15,514 - mmaction - INFO - Epoch [3][450/603] lr: 1.000e-02, eta: 0:39:19, time: 0.230, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:41:25,725 - mmaction - INFO - Epoch [3][500/603] lr: 1.000e-02, eta: 0:39:01, time: 0.204, data_time: 0.198, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:41:37,437 - mmaction - INFO - Epoch [3][550/603] lr: 1.000e-02, eta: 0:38:52, time: 0.234, data_time: 0.228, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:41:48,159 - mmaction - INFO - Epoch [3][600/603] lr: 1.000e-02, eta: 0:38:37, time: 0.214, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:41:48,539 - mmaction - INFO - Saving checkpoint at 3 epochs 2020-08-07 09:42:03,707 - mmaction - INFO - Epoch [4][50/603] lr: 1.000e-02, eta: 0:38:42, time: 0.300, data_time: 0.293, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:42:15,101 - mmaction - INFO - Epoch [4][100/603] lr: 1.000e-02, eta: 0:38:30, time: 0.228, data_time: 0.222, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 09:42:26,473 - mmaction - INFO - Epoch [4][150/603] lr: 1.000e-02, eta: 0:38:19, time: 0.227, data_time: 0.221, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:42:36,684 - mmaction - INFO - Epoch [4][200/603] lr: 1.000e-02, eta: 0:38:02, time: 0.204, data_time: 0.198, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:42:48,486 - mmaction - INFO - Epoch [4][250/603] lr: 1.000e-02, eta: 0:37:52, time: 0.236, data_time: 0.230, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:42:59,645 - mmaction - INFO - Epoch [4][300/603] lr: 1.000e-02, eta: 0:37:40, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:43:10,481 - mmaction - INFO - Epoch [4][350/603] lr: 1.000e-02, eta: 0:37:26, time: 0.217, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0266, loss: 0.0266 2020-08-07 09:43:20,908 - mmaction - INFO - Epoch [4][400/603] lr: 1.000e-02, eta: 0:37:11, time: 0.209, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:43:33,862 - mmaction - INFO - Epoch [4][450/603] lr: 1.000e-02, eta: 0:37:07, time: 0.259, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:43:44,245 - mmaction - INFO - Epoch [4][500/603] lr: 1.000e-02, eta: 0:36:51, time: 0.208, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:43:55,220 - mmaction - INFO - Epoch [4][550/603] lr: 1.000e-02, eta: 0:36:38, time: 0.220, data_time: 0.213, memory: 25, temporal_iou_loss: 0.0265, loss: 0.0265 2020-08-07 09:44:04,753 - mmaction - INFO - Epoch [4][600/603] lr: 1.000e-02, eta: 0:36:20, time: 0.191, data_time: 0.185, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:44:05,810 - mmaction - INFO - Saving checkpoint at 4 epochs 2020-08-07 09:44:20,895 - mmaction - INFO - Epoch [5][50/603] lr: 1.000e-02, eta: 0:36:18, time: 0.294, data_time: 0.286, memory: 25, temporal_iou_loss: 0.0269, loss: 0.0269 2020-08-07 09:44:31,993 - mmaction - INFO - Epoch [5][100/603] lr: 1.000e-02, eta: 0:36:06, time: 0.222, data_time: 0.215, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:44:43,338 - mmaction - INFO - Epoch [5][150/603] lr: 1.000e-02, eta: 0:35:55, time: 0.227, data_time: 0.221, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:44:53,600 - mmaction - INFO - Epoch [5][200/603] lr: 1.000e-02, eta: 0:35:39, time: 0.205, data_time: 0.199, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:45:05,299 - mmaction - INFO - Epoch [5][250/603] lr: 1.000e-02, eta: 0:35:29, time: 0.234, data_time: 0.227, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 09:45:15,746 - mmaction - INFO - Epoch [5][300/603] lr: 1.000e-02, eta: 0:35:15, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:45:28,374 - mmaction - INFO - Epoch [5][350/603] lr: 1.000e-02, eta: 0:35:08, time: 0.253, data_time: 0.246, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:45:38,601 - mmaction - INFO - Epoch [5][400/603] lr: 1.000e-02, eta: 0:34:53, time: 0.205, data_time: 0.198, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:45:48,965 - mmaction - INFO - Epoch [5][450/603] lr: 1.000e-02, eta: 0:34:39, time: 0.207, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:46:00,879 - mmaction - INFO - Epoch [5][500/603] lr: 1.000e-02, eta: 0:34:29, time: 0.238, data_time: 0.232, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 09:46:11,447 - mmaction - INFO - Epoch [5][550/603] lr: 1.000e-02, eta: 0:34:16, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 09:46:22,100 - mmaction - INFO - Epoch [5][600/603] lr: 1.000e-02, eta: 0:34:03, time: 0.213, data_time: 0.207, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:46:23,363 - mmaction - INFO - Saving checkpoint at 5 epochs 2020-08-07 09:46:38,072 - mmaction - INFO - Epoch [6][50/603] lr: 1.000e-02, eta: 0:33:58, time: 0.291, data_time: 0.284, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:46:48,506 - mmaction - INFO - Epoch [6][100/603] lr: 1.000e-02, eta: 0:33:44, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:47:01,413 - mmaction - INFO - Epoch [6][150/603] lr: 1.000e-02, eta: 0:33:37, time: 0.258, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:47:11,388 - mmaction - INFO - Epoch [6][200/603] lr: 1.000e-02, eta: 0:33:22, time: 0.199, data_time: 0.193, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:47:23,090 - mmaction - INFO - Epoch [6][250/603] lr: 1.000e-02, eta: 0:33:12, time: 0.234, data_time: 0.228, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:47:34,581 - mmaction - INFO - Epoch [6][300/603] lr: 1.000e-02, eta: 0:33:01, time: 0.230, data_time: 0.224, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:47:45,626 - mmaction - INFO - Epoch [6][350/603] lr: 1.000e-02, eta: 0:32:49, time: 0.221, data_time: 0.215, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:47:56,895 - mmaction - INFO - Epoch [6][400/603] lr: 1.000e-02, eta: 0:32:37, time: 0.225, data_time: 0.219, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:48:07,393 - mmaction - INFO - Epoch [6][450/603] lr: 1.000e-02, eta: 0:32:24, time: 0.210, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:48:17,918 - mmaction - INFO - Epoch [6][500/603] lr: 1.000e-02, eta: 0:32:11, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:48:29,575 - mmaction - INFO - Epoch [6][550/603] lr: 1.000e-02, eta: 0:32:00, time: 0.233, data_time: 0.226, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:48:40,115 - mmaction - INFO - Epoch [6][600/603] lr: 1.000e-02, eta: 0:31:47, time: 0.211, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0264, loss: 0.0264 2020-08-07 09:48:40,449 - mmaction - INFO - Saving checkpoint at 6 epochs 2020-08-07 09:48:55,336 - mmaction - INFO - Epoch [7][50/603] lr: 1.000e-02, eta: 0:31:42, time: 0.294, data_time: 0.288, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:49:06,739 - mmaction - INFO - Epoch [7][100/603] lr: 1.000e-02, eta: 0:31:30, time: 0.228, data_time: 0.222, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:49:17,213 - mmaction - INFO - Epoch [7][150/603] lr: 1.000e-02, eta: 0:31:17, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 09:49:27,285 - mmaction - INFO - Epoch [7][200/603] lr: 1.000e-02, eta: 0:31:03, time: 0.201, data_time: 0.195, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:49:40,015 - mmaction - INFO - Epoch [7][250/603] lr: 1.000e-02, eta: 0:30:55, time: 0.255, data_time: 0.248, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:49:50,663 - mmaction - INFO - Epoch [7][300/603] lr: 1.000e-02, eta: 0:30:42, time: 0.213, data_time: 0.207, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:50:01,971 - mmaction - INFO - Epoch [7][350/603] lr: 1.000e-02, eta: 0:30:31, time: 0.226, data_time: 0.220, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:50:13,541 - mmaction - INFO - Epoch [7][400/603] lr: 1.000e-02, eta: 0:30:20, time: 0.231, data_time: 0.225, memory: 25, temporal_iou_loss: 0.0268, loss: 0.0268 2020-08-07 09:50:25,248 - mmaction - INFO - Epoch [7][450/603] lr: 1.000e-02, eta: 0:30:10, time: 0.234, data_time: 0.228, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:50:36,129 - mmaction - INFO - Epoch [7][500/603] lr: 1.000e-02, eta: 0:29:57, time: 0.218, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:50:47,129 - mmaction - INFO - Epoch [7][550/603] lr: 1.000e-02, eta: 0:29:45, time: 0.220, data_time: 0.214, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:50:57,007 - mmaction - INFO - Epoch [7][600/603] lr: 1.000e-02, eta: 0:29:31, time: 0.198, data_time: 0.191, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:50:58,626 - mmaction - INFO - Saving checkpoint at 7 epochs 2020-08-07 09:51:13,775 - mmaction - INFO - Epoch [8][50/603] lr: 1.000e-02, eta: 0:29:25, time: 0.299, data_time: 0.293, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:51:25,263 - mmaction - INFO - Epoch [8][100/603] lr: 1.000e-02, eta: 0:29:14, time: 0.230, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:51:35,618 - mmaction - INFO - Epoch [8][150/603] lr: 1.000e-02, eta: 0:29:01, time: 0.207, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:51:46,260 - mmaction - INFO - Epoch [8][200/603] lr: 1.000e-02, eta: 0:28:48, time: 0.213, data_time: 0.207, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 09:51:57,790 - mmaction - INFO - Epoch [8][250/603] lr: 1.000e-02, eta: 0:28:37, time: 0.230, data_time: 0.224, memory: 25, temporal_iou_loss: 0.0267, loss: 0.0267 2020-08-07 09:52:08,908 - mmaction - INFO - Epoch [8][300/603] lr: 1.000e-02, eta: 0:28:26, time: 0.222, data_time: 0.216, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:52:20,101 - mmaction - INFO - Epoch [8][350/603] lr: 1.000e-02, eta: 0:28:14, time: 0.224, data_time: 0.218, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:52:30,903 - mmaction - INFO - Epoch [8][400/603] lr: 1.000e-02, eta: 0:28:02, time: 0.216, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:52:42,701 - mmaction - INFO - Epoch [8][450/603] lr: 1.000e-02, eta: 0:27:51, time: 0.236, data_time: 0.229, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:52:52,825 - mmaction - INFO - Epoch [8][500/603] lr: 1.000e-02, eta: 0:27:38, time: 0.203, data_time: 0.196, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:53:03,588 - mmaction - INFO - Epoch [8][550/603] lr: 1.000e-02, eta: 0:27:26, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:53:15,286 - mmaction - INFO - Epoch [8][600/603] lr: 1.000e-02, eta: 0:27:16, time: 0.234, data_time: 0.228, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:53:15,409 - mmaction - INFO - Saving checkpoint at 8 epochs 2020-08-07 09:53:30,066 - mmaction - INFO - Epoch [9][50/603] lr: 1.000e-02, eta: 0:27:07, time: 0.289, data_time: 0.283, memory: 25, temporal_iou_loss: 0.0267, loss: 0.0267 2020-08-07 09:53:41,534 - mmaction - INFO - Epoch [9][100/603] lr: 1.000e-02, eta: 0:26:56, time: 0.230, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 09:53:52,302 - mmaction - INFO - Epoch [9][150/603] lr: 1.000e-02, eta: 0:26:44, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:54:03,068 - mmaction - INFO - Epoch [9][200/603] lr: 1.000e-02, eta: 0:26:32, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:54:14,003 - mmaction - INFO - Epoch [9][250/603] lr: 1.000e-02, eta: 0:26:20, time: 0.219, data_time: 0.213, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:54:24,761 - mmaction - INFO - Epoch [9][300/603] lr: 1.000e-02, eta: 0:26:08, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:54:35,923 - mmaction - INFO - Epoch [9][350/603] lr: 1.000e-02, eta: 0:25:56, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:54:46,932 - mmaction - INFO - Epoch [9][400/603] lr: 1.000e-02, eta: 0:25:45, time: 0.220, data_time: 0.214, memory: 25, temporal_iou_loss: 0.0268, loss: 0.0268 2020-08-07 09:54:58,571 - mmaction - INFO - Epoch [9][450/603] lr: 1.000e-02, eta: 0:25:34, time: 0.233, data_time: 0.227, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 09:55:10,844 - mmaction - INFO - Epoch [9][500/603] lr: 1.000e-02, eta: 0:25:24, time: 0.245, data_time: 0.239, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:55:21,093 - mmaction - INFO - Epoch [9][550/603] lr: 1.000e-02, eta: 0:25:11, time: 0.205, data_time: 0.199, memory: 25, temporal_iou_loss: 0.0269, loss: 0.0269 2020-08-07 09:55:31,131 - mmaction - INFO - Epoch [9][600/603] lr: 1.000e-02, eta: 0:24:58, time: 0.201, data_time: 0.194, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:55:32,643 - mmaction - INFO - Saving checkpoint at 9 epochs 2020-08-07 09:55:47,151 - mmaction - INFO - Epoch [10][50/603] lr: 1.000e-02, eta: 0:24:49, time: 0.286, data_time: 0.279, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:55:58,861 - mmaction - INFO - Epoch [10][100/603] lr: 1.000e-02, eta: 0:24:38, time: 0.234, data_time: 0.227, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:56:09,789 - mmaction - INFO - Epoch [10][150/603] lr: 1.000e-02, eta: 0:24:27, time: 0.219, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0264, loss: 0.0264 2020-08-07 09:56:20,232 - mmaction - INFO - Epoch [10][200/603] lr: 1.000e-02, eta: 0:24:14, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 09:56:31,341 - mmaction - INFO - Epoch [10][250/603] lr: 1.000e-02, eta: 0:24:03, time: 0.222, data_time: 0.216, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:56:43,723 - mmaction - INFO - Epoch [10][300/603] lr: 1.000e-02, eta: 0:23:53, time: 0.248, data_time: 0.242, memory: 25, temporal_iou_loss: 0.0267, loss: 0.0267 2020-08-07 09:56:54,170 - mmaction - INFO - Epoch [10][350/603] lr: 1.000e-02, eta: 0:23:40, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 09:57:05,088 - mmaction - INFO - Epoch [10][400/603] lr: 1.000e-02, eta: 0:23:29, time: 0.218, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:57:15,270 - mmaction - INFO - Epoch [10][450/603] lr: 1.000e-02, eta: 0:23:16, time: 0.204, data_time: 0.197, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:57:26,612 - mmaction - INFO - Epoch [10][500/603] lr: 1.000e-02, eta: 0:23:05, time: 0.227, data_time: 0.220, memory: 25, temporal_iou_loss: 0.0263, loss: 0.0263 2020-08-07 09:57:38,453 - mmaction - INFO - Epoch [10][550/603] lr: 1.000e-02, eta: 0:22:54, time: 0.237, data_time: 0.231, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:57:48,200 - mmaction - INFO - Epoch [10][600/603] lr: 1.000e-02, eta: 0:22:41, time: 0.195, data_time: 0.189, memory: 25, temporal_iou_loss: 0.0264, loss: 0.0264 2020-08-07 09:57:49,206 - mmaction - INFO - Saving checkpoint at 10 epochs 2020-08-07 09:58:04,654 - mmaction - INFO - Epoch [11][50/603] lr: 1.000e-03, eta: 0:22:33, time: 0.305, data_time: 0.299, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 09:58:15,533 - mmaction - INFO - Epoch [11][100/603] lr: 1.000e-03, eta: 0:22:21, time: 0.218, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:58:26,105 - mmaction - INFO - Epoch [11][150/603] lr: 1.000e-03, eta: 0:22:09, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 09:58:36,884 - mmaction - INFO - Epoch [11][200/603] lr: 1.000e-03, eta: 0:21:57, time: 0.216, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 09:58:48,453 - mmaction - INFO - Epoch [11][250/603] lr: 1.000e-03, eta: 0:21:46, time: 0.231, data_time: 0.225, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 09:58:59,648 - mmaction - INFO - Epoch [11][300/603] lr: 1.000e-03, eta: 0:21:35, time: 0.224, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:59:10,341 - mmaction - INFO - Epoch [11][350/603] lr: 1.000e-03, eta: 0:21:23, time: 0.214, data_time: 0.207, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:59:21,803 - mmaction - INFO - Epoch [11][400/603] lr: 1.000e-03, eta: 0:21:12, time: 0.229, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 09:59:33,117 - mmaction - INFO - Epoch [11][450/603] lr: 1.000e-03, eta: 0:21:00, time: 0.226, data_time: 0.220, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 09:59:43,444 - mmaction - INFO - Epoch [11][500/603] lr: 1.000e-03, eta: 0:20:48, time: 0.207, data_time: 0.199, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 09:59:56,225 - mmaction - INFO - Epoch [11][550/603] lr: 1.000e-03, eta: 0:20:38, time: 0.256, data_time: 0.249, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:00:06,362 - mmaction - INFO - Epoch [11][600/603] lr: 1.000e-03, eta: 0:20:26, time: 0.203, data_time: 0.195, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:00:06,491 - mmaction - INFO - Saving checkpoint at 11 epochs 2020-08-07 10:00:23,524 - mmaction - INFO - Epoch [12][50/603] lr: 1.000e-03, eta: 0:20:18, time: 0.340, data_time: 0.334, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 10:00:33,591 - mmaction - INFO - Epoch [12][100/603] lr: 1.000e-03, eta: 0:20:06, time: 0.201, data_time: 0.195, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:00:45,234 - mmaction - INFO - Epoch [12][150/603] lr: 1.000e-03, eta: 0:19:55, time: 0.233, data_time: 0.226, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 10:00:58,176 - mmaction - INFO - Epoch [12][200/603] lr: 1.000e-03, eta: 0:19:44, time: 0.259, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0267, loss: 0.0267 2020-08-07 10:01:10,554 - mmaction - INFO - Epoch [12][250/603] lr: 1.000e-03, eta: 0:19:34, time: 0.248, data_time: 0.241, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:01:23,559 - mmaction - INFO - Epoch [12][300/603] lr: 1.000e-03, eta: 0:19:24, time: 0.260, data_time: 0.254, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 10:01:34,471 - mmaction - INFO - Epoch [12][350/603] lr: 1.000e-03, eta: 0:19:12, time: 0.218, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:01:49,037 - mmaction - INFO - Epoch [12][400/603] lr: 1.000e-03, eta: 0:19:03, time: 0.291, data_time: 0.285, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 10:02:00,815 - mmaction - INFO - Epoch [12][450/603] lr: 1.000e-03, eta: 0:18:52, time: 0.236, data_time: 0.230, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:02:12,049 - mmaction - INFO - Epoch [12][500/603] lr: 1.000e-03, eta: 0:18:41, time: 0.225, data_time: 0.219, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:02:24,962 - mmaction - INFO - Epoch [12][550/603] lr: 1.000e-03, eta: 0:18:30, time: 0.258, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:02:36,126 - mmaction - INFO - Epoch [12][600/603] lr: 1.000e-03, eta: 0:18:19, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:02:36,254 - mmaction - INFO - Saving checkpoint at 12 epochs 2020-08-07 10:02:51,243 - mmaction - INFO - Epoch [13][50/603] lr: 1.000e-03, eta: 0:18:08, time: 0.296, data_time: 0.290, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:03:02,948 - mmaction - INFO - Epoch [13][100/603] lr: 1.000e-03, eta: 0:17:57, time: 0.234, data_time: 0.228, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:03:13,575 - mmaction - INFO - Epoch [13][150/603] lr: 1.000e-03, eta: 0:17:45, time: 0.213, data_time: 0.206, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:03:24,089 - mmaction - INFO - Epoch [13][200/603] lr: 1.000e-03, eta: 0:17:33, time: 0.210, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:03:36,868 - mmaction - INFO - Epoch [13][250/603] lr: 1.000e-03, eta: 0:17:23, time: 0.256, data_time: 0.249, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:03:47,272 - mmaction - INFO - Epoch [13][300/603] lr: 1.000e-03, eta: 0:17:11, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:03:57,379 - mmaction - INFO - Epoch [13][350/603] lr: 1.000e-03, eta: 0:16:59, time: 0.202, data_time: 0.196, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 10:04:07,949 - mmaction - INFO - Epoch [13][400/603] lr: 1.000e-03, eta: 0:16:47, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 10:04:21,217 - mmaction - INFO - Epoch [13][450/603] lr: 1.000e-03, eta: 0:16:36, time: 0.265, data_time: 0.259, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:04:31,601 - mmaction - INFO - Epoch [13][500/603] lr: 1.000e-03, eta: 0:16:24, time: 0.208, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:04:42,318 - mmaction - INFO - Epoch [13][550/603] lr: 1.000e-03, eta: 0:16:13, time: 0.214, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:04:52,393 - mmaction - INFO - Epoch [13][600/603] lr: 1.000e-03, eta: 0:16:01, time: 0.202, data_time: 0.195, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:04:53,169 - mmaction - INFO - Saving checkpoint at 13 epochs 2020-08-07 10:05:08,323 - mmaction - INFO - Epoch [14][50/603] lr: 1.000e-03, eta: 0:15:50, time: 0.299, data_time: 0.293, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:05:19,188 - mmaction - INFO - Epoch [14][100/603] lr: 1.000e-03, eta: 0:15:38, time: 0.217, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:05:29,940 - mmaction - INFO - Epoch [14][150/603] lr: 1.000e-03, eta: 0:15:27, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:05:41,373 - mmaction - INFO - Epoch [14][200/603] lr: 1.000e-03, eta: 0:15:15, time: 0.229, data_time: 0.222, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:05:53,173 - mmaction - INFO - Epoch [14][250/603] lr: 1.000e-03, eta: 0:15:04, time: 0.236, data_time: 0.230, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 10:06:03,793 - mmaction - INFO - Epoch [14][300/603] lr: 1.000e-03, eta: 0:14:52, time: 0.212, data_time: 0.206, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:06:14,556 - mmaction - INFO - Epoch [14][350/603] lr: 1.000e-03, eta: 0:14:41, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:06:25,938 - mmaction - INFO - Epoch [14][400/603] lr: 1.000e-03, eta: 0:14:29, time: 0.228, data_time: 0.221, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:06:36,884 - mmaction - INFO - Epoch [14][450/603] lr: 1.000e-03, eta: 0:14:18, time: 0.219, data_time: 0.213, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:06:48,158 - mmaction - INFO - Epoch [14][500/603] lr: 1.000e-03, eta: 0:14:06, time: 0.225, data_time: 0.219, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:06:58,851 - mmaction - INFO - Epoch [14][550/603] lr: 1.000e-03, eta: 0:13:55, time: 0.214, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0249, loss: 0.0249 2020-08-07 10:07:10,637 - mmaction - INFO - Epoch [14][600/603] lr: 1.000e-03, eta: 0:13:43, time: 0.236, data_time: 0.230, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 10:07:10,762 - mmaction - INFO - Saving checkpoint at 14 epochs 2020-08-07 10:07:26,458 - mmaction - INFO - Epoch [15][50/603] lr: 1.000e-03, eta: 0:13:33, time: 0.310, data_time: 0.304, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:07:36,893 - mmaction - INFO - Epoch [15][100/603] lr: 1.000e-03, eta: 0:13:21, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:07:48,147 - mmaction - INFO - Epoch [15][150/603] lr: 1.000e-03, eta: 0:13:10, time: 0.225, data_time: 0.219, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:07:58,554 - mmaction - INFO - Epoch [15][200/603] lr: 1.000e-03, eta: 0:12:58, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:08:09,815 - mmaction - INFO - Epoch [15][250/603] lr: 1.000e-03, eta: 0:12:46, time: 0.225, data_time: 0.219, memory: 25, temporal_iou_loss: 0.0261, loss: 0.0261 2020-08-07 10:08:20,818 - mmaction - INFO - Epoch [15][300/603] lr: 1.000e-03, eta: 0:12:35, time: 0.220, data_time: 0.214, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:08:32,208 - mmaction - INFO - Epoch [15][350/603] lr: 1.000e-03, eta: 0:12:23, time: 0.228, data_time: 0.222, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:08:43,288 - mmaction - INFO - Epoch [15][400/603] lr: 1.000e-03, eta: 0:12:12, time: 0.222, data_time: 0.216, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:08:55,214 - mmaction - INFO - Epoch [15][450/603] lr: 1.000e-03, eta: 0:12:01, time: 0.239, data_time: 0.233, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:09:05,748 - mmaction - INFO - Epoch [15][500/603] lr: 1.000e-03, eta: 0:11:49, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:09:16,545 - mmaction - INFO - Epoch [15][550/603] lr: 1.000e-03, eta: 0:11:38, time: 0.216, data_time: 0.210, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:09:26,966 - mmaction - INFO - Epoch [15][600/603] lr: 1.000e-03, eta: 0:11:26, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:09:28,240 - mmaction - INFO - Saving checkpoint at 15 epochs 2020-08-07 10:09:43,198 - mmaction - INFO - Epoch [16][50/603] lr: 1.000e-03, eta: 0:11:15, time: 0.296, data_time: 0.289, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:09:56,108 - mmaction - INFO - Epoch [16][100/603] lr: 1.000e-03, eta: 0:11:04, time: 0.258, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:10:07,310 - mmaction - INFO - Epoch [16][150/603] lr: 1.000e-03, eta: 0:10:52, time: 0.224, data_time: 0.216, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:10:17,457 - mmaction - INFO - Epoch [16][200/603] lr: 1.000e-03, eta: 0:10:41, time: 0.203, data_time: 0.197, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:10:28,393 - mmaction - INFO - Epoch [16][250/603] lr: 1.000e-03, eta: 0:10:29, time: 0.219, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:10:40,941 - mmaction - INFO - Epoch [16][300/603] lr: 1.000e-03, eta: 0:10:18, time: 0.251, data_time: 0.245, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:10:51,305 - mmaction - INFO - Epoch [16][350/603] lr: 1.000e-03, eta: 0:10:06, time: 0.207, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:11:01,449 - mmaction - INFO - Epoch [16][400/603] lr: 1.000e-03, eta: 0:09:55, time: 0.203, data_time: 0.197, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:11:12,315 - mmaction - INFO - Epoch [16][450/603] lr: 1.000e-03, eta: 0:09:43, time: 0.217, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:11:24,724 - mmaction - INFO - Epoch [16][500/603] lr: 1.000e-03, eta: 0:09:32, time: 0.248, data_time: 0.242, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:11:34,833 - mmaction - INFO - Epoch [16][550/603] lr: 1.000e-03, eta: 0:09:20, time: 0.202, data_time: 0.196, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:11:45,964 - mmaction - INFO - Epoch [16][600/603] lr: 1.000e-03, eta: 0:09:09, time: 0.223, data_time: 0.216, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:11:46,096 - mmaction - INFO - Saving checkpoint at 16 epochs 2020-08-07 10:12:00,847 - mmaction - INFO - Epoch [17][50/603] lr: 1.000e-03, eta: 0:08:57, time: 0.291, data_time: 0.285, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:12:12,496 - mmaction - INFO - Epoch [17][100/603] lr: 1.000e-03, eta: 0:08:46, time: 0.233, data_time: 0.227, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 10:12:23,200 - mmaction - INFO - Epoch [17][150/603] lr: 1.000e-03, eta: 0:08:35, time: 0.214, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:12:33,620 - mmaction - INFO - Epoch [17][200/603] lr: 1.000e-03, eta: 0:08:23, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:12:44,983 - mmaction - INFO - Epoch [17][250/603] lr: 1.000e-03, eta: 0:08:12, time: 0.227, data_time: 0.221, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:12:57,424 - mmaction - INFO - Epoch [17][300/603] lr: 1.000e-03, eta: 0:08:00, time: 0.249, data_time: 0.243, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:13:07,654 - mmaction - INFO - Epoch [17][350/603] lr: 1.000e-03, eta: 0:07:49, time: 0.205, data_time: 0.198, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 10:13:18,051 - mmaction - INFO - Epoch [17][400/603] lr: 1.000e-03, eta: 0:07:37, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0248, loss: 0.0248 2020-08-07 10:13:29,191 - mmaction - INFO - Epoch [17][450/603] lr: 1.000e-03, eta: 0:07:26, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:13:40,358 - mmaction - INFO - Epoch [17][500/603] lr: 1.000e-03, eta: 0:07:14, time: 0.223, data_time: 0.217, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:13:51,963 - mmaction - INFO - Epoch [17][550/603] lr: 1.000e-03, eta: 0:07:03, time: 0.232, data_time: 0.226, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:14:01,806 - mmaction - INFO - Epoch [17][600/603] lr: 1.000e-03, eta: 0:06:51, time: 0.197, data_time: 0.191, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:14:02,685 - mmaction - INFO - Saving checkpoint at 17 epochs 2020-08-07 10:14:17,537 - mmaction - INFO - Epoch [18][50/603] lr: 1.000e-03, eta: 0:06:40, time: 0.293, data_time: 0.287, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 10:14:29,006 - mmaction - INFO - Epoch [18][100/603] lr: 1.000e-03, eta: 0:06:28, time: 0.230, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:14:39,963 - mmaction - INFO - Epoch [18][150/603] lr: 1.000e-03, eta: 0:06:17, time: 0.219, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:14:49,912 - mmaction - INFO - Epoch [18][200/603] lr: 1.000e-03, eta: 0:06:05, time: 0.199, data_time: 0.192, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:15:02,827 - mmaction - INFO - Epoch [18][250/603] lr: 1.000e-03, eta: 0:05:54, time: 0.258, data_time: 0.252, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:15:13,582 - mmaction - INFO - Epoch [18][300/603] lr: 1.000e-03, eta: 0:05:43, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 10:15:24,126 - mmaction - INFO - Epoch [18][350/603] lr: 1.000e-03, eta: 0:05:31, time: 0.211, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:15:34,648 - mmaction - INFO - Epoch [18][400/603] lr: 1.000e-03, eta: 0:05:20, time: 0.210, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 10:15:46,996 - mmaction - INFO - Epoch [18][450/603] lr: 1.000e-03, eta: 0:05:09, time: 0.247, data_time: 0.241, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:15:57,248 - mmaction - INFO - Epoch [18][500/603] lr: 1.000e-03, eta: 0:04:57, time: 0.205, data_time: 0.199, memory: 25, temporal_iou_loss: 0.0250, loss: 0.0250 2020-08-07 10:16:08,854 - mmaction - INFO - Epoch [18][550/603] lr: 1.000e-03, eta: 0:04:46, time: 0.232, data_time: 0.226, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 10:16:19,204 - mmaction - INFO - Epoch [18][600/603] lr: 1.000e-03, eta: 0:04:34, time: 0.207, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:16:20,370 - mmaction - INFO - Saving checkpoint at 18 epochs 2020-08-07 10:16:35,774 - mmaction - INFO - Epoch [19][50/603] lr: 1.000e-03, eta: 0:04:23, time: 0.303, data_time: 0.297, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:16:46,464 - mmaction - INFO - Epoch [19][100/603] lr: 1.000e-03, eta: 0:04:11, time: 0.214, data_time: 0.208, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:16:57,265 - mmaction - INFO - Epoch [19][150/603] lr: 1.000e-03, eta: 0:04:00, time: 0.216, data_time: 0.210, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:17:08,285 - mmaction - INFO - Epoch [19][200/603] lr: 1.000e-03, eta: 0:03:48, time: 0.220, data_time: 0.214, memory: 25, temporal_iou_loss: 0.0259, loss: 0.0259 2020-08-07 10:17:19,759 - mmaction - INFO - Epoch [19][250/603] lr: 1.000e-03, eta: 0:03:37, time: 0.229, data_time: 0.223, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:17:32,099 - mmaction - INFO - Epoch [19][300/603] lr: 1.000e-03, eta: 0:03:26, time: 0.247, data_time: 0.240, memory: 25, temporal_iou_loss: 0.0255, loss: 0.0255 2020-08-07 10:17:42,576 - mmaction - INFO - Epoch [19][350/603] lr: 1.000e-03, eta: 0:03:14, time: 0.210, data_time: 0.204, memory: 25, temporal_iou_loss: 0.0260, loss: 0.0260 2020-08-07 10:17:53,226 - mmaction - INFO - Epoch [19][400/603] lr: 1.000e-03, eta: 0:03:03, time: 0.213, data_time: 0.207, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:18:03,677 - mmaction - INFO - Epoch [19][450/603] lr: 1.000e-03, eta: 0:02:51, time: 0.209, data_time: 0.203, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:18:15,495 - mmaction - INFO - Epoch [19][500/603] lr: 1.000e-03, eta: 0:02:40, time: 0.236, data_time: 0.230, memory: 25, temporal_iou_loss: 0.0253, loss: 0.0253 2020-08-07 10:18:25,904 - mmaction - INFO - Epoch [19][550/603] lr: 1.000e-03, eta: 0:02:29, time: 0.208, data_time: 0.202, memory: 25, temporal_iou_loss: 0.0249, loss: 0.0249 2020-08-07 10:18:36,509 - mmaction - INFO - Epoch [19][600/603] lr: 1.000e-03, eta: 0:02:17, time: 0.212, data_time: 0.205, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:18:37,665 - mmaction - INFO - Saving checkpoint at 19 epochs 2020-08-07 10:18:51,926 - mmaction - INFO - Epoch [20][50/603] lr: 1.000e-03, eta: 0:02:05, time: 0.282, data_time: 0.275, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:19:03,262 - mmaction - INFO - Epoch [20][100/603] lr: 1.000e-03, eta: 0:01:54, time: 0.227, data_time: 0.220, memory: 25, temporal_iou_loss: 0.0258, loss: 0.0258 2020-08-07 10:19:14,171 - mmaction - INFO - Epoch [20][150/603] lr: 1.000e-03, eta: 0:01:42, time: 0.218, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0249, loss: 0.0249 2020-08-07 10:19:25,127 - mmaction - INFO - Epoch [20][200/603] lr: 1.000e-03, eta: 0:01:31, time: 0.219, data_time: 0.212, memory: 25, temporal_iou_loss: 0.0251, loss: 0.0251 2020-08-07 10:19:37,275 - mmaction - INFO - Epoch [20][250/603] lr: 1.000e-03, eta: 0:01:20, time: 0.243, data_time: 0.237, memory: 25, temporal_iou_loss: 0.0254, loss: 0.0254 2020-08-07 10:19:48,295 - mmaction - INFO - Epoch [20][300/603] lr: 1.000e-03, eta: 0:01:08, time: 0.220, data_time: 0.214, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:19:58,605 - mmaction - INFO - Epoch [20][350/603] lr: 1.000e-03, eta: 0:00:57, time: 0.206, data_time: 0.200, memory: 25, temporal_iou_loss: 0.0262, loss: 0.0262 2020-08-07 10:20:09,349 - mmaction - INFO - Epoch [20][400/603] lr: 1.000e-03, eta: 0:00:46, time: 0.215, data_time: 0.209, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:20:22,702 - mmaction - INFO - Epoch [20][450/603] lr: 1.000e-03, eta: 0:00:34, time: 0.267, data_time: 0.261, memory: 25, temporal_iou_loss: 0.0252, loss: 0.0252 2020-08-07 10:20:33,069 - mmaction - INFO - Epoch [20][500/603] lr: 1.000e-03, eta: 0:00:23, time: 0.207, data_time: 0.201, memory: 25, temporal_iou_loss: 0.0256, loss: 0.0256 2020-08-07 10:20:43,956 - mmaction - INFO - Epoch [20][550/603] lr: 1.000e-03, eta: 0:00:12, time: 0.218, data_time: 0.211, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:20:53,827 - mmaction - INFO - Epoch [20][600/603] lr: 1.000e-03, eta: 0:00:00, time: 0.197, data_time: 0.190, memory: 25, temporal_iou_loss: 0.0257, loss: 0.0257 2020-08-07 10:20:54,927 - mmaction - INFO - Saving checkpoint at 20 epochs