INFO:Trainer:2024-15-05 14:56:26:[cuda:1] Initialization completed, start model training.
INFO:Trainer:2024-15-05 15:01:00:[cuda:1] Epoch 100 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:01:25:mr: 6399.741
INFO:Trainer:2024-15-05 15:01:25:mrr: 0.452
INFO:Trainer:2024-15-05 15:01:25:hits@1: 0.425
INFO:Trainer:2024-15-05 15:01:25:hits@3: 0.464
INFO:Trainer:2024-15-05 15:01:25:hits@10: 0.501
INFO:Trainer:2024-15-05 15:01:25:mr_type: 3866.944
INFO:Trainer:2024-15-05 15:01:25:mrr_type: 0.464
INFO:Trainer:2024-15-05 15:01:25:hits@1_type: 0.434
INFO:Trainer:2024-15-05 15:01:25:hits@3_type: 0.476
INFO:Trainer:2024-15-05 15:01:25:hits@10_type: 0.515
INFO:EarlyStopping:2024-15-05 15:01:25:Validation score improved (-inf --> 0.501000).  Saving model ...
INFO:Trainer:2024-15-05 15:01:28:[cuda:1] Epoch 100 | Training checkpoint saved at ../../checkpoint/rotate-100.pth
INFO:Trainer:2024-15-05 15:01:28:[cuda:1] Epoch [ 100/6000] | Batchsize: 2000 | loss:  3.690686 | 2.74808 seconds/epoch
INFO:Trainer:2024-15-05 15:06:03:[cuda:1] Epoch 200 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:06:27:mr: 4960.208
INFO:Trainer:2024-15-05 15:06:27:mrr: 0.47
INFO:Trainer:2024-15-05 15:06:27:hits@1: 0.433
INFO:Trainer:2024-15-05 15:06:27:hits@3: 0.483
INFO:Trainer:2024-15-05 15:06:27:hits@10: 0.541
INFO:Trainer:2024-15-05 15:06:27:mr_type: 3068.178
INFO:Trainer:2024-15-05 15:06:27:mrr_type: 0.484
INFO:Trainer:2024-15-05 15:06:27:hits@1_type: 0.447
INFO:Trainer:2024-15-05 15:06:27:hits@3_type: 0.496
INFO:Trainer:2024-15-05 15:06:27:hits@10_type: 0.558
INFO:EarlyStopping:2024-15-05 15:06:27:Validation score improved (0.501000 --> 0.541000).  Saving model ...
INFO:Trainer:2024-15-05 15:06:30:[cuda:1] Epoch 200 | Training checkpoint saved at ../../checkpoint/rotate-200.pth
INFO:Trainer:2024-15-05 15:06:30:[cuda:1] Epoch [ 200/6000] | Batchsize: 2000 | loss:  2.475564 | 2.88471 seconds/epoch
INFO:Trainer:2024-15-05 15:11:04:[cuda:1] Epoch 300 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:11:29:mr: 4324.237
INFO:Trainer:2024-15-05 15:11:29:mrr: 0.474
INFO:Trainer:2024-15-05 15:11:29:hits@1: 0.434
INFO:Trainer:2024-15-05 15:11:29:hits@3: 0.486
INFO:Trainer:2024-15-05 15:11:29:hits@10: 0.55
INFO:Trainer:2024-15-05 15:11:29:mr_type: 2692.339
INFO:Trainer:2024-15-05 15:11:29:mrr_type: 0.489
INFO:Trainer:2024-15-05 15:11:29:hits@1_type: 0.446
INFO:Trainer:2024-15-05 15:11:29:hits@3_type: 0.503
INFO:Trainer:2024-15-05 15:11:29:hits@10_type: 0.571
INFO:EarlyStopping:2024-15-05 15:11:29:Validation score improved (0.541000 --> 0.550000).  Saving model ...
INFO:Trainer:2024-15-05 15:11:31:[cuda:1] Epoch 300 | Training checkpoint saved at ../../checkpoint/rotate-300.pth
INFO:Trainer:2024-15-05 15:11:31:[cuda:1] Epoch [ 300/6000] | Batchsize: 2000 | loss:  2.167062 | 2.92777 seconds/epoch
INFO:Trainer:2024-15-05 15:16:05:[cuda:1] Epoch 400 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:16:30:mr: 3964.748
INFO:Trainer:2024-15-05 15:16:30:mrr: 0.476
INFO:Trainer:2024-15-05 15:16:30:hits@1: 0.435
INFO:Trainer:2024-15-05 15:16:30:hits@3: 0.487
INFO:Trainer:2024-15-05 15:16:30:hits@10: 0.556
INFO:Trainer:2024-15-05 15:16:30:mr_type: 2473.831
INFO:Trainer:2024-15-05 15:16:30:mrr_type: 0.492
INFO:Trainer:2024-15-05 15:16:30:hits@1_type: 0.449
INFO:Trainer:2024-15-05 15:16:30:hits@3_type: 0.507
INFO:Trainer:2024-15-05 15:16:30:hits@10_type: 0.579
INFO:EarlyStopping:2024-15-05 15:16:30:Validation score improved (0.550000 --> 0.556000).  Saving model ...
INFO:Trainer:2024-15-05 15:16:32:[cuda:1] Epoch 400 | Training checkpoint saved at ../../checkpoint/rotate-400.pth
INFO:Trainer:2024-15-05 15:16:32:[cuda:1] Epoch [ 400/6000] | Batchsize: 2000 | loss:  2.043394 | 2.94767 seconds/epoch
INFO:Trainer:2024-15-05 15:21:09:[cuda:1] Epoch 500 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:21:34:mr: 3741.023
INFO:Trainer:2024-15-05 15:21:34:mrr: 0.476
INFO:Trainer:2024-15-05 15:21:34:hits@1: 0.434
INFO:Trainer:2024-15-05 15:21:34:hits@3: 0.49
INFO:Trainer:2024-15-05 15:21:34:hits@10: 0.558
INFO:Trainer:2024-15-05 15:21:34:mr_type: 2337.682
INFO:Trainer:2024-15-05 15:21:34:mrr_type: 0.493
INFO:Trainer:2024-15-05 15:21:34:hits@1_type: 0.448
INFO:Trainer:2024-15-05 15:21:34:hits@3_type: 0.509
INFO:Trainer:2024-15-05 15:21:34:hits@10_type: 0.582
INFO:EarlyStopping:2024-15-05 15:21:34:Validation score improved (0.556000 --> 0.558000).  Saving model ...
INFO:Trainer:2024-15-05 15:21:36:[cuda:1] Epoch 500 | Training checkpoint saved at ../../checkpoint/rotate-500.pth
INFO:Trainer:2024-15-05 15:21:36:[cuda:1] Epoch [ 500/6000] | Batchsize: 2000 | loss:  1.969485 | 2.96636 seconds/epoch
INFO:Trainer:2024-15-05 15:26:13:[cuda:1] Epoch 600 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:26:37:mr: 3611.639
INFO:Trainer:2024-15-05 15:26:37:mrr: 0.476
INFO:Trainer:2024-15-05 15:26:37:hits@1: 0.434
INFO:Trainer:2024-15-05 15:26:37:hits@3: 0.489
INFO:Trainer:2024-15-05 15:26:37:hits@10: 0.559
INFO:Trainer:2024-15-05 15:26:37:mr_type: 2250.51
INFO:Trainer:2024-15-05 15:26:37:mrr_type: 0.493
INFO:Trainer:2024-15-05 15:26:37:hits@1_type: 0.447
INFO:Trainer:2024-15-05 15:26:37:hits@3_type: 0.511
INFO:Trainer:2024-15-05 15:26:37:hits@10_type: 0.583
INFO:EarlyStopping:2024-15-05 15:26:37:Validation score improved (0.558000 --> 0.559000).  Saving model ...
INFO:Trainer:2024-15-05 15:26:40:[cuda:1] Epoch 600 | Training checkpoint saved at ../../checkpoint/rotate-600.pth
INFO:Trainer:2024-15-05 15:26:40:[cuda:1] Epoch [ 600/6000] | Batchsize: 2000 | loss:  1.930409 | 2.97842 seconds/epoch
INFO:Trainer:2024-15-05 15:31:14:[cuda:1] Epoch 700 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:31:39:mr: 3540.128
INFO:Trainer:2024-15-05 15:31:39:mrr: 0.474
INFO:Trainer:2024-15-05 15:31:39:hits@1: 0.431
INFO:Trainer:2024-15-05 15:31:39:hits@3: 0.486
INFO:Trainer:2024-15-05 15:31:39:hits@10: 0.562
INFO:Trainer:2024-15-05 15:31:39:mr_type: 2199.684
INFO:Trainer:2024-15-05 15:31:39:mrr_type: 0.492
INFO:Trainer:2024-15-05 15:31:39:hits@1_type: 0.445
INFO:Trainer:2024-15-05 15:31:39:hits@3_type: 0.509
INFO:Trainer:2024-15-05 15:31:39:hits@10_type: 0.587
INFO:EarlyStopping:2024-15-05 15:31:39:Validation score improved (0.559000 --> 0.562000).  Saving model ...
INFO:Trainer:2024-15-05 15:31:42:[cuda:1] Epoch 700 | Training checkpoint saved at ../../checkpoint/rotate-700.pth
INFO:Trainer:2024-15-05 15:31:42:[cuda:1] Epoch [ 700/6000] | Batchsize: 2000 | loss:  1.900013 | 2.98375 seconds/epoch
INFO:Trainer:2024-15-05 15:36:16:[cuda:1] Epoch 800 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:36:41:mr: 3469.78
INFO:Trainer:2024-15-05 15:36:41:mrr: 0.474
INFO:Trainer:2024-15-05 15:36:41:hits@1: 0.43
INFO:Trainer:2024-15-05 15:36:41:hits@3: 0.489
INFO:Trainer:2024-15-05 15:36:41:hits@10: 0.563
INFO:Trainer:2024-15-05 15:36:41:mr_type: 2157.465
INFO:Trainer:2024-15-05 15:36:41:mrr_type: 0.493
INFO:Trainer:2024-15-05 15:36:41:hits@1_type: 0.446
INFO:Trainer:2024-15-05 15:36:41:hits@3_type: 0.51
INFO:Trainer:2024-15-05 15:36:41:hits@10_type: 0.587
INFO:EarlyStopping:2024-15-05 15:36:41:Validation score improved (0.562000 --> 0.563000).  Saving model ...
INFO:Trainer:2024-15-05 15:36:44:[cuda:1] Epoch 800 | Training checkpoint saved at ../../checkpoint/rotate-800.pth
INFO:Trainer:2024-15-05 15:36:44:[cuda:1] Epoch [ 800/6000] | Batchsize: 2000 | loss:  1.876471 | 2.98824 seconds/epoch
INFO:Trainer:2024-15-05 15:41:17:[cuda:1] Epoch 900 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:41:42:mr: 3419.918
INFO:Trainer:2024-15-05 15:41:42:mrr: 0.476
INFO:Trainer:2024-15-05 15:41:42:hits@1: 0.434
INFO:Trainer:2024-15-05 15:41:42:hits@3: 0.488
INFO:Trainer:2024-15-05 15:41:42:hits@10: 0.562
INFO:Trainer:2024-15-05 15:41:42:mr_type: 2129.04
INFO:Trainer:2024-15-05 15:41:42:mrr_type: 0.495
INFO:Trainer:2024-15-05 15:41:42:hits@1_type: 0.448
INFO:Trainer:2024-15-05 15:41:42:hits@3_type: 0.51
INFO:Trainer:2024-15-05 15:41:42:hits@10_type: 0.588
INFO:EarlyStopping:2024-15-05 15:41:42:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-15-05 15:41:43:[cuda:1] Epoch 900 | Training checkpoint saved at ../../checkpoint/rotate-900.pth
INFO:Trainer:2024-15-05 15:41:43:[cuda:1] Epoch [ 900/6000] | Batchsize: 2000 | loss:  1.858840 | 2.99061 seconds/epoch
INFO:Trainer:2024-15-05 15:46:17:[cuda:1] Epoch 1000 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:46:42:mr: 3393.567
INFO:Trainer:2024-15-05 15:46:42:mrr: 0.477
INFO:Trainer:2024-15-05 15:46:42:hits@1: 0.433
INFO:Trainer:2024-15-05 15:46:42:hits@3: 0.49
INFO:Trainer:2024-15-05 15:46:42:hits@10: 0.565
INFO:Trainer:2024-15-05 15:46:42:mr_type: 2115.423
INFO:Trainer:2024-15-05 15:46:42:mrr_type: 0.496
INFO:Trainer:2024-15-05 15:46:42:hits@1_type: 0.449
INFO:Trainer:2024-15-05 15:46:42:hits@3_type: 0.513
INFO:Trainer:2024-15-05 15:46:42:hits@10_type: 0.59
INFO:EarlyStopping:2024-15-05 15:46:42:Validation score improved (0.563000 --> 0.565000).  Saving model ...
INFO:Trainer:2024-15-05 15:46:44:[cuda:1] Epoch 1000 | Training checkpoint saved at ../../checkpoint/rotate-1000.pth
INFO:Trainer:2024-15-05 15:46:44:[cuda:1] Epoch [1000/6000] | Batchsize: 2000 | loss:  1.843456 | 2.99143 seconds/epoch
INFO:Trainer:2024-15-05 15:51:19:[cuda:1] Epoch 1100 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:51:44:mr: 3375.65
INFO:Trainer:2024-15-05 15:51:44:mrr: 0.477
INFO:Trainer:2024-15-05 15:51:44:hits@1: 0.433
INFO:Trainer:2024-15-05 15:51:44:hits@3: 0.489
INFO:Trainer:2024-15-05 15:51:44:hits@10: 0.564
INFO:Trainer:2024-15-05 15:51:44:mr_type: 2104.245
INFO:Trainer:2024-15-05 15:51:44:mrr_type: 0.496
INFO:Trainer:2024-15-05 15:51:44:hits@1_type: 0.449
INFO:Trainer:2024-15-05 15:51:44:hits@3_type: 0.512
INFO:Trainer:2024-15-05 15:51:44:hits@10_type: 0.589
INFO:EarlyStopping:2024-15-05 15:51:44:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-15-05 15:51:45:[cuda:1] Epoch 1100 | Training checkpoint saved at ../../checkpoint/rotate-1100.pth
INFO:Trainer:2024-15-05 15:51:45:[cuda:1] Epoch [1100/6000] | Batchsize: 2000 | loss:  1.832374 | 2.99433 seconds/epoch
INFO:Trainer:2024-15-05 15:56:19:[cuda:1] Epoch 1200 | The model starts evaluation on the validation set.
INFO:Trainer:2024-15-05 15:56:44:mr: 3360.458
INFO:Trainer:2024-15-05 15:56:44:mrr: 0.475
INFO:Trainer:2024-15-05 15:56:44:hits@1: 0.431
INFO:Trainer:2024-15-05 15:56:44:hits@3: 0.489
INFO:Trainer:2024-15-05 15:56:44:hits@10: 0.564
INFO:Trainer:2024-15-05 15:56:44:mr_type: 2092.722
INFO:Trainer:2024-15-05 15:56:44:mrr_type: 0.495
INFO:Trainer:2024-15-05 15:56:44:hits@1_type: 0.448
INFO:Trainer:2024-15-05 15:56:44:hits@3_type: 0.512
INFO:Trainer:2024-15-05 15:56:44:hits@10_type: 0.589
INFO:EarlyStopping:2024-15-05 15:56:44:EarlyStopping counter: 2 / 2
INFO:Trainer:2024-15-05 15:56:44:[cuda:1] Send an early stopping signal
INFO:Trainer:2024-15-05 15:56:44:[cuda:1] The model training is completed, taking a total of 3593.39855 seconds.
INFO:Trainer:2024-15-05 15:56:44:[cuda:1] Model saved at ../../checkpoint/rotate.pth.
INFO:Trainer:2024-15-05 15:56:44:[cuda:1] The model starts evaluating in the test set.
INFO:Trainer:2024-15-05 15:57:10:mr: 3429.524
INFO:Trainer:2024-15-05 15:57:10:mrr: 0.474
INFO:Trainer:2024-15-05 15:57:10:hits@1: 0.427
INFO:Trainer:2024-15-05 15:57:10:hits@3: 0.489
INFO:Trainer:2024-15-05 15:57:10:hits@10: 0.57
INFO:Trainer:2024-15-05 15:57:10:mr_type: 2217.994
INFO:Trainer:2024-15-05 15:57:10:mrr_type: 0.495
INFO:Trainer:2024-15-05 15:57:10:hits@1_type: 0.446
INFO:Trainer:2024-15-05 15:57:10:hits@3_type: 0.513
INFO:Trainer:2024-15-05 15:57:10:hits@10_type: 0.593