DEBUG:cmd:2024-11-05 20:30:11:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False)
DEBUG:cmd:2024-11-05 20:30:11:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False)
DEBUG:connectionpool:2024-11-05 20:30:11:Starting new HTTPS connection (1): api.wandb.ai:443
DEBUG:connectionpool:2024-11-05 20:30:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None
DEBUG:connectionpool:2024-11-05 20:30:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None
wandb: Currently logged in as: 3555028709. Use `wandb login --relogin` to force relogin
DEBUG:cmd:2024-11-05 20:30:12:Popen(['git', 'cat-file', '--batch-check'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=<valid stream>, shell=False, universal_newlines=False)
wandb: wandb version 0.17.0 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.16.6
wandb: Run data is saved locally in /home/luyanfeng/my_code/github/pybind11-OpenKE/examples/TransH/wandb/run-20240511_203012-s7kg5bwf
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run TransH-FB15K237
wandb: ⭐️ View project at https://wandb.ai/3555028709/pybind11-ke
wandb: 🚀 View run at https://wandb.ai/3555028709/pybind11-ke/runs/s7kg5bwf
INFO:Trainer:2024-11-05 20:30:16:[cuda:1] Initialization completed, start model training.
INFO:Trainer:2024-11-05 20:34:59:[cuda:1] Epoch 100 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<03:32,  2.74it/s]
  0%|          | 2/585 [00:00<02:31,  3.84it/s]
  2%|▏         | 9/585 [00:00<00:29, 19.36it/s]
  3%|▎         | 17/585 [00:00<00:16, 34.06it/s]
  4%|▍         | 26/585 [00:00<00:11, 47.34it/s]
  6%|▌         | 35/585 [00:00<00:09, 57.29it/s]
  8%|▊         | 44/585 [00:01<00:08, 64.12it/s]
  9%|▉         | 53/585 [00:01<00:07, 69.40it/s]
 11%|█         | 62/585 [00:01<00:07, 72.69it/s]
 12%|█▏        | 71/585 [00:01<00:06, 75.31it/s]
 14%|█▎        | 80/585 [00:01<00:06, 77.18it/s]
 15%|█▌        | 89/585 [00:01<00:06, 78.16it/s]
 17%|█▋        | 98/585 [00:01<00:06, 79.02it/s]
 18%|█▊        | 107/585 [00:01<00:06, 79.36it/s]
 20%|█▉        | 116/585 [00:01<00:05, 80.14it/s]
 21%|██▏       | 125/585 [00:02<00:05, 79.85it/s]
 23%|██▎       | 134/585 [00:02<00:05, 80.15it/s]
 24%|██▍       | 143/585 [00:02<00:05, 80.12it/s]
 26%|██▌       | 152/585 [00:02<00:05, 80.40it/s]
 28%|██▊       | 161/585 [00:02<00:05, 80.77it/s]
 29%|██▉       | 170/585 [00:02<00:05, 80.47it/s]
 31%|███       | 179/585 [00:02<00:05, 80.81it/s]
 32%|███▏      | 188/585 [00:02<00:04, 80.46it/s]
 34%|███▎      | 197/585 [00:02<00:04, 80.69it/s]
 35%|███▌      | 206/585 [00:03<00:04, 80.58it/s]
 37%|███▋      | 215/585 [00:03<00:04, 80.60it/s]
 38%|███▊      | 224/585 [00:03<00:04, 80.67it/s]
 40%|███▉      | 233/585 [00:03<00:04, 80.53it/s]
 41%|████▏     | 242/585 [00:03<00:04, 80.61it/s]
 43%|████▎     | 251/585 [00:03<00:04, 80.86it/s]
 44%|████▍     | 260/585 [00:03<00:03, 81.31it/s]
 46%|████▌     | 269/585 [00:03<00:03, 81.28it/s]
 48%|████▊     | 278/585 [00:03<00:03, 81.53it/s]
 49%|████▉     | 287/585 [00:04<00:03, 81.34it/s]
 51%|█████     | 296/585 [00:04<00:03, 81.34it/s]
 52%|█████▏    | 305/585 [00:04<00:03, 81.42it/s]
 54%|█████▎    | 314/585 [00:04<00:03, 81.32it/s]
 55%|█████▌    | 323/585 [00:04<00:03, 81.47it/s]
 57%|█████▋    | 332/585 [00:04<00:03, 80.92it/s]
 58%|█████▊    | 341/585 [00:04<00:03, 80.60it/s]
 60%|█████▉    | 350/585 [00:04<00:02, 80.68it/s]
 61%|██████▏   | 359/585 [00:04<00:02, 80.97it/s]
 63%|██████▎   | 368/585 [00:05<00:02, 81.08it/s]
 64%|██████▍   | 377/585 [00:05<00:02, 81.09it/s]
 66%|██████▌   | 386/585 [00:05<00:02, 80.99it/s]
 68%|██████▊   | 395/585 [00:05<00:02, 80.69it/s]
 69%|██████▉   | 404/585 [00:05<00:02, 81.12it/s]
 71%|███████   | 413/585 [00:05<00:02, 81.10it/s]
 72%|███████▏  | 422/585 [00:05<00:02, 81.36it/s]
 74%|███████▎  | 431/585 [00:05<00:01, 81.27it/s]
 75%|███████▌  | 440/585 [00:05<00:01, 80.22it/s]
 77%|███████▋  | 449/585 [00:06<00:01, 80.62it/s]
 78%|███████▊  | 458/585 [00:06<00:01, 81.04it/s]
 80%|███████▉  | 467/585 [00:06<00:01, 81.63it/s]
 81%|████████▏ | 476/585 [00:06<00:01, 81.61it/s]
 83%|████████▎ | 485/585 [00:06<00:01, 81.47it/s]
 84%|████████▍ | 494/585 [00:06<00:01, 81.38it/s]
 86%|████████▌ | 503/585 [00:06<00:01, 81.29it/s]
 88%|████████▊ | 512/585 [00:06<00:00, 81.42it/s]
 89%|████████▉ | 521/585 [00:06<00:00, 81.42it/s]
 91%|█████████ | 530/585 [00:07<00:00, 81.65it/s]
 92%|█████████▏| 539/585 [00:07<00:00, 81.47it/s]
 94%|█████████▎| 548/585 [00:07<00:00, 81.49it/s]
 95%|█████████▌| 557/585 [00:07<00:00, 81.69it/s]
 97%|█████████▋| 566/585 [00:07<00:00, 82.45it/s]
 98%|█████████▊| 575/585 [00:07<00:00, 82.98it/s]
100%|█████████▉| 584/585 [00:07<00:00, 83.40it/s]
100%|██████████| 585/585 [00:07<00:00, 74.33it/s]
INFO:Trainer:2024-11-05 20:35:07:mr: 225.916
INFO:Trainer:2024-11-05 20:35:07:mrr: 0.28
INFO:Trainer:2024-11-05 20:35:07:hits@1: 0.183
INFO:Trainer:2024-11-05 20:35:07:hits@3: 0.319
INFO:Trainer:2024-11-05 20:35:07:hits@10: 0.471
INFO:Trainer:2024-11-05 20:35:07:mr_type: 115.464
INFO:Trainer:2024-11-05 20:35:07:mrr_type: 0.327
INFO:Trainer:2024-11-05 20:35:07:hits@1_type: 0.234
INFO:Trainer:2024-11-05 20:35:07:hits@3_type: 0.36
INFO:Trainer:2024-11-05 20:35:07:hits@10_type: 0.514
INFO:EarlyStopping:2024-11-05 20:35:07:Validation score improved (-inf --> 0.471000).  Saving model ...
INFO:Trainer:2024-11-05 20:35:07:[cuda:1] Epoch 100 | Training checkpoint saved at ../../checkpoint/transh-100.pth
INFO:Trainer:2024-11-05 20:35:07:[cuda:1] Epoch [ 100/1000] | Batchsize: 4096 | loss:  1.045676 | 2.82374 seconds/epoch
INFO:Trainer:2024-11-05 20:39:55:[cuda:1] Epoch 200 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<03:28,  2.80it/s]
  0%|          | 2/585 [00:00<02:08,  4.54it/s]
  2%|▏         | 9/585 [00:00<00:26, 22.02it/s]
  3%|▎         | 17/585 [00:00<00:15, 37.40it/s]
  4%|▍         | 26/585 [00:00<00:10, 50.83it/s]
  6%|▌         | 35/585 [00:00<00:09, 60.27it/s]
  8%|▊         | 44/585 [00:01<00:08, 66.95it/s]
  9%|▉         | 53/585 [00:01<00:07, 71.63it/s]
 11%|█         | 62/585 [00:01<00:07, 74.68it/s]
 12%|█▏        | 71/585 [00:01<00:06, 76.99it/s]
 14%|█▎        | 80/585 [00:01<00:06, 78.78it/s]
 15%|█▌        | 89/585 [00:01<00:06, 79.96it/s]
 17%|█▋        | 98/585 [00:01<00:06, 80.84it/s]
 18%|█▊        | 107/585 [00:01<00:05, 81.42it/s]
 20%|█▉        | 116/585 [00:01<00:05, 81.83it/s]
 21%|██▏       | 125/585 [00:02<00:05, 81.92it/s]
 23%|██▎       | 134/585 [00:02<00:05, 82.02it/s]
 24%|██▍       | 143/585 [00:02<00:05, 82.23it/s]
 26%|██▌       | 152/585 [00:02<00:05, 82.33it/s]
 28%|██▊       | 161/585 [00:02<00:05, 82.50it/s]
 29%|██▉       | 170/585 [00:02<00:05, 82.60it/s]
 31%|███       | 179/585 [00:02<00:04, 82.54it/s]
 32%|███▏      | 188/585 [00:02<00:04, 82.29it/s]
 34%|███▎      | 197/585 [00:02<00:04, 82.24it/s]
 35%|███▌      | 206/585 [00:02<00:04, 82.04it/s]
 37%|███▋      | 215/585 [00:03<00:04, 81.92it/s]
 38%|███▊      | 224/585 [00:03<00:04, 82.03it/s]
 40%|███▉      | 233/585 [00:03<00:04, 81.69it/s]
 41%|████▏     | 242/585 [00:03<00:04, 81.59it/s]
 43%|████▎     | 251/585 [00:03<00:04, 81.44it/s]
 44%|████▍     | 260/585 [00:03<00:03, 81.55it/s]
 46%|████▌     | 269/585 [00:03<00:03, 81.68it/s]
 48%|████▊     | 278/585 [00:03<00:03, 81.14it/s]
 49%|████▉     | 287/585 [00:03<00:03, 81.04it/s]
 51%|█████     | 296/585 [00:04<00:03, 81.21it/s]
 52%|█████▏    | 305/585 [00:04<00:03, 81.12it/s]
 54%|█████▎    | 314/585 [00:04<00:03, 81.27it/s]
 55%|█████▌    | 323/585 [00:04<00:03, 81.55it/s]
 57%|█████▋    | 332/585 [00:04<00:03, 81.83it/s]
 58%|█████▊    | 341/585 [00:04<00:02, 81.87it/s]
 60%|█████▉    | 350/585 [00:04<00:02, 81.90it/s]
 61%|██████▏   | 359/585 [00:04<00:02, 81.76it/s]
 63%|██████▎   | 368/585 [00:04<00:02, 82.04it/s]
 64%|██████▍   | 377/585 [00:05<00:02, 82.07it/s]
 66%|██████▌   | 386/585 [00:05<00:02, 82.02it/s]
 68%|██████▊   | 395/585 [00:05<00:02, 82.15it/s]
 69%|██████▉   | 404/585 [00:05<00:02, 81.98it/s]
 71%|███████   | 413/585 [00:05<00:02, 81.96it/s]
 72%|███████▏  | 422/585 [00:05<00:01, 81.94it/s]
 74%|███████▎  | 431/585 [00:05<00:01, 82.02it/s]
 75%|███████▌  | 440/585 [00:05<00:01, 81.74it/s]
 77%|███████▋  | 449/585 [00:05<00:01, 81.81it/s]
 78%|███████▊  | 458/585 [00:06<00:01, 81.63it/s]
 80%|███████▉  | 467/585 [00:06<00:01, 81.88it/s]
 81%|████████▏ | 476/585 [00:06<00:01, 81.92it/s]
 83%|████████▎ | 485/585 [00:06<00:01, 82.00it/s]
 84%|████████▍ | 494/585 [00:06<00:01, 82.13it/s]
 86%|████████▌ | 503/585 [00:06<00:01, 81.86it/s]
 88%|████████▊ | 512/585 [00:06<00:00, 82.07it/s]
 89%|████████▉ | 521/585 [00:06<00:00, 81.59it/s]
 91%|█████████ | 530/585 [00:06<00:00, 81.40it/s]
 92%|█████████▏| 539/585 [00:07<00:00, 81.35it/s]
 94%|█████████▎| 548/585 [00:07<00:00, 81.56it/s]
 95%|█████████▌| 557/585 [00:07<00:00, 81.71it/s]
 97%|█████████▋| 566/585 [00:07<00:00, 82.45it/s]
 98%|█████████▊| 575/585 [00:07<00:00, 82.98it/s]
100%|█████████▉| 584/585 [00:07<00:00, 83.37it/s]
100%|██████████| 585/585 [00:07<00:00, 75.91it/s]
INFO:Trainer:2024-11-05 20:40:03:mr: 229.445
INFO:Trainer:2024-11-05 20:40:03:mrr: 0.291
INFO:Trainer:2024-11-05 20:40:03:hits@1: 0.194
INFO:Trainer:2024-11-05 20:40:03:hits@3: 0.328
INFO:Trainer:2024-11-05 20:40:03:hits@10: 0.484
INFO:Trainer:2024-11-05 20:40:03:mr_type: 109.853
INFO:Trainer:2024-11-05 20:40:03:mrr_type: 0.338
INFO:Trainer:2024-11-05 20:40:03:hits@1_type: 0.245
INFO:Trainer:2024-11-05 20:40:03:hits@3_type: 0.371
INFO:Trainer:2024-11-05 20:40:03:hits@10_type: 0.526
INFO:EarlyStopping:2024-11-05 20:40:03:Validation score improved (0.471000 --> 0.484000).  Saving model ...
INFO:Trainer:2024-11-05 20:40:03:[cuda:1] Epoch 200 | Training checkpoint saved at ../../checkpoint/transh-200.pth
INFO:Trainer:2024-11-05 20:40:03:[cuda:1] Epoch [ 200/1000] | Batchsize: 4096 | loss:  0.756692 | 2.89273 seconds/epoch
INFO:Trainer:2024-11-05 20:44:49:[cuda:1] Epoch 300 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<04:06,  2.37it/s]
  1%|          | 3/585 [00:00<01:27,  6.67it/s]
  2%|▏         | 10/585 [00:00<00:25, 22.87it/s]
  3%|▎         | 18/585 [00:00<00:15, 37.16it/s]
  4%|▍         | 26/585 [00:00<00:11, 47.93it/s]
  6%|▌         | 34/585 [00:00<00:09, 55.36it/s]
  7%|▋         | 42/585 [00:01<00:08, 60.85it/s]
  9%|▊         | 50/585 [00:01<00:08, 64.94it/s]
 10%|▉         | 58/585 [00:01<00:07, 67.87it/s]
 11%|█▏        | 66/585 [00:01<00:07, 69.87it/s]
 13%|█▎        | 74/585 [00:01<00:07, 71.85it/s]
 14%|█▍        | 82/585 [00:01<00:06, 73.05it/s]
 15%|█▌        | 90/585 [00:01<00:06, 74.12it/s]
 17%|█▋        | 98/585 [00:01<00:06, 75.32it/s]
 18%|█▊        | 106/585 [00:01<00:06, 76.09it/s]
 19%|█▉        | 114/585 [00:02<00:06, 76.70it/s]
 21%|██        | 122/585 [00:02<00:06, 76.95it/s]
 22%|██▏       | 130/585 [00:02<00:05, 77.31it/s]
 24%|██▎       | 138/585 [00:02<00:05, 77.66it/s]
 25%|██▍       | 146/585 [00:02<00:05, 77.96it/s]
 26%|██▋       | 154/585 [00:02<00:05, 78.22it/s]
 28%|██▊       | 162/585 [00:02<00:05, 78.00it/s]
 29%|██▉       | 170/585 [00:02<00:05, 78.29it/s]
 30%|███       | 178/585 [00:02<00:05, 78.32it/s]
 32%|███▏      | 186/585 [00:02<00:05, 78.48it/s]
 33%|███▎      | 194/585 [00:03<00:04, 78.70it/s]
 35%|███▍      | 202/585 [00:03<00:04, 78.78it/s]
 36%|███▌      | 210/585 [00:03<00:04, 78.87it/s]
 37%|███▋      | 218/585 [00:03<00:04, 79.01it/s]
 39%|███▊      | 226/585 [00:03<00:04, 79.01it/s]
 40%|████      | 234/585 [00:03<00:04, 78.97it/s]
 41%|████▏     | 242/585 [00:03<00:04, 78.95it/s]
 43%|████▎     | 250/585 [00:03<00:04, 79.00it/s]
 44%|████▍     | 258/585 [00:03<00:04, 79.05it/s]
 45%|████▌     | 266/585 [00:03<00:04, 78.98it/s]
 47%|████▋     | 274/585 [00:04<00:03, 78.90it/s]
 48%|████▊     | 282/585 [00:04<00:03, 78.74it/s]
 50%|████▉     | 290/585 [00:04<00:03, 78.62it/s]
 51%|█████     | 298/585 [00:04<00:03, 78.01it/s]
 52%|█████▏    | 306/585 [00:04<00:03, 77.24it/s]
 54%|█████▎    | 314/585 [00:04<00:03, 76.90it/s]
 55%|█████▌    | 323/585 [00:04<00:03, 78.42it/s]
 57%|█████▋    | 332/585 [00:04<00:03, 79.82it/s]
 58%|█████▊    | 341/585 [00:04<00:03, 80.17it/s]
 60%|█████▉    | 350/585 [00:05<00:02, 81.04it/s]
 61%|██████▏   | 359/585 [00:05<00:02, 81.51it/s]
 63%|██████▎   | 368/585 [00:05<00:02, 81.62it/s]
 64%|██████▍   | 377/585 [00:05<00:02, 81.86it/s]
 66%|██████▌   | 386/585 [00:05<00:02, 82.18it/s]
 68%|██████▊   | 395/585 [00:05<00:02, 82.15it/s]
 69%|██████▉   | 404/585 [00:05<00:02, 82.15it/s]
 71%|███████   | 413/585 [00:05<00:02, 82.40it/s]
 72%|███████▏  | 422/585 [00:05<00:01, 82.63it/s]
 74%|███████▎  | 431/585 [00:05<00:01, 82.79it/s]
 75%|███████▌  | 440/585 [00:06<00:01, 82.65it/s]
 77%|███████▋  | 449/585 [00:06<00:01, 82.66it/s]
 78%|███████▊  | 458/585 [00:06<00:01, 82.73it/s]
 80%|███████▉  | 467/585 [00:06<00:01, 82.77it/s]
 81%|████████▏ | 476/585 [00:06<00:01, 82.91it/s]
 83%|████████▎ | 485/585 [00:06<00:01, 83.00it/s]
 84%|████████▍ | 494/585 [00:06<00:01, 82.99it/s]
 86%|████████▌ | 503/585 [00:06<00:00, 82.87it/s]
 88%|████████▊ | 512/585 [00:06<00:00, 82.80it/s]
 89%|████████▉ | 521/585 [00:07<00:00, 82.81it/s]
 91%|█████████ | 530/585 [00:07<00:00, 82.85it/s]
 92%|█████████▏| 539/585 [00:07<00:00, 82.87it/s]
 94%|█████████▎| 548/585 [00:07<00:00, 82.96it/s]
 95%|█████████▌| 557/585 [00:07<00:00, 83.05it/s]
 97%|█████████▋| 566/585 [00:07<00:00, 83.44it/s]
 98%|█████████▊| 575/585 [00:07<00:00, 83.72it/s]
100%|█████████▉| 584/585 [00:07<00:00, 83.92it/s]
100%|██████████| 585/585 [00:07<00:00, 73.83it/s]
INFO:Trainer:2024-11-05 20:44:57:mr: 229.887
INFO:Trainer:2024-11-05 20:44:57:mrr: 0.295
INFO:Trainer:2024-11-05 20:44:57:hits@1: 0.197
INFO:Trainer:2024-11-05 20:44:57:hits@3: 0.334
INFO:Trainer:2024-11-05 20:44:57:hits@10: 0.492
INFO:Trainer:2024-11-05 20:44:57:mr_type: 109.14
INFO:Trainer:2024-11-05 20:44:57:mrr_type: 0.344
INFO:Trainer:2024-11-05 20:44:57:hits@1_type: 0.249
INFO:Trainer:2024-11-05 20:44:57:hits@3_type: 0.378
INFO:Trainer:2024-11-05 20:44:57:hits@10_type: 0.536
INFO:EarlyStopping:2024-11-05 20:44:57:Validation score improved (0.484000 --> 0.492000).  Saving model ...
INFO:Trainer:2024-11-05 20:44:57:[cuda:1] Epoch 300 | Training checkpoint saved at ../../checkpoint/transh-300.pth
INFO:Trainer:2024-11-05 20:44:57:[cuda:1] Epoch [ 300/1000] | Batchsize: 4096 | loss:  0.619145 | 2.90835 seconds/epoch
INFO:Trainer:2024-11-05 20:49:43:[cuda:1] Epoch 400 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<03:02,  3.20it/s]
  0%|          | 2/585 [00:00<02:00,  4.86it/s]
  2%|▏         | 9/585 [00:00<00:25, 22.96it/s]
  3%|▎         | 17/585 [00:00<00:14, 38.22it/s]
  4%|▍         | 25/585 [00:00<00:11, 49.66it/s]
  6%|▌         | 33/585 [00:00<00:09, 57.77it/s]
  7%|▋         | 41/585 [00:00<00:08, 62.82it/s]
  8%|▊         | 49/585 [00:01<00:08, 66.05it/s]
 10%|▉         | 57/585 [00:01<00:07, 68.31it/s]
 11%|█         | 65/585 [00:01<00:07, 69.14it/s]
 12%|█▏        | 73/585 [00:01<00:07, 71.16it/s]
 14%|█▍        | 81/585 [00:01<00:06, 72.65it/s]
 15%|█▌        | 89/585 [00:01<00:06, 73.27it/s]
 17%|█▋        | 97/585 [00:01<00:06, 73.01it/s]
 18%|█▊        | 105/585 [00:01<00:06, 72.12it/s]
 19%|█▉        | 113/585 [00:01<00:06, 71.37it/s]
 21%|██        | 121/585 [00:02<00:06, 71.43it/s]
 22%|██▏       | 129/585 [00:02<00:06, 71.25it/s]
 23%|██▎       | 137/585 [00:02<00:06, 70.38it/s]
 25%|██▍       | 145/585 [00:02<00:06, 70.84it/s]
 26%|██▌       | 153/585 [00:02<00:06, 69.96it/s]
 28%|██▊       | 161/585 [00:02<00:06, 70.53it/s]
 29%|██▉       | 169/585 [00:02<00:05, 71.55it/s]
 30%|███       | 177/585 [00:02<00:05, 72.64it/s]
 32%|███▏      | 185/585 [00:02<00:05, 73.60it/s]
 33%|███▎      | 193/585 [00:03<00:05, 73.98it/s]
 34%|███▍      | 201/585 [00:03<00:05, 74.56it/s]
 36%|███▌      | 209/585 [00:03<00:05, 74.31it/s]
 37%|███▋      | 217/585 [00:03<00:05, 73.52it/s]
 38%|███▊      | 225/585 [00:03<00:04, 72.88it/s]
 40%|███▉      | 233/585 [00:03<00:04, 72.23it/s]
 41%|████      | 241/585 [00:03<00:04, 71.80it/s]
 43%|████▎     | 249/585 [00:03<00:04, 71.51it/s]
 44%|████▍     | 257/585 [00:03<00:04, 71.47it/s]
 45%|████▌     | 265/585 [00:04<00:04, 71.15it/s]
 47%|████▋     | 273/585 [00:04<00:04, 71.29it/s]
 48%|████▊     | 281/585 [00:04<00:04, 70.95it/s]
 49%|████▉     | 289/585 [00:04<00:04, 71.24it/s]
 51%|█████     | 297/585 [00:04<00:04, 71.46it/s]
 52%|█████▏    | 305/585 [00:04<00:03, 71.58it/s]
 54%|█████▎    | 313/585 [00:04<00:03, 72.59it/s]
 55%|█████▍    | 321/585 [00:04<00:03, 74.58it/s]
 56%|█████▋    | 330/585 [00:04<00:03, 76.47it/s]
 58%|█████▊    | 339/585 [00:05<00:03, 77.95it/s]
 59%|█████▉    | 348/585 [00:05<00:02, 79.15it/s]
 61%|██████    | 357/585 [00:05<00:02, 79.56it/s]
 63%|██████▎   | 366/585 [00:05<00:02, 79.77it/s]
 64%|██████▍   | 375/585 [00:05<00:02, 80.09it/s]
 66%|██████▌   | 384/585 [00:05<00:02, 80.03it/s]
 67%|██████▋   | 393/585 [00:05<00:02, 80.28it/s]
 69%|██████▊   | 402/585 [00:05<00:02, 80.64it/s]
 70%|███████   | 411/585 [00:05<00:02, 80.72it/s]
 72%|███████▏  | 420/585 [00:06<00:02, 80.91it/s]
 73%|███████▎  | 429/585 [00:06<00:01, 81.10it/s]
 75%|███████▍  | 438/585 [00:06<00:01, 81.17it/s]
 76%|███████▋  | 447/585 [00:06<00:01, 81.12it/s]
 78%|███████▊  | 456/585 [00:06<00:01, 81.45it/s]
 79%|███████▉  | 465/585 [00:06<00:01, 81.29it/s]
 81%|████████  | 474/585 [00:06<00:01, 81.40it/s]
 83%|████████▎ | 483/585 [00:06<00:01, 81.63it/s]
 84%|████████▍ | 492/585 [00:06<00:01, 81.36it/s]
 86%|████████▌ | 501/585 [00:07<00:01, 81.51it/s]
 87%|████████▋ | 510/585 [00:07<00:00, 81.43it/s]
 89%|████████▊ | 519/585 [00:07<00:00, 81.49it/s]
 90%|█████████ | 528/585 [00:07<00:00, 81.40it/s]
 92%|█████████▏| 537/585 [00:07<00:00, 81.56it/s]
 93%|█████████▎| 546/585 [00:07<00:00, 81.68it/s]
 95%|█████████▍| 555/585 [00:07<00:00, 81.58it/s]
 96%|█████████▋| 564/585 [00:07<00:00, 82.29it/s]
 98%|█████████▊| 573/585 [00:07<00:00, 82.84it/s]
 99%|█████████▉| 582/585 [00:08<00:00, 83.16it/s]
100%|██████████| 585/585 [00:08<00:00, 71.57it/s]
INFO:Trainer:2024-11-05 20:49:51:mr: 223.144
INFO:Trainer:2024-11-05 20:49:51:mrr: 0.301
INFO:Trainer:2024-11-05 20:49:51:hits@1: 0.202
INFO:Trainer:2024-11-05 20:49:51:hits@3: 0.339
INFO:Trainer:2024-11-05 20:49:51:hits@10: 0.496
INFO:Trainer:2024-11-05 20:49:51:mr_type: 106.982
INFO:Trainer:2024-11-05 20:49:51:mrr_type: 0.35
INFO:Trainer:2024-11-05 20:49:51:hits@1_type: 0.256
INFO:Trainer:2024-11-05 20:49:51:hits@3_type: 0.384
INFO:Trainer:2024-11-05 20:49:51:hits@10_type: 0.54
INFO:EarlyStopping:2024-11-05 20:49:51:Validation score improved (0.492000 --> 0.496000).  Saving model ...
INFO:Trainer:2024-11-05 20:49:51:[cuda:1] Epoch 400 | Training checkpoint saved at ../../checkpoint/transh-400.pth
INFO:Trainer:2024-11-05 20:49:51:[cuda:1] Epoch [ 400/1000] | Batchsize: 4096 | loss:  0.484983 | 2.91538 seconds/epoch
INFO:Trainer:2024-11-05 20:54:38:[cuda:1] Epoch 500 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<04:42,  2.06it/s]
  0%|          | 2/585 [00:00<02:39,  3.65it/s]
  2%|▏         | 9/585 [00:00<00:30, 18.77it/s]
  3%|▎         | 17/585 [00:00<00:17, 33.09it/s]
  4%|▍         | 25/585 [00:00<00:12, 45.10it/s]
  6%|▌         | 34/585 [00:01<00:09, 55.35it/s]
  7%|▋         | 42/585 [00:01<00:08, 61.89it/s]
  9%|▊         | 51/585 [00:01<00:07, 67.35it/s]
 10%|█         | 59/585 [00:01<00:07, 70.64it/s]
 11%|█▏        | 67/585 [00:01<00:07, 72.65it/s]
 13%|█▎        | 76/585 [00:01<00:06, 75.02it/s]
 14%|█▍        | 84/585 [00:01<00:06, 76.35it/s]
 16%|█▌        | 92/585 [00:01<00:06, 77.29it/s]
 17%|█▋        | 100/585 [00:01<00:06, 77.79it/s]
 19%|█▊        | 109/585 [00:01<00:06, 78.54it/s]
 20%|██        | 117/585 [00:02<00:05, 78.57it/s]
 22%|██▏       | 126/585 [00:02<00:05, 79.02it/s]
 23%|██▎       | 134/585 [00:02<00:05, 78.86it/s]
 24%|██▍       | 142/585 [00:02<00:05, 78.92it/s]
 26%|██▌       | 150/585 [00:02<00:05, 78.94it/s]
 27%|██▋       | 158/585 [00:02<00:05, 79.20it/s]
 28%|██▊       | 166/585 [00:02<00:05, 79.32it/s]
 30%|██▉       | 174/585 [00:02<00:05, 79.34it/s]
 31%|███       | 182/585 [00:02<00:05, 79.28it/s]
 33%|███▎      | 191/585 [00:03<00:04, 79.76it/s]
 34%|███▍      | 199/585 [00:03<00:04, 79.82it/s]
 36%|███▌      | 208/585 [00:03<00:04, 79.74it/s]
 37%|███▋      | 217/585 [00:03<00:04, 79.92it/s]
 39%|███▊      | 226/585 [00:03<00:04, 80.03it/s]
 40%|████      | 235/585 [00:03<00:04, 80.04it/s]
 42%|████▏     | 244/585 [00:03<00:04, 79.97it/s]
 43%|████▎     | 253/585 [00:03<00:04, 80.09it/s]
 45%|████▍     | 262/585 [00:03<00:04, 79.95it/s]
 46%|████▌     | 270/585 [00:04<00:03, 79.43it/s]
 48%|████▊     | 278/585 [00:04<00:03, 79.44it/s]
 49%|████▉     | 286/585 [00:04<00:03, 79.55it/s]
 50%|█████     | 294/585 [00:04<00:03, 79.21it/s]
 52%|█████▏    | 302/585 [00:04<00:03, 79.24it/s]
 53%|█████▎    | 311/585 [00:04<00:03, 79.61it/s]
 55%|█████▍    | 320/585 [00:04<00:03, 79.83it/s]
 56%|█████▌    | 328/585 [00:04<00:03, 79.66it/s]
 58%|█████▊    | 337/585 [00:04<00:03, 79.84it/s]
 59%|█████▉    | 346/585 [00:04<00:02, 80.06it/s]
 61%|██████    | 355/585 [00:05<00:02, 80.21it/s]
 62%|██████▏   | 364/585 [00:05<00:02, 80.34it/s]
 64%|██████▍   | 373/585 [00:05<00:02, 80.33it/s]
 65%|██████▌   | 382/585 [00:05<00:02, 80.46it/s]
 67%|██████▋   | 391/585 [00:05<00:02, 80.27it/s]
 68%|██████▊   | 400/585 [00:05<00:02, 80.43it/s]
 70%|██████▉   | 409/585 [00:05<00:02, 80.27it/s]
 71%|███████▏  | 418/585 [00:05<00:02, 80.32it/s]
 73%|███████▎  | 427/585 [00:05<00:01, 80.43it/s]
 75%|███████▍  | 436/585 [00:06<00:01, 80.38it/s]
 76%|███████▌  | 445/585 [00:06<00:01, 80.46it/s]
 78%|███████▊  | 454/585 [00:06<00:01, 80.27it/s]
 79%|███████▉  | 463/585 [00:06<00:01, 80.46it/s]
 81%|████████  | 472/585 [00:06<00:01, 80.42it/s]
 82%|████████▏ | 481/585 [00:06<00:01, 80.48it/s]
 84%|████████▍ | 490/585 [00:06<00:01, 80.65it/s]
 85%|████████▌ | 499/585 [00:06<00:01, 80.55it/s]
 87%|████████▋ | 508/585 [00:06<00:00, 80.72it/s]
 88%|████████▊ | 517/585 [00:07<00:00, 80.68it/s]
 90%|████████▉ | 526/585 [00:07<00:00, 80.84it/s]
 91%|█████████▏| 535/585 [00:07<00:00, 80.44it/s]
 93%|█████████▎| 544/585 [00:07<00:00, 80.42it/s]
 95%|█████████▍| 553/585 [00:07<00:00, 80.35it/s]
 96%|█████████▌| 562/585 [00:07<00:00, 80.86it/s]
 98%|█████████▊| 571/585 [00:07<00:00, 81.42it/s]
 99%|█████████▉| 580/585 [00:07<00:00, 81.69it/s]
100%|██████████| 585/585 [00:08<00:00, 73.03it/s]
INFO:Trainer:2024-11-05 20:54:46:mr: 224.017
INFO:Trainer:2024-11-05 20:54:46:mrr: 0.301
INFO:Trainer:2024-11-05 20:54:46:hits@1: 0.201
INFO:Trainer:2024-11-05 20:54:46:hits@3: 0.341
INFO:Trainer:2024-11-05 20:54:46:hits@10: 0.497
INFO:Trainer:2024-11-05 20:54:46:mr_type: 106.822
INFO:Trainer:2024-11-05 20:54:46:mrr_type: 0.35
INFO:Trainer:2024-11-05 20:54:46:hits@1_type: 0.255
INFO:Trainer:2024-11-05 20:54:46:hits@3_type: 0.385
INFO:Trainer:2024-11-05 20:54:46:hits@10_type: 0.543
INFO:EarlyStopping:2024-11-05 20:54:46:Validation score improved (0.496000 --> 0.497000).  Saving model ...
INFO:Trainer:2024-11-05 20:54:46:[cuda:1] Epoch 500 | Training checkpoint saved at ../../checkpoint/transh-500.pth
INFO:Trainer:2024-11-05 20:54:46:[cuda:1] Epoch [ 500/1000] | Batchsize: 4096 | loss:  0.470531 | 2.92240 seconds/epoch
INFO:Trainer:2024-11-05 20:59:43:[cuda:1] Epoch 600 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<04:22,  2.22it/s]
  1%|          | 4/585 [00:00<01:06,  8.69it/s]
  2%|▏         | 11/585 [00:00<00:24, 23.84it/s]
  3%|▎         | 18/585 [00:00<00:15, 35.83it/s]
  4%|▍         | 26/585 [00:00<00:12, 46.21it/s]
  6%|▌         | 33/585 [00:00<00:10, 52.49it/s]
  7%|▋         | 40/585 [00:01<00:09, 57.14it/s]
  8%|▊         | 47/585 [00:01<00:08, 60.06it/s]
  9%|▉         | 54/585 [00:01<00:08, 62.58it/s]
 10%|█         | 61/585 [00:01<00:08, 63.92it/s]
 12%|█▏        | 68/585 [00:01<00:07, 65.36it/s]
 13%|█▎        | 76/585 [00:01<00:07, 66.95it/s]
 14%|█▍        | 83/585 [00:01<00:07, 67.55it/s]
 15%|█▌        | 90/585 [00:01<00:07, 67.29it/s]
 17%|█▋        | 97/585 [00:01<00:07, 67.54it/s]
 18%|█▊        | 104/585 [00:02<00:07, 67.44it/s]
 19%|█▉        | 111/585 [00:02<00:06, 68.16it/s]
 20%|██        | 118/585 [00:02<00:06, 68.07it/s]
 21%|██▏       | 125/585 [00:02<00:06, 68.38it/s]
 23%|██▎       | 132/585 [00:02<00:06, 68.55it/s]
 24%|██▍       | 139/585 [00:02<00:06, 68.51it/s]
 25%|██▌       | 147/585 [00:02<00:06, 69.12it/s]
 26%|██▋       | 154/585 [00:02<00:06, 68.65it/s]
 28%|██▊       | 162/585 [00:02<00:06, 69.11it/s]
 29%|██▉       | 169/585 [00:02<00:06, 68.74it/s]
 30%|███       | 176/585 [00:03<00:05, 69.06it/s]
 31%|███▏      | 183/585 [00:03<00:05, 68.64it/s]
 32%|███▏      | 190/585 [00:03<00:05, 68.92it/s]
 34%|███▎      | 197/585 [00:03<00:05, 68.98it/s]
 35%|███▍      | 204/585 [00:03<00:05, 68.89it/s]
 36%|███▌      | 212/585 [00:03<00:05, 69.35it/s]
 37%|███▋      | 219/585 [00:03<00:05, 68.77it/s]
 39%|███▉      | 227/585 [00:03<00:05, 69.31it/s]
 40%|████      | 234/585 [00:03<00:05, 68.73it/s]
 41%|████      | 241/585 [00:04<00:04, 69.09it/s]
 42%|████▏     | 248/585 [00:04<00:04, 68.56it/s]
 44%|████▍     | 256/585 [00:04<00:04, 69.08it/s]
 45%|████▍     | 263/585 [00:04<00:04, 68.79it/s]
 46%|████▋     | 271/585 [00:04<00:04, 69.25it/s]
 48%|████▊     | 278/585 [00:04<00:04, 68.98it/s]
 49%|████▉     | 286/585 [00:04<00:04, 69.62it/s]
 50%|█████     | 294/585 [00:04<00:04, 71.81it/s]
 52%|█████▏    | 303/585 [00:04<00:03, 74.64it/s]
 53%|█████▎    | 311/585 [00:04<00:03, 75.85it/s]
 55%|█████▍    | 320/585 [00:05<00:03, 77.37it/s]
 56%|█████▌    | 328/585 [00:05<00:03, 77.59it/s]
 57%|█████▋    | 336/585 [00:05<00:03, 78.08it/s]
 59%|█████▉    | 344/585 [00:05<00:03, 78.45it/s]
 60%|██████    | 352/585 [00:05<00:02, 78.86it/s]
 62%|██████▏   | 360/585 [00:05<00:02, 78.87it/s]
 63%|██████▎   | 368/585 [00:05<00:02, 79.04it/s]
 64%|██████▍   | 376/585 [00:05<00:02, 78.89it/s]
 66%|██████▌   | 385/585 [00:05<00:02, 79.34it/s]
 67%|██████▋   | 393/585 [00:06<00:02, 79.20it/s]
 69%|██████▊   | 401/585 [00:06<00:02, 79.41it/s]
 70%|██████▉   | 409/585 [00:06<00:02, 79.29it/s]
 71%|███████▏  | 417/585 [00:06<00:02, 79.39it/s]
 73%|███████▎  | 425/585 [00:06<00:02, 79.22it/s]
 74%|███████▍  | 433/585 [00:06<00:01, 79.33it/s]
 75%|███████▌  | 441/585 [00:06<00:01, 79.18it/s]
 77%|███████▋  | 449/585 [00:06<00:01, 79.42it/s]
 78%|███████▊  | 457/585 [00:06<00:01, 79.10it/s]
 80%|███████▉  | 466/585 [00:06<00:01, 79.66it/s]
 81%|████████  | 475/585 [00:07<00:01, 79.83it/s]
 83%|████████▎ | 483/585 [00:07<00:01, 79.77it/s]
 84%|████████▍ | 492/585 [00:07<00:01, 79.90it/s]
 85%|████████▌ | 500/585 [00:07<00:01, 79.90it/s]
 87%|████████▋ | 508/585 [00:07<00:00, 79.80it/s]
 88%|████████▊ | 517/585 [00:07<00:00, 79.98it/s]
 90%|████████▉ | 525/585 [00:07<00:00, 79.93it/s]
 91%|█████████ | 533/585 [00:07<00:00, 79.86it/s]
 92%|█████████▏| 541/585 [00:07<00:00, 79.87it/s]
 94%|█████████▍| 549/585 [00:07<00:00, 79.71it/s]
 95%|█████████▌| 557/585 [00:08<00:00, 79.60it/s]
 97%|█████████▋| 566/585 [00:08<00:00, 80.69it/s]
 98%|█████████▊| 575/585 [00:08<00:00, 81.45it/s]
100%|█████████▉| 584/585 [00:08<00:00, 81.94it/s]
100%|██████████| 585/585 [00:08<00:00, 68.82it/s]
INFO:Trainer:2024-11-05 20:59:51:mr: 225.501
INFO:Trainer:2024-11-05 20:59:51:mrr: 0.301
INFO:Trainer:2024-11-05 20:59:51:hits@1: 0.201
INFO:Trainer:2024-11-05 20:59:51:hits@3: 0.34
INFO:Trainer:2024-11-05 20:59:51:hits@10: 0.497
INFO:Trainer:2024-11-05 20:59:51:mr_type: 106.989
INFO:Trainer:2024-11-05 20:59:51:mrr_type: 0.351
INFO:Trainer:2024-11-05 20:59:51:hits@1_type: 0.255
INFO:Trainer:2024-11-05 20:59:51:hits@3_type: 0.385
INFO:Trainer:2024-11-05 20:59:51:hits@10_type: 0.542
INFO:EarlyStopping:2024-11-05 20:59:51:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-11-05 20:59:51:[cuda:1] Epoch 600 | Training checkpoint saved at ../../checkpoint/transh-600.pth
INFO:Trainer:2024-11-05 20:59:51:[cuda:1] Epoch [ 600/1000] | Batchsize: 4096 | loss:  0.461229 | 2.94365 seconds/epoch
INFO:Trainer:2024-11-05 21:04:40:[cuda:1] Epoch 700 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<03:44,  2.60it/s]
  0%|          | 2/585 [00:00<02:17,  4.25it/s]
  2%|▏         | 9/585 [00:00<00:27, 21.06it/s]
  3%|▎         | 17/585 [00:00<00:15, 35.76it/s]
  4%|▍         | 25/585 [00:00<00:11, 46.87it/s]
  6%|▌         | 33/585 [00:00<00:10, 54.89it/s]
  7%|▋         | 41/585 [00:01<00:08, 60.84it/s]
  8%|▊         | 49/585 [00:01<00:08, 64.95it/s]
 10%|▉         | 57/585 [00:01<00:07, 68.09it/s]
 11%|█         | 65/585 [00:01<00:07, 69.99it/s]
 12%|█▏        | 73/585 [00:01<00:07, 71.67it/s]
 14%|█▍        | 81/585 [00:01<00:06, 73.02it/s]
 15%|█▌        | 89/585 [00:01<00:06, 73.97it/s]
 17%|█▋        | 97/585 [00:01<00:06, 74.56it/s]
 18%|█▊        | 105/585 [00:01<00:06, 74.75it/s]
 19%|█▉        | 113/585 [00:02<00:06, 75.04it/s]
 21%|██        | 121/585 [00:02<00:06, 75.13it/s]
 22%|██▏       | 129/585 [00:02<00:06, 75.54it/s]
 23%|██▎       | 137/585 [00:02<00:05, 75.70it/s]
 25%|██▍       | 145/585 [00:02<00:05, 75.83it/s]
 26%|██▌       | 153/585 [00:02<00:05, 76.01it/s]
 28%|██▊       | 161/585 [00:02<00:05, 76.06it/s]
 29%|██▉       | 169/585 [00:02<00:05, 76.22it/s]
 30%|███       | 177/585 [00:02<00:05, 76.20it/s]
 32%|███▏      | 185/585 [00:02<00:05, 76.13it/s]
 33%|███▎      | 193/585 [00:03<00:05, 76.14it/s]
 34%|███▍      | 201/585 [00:03<00:05, 76.11it/s]
 36%|███▌      | 209/585 [00:03<00:04, 76.06it/s]
 37%|███▋      | 217/585 [00:03<00:04, 76.13it/s]
 38%|███▊      | 225/585 [00:03<00:04, 75.98it/s]
 40%|███▉      | 233/585 [00:03<00:04, 75.94it/s]
 41%|████      | 241/585 [00:03<00:04, 76.01it/s]
 43%|████▎     | 249/585 [00:03<00:04, 75.83it/s]
 44%|████▍     | 257/585 [00:03<00:04, 76.02it/s]
 45%|████▌     | 265/585 [00:04<00:04, 76.04it/s]
 47%|████▋     | 273/585 [00:04<00:04, 75.63it/s]
 48%|████▊     | 281/585 [00:04<00:04, 74.79it/s]
 49%|████▉     | 289/585 [00:04<00:03, 74.98it/s]
 51%|█████     | 297/585 [00:04<00:03, 75.24it/s]
 52%|█████▏    | 305/585 [00:04<00:03, 76.50it/s]
 54%|█████▎    | 314/585 [00:04<00:03, 77.62it/s]
 55%|█████▌    | 323/585 [00:04<00:03, 78.48it/s]
 57%|█████▋    | 332/585 [00:04<00:03, 79.15it/s]
 58%|█████▊    | 340/585 [00:04<00:03, 79.22it/s]
 59%|█████▉    | 348/585 [00:05<00:03, 78.66it/s]
 61%|██████    | 356/585 [00:05<00:02, 78.06it/s]
 62%|██████▏   | 364/585 [00:05<00:02, 77.90it/s]
 64%|██████▎   | 372/585 [00:05<00:02, 77.19it/s]
 65%|██████▍   | 380/585 [00:05<00:02, 77.21it/s]
 66%|██████▋   | 388/585 [00:05<00:02, 76.59it/s]
 68%|██████▊   | 396/585 [00:05<00:02, 76.67it/s]
 69%|██████▉   | 404/585 [00:05<00:02, 76.38it/s]
 70%|███████   | 412/585 [00:05<00:02, 76.42it/s]
 72%|███████▏  | 420/585 [00:06<00:02, 76.02it/s]
 73%|███████▎  | 428/585 [00:06<00:02, 76.42it/s]
 75%|███████▍  | 436/585 [00:06<00:01, 75.74it/s]
 76%|███████▌  | 444/585 [00:06<00:01, 76.07it/s]
 77%|███████▋  | 452/585 [00:06<00:01, 75.82it/s]
 79%|███████▊  | 460/585 [00:06<00:01, 76.26it/s]
 80%|████████  | 468/585 [00:06<00:01, 75.73it/s]
 81%|████████▏ | 476/585 [00:06<00:01, 76.12it/s]
 83%|████████▎ | 484/585 [00:06<00:01, 75.98it/s]
 84%|████████▍ | 492/585 [00:06<00:01, 76.41it/s]
 85%|████████▌ | 500/585 [00:07<00:01, 75.74it/s]
 87%|████████▋ | 508/585 [00:07<00:01, 76.17it/s]
 88%|████████▊ | 516/585 [00:07<00:00, 75.88it/s]
 90%|████████▉ | 524/585 [00:07<00:00, 76.42it/s]
 91%|█████████ | 532/585 [00:07<00:00, 76.15it/s]
 92%|█████████▏| 540/585 [00:07<00:00, 77.18it/s]
 94%|█████████▍| 549/585 [00:07<00:00, 78.18it/s]
 95%|█████████▌| 558/585 [00:07<00:00, 79.16it/s]
 97%|█████████▋| 567/585 [00:07<00:00, 80.33it/s]
 98%|█████████▊| 576/585 [00:08<00:00, 81.08it/s]
100%|██████████| 585/585 [00:08<00:00, 82.71it/s]
100%|██████████| 585/585 [00:08<00:00, 70.84it/s]
INFO:Trainer:2024-11-05 21:04:48:mr: 225.918
INFO:Trainer:2024-11-05 21:04:48:mrr: 0.3
INFO:Trainer:2024-11-05 21:04:48:hits@1: 0.2
INFO:Trainer:2024-11-05 21:04:48:hits@3: 0.339
INFO:Trainer:2024-11-05 21:04:48:hits@10: 0.498
INFO:Trainer:2024-11-05 21:04:48:mr_type: 107.057
INFO:Trainer:2024-11-05 21:04:48:mrr_type: 0.351
INFO:Trainer:2024-11-05 21:04:48:hits@1_type: 0.256
INFO:Trainer:2024-11-05 21:04:48:hits@3_type: 0.385
INFO:Trainer:2024-11-05 21:04:48:hits@10_type: 0.543
INFO:EarlyStopping:2024-11-05 21:04:48:Validation score improved (0.497000 --> 0.498000).  Saving model ...
INFO:Trainer:2024-11-05 21:04:48:[cuda:1] Epoch 700 | Training checkpoint saved at ../../checkpoint/transh-700.pth
INFO:Trainer:2024-11-05 21:04:48:[cuda:1] Epoch [ 700/1000] | Batchsize: 4096 | loss:  0.459751 | 2.94792 seconds/epoch
INFO:Trainer:2024-11-05 21:09:35:[cuda:1] Epoch 800 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<03:37,  2.69it/s]
  0%|          | 2/585 [00:00<02:06,  4.60it/s]
  2%|▏         | 9/585 [00:00<00:25, 22.66it/s]
  3%|▎         | 17/585 [00:00<00:14, 38.41it/s]
  4%|▍         | 26/585 [00:00<00:10, 51.31it/s]
  6%|▌         | 34/585 [00:00<00:09, 59.10it/s]
  7%|▋         | 42/585 [00:01<00:08, 65.06it/s]
  9%|▊         | 51/585 [00:01<00:07, 69.94it/s]
 10%|█         | 59/585 [00:01<00:07, 72.44it/s]
 11%|█▏        | 67/585 [00:01<00:06, 74.25it/s]
 13%|█▎        | 75/585 [00:01<00:06, 75.52it/s]
 14%|█▍        | 83/585 [00:01<00:06, 76.75it/s]
 16%|█▌        | 91/585 [00:01<00:06, 77.69it/s]
 17%|█▋        | 100/585 [00:01<00:06, 78.44it/s]
 19%|█▊        | 109/585 [00:01<00:06, 78.99it/s]
 20%|██        | 118/585 [00:01<00:05, 79.28it/s]
 22%|██▏       | 126/585 [00:02<00:05, 79.47it/s]
 23%|██▎       | 134/585 [00:02<00:05, 79.37it/s]
 24%|██▍       | 143/585 [00:02<00:05, 79.81it/s]
 26%|██▌       | 151/585 [00:02<00:05, 79.84it/s]
 27%|██▋       | 160/585 [00:02<00:05, 80.04it/s]
 29%|██▉       | 169/585 [00:02<00:05, 80.12it/s]
 30%|███       | 178/585 [00:02<00:05, 80.34it/s]
 32%|███▏      | 187/585 [00:02<00:04, 80.11it/s]
 34%|███▎      | 196/585 [00:02<00:04, 80.27it/s]
 35%|███▌      | 205/585 [00:03<00:04, 79.91it/s]
 37%|███▋      | 214/585 [00:03<00:04, 80.01it/s]
 38%|███▊      | 223/585 [00:03<00:04, 80.05it/s]
 40%|███▉      | 232/585 [00:03<00:04, 80.11it/s]
 41%|████      | 241/585 [00:03<00:04, 80.21it/s]
 43%|████▎     | 250/585 [00:03<00:04, 80.29it/s]
 44%|████▍     | 259/585 [00:03<00:04, 80.38it/s]
 46%|████▌     | 268/585 [00:03<00:03, 80.21it/s]
 47%|████▋     | 277/585 [00:03<00:03, 80.24it/s]
 49%|████▉     | 286/585 [00:04<00:03, 80.15it/s]
 50%|█████     | 295/585 [00:04<00:03, 79.98it/s]
 52%|█████▏    | 303/585 [00:04<00:03, 79.98it/s]
 53%|█████▎    | 312/585 [00:04<00:03, 80.39it/s]
 55%|█████▍    | 321/585 [00:04<00:03, 80.04it/s]
 56%|█████▋    | 330/585 [00:04<00:03, 79.84it/s]
 58%|█████▊    | 339/585 [00:04<00:03, 80.07it/s]
 59%|█████▉    | 348/585 [00:04<00:02, 79.98it/s]
 61%|██████    | 356/585 [00:04<00:02, 79.89it/s]
 62%|██████▏   | 365/585 [00:05<00:02, 79.99it/s]
 64%|██████▍   | 374/585 [00:05<00:02, 80.04it/s]
 65%|██████▌   | 383/585 [00:05<00:02, 79.99it/s]
 67%|██████▋   | 392/585 [00:05<00:02, 80.27it/s]
 69%|██████▊   | 401/585 [00:05<00:02, 80.20it/s]
 70%|███████   | 410/585 [00:05<00:02, 80.07it/s]
 72%|███████▏  | 419/585 [00:05<00:02, 80.09it/s]
 73%|███████▎  | 428/585 [00:05<00:01, 80.06it/s]
 75%|███████▍  | 437/585 [00:05<00:01, 80.02it/s]
 76%|███████▌  | 446/585 [00:06<00:01, 79.84it/s]
 78%|███████▊  | 455/585 [00:06<00:01, 80.11it/s]
 79%|███████▉  | 464/585 [00:06<00:01, 80.14it/s]
 81%|████████  | 473/585 [00:06<00:01, 80.10it/s]
 82%|████████▏ | 482/585 [00:06<00:01, 79.64it/s]
 84%|████████▍ | 491/585 [00:06<00:01, 79.83it/s]
 85%|████████▌ | 500/585 [00:06<00:01, 79.98it/s]
 87%|████████▋ | 509/585 [00:06<00:00, 80.05it/s]
 89%|████████▊ | 518/585 [00:06<00:00, 79.80it/s]
 90%|█████████ | 527/585 [00:07<00:00, 80.01it/s]
 92%|█████████▏| 536/585 [00:07<00:00, 80.39it/s]
 93%|█████████▎| 545/585 [00:07<00:00, 80.08it/s]
 95%|█████████▍| 554/585 [00:07<00:00, 80.03it/s]
 96%|█████████▌| 563/585 [00:07<00:00, 80.92it/s]
 98%|█████████▊| 572/585 [00:07<00:00, 81.61it/s]
 99%|█████████▉| 581/585 [00:07<00:00, 82.07it/s]
100%|██████████| 585/585 [00:07<00:00, 74.20it/s]
INFO:Trainer:2024-11-05 21:09:42:mr: 225.623
INFO:Trainer:2024-11-05 21:09:42:mrr: 0.3
INFO:Trainer:2024-11-05 21:09:42:hits@1: 0.201
INFO:Trainer:2024-11-05 21:09:42:hits@3: 0.339
INFO:Trainer:2024-11-05 21:09:42:hits@10: 0.497
INFO:Trainer:2024-11-05 21:09:42:mr_type: 107.068
INFO:Trainer:2024-11-05 21:09:42:mrr_type: 0.351
INFO:Trainer:2024-11-05 21:09:42:hits@1_type: 0.256
INFO:Trainer:2024-11-05 21:09:42:hits@3_type: 0.385
INFO:Trainer:2024-11-05 21:09:42:hits@10_type: 0.543
INFO:EarlyStopping:2024-11-05 21:09:42:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-11-05 21:09:42:[cuda:1] Epoch 800 | Training checkpoint saved at ../../checkpoint/transh-800.pth
INFO:Trainer:2024-11-05 21:09:42:[cuda:1] Epoch [ 800/1000] | Batchsize: 4096 | loss:  0.453763 | 2.94757 seconds/epoch
INFO:Trainer:2024-11-05 21:14:34:[cuda:1] Epoch 900 | The model starts evaluation on the validation set.

  0%|          | 0/585 [00:00<?, ?it/s]
  0%|          | 1/585 [00:00<04:40,  2.08it/s]
  0%|          | 2/585 [00:00<02:38,  3.67it/s]
  2%|▏         | 9/585 [00:00<00:30, 18.84it/s]
  3%|▎         | 17/585 [00:00<00:16, 33.52it/s]
  4%|▍         | 26/585 [00:00<00:11, 46.92it/s]
  6%|▌         | 35/585 [00:01<00:09, 56.69it/s]
  8%|▊         | 44/585 [00:01<00:08, 63.86it/s]
  9%|▉         | 53/585 [00:01<00:07, 69.11it/s]
 11%|█         | 62/585 [00:01<00:07, 72.84it/s]
 12%|█▏        | 71/585 [00:01<00:06, 75.39it/s]
 14%|█▎        | 80/585 [00:01<00:06, 77.40it/s]
 15%|█▌        | 89/585 [00:01<00:06, 78.75it/s]
 17%|█▋        | 98/585 [00:01<00:06, 79.67it/s]
 18%|█▊        | 107/585 [00:01<00:05, 80.38it/s]
 20%|█▉        | 116/585 [00:02<00:05, 80.75it/s]
 21%|██▏       | 125/585 [00:02<00:05, 81.06it/s]
 23%|██▎       | 134/585 [00:02<00:05, 81.35it/s]
 24%|██▍       | 143/585 [00:02<00:05, 81.50it/s]
 26%|██▌       | 152/585 [00:02<00:05, 81.63it/s]
 28%|██▊       | 161/585 [00:02<00:05, 81.74it/s]
 29%|██▉       | 170/585 [00:02<00:05, 81.81it/s]
 31%|███       | 179/585 [00:02<00:04, 81.28it/s]
 32%|███▏      | 188/585 [00:02<00:04, 80.36it/s]
 34%|███▎      | 197/585 [00:03<00:04, 80.55it/s]
 35%|███▌      | 206/585 [00:03<00:04, 80.37it/s]
 37%|███▋      | 215/585 [00:03<00:04, 80.25it/s]
 38%|███▊      | 224/585 [00:03<00:04, 80.39it/s]
 40%|███▉      | 233/585 [00:03<00:04, 80.12it/s]
 41%|████▏     | 242/585 [00:03<00:04, 80.39it/s]
 43%|████▎     | 251/585 [00:03<00:04, 80.51it/s]
 44%|████▍     | 260/585 [00:03<00:04, 80.61it/s]
 46%|████▌     | 269/585 [00:03<00:03, 80.30it/s]
 48%|████▊     | 278/585 [00:04<00:03, 80.46it/s]
 49%|████▉     | 287/585 [00:04<00:03, 80.29it/s]
 51%|█████     | 296/585 [00:04<00:03, 80.28it/s]
 52%|█████▏    | 305/585 [00:04<00:03, 80.58it/s]
 54%|█████▎    | 314/585 [00:04<00:03, 80.50it/s]
 55%|█████▌    | 323/585 [00:04<00:03, 80.76it/s]
 57%|█████▋    | 332/585 [00:04<00:03, 80.59it/s]
 58%|█████▊    | 341/585 [00:04<00:03, 80.77it/s]
 60%|█████▉    | 350/585 [00:04<00:02, 80.48it/s]
 61%|██████▏   | 359/585 [00:05<00:02, 80.50it/s]
 63%|██████▎   | 368/585 [00:05<00:02, 80.53it/s]
 64%|██████▍   | 377/585 [00:05<00:02, 80.19it/s]
 66%|██████▌   | 386/585 [00:05<00:02, 80.48it/s]
 68%|██████▊   | 395/585 [00:05<00:02, 80.04it/s]
 69%|██████▉   | 404/585 [00:05<00:02, 80.03it/s]
 71%|███████   | 413/585 [00:05<00:02, 79.51it/s]
 72%|███████▏  | 422/585 [00:05<00:02, 80.06it/s]
 74%|███████▎  | 431/585 [00:05<00:01, 80.05it/s]
 75%|███████▌  | 440/585 [00:06<00:01, 80.13it/s]
 77%|███████▋  | 449/585 [00:06<00:01, 80.58it/s]
 78%|███████▊  | 458/585 [00:06<00:01, 80.36it/s]
 80%|███████▉  | 467/585 [00:06<00:01, 79.84it/s]
 81%|████████  | 475/585 [00:06<00:01, 79.72it/s]
 83%|████████▎ | 484/585 [00:06<00:01, 80.31it/s]
 84%|████████▍ | 493/585 [00:06<00:01, 80.09it/s]
 86%|████████▌ | 502/585 [00:06<00:01, 80.45it/s]
 87%|████████▋ | 511/585 [00:06<00:00, 80.32it/s]
 89%|████████▉ | 520/585 [00:07<00:00, 80.19it/s]
 90%|█████████ | 529/585 [00:07<00:00, 80.53it/s]
 92%|█████████▏| 538/585 [00:07<00:00, 80.46it/s]
 94%|█████████▎| 547/585 [00:07<00:00, 80.84it/s]
 95%|█████████▌| 556/585 [00:07<00:00, 80.57it/s]
 97%|█████████▋| 565/585 [00:07<00:00, 81.34it/s]
 98%|█████████▊| 574/585 [00:07<00:00, 81.91it/s]
100%|█████████▉| 583/585 [00:07<00:00, 82.31it/s]
100%|██████████| 585/585 [00:07<00:00, 73.64it/s]
INFO:Trainer:2024-11-05 21:14:41:mr: 225.472
INFO:Trainer:2024-11-05 21:14:41:mrr: 0.3
INFO:Trainer:2024-11-05 21:14:41:hits@1: 0.2
INFO:Trainer:2024-11-05 21:14:41:hits@3: 0.34
INFO:Trainer:2024-11-05 21:14:41:hits@10: 0.498
INFO:Trainer:2024-11-05 21:14:41:mr_type: 107.019
INFO:Trainer:2024-11-05 21:14:41:mrr_type: 0.351
INFO:Trainer:2024-11-05 21:14:41:hits@1_type: 0.256
INFO:Trainer:2024-11-05 21:14:41:hits@3_type: 0.385
INFO:Trainer:2024-11-05 21:14:41:hits@10_type: 0.544
INFO:EarlyStopping:2024-11-05 21:14:41:EarlyStopping counter: 2 / 2
INFO:Trainer:2024-11-05 21:14:41:[cuda:1] Send an early stopping signal
INFO:Trainer:2024-11-05 21:14:41:[cuda:1] The model training is completed, taking a total of 2657.03518 seconds.
INFO:Trainer:2024-11-05 21:14:42:[cuda:1] Model saved at ../../checkpoint/transh.pth.
INFO:Trainer:2024-11-05 21:14:42:[cuda:1] The model starts evaluating in the test set.

  0%|          | 0/683 [00:00<?, ?it/s]
  0%|          | 1/683 [00:00<03:37,  3.14it/s]
  0%|          | 2/683 [00:00<02:31,  4.51it/s]
  1%|▏         | 9/683 [00:00<00:31, 21.72it/s]
  2%|▏         | 16/683 [00:00<00:19, 34.67it/s]
  4%|▎         | 24/683 [00:00<00:14, 45.70it/s]
  5%|▍         | 31/683 [00:00<00:12, 52.39it/s]
  6%|▌         | 38/683 [00:01<00:11, 56.92it/s]
  7%|▋         | 45/683 [00:01<00:10, 60.17it/s]
  8%|▊         | 52/683 [00:01<00:10, 62.58it/s]
  9%|▊         | 59/683 [00:01<00:09, 63.37it/s]
 10%|▉         | 66/683 [00:01<00:09, 64.53it/s]
 11%|█         | 73/683 [00:01<00:09, 65.58it/s]
 12%|█▏        | 80/683 [00:01<00:09, 66.66it/s]
 13%|█▎        | 87/683 [00:01<00:08, 67.32it/s]
 14%|█▍        | 95/683 [00:01<00:08, 68.27it/s]
 15%|█▍        | 102/683 [00:01<00:08, 68.43it/s]
 16%|█▌        | 109/683 [00:02<00:08, 68.52it/s]
 17%|█▋        | 116/683 [00:02<00:08, 68.86it/s]
 18%|█▊        | 124/683 [00:02<00:08, 69.37it/s]
 19%|█▉        | 132/683 [00:02<00:07, 69.73it/s]
 20%|██        | 140/683 [00:02<00:07, 69.81it/s]
 22%|██▏       | 148/683 [00:02<00:07, 70.07it/s]
 23%|██▎       | 156/683 [00:02<00:07, 69.84it/s]
 24%|██▍       | 163/683 [00:02<00:07, 69.78it/s]
 25%|██▍       | 170/683 [00:02<00:07, 69.82it/s]
 26%|██▌       | 178/683 [00:03<00:07, 69.84it/s]
 27%|██▋       | 185/683 [00:03<00:07, 69.86it/s]
 28%|██▊       | 193/683 [00:03<00:06, 70.20it/s]
 29%|██▉       | 201/683 [00:03<00:06, 70.11it/s]
 31%|███       | 209/683 [00:03<00:06, 70.19it/s]
 32%|███▏      | 217/683 [00:03<00:06, 70.23it/s]
 33%|███▎      | 225/683 [00:03<00:06, 70.35it/s]
 34%|███▍      | 233/683 [00:03<00:06, 69.58it/s]
 35%|███▌      | 241/683 [00:03<00:06, 69.96it/s]
 36%|███▋      | 248/683 [00:04<00:06, 69.70it/s]
 37%|███▋      | 256/683 [00:04<00:06, 70.13it/s]
 39%|███▊      | 264/683 [00:04<00:05, 69.94it/s]
 40%|███▉      | 272/683 [00:04<00:05, 70.03it/s]
 41%|████      | 280/683 [00:04<00:05, 69.38it/s]
 42%|████▏     | 287/683 [00:04<00:05, 69.15it/s]
 43%|████▎     | 294/683 [00:04<00:05, 69.17it/s]
 44%|████▍     | 301/683 [00:04<00:05, 69.34it/s]
 45%|████▌     | 308/683 [00:04<00:05, 69.29it/s]
 46%|████▋     | 316/683 [00:05<00:05, 69.59it/s]
 47%|████▋     | 324/683 [00:05<00:05, 69.67it/s]
 49%|████▊     | 332/683 [00:05<00:05, 69.97it/s]
 50%|████▉     | 339/683 [00:05<00:04, 69.98it/s]
 51%|█████     | 347/683 [00:05<00:04, 70.42it/s]
 52%|█████▏    | 355/683 [00:05<00:04, 72.30it/s]
 53%|█████▎    | 364/683 [00:05<00:04, 75.10it/s]
 55%|█████▍    | 373/683 [00:05<00:04, 77.02it/s]
 56%|█████▌    | 382/683 [00:05<00:03, 78.21it/s]
 57%|█████▋    | 391/683 [00:05<00:03, 78.88it/s]
 59%|█████▊    | 400/683 [00:06<00:03, 79.63it/s]
 60%|█████▉    | 408/683 [00:06<00:03, 79.55it/s]
 61%|██████    | 417/683 [00:06<00:03, 79.77it/s]
 62%|██████▏   | 426/683 [00:06<00:03, 80.07it/s]
 64%|██████▎   | 435/683 [00:06<00:03, 80.22it/s]
 65%|██████▌   | 444/683 [00:06<00:02, 80.34it/s]
 66%|██████▋   | 453/683 [00:06<00:02, 80.38it/s]
 68%|██████▊   | 462/683 [00:06<00:02, 80.54it/s]
 69%|██████▉   | 471/683 [00:06<00:02, 80.49it/s]
 70%|███████   | 480/683 [00:07<00:02, 80.75it/s]
 72%|███████▏  | 489/683 [00:07<00:02, 80.83it/s]
 73%|███████▎  | 498/683 [00:07<00:02, 80.95it/s]
 74%|███████▍  | 507/683 [00:07<00:02, 80.58it/s]
 76%|███████▌  | 516/683 [00:07<00:02, 80.10it/s]
 77%|███████▋  | 525/683 [00:07<00:01, 80.32it/s]
 78%|███████▊  | 534/683 [00:07<00:01, 80.53it/s]
 80%|███████▉  | 543/683 [00:07<00:01, 80.60it/s]
 81%|████████  | 552/683 [00:07<00:01, 80.49it/s]
 82%|████████▏ | 561/683 [00:08<00:01, 80.65it/s]
 83%|████████▎ | 570/683 [00:08<00:01, 80.63it/s]
 85%|████████▍ | 579/683 [00:08<00:01, 80.71it/s]
 86%|████████▌ | 588/683 [00:08<00:01, 80.93it/s]
 87%|████████▋ | 597/683 [00:08<00:01, 80.68it/s]
 89%|████████▊ | 606/683 [00:08<00:00, 80.79it/s]
 90%|█████████ | 615/683 [00:08<00:00, 80.54it/s]
 91%|█████████▏| 624/683 [00:08<00:00, 80.68it/s]
 93%|█████████▎| 633/683 [00:08<00:00, 80.67it/s]
 94%|█████████▍| 642/683 [00:09<00:00, 80.89it/s]
 95%|█████████▌| 651/683 [00:09<00:00, 80.91it/s]
 97%|█████████▋| 660/683 [00:09<00:00, 81.41it/s]
 98%|█████████▊| 669/683 [00:09<00:00, 81.86it/s]
 99%|█████████▉| 678/683 [00:09<00:00, 82.19it/s]
100%|██████████| 683/683 [00:09<00:00, 70.32it/s]
INFO:Trainer:2024-11-05 21:14:51:mr: 234.642
INFO:Trainer:2024-11-05 21:14:51:mrr: 0.296
INFO:Trainer:2024-11-05 21:14:51:hits@1: 0.196
INFO:Trainer:2024-11-05 21:14:51:hits@3: 0.335
INFO:Trainer:2024-11-05 21:14:51:hits@10: 0.492
INFO:Trainer:2024-11-05 21:14:51:mr_type: 109.699
INFO:Trainer:2024-11-05 21:14:51:mrr_type: 0.345
INFO:Trainer:2024-11-05 21:14:51:hits@1_type: 0.25
INFO:Trainer:2024-11-05 21:14:51:hits@3_type: 0.38
INFO:Trainer:2024-11-05 21:14:51:hits@10_type: 0.536
wandb: - 0.014 MB of 0.014 MB uploaded
wandb: \ 0.014 MB of 0.014 MB uploaded
wandb: | 0.014 MB of 0.014 MB uploaded
wandb: Network error (TransientError), entering retry loop.
wandb: / 0.014 MB of 0.014 MB uploaded
wandb: - 0.014 MB of 0.014 MB uploaded
wandb: \ 0.014 MB of 0.014 MB uploaded
wandb: | 0.014 MB of 0.014 MB uploaded
wandb: / 0.024 MB of 0.024 MB uploaded
wandb: - 0.024 MB of 0.043 MB uploaded
wandb: \ 0.035 MB of 0.043 MB uploaded
wandb: | 0.036 MB of 0.043 MB uploaded
wandb: / 0.043 MB of 0.043 MB uploaded
wandb: - 0.043 MB of 0.043 MB uploaded
wandb: \ 0.043 MB of 0.043 MB uploaded
wandb:                                                                                
wandb: 
wandb: Run history:
wandb:          duration ▁
wandb:       test/hits@1 ▁
wandb:      test/hits@10 ▁
wandb: test/hits@10_type ▁
wandb:  test/hits@1_type ▁
wandb:       test/hits@3 ▁
wandb:  test/hits@3_type ▁
wandb:           test/mr ▁
wandb:      test/mr_type ▁
wandb:          test/mrr ▁
wandb:     test/mrr_type ▁
wandb:       train/epoch ▁▂▃▄▅▆▇█
wandb:  train/train_loss █▅▃▁▁▁▁▁
wandb:         val/epoch ▁▂▃▄▅▅▆▇█
wandb:        val/hits@1 ▁▅▆███▇█▇
wandb:       val/hits@10 ▁▄▆▇█████
wandb:  val/hits@10_type ▁▄▆▇█████
wandb:   val/hits@1_type ▁▅▆██████
wandb:        val/hits@3 ▁▄▆▇██▇▇█
wandb:   val/hits@3_type ▁▄▆██████
wandb:            val/mr ▄██▁▂▃▄▄▃
wandb:       val/mr_type █▃▃▁▁▁▁▁▁
wandb:           val/mrr ▁▅▆██████
wandb:      val/mrr_type ▁▄▆██████
wandb: 
wandb: Run summary:
wandb:          duration 2657.03518
wandb:       test/hits@1 0.196
wandb:      test/hits@10 0.492
wandb: test/hits@10_type 0.536
wandb:  test/hits@1_type 0.25
wandb:       test/hits@3 0.335
wandb:  test/hits@3_type 0.38
wandb:           test/mr 234.642
wandb:      test/mr_type 109.699
wandb:          test/mrr 0.296
wandb:     test/mrr_type 0.345
wandb:       train/epoch 800
wandb:  train/train_loss 0.45376
wandb:         val/epoch 899
wandb:        val/hits@1 0.2
wandb:       val/hits@10 0.498
wandb:  val/hits@10_type 0.544
wandb:   val/hits@1_type 0.256
wandb:        val/hits@3 0.34
wandb:   val/hits@3_type 0.385
wandb:            val/mr 225.472
wandb:       val/mr_type 107.019
wandb:           val/mrr 0.3
wandb:      val/mrr_type 0.351
wandb: 
wandb: 🚀 View run TransH-FB15K237 at: https://wandb.ai/3555028709/pybind11-ke/runs/s7kg5bwf
wandb: ⭐️ View project at: https://wandb.ai/3555028709/pybind11-ke
wandb: Synced 5 W&B file(s), 0 media file(s), 2 artifact file(s) and 0 other file(s)
wandb: Find logs at: ./wandb/run-20240511_203012-s7kg5bwf/logs
DEBUG:connectionpool:2024-11-05 21:15:07:Starting new HTTPS connection (1): o151352.ingest.sentry.io:443
DEBUG:connectionpool:2024-11-05 21:15:08:https://o151352.ingest.sentry.io:443 "POST /api/4504800232407040/envelope/ HTTP/1.1" 200 0