Using RTX 4000 series which doesn't support faster communication speedups. Ensuring P2P and IB communications are disabled.
INFO:Trainer:2024-13-05 20:36:03:[cuda:0] Initialization completed, start model training.
INFO:Trainer:2024-13-05 20:36:04:[cuda:0] Initialization completed, start model training.
INFO:Trainer:2024-13-05 20:36:06:[cuda:0] The model training is completed, taking a total of 3.43352 seconds.
INFO:distributed_c10d:2024-13-05 20:36:07:Added key: store_based_barrier_key:1 to store for rank: 0
INFO:Trainer:2024-13-05 20:36:08:[cuda:0] The model training is completed, taking a total of 3.42585 seconds.
INFO:distributed_c10d:2024-13-05 20:36:09:Added key: store_based_barrier_key:1 to store for rank: 1
INFO:distributed_c10d:2024-13-05 20:36:09:Rank 1: Completed store-based barrier for key:store_based_barrier_key:1 with 2 nodes.
INFO:distributed_c10d:2024-13-05 20:36:09:Rank 0: Completed store-based barrier for key:store_based_barrier_key:1 with 2 nodes.
INFO:Trainer:2024-13-05 20:36:10:[cuda:0] Initialization completed, start model training.
INFO:Trainer:2024-13-05 20:36:10:[cuda:1] Initialization completed, start model training.
INFO:distributed:2024-13-05 20:36:12:Reducer buckets have been rebuilt in this iteration.
INFO:distributed:2024-13-05 20:36:12:Reducer buckets have been rebuilt in this iteration.
INFO:Trainer:2024-13-05 20:46:30:[cuda:0] Epoch 100 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<19:01,  1.54it/s]
  0%|          | 5/1754 [00:00<03:32,  8.22it/s]
  1%|          | 9/1754 [00:00<02:03, 14.15it/s]
  1%|          | 13/1754 [00:00<01:30, 19.14it/s]
  1%|          | 17/1754 [00:01<01:15, 23.15it/s]
  1%|          | 21/1754 [00:01<01:05, 26.27it/s]
  1%|▏         | 25/1754 [00:01<01:00, 28.65it/s]
  2%|▏         | 29/1754 [00:01<00:56, 30.40it/s]
  2%|▏         | 33/1754 [00:01<00:54, 31.68it/s]
  2%|▏         | 37/1754 [00:01<00:52, 32.59it/s]
  2%|▏         | 41/1754 [00:01<00:51, 33.26it/s]
  3%|▎         | 45/1754 [00:01<00:50, 33.71it/s]
  3%|▎         | 49/1754 [00:02<00:50, 34.02it/s]
  3%|▎         | 53/1754 [00:02<00:49, 34.26it/s]
  3%|▎         | 57/1754 [00:02<00:49, 34.42it/s]
  3%|▎         | 61/1754 [00:02<00:49, 34.53it/s]
  4%|▎         | 65/1754 [00:02<00:48, 34.60it/s]
  4%|▍         | 69/1754 [00:02<00:48, 34.65it/s]
  4%|▍         | 73/1754 [00:02<00:48, 34.70it/s]
  4%|▍         | 77/1754 [00:02<00:48, 34.72it/s]
  5%|▍         | 81/1754 [00:02<00:48, 34.74it/s]
  5%|▍         | 85/1754 [00:03<00:48, 34.77it/s]
  5%|▌         | 89/1754 [00:03<00:47, 34.77it/s]
  5%|▌         | 93/1754 [00:03<00:47, 34.73it/s]
  6%|▌         | 97/1754 [00:03<00:47, 34.75it/s]
  6%|▌         | 101/1754 [00:03<00:47, 34.77it/s]
  6%|▌         | 105/1754 [00:03<00:47, 34.77it/s]
  6%|▌         | 109/1754 [00:03<00:47, 34.90it/s]
  6%|▋         | 113/1754 [00:03<00:46, 35.09it/s]
  7%|▋         | 117/1754 [00:03<00:46, 35.21it/s]
  7%|▋         | 121/1754 [00:04<00:46, 35.30it/s]
  7%|▋         | 125/1754 [00:04<00:46, 35.37it/s]
  7%|▋         | 129/1754 [00:04<00:45, 35.40it/s]
  8%|▊         | 133/1754 [00:04<00:45, 35.44it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.48it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.50it/s]
  8%|▊         | 145/1754 [00:04<00:45, 35.51it/s]
  8%|▊         | 149/1754 [00:04<00:45, 35.51it/s]
  9%|▊         | 153/1754 [00:04<00:45, 35.52it/s]
  9%|▉         | 157/1754 [00:05<00:44, 35.51it/s]
  9%|▉         | 161/1754 [00:05<00:45, 35.35it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.38it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.42it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.43it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.46it/s]
 10%|█         | 181/1754 [00:05<00:44, 35.46it/s]
 11%|█         | 185/1754 [00:05<00:44, 35.48it/s]
 11%|█         | 189/1754 [00:06<00:44, 35.49it/s]
 11%|█         | 193/1754 [00:06<00:44, 35.43it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.39it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.40it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.45it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.50it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.52it/s]
 12%|█▏        | 217/1754 [00:06<00:43, 35.55it/s]
 13%|█▎        | 221/1754 [00:06<00:43, 35.57it/s]
 13%|█▎        | 225/1754 [00:07<00:42, 35.57it/s]
 13%|█▎        | 229/1754 [00:07<00:42, 35.56it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.56it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.56it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.56it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.28it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.05it/s]
 14%|█▍        | 253/1754 [00:07<00:42, 34.92it/s]
 15%|█▍        | 257/1754 [00:07<00:43, 34.80it/s]
 15%|█▍        | 261/1754 [00:08<00:42, 34.75it/s]
 15%|█▌        | 265/1754 [00:08<00:42, 34.75it/s]
 15%|█▌        | 269/1754 [00:08<00:42, 34.78it/s]
 16%|█▌        | 273/1754 [00:08<00:42, 34.79it/s]
 16%|█▌        | 277/1754 [00:08<00:42, 34.78it/s]
 16%|█▌        | 281/1754 [00:08<00:42, 34.79it/s]
 16%|█▌        | 285/1754 [00:08<00:42, 34.79it/s]
 16%|█▋        | 289/1754 [00:08<00:42, 34.81it/s]
 17%|█▋        | 293/1754 [00:08<00:41, 34.82it/s]
 17%|█▋        | 297/1754 [00:09<00:41, 34.85it/s]
 17%|█▋        | 301/1754 [00:09<00:41, 34.88it/s]
 17%|█▋        | 305/1754 [00:09<00:41, 35.04it/s]
 18%|█▊        | 309/1754 [00:09<00:41, 35.17it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.27it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.34it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.42it/s]
 19%|█▊        | 325/1754 [00:09<00:40, 35.47it/s]
 19%|█▉        | 329/1754 [00:09<00:40, 35.51it/s]
 19%|█▉        | 333/1754 [00:10<00:39, 35.53it/s]
 19%|█▉        | 337/1754 [00:10<00:39, 35.52it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.54it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.54it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.55it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.56it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.54it/s]
 21%|██        | 361/1754 [00:10<00:39, 35.56it/s]
 21%|██        | 365/1754 [00:11<00:39, 35.57it/s]
 21%|██        | 369/1754 [00:11<00:38, 35.57it/s]
 21%|██▏       | 373/1754 [00:11<00:38, 35.58it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.59it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.57it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.59it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.59it/s]
 22%|██▏       | 393/1754 [00:11<00:38, 35.59it/s]
 23%|██▎       | 397/1754 [00:11<00:38, 35.58it/s]
 23%|██▎       | 401/1754 [00:12<00:38, 35.59it/s]
 23%|██▎       | 405/1754 [00:12<00:37, 35.60it/s]
 23%|██▎       | 409/1754 [00:12<00:37, 35.60it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.59it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.60it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.59it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.58it/s]
 24%|██▍       | 429/1754 [00:12<00:37, 35.59it/s]
 25%|██▍       | 433/1754 [00:12<00:37, 35.59it/s]
 25%|██▍       | 437/1754 [00:13<00:37, 35.58it/s]
 25%|██▌       | 441/1754 [00:13<00:36, 35.59it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.57it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.58it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.59it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.59it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.57it/s]
 27%|██▋       | 465/1754 [00:13<00:36, 35.58it/s]
 27%|██▋       | 469/1754 [00:13<00:36, 35.60it/s]
 27%|██▋       | 473/1754 [00:14<00:35, 35.60it/s]
 27%|██▋       | 477/1754 [00:14<00:35, 35.60it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.61it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.59it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.59it/s]
 29%|██▊       | 501/1754 [00:14<00:35, 35.60it/s]
 29%|██▉       | 505/1754 [00:14<00:35, 35.61it/s]
 29%|██▉       | 509/1754 [00:15<00:34, 35.59it/s]
 29%|██▉       | 513/1754 [00:15<00:34, 35.59it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.60it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.60it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.60it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.61it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.61it/s]
 31%|███       | 537/1754 [00:15<00:34, 35.60it/s]
 31%|███       | 541/1754 [00:15<00:34, 35.61it/s]
 31%|███       | 545/1754 [00:16<00:33, 35.60it/s]
 31%|███▏      | 549/1754 [00:16<00:33, 35.61it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.56it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.57it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.60it/s]
 33%|███▎      | 573/1754 [00:16<00:33, 35.59it/s]
 33%|███▎      | 577/1754 [00:16<00:33, 35.59it/s]
 33%|███▎      | 581/1754 [00:17<00:32, 35.60it/s]
 33%|███▎      | 585/1754 [00:17<00:32, 35.60it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.59it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.61it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.61it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.62it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.59it/s]
 35%|███▍      | 609/1754 [00:17<00:32, 35.61it/s]
 35%|███▍      | 613/1754 [00:17<00:32, 35.58it/s]
 35%|███▌      | 617/1754 [00:18<00:31, 35.59it/s]
 35%|███▌      | 621/1754 [00:18<00:31, 35.56it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.57it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.59it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.55it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.56it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.58it/s]
 37%|███▋      | 645/1754 [00:18<00:31, 35.59it/s]
 37%|███▋      | 649/1754 [00:18<00:31, 35.58it/s]
 37%|███▋      | 653/1754 [00:19<00:30, 35.58it/s]
 37%|███▋      | 657/1754 [00:19<00:30, 35.58it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.59it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.58it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.60it/s]
 39%|███▉      | 681/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 685/1754 [00:19<00:30, 35.62it/s]
 39%|███▉      | 689/1754 [00:20<00:29, 35.62it/s]
 40%|███▉      | 693/1754 [00:20<00:29, 35.62it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.62it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.61it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.61it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.62it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.60it/s]
 41%|████      | 717/1754 [00:20<00:29, 35.40it/s]
 41%|████      | 721/1754 [00:21<00:29, 35.43it/s]
 41%|████▏     | 725/1754 [00:21<00:29, 35.48it/s]
 42%|████▏     | 729/1754 [00:21<00:28, 35.50it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.49it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.52it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.56it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.58it/s]
 43%|████▎     | 749/1754 [00:21<00:28, 35.57it/s]
 43%|████▎     | 753/1754 [00:21<00:28, 35.59it/s]
 43%|████▎     | 757/1754 [00:22<00:28, 35.59it/s]
 43%|████▎     | 761/1754 [00:22<00:27, 35.58it/s]
 44%|████▎     | 765/1754 [00:22<00:27, 35.57it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.49it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.22it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.06it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 34.78it/s]
 45%|████▍     | 785/1754 [00:22<00:27, 34.75it/s]
 45%|████▍     | 789/1754 [00:22<00:27, 34.76it/s]
 45%|████▌     | 793/1754 [00:23<00:27, 34.79it/s]
 45%|████▌     | 797/1754 [00:23<00:27, 34.78it/s]
 46%|████▌     | 801/1754 [00:23<00:27, 34.80it/s]
 46%|████▌     | 805/1754 [00:23<00:27, 34.82it/s]
 46%|████▌     | 809/1754 [00:23<00:27, 34.84it/s]
 46%|████▋     | 813/1754 [00:23<00:27, 34.84it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 34.84it/s]
 47%|████▋     | 821/1754 [00:23<00:26, 34.83it/s]
 47%|████▋     | 825/1754 [00:23<00:26, 34.85it/s]
 47%|████▋     | 829/1754 [00:24<00:26, 34.85it/s]
 47%|████▋     | 833/1754 [00:24<00:26, 34.87it/s]
 48%|████▊     | 837/1754 [00:24<00:26, 34.85it/s]
 48%|████▊     | 841/1754 [00:24<00:26, 34.84it/s]
 48%|████▊     | 845/1754 [00:24<00:26, 34.84it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 34.82it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 34.83it/s]
 49%|████▉     | 857/1754 [00:24<00:25, 34.97it/s]
 49%|████▉     | 861/1754 [00:24<00:25, 35.13it/s]
 49%|████▉     | 865/1754 [00:25<00:25, 35.25it/s]
 50%|████▉     | 869/1754 [00:25<00:25, 35.35it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.42it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.45it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.49it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.52it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.54it/s]
 51%|█████     | 893/1754 [00:25<00:24, 35.53it/s]
 51%|█████     | 897/1754 [00:26<00:24, 35.55it/s]
 51%|█████▏    | 901/1754 [00:26<00:23, 35.57it/s]
 52%|█████▏    | 905/1754 [00:26<00:23, 35.57it/s]
 52%|█████▏    | 909/1754 [00:26<00:23, 35.58it/s]
 52%|█████▏    | 913/1754 [00:26<00:23, 35.59it/s]
 52%|█████▏    | 917/1754 [00:26<00:23, 35.58it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 35.59it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 35.59it/s]
 53%|█████▎    | 929/1754 [00:26<00:23, 35.59it/s]
 53%|█████▎    | 933/1754 [00:27<00:23, 35.60it/s]
 53%|█████▎    | 937/1754 [00:27<00:22, 35.60it/s]
 54%|█████▎    | 941/1754 [00:27<00:22, 35.60it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.60it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.61it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.61it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.62it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.59it/s]
 55%|█████▌    | 965/1754 [00:27<00:22, 35.59it/s]
 55%|█████▌    | 969/1754 [00:28<00:22, 35.60it/s]
 55%|█████▌    | 973/1754 [00:28<00:21, 35.59it/s]
 56%|█████▌    | 977/1754 [00:28<00:21, 35.59it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.60it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.59it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.59it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.60it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.61it/s]
 57%|█████▋    | 1001/1754 [00:28<00:21, 35.61it/s]
 57%|█████▋    | 1005/1754 [00:29<00:21, 35.57it/s]
 58%|█████▊    | 1009/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1013/1754 [00:29<00:20, 35.60it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.60it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.60it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.61it/s]
 59%|█████▉    | 1037/1754 [00:29<00:20, 35.58it/s]
 59%|█████▉    | 1041/1754 [00:30<00:20, 35.58it/s]
 60%|█████▉    | 1045/1754 [00:30<00:19, 35.57it/s]
 60%|█████▉    | 1049/1754 [00:30<00:19, 35.56it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.56it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.56it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.57it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.58it/s]
 61%|██████    | 1069/1754 [00:30<00:19, 35.60it/s]
 61%|██████    | 1073/1754 [00:30<00:19, 35.60it/s]
 61%|██████▏   | 1077/1754 [00:31<00:19, 35.61it/s]
 62%|██████▏   | 1081/1754 [00:31<00:18, 35.61it/s]
 62%|██████▏   | 1085/1754 [00:31<00:18, 35.60it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.60it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.61it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1105/1754 [00:31<00:18, 35.59it/s]
 63%|██████▎   | 1109/1754 [00:31<00:18, 35.59it/s]
 63%|██████▎   | 1113/1754 [00:32<00:18, 35.59it/s]
 64%|██████▎   | 1117/1754 [00:32<00:17, 35.59it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.58it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.56it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.57it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.58it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.59it/s]
 65%|██████▌   | 1141/1754 [00:32<00:17, 35.60it/s]
 65%|██████▌   | 1145/1754 [00:32<00:17, 35.59it/s]
 66%|██████▌   | 1149/1754 [00:33<00:17, 35.58it/s]
 66%|██████▌   | 1153/1754 [00:33<00:16, 35.60it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.60it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.61it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.57it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.59it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.59it/s]
 67%|██████▋   | 1177/1754 [00:33<00:16, 35.60it/s]
 67%|██████▋   | 1181/1754 [00:33<00:16, 35.59it/s]
 68%|██████▊   | 1185/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1189/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.57it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.56it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.57it/s]
 69%|██████▉   | 1213/1754 [00:34<00:15, 35.57it/s]
 69%|██████▉   | 1217/1754 [00:34<00:15, 35.58it/s]
 70%|██████▉   | 1221/1754 [00:35<00:14, 35.58it/s]
 70%|██████▉   | 1225/1754 [00:35<00:14, 35.59it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.59it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.59it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.60it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.60it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1249/1754 [00:35<00:14, 35.58it/s]
 71%|███████▏  | 1253/1754 [00:36<00:14, 35.58it/s]
 72%|███████▏  | 1257/1754 [00:36<00:13, 35.59it/s]
 72%|███████▏  | 1261/1754 [00:36<00:13, 35.59it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.60it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.60it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1285/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1289/1754 [00:37<00:13, 35.57it/s]
 74%|███████▎  | 1293/1754 [00:37<00:12, 35.58it/s]
 74%|███████▍  | 1297/1754 [00:37<00:12, 35.60it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.60it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.60it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.58it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.59it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.60it/s]
 75%|███████▌  | 1321/1754 [00:37<00:12, 35.60it/s]
 76%|███████▌  | 1325/1754 [00:38<00:12, 35.60it/s]
 76%|███████▌  | 1329/1754 [00:38<00:11, 35.61it/s]
 76%|███████▌  | 1333/1754 [00:38<00:11, 35.61it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.60it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.60it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.60it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.60it/s]
 77%|███████▋  | 1357/1754 [00:38<00:11, 35.61it/s]
 78%|███████▊  | 1361/1754 [00:39<00:11, 35.60it/s]
 78%|███████▊  | 1365/1754 [00:39<00:10, 35.60it/s]
 78%|███████▊  | 1369/1754 [00:39<00:10, 35.60it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.61it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.62it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.62it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.62it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.61it/s]
 79%|███████▉  | 1393/1754 [00:39<00:10, 35.62it/s]
 80%|███████▉  | 1397/1754 [00:40<00:10, 35.61it/s]
 80%|███████▉  | 1401/1754 [00:40<00:09, 35.61it/s]
 80%|████████  | 1405/1754 [00:40<00:09, 35.62it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.60it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.60it/s]
 81%|████████  | 1425/1754 [00:40<00:09, 35.52it/s]
 81%|████████▏ | 1429/1754 [00:40<00:09, 35.52it/s]
 82%|████████▏ | 1433/1754 [00:41<00:09, 35.54it/s]
 82%|████████▏ | 1437/1754 [00:41<00:08, 35.54it/s]
 82%|████████▏ | 1441/1754 [00:41<00:08, 35.55it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.55it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.55it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.56it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.57it/s]
 83%|████████▎ | 1461/1754 [00:41<00:08, 35.58it/s]
 84%|████████▎ | 1465/1754 [00:41<00:08, 35.59it/s]
 84%|████████▍ | 1469/1754 [00:42<00:08, 35.58it/s]
 84%|████████▍ | 1473/1754 [00:42<00:07, 35.59it/s]
 84%|████████▍ | 1477/1754 [00:42<00:07, 35.60it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.60it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.60it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.61it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.61it/s]
 85%|████████▌ | 1497/1754 [00:42<00:07, 35.62it/s]
 86%|████████▌ | 1501/1754 [00:42<00:07, 35.61it/s]
 86%|████████▌ | 1505/1754 [00:43<00:06, 35.61it/s]
 86%|████████▌ | 1509/1754 [00:43<00:06, 35.61it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.61it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.61it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.59it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.59it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.59it/s]
 87%|████████▋ | 1533/1754 [00:43<00:06, 35.59it/s]
 88%|████████▊ | 1537/1754 [00:43<00:06, 35.60it/s]
 88%|████████▊ | 1541/1754 [00:44<00:05, 35.60it/s]
 88%|████████▊ | 1545/1754 [00:44<00:05, 35.60it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.59it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.60it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.62it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1569/1754 [00:44<00:05, 35.61it/s]
 90%|████████▉ | 1573/1754 [00:45<00:05, 35.62it/s]
 90%|████████▉ | 1577/1754 [00:45<00:04, 35.60it/s]
 90%|█████████ | 1581/1754 [00:45<00:04, 35.61it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.62it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.62it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.59it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.60it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.60it/s]
 92%|█████████▏| 1605/1754 [00:45<00:04, 35.60it/s]
 92%|█████████▏| 1609/1754 [00:46<00:04, 35.61it/s]
 92%|█████████▏| 1613/1754 [00:46<00:03, 35.62it/s]
 92%|█████████▏| 1617/1754 [00:46<00:03, 35.62it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 35.59it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 35.59it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 35.60it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 35.58it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 35.58it/s]
 94%|█████████▎| 1641/1754 [00:46<00:03, 35.60it/s]
 94%|█████████▍| 1645/1754 [00:47<00:03, 35.60it/s]
 94%|█████████▍| 1649/1754 [00:47<00:02, 35.61it/s]
 94%|█████████▍| 1653/1754 [00:47<00:02, 35.61it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.61it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.62it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.62it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.62it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.61it/s]
 96%|█████████▌| 1677/1754 [00:47<00:02, 35.61it/s]
 96%|█████████▌| 1681/1754 [00:48<00:02, 35.62it/s]
 96%|█████████▌| 1685/1754 [00:48<00:01, 35.60it/s]
 96%|█████████▋| 1689/1754 [00:48<00:01, 35.60it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.61it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.62it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.62it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.62it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.62it/s]
 98%|█████████▊| 1713/1754 [00:48<00:01, 35.62it/s]
 98%|█████████▊| 1717/1754 [00:49<00:01, 35.61it/s]
 98%|█████████▊| 1721/1754 [00:49<00:00, 35.62it/s]
 98%|█████████▊| 1725/1754 [00:49<00:00, 35.66it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.67it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.70it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.73it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.76it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.77it/s]
100%|█████████▉| 1749/1754 [00:49<00:00, 35.78it/s]
100%|█████████▉| 1753/1754 [00:50<00:00, 35.79it/s]
100%|██████████| 1754/1754 [00:50<00:00, 34.95it/s]
INFO:Trainer:2024-13-05 20:47:20:mr: 285.913
INFO:Trainer:2024-13-05 20:47:20:mrr: 0.263
INFO:Trainer:2024-13-05 20:47:20:hits@1: 0.178
INFO:Trainer:2024-13-05 20:47:20:hits@3: 0.294
INFO:Trainer:2024-13-05 20:47:20:hits@10: 0.43
INFO:Trainer:2024-13-05 20:47:20:mr_type: 158.894
INFO:Trainer:2024-13-05 20:47:20:mrr_type: 0.295
INFO:Trainer:2024-13-05 20:47:20:hits@1_type: 0.208
INFO:Trainer:2024-13-05 20:47:20:hits@3_type: 0.325
INFO:Trainer:2024-13-05 20:47:20:hits@10_type: 0.467
INFO:EarlyStopping:2024-13-05 20:47:20:Validation score improved (-inf --> 0.430000).  Saving model ...
INFO:Trainer:2024-13-05 20:47:20:[cuda:0] Epoch 100 | Training checkpoint saved at ../../checkpoint/transr-100.pth
INFO:Trainer:2024-13-05 20:47:20:[cuda:0] Epoch [ 100/1000] | Batchsize: 2048 | loss:  5.636623 | 6.19339 seconds/epoch
INFO:Trainer:2024-13-05 20:47:20:[cuda:1] Epoch [ 100/1000] | Batchsize: 2048 | loss:  5.639350 | 6.19336 seconds/epoch
INFO:Trainer:2024-13-05 20:56:45:[cuda:0] Epoch 200 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<17:32,  1.67it/s]
  0%|          | 5/1754 [00:00<03:19,  8.78it/s]
  1%|          | 9/1754 [00:00<01:56, 14.97it/s]
  1%|          | 13/1754 [00:00<01:26, 20.08it/s]
  1%|          | 17/1754 [00:01<01:11, 24.16it/s]
  1%|          | 21/1754 [00:01<01:03, 27.30it/s]
  1%|▏         | 25/1754 [00:01<00:58, 29.66it/s]
  2%|▏         | 29/1754 [00:01<00:54, 31.39it/s]
  2%|▏         | 33/1754 [00:01<00:52, 32.66it/s]
  2%|▏         | 37/1754 [00:01<00:51, 33.54it/s]
  2%|▏         | 41/1754 [00:01<00:50, 34.16it/s]
  3%|▎         | 45/1754 [00:01<00:49, 34.61it/s]
  3%|▎         | 49/1754 [00:01<00:48, 34.94it/s]
  3%|▎         | 53/1754 [00:02<00:48, 35.15it/s]
  3%|▎         | 57/1754 [00:02<00:48, 35.30it/s]
  3%|▎         | 61/1754 [00:02<00:47, 35.41it/s]
  4%|▎         | 65/1754 [00:02<00:47, 35.45it/s]
  4%|▍         | 69/1754 [00:02<00:47, 35.50it/s]
  4%|▍         | 73/1754 [00:02<00:47, 35.54it/s]
  4%|▍         | 77/1754 [00:02<00:47, 35.57it/s]
  5%|▍         | 81/1754 [00:02<00:47, 35.58it/s]
  5%|▍         | 85/1754 [00:02<00:46, 35.59it/s]
  5%|▌         | 89/1754 [00:03<00:46, 35.60it/s]
  5%|▌         | 93/1754 [00:03<00:46, 35.60it/s]
  6%|▌         | 97/1754 [00:03<00:46, 35.61it/s]
  6%|▌         | 101/1754 [00:03<00:46, 35.58it/s]
  6%|▌         | 105/1754 [00:03<00:46, 35.61it/s]
  6%|▌         | 109/1754 [00:03<00:46, 35.62it/s]
  6%|▋         | 113/1754 [00:03<00:46, 35.62it/s]
  7%|▋         | 117/1754 [00:03<00:45, 35.60it/s]
  7%|▋         | 121/1754 [00:03<00:45, 35.59it/s]
  7%|▋         | 125/1754 [00:04<00:45, 35.60it/s]
  7%|▋         | 129/1754 [00:04<00:45, 35.62it/s]
  8%|▊         | 133/1754 [00:04<00:45, 35.63it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.64it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.61it/s]
  8%|▊         | 145/1754 [00:04<00:45, 35.62it/s]
  8%|▊         | 149/1754 [00:04<00:45, 35.61it/s]
  9%|▊         | 153/1754 [00:04<00:44, 35.62it/s]
  9%|▉         | 157/1754 [00:04<00:44, 35.62it/s]
  9%|▉         | 161/1754 [00:05<00:44, 35.64it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.64it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.65it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.59it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.62it/s]
 10%|█         | 181/1754 [00:05<00:44, 35.62it/s]
 11%|█         | 185/1754 [00:05<00:44, 35.61it/s]
 11%|█         | 189/1754 [00:05<00:43, 35.63it/s]
 11%|█         | 193/1754 [00:05<00:43, 35.65it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.64it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.65it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.66it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.65it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.65it/s]
 12%|█▏        | 217/1754 [00:06<00:43, 35.65it/s]
 13%|█▎        | 221/1754 [00:06<00:43, 35.63it/s]
 13%|█▎        | 225/1754 [00:06<00:42, 35.64it/s]
 13%|█▎        | 229/1754 [00:07<00:42, 35.61it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.62it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.62it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.63it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.64it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.65it/s]
 14%|█▍        | 253/1754 [00:07<00:42, 35.63it/s]
 15%|█▍        | 257/1754 [00:07<00:42, 35.64it/s]
 15%|█▍        | 261/1754 [00:07<00:41, 35.64it/s]
 15%|█▌        | 265/1754 [00:08<00:41, 35.64it/s]
 15%|█▌        | 269/1754 [00:08<00:41, 35.64it/s]
 16%|█▌        | 273/1754 [00:08<00:41, 35.65it/s]
 16%|█▌        | 277/1754 [00:08<00:41, 35.65it/s]
 16%|█▌        | 281/1754 [00:08<00:41, 35.63it/s]
 16%|█▌        | 285/1754 [00:08<00:41, 35.64it/s]
 16%|█▋        | 289/1754 [00:08<00:41, 35.65it/s]
 17%|█▋        | 293/1754 [00:08<00:40, 35.66it/s]
 17%|█▋        | 297/1754 [00:08<00:40, 35.66it/s]
 17%|█▋        | 301/1754 [00:09<00:40, 35.65it/s]
 17%|█▋        | 305/1754 [00:09<00:40, 35.60it/s]
 18%|█▊        | 309/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.63it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.65it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.65it/s]
 19%|█▊        | 325/1754 [00:09<00:40, 35.65it/s]
 19%|█▉        | 329/1754 [00:09<00:39, 35.64it/s]
 19%|█▉        | 333/1754 [00:09<00:39, 35.65it/s]
 19%|█▉        | 337/1754 [00:10<00:39, 35.64it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.64it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.65it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.65it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.65it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.66it/s]
 21%|██        | 361/1754 [00:10<00:39, 35.67it/s]
 21%|██        | 365/1754 [00:10<00:38, 35.67it/s]
 21%|██        | 369/1754 [00:10<00:38, 35.67it/s]
 21%|██▏       | 373/1754 [00:11<00:38, 35.67it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.60it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.62it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.64it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.64it/s]
 22%|██▏       | 393/1754 [00:11<00:38, 35.65it/s]
 23%|██▎       | 397/1754 [00:11<00:38, 35.62it/s]
 23%|██▎       | 401/1754 [00:11<00:37, 35.64it/s]
 23%|██▎       | 405/1754 [00:11<00:37, 35.65it/s]
 23%|██▎       | 409/1754 [00:12<00:37, 35.66it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.66it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.65it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.64it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.65it/s]
 24%|██▍       | 429/1754 [00:12<00:37, 35.64it/s]
 25%|██▍       | 433/1754 [00:12<00:37, 35.65it/s]
 25%|██▍       | 437/1754 [00:12<00:36, 35.65it/s]
 25%|██▌       | 441/1754 [00:12<00:36, 35.66it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.64it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.63it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.61it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.63it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.64it/s]
 27%|██▋       | 465/1754 [00:13<00:36, 35.65it/s]
 27%|██▋       | 469/1754 [00:13<00:36, 35.64it/s]
 27%|██▋       | 473/1754 [00:13<00:35, 35.65it/s]
 27%|██▋       | 477/1754 [00:13<00:35, 35.65it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.66it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.64it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.64it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.59it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.59it/s]
 29%|██▊       | 501/1754 [00:14<00:35, 35.59it/s]
 29%|██▉       | 505/1754 [00:14<00:35, 35.58it/s]
 29%|██▉       | 509/1754 [00:14<00:34, 35.60it/s]
 29%|██▉       | 513/1754 [00:14<00:34, 35.62it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.64it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.64it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.65it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.67it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.67it/s]
 31%|███       | 537/1754 [00:15<00:34, 35.67it/s]
 31%|███       | 541/1754 [00:15<00:33, 35.68it/s]
 31%|███       | 545/1754 [00:15<00:33, 35.68it/s]
 31%|███▏      | 549/1754 [00:15<00:33, 35.68it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.66it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.67it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.67it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.66it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.67it/s]
 33%|███▎      | 573/1754 [00:16<00:33, 35.66it/s]
 33%|███▎      | 577/1754 [00:16<00:33, 35.66it/s]
 33%|███▎      | 581/1754 [00:16<00:32, 35.67it/s]
 33%|███▎      | 585/1754 [00:16<00:32, 35.67it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.66it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.67it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.67it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.68it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.66it/s]
 35%|███▍      | 609/1754 [00:17<00:32, 35.61it/s]
 35%|███▍      | 613/1754 [00:17<00:32, 35.62it/s]
 35%|███▌      | 617/1754 [00:17<00:31, 35.64it/s]
 35%|███▌      | 621/1754 [00:17<00:31, 35.65it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.66it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.65it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.67it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.66it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.67it/s]
 37%|███▋      | 645/1754 [00:18<00:31, 35.67it/s]
 37%|███▋      | 649/1754 [00:18<00:30, 35.67it/s]
 37%|███▋      | 653/1754 [00:18<00:30, 35.64it/s]
 37%|███▋      | 657/1754 [00:19<00:30, 35.64it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.63it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.65it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.65it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.67it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.65it/s]
 39%|███▉      | 681/1754 [00:19<00:30, 35.66it/s]
 39%|███▉      | 685/1754 [00:19<00:29, 35.67it/s]
 39%|███▉      | 689/1754 [00:19<00:29, 35.65it/s]
 40%|███▉      | 693/1754 [00:20<00:29, 35.64it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.66it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.66it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.67it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.67it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.66it/s]
 41%|████      | 717/1754 [00:20<00:29, 35.66it/s]
 41%|████      | 721/1754 [00:20<00:28, 35.68it/s]
 41%|████▏     | 725/1754 [00:20<00:28, 35.68it/s]
 42%|████▏     | 729/1754 [00:21<00:28, 35.68it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.59it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.59it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.59it/s]
 43%|████▎     | 749/1754 [00:21<00:28, 35.60it/s]
 43%|████▎     | 753/1754 [00:21<00:28, 35.62it/s]
 43%|████▎     | 757/1754 [00:21<00:28, 35.59it/s]
 43%|████▎     | 761/1754 [00:21<00:27, 35.61it/s]
 44%|████▎     | 765/1754 [00:22<00:27, 35.63it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.63it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.64it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.64it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 35.65it/s]
 45%|████▍     | 785/1754 [00:22<00:27, 35.66it/s]
 45%|████▍     | 789/1754 [00:22<00:27, 35.59it/s]
 45%|████▌     | 793/1754 [00:22<00:27, 35.57it/s]
 45%|████▌     | 797/1754 [00:22<00:26, 35.59it/s]
 46%|████▌     | 801/1754 [00:23<00:26, 35.53it/s]
 46%|████▌     | 805/1754 [00:23<00:26, 35.57it/s]
 46%|████▌     | 809/1754 [00:23<00:26, 35.60it/s]
 46%|████▋     | 813/1754 [00:23<00:26, 35.61it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 35.63it/s]
 47%|████▋     | 821/1754 [00:23<00:26, 35.56it/s]
 47%|████▋     | 825/1754 [00:23<00:26, 35.58it/s]
 47%|████▋     | 829/1754 [00:23<00:25, 35.60it/s]
 47%|████▋     | 833/1754 [00:23<00:25, 35.62it/s]
 48%|████▊     | 837/1754 [00:24<00:25, 35.62it/s]
 48%|████▊     | 841/1754 [00:24<00:25, 35.63it/s]
 48%|████▊     | 845/1754 [00:24<00:25, 35.58it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 35.57it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 35.59it/s]
 49%|████▉     | 857/1754 [00:24<00:25, 35.60it/s]
 49%|████▉     | 861/1754 [00:24<00:25, 35.61it/s]
 49%|████▉     | 865/1754 [00:24<00:24, 35.62it/s]
 50%|████▉     | 869/1754 [00:24<00:24, 35.63it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.64it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.62it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.62it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.63it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.64it/s]
 51%|█████     | 893/1754 [00:25<00:24, 35.63it/s]
 51%|█████     | 897/1754 [00:25<00:24, 35.63it/s]
 51%|█████▏    | 901/1754 [00:25<00:23, 35.62it/s]
 52%|█████▏    | 905/1754 [00:25<00:23, 35.63it/s]
 52%|█████▏    | 909/1754 [00:26<00:23, 35.61it/s]
 52%|█████▏    | 913/1754 [00:26<00:23, 35.63it/s]
 52%|█████▏    | 917/1754 [00:26<00:23, 35.64it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 35.65it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 35.66it/s]
 53%|█████▎    | 929/1754 [00:26<00:23, 35.64it/s]
 53%|█████▎    | 933/1754 [00:26<00:23, 35.66it/s]
 53%|█████▎    | 937/1754 [00:26<00:22, 35.67it/s]
 54%|█████▎    | 941/1754 [00:26<00:22, 35.66it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.67it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.65it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.65it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.65it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.66it/s]
 55%|█████▌    | 965/1754 [00:27<00:22, 35.67it/s]
 55%|█████▌    | 969/1754 [00:27<00:22, 35.67it/s]
 55%|█████▌    | 973/1754 [00:27<00:21, 35.67it/s]
 56%|█████▌    | 977/1754 [00:27<00:21, 35.67it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.67it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.61it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.63it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.65it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.64it/s]
 57%|█████▋    | 1001/1754 [00:28<00:21, 35.66it/s]
 57%|█████▋    | 1005/1754 [00:28<00:21, 35.66it/s]
 58%|█████▊    | 1009/1754 [00:28<00:20, 35.65it/s]
 58%|█████▊    | 1013/1754 [00:28<00:20, 35.66it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.68it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.68it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.68it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.67it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.68it/s]
 59%|█████▉    | 1037/1754 [00:29<00:20, 35.67it/s]
 59%|█████▉    | 1041/1754 [00:29<00:19, 35.67it/s]
 60%|█████▉    | 1045/1754 [00:29<00:19, 35.67it/s]
 60%|█████▉    | 1049/1754 [00:30<00:19, 35.67it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.66it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.67it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.66it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.67it/s]
 61%|██████    | 1069/1754 [00:30<00:19, 35.66it/s]
 61%|██████    | 1073/1754 [00:30<00:19, 35.67it/s]
 61%|██████▏   | 1077/1754 [00:30<00:18, 35.66it/s]
 62%|██████▏   | 1081/1754 [00:30<00:18, 35.67it/s]
 62%|██████▏   | 1085/1754 [00:31<00:18, 35.65it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.66it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.65it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.67it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.67it/s]
 63%|██████▎   | 1105/1754 [00:31<00:18, 35.68it/s]
 63%|██████▎   | 1109/1754 [00:31<00:18, 35.68it/s]
 63%|██████▎   | 1113/1754 [00:31<00:17, 35.68it/s]
 64%|██████▎   | 1117/1754 [00:31<00:17, 35.67it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.68it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.68it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.69it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.68it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.67it/s]
 65%|██████▌   | 1141/1754 [00:32<00:17, 35.67it/s]
 65%|██████▌   | 1145/1754 [00:32<00:17, 35.67it/s]
 66%|██████▌   | 1149/1754 [00:32<00:16, 35.67it/s]
 66%|██████▌   | 1153/1754 [00:32<00:16, 35.66it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.67it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.67it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.64it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.64it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.65it/s]
 67%|██████▋   | 1177/1754 [00:33<00:16, 35.66it/s]
 67%|██████▋   | 1181/1754 [00:33<00:16, 35.66it/s]
 68%|██████▊   | 1185/1754 [00:33<00:15, 35.66it/s]
 68%|██████▊   | 1189/1754 [00:33<00:15, 35.65it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.66it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.66it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.65it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.66it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.67it/s]
 69%|██████▉   | 1213/1754 [00:34<00:15, 35.66it/s]
 69%|██████▉   | 1217/1754 [00:34<00:15, 35.66it/s]
 70%|██████▉   | 1221/1754 [00:34<00:14, 35.66it/s]
 70%|██████▉   | 1225/1754 [00:34<00:14, 35.68it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.67it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.68it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.67it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.68it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.66it/s]
 71%|███████   | 1249/1754 [00:35<00:14, 35.67it/s]
 71%|███████▏  | 1253/1754 [00:35<00:14, 35.65it/s]
 72%|███████▏  | 1257/1754 [00:35<00:13, 35.66it/s]
 72%|███████▏  | 1261/1754 [00:35<00:13, 35.66it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.63it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.64it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.66it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.66it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.66it/s]
 73%|███████▎  | 1285/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1289/1754 [00:36<00:13, 35.63it/s]
 74%|███████▎  | 1293/1754 [00:36<00:12, 35.62it/s]
 74%|███████▍  | 1297/1754 [00:36<00:12, 35.61it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.63it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.65it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.64it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.65it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1321/1754 [00:37<00:12, 35.64it/s]
 76%|███████▌  | 1325/1754 [00:37<00:12, 35.64it/s]
 76%|███████▌  | 1329/1754 [00:37<00:11, 35.64it/s]
 76%|███████▌  | 1333/1754 [00:37<00:11, 35.65it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.67it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.66it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.66it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.62it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.63it/s]
 77%|███████▋  | 1357/1754 [00:38<00:11, 35.63it/s]
 78%|███████▊  | 1361/1754 [00:38<00:11, 35.63it/s]
 78%|███████▊  | 1365/1754 [00:38<00:10, 35.64it/s]
 78%|███████▊  | 1369/1754 [00:38<00:10, 35.64it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.66it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.65it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.66it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.66it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.65it/s]
 79%|███████▉  | 1393/1754 [00:39<00:10, 35.66it/s]
 80%|███████▉  | 1397/1754 [00:39<00:10, 35.66it/s]
 80%|███████▉  | 1401/1754 [00:39<00:09, 35.67it/s]
 80%|████████  | 1405/1754 [00:39<00:09, 35.67it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.68it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.66it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.63it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.63it/s]
 81%|████████  | 1425/1754 [00:40<00:09, 35.62it/s]
 81%|████████▏ | 1429/1754 [00:40<00:09, 35.63it/s]
 82%|████████▏ | 1433/1754 [00:40<00:09, 35.64it/s]
 82%|████████▏ | 1437/1754 [00:40<00:08, 35.65it/s]
 82%|████████▏ | 1441/1754 [00:41<00:08, 35.66it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.66it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.66it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.65it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.67it/s]
 83%|████████▎ | 1461/1754 [00:41<00:08, 35.67it/s]
 84%|████████▎ | 1465/1754 [00:41<00:08, 35.68it/s]
 84%|████████▍ | 1469/1754 [00:41<00:07, 35.66it/s]
 84%|████████▍ | 1473/1754 [00:41<00:07, 35.67it/s]
 84%|████████▍ | 1477/1754 [00:42<00:07, 35.67it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.68it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.66it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.66it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.66it/s]
 85%|████████▌ | 1497/1754 [00:42<00:07, 35.67it/s]
 86%|████████▌ | 1501/1754 [00:42<00:07, 35.66it/s]
 86%|████████▌ | 1505/1754 [00:42<00:06, 35.67it/s]
 86%|████████▌ | 1509/1754 [00:42<00:06, 35.68it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.68it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.68it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.68it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.62it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.63it/s]
 87%|████████▋ | 1533/1754 [00:43<00:06, 35.63it/s]
 88%|████████▊ | 1537/1754 [00:43<00:06, 35.65it/s]
 88%|████████▊ | 1541/1754 [00:43<00:05, 35.53it/s]
 88%|████████▊ | 1545/1754 [00:43<00:05, 35.58it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.61it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.62it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.62it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.65it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.66it/s]
 89%|████████▉ | 1569/1754 [00:44<00:05, 35.65it/s]
 90%|████████▉ | 1573/1754 [00:44<00:05, 35.66it/s]
 90%|████████▉ | 1577/1754 [00:44<00:04, 35.65it/s]
 90%|█████████ | 1581/1754 [00:44<00:04, 35.62it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.62it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.62it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.65it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.64it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.65it/s]
 92%|█████████▏| 1605/1754 [00:45<00:04, 35.65it/s]
 92%|█████████▏| 1609/1754 [00:45<00:04, 35.66it/s]
 92%|█████████▏| 1613/1754 [00:45<00:03, 35.65it/s]
 92%|█████████▏| 1617/1754 [00:45<00:03, 35.67it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 35.67it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 35.68it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 35.68it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 35.66it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 35.67it/s]
 94%|█████████▎| 1641/1754 [00:46<00:03, 35.67it/s]
 94%|█████████▍| 1645/1754 [00:46<00:03, 35.67it/s]
 94%|█████████▍| 1649/1754 [00:46<00:02, 35.68it/s]
 94%|█████████▍| 1653/1754 [00:46<00:02, 35.67it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.67it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.66it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.66it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.66it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.59it/s]
 96%|█████████▌| 1677/1754 [00:47<00:02, 35.61it/s]
 96%|█████████▌| 1681/1754 [00:47<00:02, 35.63it/s]
 96%|█████████▌| 1685/1754 [00:47<00:01, 35.62it/s]
 96%|█████████▋| 1689/1754 [00:47<00:01, 35.65it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.64it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.64it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.65it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.67it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.66it/s]
 98%|█████████▊| 1713/1754 [00:48<00:01, 35.67it/s]
 98%|█████████▊| 1717/1754 [00:48<00:01, 35.67it/s]
 98%|█████████▊| 1721/1754 [00:48<00:00, 35.68it/s]
 98%|█████████▊| 1725/1754 [00:48<00:00, 35.71it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.75it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.77it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.79it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.81it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.82it/s]
100%|█████████▉| 1749/1754 [00:49<00:00, 35.83it/s]
100%|█████████▉| 1753/1754 [00:49<00:00, 35.83it/s]
100%|██████████| 1754/1754 [00:49<00:00, 35.16it/s]
INFO:Trainer:2024-13-05 20:57:35:mr: 253.051
INFO:Trainer:2024-13-05 20:57:35:mrr: 0.275
INFO:Trainer:2024-13-05 20:57:35:hits@1: 0.187
INFO:Trainer:2024-13-05 20:57:35:hits@3: 0.307
INFO:Trainer:2024-13-05 20:57:35:hits@10: 0.447
INFO:Trainer:2024-13-05 20:57:35:mr_type: 141.063
INFO:Trainer:2024-13-05 20:57:35:mrr_type: 0.308
INFO:Trainer:2024-13-05 20:57:35:hits@1_type: 0.218
INFO:Trainer:2024-13-05 20:57:35:hits@3_type: 0.339
INFO:Trainer:2024-13-05 20:57:35:hits@10_type: 0.484
INFO:EarlyStopping:2024-13-05 20:57:35:Validation score improved (0.430000 --> 0.447000).  Saving model ...
INFO:Trainer:2024-13-05 20:57:35:[cuda:0] Epoch 200 | Training checkpoint saved at ../../checkpoint/transr-200.pth
INFO:Trainer:2024-13-05 20:57:35:[cuda:0] Epoch [ 200/1000] | Batchsize: 2048 | loss:  4.212298 | 6.17439 seconds/epoch
INFO:Trainer:2024-13-05 20:57:35:[cuda:1] Epoch [ 200/1000] | Batchsize: 2048 | loss:  4.219561 | 6.17446 seconds/epoch
INFO:Trainer:2024-13-05 21:07:02:[cuda:0] Epoch 300 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<23:40,  1.23it/s]
  0%|          | 5/1754 [00:00<04:14,  6.87it/s]
  1%|          | 9/1754 [00:01<02:22, 12.22it/s]
  1%|          | 13/1754 [00:01<01:42, 16.99it/s]
  1%|          | 17/1754 [00:01<01:22, 21.06it/s]
  1%|          | 21/1754 [00:01<01:11, 24.36it/s]
  1%|▏         | 25/1754 [00:01<01:04, 26.94it/s]
  2%|▏         | 29/1754 [00:01<00:59, 28.86it/s]
  2%|▏         | 33/1754 [00:01<00:56, 30.32it/s]
  2%|▏         | 37/1754 [00:01<00:54, 31.33it/s]
  2%|▏         | 41/1754 [00:01<00:53, 32.09it/s]
  3%|▎         | 45/1754 [00:02<00:52, 32.61it/s]
  3%|▎         | 49/1754 [00:02<00:51, 33.00it/s]
  3%|▎         | 53/1754 [00:02<00:51, 33.27it/s]
  3%|▎         | 57/1754 [00:02<00:50, 33.44it/s]
  3%|▎         | 61/1754 [00:02<00:50, 33.47it/s]
  4%|▎         | 65/1754 [00:02<00:50, 33.52it/s]
  4%|▍         | 69/1754 [00:02<00:50, 33.35it/s]
  4%|▍         | 73/1754 [00:02<00:50, 33.48it/s]
  4%|▍         | 77/1754 [00:03<00:50, 33.40it/s]
  5%|▍         | 81/1754 [00:03<00:50, 33.37it/s]
  5%|▍         | 85/1754 [00:03<00:50, 33.32it/s]
  5%|▌         | 89/1754 [00:03<00:49, 33.41it/s]
  5%|▌         | 93/1754 [00:03<00:49, 33.40it/s]
  6%|▌         | 97/1754 [00:03<00:49, 33.51it/s]
  6%|▌         | 101/1754 [00:03<00:49, 33.61it/s]
  6%|▌         | 105/1754 [00:03<00:48, 33.70it/s]
  6%|▌         | 109/1754 [00:04<00:48, 33.64it/s]
  6%|▋         | 113/1754 [00:04<00:48, 33.71it/s]
  7%|▋         | 117/1754 [00:04<00:48, 34.10it/s]
  7%|▋         | 121/1754 [00:04<00:47, 34.51it/s]
  7%|▋         | 125/1754 [00:04<00:46, 34.82it/s]
  7%|▋         | 129/1754 [00:04<00:46, 35.03it/s]
  8%|▊         | 133/1754 [00:04<00:46, 35.15it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.28it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.37it/s]
  8%|▊         | 145/1754 [00:05<00:45, 35.44it/s]
  8%|▊         | 149/1754 [00:05<00:45, 35.48it/s]
  9%|▊         | 153/1754 [00:05<00:45, 35.50it/s]
  9%|▉         | 157/1754 [00:05<00:44, 35.51it/s]
  9%|▉         | 161/1754 [00:05<00:44, 35.56it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.55it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.55it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.54it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.56it/s]
 10%|█         | 181/1754 [00:06<00:44, 35.56it/s]
 11%|█         | 185/1754 [00:06<00:44, 35.57it/s]
 11%|█         | 189/1754 [00:06<00:44, 35.55it/s]
 11%|█         | 193/1754 [00:06<00:43, 35.55it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.56it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.57it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.56it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.57it/s]
 12%|█▏        | 217/1754 [00:07<00:43, 35.57it/s]
 13%|█▎        | 221/1754 [00:07<00:43, 35.58it/s]
 13%|█▎        | 225/1754 [00:07<00:42, 35.60it/s]
 13%|█▎        | 229/1754 [00:07<00:42, 35.58it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.58it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.57it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.57it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.57it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.58it/s]
 14%|█▍        | 253/1754 [00:08<00:42, 35.59it/s]
 15%|█▍        | 257/1754 [00:08<00:42, 35.59it/s]
 15%|█▍        | 261/1754 [00:08<00:41, 35.57it/s]
 15%|█▌        | 265/1754 [00:08<00:41, 35.59it/s]
 15%|█▌        | 269/1754 [00:08<00:41, 35.60it/s]
 16%|█▌        | 273/1754 [00:08<00:41, 35.61it/s]
 16%|█▌        | 277/1754 [00:08<00:41, 35.62it/s]
 16%|█▌        | 281/1754 [00:08<00:41, 35.61it/s]
 16%|█▌        | 285/1754 [00:08<00:41, 35.61it/s]
 16%|█▋        | 289/1754 [00:09<00:41, 35.61it/s]
 17%|█▋        | 293/1754 [00:09<00:41, 35.60it/s]
 17%|█▋        | 297/1754 [00:09<00:40, 35.61it/s]
 17%|█▋        | 301/1754 [00:09<00:40, 35.61it/s]
 17%|█▋        | 305/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 309/1754 [00:09<00:40, 35.60it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.54it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.51it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.53it/s]
 19%|█▊        | 325/1754 [00:10<00:40, 35.54it/s]
 19%|█▉        | 329/1754 [00:10<00:40, 35.54it/s]
 19%|█▉        | 333/1754 [00:10<00:39, 35.54it/s]
 19%|█▉        | 337/1754 [00:10<00:39, 35.54it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.51it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.49it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.52it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.55it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.56it/s]
 21%|██        | 361/1754 [00:11<00:39, 35.58it/s]
 21%|██        | 365/1754 [00:11<00:39, 35.58it/s]
 21%|██        | 369/1754 [00:11<00:38, 35.60it/s]
 21%|██▏       | 373/1754 [00:11<00:38, 35.60it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.60it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.59it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.57it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.56it/s]
 22%|██▏       | 393/1754 [00:12<00:38, 35.56it/s]
 23%|██▎       | 397/1754 [00:12<00:38, 35.57it/s]
 23%|██▎       | 401/1754 [00:12<00:38, 35.58it/s]
 23%|██▎       | 405/1754 [00:12<00:37, 35.58it/s]
 23%|██▎       | 409/1754 [00:12<00:37, 35.59it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.58it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.57it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.56it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.58it/s]
 24%|██▍       | 429/1754 [00:13<00:37, 35.56it/s]
 25%|██▍       | 433/1754 [00:13<00:37, 35.58it/s]
 25%|██▍       | 437/1754 [00:13<00:37, 35.59it/s]
 25%|██▌       | 441/1754 [00:13<00:36, 35.60it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.55it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.57it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.52it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.54it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.55it/s]
 27%|██▋       | 465/1754 [00:14<00:36, 35.57it/s]
 27%|██▋       | 469/1754 [00:14<00:36, 35.57it/s]
 27%|██▋       | 473/1754 [00:14<00:36, 35.58it/s]
 27%|██▋       | 477/1754 [00:14<00:35, 35.59it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.54it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.54it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.54it/s]
 29%|██▊       | 501/1754 [00:15<00:35, 35.52it/s]
 29%|██▉       | 505/1754 [00:15<00:35, 35.52it/s]
 29%|██▉       | 509/1754 [00:15<00:35, 35.54it/s]
 29%|██▉       | 513/1754 [00:15<00:34, 35.57it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.55it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.57it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.58it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.59it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.60it/s]
 31%|███       | 537/1754 [00:16<00:34, 35.60it/s]
 31%|███       | 541/1754 [00:16<00:34, 35.60it/s]
 31%|███       | 545/1754 [00:16<00:33, 35.61it/s]
 31%|███▏      | 549/1754 [00:16<00:33, 35.61it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.60it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.59it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.56it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.58it/s]
 33%|███▎      | 573/1754 [00:17<00:33, 35.59it/s]
 33%|███▎      | 577/1754 [00:17<00:33, 35.61it/s]
 33%|███▎      | 581/1754 [00:17<00:32, 35.62it/s]
 33%|███▎      | 585/1754 [00:17<00:32, 35.60it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.59it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.60it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.56it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.54it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.54it/s]
 35%|███▍      | 609/1754 [00:18<00:32, 35.55it/s]
 35%|███▍      | 613/1754 [00:18<00:32, 35.56it/s]
 35%|███▌      | 617/1754 [00:18<00:31, 35.56it/s]
 35%|███▌      | 621/1754 [00:18<00:31, 35.54it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.56it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.58it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.55it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.54it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.57it/s]
 37%|███▋      | 645/1754 [00:19<00:31, 35.59it/s]
 37%|███▋      | 649/1754 [00:19<00:31, 35.59it/s]
 37%|███▋      | 653/1754 [00:19<00:30, 35.59it/s]
 37%|███▋      | 657/1754 [00:19<00:30, 35.60it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.58it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.57it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.59it/s]
 39%|███▉      | 681/1754 [00:20<00:30, 35.60it/s]
 39%|███▉      | 685/1754 [00:20<00:30, 35.61it/s]
 39%|███▉      | 689/1754 [00:20<00:29, 35.62it/s]
 40%|███▉      | 693/1754 [00:20<00:29, 35.61it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.60it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.60it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.61it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.62it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 717/1754 [00:21<00:29, 35.56it/s]
 41%|████      | 721/1754 [00:21<00:29, 35.58it/s]
 41%|████▏     | 725/1754 [00:21<00:28, 35.57it/s]
 42%|████▏     | 729/1754 [00:21<00:28, 35.56it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.55it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.57it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.57it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.58it/s]
 43%|████▎     | 749/1754 [00:22<00:28, 35.57it/s]
 43%|████▎     | 753/1754 [00:22<00:28, 35.52it/s]
 43%|████▎     | 757/1754 [00:22<00:28, 35.53it/s]
 43%|████▎     | 761/1754 [00:22<00:27, 35.56it/s]
 44%|████▎     | 765/1754 [00:22<00:27, 35.57it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.50it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.45it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.47it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 35.49it/s]
 45%|████▍     | 785/1754 [00:23<00:27, 35.51it/s]
 45%|████▍     | 789/1754 [00:23<00:27, 35.52it/s]
 45%|████▌     | 793/1754 [00:23<00:27, 35.53it/s]
 45%|████▌     | 797/1754 [00:23<00:26, 35.54it/s]
 46%|████▌     | 801/1754 [00:23<00:26, 35.57it/s]
 46%|████▌     | 805/1754 [00:23<00:26, 35.57it/s]
 46%|████▌     | 809/1754 [00:23<00:26, 35.59it/s]
 46%|████▋     | 813/1754 [00:23<00:26, 35.60it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 35.61it/s]
 47%|████▋     | 821/1754 [00:24<00:26, 35.60it/s]
 47%|████▋     | 825/1754 [00:24<00:26, 35.59it/s]
 47%|████▋     | 829/1754 [00:24<00:25, 35.61it/s]
 47%|████▋     | 833/1754 [00:24<00:25, 35.62it/s]
 48%|████▊     | 837/1754 [00:24<00:25, 35.62it/s]
 48%|████▊     | 841/1754 [00:24<00:25, 35.61it/s]
 48%|████▊     | 845/1754 [00:24<00:25, 35.59it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 35.60it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 35.60it/s]
 49%|████▉     | 857/1754 [00:25<00:25, 35.61it/s]
 49%|████▉     | 861/1754 [00:25<00:25, 35.61it/s]
 49%|████▉     | 865/1754 [00:25<00:24, 35.62it/s]
 50%|████▉     | 869/1754 [00:25<00:24, 35.61it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.62it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.61it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.62it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.61it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.61it/s]
 51%|█████     | 893/1754 [00:26<00:24, 35.55it/s]
 51%|█████     | 897/1754 [00:26<00:24, 35.57it/s]
 51%|█████▏    | 901/1754 [00:26<00:23, 35.58it/s]
 52%|█████▏    | 905/1754 [00:26<00:23, 35.56it/s]
 52%|█████▏    | 909/1754 [00:26<00:23, 35.58it/s]
 52%|█████▏    | 913/1754 [00:26<00:23, 35.59it/s]
 52%|█████▏    | 917/1754 [00:26<00:23, 35.60it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 35.57it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 35.58it/s]
 53%|█████▎    | 929/1754 [00:27<00:23, 35.55it/s]
 53%|█████▎    | 933/1754 [00:27<00:23, 35.55it/s]
 53%|█████▎    | 937/1754 [00:27<00:22, 35.56it/s]
 54%|█████▎    | 941/1754 [00:27<00:22, 35.57it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.60it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.61it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.60it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.61it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.61it/s]
 55%|█████▌    | 965/1754 [00:28<00:22, 35.61it/s]
 55%|█████▌    | 969/1754 [00:28<00:22, 35.60it/s]
 55%|█████▌    | 973/1754 [00:28<00:21, 35.58it/s]
 56%|█████▌    | 977/1754 [00:28<00:21, 35.60it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.46it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.48it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.50it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.53it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.53it/s]
 57%|█████▋    | 1001/1754 [00:29<00:21, 35.55it/s]
 57%|█████▋    | 1005/1754 [00:29<00:21, 35.51it/s]
 58%|█████▊    | 1009/1754 [00:29<00:20, 35.49it/s]
 58%|█████▊    | 1013/1754 [00:29<00:20, 35.52it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.55it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.57it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.58it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.59it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.60it/s]
 59%|█████▉    | 1037/1754 [00:30<00:20, 35.59it/s]
 59%|█████▉    | 1041/1754 [00:30<00:20, 35.59it/s]
 60%|█████▉    | 1045/1754 [00:30<00:19, 35.58it/s]
 60%|█████▉    | 1049/1754 [00:30<00:19, 35.60it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.60it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.62it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.59it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.60it/s]
 61%|██████    | 1069/1754 [00:31<00:19, 35.61it/s]
 61%|██████    | 1073/1754 [00:31<00:19, 35.57it/s]
 61%|██████▏   | 1077/1754 [00:31<00:19, 35.58it/s]
 62%|██████▏   | 1081/1754 [00:31<00:18, 35.58it/s]
 62%|██████▏   | 1085/1754 [00:31<00:18, 35.59it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.60it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.57it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.51it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.54it/s]
 63%|██████▎   | 1105/1754 [00:32<00:18, 35.56it/s]
 63%|██████▎   | 1109/1754 [00:32<00:18, 35.58it/s]
 63%|██████▎   | 1113/1754 [00:32<00:18, 35.59it/s]
 64%|██████▎   | 1117/1754 [00:32<00:17, 35.59it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.60it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.58it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.54it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.54it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.56it/s]
 65%|██████▌   | 1141/1754 [00:33<00:17, 35.58it/s]
 65%|██████▌   | 1145/1754 [00:33<00:17, 35.56it/s]
 66%|██████▌   | 1149/1754 [00:33<00:17, 35.52it/s]
 66%|██████▌   | 1153/1754 [00:33<00:16, 35.55it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.59it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.58it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.59it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.61it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.63it/s]
 67%|██████▋   | 1177/1754 [00:34<00:16, 35.62it/s]
 67%|██████▋   | 1181/1754 [00:34<00:16, 35.59it/s]
 68%|██████▊   | 1185/1754 [00:34<00:15, 35.58it/s]
 68%|██████▊   | 1189/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.59it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.60it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.60it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.60it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.59it/s]
 69%|██████▉   | 1213/1754 [00:35<00:15, 35.61it/s]
 69%|██████▉   | 1217/1754 [00:35<00:15, 35.62it/s]
 70%|██████▉   | 1221/1754 [00:35<00:14, 35.62it/s]
 70%|██████▉   | 1225/1754 [00:35<00:14, 35.62it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.62it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1249/1754 [00:36<00:14, 35.59it/s]
 71%|███████▏  | 1253/1754 [00:36<00:14, 35.57it/s]
 72%|███████▏  | 1257/1754 [00:36<00:13, 35.58it/s]
 72%|███████▏  | 1261/1754 [00:36<00:13, 35.52it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.55it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.54it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.56it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.57it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.59it/s]
 73%|███████▎  | 1285/1754 [00:37<00:13, 35.58it/s]
 73%|███████▎  | 1289/1754 [00:37<00:13, 35.58it/s]
 74%|███████▎  | 1293/1754 [00:37<00:12, 35.58it/s]
 74%|███████▍  | 1297/1754 [00:37<00:12, 35.58it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.59it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.60it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.60it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1321/1754 [00:38<00:12, 35.61it/s]
 76%|███████▌  | 1325/1754 [00:38<00:12, 35.61it/s]
 76%|███████▌  | 1329/1754 [00:38<00:11, 35.62it/s]
 76%|███████▌  | 1333/1754 [00:38<00:11, 35.61it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.62it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.57it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.58it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.59it/s]
 77%|███████▋  | 1357/1754 [00:39<00:11, 35.60it/s]
 78%|███████▊  | 1361/1754 [00:39<00:11, 35.60it/s]
 78%|███████▊  | 1365/1754 [00:39<00:10, 35.60it/s]
 78%|███████▊  | 1369/1754 [00:39<00:10, 35.60it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.60it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.62it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.63it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.63it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.63it/s]
 79%|███████▉  | 1393/1754 [00:40<00:10, 35.59it/s]
 80%|███████▉  | 1397/1754 [00:40<00:10, 35.58it/s]
 80%|███████▉  | 1401/1754 [00:40<00:09, 35.58it/s]
 80%|████████  | 1405/1754 [00:40<00:09, 35.59it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.61it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.60it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.60it/s]
 81%|████████  | 1425/1754 [00:41<00:09, 35.60it/s]
 81%|████████▏ | 1429/1754 [00:41<00:09, 35.58it/s]
 82%|████████▏ | 1433/1754 [00:41<00:09, 35.57it/s]
 82%|████████▏ | 1437/1754 [00:41<00:08, 35.59it/s]
 82%|████████▏ | 1441/1754 [00:41<00:08, 35.61it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.55it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.58it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.53it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.54it/s]
 83%|████████▎ | 1461/1754 [00:42<00:08, 35.53it/s]
 84%|████████▎ | 1465/1754 [00:42<00:08, 35.55it/s]
 84%|████████▍ | 1469/1754 [00:42<00:08, 35.55it/s]
 84%|████████▍ | 1473/1754 [00:42<00:07, 35.58it/s]
 84%|████████▍ | 1477/1754 [00:42<00:07, 35.59it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.59it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.55it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.54it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.57it/s]
 85%|████████▌ | 1497/1754 [00:43<00:07, 35.58it/s]
 86%|████████▌ | 1501/1754 [00:43<00:07, 35.56it/s]
 86%|████████▌ | 1505/1754 [00:43<00:06, 35.58it/s]
 86%|████████▌ | 1509/1754 [00:43<00:06, 35.59it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.60it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.59it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.61it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.59it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.58it/s]
 87%|████████▋ | 1533/1754 [00:44<00:06, 35.57it/s]
 88%|████████▊ | 1537/1754 [00:44<00:06, 35.60it/s]
 88%|████████▊ | 1541/1754 [00:44<00:05, 35.59it/s]
 88%|████████▊ | 1545/1754 [00:44<00:05, 35.55it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.57it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.59it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.60it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1569/1754 [00:45<00:05, 35.62it/s]
 90%|████████▉ | 1573/1754 [00:45<00:05, 35.62it/s]
 90%|████████▉ | 1577/1754 [00:45<00:04, 35.61it/s]
 90%|█████████ | 1581/1754 [00:45<00:04, 35.61it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.62it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.61it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.61it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.62it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.64it/s]
 92%|█████████▏| 1605/1754 [00:46<00:04, 35.63it/s]
 92%|█████████▏| 1609/1754 [00:46<00:04, 35.63it/s]
 92%|█████████▏| 1613/1754 [00:46<00:03, 35.64it/s]
 92%|█████████▏| 1617/1754 [00:46<00:03, 35.57it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 35.59it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 35.60it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 35.61it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 35.61it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 35.63it/s]
 94%|█████████▎| 1641/1754 [00:47<00:03, 35.58it/s]
 94%|█████████▍| 1645/1754 [00:47<00:03, 35.58it/s]
 94%|█████████▍| 1649/1754 [00:47<00:02, 35.60it/s]
 94%|█████████▍| 1653/1754 [00:47<00:02, 35.60it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.57it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.55it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.57it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.58it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.60it/s]
 96%|█████████▌| 1677/1754 [00:48<00:02, 35.56it/s]
 96%|█████████▌| 1681/1754 [00:48<00:02, 35.58it/s]
 96%|█████████▌| 1685/1754 [00:48<00:01, 35.58it/s]
 96%|█████████▋| 1689/1754 [00:48<00:01, 35.58it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.49it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.54it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.56it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.58it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.60it/s]
 98%|█████████▊| 1713/1754 [00:49<00:01, 35.62it/s]
 98%|█████████▊| 1717/1754 [00:49<00:01, 35.54it/s]
 98%|█████████▊| 1721/1754 [00:49<00:00, 35.55it/s]
 98%|█████████▊| 1725/1754 [00:49<00:00, 35.61it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.67it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.71it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.74it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.76it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.77it/s]
100%|█████████▉| 1749/1754 [00:50<00:00, 35.79it/s]
100%|█████████▉| 1753/1754 [00:50<00:00, 35.79it/s]
100%|██████████| 1754/1754 [00:50<00:00, 34.83it/s]
INFO:Trainer:2024-13-05 21:07:52:mr: 241.668
INFO:Trainer:2024-13-05 21:07:52:mrr: 0.281
INFO:Trainer:2024-13-05 21:07:52:hits@1: 0.191
INFO:Trainer:2024-13-05 21:07:52:hits@3: 0.315
INFO:Trainer:2024-13-05 21:07:52:hits@10: 0.457
INFO:Trainer:2024-13-05 21:07:52:mr_type: 133.527
INFO:Trainer:2024-13-05 21:07:52:mrr_type: 0.314
INFO:Trainer:2024-13-05 21:07:52:hits@1_type: 0.222
INFO:Trainer:2024-13-05 21:07:52:hits@3_type: 0.347
INFO:Trainer:2024-13-05 21:07:52:hits@10_type: 0.495
INFO:EarlyStopping:2024-13-05 21:07:52:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-13-05 21:07:52:[cuda:0] Epoch 300 | Training checkpoint saved at ../../checkpoint/transr-300.pth
INFO:Trainer:2024-13-05 21:07:52:[cuda:0] Epoch [ 300/1000] | Batchsize: 2048 | loss:  3.642070 | 6.17108 seconds/epoch
INFO:Trainer:2024-13-05 21:07:52:[cuda:1] Epoch [ 300/1000] | Batchsize: 2048 | loss:  3.641772 | 6.17110 seconds/epoch
INFO:Trainer:2024-13-05 21:17:20:[cuda:0] Epoch 400 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<21:34,  1.35it/s]
  0%|          | 5/1754 [00:00<03:55,  7.43it/s]
  1%|          | 9/1754 [00:00<02:13, 13.05it/s]
  1%|          | 13/1754 [00:01<01:37, 17.89it/s]
  1%|          | 17/1754 [00:01<01:19, 21.90it/s]
  1%|          | 21/1754 [00:01<01:09, 25.04it/s]
  1%|▏         | 25/1754 [00:01<01:02, 27.45it/s]
  2%|▏         | 29/1754 [00:01<00:58, 29.26it/s]
  2%|▏         | 33/1754 [00:01<00:56, 30.60it/s]
  2%|▏         | 37/1754 [00:01<00:54, 31.50it/s]
  2%|▏         | 41/1754 [00:01<00:53, 32.16it/s]
  3%|▎         | 45/1754 [00:02<00:52, 32.68it/s]
  3%|▎         | 49/1754 [00:02<00:51, 33.01it/s]
  3%|▎         | 53/1754 [00:02<00:51, 33.19it/s]
  3%|▎         | 57/1754 [00:02<00:50, 33.37it/s]
  3%|▎         | 61/1754 [00:02<00:50, 33.46it/s]
  4%|▎         | 65/1754 [00:02<00:50, 33.60it/s]
  4%|▍         | 69/1754 [00:02<00:49, 33.86it/s]
  4%|▍         | 73/1754 [00:02<00:48, 34.31it/s]
  4%|▍         | 77/1754 [00:02<00:48, 34.67it/s]
  5%|▍         | 81/1754 [00:03<00:47, 34.94it/s]
  5%|▍         | 85/1754 [00:03<00:47, 35.10it/s]
  5%|▌         | 89/1754 [00:03<00:47, 35.22it/s]
  5%|▌         | 93/1754 [00:03<00:47, 35.32it/s]
  6%|▌         | 97/1754 [00:03<00:46, 35.38it/s]
  6%|▌         | 101/1754 [00:03<00:46, 35.39it/s]
  6%|▌         | 105/1754 [00:03<00:46, 35.37it/s]
  6%|▌         | 109/1754 [00:03<00:46, 35.43it/s]
  6%|▋         | 113/1754 [00:03<00:46, 35.47it/s]
  7%|▋         | 117/1754 [00:04<00:46, 35.46it/s]
  7%|▋         | 121/1754 [00:04<00:46, 35.44it/s]
  7%|▋         | 125/1754 [00:04<00:45, 35.48it/s]
  7%|▋         | 129/1754 [00:04<00:45, 35.53it/s]
  8%|▊         | 133/1754 [00:04<00:45, 35.52it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.52it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.53it/s]
  8%|▊         | 145/1754 [00:04<00:45, 35.49it/s]
  8%|▊         | 149/1754 [00:04<00:45, 35.45it/s]
  9%|▊         | 153/1754 [00:05<00:45, 35.47it/s]
  9%|▉         | 157/1754 [00:05<00:44, 35.51it/s]
  9%|▉         | 161/1754 [00:05<00:44, 35.52it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.53it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.53it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.53it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.54it/s]
 10%|█         | 181/1754 [00:05<00:44, 35.55it/s]
 11%|█         | 185/1754 [00:06<00:44, 35.55it/s]
 11%|█         | 189/1754 [00:06<00:44, 35.56it/s]
 11%|█         | 193/1754 [00:06<00:43, 35.57it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.56it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.59it/s]
 12%|█▏        | 217/1754 [00:06<00:43, 35.61it/s]
 13%|█▎        | 221/1754 [00:07<00:43, 35.58it/s]
 13%|█▎        | 225/1754 [00:07<00:42, 35.59it/s]
 13%|█▎        | 229/1754 [00:07<00:42, 35.57it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.58it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.58it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.59it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.58it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.59it/s]
 14%|█▍        | 253/1754 [00:07<00:42, 35.59it/s]
 15%|█▍        | 257/1754 [00:08<00:42, 35.58it/s]
 15%|█▍        | 261/1754 [00:08<00:41, 35.56it/s]
 15%|█▌        | 265/1754 [00:08<00:41, 35.58it/s]
 15%|█▌        | 269/1754 [00:08<00:41, 35.59it/s]
 16%|█▌        | 273/1754 [00:08<00:41, 35.60it/s]
 16%|█▌        | 277/1754 [00:08<00:41, 35.60it/s]
 16%|█▌        | 281/1754 [00:08<00:41, 35.59it/s]
 16%|█▌        | 285/1754 [00:08<00:41, 35.60it/s]
 16%|█▋        | 289/1754 [00:08<00:41, 35.59it/s]
 17%|█▋        | 293/1754 [00:09<00:41, 35.59it/s]
 17%|█▋        | 297/1754 [00:09<00:40, 35.59it/s]
 17%|█▋        | 301/1754 [00:09<00:40, 35.59it/s]
 17%|█▋        | 305/1754 [00:09<00:40, 35.57it/s]
 18%|█▊        | 309/1754 [00:09<00:40, 35.56it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.58it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.60it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.60it/s]
 19%|█▊        | 325/1754 [00:09<00:40, 35.57it/s]
 19%|█▉        | 329/1754 [00:10<00:40, 35.54it/s]
 19%|█▉        | 333/1754 [00:10<00:39, 35.55it/s]
 19%|█▉        | 337/1754 [00:10<00:39, 35.52it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.47it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.48it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.51it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.50it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.42it/s]
 21%|██        | 361/1754 [00:10<00:39, 35.44it/s]
 21%|██        | 365/1754 [00:11<00:39, 35.49it/s]
 21%|██        | 369/1754 [00:11<00:38, 35.52it/s]
 21%|██▏       | 373/1754 [00:11<00:38, 35.53it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.54it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.56it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.55it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.55it/s]
 22%|██▏       | 393/1754 [00:11<00:38, 35.55it/s]
 23%|██▎       | 397/1754 [00:11<00:38, 35.56it/s]
 23%|██▎       | 401/1754 [00:12<00:38, 35.57it/s]
 23%|██▎       | 405/1754 [00:12<00:37, 35.58it/s]
 23%|██▎       | 409/1754 [00:12<00:37, 35.54it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.56it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.54it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.47it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.51it/s]
 24%|██▍       | 429/1754 [00:12<00:37, 35.54it/s]
 25%|██▍       | 433/1754 [00:12<00:37, 35.56it/s]
 25%|██▍       | 437/1754 [00:13<00:37, 35.54it/s]
 25%|██▌       | 441/1754 [00:13<00:36, 35.56it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.54it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.55it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.56it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.57it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.58it/s]
 27%|██▋       | 465/1754 [00:13<00:36, 35.57it/s]
 27%|██▋       | 469/1754 [00:13<00:36, 35.57it/s]
 27%|██▋       | 473/1754 [00:14<00:36, 35.57it/s]
 27%|██▋       | 477/1754 [00:14<00:35, 35.58it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.57it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.56it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.57it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.58it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.58it/s]
 29%|██▊       | 501/1754 [00:14<00:35, 35.57it/s]
 29%|██▉       | 505/1754 [00:15<00:35, 35.55it/s]
 29%|██▉       | 509/1754 [00:15<00:35, 35.56it/s]
 29%|██▉       | 513/1754 [00:15<00:34, 35.56it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.56it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.58it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.58it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.60it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.60it/s]
 31%|███       | 537/1754 [00:15<00:34, 35.60it/s]
 31%|███       | 541/1754 [00:16<00:34, 35.62it/s]
 31%|███       | 545/1754 [00:16<00:33, 35.58it/s]
 31%|███▏      | 549/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.57it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.60it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.58it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.54it/s]
 33%|███▎      | 573/1754 [00:16<00:33, 35.54it/s]
 33%|███▎      | 577/1754 [00:17<00:33, 35.53it/s]
 33%|███▎      | 581/1754 [00:17<00:33, 35.54it/s]
 33%|███▎      | 585/1754 [00:17<00:32, 35.55it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.56it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.56it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.56it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.57it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.54it/s]
 35%|███▍      | 609/1754 [00:17<00:32, 35.56it/s]
 35%|███▍      | 613/1754 [00:18<00:32, 35.56it/s]
 35%|███▌      | 617/1754 [00:18<00:31, 35.55it/s]
 35%|███▌      | 621/1754 [00:18<00:31, 35.55it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.57it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.57it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.56it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.55it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.56it/s]
 37%|███▋      | 645/1754 [00:18<00:31, 35.57it/s]
 37%|███▋      | 649/1754 [00:19<00:31, 35.59it/s]
 37%|███▋      | 653/1754 [00:19<00:30, 35.60it/s]
 37%|███▋      | 657/1754 [00:19<00:30, 35.56it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.56it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.59it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.61it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 681/1754 [00:19<00:30, 35.60it/s]
 39%|███▉      | 685/1754 [00:20<00:30, 35.59it/s]
 39%|███▉      | 689/1754 [00:20<00:29, 35.60it/s]
 40%|███▉      | 693/1754 [00:20<00:29, 35.59it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.59it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.60it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.61it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 717/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 721/1754 [00:21<00:29, 35.61it/s]
 41%|████▏     | 725/1754 [00:21<00:28, 35.59it/s]
 42%|████▏     | 729/1754 [00:21<00:28, 35.59it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.53it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.54it/s]
 43%|████▎     | 749/1754 [00:21<00:28, 35.57it/s]
 43%|████▎     | 753/1754 [00:21<00:28, 35.58it/s]
 43%|████▎     | 757/1754 [00:22<00:28, 35.57it/s]
 43%|████▎     | 761/1754 [00:22<00:27, 35.59it/s]
 44%|████▎     | 765/1754 [00:22<00:27, 35.56it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.53it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.53it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.53it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 35.55it/s]
 45%|████▍     | 785/1754 [00:22<00:27, 35.57it/s]
 45%|████▍     | 789/1754 [00:22<00:27, 35.58it/s]
 45%|████▌     | 793/1754 [00:23<00:27, 35.59it/s]
 45%|████▌     | 797/1754 [00:23<00:26, 35.60it/s]
 46%|████▌     | 801/1754 [00:23<00:26, 35.60it/s]
 46%|████▌     | 805/1754 [00:23<00:26, 35.59it/s]
 46%|████▌     | 809/1754 [00:23<00:26, 35.54it/s]
 46%|████▋     | 813/1754 [00:23<00:26, 35.56it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 35.58it/s]
 47%|████▋     | 821/1754 [00:23<00:26, 35.55it/s]
 47%|████▋     | 825/1754 [00:24<00:26, 35.56it/s]
 47%|████▋     | 829/1754 [00:24<00:25, 35.58it/s]
 47%|████▋     | 833/1754 [00:24<00:25, 35.60it/s]
 48%|████▊     | 837/1754 [00:24<00:25, 35.59it/s]
 48%|████▊     | 841/1754 [00:24<00:25, 35.59it/s]
 48%|████▊     | 845/1754 [00:24<00:25, 35.59it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 35.59it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 35.59it/s]
 49%|████▉     | 857/1754 [00:24<00:25, 35.58it/s]
 49%|████▉     | 861/1754 [00:25<00:25, 35.57it/s]
 49%|████▉     | 865/1754 [00:25<00:24, 35.58it/s]
 50%|████▉     | 869/1754 [00:25<00:24, 35.59it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.59it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.58it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.59it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.25it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.06it/s]
 51%|█████     | 893/1754 [00:25<00:24, 34.92it/s]
 51%|█████     | 897/1754 [00:26<00:24, 34.91it/s]
 51%|█████▏    | 901/1754 [00:26<00:24, 34.90it/s]
 52%|█████▏    | 905/1754 [00:26<00:24, 34.89it/s]
 52%|█████▏    | 909/1754 [00:26<00:24, 34.88it/s]
 52%|█████▏    | 913/1754 [00:26<00:24, 34.85it/s]
 52%|█████▏    | 917/1754 [00:26<00:24, 34.86it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 34.87it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 34.92it/s]
 53%|█████▎    | 929/1754 [00:26<00:23, 35.13it/s]
 53%|█████▎    | 933/1754 [00:27<00:23, 35.27it/s]
 53%|█████▎    | 937/1754 [00:27<00:23, 35.38it/s]
 54%|█████▎    | 941/1754 [00:27<00:22, 35.46it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.50it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.55it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.57it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.58it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.55it/s]
 55%|█████▌    | 965/1754 [00:27<00:22, 35.56it/s]
 55%|█████▌    | 969/1754 [00:28<00:22, 35.56it/s]
 55%|█████▌    | 973/1754 [00:28<00:21, 35.51it/s]
 56%|█████▌    | 977/1754 [00:28<00:21, 35.54it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.56it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.56it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.58it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.60it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.62it/s]
 57%|█████▋    | 1001/1754 [00:28<00:21, 35.62it/s]
 57%|█████▋    | 1005/1754 [00:29<00:21, 35.63it/s]
 58%|█████▊    | 1009/1754 [00:29<00:20, 35.63it/s]
 58%|█████▊    | 1013/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.60it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.61it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.62it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.63it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.57it/s]
 59%|█████▉    | 1037/1754 [00:29<00:20, 35.56it/s]
 59%|█████▉    | 1041/1754 [00:30<00:20, 35.56it/s]
 60%|█████▉    | 1045/1754 [00:30<00:19, 35.56it/s]
 60%|█████▉    | 1049/1754 [00:30<00:19, 35.55it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.58it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.60it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.60it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.61it/s]
 61%|██████    | 1069/1754 [00:30<00:19, 35.61it/s]
 61%|██████    | 1073/1754 [00:30<00:19, 35.60it/s]
 61%|██████▏   | 1077/1754 [00:31<00:19, 35.54it/s]
 62%|██████▏   | 1081/1754 [00:31<00:18, 35.57it/s]
 62%|██████▏   | 1085/1754 [00:31<00:18, 35.58it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.55it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.55it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.58it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.59it/s]
 63%|██████▎   | 1105/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1109/1754 [00:32<00:18, 35.55it/s]
 63%|██████▎   | 1113/1754 [00:32<00:18, 35.52it/s]
 64%|██████▎   | 1117/1754 [00:32<00:17, 35.50it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.48it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.51it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.55it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.57it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.58it/s]
 65%|██████▌   | 1141/1754 [00:32<00:17, 35.59it/s]
 65%|██████▌   | 1145/1754 [00:33<00:17, 35.60it/s]
 66%|██████▌   | 1149/1754 [00:33<00:16, 35.62it/s]
 66%|██████▌   | 1153/1754 [00:33<00:16, 35.63it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.63it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.58it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.60it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.61it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.62it/s]
 67%|██████▋   | 1177/1754 [00:33<00:16, 35.62it/s]
 67%|██████▋   | 1181/1754 [00:34<00:16, 35.62it/s]
 68%|██████▊   | 1185/1754 [00:34<00:15, 35.63it/s]
 68%|██████▊   | 1189/1754 [00:34<00:15, 35.62it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.60it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.62it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.61it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.61it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.57it/s]
 69%|██████▉   | 1213/1754 [00:34<00:15, 35.58it/s]
 69%|██████▉   | 1217/1754 [00:35<00:15, 35.60it/s]
 70%|██████▉   | 1221/1754 [00:35<00:14, 35.60it/s]
 70%|██████▉   | 1225/1754 [00:35<00:14, 35.61it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.62it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.62it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.63it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.61it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.63it/s]
 71%|███████   | 1249/1754 [00:35<00:14, 35.62it/s]
 71%|███████▏  | 1253/1754 [00:36<00:14, 35.62it/s]
 72%|███████▏  | 1257/1754 [00:36<00:13, 35.57it/s]
 72%|███████▏  | 1261/1754 [00:36<00:13, 35.59it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.60it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.62it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.62it/s]
 73%|███████▎  | 1285/1754 [00:36<00:13, 35.59it/s]
 73%|███████▎  | 1289/1754 [00:37<00:13, 35.59it/s]
 74%|███████▎  | 1293/1754 [00:37<00:12, 35.61it/s]
 74%|███████▍  | 1297/1754 [00:37<00:12, 35.62it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.60it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.57it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.58it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.60it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1321/1754 [00:37<00:12, 35.55it/s]
 76%|███████▌  | 1325/1754 [00:38<00:12, 35.56it/s]
 76%|███████▌  | 1329/1754 [00:38<00:11, 35.56it/s]
 76%|███████▌  | 1333/1754 [00:38<00:11, 35.56it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.58it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.60it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.62it/s]
 77%|███████▋  | 1357/1754 [00:38<00:11, 35.64it/s]
 78%|███████▊  | 1361/1754 [00:39<00:11, 35.62it/s]
 78%|███████▊  | 1365/1754 [00:39<00:10, 35.55it/s]
 78%|███████▊  | 1369/1754 [00:39<00:10, 35.53it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.53it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.55it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.58it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.58it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.61it/s]
 79%|███████▉  | 1393/1754 [00:39<00:10, 35.61it/s]
 80%|███████▉  | 1397/1754 [00:40<00:10, 35.62it/s]
 80%|███████▉  | 1401/1754 [00:40<00:09, 35.62it/s]
 80%|████████  | 1405/1754 [00:40<00:09, 35.61it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.63it/s]
 81%|████████  | 1425/1754 [00:40<00:09, 35.64it/s]
 81%|████████▏ | 1429/1754 [00:40<00:09, 35.64it/s]
 82%|████████▏ | 1433/1754 [00:41<00:09, 35.64it/s]
 82%|████████▏ | 1437/1754 [00:41<00:08, 35.64it/s]
 82%|████████▏ | 1441/1754 [00:41<00:08, 35.65it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.65it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.64it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.65it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.65it/s]
 83%|████████▎ | 1461/1754 [00:41<00:08, 35.65it/s]
 84%|████████▎ | 1465/1754 [00:42<00:08, 35.65it/s]
 84%|████████▍ | 1469/1754 [00:42<00:07, 35.65it/s]
 84%|████████▍ | 1473/1754 [00:42<00:07, 35.64it/s]
 84%|████████▍ | 1477/1754 [00:42<00:07, 35.63it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.64it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.64it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.64it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.62it/s]
 85%|████████▌ | 1497/1754 [00:42<00:07, 35.58it/s]
 86%|████████▌ | 1501/1754 [00:43<00:07, 35.59it/s]
 86%|████████▌ | 1505/1754 [00:43<00:06, 35.61it/s]
 86%|████████▌ | 1509/1754 [00:43<00:06, 35.61it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.61it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.63it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.63it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.58it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.60it/s]
 87%|████████▋ | 1533/1754 [00:43<00:06, 35.61it/s]
 88%|████████▊ | 1537/1754 [00:44<00:06, 35.62it/s]
 88%|████████▊ | 1541/1754 [00:44<00:05, 35.62it/s]
 88%|████████▊ | 1545/1754 [00:44<00:05, 35.55it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.58it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.59it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.62it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.64it/s]
 89%|████████▉ | 1569/1754 [00:44<00:05, 35.64it/s]
 90%|████████▉ | 1573/1754 [00:45<00:05, 35.64it/s]
 90%|████████▉ | 1577/1754 [00:45<00:04, 35.61it/s]
 90%|█████████ | 1581/1754 [00:45<00:04, 35.63it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.63it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.64it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.64it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.64it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.62it/s]
 92%|█████████▏| 1605/1754 [00:45<00:04, 35.61it/s]
 92%|█████████▏| 1609/1754 [00:46<00:04, 35.62it/s]
 92%|█████████▏| 1613/1754 [00:46<00:03, 35.64it/s]
 92%|█████████▏| 1617/1754 [00:46<00:03, 35.65it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 35.65it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 35.64it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 35.65it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 35.64it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 35.63it/s]
 94%|█████████▎| 1641/1754 [00:46<00:03, 35.63it/s]
 94%|█████████▍| 1645/1754 [00:47<00:03, 35.65it/s]
 94%|█████████▍| 1649/1754 [00:47<00:02, 35.65it/s]
 94%|█████████▍| 1653/1754 [00:47<00:02, 35.64it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.64it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.65it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.57it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.57it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.58it/s]
 96%|█████████▌| 1677/1754 [00:47<00:02, 35.60it/s]
 96%|█████████▌| 1681/1754 [00:48<00:02, 35.60it/s]
 96%|█████████▌| 1685/1754 [00:48<00:01, 35.60it/s]
 96%|█████████▋| 1689/1754 [00:48<00:01, 35.61it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.63it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.64it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.65it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.65it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.66it/s]
 98%|█████████▊| 1713/1754 [00:48<00:01, 35.65it/s]
 98%|█████████▊| 1717/1754 [00:49<00:01, 35.57it/s]
 98%|█████████▊| 1721/1754 [00:49<00:00, 35.58it/s]
 98%|█████████▊| 1725/1754 [00:49<00:00, 35.64it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.70it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.74it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.76it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.78it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.80it/s]
100%|█████████▉| 1749/1754 [00:49<00:00, 35.82it/s]
100%|█████████▉| 1753/1754 [00:50<00:00, 35.83it/s]
100%|██████████| 1754/1754 [00:50<00:00, 34.93it/s]
INFO:Trainer:2024-13-05 21:18:10:mr: 239.057
INFO:Trainer:2024-13-05 21:18:10:mrr: 0.283
INFO:Trainer:2024-13-05 21:18:10:hits@1: 0.193
INFO:Trainer:2024-13-05 21:18:10:hits@3: 0.316
INFO:Trainer:2024-13-05 21:18:10:hits@10: 0.46
INFO:Trainer:2024-13-05 21:18:10:mr_type: 131.646
INFO:Trainer:2024-13-05 21:18:10:mrr_type: 0.316
INFO:Trainer:2024-13-05 21:18:10:hits@1_type: 0.224
INFO:Trainer:2024-13-05 21:18:10:hits@3_type: 0.349
INFO:Trainer:2024-13-05 21:18:10:hits@10_type: 0.498
INFO:EarlyStopping:2024-13-05 21:18:10:Validation score improved (0.447000 --> 0.460000).  Saving model ...
INFO:Trainer:2024-13-05 21:18:10:[cuda:0] Epoch 400 | Training checkpoint saved at ../../checkpoint/transr-400.pth
INFO:Trainer:2024-13-05 21:18:10:[cuda:1] Epoch [ 400/1000] | Batchsize: 2048 | loss:  3.471031 | 6.17463 seconds/epoch
INFO:Trainer:2024-13-05 21:18:10:[cuda:0] Epoch [ 400/1000] | Batchsize: 2048 | loss:  3.458506 | 6.17454 seconds/epoch
INFO:Trainer:2024-13-05 21:27:40:[cuda:0] Epoch 500 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<15:40,  1.86it/s]
  0%|          | 5/1754 [00:00<03:01,  9.63it/s]
  1%|          | 9/1754 [00:00<01:48, 16.07it/s]
  1%|          | 13/1754 [00:00<01:22, 21.15it/s]
  1%|          | 17/1754 [00:00<01:09, 25.08it/s]
  1%|          | 21/1754 [00:01<01:01, 28.04it/s]
  1%|▏         | 25/1754 [00:01<00:57, 30.23it/s]
  2%|▏         | 29/1754 [00:01<00:54, 31.80it/s]
  2%|▏         | 33/1754 [00:01<00:52, 32.94it/s]
  2%|▏         | 37/1754 [00:01<00:50, 33.75it/s]
  2%|▏         | 41/1754 [00:01<00:49, 34.32it/s]
  3%|▎         | 45/1754 [00:01<00:49, 34.69it/s]
  3%|▎         | 49/1754 [00:01<00:48, 34.99it/s]
  3%|▎         | 53/1754 [00:01<00:48, 35.20it/s]
  3%|▎         | 57/1754 [00:02<00:47, 35.36it/s]
  3%|▎         | 61/1754 [00:02<00:47, 35.41it/s]
  4%|▎         | 65/1754 [00:02<00:47, 35.48it/s]
  4%|▍         | 69/1754 [00:02<00:47, 35.52it/s]
  4%|▍         | 73/1754 [00:02<00:47, 35.56it/s]
  4%|▍         | 77/1754 [00:02<00:47, 35.57it/s]
  5%|▍         | 81/1754 [00:02<00:47, 35.55it/s]
  5%|▍         | 85/1754 [00:02<00:46, 35.57it/s]
  5%|▌         | 89/1754 [00:03<00:46, 35.59it/s]
  5%|▌         | 93/1754 [00:03<00:46, 35.59it/s]
  6%|▌         | 97/1754 [00:03<00:46, 35.58it/s]
  6%|▌         | 101/1754 [00:03<00:46, 35.59it/s]
  6%|▌         | 105/1754 [00:03<00:46, 35.59it/s]
  6%|▌         | 109/1754 [00:03<00:46, 35.60it/s]
  6%|▋         | 113/1754 [00:03<00:46, 35.61it/s]
  7%|▋         | 117/1754 [00:03<00:45, 35.61it/s]
  7%|▋         | 121/1754 [00:03<00:45, 35.56it/s]
  7%|▋         | 125/1754 [00:04<00:45, 35.57it/s]
  7%|▋         | 129/1754 [00:04<00:45, 35.54it/s]
  8%|▊         | 133/1754 [00:04<00:45, 35.55it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.56it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.56it/s]
  8%|▊         | 145/1754 [00:04<00:45, 35.57it/s]
  8%|▊         | 149/1754 [00:04<00:45, 35.57it/s]
  9%|▊         | 153/1754 [00:04<00:45, 35.54it/s]
  9%|▉         | 157/1754 [00:04<00:45, 35.48it/s]
  9%|▉         | 161/1754 [00:05<00:44, 35.43it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.44it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.49it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.50it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.53it/s]
 10%|█         | 181/1754 [00:05<00:44, 35.57it/s]
 11%|█         | 185/1754 [00:05<00:44, 35.59it/s]
 11%|█         | 189/1754 [00:05<00:43, 35.58it/s]
 11%|█         | 193/1754 [00:05<00:43, 35.58it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.59it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.61it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.60it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.60it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.60it/s]
 12%|█▏        | 217/1754 [00:06<00:43, 35.61it/s]
 13%|█▎        | 221/1754 [00:06<00:43, 35.60it/s]
 13%|█▎        | 225/1754 [00:06<00:42, 35.60it/s]
 13%|█▎        | 229/1754 [00:06<00:42, 35.59it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.60it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.61it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.58it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.59it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.59it/s]
 14%|█▍        | 253/1754 [00:07<00:42, 35.55it/s]
 15%|█▍        | 257/1754 [00:07<00:42, 35.58it/s]
 15%|█▍        | 261/1754 [00:07<00:41, 35.60it/s]
 15%|█▌        | 265/1754 [00:07<00:41, 35.61it/s]
 15%|█▌        | 269/1754 [00:08<00:41, 35.61it/s]
 16%|█▌        | 273/1754 [00:08<00:41, 35.61it/s]
 16%|█▌        | 277/1754 [00:08<00:41, 35.61it/s]
 16%|█▌        | 281/1754 [00:08<00:41, 35.59it/s]
 16%|█▌        | 285/1754 [00:08<00:41, 35.61it/s]
 16%|█▋        | 289/1754 [00:08<00:41, 35.61it/s]
 17%|█▋        | 293/1754 [00:08<00:41, 35.62it/s]
 17%|█▋        | 297/1754 [00:08<00:40, 35.63it/s]
 17%|█▋        | 301/1754 [00:08<00:40, 35.63it/s]
 17%|█▋        | 305/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 309/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.60it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.60it/s]
 19%|█▊        | 325/1754 [00:09<00:40, 35.61it/s]
 19%|█▉        | 329/1754 [00:09<00:40, 35.62it/s]
 19%|█▉        | 333/1754 [00:09<00:39, 35.61it/s]
 19%|█▉        | 337/1754 [00:09<00:39, 35.62it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.63it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.63it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.62it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.61it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.60it/s]
 21%|██        | 361/1754 [00:10<00:39, 35.62it/s]
 21%|██        | 365/1754 [00:10<00:39, 35.61it/s]
 21%|██        | 369/1754 [00:10<00:38, 35.62it/s]
 21%|██▏       | 373/1754 [00:10<00:38, 35.63it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.63it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.63it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.63it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.62it/s]
 22%|██▏       | 393/1754 [00:11<00:38, 35.59it/s]
 23%|██▎       | 397/1754 [00:11<00:38, 35.58it/s]
 23%|██▎       | 401/1754 [00:11<00:38, 35.59it/s]
 23%|██▎       | 405/1754 [00:11<00:37, 35.56it/s]
 23%|██▎       | 409/1754 [00:11<00:37, 35.56it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.56it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.57it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.58it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.60it/s]
 24%|██▍       | 429/1754 [00:12<00:37, 35.60it/s]
 25%|██▍       | 433/1754 [00:12<00:37, 35.62it/s]
 25%|██▍       | 437/1754 [00:12<00:37, 35.48it/s]
 25%|██▌       | 441/1754 [00:12<00:36, 35.52it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.53it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.54it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.57it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.59it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.60it/s]
 27%|██▋       | 465/1754 [00:13<00:36, 35.62it/s]
 27%|██▋       | 469/1754 [00:13<00:36, 35.61it/s]
 27%|██▋       | 473/1754 [00:13<00:35, 35.60it/s]
 27%|██▋       | 477/1754 [00:13<00:35, 35.58it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.61it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.62it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.61it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.48it/s]
 29%|██▊       | 501/1754 [00:14<00:35, 35.50it/s]
 29%|██▉       | 505/1754 [00:14<00:35, 35.51it/s]
 29%|██▉       | 509/1754 [00:14<00:35, 35.52it/s]
 29%|██▉       | 513/1754 [00:14<00:34, 35.54it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.57it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.58it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.57it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.57it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.59it/s]
 31%|███       | 537/1754 [00:15<00:34, 35.60it/s]
 31%|███       | 541/1754 [00:15<00:34, 35.61it/s]
 31%|███       | 545/1754 [00:15<00:33, 35.62it/s]
 31%|███▏      | 549/1754 [00:15<00:33, 35.62it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.62it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.62it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.63it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.62it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.62it/s]
 33%|███▎      | 573/1754 [00:16<00:33, 35.61it/s]
 33%|███▎      | 577/1754 [00:16<00:33, 35.62it/s]
 33%|███▎      | 581/1754 [00:16<00:32, 35.63it/s]
 33%|███▎      | 585/1754 [00:16<00:32, 35.63it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.62it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.58it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.54it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.51it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.52it/s]
 35%|███▍      | 609/1754 [00:17<00:32, 35.54it/s]
 35%|███▍      | 613/1754 [00:17<00:32, 35.55it/s]
 35%|███▌      | 617/1754 [00:17<00:31, 35.57it/s]
 35%|███▌      | 621/1754 [00:17<00:31, 35.56it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.58it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.60it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.61it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.61it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.62it/s]
 37%|███▋      | 645/1754 [00:18<00:31, 35.63it/s]
 37%|███▋      | 649/1754 [00:18<00:31, 35.62it/s]
 37%|███▋      | 653/1754 [00:18<00:30, 35.62it/s]
 37%|███▋      | 657/1754 [00:18<00:30, 35.61it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.61it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.62it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.61it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.61it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 681/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 685/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 689/1754 [00:19<00:29, 35.60it/s]
 40%|███▉      | 693/1754 [00:19<00:29, 35.62it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.62it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.60it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.59it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.60it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.60it/s]
 41%|████      | 717/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 721/1754 [00:20<00:29, 35.61it/s]
 41%|████▏     | 725/1754 [00:20<00:28, 35.59it/s]
 42%|████▏     | 729/1754 [00:20<00:28, 35.61it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.62it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.63it/s]
 43%|████▎     | 749/1754 [00:21<00:28, 35.61it/s]
 43%|████▎     | 753/1754 [00:21<00:28, 35.59it/s]
 43%|████▎     | 757/1754 [00:21<00:27, 35.61it/s]
 43%|████▎     | 761/1754 [00:21<00:27, 35.62it/s]
 44%|████▎     | 765/1754 [00:21<00:27, 35.62it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.59it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.61it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.58it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 35.58it/s]
 45%|████▍     | 785/1754 [00:22<00:27, 35.59it/s]
 45%|████▍     | 789/1754 [00:22<00:27, 35.62it/s]
 45%|████▌     | 793/1754 [00:22<00:26, 35.62it/s]
 45%|████▌     | 797/1754 [00:22<00:26, 35.60it/s]
 46%|████▌     | 801/1754 [00:23<00:26, 35.60it/s]
 46%|████▌     | 805/1754 [00:23<00:26, 35.56it/s]
 46%|████▌     | 809/1754 [00:23<00:26, 35.57it/s]
 46%|████▋     | 813/1754 [00:23<00:26, 35.57it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 35.57it/s]
 47%|████▋     | 821/1754 [00:23<00:26, 35.57it/s]
 47%|████▋     | 825/1754 [00:23<00:26, 35.59it/s]
 47%|████▋     | 829/1754 [00:23<00:25, 35.58it/s]
 47%|████▋     | 833/1754 [00:23<00:25, 35.59it/s]
 48%|████▊     | 837/1754 [00:24<00:25, 35.60it/s]
 48%|████▊     | 841/1754 [00:24<00:25, 35.61it/s]
 48%|████▊     | 845/1754 [00:24<00:25, 35.62it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 35.62it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 35.62it/s]
 49%|████▉     | 857/1754 [00:24<00:25, 35.63it/s]
 49%|████▉     | 861/1754 [00:24<00:25, 35.58it/s]
 49%|████▉     | 865/1754 [00:24<00:24, 35.57it/s]
 50%|████▉     | 869/1754 [00:24<00:24, 35.58it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.59it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.58it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.59it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.61it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.62it/s]
 51%|█████     | 893/1754 [00:25<00:24, 35.62it/s]
 51%|█████     | 897/1754 [00:25<00:24, 35.57it/s]
 51%|█████▏    | 901/1754 [00:25<00:23, 35.58it/s]
 52%|█████▏    | 905/1754 [00:25<00:23, 35.58it/s]
 52%|█████▏    | 909/1754 [00:26<00:23, 35.57it/s]
 52%|█████▏    | 913/1754 [00:26<00:23, 35.59it/s]
 52%|█████▏    | 917/1754 [00:26<00:23, 35.60it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 35.58it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 35.59it/s]
 53%|█████▎    | 929/1754 [00:26<00:23, 35.59it/s]
 53%|█████▎    | 933/1754 [00:26<00:23, 35.55it/s]
 53%|█████▎    | 937/1754 [00:26<00:22, 35.55it/s]
 54%|█████▎    | 941/1754 [00:26<00:22, 35.57it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.59it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.60it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.62it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.62it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.63it/s]
 55%|█████▌    | 965/1754 [00:27<00:22, 35.64it/s]
 55%|█████▌    | 969/1754 [00:27<00:22, 35.64it/s]
 55%|█████▌    | 973/1754 [00:27<00:21, 35.64it/s]
 56%|█████▌    | 977/1754 [00:27<00:21, 35.63it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.63it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.63it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.63it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.64it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.62it/s]
 57%|█████▋    | 1001/1754 [00:28<00:21, 35.63it/s]
 57%|█████▋    | 1005/1754 [00:28<00:21, 35.61it/s]
 58%|█████▊    | 1009/1754 [00:28<00:20, 35.62it/s]
 58%|█████▊    | 1013/1754 [00:28<00:20, 35.64it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.65it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.64it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.65it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.65it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.65it/s]
 59%|█████▉    | 1037/1754 [00:29<00:20, 35.62it/s]
 59%|█████▉    | 1041/1754 [00:29<00:20, 35.63it/s]
 60%|█████▉    | 1045/1754 [00:29<00:19, 35.64it/s]
 60%|█████▉    | 1049/1754 [00:29<00:19, 35.62it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.62it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.60it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.61it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.54it/s]
 61%|██████    | 1069/1754 [00:30<00:19, 35.55it/s]
 61%|██████    | 1073/1754 [00:30<00:19, 35.53it/s]
 61%|██████▏   | 1077/1754 [00:30<00:19, 35.53it/s]
 62%|██████▏   | 1081/1754 [00:30<00:18, 35.55it/s]
 62%|██████▏   | 1085/1754 [00:30<00:18, 35.53it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.55it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.57it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.58it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.59it/s]
 63%|██████▎   | 1105/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1109/1754 [00:31<00:18, 35.61it/s]
 63%|██████▎   | 1113/1754 [00:31<00:17, 35.62it/s]
 64%|██████▎   | 1117/1754 [00:31<00:17, 35.62it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.62it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.63it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.63it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.62it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.62it/s]
 65%|██████▌   | 1141/1754 [00:32<00:17, 35.62it/s]
 65%|██████▌   | 1145/1754 [00:32<00:17, 35.56it/s]
 66%|██████▌   | 1149/1754 [00:32<00:17, 35.49it/s]
 66%|██████▌   | 1153/1754 [00:32<00:16, 35.54it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.58it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.60it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.59it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.61it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.61it/s]
 67%|██████▋   | 1177/1754 [00:33<00:16, 35.62it/s]
 67%|██████▋   | 1181/1754 [00:33<00:16, 35.61it/s]
 68%|██████▊   | 1185/1754 [00:33<00:15, 35.63it/s]
 68%|██████▊   | 1189/1754 [00:33<00:15, 35.63it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.63it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.63it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.62it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.62it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.61it/s]
 69%|██████▉   | 1213/1754 [00:34<00:15, 35.60it/s]
 69%|██████▉   | 1217/1754 [00:34<00:15, 35.51it/s]
 70%|██████▉   | 1221/1754 [00:34<00:15, 35.50it/s]
 70%|██████▉   | 1225/1754 [00:34<00:14, 35.52it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.54it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.55it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.55it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.57it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.59it/s]
 71%|███████   | 1249/1754 [00:35<00:14, 35.60it/s]
 71%|███████▏  | 1253/1754 [00:35<00:14, 35.57it/s]
 72%|███████▏  | 1257/1754 [00:35<00:13, 35.58it/s]
 72%|███████▏  | 1261/1754 [00:35<00:13, 35.58it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.59it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.60it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.60it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.61it/s]
 73%|███████▎  | 1285/1754 [00:36<00:13, 35.62it/s]
 73%|███████▎  | 1289/1754 [00:36<00:13, 35.63it/s]
 74%|███████▎  | 1293/1754 [00:36<00:12, 35.63it/s]
 74%|███████▍  | 1297/1754 [00:36<00:12, 35.62it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.60it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.61it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.61it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.63it/s]
 75%|███████▌  | 1321/1754 [00:37<00:12, 35.62it/s]
 76%|███████▌  | 1325/1754 [00:37<00:12, 35.61it/s]
 76%|███████▌  | 1329/1754 [00:37<00:11, 35.61it/s]
 76%|███████▌  | 1333/1754 [00:37<00:11, 35.61it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.61it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.59it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.60it/s]
 77%|███████▋  | 1357/1754 [00:38<00:11, 35.61it/s]
 78%|███████▊  | 1361/1754 [00:38<00:11, 35.61it/s]
 78%|███████▊  | 1365/1754 [00:38<00:10, 35.57it/s]
 78%|███████▊  | 1369/1754 [00:38<00:10, 35.58it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.60it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.62it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.63it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.62it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.62it/s]
 79%|███████▉  | 1393/1754 [00:39<00:10, 35.63it/s]
 80%|███████▉  | 1397/1754 [00:39<00:10, 35.61it/s]
 80%|███████▉  | 1401/1754 [00:39<00:09, 35.62it/s]
 80%|████████  | 1405/1754 [00:39<00:09, 35.62it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.61it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.61it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.60it/s]
 81%|████████  | 1425/1754 [00:40<00:09, 35.61it/s]
 81%|████████▏ | 1429/1754 [00:40<00:09, 35.60it/s]
 82%|████████▏ | 1433/1754 [00:40<00:09, 35.61it/s]
 82%|████████▏ | 1437/1754 [00:40<00:08, 35.61it/s]
 82%|████████▏ | 1441/1754 [00:40<00:08, 35.62it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.64it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.62it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.62it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.63it/s]
 83%|████████▎ | 1461/1754 [00:41<00:08, 35.63it/s]
 84%|████████▎ | 1465/1754 [00:41<00:08, 35.63it/s]
 84%|████████▍ | 1469/1754 [00:41<00:08, 35.62it/s]
 84%|████████▍ | 1473/1754 [00:41<00:07, 35.61it/s]
 84%|████████▍ | 1477/1754 [00:41<00:07, 35.63it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.63it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.63it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.64it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.65it/s]
 85%|████████▌ | 1497/1754 [00:42<00:07, 35.64it/s]
 86%|████████▌ | 1501/1754 [00:42<00:07, 35.64it/s]
 86%|████████▌ | 1505/1754 [00:42<00:06, 35.65it/s]
 86%|████████▌ | 1509/1754 [00:42<00:06, 35.65it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.64it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.62it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.63it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.62it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.64it/s]
 87%|████████▋ | 1533/1754 [00:43<00:06, 35.64it/s]
 88%|████████▊ | 1537/1754 [00:43<00:06, 35.64it/s]
 88%|████████▊ | 1541/1754 [00:43<00:05, 35.65it/s]
 88%|████████▊ | 1545/1754 [00:43<00:05, 35.64it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.65it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.65it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.64it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.64it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.64it/s]
 89%|████████▉ | 1569/1754 [00:44<00:05, 35.65it/s]
 90%|████████▉ | 1573/1754 [00:44<00:05, 35.66it/s]
 90%|████████▉ | 1577/1754 [00:44<00:04, 35.65it/s]
 90%|█████████ | 1581/1754 [00:44<00:04, 35.64it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.65it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.66it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.66it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.64it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.61it/s]
 92%|█████████▏| 1605/1754 [00:45<00:04, 35.59it/s]
 92%|█████████▏| 1609/1754 [00:45<00:04, 35.39it/s]
 92%|█████████▏| 1613/1754 [00:45<00:04, 35.09it/s]
 92%|█████████▏| 1617/1754 [00:45<00:03, 34.97it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 34.93it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 34.90it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 34.87it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 34.83it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 34.84it/s]
 94%|█████████▎| 1641/1754 [00:46<00:03, 35.00it/s]
 94%|█████████▍| 1645/1754 [00:46<00:03, 35.15it/s]
 94%|█████████▍| 1649/1754 [00:46<00:02, 35.29it/s]
 94%|█████████▍| 1653/1754 [00:46<00:02, 35.37it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.42it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.45it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.49it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.53it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.55it/s]
 96%|█████████▌| 1677/1754 [00:47<00:02, 35.56it/s]
 96%|█████████▌| 1681/1754 [00:47<00:02, 35.54it/s]
 96%|█████████▌| 1685/1754 [00:47<00:01, 35.55it/s]
 96%|█████████▋| 1689/1754 [00:47<00:01, 35.56it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.56it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.57it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.58it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.58it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.58it/s]
 98%|█████████▊| 1713/1754 [00:48<00:01, 35.60it/s]
 98%|█████████▊| 1717/1754 [00:48<00:01, 35.61it/s]
 98%|█████████▊| 1721/1754 [00:48<00:00, 35.60it/s]
 98%|█████████▊| 1725/1754 [00:48<00:00, 35.64it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.69it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.72it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.74it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.76it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.77it/s]
100%|█████████▉| 1749/1754 [00:49<00:00, 35.78it/s]
100%|█████████▉| 1753/1754 [00:49<00:00, 35.78it/s]
100%|██████████| 1754/1754 [00:49<00:00, 35.15it/s]
INFO:Trainer:2024-13-05 21:28:30:mr: 238.679
INFO:Trainer:2024-13-05 21:28:30:mrr: 0.283
INFO:Trainer:2024-13-05 21:28:30:hits@1: 0.193
INFO:Trainer:2024-13-05 21:28:30:hits@3: 0.316
INFO:Trainer:2024-13-05 21:28:30:hits@10: 0.46
INFO:Trainer:2024-13-05 21:28:30:mr_type: 131.207
INFO:Trainer:2024-13-05 21:28:30:mrr_type: 0.316
INFO:Trainer:2024-13-05 21:28:30:hits@1_type: 0.224
INFO:Trainer:2024-13-05 21:28:30:hits@3_type: 0.35
INFO:Trainer:2024-13-05 21:28:30:hits@10_type: 0.499
INFO:EarlyStopping:2024-13-05 21:28:30:EarlyStopping counter: 1 / 2
INFO:Trainer:2024-13-05 21:28:30:[cuda:0] Epoch 500 | Training checkpoint saved at ../../checkpoint/transr-500.pth
INFO:Trainer:2024-13-05 21:28:30:[cuda:1] Epoch [ 500/1000] | Batchsize: 2048 | loss:  3.413120 | 6.17927 seconds/epoch
INFO:Trainer:2024-13-05 21:28:30:[cuda:0] Epoch [ 500/1000] | Batchsize: 2048 | loss:  3.419101 | 6.17933 seconds/epoch
INFO:Trainer:2024-13-05 21:37:57:[cuda:0] Epoch 600 | The model starts evaluation on the validation set.

  0%|          | 0/1754 [00:00<?, ?it/s]
  0%|          | 1/1754 [00:00<20:15,  1.44it/s]
  0%|          | 5/1754 [00:00<03:44,  7.81it/s]
  1%|          | 9/1754 [00:00<02:08, 13.59it/s]
  1%|          | 13/1754 [00:01<01:33, 18.56it/s]
  1%|          | 17/1754 [00:01<01:16, 22.61it/s]
  1%|          | 21/1754 [00:01<01:07, 25.84it/s]
  1%|▏         | 25/1754 [00:01<01:01, 28.31it/s]
  2%|▏         | 29/1754 [00:01<00:57, 30.15it/s]
  2%|▏         | 33/1754 [00:01<00:54, 31.48it/s]
  2%|▏         | 37/1754 [00:01<00:52, 32.46it/s]
  2%|▏         | 41/1754 [00:01<00:51, 33.18it/s]
  3%|▎         | 45/1754 [00:01<00:50, 33.68it/s]
  3%|▎         | 49/1754 [00:02<00:50, 34.01it/s]
  3%|▎         | 53/1754 [00:02<00:49, 34.27it/s]
  3%|▎         | 57/1754 [00:02<00:49, 34.46it/s]
  3%|▎         | 61/1754 [00:02<00:48, 34.58it/s]
  4%|▎         | 65/1754 [00:02<00:48, 34.63it/s]
  4%|▍         | 69/1754 [00:02<00:48, 34.69it/s]
  4%|▍         | 73/1754 [00:02<00:48, 34.73it/s]
  4%|▍         | 77/1754 [00:02<00:48, 34.72it/s]
  5%|▍         | 81/1754 [00:02<00:48, 34.49it/s]
  5%|▍         | 85/1754 [00:03<00:48, 34.14it/s]
  5%|▌         | 89/1754 [00:03<00:48, 34.05it/s]
  5%|▌         | 93/1754 [00:03<00:48, 34.00it/s]
  6%|▌         | 97/1754 [00:03<00:48, 33.97it/s]
  6%|▌         | 101/1754 [00:03<00:48, 33.99it/s]
  6%|▌         | 105/1754 [00:03<00:47, 34.37it/s]
  6%|▌         | 109/1754 [00:03<00:47, 34.74it/s]
  6%|▋         | 113/1754 [00:03<00:46, 34.98it/s]
  7%|▋         | 117/1754 [00:04<00:46, 35.17it/s]
  7%|▋         | 121/1754 [00:04<00:46, 35.27it/s]
  7%|▋         | 125/1754 [00:04<00:46, 35.38it/s]
  7%|▋         | 129/1754 [00:04<00:45, 35.43it/s]
  8%|▊         | 133/1754 [00:04<00:45, 35.49it/s]
  8%|▊         | 137/1754 [00:04<00:45, 35.50it/s]
  8%|▊         | 141/1754 [00:04<00:45, 35.56it/s]
  8%|▊         | 145/1754 [00:04<00:45, 35.56it/s]
  8%|▊         | 149/1754 [00:04<00:45, 35.57it/s]
  9%|▊         | 153/1754 [00:05<00:44, 35.58it/s]
  9%|▉         | 157/1754 [00:05<00:44, 35.57it/s]
  9%|▉         | 161/1754 [00:05<00:44, 35.56it/s]
  9%|▉         | 165/1754 [00:05<00:44, 35.57it/s]
 10%|▉         | 169/1754 [00:05<00:44, 35.59it/s]
 10%|▉         | 173/1754 [00:05<00:44, 35.59it/s]
 10%|█         | 177/1754 [00:05<00:44, 35.54it/s]
 10%|█         | 181/1754 [00:05<00:44, 35.55it/s]
 11%|█         | 185/1754 [00:05<00:44, 35.58it/s]
 11%|█         | 189/1754 [00:06<00:43, 35.58it/s]
 11%|█         | 193/1754 [00:06<00:43, 35.58it/s]
 11%|█         | 197/1754 [00:06<00:43, 35.60it/s]
 11%|█▏        | 201/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 205/1754 [00:06<00:43, 35.58it/s]
 12%|█▏        | 209/1754 [00:06<00:43, 35.53it/s]
 12%|█▏        | 213/1754 [00:06<00:43, 35.55it/s]
 12%|█▏        | 217/1754 [00:06<00:43, 35.55it/s]
 13%|█▎        | 221/1754 [00:06<00:43, 35.58it/s]
 13%|█▎        | 225/1754 [00:07<00:42, 35.56it/s]
 13%|█▎        | 229/1754 [00:07<00:42, 35.56it/s]
 13%|█▎        | 233/1754 [00:07<00:42, 35.57it/s]
 14%|█▎        | 237/1754 [00:07<00:42, 35.57it/s]
 14%|█▎        | 241/1754 [00:07<00:42, 35.55it/s]
 14%|█▍        | 245/1754 [00:07<00:42, 35.50it/s]
 14%|█▍        | 249/1754 [00:07<00:42, 35.52it/s]
 14%|█▍        | 253/1754 [00:07<00:42, 35.54it/s]
 15%|█▍        | 257/1754 [00:07<00:42, 35.48it/s]
 15%|█▍        | 261/1754 [00:08<00:42, 35.52it/s]
 15%|█▌        | 265/1754 [00:08<00:41, 35.55it/s]
 15%|█▌        | 269/1754 [00:08<00:41, 35.58it/s]
 16%|█▌        | 273/1754 [00:08<00:41, 35.57it/s]
 16%|█▌        | 277/1754 [00:08<00:41, 35.59it/s]
 16%|█▌        | 281/1754 [00:08<00:41, 35.59it/s]
 16%|█▌        | 285/1754 [00:08<00:41, 35.61it/s]
 16%|█▋        | 289/1754 [00:08<00:41, 35.60it/s]
 17%|█▋        | 293/1754 [00:08<00:41, 35.62it/s]
 17%|█▋        | 297/1754 [00:09<00:40, 35.62it/s]
 17%|█▋        | 301/1754 [00:09<00:40, 35.62it/s]
 17%|█▋        | 305/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 309/1754 [00:09<00:40, 35.62it/s]
 18%|█▊        | 313/1754 [00:09<00:40, 35.61it/s]
 18%|█▊        | 317/1754 [00:09<00:40, 35.60it/s]
 18%|█▊        | 321/1754 [00:09<00:40, 35.58it/s]
 19%|█▊        | 325/1754 [00:09<00:40, 35.58it/s]
 19%|█▉        | 329/1754 [00:09<00:40, 35.60it/s]
 19%|█▉        | 333/1754 [00:10<00:39, 35.59it/s]
 19%|█▉        | 337/1754 [00:10<00:39, 35.57it/s]
 19%|█▉        | 341/1754 [00:10<00:39, 35.58it/s]
 20%|█▉        | 345/1754 [00:10<00:39, 35.60it/s]
 20%|█▉        | 349/1754 [00:10<00:39, 35.61it/s]
 20%|██        | 353/1754 [00:10<00:39, 35.60it/s]
 20%|██        | 357/1754 [00:10<00:39, 35.61it/s]
 21%|██        | 361/1754 [00:10<00:39, 35.61it/s]
 21%|██        | 365/1754 [00:11<00:38, 35.62it/s]
 21%|██        | 369/1754 [00:11<00:38, 35.61it/s]
 21%|██▏       | 373/1754 [00:11<00:38, 35.60it/s]
 21%|██▏       | 377/1754 [00:11<00:38, 35.62it/s]
 22%|██▏       | 381/1754 [00:11<00:38, 35.62it/s]
 22%|██▏       | 385/1754 [00:11<00:38, 35.62it/s]
 22%|██▏       | 389/1754 [00:11<00:38, 35.57it/s]
 22%|██▏       | 393/1754 [00:11<00:38, 35.55it/s]
 23%|██▎       | 397/1754 [00:11<00:38, 35.58it/s]
 23%|██▎       | 401/1754 [00:12<00:38, 35.54it/s]
 23%|██▎       | 405/1754 [00:12<00:37, 35.57it/s]
 23%|██▎       | 409/1754 [00:12<00:37, 35.58it/s]
 24%|██▎       | 413/1754 [00:12<00:37, 35.61it/s]
 24%|██▍       | 417/1754 [00:12<00:37, 35.60it/s]
 24%|██▍       | 421/1754 [00:12<00:37, 35.60it/s]
 24%|██▍       | 425/1754 [00:12<00:37, 35.60it/s]
 24%|██▍       | 429/1754 [00:12<00:37, 35.62it/s]
 25%|██▍       | 433/1754 [00:12<00:37, 35.60it/s]
 25%|██▍       | 437/1754 [00:13<00:36, 35.61it/s]
 25%|██▌       | 441/1754 [00:13<00:36, 35.61it/s]
 25%|██▌       | 445/1754 [00:13<00:36, 35.57it/s]
 26%|██▌       | 449/1754 [00:13<00:36, 35.57it/s]
 26%|██▌       | 453/1754 [00:13<00:36, 35.59it/s]
 26%|██▌       | 457/1754 [00:13<00:36, 35.59it/s]
 26%|██▋       | 461/1754 [00:13<00:36, 35.59it/s]
 27%|██▋       | 465/1754 [00:13<00:36, 35.58it/s]
 27%|██▋       | 469/1754 [00:13<00:36, 35.59it/s]
 27%|██▋       | 473/1754 [00:14<00:35, 35.59it/s]
 27%|██▋       | 477/1754 [00:14<00:35, 35.60it/s]
 27%|██▋       | 481/1754 [00:14<00:35, 35.59it/s]
 28%|██▊       | 485/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 489/1754 [00:14<00:35, 35.59it/s]
 28%|██▊       | 493/1754 [00:14<00:35, 35.60it/s]
 28%|██▊       | 497/1754 [00:14<00:35, 35.58it/s]
 29%|██▊       | 501/1754 [00:14<00:35, 35.59it/s]
 29%|██▉       | 505/1754 [00:14<00:35, 35.60it/s]
 29%|██▉       | 509/1754 [00:15<00:34, 35.60it/s]
 29%|██▉       | 513/1754 [00:15<00:34, 35.60it/s]
 29%|██▉       | 517/1754 [00:15<00:34, 35.62it/s]
 30%|██▉       | 521/1754 [00:15<00:34, 35.62it/s]
 30%|██▉       | 525/1754 [00:15<00:34, 35.63it/s]
 30%|███       | 529/1754 [00:15<00:34, 35.61it/s]
 30%|███       | 533/1754 [00:15<00:34, 35.63it/s]
 31%|███       | 537/1754 [00:15<00:34, 35.62it/s]
 31%|███       | 541/1754 [00:15<00:34, 35.63it/s]
 31%|███       | 545/1754 [00:16<00:33, 35.62it/s]
 31%|███▏      | 549/1754 [00:16<00:33, 35.63it/s]
 32%|███▏      | 553/1754 [00:16<00:33, 35.61it/s]
 32%|███▏      | 557/1754 [00:16<00:33, 35.62it/s]
 32%|███▏      | 561/1754 [00:16<00:33, 35.59it/s]
 32%|███▏      | 565/1754 [00:16<00:33, 35.59it/s]
 32%|███▏      | 569/1754 [00:16<00:33, 35.60it/s]
 33%|███▎      | 573/1754 [00:16<00:33, 35.63it/s]
 33%|███▎      | 577/1754 [00:16<00:33, 35.61it/s]
 33%|███▎      | 581/1754 [00:17<00:32, 35.58it/s]
 33%|███▎      | 585/1754 [00:17<00:32, 35.55it/s]
 34%|███▎      | 589/1754 [00:17<00:32, 35.58it/s]
 34%|███▍      | 593/1754 [00:17<00:32, 35.58it/s]
 34%|███▍      | 597/1754 [00:17<00:32, 35.61it/s]
 34%|███▍      | 601/1754 [00:17<00:32, 35.60it/s]
 34%|███▍      | 605/1754 [00:17<00:32, 35.61it/s]
 35%|███▍      | 609/1754 [00:17<00:32, 35.60it/s]
 35%|███▍      | 613/1754 [00:17<00:32, 35.62it/s]
 35%|███▌      | 617/1754 [00:18<00:31, 35.62it/s]
 35%|███▌      | 621/1754 [00:18<00:31, 35.61it/s]
 36%|███▌      | 625/1754 [00:18<00:31, 35.59it/s]
 36%|███▌      | 629/1754 [00:18<00:31, 35.61it/s]
 36%|███▌      | 633/1754 [00:18<00:31, 35.61it/s]
 36%|███▋      | 637/1754 [00:18<00:31, 35.61it/s]
 37%|███▋      | 641/1754 [00:18<00:31, 35.59it/s]
 37%|███▋      | 645/1754 [00:18<00:31, 35.60it/s]
 37%|███▋      | 649/1754 [00:18<00:31, 35.59it/s]
 37%|███▋      | 653/1754 [00:19<00:30, 35.58it/s]
 37%|███▋      | 657/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 661/1754 [00:19<00:30, 35.57it/s]
 38%|███▊      | 665/1754 [00:19<00:30, 35.58it/s]
 38%|███▊      | 669/1754 [00:19<00:30, 35.60it/s]
 38%|███▊      | 673/1754 [00:19<00:30, 35.59it/s]
 39%|███▊      | 677/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 681/1754 [00:19<00:30, 35.61it/s]
 39%|███▉      | 685/1754 [00:19<00:30, 35.63it/s]
 39%|███▉      | 689/1754 [00:20<00:29, 35.63it/s]
 40%|███▉      | 693/1754 [00:20<00:29, 35.64it/s]
 40%|███▉      | 697/1754 [00:20<00:29, 35.63it/s]
 40%|███▉      | 701/1754 [00:20<00:29, 35.63it/s]
 40%|████      | 705/1754 [00:20<00:29, 35.62it/s]
 40%|████      | 709/1754 [00:20<00:29, 35.63it/s]
 41%|████      | 713/1754 [00:20<00:29, 35.61it/s]
 41%|████      | 717/1754 [00:20<00:29, 35.60it/s]
 41%|████      | 721/1754 [00:21<00:29, 35.60it/s]
 41%|████▏     | 725/1754 [00:21<00:28, 35.58it/s]
 42%|████▏     | 729/1754 [00:21<00:28, 35.60it/s]
 42%|████▏     | 733/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 737/1754 [00:21<00:28, 35.59it/s]
 42%|████▏     | 741/1754 [00:21<00:28, 35.61it/s]
 42%|████▏     | 745/1754 [00:21<00:28, 35.61it/s]
 43%|████▎     | 749/1754 [00:21<00:28, 35.58it/s]
 43%|████▎     | 753/1754 [00:21<00:28, 35.57it/s]
 43%|████▎     | 757/1754 [00:22<00:28, 35.56it/s]
 43%|████▎     | 761/1754 [00:22<00:27, 35.58it/s]
 44%|████▎     | 765/1754 [00:22<00:27, 35.58it/s]
 44%|████▍     | 769/1754 [00:22<00:27, 35.57it/s]
 44%|████▍     | 773/1754 [00:22<00:27, 35.59it/s]
 44%|████▍     | 777/1754 [00:22<00:27, 35.59it/s]
 45%|████▍     | 781/1754 [00:22<00:27, 35.60it/s]
 45%|████▍     | 785/1754 [00:22<00:27, 35.59it/s]
 45%|████▍     | 789/1754 [00:22<00:27, 35.60it/s]
 45%|████▌     | 793/1754 [00:23<00:26, 35.60it/s]
 45%|████▌     | 797/1754 [00:23<00:26, 35.60it/s]
 46%|████▌     | 801/1754 [00:23<00:26, 35.58it/s]
 46%|████▌     | 805/1754 [00:23<00:26, 35.58it/s]
 46%|████▌     | 809/1754 [00:23<00:26, 35.59it/s]
 46%|████▋     | 813/1754 [00:23<00:26, 35.60it/s]
 47%|████▋     | 817/1754 [00:23<00:26, 35.59it/s]
 47%|████▋     | 821/1754 [00:23<00:26, 35.58it/s]
 47%|████▋     | 825/1754 [00:23<00:26, 35.52it/s]
 47%|████▋     | 829/1754 [00:24<00:26, 35.55it/s]
 47%|████▋     | 833/1754 [00:24<00:25, 35.56it/s]
 48%|████▊     | 837/1754 [00:24<00:25, 35.57it/s]
 48%|████▊     | 841/1754 [00:24<00:25, 35.58it/s]
 48%|████▊     | 845/1754 [00:24<00:25, 35.60it/s]
 48%|████▊     | 849/1754 [00:24<00:25, 35.59it/s]
 49%|████▊     | 853/1754 [00:24<00:25, 35.61it/s]
 49%|████▉     | 857/1754 [00:24<00:25, 35.62it/s]
 49%|████▉     | 861/1754 [00:24<00:25, 35.62it/s]
 49%|████▉     | 865/1754 [00:25<00:24, 35.61it/s]
 50%|████▉     | 869/1754 [00:25<00:24, 35.62it/s]
 50%|████▉     | 873/1754 [00:25<00:24, 35.62it/s]
 50%|█████     | 877/1754 [00:25<00:24, 35.61it/s]
 50%|█████     | 881/1754 [00:25<00:24, 35.57it/s]
 50%|█████     | 885/1754 [00:25<00:24, 35.59it/s]
 51%|█████     | 889/1754 [00:25<00:24, 35.59it/s]
 51%|█████     | 893/1754 [00:25<00:24, 35.60it/s]
 51%|█████     | 897/1754 [00:25<00:24, 35.59it/s]
 51%|█████▏    | 901/1754 [00:26<00:23, 35.61it/s]
 52%|█████▏    | 905/1754 [00:26<00:23, 35.61it/s]
 52%|█████▏    | 909/1754 [00:26<00:23, 35.64it/s]
 52%|█████▏    | 913/1754 [00:26<00:23, 35.61it/s]
 52%|█████▏    | 917/1754 [00:26<00:23, 35.62it/s]
 53%|█████▎    | 921/1754 [00:26<00:23, 35.62it/s]
 53%|█████▎    | 925/1754 [00:26<00:23, 35.63it/s]
 53%|█████▎    | 929/1754 [00:26<00:23, 35.58it/s]
 53%|█████▎    | 933/1754 [00:26<00:23, 35.54it/s]
 53%|█████▎    | 937/1754 [00:27<00:22, 35.55it/s]
 54%|█████▎    | 941/1754 [00:27<00:22, 35.58it/s]
 54%|█████▍    | 945/1754 [00:27<00:22, 35.58it/s]
 54%|█████▍    | 949/1754 [00:27<00:22, 35.59it/s]
 54%|█████▍    | 953/1754 [00:27<00:22, 35.61it/s]
 55%|█████▍    | 957/1754 [00:27<00:22, 35.62it/s]
 55%|█████▍    | 961/1754 [00:27<00:22, 35.61it/s]
 55%|█████▌    | 965/1754 [00:27<00:22, 35.62it/s]
 55%|█████▌    | 969/1754 [00:27<00:22, 35.63it/s]
 55%|█████▌    | 973/1754 [00:28<00:21, 35.63it/s]
 56%|█████▌    | 977/1754 [00:28<00:21, 35.61it/s]
 56%|█████▌    | 981/1754 [00:28<00:21, 35.60it/s]
 56%|█████▌    | 985/1754 [00:28<00:21, 35.58it/s]
 56%|█████▋    | 989/1754 [00:28<00:21, 35.60it/s]
 57%|█████▋    | 993/1754 [00:28<00:21, 35.60it/s]
 57%|█████▋    | 997/1754 [00:28<00:21, 35.62it/s]
 57%|█████▋    | 1001/1754 [00:28<00:21, 35.63it/s]
 57%|█████▋    | 1005/1754 [00:28<00:21, 35.60it/s]
 58%|█████▊    | 1009/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1013/1754 [00:29<00:20, 35.60it/s]
 58%|█████▊    | 1017/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1021/1754 [00:29<00:20, 35.59it/s]
 58%|█████▊    | 1025/1754 [00:29<00:20, 35.59it/s]
 59%|█████▊    | 1029/1754 [00:29<00:20, 35.61it/s]
 59%|█████▉    | 1033/1754 [00:29<00:20, 35.62it/s]
 59%|█████▉    | 1037/1754 [00:29<00:20, 35.61it/s]
 59%|█████▉    | 1041/1754 [00:29<00:20, 35.61it/s]
 60%|█████▉    | 1045/1754 [00:30<00:19, 35.58it/s]
 60%|█████▉    | 1049/1754 [00:30<00:19, 35.58it/s]
 60%|██████    | 1053/1754 [00:30<00:19, 35.58it/s]
 60%|██████    | 1057/1754 [00:30<00:19, 35.56it/s]
 60%|██████    | 1061/1754 [00:30<00:19, 35.58it/s]
 61%|██████    | 1065/1754 [00:30<00:19, 35.58it/s]
 61%|██████    | 1069/1754 [00:30<00:19, 35.61it/s]
 61%|██████    | 1073/1754 [00:30<00:19, 35.61it/s]
 61%|██████▏   | 1077/1754 [00:31<00:19, 35.63it/s]
 62%|██████▏   | 1081/1754 [00:31<00:18, 35.63it/s]
 62%|██████▏   | 1085/1754 [00:31<00:18, 35.64it/s]
 62%|██████▏   | 1089/1754 [00:31<00:18, 35.62it/s]
 62%|██████▏   | 1093/1754 [00:31<00:18, 35.62it/s]
 63%|██████▎   | 1097/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1101/1754 [00:31<00:18, 35.61it/s]
 63%|██████▎   | 1105/1754 [00:31<00:18, 35.60it/s]
 63%|██████▎   | 1109/1754 [00:31<00:18, 35.57it/s]
 63%|██████▎   | 1113/1754 [00:32<00:18, 35.60it/s]
 64%|██████▎   | 1117/1754 [00:32<00:17, 35.62it/s]
 64%|██████▍   | 1121/1754 [00:32<00:17, 35.61it/s]
 64%|██████▍   | 1125/1754 [00:32<00:17, 35.62it/s]
 64%|██████▍   | 1129/1754 [00:32<00:17, 35.64it/s]
 65%|██████▍   | 1133/1754 [00:32<00:17, 35.63it/s]
 65%|██████▍   | 1137/1754 [00:32<00:17, 35.61it/s]
 65%|██████▌   | 1141/1754 [00:32<00:17, 35.63it/s]
 65%|██████▌   | 1145/1754 [00:32<00:17, 35.63it/s]
 66%|██████▌   | 1149/1754 [00:33<00:16, 35.63it/s]
 66%|██████▌   | 1153/1754 [00:33<00:16, 35.62it/s]
 66%|██████▌   | 1157/1754 [00:33<00:16, 35.62it/s]
 66%|██████▌   | 1161/1754 [00:33<00:16, 35.63it/s]
 66%|██████▋   | 1165/1754 [00:33<00:16, 35.62it/s]
 67%|██████▋   | 1169/1754 [00:33<00:16, 35.61it/s]
 67%|██████▋   | 1173/1754 [00:33<00:16, 35.63it/s]
 67%|██████▋   | 1177/1754 [00:33<00:16, 35.64it/s]
 67%|██████▋   | 1181/1754 [00:33<00:16, 35.64it/s]
 68%|██████▊   | 1185/1754 [00:34<00:15, 35.62it/s]
 68%|██████▊   | 1189/1754 [00:34<00:15, 35.63it/s]
 68%|██████▊   | 1193/1754 [00:34<00:15, 35.64it/s]
 68%|██████▊   | 1197/1754 [00:34<00:15, 35.65it/s]
 68%|██████▊   | 1201/1754 [00:34<00:15, 35.61it/s]
 69%|██████▊   | 1205/1754 [00:34<00:15, 35.62it/s]
 69%|██████▉   | 1209/1754 [00:34<00:15, 35.63it/s]
 69%|██████▉   | 1213/1754 [00:34<00:15, 35.62it/s]
 69%|██████▉   | 1217/1754 [00:34<00:15, 35.62it/s]
 70%|██████▉   | 1221/1754 [00:35<00:14, 35.62it/s]
 70%|██████▉   | 1225/1754 [00:35<00:14, 35.62it/s]
 70%|███████   | 1229/1754 [00:35<00:14, 35.61it/s]
 70%|███████   | 1233/1754 [00:35<00:14, 35.60it/s]
 71%|███████   | 1237/1754 [00:35<00:14, 35.59it/s]
 71%|███████   | 1241/1754 [00:35<00:14, 35.61it/s]
 71%|███████   | 1245/1754 [00:35<00:14, 35.62it/s]
 71%|███████   | 1249/1754 [00:35<00:14, 35.62it/s]
 71%|███████▏  | 1253/1754 [00:35<00:14, 35.63it/s]
 72%|███████▏  | 1257/1754 [00:36<00:13, 35.63it/s]
 72%|███████▏  | 1261/1754 [00:36<00:13, 35.63it/s]
 72%|███████▏  | 1265/1754 [00:36<00:13, 35.63it/s]
 72%|███████▏  | 1269/1754 [00:36<00:13, 35.63it/s]
 73%|███████▎  | 1273/1754 [00:36<00:13, 35.64it/s]
 73%|███████▎  | 1277/1754 [00:36<00:13, 35.64it/s]
 73%|███████▎  | 1281/1754 [00:36<00:13, 35.57it/s]
 73%|███████▎  | 1285/1754 [00:36<00:13, 35.58it/s]
 73%|███████▎  | 1289/1754 [00:36<00:13, 35.59it/s]
 74%|███████▎  | 1293/1754 [00:37<00:12, 35.61it/s]
 74%|███████▍  | 1297/1754 [00:37<00:12, 35.61it/s]
 74%|███████▍  | 1301/1754 [00:37<00:12, 35.62it/s]
 74%|███████▍  | 1305/1754 [00:37<00:12, 35.62it/s]
 75%|███████▍  | 1309/1754 [00:37<00:12, 35.60it/s]
 75%|███████▍  | 1313/1754 [00:37<00:12, 35.59it/s]
 75%|███████▌  | 1317/1754 [00:37<00:12, 35.61it/s]
 75%|███████▌  | 1321/1754 [00:37<00:12, 35.63it/s]
 76%|███████▌  | 1325/1754 [00:37<00:12, 35.58it/s]
 76%|███████▌  | 1329/1754 [00:38<00:11, 35.59it/s]
 76%|███████▌  | 1333/1754 [00:38<00:11, 35.60it/s]
 76%|███████▌  | 1337/1754 [00:38<00:11, 35.61it/s]
 76%|███████▋  | 1341/1754 [00:38<00:11, 35.62it/s]
 77%|███████▋  | 1345/1754 [00:38<00:11, 35.61it/s]
 77%|███████▋  | 1349/1754 [00:38<00:11, 35.62it/s]
 77%|███████▋  | 1353/1754 [00:38<00:11, 35.62it/s]
 77%|███████▋  | 1357/1754 [00:38<00:11, 35.64it/s]
 78%|███████▊  | 1361/1754 [00:38<00:11, 35.60it/s]
 78%|███████▊  | 1365/1754 [00:39<00:10, 35.61it/s]
 78%|███████▊  | 1369/1754 [00:39<00:10, 35.63it/s]
 78%|███████▊  | 1373/1754 [00:39<00:10, 35.61it/s]
 79%|███████▊  | 1377/1754 [00:39<00:10, 35.61it/s]
 79%|███████▊  | 1381/1754 [00:39<00:10, 35.61it/s]
 79%|███████▉  | 1385/1754 [00:39<00:10, 35.60it/s]
 79%|███████▉  | 1389/1754 [00:39<00:10, 35.61it/s]
 79%|███████▉  | 1393/1754 [00:39<00:10, 35.60it/s]
 80%|███████▉  | 1397/1754 [00:39<00:10, 35.62it/s]
 80%|███████▉  | 1401/1754 [00:40<00:09, 35.63it/s]
 80%|████████  | 1405/1754 [00:40<00:09, 35.64it/s]
 80%|████████  | 1409/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1413/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1417/1754 [00:40<00:09, 35.62it/s]
 81%|████████  | 1421/1754 [00:40<00:09, 35.63it/s]
 81%|████████  | 1425/1754 [00:40<00:09, 35.61it/s]
 81%|████████▏ | 1429/1754 [00:40<00:09, 35.63it/s]
 82%|████████▏ | 1433/1754 [00:41<00:09, 35.63it/s]
 82%|████████▏ | 1437/1754 [00:41<00:08, 35.63it/s]
 82%|████████▏ | 1441/1754 [00:41<00:08, 35.62it/s]
 82%|████████▏ | 1445/1754 [00:41<00:08, 35.61it/s]
 83%|████████▎ | 1449/1754 [00:41<00:08, 35.62it/s]
 83%|████████▎ | 1453/1754 [00:41<00:08, 35.63it/s]
 83%|████████▎ | 1457/1754 [00:41<00:08, 35.61it/s]
 83%|████████▎ | 1461/1754 [00:41<00:08, 35.56it/s]
 84%|████████▎ | 1465/1754 [00:41<00:08, 35.59it/s]
 84%|████████▍ | 1469/1754 [00:42<00:08, 35.60it/s]
 84%|████████▍ | 1473/1754 [00:42<00:07, 35.57it/s]
 84%|████████▍ | 1477/1754 [00:42<00:07, 35.60it/s]
 84%|████████▍ | 1481/1754 [00:42<00:07, 35.61it/s]
 85%|████████▍ | 1485/1754 [00:42<00:07, 35.62it/s]
 85%|████████▍ | 1489/1754 [00:42<00:07, 35.61it/s]
 85%|████████▌ | 1493/1754 [00:42<00:07, 35.61it/s]
 85%|████████▌ | 1497/1754 [00:42<00:07, 35.62it/s]
 86%|████████▌ | 1501/1754 [00:42<00:07, 35.62it/s]
 86%|████████▌ | 1505/1754 [00:43<00:06, 35.62it/s]
 86%|████████▌ | 1509/1754 [00:43<00:06, 35.62it/s]
 86%|████████▋ | 1513/1754 [00:43<00:06, 35.62it/s]
 86%|████████▋ | 1517/1754 [00:43<00:06, 35.63it/s]
 87%|████████▋ | 1521/1754 [00:43<00:06, 35.62it/s]
 87%|████████▋ | 1525/1754 [00:43<00:06, 35.58it/s]
 87%|████████▋ | 1529/1754 [00:43<00:06, 35.58it/s]
 87%|████████▋ | 1533/1754 [00:43<00:06, 35.60it/s]
 88%|████████▊ | 1537/1754 [00:43<00:06, 35.59it/s]
 88%|████████▊ | 1541/1754 [00:44<00:05, 35.61it/s]
 88%|████████▊ | 1545/1754 [00:44<00:05, 35.61it/s]
 88%|████████▊ | 1549/1754 [00:44<00:05, 35.61it/s]
 89%|████████▊ | 1553/1754 [00:44<00:05, 35.60it/s]
 89%|████████▉ | 1557/1754 [00:44<00:05, 35.62it/s]
 89%|████████▉ | 1561/1754 [00:44<00:05, 35.60it/s]
 89%|████████▉ | 1565/1754 [00:44<00:05, 35.61it/s]
 89%|████████▉ | 1569/1754 [00:44<00:05, 35.61it/s]
 90%|████████▉ | 1573/1754 [00:44<00:05, 35.63it/s]
 90%|████████▉ | 1577/1754 [00:45<00:04, 35.62it/s]
 90%|█████████ | 1581/1754 [00:45<00:04, 35.64it/s]
 90%|█████████ | 1585/1754 [00:45<00:04, 35.63it/s]
 91%|█████████ | 1589/1754 [00:45<00:04, 35.63it/s]
 91%|█████████ | 1593/1754 [00:45<00:04, 35.63it/s]
 91%|█████████ | 1597/1754 [00:45<00:04, 35.64it/s]
 91%|█████████▏| 1601/1754 [00:45<00:04, 35.61it/s]
 92%|█████████▏| 1605/1754 [00:45<00:04, 35.62it/s]
 92%|█████████▏| 1609/1754 [00:45<00:04, 35.60it/s]
 92%|█████████▏| 1613/1754 [00:46<00:03, 35.63it/s]
 92%|█████████▏| 1617/1754 [00:46<00:03, 35.61it/s]
 92%|█████████▏| 1621/1754 [00:46<00:03, 35.62it/s]
 93%|█████████▎| 1625/1754 [00:46<00:03, 35.59it/s]
 93%|█████████▎| 1629/1754 [00:46<00:03, 35.61it/s]
 93%|█████████▎| 1633/1754 [00:46<00:03, 35.60it/s]
 93%|█████████▎| 1637/1754 [00:46<00:03, 35.60it/s]
 94%|█████████▎| 1641/1754 [00:46<00:03, 35.61it/s]
 94%|█████████▍| 1645/1754 [00:46<00:03, 35.63it/s]
 94%|█████████▍| 1649/1754 [00:47<00:02, 35.61it/s]
 94%|█████████▍| 1653/1754 [00:47<00:02, 35.62it/s]
 94%|█████████▍| 1657/1754 [00:47<00:02, 35.63it/s]
 95%|█████████▍| 1661/1754 [00:47<00:02, 35.63it/s]
 95%|█████████▍| 1665/1754 [00:47<00:02, 35.63it/s]
 95%|█████████▌| 1669/1754 [00:47<00:02, 35.63it/s]
 95%|█████████▌| 1673/1754 [00:47<00:02, 35.64it/s]
 96%|█████████▌| 1677/1754 [00:47<00:02, 35.65it/s]
 96%|█████████▌| 1681/1754 [00:47<00:02, 35.63it/s]
 96%|█████████▌| 1685/1754 [00:48<00:01, 35.63it/s]
 96%|█████████▋| 1689/1754 [00:48<00:01, 35.60it/s]
 97%|█████████▋| 1693/1754 [00:48<00:01, 35.62it/s]
 97%|█████████▋| 1697/1754 [00:48<00:01, 35.61it/s]
 97%|█████████▋| 1701/1754 [00:48<00:01, 35.63it/s]
 97%|█████████▋| 1705/1754 [00:48<00:01, 35.63it/s]
 97%|█████████▋| 1709/1754 [00:48<00:01, 35.63it/s]
 98%|█████████▊| 1713/1754 [00:48<00:01, 35.62it/s]
 98%|█████████▊| 1717/1754 [00:48<00:01, 35.63it/s]
 98%|█████████▊| 1721/1754 [00:49<00:00, 35.63it/s]
 98%|█████████▊| 1725/1754 [00:49<00:00, 35.68it/s]
 99%|█████████▊| 1729/1754 [00:49<00:00, 35.73it/s]
 99%|█████████▉| 1733/1754 [00:49<00:00, 35.76it/s]
 99%|█████████▉| 1737/1754 [00:49<00:00, 35.79it/s]
 99%|█████████▉| 1741/1754 [00:49<00:00, 35.81it/s]
 99%|█████████▉| 1745/1754 [00:49<00:00, 35.80it/s]
100%|█████████▉| 1749/1754 [00:49<00:00, 35.81it/s]
100%|█████████▉| 1753/1754 [00:49<00:00, 35.82it/s]
100%|██████████| 1754/1754 [00:50<00:00, 34.98it/s]
INFO:Trainer:2024-13-05 21:38:47:mr: 238.207
INFO:Trainer:2024-13-05 21:38:47:mrr: 0.284
INFO:Trainer:2024-13-05 21:38:47:hits@1: 0.194
INFO:Trainer:2024-13-05 21:38:47:hits@3: 0.317
INFO:Trainer:2024-13-05 21:38:47:hits@10: 0.461
INFO:Trainer:2024-13-05 21:38:47:mr_type: 130.809
INFO:Trainer:2024-13-05 21:38:47:mrr_type: 0.317
INFO:Trainer:2024-13-05 21:38:47:hits@1_type: 0.225
INFO:Trainer:2024-13-05 21:38:47:hits@3_type: 0.35
INFO:Trainer:2024-13-05 21:38:47:hits@10_type: 0.499
INFO:EarlyStopping:2024-13-05 21:38:47:EarlyStopping counter: 2 / 2
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] Send an early stopping signal
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] Epoch 600 | Training checkpoint saved at ../../checkpoint/transr-600.pth
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] Early stopping
INFO:Trainer:2024-13-05 21:38:47:[cuda:1] Early stopping
INFO:Trainer:2024-13-05 21:38:47:[cuda:1] The model training is completed, taking a total of 3706.60175 seconds.
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] The model training is completed, taking a total of 3706.59565 seconds.
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] Model saved at ../../checkpoint/transr.pth.
INFO:Trainer:2024-13-05 21:38:47:[cuda:0] The model starts evaluating in the test set.

  0%|          | 0/2047 [00:00<?, ?it/s]
  0%|          | 1/2047 [00:00<16:52,  2.02it/s]
  0%|          | 5/2047 [00:00<03:20, 10.17it/s]
  0%|          | 9/2047 [00:00<02:02, 16.63it/s]
  1%|          | 13/2047 [00:00<01:34, 21.60it/s]
  1%|          | 17/2047 [00:00<01:20, 25.25it/s]
  1%|          | 21/2047 [00:01<01:12, 27.99it/s]
  1%|          | 25/2047 [00:01<01:07, 29.92it/s]
  1%|▏         | 29/2047 [00:01<01:04, 31.15it/s]
  2%|▏         | 33/2047 [00:01<01:02, 31.97it/s]
  2%|▏         | 37/2047 [00:01<01:01, 32.44it/s]
  2%|▏         | 41/2047 [00:01<01:01, 32.73it/s]
  2%|▏         | 45/2047 [00:01<01:00, 32.91it/s]
  2%|▏         | 49/2047 [00:01<01:00, 33.09it/s]
  3%|▎         | 53/2047 [00:02<01:00, 33.17it/s]
  3%|▎         | 57/2047 [00:02<01:00, 33.13it/s]
  3%|▎         | 61/2047 [00:02<00:59, 33.26it/s]
  3%|▎         | 65/2047 [00:02<00:59, 33.30it/s]
  3%|▎         | 69/2047 [00:02<00:59, 33.28it/s]
  4%|▎         | 73/2047 [00:02<00:59, 33.27it/s]
  4%|▍         | 77/2047 [00:02<00:59, 33.35it/s]
  4%|▍         | 81/2047 [00:02<00:58, 33.40it/s]
  4%|▍         | 85/2047 [00:02<00:58, 33.37it/s]
  4%|▍         | 89/2047 [00:03<00:58, 33.53it/s]
  5%|▍         | 93/2047 [00:03<00:57, 34.03it/s]
  5%|▍         | 97/2047 [00:03<00:56, 34.48it/s]
  5%|▍         | 101/2047 [00:03<00:55, 34.80it/s]
  5%|▌         | 105/2047 [00:03<00:55, 35.04it/s]
  5%|▌         | 109/2047 [00:03<00:55, 35.21it/s]
  6%|▌         | 113/2047 [00:03<00:54, 35.31it/s]
  6%|▌         | 117/2047 [00:03<00:54, 35.31it/s]
  6%|▌         | 121/2047 [00:03<00:54, 35.35it/s]
  6%|▌         | 125/2047 [00:04<00:54, 35.40it/s]
  6%|▋         | 129/2047 [00:04<00:54, 35.43it/s]
  6%|▋         | 133/2047 [00:04<00:53, 35.48it/s]
  7%|▋         | 137/2047 [00:04<00:53, 35.44it/s]
  7%|▋         | 141/2047 [00:04<00:53, 35.46it/s]
  7%|▋         | 145/2047 [00:04<00:53, 35.49it/s]
  7%|▋         | 149/2047 [00:04<00:53, 35.52it/s]
  7%|▋         | 153/2047 [00:04<00:53, 35.53it/s]
  8%|▊         | 157/2047 [00:05<00:53, 35.55it/s]
  8%|▊         | 161/2047 [00:05<00:53, 35.55it/s]
  8%|▊         | 165/2047 [00:05<00:53, 35.45it/s]
  8%|▊         | 169/2047 [00:05<00:52, 35.47it/s]
  8%|▊         | 173/2047 [00:05<00:52, 35.48it/s]
  9%|▊         | 177/2047 [00:05<00:52, 35.52it/s]
  9%|▉         | 181/2047 [00:05<00:52, 35.38it/s]
  9%|▉         | 185/2047 [00:05<00:52, 35.34it/s]
  9%|▉         | 189/2047 [00:05<00:52, 35.41it/s]
  9%|▉         | 193/2047 [00:06<00:52, 35.46it/s]
 10%|▉         | 197/2047 [00:06<00:52, 35.46it/s]
 10%|▉         | 201/2047 [00:06<00:52, 35.44it/s]
 10%|█         | 205/2047 [00:06<00:51, 35.47it/s]
 10%|█         | 209/2047 [00:06<00:51, 35.46it/s]
 10%|█         | 213/2047 [00:06<00:51, 35.50it/s]
 11%|█         | 217/2047 [00:06<00:51, 35.53it/s]
 11%|█         | 221/2047 [00:06<00:51, 35.52it/s]
 11%|█         | 225/2047 [00:06<00:51, 35.50it/s]
 11%|█         | 229/2047 [00:07<00:51, 35.50it/s]
 11%|█▏        | 233/2047 [00:07<00:51, 35.50it/s]
 12%|█▏        | 237/2047 [00:07<00:50, 35.52it/s]
 12%|█▏        | 241/2047 [00:07<00:50, 35.54it/s]
 12%|█▏        | 245/2047 [00:07<00:50, 35.56it/s]
 12%|█▏        | 249/2047 [00:07<00:50, 35.56it/s]
 12%|█▏        | 253/2047 [00:07<00:50, 35.57it/s]
 13%|█▎        | 257/2047 [00:07<00:50, 35.56it/s]
 13%|█▎        | 261/2047 [00:07<00:50, 35.56it/s]
 13%|█▎        | 265/2047 [00:08<00:50, 35.55it/s]
 13%|█▎        | 269/2047 [00:08<00:49, 35.56it/s]
 13%|█▎        | 273/2047 [00:08<00:49, 35.56it/s]
 14%|█▎        | 277/2047 [00:08<00:49, 35.58it/s]
 14%|█▎        | 281/2047 [00:08<00:49, 35.57it/s]
 14%|█▍        | 285/2047 [00:08<00:49, 35.57it/s]
 14%|█▍        | 289/2047 [00:08<00:49, 35.56it/s]
 14%|█▍        | 293/2047 [00:08<00:49, 35.52it/s]
 15%|█▍        | 297/2047 [00:08<00:49, 35.53it/s]
 15%|█▍        | 301/2047 [00:09<00:49, 35.53it/s]
 15%|█▍        | 305/2047 [00:09<00:49, 35.53it/s]
 15%|█▌        | 309/2047 [00:09<00:48, 35.56it/s]
 15%|█▌        | 313/2047 [00:09<00:48, 35.58it/s]
 15%|█▌        | 317/2047 [00:09<00:48, 35.57it/s]
 16%|█▌        | 321/2047 [00:09<00:48, 35.56it/s]
 16%|█▌        | 325/2047 [00:09<00:48, 35.54it/s]
 16%|█▌        | 329/2047 [00:09<00:48, 35.55it/s]
 16%|█▋        | 333/2047 [00:09<00:48, 35.57it/s]
 16%|█▋        | 337/2047 [00:10<00:48, 35.56it/s]
 17%|█▋        | 341/2047 [00:10<00:47, 35.57it/s]
 17%|█▋        | 345/2047 [00:10<00:47, 35.57it/s]
 17%|█▋        | 349/2047 [00:10<00:47, 35.56it/s]
 17%|█▋        | 353/2047 [00:10<00:47, 35.56it/s]
 17%|█▋        | 357/2047 [00:10<00:47, 35.55it/s]
 18%|█▊        | 361/2047 [00:10<00:47, 35.54it/s]
 18%|█▊        | 365/2047 [00:10<00:47, 35.47it/s]
 18%|█▊        | 369/2047 [00:10<00:47, 35.48it/s]
 18%|█▊        | 373/2047 [00:11<00:47, 35.44it/s]
 18%|█▊        | 377/2047 [00:11<00:47, 35.47it/s]
 19%|█▊        | 381/2047 [00:11<00:46, 35.50it/s]
 19%|█▉        | 385/2047 [00:11<00:46, 35.50it/s]
 19%|█▉        | 389/2047 [00:11<00:46, 35.52it/s]
 19%|█▉        | 393/2047 [00:11<00:46, 35.53it/s]
 19%|█▉        | 397/2047 [00:11<00:46, 35.53it/s]
 20%|█▉        | 401/2047 [00:11<00:46, 35.52it/s]
 20%|█▉        | 405/2047 [00:11<00:46, 35.53it/s]
 20%|█▉        | 409/2047 [00:12<00:46, 35.52it/s]
 20%|██        | 413/2047 [00:12<00:46, 35.52it/s]
 20%|██        | 417/2047 [00:12<00:45, 35.53it/s]
 21%|██        | 421/2047 [00:12<00:45, 35.53it/s]
 21%|██        | 425/2047 [00:12<00:45, 35.48it/s]
 21%|██        | 429/2047 [00:12<00:45, 35.50it/s]
 21%|██        | 433/2047 [00:12<00:45, 35.52it/s]
 21%|██▏       | 437/2047 [00:12<00:45, 35.54it/s]
 22%|██▏       | 441/2047 [00:13<00:45, 35.55it/s]
 22%|██▏       | 445/2047 [00:13<00:45, 35.55it/s]
 22%|██▏       | 449/2047 [00:13<00:44, 35.54it/s]
 22%|██▏       | 453/2047 [00:13<00:44, 35.50it/s]
 22%|██▏       | 457/2047 [00:13<00:44, 35.51it/s]
 23%|██▎       | 461/2047 [00:13<00:44, 35.53it/s]
 23%|██▎       | 465/2047 [00:13<00:44, 35.54it/s]
 23%|██▎       | 469/2047 [00:13<00:44, 35.55it/s]
 23%|██▎       | 473/2047 [00:13<00:44, 35.55it/s]
 23%|██▎       | 477/2047 [00:14<00:44, 35.56it/s]
 23%|██▎       | 481/2047 [00:14<00:44, 35.56it/s]
 24%|██▎       | 485/2047 [00:14<00:43, 35.53it/s]
 24%|██▍       | 489/2047 [00:14<00:43, 35.51it/s]
 24%|██▍       | 493/2047 [00:14<00:43, 35.53it/s]
 24%|██▍       | 497/2047 [00:14<00:43, 35.53it/s]
 24%|██▍       | 501/2047 [00:14<00:43, 35.53it/s]
 25%|██▍       | 505/2047 [00:14<00:43, 35.47it/s]
 25%|██▍       | 509/2047 [00:14<00:43, 35.49it/s]
 25%|██▌       | 513/2047 [00:15<00:43, 35.50it/s]
 25%|██▌       | 517/2047 [00:15<00:43, 35.52it/s]
 25%|██▌       | 521/2047 [00:15<00:42, 35.53it/s]
 26%|██▌       | 525/2047 [00:15<00:42, 35.55it/s]
 26%|██▌       | 529/2047 [00:15<00:42, 35.56it/s]
 26%|██▌       | 533/2047 [00:15<00:42, 35.56it/s]
 26%|██▌       | 537/2047 [00:15<00:42, 35.53it/s]
 26%|██▋       | 541/2047 [00:15<00:42, 35.54it/s]
 27%|██▋       | 545/2047 [00:15<00:42, 35.55it/s]
 27%|██▋       | 549/2047 [00:16<00:42, 35.53it/s]
 27%|██▋       | 553/2047 [00:16<00:42, 35.54it/s]
 27%|██▋       | 557/2047 [00:16<00:41, 35.55it/s]
 27%|██▋       | 561/2047 [00:16<00:41, 35.56it/s]
 28%|██▊       | 565/2047 [00:16<00:41, 35.58it/s]
 28%|██▊       | 569/2047 [00:16<00:41, 35.54it/s]
 28%|██▊       | 573/2047 [00:16<00:41, 35.54it/s]
 28%|██▊       | 577/2047 [00:16<00:41, 35.54it/s]
 28%|██▊       | 581/2047 [00:16<00:41, 35.53it/s]
 29%|██▊       | 585/2047 [00:17<00:41, 35.54it/s]
 29%|██▉       | 589/2047 [00:17<00:41, 35.50it/s]
 29%|██▉       | 593/2047 [00:17<00:40, 35.47it/s]
 29%|██▉       | 597/2047 [00:17<00:40, 35.46it/s]
 29%|██▉       | 601/2047 [00:17<00:40, 35.45it/s]
 30%|██▉       | 605/2047 [00:17<00:40, 35.47it/s]
 30%|██▉       | 609/2047 [00:17<00:40, 35.50it/s]
 30%|██▉       | 613/2047 [00:17<00:40, 35.45it/s]
 30%|███       | 617/2047 [00:17<00:40, 35.50it/s]
 30%|███       | 621/2047 [00:18<00:40, 35.53it/s]
 31%|███       | 625/2047 [00:18<00:40, 35.51it/s]
 31%|███       | 629/2047 [00:18<00:39, 35.54it/s]
 31%|███       | 633/2047 [00:18<00:39, 35.55it/s]
 31%|███       | 637/2047 [00:18<00:39, 35.55it/s]
 31%|███▏      | 641/2047 [00:18<00:39, 35.55it/s]
 32%|███▏      | 645/2047 [00:18<00:39, 35.54it/s]
 32%|███▏      | 649/2047 [00:18<00:39, 35.55it/s]
 32%|███▏      | 653/2047 [00:18<00:39, 35.57it/s]
 32%|███▏      | 657/2047 [00:19<00:39, 35.56it/s]
 32%|███▏      | 661/2047 [00:19<00:39, 35.50it/s]
 32%|███▏      | 665/2047 [00:19<00:38, 35.53it/s]
 33%|███▎      | 669/2047 [00:19<00:38, 35.53it/s]
 33%|███▎      | 673/2047 [00:19<00:38, 35.49it/s]
 33%|███▎      | 677/2047 [00:19<00:38, 35.52it/s]
 33%|███▎      | 681/2047 [00:19<00:38, 35.53it/s]
 33%|███▎      | 685/2047 [00:19<00:38, 35.52it/s]
 34%|███▎      | 689/2047 [00:19<00:38, 35.53it/s]
 34%|███▍      | 693/2047 [00:20<00:38, 35.55it/s]
 34%|███▍      | 697/2047 [00:20<00:37, 35.57it/s]
 34%|███▍      | 701/2047 [00:20<00:37, 35.57it/s]
 34%|███▍      | 705/2047 [00:20<00:37, 35.55it/s]
 35%|███▍      | 709/2047 [00:20<00:37, 35.53it/s]
 35%|███▍      | 713/2047 [00:20<00:37, 35.53it/s]
 35%|███▌      | 717/2047 [00:20<00:37, 35.55it/s]
 35%|███▌      | 721/2047 [00:20<00:37, 35.56it/s]
 35%|███▌      | 725/2047 [00:21<00:37, 35.53it/s]
 36%|███▌      | 729/2047 [00:21<00:37, 35.50it/s]
 36%|███▌      | 733/2047 [00:21<00:36, 35.52it/s]
 36%|███▌      | 737/2047 [00:21<00:36, 35.53it/s]
 36%|███▌      | 741/2047 [00:21<00:36, 35.55it/s]
 36%|███▋      | 745/2047 [00:21<00:36, 35.56it/s]
 37%|███▋      | 749/2047 [00:21<00:36, 35.56it/s]
 37%|███▋      | 753/2047 [00:21<00:36, 35.56it/s]
 37%|███▋      | 757/2047 [00:21<00:36, 35.53it/s]
 37%|███▋      | 761/2047 [00:22<00:36, 35.54it/s]
 37%|███▋      | 765/2047 [00:22<00:36, 35.55it/s]
 38%|███▊      | 769/2047 [00:22<00:35, 35.54it/s]
 38%|███▊      | 773/2047 [00:22<00:35, 35.56it/s]
 38%|███▊      | 777/2047 [00:22<00:35, 35.57it/s]
 38%|███▊      | 781/2047 [00:22<00:35, 35.55it/s]
 38%|███▊      | 785/2047 [00:22<00:35, 35.55it/s]
 39%|███▊      | 789/2047 [00:22<00:35, 35.53it/s]
 39%|███▊      | 793/2047 [00:22<00:35, 35.46it/s]
 39%|███▉      | 797/2047 [00:23<00:35, 35.50it/s]
 39%|███▉      | 801/2047 [00:23<00:35, 35.51it/s]
 39%|███▉      | 805/2047 [00:23<00:34, 35.54it/s]
 40%|███▉      | 809/2047 [00:23<00:34, 35.50it/s]
 40%|███▉      | 813/2047 [00:23<00:34, 35.50it/s]
 40%|███▉      | 817/2047 [00:23<00:34, 35.51it/s]
 40%|████      | 821/2047 [00:23<00:34, 35.53it/s]
 40%|████      | 825/2047 [00:23<00:34, 35.52it/s]
 40%|████      | 829/2047 [00:23<00:34, 35.51it/s]
 41%|████      | 833/2047 [00:24<00:34, 35.53it/s]
 41%|████      | 837/2047 [00:24<00:34, 35.52it/s]
 41%|████      | 841/2047 [00:24<00:33, 35.51it/s]
 41%|████▏     | 845/2047 [00:24<00:33, 35.52it/s]
 41%|████▏     | 849/2047 [00:24<00:33, 35.54it/s]
 42%|████▏     | 853/2047 [00:24<00:33, 35.56it/s]
 42%|████▏     | 857/2047 [00:24<00:33, 35.58it/s]
 42%|████▏     | 861/2047 [00:24<00:33, 35.58it/s]
 42%|████▏     | 865/2047 [00:24<00:33, 35.56it/s]
 42%|████▏     | 869/2047 [00:25<00:33, 35.55it/s]
 43%|████▎     | 873/2047 [00:25<00:33, 35.56it/s]
 43%|████▎     | 877/2047 [00:25<00:32, 35.55it/s]
 43%|████▎     | 881/2047 [00:25<00:32, 35.57it/s]
 43%|████▎     | 885/2047 [00:25<00:32, 35.55it/s]
 43%|████▎     | 889/2047 [00:25<00:32, 35.56it/s]
 44%|████▎     | 893/2047 [00:25<00:32, 35.55it/s]
 44%|████▍     | 897/2047 [00:25<00:32, 35.55it/s]
 44%|████▍     | 901/2047 [00:25<00:32, 35.54it/s]
 44%|████▍     | 905/2047 [00:26<00:32, 35.53it/s]
 44%|████▍     | 909/2047 [00:26<00:32, 35.54it/s]
 45%|████▍     | 913/2047 [00:26<00:31, 35.52it/s]
 45%|████▍     | 917/2047 [00:26<00:31, 35.55it/s]
 45%|████▍     | 921/2047 [00:26<00:31, 35.57it/s]
 45%|████▌     | 925/2047 [00:26<00:31, 35.54it/s]
 45%|████▌     | 929/2047 [00:26<00:31, 35.53it/s]
 46%|████▌     | 933/2047 [00:26<00:31, 35.52it/s]
 46%|████▌     | 937/2047 [00:26<00:31, 35.53it/s]
 46%|████▌     | 941/2047 [00:27<00:31, 35.52it/s]
 46%|████▌     | 945/2047 [00:27<00:31, 35.53it/s]
 46%|████▋     | 949/2047 [00:27<00:30, 35.55it/s]
 47%|████▋     | 953/2047 [00:27<00:30, 35.56it/s]
 47%|████▋     | 957/2047 [00:27<00:30, 35.54it/s]
 47%|████▋     | 961/2047 [00:27<00:30, 35.55it/s]
 47%|████▋     | 965/2047 [00:27<00:30, 35.53it/s]
 47%|████▋     | 969/2047 [00:27<00:30, 35.55it/s]
 48%|████▊     | 973/2047 [00:27<00:30, 35.53it/s]
 48%|████▊     | 977/2047 [00:28<00:30, 35.54it/s]
 48%|████▊     | 981/2047 [00:28<00:30, 35.51it/s]
 48%|████▊     | 985/2047 [00:28<00:29, 35.42it/s]
 48%|████▊     | 989/2047 [00:28<00:29, 35.46it/s]
 49%|████▊     | 993/2047 [00:28<00:29, 35.50it/s]
 49%|████▊     | 997/2047 [00:28<00:29, 35.53it/s]
 49%|████▉     | 1001/2047 [00:28<00:29, 35.55it/s]
 49%|████▉     | 1005/2047 [00:28<00:29, 35.53it/s]
 49%|████▉     | 1009/2047 [00:28<00:29, 35.54it/s]
 49%|████▉     | 1013/2047 [00:29<00:29, 35.52it/s]
 50%|████▉     | 1017/2047 [00:29<00:28, 35.54it/s]
 50%|████▉     | 1021/2047 [00:29<00:28, 35.55it/s]
 50%|█████     | 1025/2047 [00:29<00:28, 35.55it/s]
 50%|█████     | 1029/2047 [00:29<00:28, 35.57it/s]
 50%|█████     | 1033/2047 [00:29<00:28, 35.58it/s]
 51%|█████     | 1037/2047 [00:29<00:28, 35.55it/s]
 51%|█████     | 1041/2047 [00:29<00:28, 35.55it/s]
 51%|█████     | 1045/2047 [00:30<00:28, 35.54it/s]
 51%|█████     | 1049/2047 [00:30<00:28, 35.55it/s]
 51%|█████▏    | 1053/2047 [00:30<00:27, 35.56it/s]
 52%|█████▏    | 1057/2047 [00:30<00:27, 35.56it/s]
 52%|█████▏    | 1061/2047 [00:30<00:27, 35.58it/s]
 52%|█████▏    | 1065/2047 [00:30<00:27, 35.57it/s]
 52%|█████▏    | 1069/2047 [00:30<00:27, 35.54it/s]
 52%|█████▏    | 1073/2047 [00:30<00:27, 35.55it/s]
 53%|█████▎    | 1077/2047 [00:30<00:27, 35.46it/s]
 53%|█████▎    | 1081/2047 [00:31<00:27, 35.48it/s]
 53%|█████▎    | 1085/2047 [00:31<00:27, 35.50it/s]
 53%|█████▎    | 1089/2047 [00:31<00:26, 35.52it/s]
 53%|█████▎    | 1093/2047 [00:31<00:26, 35.54it/s]
 54%|█████▎    | 1097/2047 [00:31<00:26, 35.43it/s]
 54%|█████▍    | 1101/2047 [00:31<00:26, 35.48it/s]
 54%|█████▍    | 1105/2047 [00:31<00:26, 35.48it/s]
 54%|█████▍    | 1109/2047 [00:31<00:26, 35.51it/s]
 54%|█████▍    | 1113/2047 [00:31<00:26, 35.54it/s]
 55%|█████▍    | 1117/2047 [00:32<00:26, 35.55it/s]
 55%|█████▍    | 1121/2047 [00:32<00:26, 35.53it/s]
 55%|█████▍    | 1125/2047 [00:32<00:25, 35.52it/s]
 55%|█████▌    | 1129/2047 [00:32<00:25, 35.55it/s]
 55%|█████▌    | 1133/2047 [00:32<00:25, 35.55it/s]
 56%|█████▌    | 1137/2047 [00:32<00:25, 35.56it/s]
 56%|█████▌    | 1141/2047 [00:32<00:25, 35.57it/s]
 56%|█████▌    | 1145/2047 [00:32<00:25, 35.57it/s]
 56%|█████▌    | 1149/2047 [00:32<00:25, 35.54it/s]
 56%|█████▋    | 1153/2047 [00:33<00:25, 35.53it/s]
 57%|█████▋    | 1157/2047 [00:33<00:25, 35.52it/s]
 57%|█████▋    | 1161/2047 [00:33<00:24, 35.54it/s]
 57%|█████▋    | 1165/2047 [00:33<00:24, 35.55it/s]
 57%|█████▋    | 1169/2047 [00:33<00:24, 35.55it/s]
 57%|█████▋    | 1173/2047 [00:33<00:24, 35.56it/s]
 57%|█████▋    | 1177/2047 [00:33<00:24, 35.58it/s]
 58%|█████▊    | 1181/2047 [00:33<00:24, 35.58it/s]
 58%|█████▊    | 1185/2047 [00:33<00:24, 35.56it/s]
 58%|█████▊    | 1189/2047 [00:34<00:24, 35.54it/s]
 58%|█████▊    | 1193/2047 [00:34<00:24, 35.55it/s]
 58%|█████▊    | 1197/2047 [00:34<00:23, 35.56it/s]
 59%|█████▊    | 1201/2047 [00:34<00:23, 35.55it/s]
 59%|█████▉    | 1205/2047 [00:34<00:23, 35.57it/s]
 59%|█████▉    | 1209/2047 [00:34<00:23, 35.58it/s]
 59%|█████▉    | 1213/2047 [00:34<00:23, 35.58it/s]
 59%|█████▉    | 1217/2047 [00:34<00:23, 35.56it/s]
 60%|█████▉    | 1221/2047 [00:34<00:23, 35.52it/s]
 60%|█████▉    | 1225/2047 [00:35<00:23, 35.54it/s]
 60%|██████    | 1229/2047 [00:35<00:23, 35.54it/s]
 60%|██████    | 1233/2047 [00:35<00:22, 35.55it/s]
 60%|██████    | 1237/2047 [00:35<00:22, 35.54it/s]
 61%|██████    | 1241/2047 [00:35<00:22, 35.56it/s]
 61%|██████    | 1245/2047 [00:35<00:22, 35.54it/s]
 61%|██████    | 1249/2047 [00:35<00:22, 35.54it/s]
 61%|██████    | 1253/2047 [00:35<00:22, 35.52it/s]
 61%|██████▏   | 1257/2047 [00:35<00:22, 35.54it/s]
 62%|██████▏   | 1261/2047 [00:36<00:22, 35.54it/s]
 62%|██████▏   | 1265/2047 [00:36<00:21, 35.56it/s]
 62%|██████▏   | 1269/2047 [00:36<00:21, 35.57it/s]
 62%|██████▏   | 1273/2047 [00:36<00:21, 35.59it/s]
 62%|██████▏   | 1277/2047 [00:36<00:21, 35.56it/s]
 63%|██████▎   | 1281/2047 [00:36<00:21, 35.55it/s]
 63%|██████▎   | 1285/2047 [00:36<00:21, 35.54it/s]
 63%|██████▎   | 1289/2047 [00:36<00:21, 35.57it/s]
 63%|██████▎   | 1293/2047 [00:36<00:21, 35.57it/s]
 63%|██████▎   | 1297/2047 [00:37<00:21, 35.57it/s]
 64%|██████▎   | 1301/2047 [00:37<00:20, 35.57it/s]
 64%|██████▍   | 1305/2047 [00:37<00:20, 35.59it/s]
 64%|██████▍   | 1309/2047 [00:37<00:20, 35.56it/s]
 64%|██████▍   | 1313/2047 [00:37<00:20, 35.55it/s]
 64%|██████▍   | 1317/2047 [00:37<00:20, 35.52it/s]
 65%|██████▍   | 1321/2047 [00:37<00:20, 35.49it/s]
 65%|██████▍   | 1325/2047 [00:37<00:20, 35.52it/s]
 65%|██████▍   | 1329/2047 [00:37<00:20, 35.54it/s]
 65%|██████▌   | 1333/2047 [00:38<00:20, 35.55it/s]
 65%|██████▌   | 1337/2047 [00:38<00:19, 35.57it/s]
 66%|██████▌   | 1341/2047 [00:38<00:19, 35.55it/s]
 66%|██████▌   | 1345/2047 [00:38<00:19, 35.55it/s]
 66%|██████▌   | 1349/2047 [00:38<00:19, 35.54it/s]
 66%|██████▌   | 1353/2047 [00:38<00:19, 35.55it/s]
 66%|██████▋   | 1357/2047 [00:38<00:19, 35.57it/s]
 66%|██████▋   | 1361/2047 [00:38<00:19, 35.55it/s]
 67%|██████▋   | 1365/2047 [00:39<00:19, 35.57it/s]
 67%|██████▋   | 1369/2047 [00:39<00:19, 35.58it/s]
 67%|██████▋   | 1373/2047 [00:39<00:18, 35.57it/s]
 67%|██████▋   | 1377/2047 [00:39<00:18, 35.58it/s]
 67%|██████▋   | 1381/2047 [00:39<00:18, 35.51it/s]
 68%|██████▊   | 1385/2047 [00:39<00:18, 35.51it/s]
 68%|██████▊   | 1389/2047 [00:39<00:18, 35.51it/s]
 68%|██████▊   | 1393/2047 [00:39<00:18, 35.52it/s]
 68%|██████▊   | 1397/2047 [00:39<00:18, 35.55it/s]
 68%|██████▊   | 1401/2047 [00:40<00:18, 35.52it/s]
 69%|██████▊   | 1405/2047 [00:40<00:18, 35.51it/s]
 69%|██████▉   | 1409/2047 [00:40<00:17, 35.54it/s]
 69%|██████▉   | 1413/2047 [00:40<00:17, 35.54it/s]
 69%|██████▉   | 1417/2047 [00:40<00:17, 35.54it/s]
 69%|██████▉   | 1421/2047 [00:40<00:17, 35.54it/s]
 70%|██████▉   | 1425/2047 [00:40<00:17, 35.54it/s]
 70%|██████▉   | 1429/2047 [00:40<00:17, 35.51it/s]
 70%|███████   | 1433/2047 [00:40<00:17, 35.53it/s]
 70%|███████   | 1437/2047 [00:41<00:17, 35.51it/s]
 70%|███████   | 1441/2047 [00:41<00:17, 35.50it/s]
 71%|███████   | 1445/2047 [00:41<00:16, 35.51it/s]
 71%|███████   | 1449/2047 [00:41<00:16, 35.54it/s]
 71%|███████   | 1453/2047 [00:41<00:16, 35.52it/s]
 71%|███████   | 1457/2047 [00:41<00:16, 35.54it/s]
 71%|███████▏  | 1461/2047 [00:41<00:16, 35.52it/s]
 72%|███████▏  | 1465/2047 [00:41<00:16, 35.55it/s]
 72%|███████▏  | 1469/2047 [00:41<00:16, 35.54it/s]
 72%|███████▏  | 1473/2047 [00:42<00:16, 35.56it/s]
 72%|███████▏  | 1477/2047 [00:42<00:16, 35.52it/s]
 72%|███████▏  | 1481/2047 [00:42<00:15, 35.51it/s]
 73%|███████▎  | 1485/2047 [00:42<00:15, 35.48it/s]
 73%|███████▎  | 1489/2047 [00:42<00:15, 35.51it/s]
 73%|███████▎  | 1493/2047 [00:42<00:15, 35.50it/s]
 73%|███████▎  | 1497/2047 [00:42<00:15, 35.53it/s]
 73%|███████▎  | 1501/2047 [00:42<00:15, 35.54it/s]
 74%|███████▎  | 1505/2047 [00:42<00:15, 35.54it/s]
 74%|███████▎  | 1509/2047 [00:43<00:15, 35.56it/s]
 74%|███████▍  | 1513/2047 [00:43<00:15, 35.57it/s]
 74%|███████▍  | 1517/2047 [00:43<00:14, 35.57it/s]
 74%|███████▍  | 1521/2047 [00:43<00:14, 35.57it/s]
 74%|███████▍  | 1525/2047 [00:43<00:14, 35.54it/s]
 75%|███████▍  | 1529/2047 [00:43<00:14, 35.56it/s]
 75%|███████▍  | 1533/2047 [00:43<00:14, 35.57it/s]
 75%|███████▌  | 1537/2047 [00:43<00:14, 35.57it/s]
 75%|███████▌  | 1541/2047 [00:43<00:14, 35.54it/s]
 75%|███████▌  | 1545/2047 [00:44<00:14, 35.55it/s]
 76%|███████▌  | 1549/2047 [00:44<00:14, 35.50it/s]
 76%|███████▌  | 1553/2047 [00:44<00:13, 35.49it/s]
 76%|███████▌  | 1557/2047 [00:44<00:13, 35.53it/s]
 76%|███████▋  | 1561/2047 [00:44<00:13, 35.55it/s]
 76%|███████▋  | 1565/2047 [00:44<00:13, 35.55it/s]
 77%|███████▋  | 1569/2047 [00:44<00:13, 35.55it/s]
 77%|███████▋  | 1573/2047 [00:44<00:13, 35.50it/s]
 77%|███████▋  | 1577/2047 [00:44<00:13, 35.50it/s]
 77%|███████▋  | 1581/2047 [00:45<00:13, 35.49it/s]
 77%|███████▋  | 1585/2047 [00:45<00:13, 35.51it/s]
 78%|███████▊  | 1589/2047 [00:45<00:12, 35.54it/s]
 78%|███████▊  | 1593/2047 [00:45<00:12, 35.56it/s]
 78%|███████▊  | 1597/2047 [00:45<00:12, 35.56it/s]
 78%|███████▊  | 1601/2047 [00:45<00:12, 35.57it/s]
 78%|███████▊  | 1605/2047 [00:45<00:12, 35.52it/s]
 79%|███████▊  | 1609/2047 [00:45<00:12, 35.54it/s]
 79%|███████▉  | 1613/2047 [00:45<00:12, 35.54it/s]
 79%|███████▉  | 1617/2047 [00:46<00:12, 35.55it/s]
 79%|███████▉  | 1621/2047 [00:46<00:12, 35.48it/s]
 79%|███████▉  | 1625/2047 [00:46<00:11, 35.51it/s]
 80%|███████▉  | 1629/2047 [00:46<00:11, 35.49it/s]
 80%|███████▉  | 1633/2047 [00:46<00:11, 35.51it/s]
 80%|███████▉  | 1637/2047 [00:46<00:11, 35.53it/s]
 80%|████████  | 1641/2047 [00:46<00:11, 35.55it/s]
 80%|████████  | 1645/2047 [00:46<00:11, 35.55it/s]
 81%|████████  | 1649/2047 [00:47<00:11, 35.54it/s]
 81%|████████  | 1653/2047 [00:47<00:11, 35.52it/s]
 81%|████████  | 1657/2047 [00:47<00:10, 35.51it/s]
 81%|████████  | 1661/2047 [00:47<00:10, 35.53it/s]
 81%|████████▏ | 1665/2047 [00:47<00:10, 35.55it/s]
 82%|████████▏ | 1669/2047 [00:47<00:10, 35.55it/s]
 82%|████████▏ | 1673/2047 [00:47<00:10, 35.56it/s]
 82%|████████▏ | 1677/2047 [00:47<00:10, 35.55it/s]
 82%|████████▏ | 1681/2047 [00:47<00:10, 35.53it/s]
 82%|████████▏ | 1685/2047 [00:48<00:10, 35.50it/s]
 83%|████████▎ | 1689/2047 [00:48<00:10, 35.53it/s]
 83%|████████▎ | 1693/2047 [00:48<00:09, 35.55it/s]
 83%|████████▎ | 1697/2047 [00:48<00:09, 35.56it/s]
 83%|████████▎ | 1701/2047 [00:48<00:09, 35.56it/s]
 83%|████████▎ | 1705/2047 [00:48<00:09, 35.57it/s]
 83%|████████▎ | 1709/2047 [00:48<00:09, 35.56it/s]
 84%|████████▎ | 1713/2047 [00:48<00:09, 35.54it/s]
 84%|████████▍ | 1717/2047 [00:48<00:09, 35.52it/s]
 84%|████████▍ | 1721/2047 [00:49<00:09, 35.54it/s]
 84%|████████▍ | 1725/2047 [00:49<00:09, 35.55it/s]
 84%|████████▍ | 1729/2047 [00:49<00:08, 35.57it/s]
 85%|████████▍ | 1733/2047 [00:49<00:08, 35.57it/s]
 85%|████████▍ | 1737/2047 [00:49<00:08, 35.58it/s]
 85%|████████▌ | 1741/2047 [00:49<00:08, 35.56it/s]
 85%|████████▌ | 1745/2047 [00:49<00:08, 35.57it/s]
 85%|████████▌ | 1749/2047 [00:49<00:08, 35.54it/s]
 86%|████████▌ | 1753/2047 [00:49<00:08, 35.55it/s]
 86%|████████▌ | 1757/2047 [00:50<00:08, 35.52it/s]
 86%|████████▌ | 1761/2047 [00:50<00:08, 35.54it/s]
 86%|████████▌ | 1765/2047 [00:50<00:07, 35.56it/s]
 86%|████████▋ | 1769/2047 [00:50<00:07, 35.58it/s]
 87%|████████▋ | 1773/2047 [00:50<00:07, 35.56it/s]
 87%|████████▋ | 1777/2047 [00:50<00:07, 35.55it/s]
 87%|████████▋ | 1781/2047 [00:50<00:07, 35.53it/s]
 87%|████████▋ | 1785/2047 [00:50<00:07, 35.52it/s]
 87%|████████▋ | 1789/2047 [00:50<00:07, 35.53it/s]
 88%|████████▊ | 1793/2047 [00:51<00:07, 35.55it/s]
 88%|████████▊ | 1797/2047 [00:51<00:07, 35.56it/s]
 88%|████████▊ | 1801/2047 [00:51<00:06, 35.56it/s]
 88%|████████▊ | 1805/2047 [00:51<00:06, 35.56it/s]
 88%|████████▊ | 1809/2047 [00:51<00:06, 35.54it/s]
 89%|████████▊ | 1813/2047 [00:51<00:06, 35.53it/s]
 89%|████████▉ | 1817/2047 [00:51<00:06, 35.50it/s]
 89%|████████▉ | 1821/2047 [00:51<00:06, 35.52it/s]
 89%|████████▉ | 1825/2047 [00:51<00:06, 35.54it/s]
 89%|████████▉ | 1829/2047 [00:52<00:06, 35.51it/s]
 90%|████████▉ | 1833/2047 [00:52<00:06, 35.53it/s]
 90%|████████▉ | 1837/2047 [00:52<00:05, 35.53it/s]
 90%|████████▉ | 1841/2047 [00:52<00:05, 35.51it/s]
 90%|█████████ | 1845/2047 [00:52<00:05, 35.53it/s]
 90%|█████████ | 1849/2047 [00:52<00:05, 35.55it/s]
 91%|█████████ | 1853/2047 [00:52<00:05, 35.56it/s]
 91%|█████████ | 1857/2047 [00:52<00:05, 35.56it/s]
 91%|█████████ | 1861/2047 [00:52<00:05, 35.51it/s]
 91%|█████████ | 1865/2047 [00:53<00:05, 35.53it/s]
 91%|█████████▏| 1869/2047 [00:53<00:05, 35.55it/s]
 91%|█████████▏| 1873/2047 [00:53<00:04, 35.54it/s]
 92%|█████████▏| 1877/2047 [00:53<00:04, 35.55it/s]
 92%|█████████▏| 1881/2047 [00:53<00:04, 35.57it/s]
 92%|█████████▏| 1885/2047 [00:53<00:04, 35.54it/s]
 92%|█████████▏| 1889/2047 [00:53<00:04, 35.55it/s]
 92%|█████████▏| 1893/2047 [00:53<00:04, 35.57it/s]
 93%|█████████▎| 1897/2047 [00:53<00:04, 35.57it/s]
 93%|█████████▎| 1901/2047 [00:54<00:04, 35.56it/s]
 93%|█████████▎| 1905/2047 [00:54<00:03, 35.53it/s]
 93%|█████████▎| 1909/2047 [00:54<00:03, 35.55it/s]
 93%|█████████▎| 1913/2047 [00:54<00:03, 35.57it/s]
 94%|█████████▎| 1917/2047 [00:54<00:03, 35.56it/s]
 94%|█████████▍| 1921/2047 [00:54<00:03, 35.56it/s]
 94%|█████████▍| 1925/2047 [00:54<00:03, 35.56it/s]
 94%|█████████▍| 1929/2047 [00:54<00:03, 35.58it/s]
 94%|█████████▍| 1933/2047 [00:54<00:03, 35.57it/s]
 95%|█████████▍| 1937/2047 [00:55<00:03, 35.58it/s]
 95%|█████████▍| 1941/2047 [00:55<00:02, 35.56it/s]
 95%|█████████▌| 1945/2047 [00:55<00:02, 35.56it/s]
 95%|█████████▌| 1949/2047 [00:55<00:02, 35.56it/s]
 95%|█████████▌| 1953/2047 [00:55<00:02, 35.57it/s]
 96%|█████████▌| 1957/2047 [00:55<00:02, 35.51it/s]
 96%|█████████▌| 1961/2047 [00:55<00:02, 35.53it/s]
 96%|█████████▌| 1965/2047 [00:55<00:02, 35.56it/s]
 96%|█████████▌| 1969/2047 [00:56<00:02, 35.56it/s]
 96%|█████████▋| 1973/2047 [00:56<00:02, 35.54it/s]
 97%|█████████▋| 1977/2047 [00:56<00:01, 35.55it/s]
 97%|█████████▋| 1981/2047 [00:56<00:01, 35.55it/s]
 97%|█████████▋| 1985/2047 [00:56<00:01, 35.56it/s]
 97%|█████████▋| 1989/2047 [00:56<00:01, 35.57it/s]
 97%|█████████▋| 1993/2047 [00:56<00:01, 35.57it/s]
 98%|█████████▊| 1997/2047 [00:56<00:01, 35.57it/s]
 98%|█████████▊| 2001/2047 [00:56<00:01, 35.58it/s]
 98%|█████████▊| 2005/2047 [00:57<00:01, 35.56it/s]
 98%|█████████▊| 2009/2047 [00:57<00:01, 35.56it/s]
 98%|█████████▊| 2013/2047 [00:57<00:00, 35.57it/s]
 99%|█████████▊| 2017/2047 [00:57<00:00, 35.61it/s]
 99%|█████████▊| 2021/2047 [00:57<00:00, 35.67it/s]
 99%|█████████▉| 2025/2047 [00:57<00:00, 35.72it/s]
 99%|█████████▉| 2029/2047 [00:57<00:00, 35.74it/s]
 99%|█████████▉| 2033/2047 [00:57<00:00, 35.76it/s]
100%|█████████▉| 2037/2047 [00:57<00:00, 35.78it/s]
100%|█████████▉| 2041/2047 [00:58<00:00, 35.79it/s]
100%|█████████▉| 2045/2047 [00:58<00:00, 35.80it/s]
100%|██████████| 2047/2047 [00:58<00:00, 35.11it/s]
INFO:Trainer:2024-13-05 21:39:45:mr: 245.189
INFO:Trainer:2024-13-05 21:39:45:mrr: 0.282
INFO:Trainer:2024-13-05 21:39:45:hits@1: 0.193
INFO:Trainer:2024-13-05 21:39:45:hits@3: 0.315
INFO:Trainer:2024-13-05 21:39:45:hits@10: 0.458
INFO:Trainer:2024-13-05 21:39:45:mr_type: 133.345
INFO:Trainer:2024-13-05 21:39:45:mrr_type: 0.314
INFO:Trainer:2024-13-05 21:39:45:hits@1_type: 0.222
INFO:Trainer:2024-13-05 21:39:45:hits@3_type: 0.347
INFO:Trainer:2024-13-05 21:39:45:hits@10_type: 0.494