DEBUG:cmd:2024-05-18 20:23:29:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:cmd:2024-05-18 20:23:29:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:connectionpool:2024-05-18 20:23:30:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:23:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:23:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Currently logged in as: 3555028709. Use `wandb login --relogin` to force relogin DEBUG:connectionpool:2024-05-18 20:23:31:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:23:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:pyagent:2024-05-18 20:23:39:Starting sweep agent: entity=None, project=None, count=3 DEBUG:pyagent:2024-05-18 20:23:39:Agent._setup() DEBUG:pyagent:2024-05-18 20:23:39:Agent._register() DEBUG:connectionpool:2024-05-18 20:23:39:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:23:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:pyagent:2024-05-18 20:23:40:agent_id = QWdlbnQ6bXVtNmtmM3Y= DEBUG:connectionpool:2024-05-18 20:23:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:pyagent:2024-05-18 20:23:40:Job received: Job(zbq6noyk,{'adv_temperature': {'value': 3}, 'batch_size': {'value': 512}, 'dataloader': {'value': 'KGEDataLoader'}, 'delta': {'value': 0.0001}, 'device': {'value': 'cuda:0'}, 'dim': {'value': 50}, 'ent_file': {'value': 'entity2id.txt'}, 'epochs': {'value': 10000}, 'in_path': {'value': '../../benchmarks/WN18RR/'}, 'l3_regul_rate': {'value': 0}, 'log_interval': {'value': 100}, 'loss': {'value': 'SoftplusLoss'}, 'lr': {'value': 0.5328969370662224}, 'metric': {'value': 'hits@10'}, 'model': {'value': 'HolE'}, 'neg_ent': {'value': 16}, 'num_workers': {'value': 16}, 'opt_method': {'value': 'sgd'}, 'patience': {'value': 2}, 'prediction': {'value': 'all'}, 'regul_rate': {'value': 0}, 'rel_file': {'value': 'relation2id.txt'}, 'save_path': {'value': './model.pth'}, 'strategy': {'value': 'NegativeSampling'}, 'test_batch_size': {'value': 30}, 'test_file': {'value': 'test2id.txt'}, 'test_sampler': {'value': 'TradTestSampler'}, 'tester': {'value': 'Tester'}, 'train_file': {'value': 'train2id.txt'}, 'train_sampler': {'value': 'BernSampler'}, 'trainer': {'value': 'Trainer'}, 'type_constrain': {'value': True}, 'use_early_stopping': {'value': True}, 'use_gpu': {'value': True}, 'use_tqdm': {'value': False}, 'valid_file': {'value': 'valid2id.txt'}, 'valid_interval': {'value': 100}}) DEBUG:pyagent:2024-05-18 20:23:40:Spawning new thread for run zbq6noyk. wandb: Agent Starting Run: zbq6noyk with config: wandb: adv_temperature: 3 wandb: batch_size: 512 wandb: dataloader: KGEDataLoader wandb: delta: 0.0001 wandb: device: cuda:0 wandb: dim: 50 wandb: ent_file: entity2id.txt wandb: epochs: 10000 wandb: in_path: ../../benchmarks/WN18RR/ wandb: l3_regul_rate: 0 wandb: log_interval: 100 wandb: loss: SoftplusLoss wandb: lr: 0.5328969370662224 wandb: metric: hits@10 wandb: model: HolE wandb: neg_ent: 16 wandb: num_workers: 16 wandb: opt_method: sgd wandb: patience: 2 wandb: prediction: all wandb: regul_rate: 0 wandb: rel_file: relation2id.txt wandb: save_path: ./model.pth wandb: strategy: NegativeSampling wandb: test_batch_size: 30 wandb: test_file: test2id.txt wandb: test_sampler: TradTestSampler wandb: tester: Tester wandb: train_file: train2id.txt wandb: train_sampler: BernSampler wandb: trainer: Trainer wandb: type_constrain: True wandb: use_early_stopping: True wandb: use_gpu: True wandb: use_tqdm: False wandb: valid_file: valid2id.txt wandb: valid_interval: 100 DEBUG:cmd:2024-05-18 20:23:41:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:cmd:2024-05-18 20:23:41:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:connectionpool:2024-05-18 20:23:41:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:23:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:23:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:cmd:2024-05-18 20:23:42:Popen(['git', 'cat-file', '--batch-check'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=, shell=False, universal_newlines=False) wandb: wandb version 0.17.0 is available! To upgrade, please run: wandb: $ pip install wandb --upgrade wandb: Tracking run with wandb version 0.16.6 wandb: Run data is saved locally in /home/luyanfeng/my_code/github/pybind11-OpenKE/examples/HolE/wandb/run-20240518_202342-zbq6noyk wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run stellar-sweep-1 wandb: โญ๏ธ View project at https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: ๐Ÿงน View sweep at https://wandb.ai/3555028709/pybind11-ke-sweeps/sweeps/cid6trdk wandb: ๐Ÿš€ View run at https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/zbq6noyk DEBUG:connectionpool:2024-05-18 20:23:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:23:46:[cuda:0] Initialization completed, start model training. data_loader_config: {'batch_size': {'values': [512, 1024, 2048, 4096]}, 'dataloader': {'value': 'KGEDataLoader'}, 'ent_file': {'value': 'entity2id.txt'}, 'in_path': {'value': './'}, 'neg_ent': {'values': [1, 4, 16, 64]}, 'num_workers': {'value': 16}, 'rel_file': {'value': 'relation2id.txt'}, 'test_batch_size': {'value': 30}, 'test_file': {'value': 'test2id.txt'}, 'test_sampler': {'value': 'TradTestSampler'}, 'train_file': {'value': 'train2id.txt'}, 'train_sampler': {'value': 'BernSampler'}, 'type_constrain': {'value': True}, 'valid_file': {'value': 'valid2id.txt'}} kge_config: {'dim': {'values': [50, 100, 200]}, 'model': {'value': 'HolE'}} loss_config: {'adv_temperature': {'values': [1.0, 3.0, 6.0]}, 'loss': {'value': 'SoftplusLoss'}} strategy_config: {'l3_regul_rate': {'value': 0.0}, 'regul_rate': {'value': 0.0}, 'strategy': {'value': 'NegativeSampling'}} tester_config: {'device': {'value': 'cuda:0'}, 'prediction': {'value': 'all'}, 'tester': {'value': 'Tester'}, 'use_gpu': {'value': True}, 'use_tqdm': {'value': False}} trainer_config: {'delta': {'value': 0.0001}, 'epochs': {'value': 10000}, 'log_interval': {'value': 100}, 'lr': {'distribution': 'uniform', 'max': 1.0, 'min': 1e-05}, 'metric': {'value': 'hits@10'}, 'opt_method': {'values': ['adam', 'adagrad', 'sgd']}, 'patience': {'value': 2}, 'save_path': {'value': './model.pth'}, 'trainer': {'value': 'Trainer'}, 'use_early_stopping': {'value': True}, 'valid_interval': {'value': 100}} sweep_config: {'method': 'bayes', 'metric': {'goal': 'maximize', 'name': 'val/hits@10'}, 'name': 'HolE_WN18RR', 'parameters': {'adv_temperature': {'values': [1.0, 3.0, 6.0]}, 'batch_size': {'values': [512, 1024, 2048, 4096]}, 'dataloader': {'value': 'KGEDataLoader'}, 'delta': {'value': 0.0001}, 'device': {'value': 'cuda:0'}, 'dim': {'values': [50, 100, 200]}, 'ent_file': {'value': 'entity2id.txt'}, 'epochs': {'value': 10000}, 'in_path': {'value': '../../benchmarks/WN18RR/'}, 'l3_regul_rate': {'value': 0.0}, 'log_interval': {'value': 100}, 'loss': {'value': 'SoftplusLoss'}, 'lr': {'distribution': 'uniform', 'max': 1.0, 'min': 1e-05}, 'metric': {'value': 'hits@10'}, 'model': {'value': 'HolE'}, 'neg_ent': {'values': [1, 4, 16, 64]}, 'num_workers': {'value': 16}, 'opt_method': {'values': ['adam', 'adagrad', 'sgd']}, 'patience': {'value': 2}, 'prediction': {'value': 'all'}, 'regul_rate': {'value': 0.0}, 'rel_file': {'value': 'relation2id.txt'}, 'save_path': {'value': './model.pth'}, 'strategy': {'value': 'NegativeSampling'}, 'test_batch_size': {'value': 30}, 'test_file': {'value': 'test2id.txt'}, 'test_sampler': {'value': 'TradTestSampler'}, 'tester': {'value': 'Tester'}, 'train_file': {'value': 'train2id.txt'}, 'train_sampler': {'value': 'BernSampler'}, 'trainer': {'value': 'Trainer'}, 'type_constrain': {'value': True}, 'use_early_stopping': {'value': True}, 'use_gpu': {'value': True}, 'use_tqdm': {'value': False}, 'valid_file': {'value': 'valid2id.txt'}, 'valid_interval': {'value': 100}}} Create sweep with ID: cid6trdk Sweep URL: https://wandb.ai/3555028709/pybind11-ke-sweeps/sweeps/cid6trdk wandb: Network error (TransientError), entering retry loop. DEBUG:connectionpool:2024-05-18 20:23:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:23:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:24:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:25:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:26:48:[cuda:0] Epoch 100 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:26:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:26:50:mr: 9694.297 INFO:Trainer:2024-05-18 20:26:50:mrr: 0.129 INFO:Trainer:2024-05-18 20:26:50:hits@1: 0.072 INFO:Trainer:2024-05-18 20:26:50:hits@3: 0.146 INFO:Trainer:2024-05-18 20:26:50:hits@10: 0.257 INFO:Trainer:2024-05-18 20:26:50:mr_type: 3436.417 INFO:Trainer:2024-05-18 20:26:50:mrr_type: 0.138 INFO:Trainer:2024-05-18 20:26:50:hits@1_type: 0.077 INFO:Trainer:2024-05-18 20:26:50:hits@3_type: 0.156 INFO:Trainer:2024-05-18 20:26:50:hits@10_type: 0.271 INFO:EarlyStopping:2024-05-18 20:26:50:Validation score improved (-inf --> 0.257000). Saving model ... INFO:Trainer:2024-05-18 20:26:50:[cuda:0] Epoch [ 100/10000] | Batchsize: 512 | loss: 38.770856 | 1.81282 seconds/epoch DEBUG:connectionpool:2024-05-18 20:26:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:26:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:47:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:27:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:08:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:13:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:28:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:00:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:29:45:[cuda:0] Epoch 200 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:29:46:mr: 9617.892 INFO:Trainer:2024-05-18 20:29:46:mrr: 0.315 INFO:Trainer:2024-05-18 20:29:46:hits@1: 0.269 INFO:Trainer:2024-05-18 20:29:46:hits@3: 0.353 INFO:Trainer:2024-05-18 20:29:46:hits@10: 0.381 INFO:Trainer:2024-05-18 20:29:46:mr_type: 3104.772 INFO:Trainer:2024-05-18 20:29:46:mrr_type: 0.328 INFO:Trainer:2024-05-18 20:29:46:hits@1_type: 0.28 INFO:Trainer:2024-05-18 20:29:46:hits@3_type: 0.364 INFO:Trainer:2024-05-18 20:29:46:hits@10_type: 0.394 INFO:EarlyStopping:2024-05-18 20:29:46:Validation score improved (0.257000 --> 0.381000). Saving model ... INFO:Trainer:2024-05-18 20:29:46:[cuda:0] Epoch [ 200/10000] | Batchsize: 512 | loss: 4.682249 | 1.79114 seconds/epoch DEBUG:connectionpool:2024-05-18 20:29:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:29:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:30:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:31:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:32:38:[cuda:0] Epoch 300 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:32:40:mr: 9741.674 INFO:Trainer:2024-05-18 20:32:40:mrr: 0.335 INFO:Trainer:2024-05-18 20:32:40:hits@1: 0.299 INFO:Trainer:2024-05-18 20:32:40:hits@3: 0.364 INFO:Trainer:2024-05-18 20:32:40:hits@10: 0.384 INFO:Trainer:2024-05-18 20:32:40:mr_type: 3057.02 INFO:Trainer:2024-05-18 20:32:40:mrr_type: 0.346 INFO:Trainer:2024-05-18 20:32:40:hits@1_type: 0.308 INFO:Trainer:2024-05-18 20:32:40:hits@3_type: 0.373 INFO:Trainer:2024-05-18 20:32:40:hits@10_type: 0.399 INFO:EarlyStopping:2024-05-18 20:32:40:Validation score improved (0.381000 --> 0.384000). Saving model ... INFO:Trainer:2024-05-18 20:32:40:[cuda:0] Epoch [ 300/10000] | Batchsize: 512 | loss: 2.642386 | 1.77225 seconds/epoch DEBUG:connectionpool:2024-05-18 20:32:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:32:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:33:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:34:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:35:32:[cuda:0] Epoch 400 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:35:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:35:33:mr: 9751.269 INFO:Trainer:2024-05-18 20:35:33:mrr: 0.352 INFO:Trainer:2024-05-18 20:35:33:hits@1: 0.331 INFO:Trainer:2024-05-18 20:35:33:hits@3: 0.366 INFO:Trainer:2024-05-18 20:35:33:hits@10: 0.38 INFO:Trainer:2024-05-18 20:35:33:mr_type: 3015.102 INFO:Trainer:2024-05-18 20:35:33:mrr_type: 0.362 INFO:Trainer:2024-05-18 20:35:33:hits@1_type: 0.339 INFO:Trainer:2024-05-18 20:35:33:hits@3_type: 0.374 INFO:Trainer:2024-05-18 20:35:33:hits@10_type: 0.396 INFO:EarlyStopping:2024-05-18 20:35:33:EarlyStopping counter: 1 / 2 INFO:Trainer:2024-05-18 20:35:33:[cuda:0] Epoch [ 400/10000] | Batchsize: 512 | loss: 1.744126 | 1.76321 seconds/epoch DEBUG:connectionpool:2024-05-18 20:35:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:35:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:36:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:37:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:38:25:[cuda:0] Epoch 500 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:38:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:38:26:mr: 9827.921 INFO:Trainer:2024-05-18 20:38:26:mrr: 0.351 INFO:Trainer:2024-05-18 20:38:26:hits@1: 0.331 INFO:Trainer:2024-05-18 20:38:26:hits@3: 0.366 INFO:Trainer:2024-05-18 20:38:26:hits@10: 0.379 INFO:Trainer:2024-05-18 20:38:26:mr_type: 3002.084 INFO:Trainer:2024-05-18 20:38:26:mrr_type: 0.363 INFO:Trainer:2024-05-18 20:38:26:hits@1_type: 0.339 INFO:Trainer:2024-05-18 20:38:26:hits@3_type: 0.376 INFO:Trainer:2024-05-18 20:38:26:hits@10_type: 0.396 INFO:EarlyStopping:2024-05-18 20:38:26:EarlyStopping counter: 2 / 2 INFO:Trainer:2024-05-18 20:38:26:[cuda:0] Send an early stopping signal INFO:Trainer:2024-05-18 20:38:26:[cuda:0] The model training is completed, taking a total of 878.22604 seconds. INFO:Trainer:2024-05-18 20:38:26:[cuda:0] Model saved at ./model.pth. INFO:Trainer:2024-05-18 20:38:26:[cuda:0] The model starts evaluating in the test set. INFO:Trainer:2024-05-18 20:38:28:mr: 9788.055 INFO:Trainer:2024-05-18 20:38:28:mrr: 0.348 INFO:Trainer:2024-05-18 20:38:28:hits@1: 0.327 INFO:Trainer:2024-05-18 20:38:28:hits@3: 0.363 INFO:Trainer:2024-05-18 20:38:28:hits@10: 0.375 INFO:Trainer:2024-05-18 20:38:28:mr_type: 3017.081 INFO:Trainer:2024-05-18 20:38:28:mrr_type: 0.36 INFO:Trainer:2024-05-18 20:38:28:hits@1_type: 0.338 INFO:Trainer:2024-05-18 20:38:28:hits@3_type: 0.372 INFO:Trainer:2024-05-18 20:38:28:hits@10_type: 0.389 DEBUG:connectionpool:2024-05-18 20:38:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: - 0.014 MB of 0.014 MB uploaded wandb: \ 0.014 MB of 0.043 MB uploaded wandb: | 0.022 MB of 0.043 MB uploaded wandb: / 0.022 MB of 0.043 MB uploaded wandb: - 0.043 MB of 0.043 MB uploaded wandb: wandb: wandb: Run history: wandb: duration โ– wandb: test/hits@1 โ– wandb: test/hits@10 โ– wandb: test/hits@10_type โ– wandb: test/hits@1_type โ– wandb: test/hits@3 โ– wandb: test/hits@3_type โ– wandb: test/mr โ– wandb: test/mr_type โ– wandb: test/mrr โ– wandb: test/mrr_type โ– wandb: train/epoch โ–โ–ƒโ–†โ–ˆ wandb: train/train_loss โ–ˆโ–‚โ–โ– wandb: val/epoch โ–โ–ƒโ–…โ–†โ–ˆ wandb: val/hits@1 โ–โ–†โ–‡โ–ˆโ–ˆ wandb: val/hits@10 โ–โ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/hits@10_type โ–โ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/hits@1_type โ–โ–†โ–‡โ–ˆโ–ˆ wandb: val/hits@3 โ–โ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/hits@3_type โ–โ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/mr โ–„โ–โ–…โ–…โ–ˆ wandb: val/mr_type โ–ˆโ–ƒโ–‚โ–โ– wandb: val/mrr โ–โ–‡โ–‡โ–ˆโ–ˆ wandb: val/mrr_type โ–โ–‡โ–‡โ–ˆโ–ˆ wandb: wandb: Run summary: wandb: duration 878.22604 wandb: test/hits@1 0.327 wandb: test/hits@10 0.375 wandb: test/hits@10_type 0.389 wandb: test/hits@1_type 0.338 wandb: test/hits@3 0.363 wandb: test/hits@3_type 0.372 wandb: test/mr 9788.055 wandb: test/mr_type 3017.081 wandb: test/mrr 0.348 wandb: test/mrr_type 0.36 wandb: train/epoch 400 wandb: train/train_loss 1.74413 wandb: val/epoch 499 wandb: val/hits@1 0.331 wandb: val/hits@10 0.379 wandb: val/hits@10_type 0.396 wandb: val/hits@1_type 0.339 wandb: val/hits@3 0.366 wandb: val/hits@3_type 0.376 wandb: val/mr 9827.921 wandb: val/mr_type 3002.084 wandb: val/mrr 0.351 wandb: val/mrr_type 0.363 wandb: wandb: ๐Ÿš€ View run stellar-sweep-1 at: https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/zbq6noyk wandb: โญ๏ธ View project at: https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: Synced 5 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s) wandb: Find logs at: ./wandb/run-20240518_202342-zbq6noyk/logs DEBUG:connectionpool:2024-05-18 20:38:34:Starting new HTTPS connection (1): o151352.ingest.sentry.io:443 DEBUG:connectionpool:2024-05-18 20:38:35:https://o151352.ingest.sentry.io:443 "POST /api/4504800232407040/envelope/ HTTP/1.1" 200 0 DEBUG:connectionpool:2024-05-18 20:38:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Sweep Agent: Waiting for job. DEBUG:connectionpool:2024-05-18 20:38:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Job received. DEBUG:connectionpool:2024-05-18 20:38:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Agent Starting Run: z7hc6ilv with config: wandb: adv_temperature: 6 wandb: batch_size: 512 wandb: dataloader: KGEDataLoader wandb: delta: 0.0001 wandb: device: cuda:0 wandb: dim: 50 wandb: ent_file: entity2id.txt wandb: epochs: 10000 wandb: in_path: ../../benchmarks/WN18RR/ wandb: l3_regul_rate: 0 wandb: log_interval: 100 wandb: loss: SoftplusLoss wandb: lr: 0.700422777193089 wandb: metric: hits@10 wandb: model: HolE wandb: neg_ent: 16 wandb: num_workers: 16 wandb: opt_method: sgd wandb: patience: 2 wandb: prediction: all wandb: regul_rate: 0 wandb: rel_file: relation2id.txt wandb: save_path: ./model.pth wandb: strategy: NegativeSampling wandb: test_batch_size: 30 wandb: test_file: test2id.txt wandb: test_sampler: TradTestSampler wandb: tester: Tester wandb: train_file: train2id.txt wandb: train_sampler: BernSampler wandb: trainer: Trainer wandb: type_constrain: True wandb: use_early_stopping: True wandb: use_gpu: True wandb: use_tqdm: False wandb: valid_file: valid2id.txt wandb: valid_interval: 100 DEBUG:cmd:2024-05-18 20:38:47:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:cmd:2024-05-18 20:38:47:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:connectionpool:2024-05-18 20:38:47:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:38:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:cmd:2024-05-18 20:38:48:Popen(['git', 'cat-file', '--batch-check'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=, shell=False, universal_newlines=False) wandb: - Waiting for wandb.init()... wandb: \ Waiting for wandb.init()... wandb: wandb version 0.17.0 is available! To upgrade, please run: wandb: $ pip install wandb --upgrade wandb: Tracking run with wandb version 0.16.6 wandb: Run data is saved locally in /home/luyanfeng/my_code/github/pybind11-OpenKE/examples/HolE/wandb/run-20240518_203848-z7hc6ilv wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run feasible-sweep-2 wandb: โญ๏ธ View project at https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: ๐Ÿงน View sweep at https://wandb.ai/3555028709/pybind11-ke-sweeps/sweeps/cid6trdk wandb: ๐Ÿš€ View run at https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/z7hc6ilv INFO:Trainer:2024-05-18 20:38:51:[cuda:0] Initialization completed, start model training. DEBUG:connectionpool:2024-05-18 20:38:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:38:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:18:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:23:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:44:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:39:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:05:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:26:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:47:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:52:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:40:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:13:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:18:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:23:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:44:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:41:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:00:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:05:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:42:11:[cuda:0] Epoch 100 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:42:12:mr: 8511.545 INFO:Trainer:2024-05-18 20:42:12:mrr: 0.209 INFO:Trainer:2024-05-18 20:42:12:hits@1: 0.14 INFO:Trainer:2024-05-18 20:42:12:hits@3: 0.242 INFO:Trainer:2024-05-18 20:42:12:hits@10: 0.352 INFO:Trainer:2024-05-18 20:42:12:mr_type: 3020.895 INFO:Trainer:2024-05-18 20:42:12:mrr_type: 0.223 INFO:Trainer:2024-05-18 20:42:12:hits@1_type: 0.149 INFO:Trainer:2024-05-18 20:42:12:hits@3_type: 0.261 INFO:Trainer:2024-05-18 20:42:12:hits@10_type: 0.371 INFO:EarlyStopping:2024-05-18 20:42:12:Validation score improved (-inf --> 0.352000). Saving model ... INFO:Trainer:2024-05-18 20:42:12:[cuda:0] Epoch [ 100/10000] | Batchsize: 512 | loss: 20.174406 | 1.99190 seconds/epoch DEBUG:connectionpool:2024-05-18 20:42:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:26:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:47:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:52:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:42:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:08:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:13:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:18:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:43:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:00:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:05:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:26:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:44:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:45:15:[cuda:0] Epoch 200 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:45:16:mr: 8722.63 INFO:Trainer:2024-05-18 20:45:16:mrr: 0.335 INFO:Trainer:2024-05-18 20:45:16:hits@1: 0.294 INFO:Trainer:2024-05-18 20:45:16:hits@3: 0.368 INFO:Trainer:2024-05-18 20:45:16:hits@10: 0.391 INFO:Trainer:2024-05-18 20:45:16:mr_type: 2890.575 INFO:Trainer:2024-05-18 20:45:16:mrr_type: 0.349 INFO:Trainer:2024-05-18 20:45:16:hits@1_type: 0.306 INFO:Trainer:2024-05-18 20:45:16:hits@3_type: 0.382 INFO:Trainer:2024-05-18 20:45:16:hits@10_type: 0.408 INFO:EarlyStopping:2024-05-18 20:45:16:Validation score improved (0.352000 --> 0.391000). Saving model ... INFO:Trainer:2024-05-18 20:45:16:[cuda:0] Epoch [ 200/10000] | Batchsize: 512 | loss: 3.336950 | 1.91600 seconds/epoch DEBUG:connectionpool:2024-05-18 20:45:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:45:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:46:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:47:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:48:13:[cuda:0] Epoch 300 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:48:15:mr: 8768.812 INFO:Trainer:2024-05-18 20:48:15:mrr: 0.347 INFO:Trainer:2024-05-18 20:48:15:hits@1: 0.317 INFO:Trainer:2024-05-18 20:48:15:hits@3: 0.37 INFO:Trainer:2024-05-18 20:48:15:hits@10: 0.389 INFO:Trainer:2024-05-18 20:48:15:mr_type: 2826.244 INFO:Trainer:2024-05-18 20:48:15:mrr_type: 0.361 INFO:Trainer:2024-05-18 20:48:15:hits@1_type: 0.329 INFO:Trainer:2024-05-18 20:48:15:hits@3_type: 0.382 INFO:Trainer:2024-05-18 20:48:15:hits@10_type: 0.408 INFO:EarlyStopping:2024-05-18 20:48:15:EarlyStopping counter: 1 / 2 INFO:Trainer:2024-05-18 20:48:15:[cuda:0] Epoch [ 300/10000] | Batchsize: 512 | loss: 2.042030 | 1.87297 seconds/epoch DEBUG:connectionpool:2024-05-18 20:48:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:48:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:05:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:26:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:47:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:49:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:08:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:50:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:51:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:51:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:51:11:[cuda:0] Epoch 400 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:51:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:51:13:mr: 8835.196 INFO:Trainer:2024-05-18 20:51:13:mrr: 0.353 INFO:Trainer:2024-05-18 20:51:13:hits@1: 0.328 INFO:Trainer:2024-05-18 20:51:13:hits@3: 0.372 INFO:Trainer:2024-05-18 20:51:13:hits@10: 0.387 INFO:Trainer:2024-05-18 20:51:13:mr_type: 2784.5 INFO:Trainer:2024-05-18 20:51:13:mrr_type: 0.366 INFO:Trainer:2024-05-18 20:51:13:hits@1_type: 0.338 INFO:Trainer:2024-05-18 20:51:13:hits@3_type: 0.382 INFO:Trainer:2024-05-18 20:51:13:hits@10_type: 0.407 INFO:EarlyStopping:2024-05-18 20:51:13:EarlyStopping counter: 2 / 2 INFO:Trainer:2024-05-18 20:51:13:[cuda:0] Send an early stopping signal INFO:Trainer:2024-05-18 20:51:13:[cuda:0] The model training is completed, taking a total of 739.66497 seconds. INFO:Trainer:2024-05-18 20:51:13:[cuda:0] Model saved at ./model.pth. INFO:Trainer:2024-05-18 20:51:13:[cuda:0] The model starts evaluating in the test set. INFO:Trainer:2024-05-18 20:51:15:mr: 9101.847 INFO:Trainer:2024-05-18 20:51:15:mrr: 0.349 INFO:Trainer:2024-05-18 20:51:15:hits@1: 0.323 INFO:Trainer:2024-05-18 20:51:15:hits@3: 0.365 INFO:Trainer:2024-05-18 20:51:15:hits@10: 0.385 INFO:Trainer:2024-05-18 20:51:15:mr_type: 2784.687 INFO:Trainer:2024-05-18 20:51:15:mrr_type: 0.36 INFO:Trainer:2024-05-18 20:51:15:hits@1_type: 0.331 INFO:Trainer:2024-05-18 20:51:15:hits@3_type: 0.378 INFO:Trainer:2024-05-18 20:51:15:hits@10_type: 0.404 wandb: - 0.014 MB of 0.014 MB uploaded DEBUG:connectionpool:2024-05-18 20:51:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: \ 0.014 MB of 0.040 MB uploaded wandb: | 0.016 MB of 0.040 MB uploaded wandb: / 0.035 MB of 0.040 MB uploaded wandb: - 0.035 MB of 0.040 MB uploaded wandb: \ 0.040 MB of 0.040 MB uploaded wandb: wandb: wandb: Run history: wandb: duration โ– wandb: test/hits@1 โ– wandb: test/hits@10 โ– wandb: test/hits@10_type โ– wandb: test/hits@1_type โ– wandb: test/hits@3 โ– wandb: test/hits@3_type โ– wandb: test/mr โ– wandb: test/mr_type โ– wandb: test/mrr โ– wandb: test/mrr_type โ– wandb: train/epoch โ–โ–…โ–ˆ wandb: train/train_loss โ–ˆโ–โ– wandb: val/epoch โ–โ–ƒโ–†โ–ˆ wandb: val/hits@1 โ–โ–‡โ–ˆโ–ˆ wandb: val/hits@10 โ–โ–ˆโ–ˆโ–‡ wandb: val/hits@10_type โ–โ–ˆโ–ˆโ–ˆ wandb: val/hits@1_type โ–โ–‡โ–ˆโ–ˆ wandb: val/hits@3 โ–โ–ˆโ–ˆโ–ˆ wandb: val/hits@3_type โ–โ–ˆโ–ˆโ–ˆ wandb: val/mr โ–โ–†โ–‡โ–ˆ wandb: val/mr_type โ–ˆโ–„โ–‚โ– wandb: val/mrr โ–โ–‡โ–ˆโ–ˆ wandb: val/mrr_type โ–โ–‡โ–ˆโ–ˆ wandb: wandb: Run summary: wandb: duration 739.66497 wandb: test/hits@1 0.323 wandb: test/hits@10 0.385 wandb: test/hits@10_type 0.404 wandb: test/hits@1_type 0.331 wandb: test/hits@3 0.365 wandb: test/hits@3_type 0.378 wandb: test/mr 9101.847 wandb: test/mr_type 2784.687 wandb: test/mrr 0.349 wandb: test/mrr_type 0.36 wandb: train/epoch 300 wandb: train/train_loss 2.04203 wandb: val/epoch 399 wandb: val/hits@1 0.328 wandb: val/hits@10 0.387 wandb: val/hits@10_type 0.407 wandb: val/hits@1_type 0.338 wandb: val/hits@3 0.372 wandb: val/hits@3_type 0.382 wandb: val/mr 8835.196 wandb: val/mr_type 2784.5 wandb: val/mrr 0.353 wandb: val/mrr_type 0.366 wandb: wandb: ๐Ÿš€ View run feasible-sweep-2 at: https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/z7hc6ilv wandb: โญ๏ธ View project at: https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: Synced 5 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s) wandb: Find logs at: ./wandb/run-20240518_203848-z7hc6ilv/logs DEBUG:connectionpool:2024-05-18 20:51:21:Resetting dropped connection: o151352.ingest.sentry.io DEBUG:connectionpool:2024-05-18 20:51:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:51:22:https://o151352.ingest.sentry.io:443 "POST /api/4504800232407040/envelope/ HTTP/1.1" 200 0 wandb: Sweep Agent: Waiting for job. DEBUG:connectionpool:2024-05-18 20:51:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Job received. wandb: Agent Starting Run: l62bxlm8 with config: wandb: adv_temperature: 3 wandb: batch_size: 2048 wandb: dataloader: KGEDataLoader wandb: delta: 0.0001 wandb: device: cuda:0 wandb: dim: 200 wandb: ent_file: entity2id.txt wandb: epochs: 10000 wandb: in_path: ../../benchmarks/WN18RR/ wandb: l3_regul_rate: 0 wandb: log_interval: 100 wandb: loss: SoftplusLoss wandb: lr: 0.6314104206980948 wandb: metric: hits@10 wandb: model: HolE wandb: neg_ent: 1 wandb: num_workers: 16 wandb: opt_method: adam wandb: patience: 2 wandb: prediction: all wandb: regul_rate: 0 wandb: rel_file: relation2id.txt wandb: save_path: ./model.pth wandb: strategy: NegativeSampling wandb: test_batch_size: 30 wandb: test_file: test2id.txt wandb: test_sampler: TradTestSampler wandb: tester: Tester wandb: train_file: train2id.txt wandb: train_sampler: BernSampler wandb: trainer: Trainer wandb: type_constrain: True wandb: use_early_stopping: True wandb: use_gpu: True wandb: use_tqdm: False wandb: valid_file: valid2id.txt wandb: valid_interval: 100 DEBUG:cmd:2024-05-18 20:51:44:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:cmd:2024-05-18 20:51:44:Popen(['git', 'rev-parse', '--show-toplevel'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=None, shell=False, universal_newlines=False) DEBUG:connectionpool:2024-05-18 20:51:44:Starting new HTTPS connection (1): api.wandb.ai:443 DEBUG:connectionpool:2024-05-18 20:51:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:51:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:51:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:cmd:2024-05-18 20:51:45:Popen(['git', 'cat-file', '--batch-check'], cwd=/home/luyanfeng/my_code/github/pybind11-OpenKE, stdin=, shell=False, universal_newlines=False) DEBUG:connectionpool:2024-05-18 20:51:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: Tracking run with wandb version 0.16.6 wandb: Run data is saved locally in /home/luyanfeng/my_code/github/pybind11-OpenKE/examples/HolE/wandb/run-20240518_205145-l62bxlm8 wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run worthy-sweep-3 wandb: โญ๏ธ View project at https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: ๐Ÿงน View sweep at https://wandb.ai/3555028709/pybind11-ke-sweeps/sweeps/cid6trdk wandb: ๐Ÿš€ View run at https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/l62bxlm8 INFO:Trainer:2024-05-18 20:51:53:[cuda:0] Initialization completed, start model training. DEBUG:connectionpool:2024-05-18 20:51:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:52:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:53:23:[cuda:0] Epoch 100 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:53:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:53:26:mr: 9417.172 INFO:Trainer:2024-05-18 20:53:26:mrr: 0.212 INFO:Trainer:2024-05-18 20:53:26:hits@1: 0.181 INFO:Trainer:2024-05-18 20:53:26:hits@3: 0.225 INFO:Trainer:2024-05-18 20:53:26:hits@10: 0.269 INFO:Trainer:2024-05-18 20:53:26:mr_type: 4326.359 INFO:Trainer:2024-05-18 20:53:26:mrr_type: 0.234 INFO:Trainer:2024-05-18 20:53:26:hits@1_type: 0.199 INFO:Trainer:2024-05-18 20:53:26:hits@3_type: 0.247 INFO:Trainer:2024-05-18 20:53:26:hits@10_type: 0.301 INFO:EarlyStopping:2024-05-18 20:53:26:Validation score improved (-inf --> 0.269000). Saving model ... INFO:Trainer:2024-05-18 20:53:26:[cuda:0] Epoch [ 100/10000] | Batchsize: 2048 | loss: 165072.822998 | 0.90033 seconds/epoch DEBUG:connectionpool:2024-05-18 20:53:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:52:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:53:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:13:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:18:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:23:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:44:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:54:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:54:57:[cuda:0] Epoch 200 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:55:00:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:55:00:mr: 8896.859 INFO:Trainer:2024-05-18 20:55:00:mrr: 0.317 INFO:Trainer:2024-05-18 20:55:00:hits@1: 0.294 INFO:Trainer:2024-05-18 20:55:00:hits@3: 0.332 INFO:Trainer:2024-05-18 20:55:00:hits@10: 0.358 INFO:Trainer:2024-05-18 20:55:00:mr_type: 6862.989 INFO:Trainer:2024-05-18 20:55:00:mrr_type: 0.334 INFO:Trainer:2024-05-18 20:55:00:hits@1_type: 0.31 INFO:Trainer:2024-05-18 20:55:00:hits@3_type: 0.346 INFO:Trainer:2024-05-18 20:55:00:hits@10_type: 0.378 INFO:EarlyStopping:2024-05-18 20:55:00:Validation score improved (0.269000 --> 0.358000). Saving model ... INFO:Trainer:2024-05-18 20:55:01:[cuda:0] Epoch [ 200/10000] | Batchsize: 2048 | loss: 192752.293213 | 0.92217 seconds/epoch DEBUG:connectionpool:2024-05-18 20:55:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:55:58:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:09:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:30:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:56:30:[cuda:0] Epoch 300 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 20:56:34:mr: 8521.564 INFO:Trainer:2024-05-18 20:56:34:mrr: 0.331 INFO:Trainer:2024-05-18 20:56:34:hits@1: 0.309 INFO:Trainer:2024-05-18 20:56:34:hits@3: 0.344 INFO:Trainer:2024-05-18 20:56:34:hits@10: 0.369 INFO:Trainer:2024-05-18 20:56:34:mr_type: 9369.729 INFO:Trainer:2024-05-18 20:56:34:mrr_type: 0.343 INFO:Trainer:2024-05-18 20:56:34:hits@1_type: 0.319 INFO:Trainer:2024-05-18 20:56:34:hits@3_type: 0.36 INFO:Trainer:2024-05-18 20:56:34:hits@10_type: 0.384 INFO:EarlyStopping:2024-05-18 20:56:34:Validation score improved (0.358000 --> 0.369000). Saving model ... INFO:Trainer:2024-05-18 20:56:34:[cuda:0] Epoch [ 300/10000] | Batchsize: 2048 | loss: 270891.104370 | 0.92625 seconds/epoch DEBUG:connectionpool:2024-05-18 20:56:35:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:51:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:56:56:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:12:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:17:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:22:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:33:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:38:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:43:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:54:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:57:59:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:58:02:[cuda:0] Epoch 400 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:58:04:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:58:06:mr: 8581.661 INFO:Trainer:2024-05-18 20:58:06:mrr: 0.337 INFO:Trainer:2024-05-18 20:58:06:hits@1: 0.317 INFO:Trainer:2024-05-18 20:58:06:hits@3: 0.349 INFO:Trainer:2024-05-18 20:58:06:hits@10: 0.37 INFO:Trainer:2024-05-18 20:58:06:mr_type: 11870.045 INFO:Trainer:2024-05-18 20:58:06:mrr_type: 0.348 INFO:Trainer:2024-05-18 20:58:06:hits@1_type: 0.326 INFO:Trainer:2024-05-18 20:58:06:hits@3_type: 0.362 INFO:Trainer:2024-05-18 20:58:06:hits@10_type: 0.384 INFO:EarlyStopping:2024-05-18 20:58:06:Validation score improved (0.369000 --> 0.370000). Saving model ... INFO:Trainer:2024-05-18 20:58:06:[cuda:0] Epoch [ 400/10000] | Batchsize: 2048 | loss: 256845.833496 | 0.92374 seconds/epoch DEBUG:connectionpool:2024-05-18 20:58:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:15:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:20:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:25:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:36:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:41:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:46:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:52:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:58:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:02:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:07:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:13:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:18:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:23:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:28:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:59:38:[cuda:0] Epoch 500 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 20:59:39:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 20:59:41:mr: 8509.122 INFO:Trainer:2024-05-18 20:59:41:mrr: 0.348 INFO:Trainer:2024-05-18 20:59:41:hits@1: 0.329 INFO:Trainer:2024-05-18 20:59:41:hits@3: 0.36 INFO:Trainer:2024-05-18 20:59:41:hits@10: 0.378 INFO:Trainer:2024-05-18 20:59:41:mr_type: 13783.719 INFO:Trainer:2024-05-18 20:59:41:mrr_type: 0.358 INFO:Trainer:2024-05-18 20:59:41:hits@1_type: 0.338 INFO:Trainer:2024-05-18 20:59:41:hits@3_type: 0.369 INFO:Trainer:2024-05-18 20:59:41:hits@10_type: 0.389 INFO:EarlyStopping:2024-05-18 20:59:41:Validation score improved (0.370000 --> 0.378000). Saving model ... INFO:Trainer:2024-05-18 20:59:41:[cuda:0] Epoch [ 500/10000] | Batchsize: 2048 | loss: 303229.930420 | 0.93047 seconds/epoch DEBUG:connectionpool:2024-05-18 20:59:44:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:49:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 20:59:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:00:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:05:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:10:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:26:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:31:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:47:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:52:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:00:57:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:03:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:08:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 21:01:10:[cuda:0] Epoch 600 | The model starts evaluation on the validation set. INFO:Trainer:2024-05-18 21:01:13:mr: 8557.757 INFO:Trainer:2024-05-18 21:01:13:mrr: 0.353 INFO:Trainer:2024-05-18 21:01:13:hits@1: 0.338 INFO:Trainer:2024-05-18 21:01:13:hits@3: 0.363 INFO:Trainer:2024-05-18 21:01:13:hits@10: 0.376 INFO:Trainer:2024-05-18 21:01:13:mr_type: 16395.035 INFO:Trainer:2024-05-18 21:01:13:mrr_type: 0.36 INFO:Trainer:2024-05-18 21:01:13:hits@1_type: 0.344 INFO:Trainer:2024-05-18 21:01:13:hits@3_type: 0.37 INFO:Trainer:2024-05-18 21:01:13:hits@10_type: 0.384 INFO:EarlyStopping:2024-05-18 21:01:13:EarlyStopping counter: 1 / 2 INFO:Trainer:2024-05-18 21:01:13:[cuda:0] Epoch [ 600/10000] | Batchsize: 2048 | loss: 348731.899414 | 0.92819 seconds/epoch DEBUG:connectionpool:2024-05-18 21:01:14:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:19:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:24:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:29:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:34:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:40:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:45:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:50:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:01:55:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:01:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:06:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:11:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:16:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:21:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:27:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:32:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None DEBUG:connectionpool:2024-05-18 21:02:37:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 21:02:41:[cuda:0] Epoch 700 | The model starts evaluation on the validation set. DEBUG:connectionpool:2024-05-18 21:02:42:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 21:02:44:mr: 8564.983 INFO:Trainer:2024-05-18 21:02:44:mrr: 0.352 INFO:Trainer:2024-05-18 21:02:44:hits@1: 0.337 INFO:Trainer:2024-05-18 21:02:44:hits@3: 0.362 INFO:Trainer:2024-05-18 21:02:44:hits@10: 0.374 INFO:Trainer:2024-05-18 21:02:44:mr_type: 17276.764 INFO:Trainer:2024-05-18 21:02:44:mrr_type: 0.359 INFO:Trainer:2024-05-18 21:02:44:hits@1_type: 0.343 INFO:Trainer:2024-05-18 21:02:44:hits@3_type: 0.368 INFO:Trainer:2024-05-18 21:02:44:hits@10_type: 0.384 INFO:EarlyStopping:2024-05-18 21:02:44:EarlyStopping counter: 2 / 2 INFO:Trainer:2024-05-18 21:02:44:[cuda:0] Send an early stopping signal INFO:Trainer:2024-05-18 21:02:44:[cuda:0] The model training is completed, taking a total of 647.93930 seconds. INFO:Trainer:2024-05-18 21:02:44:[cuda:0] Model saved at ./model.pth. INFO:Trainer:2024-05-18 21:02:44:[cuda:0] The model starts evaluating in the test set. DEBUG:connectionpool:2024-05-18 21:02:48:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None INFO:Trainer:2024-05-18 21:02:48:mr: 8562.068 INFO:Trainer:2024-05-18 21:02:48:mrr: 0.352 INFO:Trainer:2024-05-18 21:02:48:hits@1: 0.335 INFO:Trainer:2024-05-18 21:02:48:hits@3: 0.362 INFO:Trainer:2024-05-18 21:02:48:hits@10: 0.377 INFO:Trainer:2024-05-18 21:02:48:mr_type: 17003.867 INFO:Trainer:2024-05-18 21:02:48:mrr_type: 0.36 INFO:Trainer:2024-05-18 21:02:48:hits@1_type: 0.343 INFO:Trainer:2024-05-18 21:02:48:hits@3_type: 0.371 INFO:Trainer:2024-05-18 21:02:48:hits@10_type: 0.388 wandb: - 0.014 MB of 0.014 MB uploaded wandb: \ 0.014 MB of 0.040 MB uploaded wandb: | 0.022 MB of 0.040 MB uploaded wandb: / 0.040 MB of 0.040 MB uploaded wandb: - 0.040 MB of 0.040 MB uploaded wandb: \ 0.040 MB of 0.040 MB uploaded wandb: DEBUG:connectionpool:2024-05-18 21:02:53:https://api.wandb.ai:443 "POST /graphql HTTP/1.1" 200 None wandb: wandb: Run history: wandb: duration โ– wandb: test/hits@1 โ– wandb: test/hits@10 โ– wandb: test/hits@10_type โ– wandb: test/hits@1_type โ– wandb: test/hits@3 โ– wandb: test/hits@3_type โ– wandb: test/mr โ– wandb: test/mr_type โ– wandb: test/mrr โ– wandb: test/mrr_type โ– wandb: train/epoch โ–โ–‚โ–„โ–…โ–‡โ–ˆ wandb: train/train_loss โ–โ–‚โ–…โ–„โ–†โ–ˆ wandb: val/epoch โ–โ–‚โ–ƒโ–…โ–†โ–‡โ–ˆ wandb: val/hits@1 โ–โ–†โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: val/hits@10 โ–โ–‡โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: val/hits@10_type โ–โ–‡โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/hits@1_type โ–โ–†โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: val/hits@3 โ–โ–†โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: val/hits@3_type โ–โ–‡โ–‡โ–ˆโ–ˆโ–ˆโ–ˆ wandb: val/mr โ–ˆโ–„โ–โ–‚โ–โ–โ– wandb: val/mr_type โ–โ–‚โ–„โ–…โ–†โ–ˆโ–ˆ wandb: val/mrr โ–โ–†โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: val/mrr_type โ–โ–‡โ–‡โ–‡โ–ˆโ–ˆโ–ˆ wandb: wandb: Run summary: wandb: duration 647.9393 wandb: test/hits@1 0.335 wandb: test/hits@10 0.377 wandb: test/hits@10_type 0.388 wandb: test/hits@1_type 0.343 wandb: test/hits@3 0.362 wandb: test/hits@3_type 0.371 wandb: test/mr 8562.068 wandb: test/mr_type 17003.867 wandb: test/mrr 0.352 wandb: test/mrr_type 0.36 wandb: train/epoch 600 wandb: train/train_loss 348731.89941 wandb: val/epoch 699 wandb: val/hits@1 0.337 wandb: val/hits@10 0.374 wandb: val/hits@10_type 0.384 wandb: val/hits@1_type 0.343 wandb: val/hits@3 0.362 wandb: val/hits@3_type 0.368 wandb: val/mr 8564.983 wandb: val/mr_type 17276.764 wandb: val/mrr 0.352 wandb: val/mrr_type 0.359 wandb: wandb: ๐Ÿš€ View run worthy-sweep-3 at: https://wandb.ai/3555028709/pybind11-ke-sweeps/runs/l62bxlm8 wandb: โญ๏ธ View project at: https://wandb.ai/3555028709/pybind11-ke-sweeps wandb: Synced 5 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s) wandb: Find logs at: ./wandb/run-20240518_205145-l62bxlm8/logs DEBUG:connectionpool:2024-05-18 21:02:55:Resetting dropped connection: o151352.ingest.sentry.io DEBUG:connectionpool:2024-05-18 21:02:56:https://o151352.ingest.sentry.io:443 "POST /api/4504800232407040/envelope/ HTTP/1.1" 200 0