log_student.txt

Namespace(alpha=0.2, atten_weight=0.01, attn_drop=0, batch_size=2, checkpoint='models', gpu=0, grad_weight=0.1, in_drop=0, lr=0.0001, mode='mi', residual=True, s_epochs=1500, s_num_heads=4, s_num_hidden=256, s_num_layers=2, s_num_out_heads=6, swap_weight=1, t2_num_heads=4, t2_num_hidden=256, t2_num_layers=2, t2_num_out_heads=6, t_epochs=60, t_num_heads=4, t_num_hidden=256, t_num_layers=2, t_num_out_heads=6, target_layer=1, train_mode='together', warmup_epoch=600, weight_decay=4e-06)
{'s_feat': [1024, 1024], 't_feat': [1024, 1024], 't2_feat': [1024, 1024]}
60
60
1024
1024
1024
1024
1024
1024
Load model from ./teacher_models_best/t1_best_model.pt
Load model from ./teacher_models_best/t2_best_model.pt
Epoch 00001 | Loss: 1.6505 | Swap Loss: 0.0000 | Grad Loss: 2.8180 | Atten Loss: 0.0000 | Soft Loss: 1.3687 | Time: 4.1410s
Epoch 00002 | Loss: 1.5610 | Swap Loss: 0.0000 | Grad Loss: 2.4830 | Atten Loss: 0.0000 | Soft Loss: 1.3127 | Time: 3.3821s
Epoch 00003 | Loss: 1.4693 | Swap Loss: 0.0000 | Grad Loss: 2.3821 | Atten Loss: 0.0000 | Soft Loss: 1.2311 | Time: 3.1784s
Epoch 00004 | Loss: 1.3865 | Swap Loss: 0.0000 | Grad Loss: 2.3286 | Atten Loss: 0.0000 | Soft Loss: 1.1536 | Time: 3.0303s
F1-Score on valset:       whole 0.4301, part1 0.4337, part2 0.4264
F1-Score on testset:       whole 0.4309, part1 0.4342, part2 0.4275
Epoch 00005 | Loss: 1.3455 | Swap Loss: 0.0000 | Grad Loss: 2.2013 | Atten Loss: 0.0000 | Soft Loss: 1.1254 | Time: 3.2069s
Epoch 00006 | Loss: 1.3135 | Swap Loss: 0.0000 | Grad Loss: 2.0382 | Atten Loss: 0.0000 | Soft Loss: 1.1097 | Time: 3.2421s
Epoch 00007 | Loss: 1.2921 | Swap Loss: 0.0000 | Grad Loss: 1.9059 | Atten Loss: 0.0000 | Soft Loss: 1.1015 | Time: 3.5287s
Epoch 00008 | Loss: 1.2703 | Swap Loss: 0.0000 | Grad Loss: 1.7950 | Atten Loss: 0.0000 | Soft Loss: 1.0907 | Time: 3.3906s
Epoch 00009 | Loss: 1.2482 | Swap Loss: 0.0000 | Grad Loss: 1.6974 | Atten Loss: 0.0000 | Soft Loss: 1.0785 | Time: 3.1568s
F1-Score on valset:       whole 0.4395, part1 0.4542, part2 0.4238
F1-Score on testset:       whole 0.4419, part1 0.4561, part2 0.4269
Epoch 00010 | Loss: 1.2327 | Swap Loss: 0.0000 | Grad Loss: 1.6227 | Atten Loss: 0.0000 | Soft Loss: 1.0705 | Time: 3.2943s
Epoch 00011 | Loss: 1.2201 | Swap Loss: 0.0000 | Grad Loss: 1.5609 | Atten Loss: 0.0000 | Soft Loss: 1.0640 | Time: 3.2596s
Epoch 00012 | Loss: 1.2065 | Swap Loss: 0.0000 | Grad Loss: 1.5080 | Atten Loss: 0.0000 | Soft Loss: 1.0557 | Time: 3.3920s
Epoch 00013 | Loss: 1.1959 | Swap Loss: 0.0000 | Grad Loss: 1.4679 | Atten Loss: 0.0000 | Soft Loss: 1.0491 | Time: 3.1889s
Epoch 00014 | Loss: 1.1815 | Swap Loss: 0.0000 | Grad Loss: 1.4142 | Atten Loss: 0.0000 | Soft Loss: 1.0400 | Time: 3.1934s
F1-Score on valset:       whole 0.4676, part1 0.4836, part2 0.4505
F1-Score on testset:       whole 0.4721, part1 0.4873, part2 0.4558
Epoch 00015 | Loss: 1.1696 | Swap Loss: 0.0000 | Grad Loss: 1.3675 | Atten Loss: 0.0000 | Soft Loss: 1.0328 | Time: 3.3944s
Epoch 00016 | Loss: 1.1643 | Swap Loss: 0.0000 | Grad Loss: 1.3563 | Atten Loss: 0.0000 | Soft Loss: 1.0286 | Time: 3.2398s
Epoch 00017 | Loss: 1.1517 | Swap Loss: 0.0000 | Grad Loss: 1.3175 | Atten Loss: 0.0000 | Soft Loss: 1.0199 | Time: 3.1433s
Epoch 00018 | Loss: 1.1444 | Swap Loss: 0.0000 | Grad Loss: 1.2899 | Atten Loss: 0.0000 | Soft Loss: 1.0154 | Time: 3.2658s
Epoch 00019 | Loss: 1.1317 | Swap Loss: 0.0000 | Grad Loss: 1.2444 | Atten Loss: 0.0000 | Soft Loss: 1.0073 | Time: 3.4115s
F1-Score on valset:       whole 0.4977, part1 0.5097, part2 0.4848
F1-Score on testset:       whole 0.5017, part1 0.5127, part2 0.4900
Epoch 00020 | Loss: 1.1261 | Swap Loss: 0.0000 | Grad Loss: 1.2282 | Atten Loss: 0.0000 | Soft Loss: 1.0033 | Time: 3.2750s
Epoch 00021 | Loss: 1.1166 | Swap Loss: 0.0000 | Grad Loss: 1.1907 | Atten Loss: 0.0000 | Soft Loss: 0.9975 | Time: 3.2868s
Epoch 00022 | Loss: 1.1167 | Swap Loss: 0.0000 | Grad Loss: 1.2135 | Atten Loss: 0.0000 | Soft Loss: 0.9954 | Time: 3.4457s
Epoch 00023 | Loss: 1.1039 | Swap Loss: 0.0000 | Grad Loss: 1.1573 | Atten Loss: 0.0000 | Soft Loss: 0.9882 | Time: 3.1895s
Epoch 00024 | Loss: 1.0992 | Swap Loss: 0.0000 | Grad Loss: 1.1384 | Atten Loss: 0.0000 | Soft Loss: 0.9853 | Time: 3.1548s
F1-Score on valset:       whole 0.5207, part1 0.5302, part2 0.5106
F1-Score on testset:       whole 0.5245, part1 0.5330, part2 0.5156
Epoch 00025 | Loss: 1.0980 | Swap Loss: 0.0000 | Grad Loss: 1.1418 | Atten Loss: 0.0000 | Soft Loss: 0.9838 | Time: 3.1265s
Epoch 00026 | Loss: 1.0873 | Swap Loss: 0.0000 | Grad Loss: 1.0986 | Atten Loss: 0.0000 | Soft Loss: 0.9774 | Time: 3.3177s
Epoch 00027 | Loss: 1.0799 | Swap Loss: 0.0000 | Grad Loss: 1.0757 | Atten Loss: 0.0000 | Soft Loss: 0.9723 | Time: 3.0624s
Epoch 00028 | Loss: 1.0748 | Swap Loss: 0.0000 | Grad Loss: 1.0429 | Atten Loss: 0.0000 | Soft Loss: 0.9705 | Time: 3.0890s
Epoch 00029 | Loss: 1.0692 | Swap Loss: 0.0000 | Grad Loss: 1.0309 | Atten Loss: 0.0000 | Soft Loss: 0.9661 | Time: 3.2314s
F1-Score on valset:       whole 0.5349, part1 0.5436, part2 0.5258
F1-Score on testset:       whole 0.5391, part1 0.5465, part2 0.5312
Epoch 00030 | Loss: 1.0654 | Swap Loss: 0.0000 | Grad Loss: 1.0184 | Atten Loss: 0.0000 | Soft Loss: 0.9635 | Time: 3.4330s
Epoch 00031 | Loss: 1.0615 | Swap Loss: 0.0000 | Grad Loss: 1.0018 | Atten Loss: 0.0000 | Soft Loss: 0.9614 | Time: 3.1978s
Epoch 00032 | Loss: 1.0557 | Swap Loss: 0.0000 | Grad Loss: 0.9867 | Atten Loss: 0.0000 | Soft Loss: 0.9570 | Time: 3.1898s
Epoch 00033 | Loss: 1.0595 | Swap Loss: 0.0000 | Grad Loss: 1.0072 | Atten Loss: 0.0000 | Soft Loss: 0.9588 | Time: 6.2359s
Epoch 00034 | Loss: 1.0506 | Swap Loss: 0.0000 | Grad Loss: 0.9733 | Atten Loss: 0.0000 | Soft Loss: 0.9533 | Time: 3.2318s
F1-Score on valset:       whole 0.5476, part1 0.5554, part2 0.5394
F1-Score on testset:       whole 0.5521, part1 0.5591, part2 0.5447
Epoch 00035 | Loss: 1.0459 | Swap Loss: 0.0000 | Grad Loss: 0.9648 | Atten Loss: 0.0000 | Soft Loss: 0.9495 | Time: 3.2740s
Epoch 00036 | Loss: 1.0423 | Swap Loss: 0.0000 | Grad Loss: 0.9533 | Atten Loss: 0.0000 | Soft Loss: 0.9470 | Time: 3.3006s
Epoch 00037 | Loss: 1.0382 | Swap Loss: 0.0000 | Grad Loss: 0.9338 | Atten Loss: 0.0000 | Soft Loss: 0.9448 | Time: 3.1921s
Epoch 00038 | Loss: 1.0329 | Swap Loss: 0.0000 | Grad Loss: 0.9169 | Atten Loss: 0.0000 | Soft Loss: 0.9413 | Time: 3.4862s
Epoch 00039 | Loss: 1.0310 | Swap Loss: 0.0000 | Grad Loss: 0.9141 | Atten Loss: 0.0000 | Soft Loss: 0.9396 | Time: 3.3762s
F1-Score on valset:       whole 0.5605, part1 0.5676, part2 0.5530
F1-Score on testset:       whole 0.5658, part1 0.5724, part2 0.5589
Epoch 00040 | Loss: 1.0255 | Swap Loss: 0.0000 | Grad Loss: 0.8933 | Atten Loss: 0.0000 | Soft Loss: 0.9362 | Time: 3.2456s
Epoch 00041 | Loss: 1.0226 | Swap Loss: 0.0000 | Grad Loss: 0.8842 | Atten Loss: 0.0000 | Soft Loss: 0.9342 | Time: 3.2275s
Epoch 00042 | Loss: 1.0197 | Swap Loss: 0.0000 | Grad Loss: 0.8890 | Atten Loss: 0.0000 | Soft Loss: 0.9308 | Time: 3.5554s
Epoch 00043 | Loss: 1.0152 | Swap Loss: 0.0000 | Grad Loss: 0.8695 | Atten Loss: 0.0000 | Soft Loss: 0.9282 | Time: 3.3914s
Epoch 00044 | Loss: 1.0103 | Swap Loss: 0.0000 | Grad Loss: 0.8533 | Atten Loss: 0.0000 | Soft Loss: 0.9249 | Time: 2.8875s
F1-Score on valset:       whole 0.5704, part1 0.5769, part2 0.5636
F1-Score on testset:       whole 0.5760, part1 0.5819, part2 0.5699
Epoch 00045 | Loss: 1.0098 | Swap Loss: 0.0000 | Grad Loss: 0.8645 | Atten Loss: 0.0000 | Soft Loss: 0.9233 | Time: 2.9955s
Epoch 00046 | Loss: 1.0068 | Swap Loss: 0.0000 | Grad Loss: 0.8466 | Atten Loss: 0.0000 | Soft Loss: 0.9221 | Time: 3.0219s
Epoch 00047 | Loss: 1.0013 | Swap Loss: 0.0000 | Grad Loss: 0.8395 | Atten Loss: 0.0000 | Soft Loss: 0.9174 | Time: 3.2162s
Epoch 00048 | Loss: 0.9981 | Swap Loss: 0.0000 | Grad Loss: 0.8309 | Atten Loss: 0.0000 | Soft Loss: 0.9150 | Time: 3.1325s
Epoch 00049 | Loss: 0.9951 | Swap Loss: 0.0000 | Grad Loss: 0.8185 | Atten Loss: 0.0000 | Soft Loss: 0.9132 | Time: 3.2860s
F1-Score on valset:       whole 0.5806, part1 0.5867, part2 0.5742
F1-Score on testset:       whole 0.5877, part1 0.5928, part2 0.5824
Epoch 00050 | Loss: 0.9902 | Swap Loss: 0.0000 | Grad Loss: 0.8073 | Atten Loss: 0.0000 | Soft Loss: 0.9094 | Time: 3.3624s
Epoch 00051 | Loss: 0.9855 | Swap Loss: 0.0000 | Grad Loss: 0.7915 | Atten Loss: 0.0000 | Soft Loss: 0.9064 | Time: 3.2327s
Epoch 00052 | Loss: 0.9868 | Swap Loss: 0.0000 | Grad Loss: 0.8093 | Atten Loss: 0.0000 | Soft Loss: 0.9059 | Time: 3.3287s
Epoch 00053 | Loss: 0.9869 | Swap Loss: 0.0000 | Grad Loss: 0.8165 | Atten Loss: 0.0000 | Soft Loss: 0.9053 | Time: 3.4065s
Epoch 00054 | Loss: 0.9796 | Swap Loss: 0.0000 | Grad Loss: 0.7976 | Atten Loss: 0.0000 | Soft Loss: 0.8999 | Time: 3.2801s
F1-Score on valset:       whole 0.5873, part1 0.5929, part2 0.5814
F1-Score on testset:       whole 0.5957, part1 0.6001, part2 0.5913
Epoch 00055 | Loss: 0.9738 | Swap Loss: 0.0000 | Grad Loss: 0.7784 | Atten Loss: 0.0000 | Soft Loss: 0.8959 | Time: 2.9567s
Epoch 00056 | Loss: 0.9706 | Swap Loss: 0.0000 | Grad Loss: 0.7688 | Atten Loss: 0.0000 | Soft Loss: 0.8937 | Time: 3.1534s
Epoch 00057 | Loss: 0.9698 | Swap Loss: 0.0000 | Grad Loss: 0.7714 | Atten Loss: 0.0000 | Soft Loss: 0.8927 | Time: 3.4238s
Epoch 00058 | Loss: 0.9640 | Swap Loss: 0.0000 | Grad Loss: 0.7580 | Atten Loss: 0.0000 | Soft Loss: 0.8882 | Time: 3.3418s
Epoch 00059 | Loss: 0.9636 | Swap Loss: 0.0000 | Grad Loss: 0.7653 | Atten Loss: 0.0000 | Soft Loss: 0.8871 | Time: 3.5847s
F1-Score on valset:       whole 0.5918, part1 0.5972, part2 0.5862
F1-Score on testset:       whole 0.6000, part1 0.6049, part2 0.5950
Epoch 00060 | Loss: 0.9629 | Swap Loss: 0.0000 | Grad Loss: 0.7708 | Atten Loss: 0.0000 | Soft Loss: 0.8858 | Time: 3.2327s
Epoch 00061 | Loss: 0.9550 | Swap Loss: 0.0000 | Grad Loss: 0.7495 | Atten Loss: 0.0000 | Soft Loss: 0.8800 | Time: 3.2107s
Epoch 00062 | Loss: 0.9596 | Swap Loss: 0.0000 | Grad Loss: 0.7755 | Atten Loss: 0.0000 | Soft Loss: 0.8820 | Time: 3.3264s
Epoch 00063 | Loss: 0.9482 | Swap Loss: 0.0000 | Grad Loss: 0.7381 | Atten Loss: 0.0000 | Soft Loss: 0.8744 | Time: 3.2811s
Epoch 00064 | Loss: 0.9464 | Swap Loss: 0.0000 | Grad Loss: 0.7395 | Atten Loss: 0.0000 | Soft Loss: 0.8724 | Time: 3.2092s
F1-Score on valset:       whole 0.6108, part1 0.6142, part2 0.6072
F1-Score on testset:       whole 0.6203, part1 0.6228, part2 0.6177
Epoch 00065 | Loss: 0.9408 | Swap Loss: 0.0000 | Grad Loss: 0.7194 | Atten Loss: 0.0000 | Soft Loss: 0.8689 | Time: 3.2535s
Epoch 00066 | Loss: 0.9398 | Swap Loss: 0.0000 | Grad Loss: 0.7306 | Atten Loss: 0.0000 | Soft Loss: 0.8667 | Time: 3.5328s
Epoch 00067 | Loss: 0.9365 | Swap Loss: 0.0000 | Grad Loss: 0.7249 | Atten Loss: 0.0000 | Soft Loss: 0.8640 | Time: 3.4304s
Epoch 00068 | Loss: 0.9371 | Swap Loss: 0.0000 | Grad Loss: 0.7310 | Atten Loss: 0.0000 | Soft Loss: 0.8640 | Time: 3.4848s
Epoch 00069 | Loss: 0.9315 | Swap Loss: 0.0000 | Grad Loss: 0.7155 | Atten Loss: 0.0000 | Soft Loss: 0.8600 | Time: 3.4502s
F1-Score on valset:       whole 0.6159, part1 0.6194, part2 0.6122
F1-Score on testset:       whole 0.6257, part1 0.6284, part2 0.6229
Epoch 00070 | Loss: 0.9255 | Swap Loss: 0.0000 | Grad Loss: 0.7013 | Atten Loss: 0.0000 | Soft Loss: 0.8553 | Time: 3.4144s
Epoch 00071 | Loss: 0.9252 | Swap Loss: 0.0000 | Grad Loss: 0.7144 | Atten Loss: 0.0000 | Soft Loss: 0.8538 | Time: 3.4556s
Epoch 00072 | Loss: 0.9225 | Swap Loss: 0.0000 | Grad Loss: 0.7075 | Atten Loss: 0.0000 | Soft Loss: 0.8517 | Time: 3.2246s
Epoch 00073 | Loss: 0.9190 | Swap Loss: 0.0000 | Grad Loss: 0.7059 | Atten Loss: 0.0000 | Soft Loss: 0.8484 | Time: 3.3006s
Epoch 00074 | Loss: 0.9138 | Swap Loss: 0.0000 | Grad Loss: 0.6958 | Atten Loss: 0.0000 | Soft Loss: 0.8442 | Time: 3.4746s
F1-Score on valset:       whole 0.6243, part1 0.6273, part2 0.6212
F1-Score on testset:       whole 0.6345, part1 0.6366, part2 0.6323
Epoch 00075 | Loss: 0.9184 | Swap Loss: 0.0000 | Grad Loss: 0.7128 | Atten Loss: 0.0000 | Soft Loss: 0.8471 | Time: 3.4818s
Epoch 00076 | Loss: 0.9081 | Swap Loss: 0.0000 | Grad Loss: 0.6865 | Atten Loss: 0.0000 | Soft Loss: 0.8395 | Time: 3.4055s
Epoch 00077 | Loss: 0.9070 | Swap Loss: 0.0000 | Grad Loss: 0.6900 | Atten Loss: 0.0000 | Soft Loss: 0.8380 | Time: 3.1641s
Epoch 00078 | Loss: 0.8987 | Swap Loss: 0.0000 | Grad Loss: 0.6697 | Atten Loss: 0.0000 | Soft Loss: 0.8317 | Time: 3.2157s
Epoch 00079 | Loss: 0.8995 | Swap Loss: 0.0000 | Grad Loss: 0.6783 | Atten Loss: 0.0000 | Soft Loss: 0.8316 | Time: 3.2586s
F1-Score on valset:       whole 0.6296, part1 0.6320, part2 0.6271
F1-Score on testset:       whole 0.6410, part1 0.6424, part2 0.6395
Epoch 00080 | Loss: 0.8924 | Swap Loss: 0.0000 | Grad Loss: 0.6619 | Atten Loss: 0.0000 | Soft Loss: 0.8262 | Time: 3.0170s
Epoch 00081 | Loss: 0.8887 | Swap Loss: 0.0000 | Grad Loss: 0.6560 | Atten Loss: 0.0000 | Soft Loss: 0.8231 | Time: 3.0825s
Epoch 00082 | Loss: 0.8931 | Swap Loss: 0.0000 | Grad Loss: 0.6908 | Atten Loss: 0.0000 | Soft Loss: 0.8240 | Time: 3.2966s
Epoch 00083 | Loss: 0.8820 | Swap Loss: 0.0000 | Grad Loss: 0.6517 | Atten Loss: 0.0000 | Soft Loss: 0.8168 | Time: 2.9186s
Epoch 00084 | Loss: 0.8838 | Swap Loss: 0.0000 | Grad Loss: 0.6751 | Atten Loss: 0.0000 | Soft Loss: 0.8163 | Time: 3.2251s
F1-Score on valset:       whole 0.6449, part1 0.6462, part2 0.6435
F1-Score on testset:       whole 0.6580, part1 0.6586, part2 0.6575
Epoch 00085 | Loss: 0.8775 | Swap Loss: 0.0000 | Grad Loss: 0.6523 | Atten Loss: 0.0000 | Soft Loss: 0.8123 | Time: 3.2115s
Epoch 00086 | Loss: 0.8723 | Swap Loss: 0.0000 | Grad Loss: 0.6423 | Atten Loss: 0.0000 | Soft Loss: 0.8081 | Time: 2.8874s
Epoch 00087 | Loss: 0.8699 | Swap Loss: 0.0000 | Grad Loss: 0.6442 | Atten Loss: 0.0000 | Soft Loss: 0.8055 | Time: 3.2533s
Epoch 00088 | Loss: 0.8667 | Swap Loss: 0.0000 | Grad Loss: 0.6447 | Atten Loss: 0.0000 | Soft Loss: 0.8022 | Time: 3.4616s
Epoch 00089 | Loss: 0.8733 | Swap Loss: 0.0000 | Grad Loss: 0.6702 | Atten Loss: 0.0000 | Soft Loss: 0.8063 | Time: 3.2960s
F1-Score on valset:       whole 0.6469, part1 0.6481, part2 0.6455
F1-Score on testset:       whole 0.6599, part1 0.6603, part2 0.6596
Epoch 00090 | Loss: 0.8637 | Swap Loss: 0.0000 | Grad Loss: 0.6586 | Atten Loss: 0.0000 | Soft Loss: 0.7978 | Time: 3.6881s
Epoch 00091 | Loss: 0.8560 | Swap Loss: 0.0000 | Grad Loss: 0.6363 | Atten Loss: 0.0000 | Soft Loss: 0.7923 | Time: 3.4651s
Epoch 00092 | Loss: 0.8541 | Swap Loss: 0.0000 | Grad Loss: 0.6361 | Atten Loss: 0.0000 | Soft Loss: 0.7904 | Time: 3.2767s
Epoch 00093 | Loss: 0.8538 | Swap Loss: 0.0000 | Grad Loss: 0.6498 | Atten Loss: 0.0000 | Soft Loss: 0.7888 | Time: 3.2584s
Epoch 00094 | Loss: 0.8469 | Swap Loss: 0.0000 | Grad Loss: 0.6310 | Atten Loss: 0.0000 | Soft Loss: 0.7838 | Time: 3.4530s
F1-Score on valset:       whole 0.6605, part1 0.6601, part2 0.6608
F1-Score on testset:       whole 0.6757, part1 0.6746, part2 0.6769
Epoch 00095 | Loss: 0.8429 | Swap Loss: 0.0000 | Grad Loss: 0.6291 | Atten Loss: 0.0000 | Soft Loss: 0.7800 | Time: 3.3994s
Epoch 00096 | Loss: 0.8372 | Swap Loss: 0.0000 | Grad Loss: 0.6139 | Atten Loss: 0.0000 | Soft Loss: 0.7758 | Time: 3.1376s
Epoch 00097 | Loss: 0.8327 | Swap Loss: 0.0000 | Grad Loss: 0.6079 | Atten Loss: 0.0000 | Soft Loss: 0.7720 | Time: 3.2656s
Epoch 00098 | Loss: 0.8315 | Swap Loss: 0.0000 | Grad Loss: 0.6133 | Atten Loss: 0.0000 | Soft Loss: 0.7701 | Time: 3.3212s
Epoch 00099 | Loss: 0.8373 | Swap Loss: 0.0000 | Grad Loss: 0.6405 | Atten Loss: 0.0000 | Soft Loss: 0.7732 | Time: 3.2544s
F1-Score on valset:       whole 0.6762, part1 0.6752, part2 0.6772
F1-Score on testset:       whole 0.6922, part1 0.6902, part2 0.6941
Epoch 00100 | Loss: 0.8232 | Swap Loss: 0.0000 | Grad Loss: 0.6077 | Atten Loss: 0.0000 | Soft Loss: 0.7624 | Time: 3.3393s
Epoch 00101 | Loss: 0.8207 | Swap Loss: 0.0000 | Grad Loss: 0.6036 | Atten Loss: 0.0000 | Soft Loss: 0.7604 | Time: 3.1519s
Epoch 00102 | Loss: 0.8158 | Swap Loss: 0.0000 | Grad Loss: 0.6022 | Atten Loss: 0.0000 | Soft Loss: 0.7556 | Time: 3.3778s
Epoch 00103 | Loss: 0.8133 | Swap Loss: 0.0000 | Grad Loss: 0.6028 | Atten Loss: 0.0000 | Soft Loss: 0.7530 | Time: 3.4341s
Epoch 00104 | Loss: 0.8099 | Swap Loss: 0.0000 | Grad Loss: 0.5995 | Atten Loss: 0.0000 | Soft Loss: 0.7499 | Time: 3.3356s
F1-Score on valset:       whole 0.6664, part1 0.6670, part2 0.6658
F1-Score on testset:       whole 0.6825, part1 0.6815, part2 0.6836
Epoch 00105 | Loss: 0.8096 | Swap Loss: 0.0000 | Grad Loss: 0.6096 | Atten Loss: 0.0000 | Soft Loss: 0.7487 | Time: 3.4871s
Epoch 00106 | Loss: 0.8037 | Swap Loss: 0.0000 | Grad Loss: 0.5954 | Atten Loss: 0.0000 | Soft Loss: 0.7441 | Time: 3.3324s
Epoch 00107 | Loss: 0.7990 | Swap Loss: 0.0000 | Grad Loss: 0.5960 | Atten Loss: 0.0000 | Soft Loss: 0.7394 | Time: 3.0993s
Epoch 00108 | Loss: 0.7961 | Swap Loss: 0.0000 | Grad Loss: 0.5970 | Atten Loss: 0.0000 | Soft Loss: 0.7364 | Time: 3.3124s
Epoch 00109 | Loss: 0.7916 | Swap Loss: 0.0000 | Grad Loss: 0.5897 | Atten Loss: 0.0000 | Soft Loss: 0.7326 | Time: 3.1382s
F1-Score on valset:       whole 0.6881, part1 0.6875, part2 0.6887
F1-Score on testset:       whole 0.7052, part1 0.7028, part2 0.7077
Epoch 00110 | Loss: 0.7865 | Swap Loss: 0.0000 | Grad Loss: 0.5841 | Atten Loss: 0.0000 | Soft Loss: 0.7281 | Time: 3.3275s
Epoch 00111 | Loss: 0.7830 | Swap Loss: 0.0000 | Grad Loss: 0.5845 | Atten Loss: 0.0000 | Soft Loss: 0.7245 | Time: 3.4771s
Epoch 00112 | Loss: 0.7818 | Swap Loss: 0.0000 | Grad Loss: 0.5883 | Atten Loss: 0.0000 | Soft Loss: 0.7230 | Time: 3.2801s
Epoch 00113 | Loss: 0.7762 | Swap Loss: 0.0000 | Grad Loss: 0.5785 | Atten Loss: 0.0000 | Soft Loss: 0.7184 | Time: 3.1279s
Epoch 00114 | Loss: 0.7718 | Swap Loss: 0.0000 | Grad Loss: 0.5787 | Atten Loss: 0.0000 | Soft Loss: 0.7139 | Time: 3.0962s
F1-Score on valset:       whole 0.6970, part1 0.6951, part2 0.6990
F1-Score on testset:       whole 0.7153, part1 0.7124, part2 0.7183
Epoch 00115 | Loss: 0.7767 | Swap Loss: 0.0000 | Grad Loss: 0.5990 | Atten Loss: 0.0000 | Soft Loss: 0.7168 | Time: 3.2230s
Epoch 00116 | Loss: 0.7668 | Swap Loss: 0.0000 | Grad Loss: 0.5826 | Atten Loss: 0.0000 | Soft Loss: 0.7085 | Time: 3.1383s
Epoch 00117 | Loss: 0.7624 | Swap Loss: 0.0000 | Grad Loss: 0.5777 | Atten Loss: 0.0000 | Soft Loss: 0.7046 | Time: 3.4614s
Epoch 00118 | Loss: 0.7556 | Swap Loss: 0.0000 | Grad Loss: 0.5659 | Atten Loss: 0.0000 | Soft Loss: 0.6990 | Time: 3.2397s
Epoch 00119 | Loss: 0.7501 | Swap Loss: 0.0000 | Grad Loss: 0.5616 | Atten Loss: 0.0000 | Soft Loss: 0.6939 | Time: 3.3547s
F1-Score on valset:       whole 0.7082, part1 0.7068, part2 0.7096
F1-Score on testset:       whole 0.7282, part1 0.7256, part2 0.7309
Epoch 00120 | Loss: 0.7472 | Swap Loss: 0.0000 | Grad Loss: 0.5605 | Atten Loss: 0.0000 | Soft Loss: 0.6912 | Time: 3.4747s
Epoch 00121 | Loss: 0.7445 | Swap Loss: 0.0000 | Grad Loss: 0.5652 | Atten Loss: 0.0000 | Soft Loss: 0.6880 | Time: 3.1143s
Epoch 00122 | Loss: 0.7390 | Swap Loss: 0.0000 | Grad Loss: 0.5549 | Atten Loss: 0.0000 | Soft Loss: 0.6835 | Time: 3.2312s
Epoch 00123 | Loss: 0.7382 | Swap Loss: 0.0000 | Grad Loss: 0.5619 | Atten Loss: 0.0000 | Soft Loss: 0.6820 | Time: 3.1571s
Epoch 00124 | Loss: 0.7324 | Swap Loss: 0.0000 | Grad Loss: 0.5557 | Atten Loss: 0.0000 | Soft Loss: 0.6769 | Time: 3.2566s
F1-Score on valset:       whole 0.7149, part1 0.7135, part2 0.7163
F1-Score on testset:       whole 0.7344, part1 0.7320, part2 0.7369
Epoch 00125 | Loss: 0.7340 | Swap Loss: 0.0000 | Grad Loss: 0.5720 | Atten Loss: 0.0000 | Soft Loss: 0.6768 | Time: 3.3553s
Epoch 00126 | Loss: 0.7231 | Swap Loss: 0.0000 | Grad Loss: 0.5515 | Atten Loss: 0.0000 | Soft Loss: 0.6679 | Time: 3.3018s
Epoch 00127 | Loss: 0.7238 | Swap Loss: 0.0000 | Grad Loss: 0.5613 | Atten Loss: 0.0000 | Soft Loss: 0.6677 | Time: 3.1608s
Epoch 00128 | Loss: 0.7176 | Swap Loss: 0.0000 | Grad Loss: 0.5527 | Atten Loss: 0.0000 | Soft Loss: 0.6623 | Time: 3.2627s
Epoch 00129 | Loss: 0.7189 | Swap Loss: 0.0000 | Grad Loss: 0.5665 | Atten Loss: 0.0000 | Soft Loss: 0.6623 | Time: 3.2591s
F1-Score on valset:       whole 0.7267, part1 0.7249, part2 0.7285
F1-Score on testset:       whole 0.7472, part1 0.7440, part2 0.7504
Epoch 00130 | Loss: 0.7118 | Swap Loss: 0.0000 | Grad Loss: 0.5548 | Atten Loss: 0.0000 | Soft Loss: 0.6563 | Time: 3.1243s
Epoch 00131 | Loss: 0.7087 | Swap Loss: 0.0000 | Grad Loss: 0.5523 | Atten Loss: 0.0000 | Soft Loss: 0.6535 | Time: 3.3018s
Epoch 00132 | Loss: 0.7043 | Swap Loss: 0.0000 | Grad Loss: 0.5547 | Atten Loss: 0.0000 | Soft Loss: 0.6488 | Time: 3.4194s
Epoch 00133 | Loss: 0.6974 | Swap Loss: 0.0000 | Grad Loss: 0.5507 | Atten Loss: 0.0000 | Soft Loss: 0.6423 | Time: 3.3082s
Epoch 00134 | Loss: 0.6969 | Swap Loss: 0.0000 | Grad Loss: 0.5588 | Atten Loss: 0.0000 | Soft Loss: 0.6410 | Time: 3.2593s
F1-Score on valset:       whole 0.7408, part1 0.7390, part2 0.7428
F1-Score on testset:       whole 0.7621, part1 0.7595, part2 0.7648
Epoch 00135 | Loss: 0.6900 | Swap Loss: 0.0000 | Grad Loss: 0.5420 | Atten Loss: 0.0000 | Soft Loss: 0.6358 | Time: 3.3563s
Epoch 00136 | Loss: 0.6889 | Swap Loss: 0.0000 | Grad Loss: 0.5491 | Atten Loss: 0.0000 | Soft Loss: 0.6340 | Time: 3.3088s
Epoch 00137 | Loss: 0.6842 | Swap Loss: 0.0000 | Grad Loss: 0.5531 | Atten Loss: 0.0000 | Soft Loss: 0.6289 | Time: 3.1459s
Epoch 00138 | Loss: 0.6750 | Swap Loss: 0.0000 | Grad Loss: 0.5313 | Atten Loss: 0.0000 | Soft Loss: 0.6219 | Time: 3.4660s
Epoch 00139 | Loss: 0.6745 | Swap Loss: 0.0000 | Grad Loss: 0.5363 | Atten Loss: 0.0000 | Soft Loss: 0.6208 | Time: 3.3119s
F1-Score on valset:       whole 0.7455, part1 0.7438, part2 0.7473
F1-Score on testset:       whole 0.7676, part1 0.7652, part2 0.7700
Epoch 00140 | Loss: 0.6723 | Swap Loss: 0.0000 | Grad Loss: 0.5463 | Atten Loss: 0.0000 | Soft Loss: 0.6177 | Time: 3.3192s
Epoch 00141 | Loss: 0.6683 | Swap Loss: 0.0000 | Grad Loss: 0.5423 | Atten Loss: 0.0000 | Soft Loss: 0.6140 | Time: 3.1127s
Epoch 00142 | Loss: 0.6613 | Swap Loss: 0.0000 | Grad Loss: 0.5303 | Atten Loss: 0.0000 | Soft Loss: 0.6083 | Time: 3.2859s
Epoch 00143 | Loss: 0.6615 | Swap Loss: 0.0000 | Grad Loss: 0.5375 | Atten Loss: 0.0000 | Soft Loss: 0.6078 | Time: 3.3423s
Epoch 00144 | Loss: 0.6535 | Swap Loss: 0.0000 | Grad Loss: 0.5287 | Atten Loss: 0.0000 | Soft Loss: 0.6006 | Time: 3.2232s
F1-Score on valset:       whole 0.7562, part1 0.7540, part2 0.7584
F1-Score on testset:       whole 0.7782, part1 0.7757, part2 0.7808
Epoch 00145 | Loss: 0.6479 | Swap Loss: 0.0000 | Grad Loss: 0.5219 | Atten Loss: 0.0000 | Soft Loss: 0.5957 | Time: 3.4543s
Epoch 00146 | Loss: 0.6466 | Swap Loss: 0.0000 | Grad Loss: 0.5302 | Atten Loss: 0.0000 | Soft Loss: 0.5935 | Time: 3.3724s
Epoch 00147 | Loss: 0.6405 | Swap Loss: 0.0000 | Grad Loss: 0.5192 | Atten Loss: 0.0000 | Soft Loss: 0.5886 | Time: 3.4258s
Epoch 00148 | Loss: 0.6422 | Swap Loss: 0.0000 | Grad Loss: 0.5355 | Atten Loss: 0.0000 | Soft Loss: 0.5887 | Time: 3.3554s
Epoch 00149 | Loss: 0.6339 | Swap Loss: 0.0000 | Grad Loss: 0.5247 | Atten Loss: 0.0000 | Soft Loss: 0.5814 | Time: 3.3282s
F1-Score on valset:       whole 0.7694, part1 0.7672, part2 0.7716
F1-Score on testset:       whole 0.7924, part1 0.7900, part2 0.7948
Epoch 00150 | Loss: 0.6411 | Swap Loss: 0.0000 | Grad Loss: 0.5424 | Atten Loss: 0.0000 | Soft Loss: 0.5868 | Time: 3.1908s
Epoch 00151 | Loss: 0.6232 | Swap Loss: 0.0000 | Grad Loss: 0.5156 | Atten Loss: 0.0000 | Soft Loss: 0.5716 | Time: 3.3101s
Epoch 00152 | Loss: 0.6223 | Swap Loss: 0.0000 | Grad Loss: 0.5196 | Atten Loss: 0.0000 | Soft Loss: 0.5703 | Time: 3.2013s
Epoch 00153 | Loss: 0.6223 | Swap Loss: 0.0000 | Grad Loss: 0.5338 | Atten Loss: 0.0000 | Soft Loss: 0.5689 | Time: 3.3573s
Epoch 00154 | Loss: 0.6148 | Swap Loss: 0.0000 | Grad Loss: 0.5182 | Atten Loss: 0.0000 | Soft Loss: 0.5630 | Time: 3.0680s
F1-Score on valset:       whole 0.7782, part1 0.7769, part2 0.7795
F1-Score on testset:       whole 0.8010, part1 0.7990, part2 0.8030
Epoch 00155 | Loss: 0.6133 | Swap Loss: 0.0000 | Grad Loss: 0.5280 | Atten Loss: 0.0000 | Soft Loss: 0.5605 | Time: 2.9220s
Epoch 00156 | Loss: 0.6091 | Swap Loss: 0.0000 | Grad Loss: 0.5241 | Atten Loss: 0.0000 | Soft Loss: 0.5567 | Time: 3.2716s
Epoch 00157 | Loss: 0.5980 | Swap Loss: 0.0000 | Grad Loss: 0.5066 | Atten Loss: 0.0000 | Soft Loss: 0.5473 | Time: 3.2362s
Epoch 00158 | Loss: 0.5965 | Swap Loss: 0.0000 | Grad Loss: 0.5038 | Atten Loss: 0.0000 | Soft Loss: 0.5461 | Time: 3.3238s
Epoch 00159 | Loss: 0.5941 | Swap Loss: 0.0000 | Grad Loss: 0.5118 | Atten Loss: 0.0000 | Soft Loss: 0.5429 | Time: 3.3670s
F1-Score on valset:       whole 0.7840, part1 0.7832, part2 0.7847
F1-Score on testset:       whole 0.8078, part1 0.8061, part2 0.8095
Epoch 00160 | Loss: 0.5936 | Swap Loss: 0.0000 | Grad Loss: 0.5180 | Atten Loss: 0.0000 | Soft Loss: 0.5418 | Time: 3.3369s
Epoch 00161 | Loss: 0.5921 | Swap Loss: 0.0000 | Grad Loss: 0.5185 | Atten Loss: 0.0000 | Soft Loss: 0.5402 | Time: 3.2815s
Epoch 00162 | Loss: 0.5818 | Swap Loss: 0.0000 | Grad Loss: 0.5010 | Atten Loss: 0.0000 | Soft Loss: 0.5317 | Time: 3.5320s
Epoch 00163 | Loss: 0.5843 | Swap Loss: 0.0000 | Grad Loss: 0.5192 | Atten Loss: 0.0000 | Soft Loss: 0.5323 | Time: 3.4849s
Epoch 00164 | Loss: 0.5732 | Swap Loss: 0.0000 | Grad Loss: 0.4977 | Atten Loss: 0.0000 | Soft Loss: 0.5235 | Time: 3.3102s
F1-Score on valset:       whole 0.7932, part1 0.7916, part2 0.7948
F1-Score on testset:       whole 0.8165, part1 0.8148, part2 0.8183
Epoch 00165 | Loss: 0.5730 | Swap Loss: 0.0000 | Grad Loss: 0.5063 | Atten Loss: 0.0000 | Soft Loss: 0.5224 | Time: 3.1371s
Epoch 00166 | Loss: 0.5700 | Swap Loss: 0.0000 | Grad Loss: 0.5091 | Atten Loss: 0.0000 | Soft Loss: 0.5191 | Time: 3.2051s
Epoch 00167 | Loss: 0.5610 | Swap Loss: 0.0000 | Grad Loss: 0.4930 | Atten Loss: 0.0000 | Soft Loss: 0.5117 | Time: 3.1698s
Epoch 00168 | Loss: 0.5596 | Swap Loss: 0.0000 | Grad Loss: 0.4951 | Atten Loss: 0.0000 | Soft Loss: 0.5101 | Time: 3.1819s
Epoch 00169 | Loss: 0.5537 | Swap Loss: 0.0000 | Grad Loss: 0.4891 | Atten Loss: 0.0000 | Soft Loss: 0.5048 | Time: 3.2651s
F1-Score on valset:       whole 0.8014, part1 0.7999, part2 0.8030
F1-Score on testset:       whole 0.8254, part1 0.8238, part2 0.8271
Epoch 00170 | Loss: 0.5507 | Swap Loss: 0.0000 | Grad Loss: 0.4954 | Atten Loss: 0.0000 | Soft Loss: 0.5011 | Time: 3.4850s
Epoch 00171 | Loss: 0.5491 | Swap Loss: 0.0000 | Grad Loss: 0.4992 | Atten Loss: 0.0000 | Soft Loss: 0.4992 | Time: 3.2434s
Epoch 00172 | Loss: 0.5455 | Swap Loss: 0.0000 | Grad Loss: 0.4967 | Atten Loss: 0.0000 | Soft Loss: 0.4958 | Time: 3.2817s
Epoch 00173 | Loss: 0.5418 | Swap Loss: 0.0000 | Grad Loss: 0.4961 | Atten Loss: 0.0000 | Soft Loss: 0.4922 | Time: 3.3758s
Epoch 00174 | Loss: 0.5374 | Swap Loss: 0.0000 | Grad Loss: 0.4895 | Atten Loss: 0.0000 | Soft Loss: 0.4884 | Time: 3.2495s
F1-Score on valset:       whole 0.8106, part1 0.8094, part2 0.8118
F1-Score on testset:       whole 0.8351, part1 0.8337, part2 0.8365
Epoch 00175 | Loss: 0.5410 | Swap Loss: 0.0000 | Grad Loss: 0.5029 | Atten Loss: 0.0000 | Soft Loss: 0.4907 | Time: 3.1235s
Epoch 00176 | Loss: 0.5289 | Swap Loss: 0.0000 | Grad Loss: 0.4818 | Atten Loss: 0.0000 | Soft Loss: 0.4807 | Time: 3.2949s
Epoch 00177 | Loss: 0.5274 | Swap Loss: 0.0000 | Grad Loss: 0.4907 | Atten Loss: 0.0000 | Soft Loss: 0.4783 | Time: 3.3196s
Epoch 00178 | Loss: 0.5359 | Swap Loss: 0.0000 | Grad Loss: 0.5094 | Atten Loss: 0.0000 | Soft Loss: 0.4850 | Time: 3.3045s
Epoch 00179 | Loss: 0.5218 | Swap Loss: 0.0000 | Grad Loss: 0.4908 | Atten Loss: 0.0000 | Soft Loss: 0.4728 | Time: 3.5054s
F1-Score on valset:       whole 0.8181, part1 0.8167, part2 0.8196
F1-Score on testset:       whole 0.8428, part1 0.8416, part2 0.8441
Epoch 00180 | Loss: 0.5240 | Swap Loss: 0.0000 | Grad Loss: 0.4971 | Atten Loss: 0.0000 | Soft Loss: 0.4743 | Time: 3.3125s
Epoch 00181 | Loss: 0.5197 | Swap Loss: 0.0000 | Grad Loss: 0.4988 | Atten Loss: 0.0000 | Soft Loss: 0.4699 | Time: 3.3031s
Epoch 00182 | Loss: 0.5178 | Swap Loss: 0.0000 | Grad Loss: 0.4998 | Atten Loss: 0.0000 | Soft Loss: 0.4678 | Time: 3.0836s
Epoch 00183 | Loss: 0.5077 | Swap Loss: 0.0000 | Grad Loss: 0.4850 | Atten Loss: 0.0000 | Soft Loss: 0.4592 | Time: 3.3130s
Epoch 00184 | Loss: 0.5134 | Swap Loss: 0.0000 | Grad Loss: 0.4962 | Atten Loss: 0.0000 | Soft Loss: 0.4638 | Time: 3.0371s
F1-Score on valset:       whole 0.8261, part1 0.8256, part2 0.8266
F1-Score on testset:       whole 0.8516, part1 0.8507, part2 0.8525
Epoch 00185 | Loss: 0.5010 | Swap Loss: 0.0000 | Grad Loss: 0.4826 | Atten Loss: 0.0000 | Soft Loss: 0.4528 | Time: 3.4176s
Epoch 00186 | Loss: 0.5029 | Swap Loss: 0.0000 | Grad Loss: 0.4935 | Atten Loss: 0.0000 | Soft Loss: 0.4535 | Time: 3.4449s
Epoch 00187 | Loss: 0.4918 | Swap Loss: 0.0000 | Grad Loss: 0.4709 | Atten Loss: 0.0000 | Soft Loss: 0.4447 | Time: 3.2887s
Epoch 00188 | Loss: 0.4867 | Swap Loss: 0.0000 | Grad Loss: 0.4680 | Atten Loss: 0.0000 | Soft Loss: 0.4399 | Time: 7.1154s
Epoch 00189 | Loss: 0.4856 | Swap Loss: 0.0000 | Grad Loss: 0.4777 | Atten Loss: 0.0000 | Soft Loss: 0.4378 | Time: 3.1055s
F1-Score on valset:       whole 0.8299, part1 0.8290, part2 0.8308
F1-Score on testset:       whole 0.8550, part1 0.8542, part2 0.8559
Epoch 00190 | Loss: 0.4808 | Swap Loss: 0.0000 | Grad Loss: 0.4690 | Atten Loss: 0.0000 | Soft Loss: 0.4339 | Time: 3.3822s
Epoch 00191 | Loss: 0.4759 | Swap Loss: 0.0000 | Grad Loss: 0.4654 | Atten Loss: 0.0000 | Soft Loss: 0.4294 | Time: 3.3396s
Epoch 00192 | Loss: 0.4781 | Swap Loss: 0.0000 | Grad Loss: 0.4759 | Atten Loss: 0.0000 | Soft Loss: 0.4305 | Time: 3.4667s
Epoch 00193 | Loss: 0.4758 | Swap Loss: 0.0000 | Grad Loss: 0.4772 | Atten Loss: 0.0000 | Soft Loss: 0.4281 | Time: 3.2779s
Epoch 00194 | Loss: 0.4707 | Swap Loss: 0.0000 | Grad Loss: 0.4697 | Atten Loss: 0.0000 | Soft Loss: 0.4237 | Time: 3.0686s
F1-Score on valset:       whole 0.8388, part1 0.8383, part2 0.8393
F1-Score on testset:       whole 0.8642, part1 0.8634, part2 0.8650
Epoch 00195 | Loss: 0.4651 | Swap Loss: 0.0000 | Grad Loss: 0.4660 | Atten Loss: 0.0000 | Soft Loss: 0.4185 | Time: 3.4339s
Epoch 00196 | Loss: 0.4620 | Swap Loss: 0.0000 | Grad Loss: 0.4660 | Atten Loss: 0.0000 | Soft Loss: 0.4154 | Time: 3.3421s
Epoch 00197 | Loss: 0.4639 | Swap Loss: 0.0000 | Grad Loss: 0.4711 | Atten Loss: 0.0000 | Soft Loss: 0.4168 | Time: 3.2978s
Epoch 00198 | Loss: 0.4590 | Swap Loss: 0.0000 | Grad Loss: 0.4667 | Atten Loss: 0.0000 | Soft Loss: 0.4123 | Time: 3.3145s
Epoch 00199 | Loss: 0.4602 | Swap Loss: 0.0000 | Grad Loss: 0.4762 | Atten Loss: 0.0000 | Soft Loss: 0.4126 | Time: 3.2144s
F1-Score on valset:       whole 0.8440, part1 0.8436, part2 0.8443
F1-Score on testset:       whole 0.8697, part1 0.8690, part2 0.8703
Epoch 00200 | Loss: 0.4522 | Swap Loss: 0.0000 | Grad Loss: 0.4627 | Atten Loss: 0.0000 | Soft Loss: 0.4059 | Time: 3.1706s
Epoch 00201 | Loss: 0.4533 | Swap Loss: 0.0000 | Grad Loss: 0.4744 | Atten Loss: 0.0000 | Soft Loss: 0.4059 | Time: 3.4048s
Epoch 00202 | Loss: 0.4468 | Swap Loss: 0.0000 | Grad Loss: 0.4649 | Atten Loss: 0.0000 | Soft Loss: 0.4003 | Time: 3.2772s
Epoch 00203 | Loss: 0.4382 | Swap Loss: 0.0000 | Grad Loss: 0.4529 | Atten Loss: 0.0000 | Soft Loss: 0.3929 | Time: 3.1693s
Epoch 00204 | Loss: 0.4420 | Swap Loss: 0.0000 | Grad Loss: 0.4638 | Atten Loss: 0.0000 | Soft Loss: 0.3956 | Time: 3.1939s
F1-Score on valset:       whole 0.8515, part1 0.8510, part2 0.8519
F1-Score on testset:       whole 0.8772, part1 0.8769, part2 0.8774
Epoch 00205 | Loss: 0.4496 | Swap Loss: 0.0000 | Grad Loss: 0.4821 | Atten Loss: 0.0000 | Soft Loss: 0.4014 | Time: 3.3568s
Epoch 00206 | Loss: 0.4346 | Swap Loss: 0.0000 | Grad Loss: 0.4605 | Atten Loss: 0.0000 | Soft Loss: 0.3886 | Time: 3.5209s
Epoch 00207 | Loss: 0.4311 | Swap Loss: 0.0000 | Grad Loss: 0.4586 | Atten Loss: 0.0000 | Soft Loss: 0.3852 | Time: 3.4249s
Epoch 00208 | Loss: 0.4469 | Swap Loss: 0.0000 | Grad Loss: 0.4855 | Atten Loss: 0.0000 | Soft Loss: 0.3983 | Time: 3.1944s
Epoch 00209 | Loss: 0.4257 | Swap Loss: 0.0000 | Grad Loss: 0.4564 | Atten Loss: 0.0000 | Soft Loss: 0.3800 | Time: 3.0244s
F1-Score on valset:       whole 0.8569, part1 0.8570, part2 0.8567
F1-Score on testset:       whole 0.8825, part1 0.8825, part2 0.8826
Epoch 00210 | Loss: 0.4251 | Swap Loss: 0.0000 | Grad Loss: 0.4614 | Atten Loss: 0.0000 | Soft Loss: 0.3790 | Time: 3.4913s
Epoch 00211 | Loss: 0.4254 | Swap Loss: 0.0000 | Grad Loss: 0.4635 | Atten Loss: 0.0000 | Soft Loss: 0.3791 | Time: 3.2744s
Epoch 00212 | Loss: 0.4155 | Swap Loss: 0.0000 | Grad Loss: 0.4512 | Atten Loss: 0.0000 | Soft Loss: 0.3704 | Time: 3.3332s
Epoch 00213 | Loss: 0.4203 | Swap Loss: 0.0000 | Grad Loss: 0.4656 | Atten Loss: 0.0000 | Soft Loss: 0.3737 | Time: 3.3212s
Epoch 00214 | Loss: 0.4133 | Swap Loss: 0.0000 | Grad Loss: 0.4560 | Atten Loss: 0.0000 | Soft Loss: 0.3677 | Time: 3.1865s
F1-Score on valset:       whole 0.8604, part1 0.8607, part2 0.8601
F1-Score on testset:       whole 0.8861, part1 0.8859, part2 0.8863
Epoch 00215 | Loss: 0.4073 | Swap Loss: 0.0000 | Grad Loss: 0.4441 | Atten Loss: 0.0000 | Soft Loss: 0.3629 | Time: 3.0533s
Epoch 00216 | Loss: 0.4164 | Swap Loss: 0.0000 | Grad Loss: 0.4622 | Atten Loss: 0.0000 | Soft Loss: 0.3702 | Time: 3.2540s
Epoch 00217 | Loss: 0.4027 | Swap Loss: 0.0000 | Grad Loss: 0.4464 | Atten Loss: 0.0000 | Soft Loss: 0.3581 | Time: 3.1047s
Epoch 00218 | Loss: 0.4105 | Swap Loss: 0.0000 | Grad Loss: 0.4655 | Atten Loss: 0.0000 | Soft Loss: 0.3639 | Time: 3.0721s
Epoch 00219 | Loss: 0.4032 | Swap Loss: 0.0000 | Grad Loss: 0.4518 | Atten Loss: 0.0000 | Soft Loss: 0.3580 | Time: 3.0478s
F1-Score on valset:       whole 0.8658, part1 0.8657, part2 0.8658
F1-Score on testset:       whole 0.8916, part1 0.8912, part2 0.8920
Epoch 00220 | Loss: 0.4129 | Swap Loss: 0.0000 | Grad Loss: 0.4678 | Atten Loss: 0.0000 | Soft Loss: 0.3661 | Time: 3.0575s
Epoch 00221 | Loss: 0.3965 | Swap Loss: 0.0000 | Grad Loss: 0.4488 | Atten Loss: 0.0000 | Soft Loss: 0.3516 | Time: 3.0890s
Epoch 00222 | Loss: 0.3913 | Swap Loss: 0.0000 | Grad Loss: 0.4431 | Atten Loss: 0.0000 | Soft Loss: 0.3470 | Time: 3.2063s
Epoch 00223 | Loss: 0.3870 | Swap Loss: 0.0000 | Grad Loss: 0.4372 | Atten Loss: 0.0000 | Soft Loss: 0.3433 | Time: 3.4893s
Epoch 00224 | Loss: 0.3925 | Swap Loss: 0.0000 | Grad Loss: 0.4527 | Atten Loss: 0.0000 | Soft Loss: 0.3472 | Time: 3.1544s
F1-Score on valset:       whole 0.8723, part1 0.8723, part2 0.8723
F1-Score on testset:       whole 0.8977, part1 0.8978, part2 0.8976
Epoch 00225 | Loss: 0.4000 | Swap Loss: 0.0000 | Grad Loss: 0.4659 | Atten Loss: 0.0000 | Soft Loss: 0.3534 | Time: 3.4649s
Epoch 00226 | Loss: 0.3826 | Swap Loss: 0.0000 | Grad Loss: 0.4459 | Atten Loss: 0.0000 | Soft Loss: 0.3380 | Time: 3.3702s
Epoch 00227 | Loss: 0.3842 | Swap Loss: 0.0000 | Grad Loss: 0.4511 | Atten Loss: 0.0000 | Soft Loss: 0.3391 | Time: 3.3947s
Epoch 00228 | Loss: 0.3897 | Swap Loss: 0.0000 | Grad Loss: 0.4591 | Atten Loss: 0.0000 | Soft Loss: 0.3438 | Time: 3.2736s
Epoch 00229 | Loss: 0.3757 | Swap Loss: 0.0000 | Grad Loss: 0.4422 | Atten Loss: 0.0000 | Soft Loss: 0.3315 | Time: 3.1950s
F1-Score on valset:       whole 0.8728, part1 0.8730, part2 0.8726
F1-Score on testset:       whole 0.8986, part1 0.8981, part2 0.8992
Epoch 00230 | Loss: 0.3793 | Swap Loss: 0.0000 | Grad Loss: 0.4527 | Atten Loss: 0.0000 | Soft Loss: 0.3340 | Time: 3.2399s
Epoch 00231 | Loss: 0.3706 | Swap Loss: 0.0000 | Grad Loss: 0.4380 | Atten Loss: 0.0000 | Soft Loss: 0.3268 | Time: 3.3824s
Epoch 00232 | Loss: 0.3750 | Swap Loss: 0.0000 | Grad Loss: 0.4514 | Atten Loss: 0.0000 | Soft Loss: 0.3298 | Time: 3.4772s
Epoch 00233 | Loss: 0.3768 | Swap Loss: 0.0000 | Grad Loss: 0.4504 | Atten Loss: 0.0000 | Soft Loss: 0.3317 | Time: 3.1788s
Epoch 00234 | Loss: 0.3700 | Swap Loss: 0.0000 | Grad Loss: 0.4513 | Atten Loss: 0.0000 | Soft Loss: 0.3248 | Time: 3.2440s
F1-Score on valset:       whole 0.8778, part1 0.8777, part2 0.8780
F1-Score on testset:       whole 0.9031, part1 0.9028, part2 0.9034
Epoch 00235 | Loss: 0.3635 | Swap Loss: 0.0000 | Grad Loss: 0.4359 | Atten Loss: 0.0000 | Soft Loss: 0.3199 | Time: 3.2577s
Epoch 00236 | Loss: 0.3663 | Swap Loss: 0.0000 | Grad Loss: 0.4519 | Atten Loss: 0.0000 | Soft Loss: 0.3211 | Time: 3.2094s
Epoch 00237 | Loss: 0.3640 | Swap Loss: 0.0000 | Grad Loss: 0.4481 | Atten Loss: 0.0000 | Soft Loss: 0.3192 | Time: 3.1162s
Epoch 00238 | Loss: 0.3539 | Swap Loss: 0.0000 | Grad Loss: 0.4305 | Atten Loss: 0.0000 | Soft Loss: 0.3109 | Time: 3.2590s
Epoch 00239 | Loss: 0.3623 | Swap Loss: 0.0000 | Grad Loss: 0.4425 | Atten Loss: 0.0000 | Soft Loss: 0.3181 | Time: 3.2469s
F1-Score on valset:       whole 0.8814, part1 0.8814, part2 0.8813
F1-Score on testset:       whole 0.9069, part1 0.9066, part2 0.9071
Epoch 00240 | Loss: 0.3528 | Swap Loss: 0.0000 | Grad Loss: 0.4342 | Atten Loss: 0.0000 | Soft Loss: 0.3094 | Time: 3.1767s
Epoch 00241 | Loss: 0.3479 | Swap Loss: 0.0000 | Grad Loss: 0.4276 | Atten Loss: 0.0000 | Soft Loss: 0.3051 | Time: 3.1224s
Epoch 00242 | Loss: 0.3496 | Swap Loss: 0.0000 | Grad Loss: 0.4381 | Atten Loss: 0.0000 | Soft Loss: 0.3058 | Time: 3.2103s
Epoch 00243 | Loss: 0.3448 | Swap Loss: 0.0000 | Grad Loss: 0.4286 | Atten Loss: 0.0000 | Soft Loss: 0.3019 | Time: 3.3047s
Epoch 00244 | Loss: 0.3424 | Swap Loss: 0.0000 | Grad Loss: 0.4281 | Atten Loss: 0.0000 | Soft Loss: 0.2996 | Time: 3.0393s
F1-Score on valset:       whole 0.8867, part1 0.8867, part2 0.8867
F1-Score on testset:       whole 0.9118, part1 0.9117, part2 0.9120
Epoch 00245 | Loss: 0.3457 | Swap Loss: 0.0000 | Grad Loss: 0.4392 | Atten Loss: 0.0000 | Soft Loss: 0.3018 | Time: 3.2876s
Epoch 00246 | Loss: 0.3373 | Swap Loss: 0.0000 | Grad Loss: 0.4237 | Atten Loss: 0.0000 | Soft Loss: 0.2950 | Time: 3.3706s
Epoch 00247 | Loss: 0.3386 | Swap Loss: 0.0000 | Grad Loss: 0.4361 | Atten Loss: 0.0000 | Soft Loss: 0.2950 | Time: 3.3925s
Epoch 00248 | Loss: 0.3388 | Swap Loss: 0.0000 | Grad Loss: 0.4329 | Atten Loss: 0.0000 | Soft Loss: 0.2955 | Time: 3.4731s
Epoch 00249 | Loss: 0.3362 | Swap Loss: 0.0000 | Grad Loss: 0.4301 | Atten Loss: 0.0000 | Soft Loss: 0.2931 | Time: 3.2276s
F1-Score on valset:       whole 0.8907, part1 0.8908, part2 0.8906
F1-Score on testset:       whole 0.9152, part1 0.9150, part2 0.9154
Epoch 00250 | Loss: 0.3324 | Swap Loss: 0.0000 | Grad Loss: 0.4289 | Atten Loss: 0.0000 | Soft Loss: 0.2896 | Time: 3.3902s
Epoch 00251 | Loss: 0.3339 | Swap Loss: 0.0000 | Grad Loss: 0.4335 | Atten Loss: 0.0000 | Soft Loss: 0.2906 | Time: 3.1619s
Epoch 00252 | Loss: 0.3305 | Swap Loss: 0.0000 | Grad Loss: 0.4314 | Atten Loss: 0.0000 | Soft Loss: 0.2874 | Time: 3.3920s
Epoch 00253 | Loss: 0.3295 | Swap Loss: 0.0000 | Grad Loss: 0.4313 | Atten Loss: 0.0000 | Soft Loss: 0.2864 | Time: 3.2066s
Epoch 00254 | Loss: 0.3280 | Swap Loss: 0.0000 | Grad Loss: 0.4337 | Atten Loss: 0.0000 | Soft Loss: 0.2847 | Time: 3.3174s
F1-Score on valset:       whole 0.8944, part1 0.8944, part2 0.8944
F1-Score on testset:       whole 0.9191, part1 0.9191, part2 0.9190
Epoch 00255 | Loss: 0.3275 | Swap Loss: 0.0000 | Grad Loss: 0.4326 | Atten Loss: 0.0000 | Soft Loss: 0.2842 | Time: 3.3528s
Epoch 00256 | Loss: 0.3217 | Swap Loss: 0.0000 | Grad Loss: 0.4255 | Atten Loss: 0.0000 | Soft Loss: 0.2792 | Time: 3.3063s
Epoch 00257 | Loss: 0.3171 | Swap Loss: 0.0000 | Grad Loss: 0.4186 | Atten Loss: 0.0000 | Soft Loss: 0.2752 | Time: 3.3768s
Epoch 00258 | Loss: 0.3156 | Swap Loss: 0.0000 | Grad Loss: 0.4180 | Atten Loss: 0.0000 | Soft Loss: 0.2738 | Time: 2.9700s
Epoch 00259 | Loss: 0.3131 | Swap Loss: 0.0000 | Grad Loss: 0.4194 | Atten Loss: 0.0000 | Soft Loss: 0.2712 | Time: 3.2715s
F1-Score on valset:       whole 0.8978, part1 0.8979, part2 0.8977
F1-Score on testset:       whole 0.9222, part1 0.9222, part2 0.9222
Epoch 00260 | Loss: 0.3180 | Swap Loss: 0.0000 | Grad Loss: 0.4291 | Atten Loss: 0.0000 | Soft Loss: 0.2751 | Time: 3.4560s
Epoch 00261 | Loss: 0.3103 | Swap Loss: 0.0000 | Grad Loss: 0.4145 | Atten Loss: 0.0000 | Soft Loss: 0.2688 | Time: 3.0702s
Epoch 00262 | Loss: 0.3103 | Swap Loss: 0.0000 | Grad Loss: 0.4203 | Atten Loss: 0.0000 | Soft Loss: 0.2683 | Time: 3.4454s
Epoch 00263 | Loss: 0.3070 | Swap Loss: 0.0000 | Grad Loss: 0.4163 | Atten Loss: 0.0000 | Soft Loss: 0.2654 | Time: 3.3167s
Epoch 00264 | Loss: 0.3075 | Swap Loss: 0.0000 | Grad Loss: 0.4246 | Atten Loss: 0.0000 | Soft Loss: 0.2651 | Time: 3.2026s
F1-Score on valset:       whole 0.9004, part1 0.9006, part2 0.9003
F1-Score on testset:       whole 0.9247, part1 0.9249, part2 0.9246
Epoch 00265 | Loss: 0.3053 | Swap Loss: 0.0000 | Grad Loss: 0.4192 | Atten Loss: 0.0000 | Soft Loss: 0.2634 | Time: 7.3185s
Epoch 00266 | Loss: 0.3032 | Swap Loss: 0.0000 | Grad Loss: 0.4154 | Atten Loss: 0.0000 | Soft Loss: 0.2616 | Time: 3.3848s
Epoch 00267 | Loss: 0.3082 | Swap Loss: 0.0000 | Grad Loss: 0.4290 | Atten Loss: 0.0000 | Soft Loss: 0.2653 | Time: 3.3793s
Epoch 00268 | Loss: 0.2982 | Swap Loss: 0.0000 | Grad Loss: 0.4106 | Atten Loss: 0.0000 | Soft Loss: 0.2571 | Time: 3.1844s
Epoch 00269 | Loss: 0.2966 | Swap Loss: 0.0000 | Grad Loss: 0.4109 | Atten Loss: 0.0000 | Soft Loss: 0.2555 | Time: 3.2313s
F1-Score on valset:       whole 0.9029, part1 0.9030, part2 0.9027
F1-Score on testset:       whole 0.9272, part1 0.9274, part2 0.9270
Epoch 00270 | Loss: 0.3114 | Swap Loss: 0.0000 | Grad Loss: 0.4355 | Atten Loss: 0.0000 | Soft Loss: 0.2679 | Time: 3.7197s
Epoch 00271 | Loss: 0.2976 | Swap Loss: 0.0000 | Grad Loss: 0.4208 | Atten Loss: 0.0000 | Soft Loss: 0.2555 | Time: 3.3616s
Epoch 00272 | Loss: 0.2948 | Swap Loss: 0.0000 | Grad Loss: 0.4143 | Atten Loss: 0.0000 | Soft Loss: 0.2534 | Time: 3.4635s
Epoch 00273 | Loss: 0.2895 | Swap Loss: 0.0000 | Grad Loss: 0.4103 | Atten Loss: 0.0000 | Soft Loss: 0.2485 | Time: 3.4555s
Epoch 00274 | Loss: 0.2917 | Swap Loss: 0.0000 | Grad Loss: 0.4119 | Atten Loss: 0.0000 | Soft Loss: 0.2505 | Time: 3.2760s
F1-Score on valset:       whole 0.9066, part1 0.9068, part2 0.9064
F1-Score on testset:       whole 0.9306, part1 0.9308, part2 0.9304
Epoch 00275 | Loss: 0.2860 | Swap Loss: 0.0000 | Grad Loss: 0.4067 | Atten Loss: 0.0000 | Soft Loss: 0.2453 | Time: 3.3910s
Epoch 00276 | Loss: 0.2917 | Swap Loss: 0.0000 | Grad Loss: 0.4184 | Atten Loss: 0.0000 | Soft Loss: 0.2499 | Time: 3.2244s
Epoch 00277 | Loss: 0.2819 | Swap Loss: 0.0000 | Grad Loss: 0.4067 | Atten Loss: 0.0000 | Soft Loss: 0.2412 | Time: 3.2921s
Epoch 00278 | Loss: 0.2843 | Swap Loss: 0.0000 | Grad Loss: 0.4073 | Atten Loss: 0.0000 | Soft Loss: 0.2436 | Time: 3.4041s
Epoch 00279 | Loss: 0.2963 | Swap Loss: 0.0000 | Grad Loss: 0.4298 | Atten Loss: 0.0000 | Soft Loss: 0.2533 | Time: 3.1957s
F1-Score on valset:       whole 0.9079, part1 0.9077, part2 0.9080
F1-Score on testset:       whole 0.9321, part1 0.9322, part2 0.9321
Epoch 00280 | Loss: 0.2766 | Swap Loss: 0.0000 | Grad Loss: 0.3984 | Atten Loss: 0.0000 | Soft Loss: 0.2368 | Time: 3.3455s
Epoch 00281 | Loss: 0.2839 | Swap Loss: 0.0000 | Grad Loss: 0.4136 | Atten Loss: 0.0000 | Soft Loss: 0.2425 | Time: 3.3314s
Epoch 00282 | Loss: 0.2823 | Swap Loss: 0.0000 | Grad Loss: 0.4130 | Atten Loss: 0.0000 | Soft Loss: 0.2410 | Time: 3.3012s
Epoch 00283 | Loss: 0.2768 | Swap Loss: 0.0000 | Grad Loss: 0.4041 | Atten Loss: 0.0000 | Soft Loss: 0.2364 | Time: 3.2116s
Epoch 00284 | Loss: 0.2842 | Swap Loss: 0.0000 | Grad Loss: 0.4197 | Atten Loss: 0.0000 | Soft Loss: 0.2423 | Time: 3.2984s
F1-Score on valset:       whole 0.9104, part1 0.9102, part2 0.9106
F1-Score on testset:       whole 0.9341, part1 0.9343, part2 0.9340
Epoch 00285 | Loss: 0.2756 | Swap Loss: 0.0000 | Grad Loss: 0.4109 | Atten Loss: 0.0000 | Soft Loss: 0.2345 | Time: 3.2536s
Epoch 00286 | Loss: 0.2730 | Swap Loss: 0.0000 | Grad Loss: 0.4066 | Atten Loss: 0.0000 | Soft Loss: 0.2323 | Time: 3.3645s
Epoch 00287 | Loss: 0.2741 | Swap Loss: 0.0000 | Grad Loss: 0.4071 | Atten Loss: 0.0000 | Soft Loss: 0.2334 | Time: 3.3165s
Epoch 00288 | Loss: 0.2684 | Swap Loss: 0.0000 | Grad Loss: 0.4009 | Atten Loss: 0.0000 | Soft Loss: 0.2283 | Time: 3.1882s
Epoch 00289 | Loss: 0.2675 | Swap Loss: 0.0000 | Grad Loss: 0.4034 | Atten Loss: 0.0000 | Soft Loss: 0.2272 | Time: 3.2863s
F1-Score on valset:       whole 0.9130, part1 0.9127, part2 0.9132
F1-Score on testset:       whole 0.9366, part1 0.9368, part2 0.9364
Epoch 00290 | Loss: 0.2680 | Swap Loss: 0.0000 | Grad Loss: 0.4078 | Atten Loss: 0.0000 | Soft Loss: 0.2273 | Time: 3.4213s
Epoch 00291 | Loss: 0.2635 | Swap Loss: 0.0000 | Grad Loss: 0.3967 | Atten Loss: 0.0000 | Soft Loss: 0.2238 | Time: 3.4345s
Epoch 00292 | Loss: 0.2614 | Swap Loss: 0.0000 | Grad Loss: 0.3998 | Atten Loss: 0.0000 | Soft Loss: 0.2214 | Time: 3.2827s
Epoch 00293 | Loss: 0.2609 | Swap Loss: 0.0000 | Grad Loss: 0.3964 | Atten Loss: 0.0000 | Soft Loss: 0.2213 | Time: 3.2183s
Epoch 00294 | Loss: 0.2574 | Swap Loss: 0.0000 | Grad Loss: 0.3948 | Atten Loss: 0.0000 | Soft Loss: 0.2179 | Time: 3.1124s
F1-Score on valset:       whole 0.9146, part1 0.9146, part2 0.9146
F1-Score on testset:       whole 0.9379, part1 0.9383, part2 0.9374
Epoch 00295 | Loss: 0.2658 | Swap Loss: 0.0000 | Grad Loss: 0.4055 | Atten Loss: 0.0000 | Soft Loss: 0.2253 | Time: 3.2650s
Epoch 00296 | Loss: 0.2620 | Swap Loss: 0.0000 | Grad Loss: 0.4060 | Atten Loss: 0.0000 | Soft Loss: 0.2214 | Time: 3.5297s
Epoch 00297 | Loss: 0.2588 | Swap Loss: 0.0000 | Grad Loss: 0.4010 | Atten Loss: 0.0000 | Soft Loss: 0.2187 | Time: 3.4261s
Epoch 00298 | Loss: 0.2551 | Swap Loss: 0.0000 | Grad Loss: 0.3972 | Atten Loss: 0.0000 | Soft Loss: 0.2154 | Time: 3.1407s
Epoch 00299 | Loss: 0.2541 | Swap Loss: 0.0000 | Grad Loss: 0.3944 | Atten Loss: 0.0000 | Soft Loss: 0.2147 | Time: 3.2585s
F1-Score on valset:       whole 0.9176, part1 0.9174, part2 0.9177
F1-Score on testset:       whole 0.9402, part1 0.9405, part2 0.9398
Epoch 00300 | Loss: 0.2533 | Swap Loss: 0.0000 | Grad Loss: 0.3953 | Atten Loss: 0.0000 | Soft Loss: 0.2138 | Time: 3.3489s
Epoch 00301 | Loss: 0.2532 | Swap Loss: 0.0000 | Grad Loss: 0.3984 | Atten Loss: 0.0000 | Soft Loss: 0.2133 | Time: 3.4262s
Epoch 00302 | Loss: 0.2531 | Swap Loss: 0.0000 | Grad Loss: 0.3998 | Atten Loss: 0.0000 | Soft Loss: 0.2132 | Time: 3.4315s
Epoch 00303 | Loss: 0.2502 | Swap Loss: 0.0000 | Grad Loss: 0.3956 | Atten Loss: 0.0000 | Soft Loss: 0.2106 | Time: 3.4387s
Epoch 00304 | Loss: 0.2519 | Swap Loss: 0.0000 | Grad Loss: 0.3980 | Atten Loss: 0.0000 | Soft Loss: 0.2121 | Time: 3.4081s
F1-Score on valset:       whole 0.9199, part1 0.9200, part2 0.9197
F1-Score on testset:       whole 0.9424, part1 0.9428, part2 0.9421
Epoch 00305 | Loss: 0.2443 | Swap Loss: 0.0000 | Grad Loss: 0.3860 | Atten Loss: 0.0000 | Soft Loss: 0.2057 | Time: 3.3311s
Epoch 00306 | Loss: 0.2421 | Swap Loss: 0.0000 | Grad Loss: 0.3884 | Atten Loss: 0.0000 | Soft Loss: 0.2032 | Time: 3.1861s
Epoch 00307 | Loss: 0.2439 | Swap Loss: 0.0000 | Grad Loss: 0.3926 | Atten Loss: 0.0000 | Soft Loss: 0.2047 | Time: 2.9532s
Epoch 00308 | Loss: 0.2461 | Swap Loss: 0.0000 | Grad Loss: 0.3976 | Atten Loss: 0.0000 | Soft Loss: 0.2063 | Time: 3.1891s
Epoch 00309 | Loss: 0.2442 | Swap Loss: 0.0000 | Grad Loss: 0.3939 | Atten Loss: 0.0000 | Soft Loss: 0.2048 | Time: 3.3833s
F1-Score on valset:       whole 0.9215, part1 0.9216, part2 0.9214
F1-Score on testset:       whole 0.9442, part1 0.9447, part2 0.9437
Epoch 00310 | Loss: 0.2424 | Swap Loss: 0.0000 | Grad Loss: 0.3922 | Atten Loss: 0.0000 | Soft Loss: 0.2032 | Time: 3.4627s
Epoch 00311 | Loss: 0.2415 | Swap Loss: 0.0000 | Grad Loss: 0.3936 | Atten Loss: 0.0000 | Soft Loss: 0.2022 | Time: 3.5227s
Epoch 00312 | Loss: 0.2394 | Swap Loss: 0.0000 | Grad Loss: 0.3928 | Atten Loss: 0.0000 | Soft Loss: 0.2001 | Time: 3.3793s
Epoch 00313 | Loss: 0.2352 | Swap Loss: 0.0000 | Grad Loss: 0.3851 | Atten Loss: 0.0000 | Soft Loss: 0.1967 | Time: 3.4102s
Epoch 00314 | Loss: 0.2355 | Swap Loss: 0.0000 | Grad Loss: 0.3877 | Atten Loss: 0.0000 | Soft Loss: 0.1967 | Time: 3.3307s
F1-Score on valset:       whole 0.9236, part1 0.9235, part2 0.9236
F1-Score on testset:       whole 0.9457, part1 0.9461, part2 0.9452
Epoch 00315 | Loss: 0.2326 | Swap Loss: 0.0000 | Grad Loss: 0.3865 | Atten Loss: 0.0000 | Soft Loss: 0.1940 | Time: 3.2699s
Epoch 00316 | Loss: 0.2350 | Swap Loss: 0.0000 | Grad Loss: 0.3891 | Atten Loss: 0.0000 | Soft Loss: 0.1961 | Time: 3.4112s
Epoch 00317 | Loss: 0.2356 | Swap Loss: 0.0000 | Grad Loss: 0.3939 | Atten Loss: 0.0000 | Soft Loss: 0.1962 | Time: 3.0975s
Epoch 00318 | Loss: 0.2435 | Swap Loss: 0.0000 | Grad Loss: 0.4060 | Atten Loss: 0.0000 | Soft Loss: 0.2029 | Time: 3.3022s
Epoch 00319 | Loss: 0.2279 | Swap Loss: 0.0000 | Grad Loss: 0.3859 | Atten Loss: 0.0000 | Soft Loss: 0.1893 | Time: 3.0078s
F1-Score on valset:       whole 0.9247, part1 0.9250, part2 0.9245
F1-Score on testset:       whole 0.9467, part1 0.9471, part2 0.9463
Epoch 00320 | Loss: 0.2366 | Swap Loss: 0.0000 | Grad Loss: 0.4009 | Atten Loss: 0.0000 | Soft Loss: 0.1965 | Time: 3.4005s
Epoch 00321 | Loss: 0.2254 | Swap Loss: 0.0000 | Grad Loss: 0.3803 | Atten Loss: 0.0000 | Soft Loss: 0.1873 | Time: 3.4721s
Epoch 00322 | Loss: 0.2295 | Swap Loss: 0.0000 | Grad Loss: 0.3880 | Atten Loss: 0.0000 | Soft Loss: 0.1907 | Time: 3.3528s
Epoch 00323 | Loss: 0.2256 | Swap Loss: 0.0000 | Grad Loss: 0.3843 | Atten Loss: 0.0000 | Soft Loss: 0.1871 | Time: 3.1620s
Epoch 00324 | Loss: 0.2371 | Swap Loss: 0.0000 | Grad Loss: 0.3976 | Atten Loss: 0.0000 | Soft Loss: 0.1974 | Time: 3.4746s
F1-Score on valset:       whole 0.9256, part1 0.9257, part2 0.9256
F1-Score on testset:       whole 0.9477, part1 0.9481, part2 0.9473
Epoch 00325 | Loss: 0.2245 | Swap Loss: 0.0000 | Grad Loss: 0.3830 | Atten Loss: 0.0000 | Soft Loss: 0.1862 | Time: 3.1442s
Epoch 00326 | Loss: 0.2222 | Swap Loss: 0.0000 | Grad Loss: 0.3808 | Atten Loss: 0.0000 | Soft Loss: 0.1841 | Time: 3.1172s
Epoch 00327 | Loss: 0.2257 | Swap Loss: 0.0000 | Grad Loss: 0.3876 | Atten Loss: 0.0000 | Soft Loss: 0.1870 | Time: 3.3178s
Epoch 00328 | Loss: 0.2198 | Swap Loss: 0.0000 | Grad Loss: 0.3808 | Atten Loss: 0.0000 | Soft Loss: 0.1818 | Time: 3.2780s
Epoch 00329 | Loss: 0.2253 | Swap Loss: 0.0000 | Grad Loss: 0.3916 | Atten Loss: 0.0000 | Soft Loss: 0.1862 | Time: 3.4536s
F1-Score on valset:       whole 0.9276, part1 0.9276, part2 0.9276
F1-Score on testset:       whole 0.9493, part1 0.9496, part2 0.9490
Epoch 00330 | Loss: 0.2248 | Swap Loss: 0.0000 | Grad Loss: 0.3939 | Atten Loss: 0.0000 | Soft Loss: 0.1854 | Time: 3.3856s
Epoch 00331 | Loss: 0.2244 | Swap Loss: 0.0000 | Grad Loss: 0.3914 | Atten Loss: 0.0000 | Soft Loss: 0.1853 | Time: 3.3332s
Epoch 00332 | Loss: 0.2147 | Swap Loss: 0.0000 | Grad Loss: 0.3776 | Atten Loss: 0.0000 | Soft Loss: 0.1770 | Time: 3.4349s
Epoch 00333 | Loss: 0.2143 | Swap Loss: 0.0000 | Grad Loss: 0.3765 | Atten Loss: 0.0000 | Soft Loss: 0.1766 | Time: 3.3534s
Epoch 00334 | Loss: 0.2158 | Swap Loss: 0.0000 | Grad Loss: 0.3801 | Atten Loss: 0.0000 | Soft Loss: 0.1778 | Time: 3.3988s
F1-Score on valset:       whole 0.9287, part1 0.9288, part2 0.9286
F1-Score on testset:       whole 0.9503, part1 0.9507, part2 0.9498
Epoch 00335 | Loss: 0.2120 | Swap Loss: 0.0000 | Grad Loss: 0.3765 | Atten Loss: 0.0000 | Soft Loss: 0.1743 | Time: 3.2806s
Epoch 00336 | Loss: 0.2178 | Swap Loss: 0.0000 | Grad Loss: 0.3821 | Atten Loss: 0.0000 | Soft Loss: 0.1796 | Time: 3.3502s
Epoch 00337 | Loss: 0.2091 | Swap Loss: 0.0000 | Grad Loss: 0.3714 | Atten Loss: 0.0000 | Soft Loss: 0.1720 | Time: 3.2094s
Epoch 00338 | Loss: 0.2090 | Swap Loss: 0.0000 | Grad Loss: 0.3721 | Atten Loss: 0.0000 | Soft Loss: 0.1718 | Time: 3.4639s
Epoch 00339 | Loss: 0.2147 | Swap Loss: 0.0000 | Grad Loss: 0.3862 | Atten Loss: 0.0000 | Soft Loss: 0.1761 | Time: 3.3747s
F1-Score on valset:       whole 0.9305, part1 0.9304, part2 0.9306
F1-Score on testset:       whole 0.9521, part1 0.9524, part2 0.9517
Epoch 00340 | Loss: 0.2082 | Swap Loss: 0.0000 | Grad Loss: 0.3736 | Atten Loss: 0.0000 | Soft Loss: 0.1709 | Time: 3.2905s
Epoch 00341 | Loss: 0.2080 | Swap Loss: 0.0000 | Grad Loss: 0.3744 | Atten Loss: 0.0000 | Soft Loss: 0.1706 | Time: 3.4890s
Epoch 00342 | Loss: 0.2055 | Swap Loss: 0.0000 | Grad Loss: 0.3721 | Atten Loss: 0.0000 | Soft Loss: 0.1683 | Time: 3.2055s
Epoch 00343 | Loss: 0.2068 | Swap Loss: 0.0000 | Grad Loss: 0.3748 | Atten Loss: 0.0000 | Soft Loss: 0.1693 | Time: 3.3958s
Epoch 00344 | Loss: 0.2070 | Swap Loss: 0.0000 | Grad Loss: 0.3762 | Atten Loss: 0.0000 | Soft Loss: 0.1694 | Time: 3.2674s
F1-Score on valset:       whole 0.9319, part1 0.9320, part2 0.9319
F1-Score on testset:       whole 0.9529, part1 0.9533, part2 0.9525
Epoch 00345 | Loss: 0.2157 | Swap Loss: 0.0000 | Grad Loss: 0.3892 | Atten Loss: 0.0000 | Soft Loss: 0.1767 | Time: 3.2125s
Epoch 00346 | Loss: 0.2112 | Swap Loss: 0.0000 | Grad Loss: 0.3892 | Atten Loss: 0.0000 | Soft Loss: 0.1723 | Time: 3.4142s
Epoch 00347 | Loss: 0.1988 | Swap Loss: 0.0000 | Grad Loss: 0.3677 | Atten Loss: 0.0000 | Soft Loss: 0.1621 | Time: 3.2267s
Epoch 00348 | Loss: 0.2037 | Swap Loss: 0.0000 | Grad Loss: 0.3772 | Atten Loss: 0.0000 | Soft Loss: 0.1660 | Time: 3.2757s
Epoch 00349 | Loss: 0.2037 | Swap Loss: 0.0000 | Grad Loss: 0.3795 | Atten Loss: 0.0000 | Soft Loss: 0.1658 | Time: 3.3618s
F1-Score on valset:       whole 0.9334, part1 0.9335, part2 0.9334
F1-Score on testset:       whole 0.9544, part1 0.9548, part2 0.9540
Epoch 00350 | Loss: 0.1972 | Swap Loss: 0.0000 | Grad Loss: 0.3702 | Atten Loss: 0.0000 | Soft Loss: 0.1601 | Time: 3.2965s
Epoch 00351 | Loss: 0.2013 | Swap Loss: 0.0000 | Grad Loss: 0.3754 | Atten Loss: 0.0000 | Soft Loss: 0.1638 | Time: 3.3197s
Epoch 00352 | Loss: 0.1973 | Swap Loss: 0.0000 | Grad Loss: 0.3699 | Atten Loss: 0.0000 | Soft Loss: 0.1604 | Time: 3.3023s
Epoch 00353 | Loss: 0.1965 | Swap Loss: 0.0000 | Grad Loss: 0.3703 | Atten Loss: 0.0000 | Soft Loss: 0.1595 | Time: 3.2607s
Epoch 00354 | Loss: 0.1957 | Swap Loss: 0.0000 | Grad Loss: 0.3664 | Atten Loss: 0.0000 | Soft Loss: 0.1591 | Time: 3.5354s
F1-Score on valset:       whole 0.9345, part1 0.9346, part2 0.9344
F1-Score on testset:       whole 0.9553, part1 0.9556, part2 0.9550
Epoch 00355 | Loss: 0.1965 | Swap Loss: 0.0000 | Grad Loss: 0.3674 | Atten Loss: 0.0000 | Soft Loss: 0.1598 | Time: 3.1330s
Epoch 00356 | Loss: 0.1937 | Swap Loss: 0.0000 | Grad Loss: 0.3656 | Atten Loss: 0.0000 | Soft Loss: 0.1571 | Time: 3.2835s
Epoch 00357 | Loss: 0.1957 | Swap Loss: 0.0000 | Grad Loss: 0.3699 | Atten Loss: 0.0000 | Soft Loss: 0.1587 | Time: 3.5243s
Epoch 00358 | Loss: 0.1936 | Swap Loss: 0.0000 | Grad Loss: 0.3680 | Atten Loss: 0.0000 | Soft Loss: 0.1568 | Time: 3.3717s
Epoch 00359 | Loss: 0.1943 | Swap Loss: 0.0000 | Grad Loss: 0.3716 | Atten Loss: 0.0000 | Soft Loss: 0.1571 | Time: 3.4000s
F1-Score on valset:       whole 0.9351, part1 0.9352, part2 0.9351
F1-Score on testset:       whole 0.9559, part1 0.9563, part2 0.9556
Epoch 00360 | Loss: 0.1988 | Swap Loss: 0.0000 | Grad Loss: 0.3795 | Atten Loss: 0.0000 | Soft Loss: 0.1608 | Time: 3.2287s
Epoch 00361 | Loss: 0.1901 | Swap Loss: 0.0000 | Grad Loss: 0.3699 | Atten Loss: 0.0000 | Soft Loss: 0.1531 | Time: 3.3389s
Epoch 00362 | Loss: 0.1918 | Swap Loss: 0.0000 | Grad Loss: 0.3719 | Atten Loss: 0.0000 | Soft Loss: 0.1546 | Time: 3.4354s
Epoch 00363 | Loss: 0.1909 | Swap Loss: 0.0000 | Grad Loss: 0.3710 | Atten Loss: 0.0000 | Soft Loss: 0.1538 | Time: 3.2952s
Epoch 00364 | Loss: 0.1893 | Swap Loss: 0.0000 | Grad Loss: 0.3659 | Atten Loss: 0.0000 | Soft Loss: 0.1528 | Time: 3.2062s
F1-Score on valset:       whole 0.9369, part1 0.9370, part2 0.9367
F1-Score on testset:       whole 0.9571, part1 0.9574, part2 0.9569
Epoch 00365 | Loss: 0.1859 | Swap Loss: 0.0000 | Grad Loss: 0.3634 | Atten Loss: 0.0000 | Soft Loss: 0.1496 | Time: 3.3447s
Epoch 00366 | Loss: 0.1887 | Swap Loss: 0.0000 | Grad Loss: 0.3701 | Atten Loss: 0.0000 | Soft Loss: 0.1517 | Time: 3.2170s
Epoch 00367 | Loss: 0.1885 | Swap Loss: 0.0000 | Grad Loss: 0.3692 | Atten Loss: 0.0000 | Soft Loss: 0.1516 | Time: 3.2439s
Epoch 00368 | Loss: 0.1885 | Swap Loss: 0.0000 | Grad Loss: 0.3714 | Atten Loss: 0.0000 | Soft Loss: 0.1514 | Time: 3.3883s
Epoch 00369 | Loss: 0.1876 | Swap Loss: 0.0000 | Grad Loss: 0.3706 | Atten Loss: 0.0000 | Soft Loss: 0.1506 | Time: 3.2454s
F1-Score on valset:       whole 0.9376, part1 0.9376, part2 0.9375
F1-Score on testset:       whole 0.9579, part1 0.9583, part2 0.9575
Epoch 00370 | Loss: 0.1816 | Swap Loss: 0.0000 | Grad Loss: 0.3613 | Atten Loss: 0.0000 | Soft Loss: 0.1455 | Time: 3.2712s
Epoch 00371 | Loss: 0.1865 | Swap Loss: 0.0000 | Grad Loss: 0.3699 | Atten Loss: 0.0000 | Soft Loss: 0.1495 | Time: 3.4345s
Epoch 00372 | Loss: 0.1781 | Swap Loss: 0.0000 | Grad Loss: 0.3529 | Atten Loss: 0.0000 | Soft Loss: 0.1428 | Time: 3.4534s
Epoch 00373 | Loss: 0.1808 | Swap Loss: 0.0000 | Grad Loss: 0.3613 | Atten Loss: 0.0000 | Soft Loss: 0.1447 | Time: 3.4422s
Epoch 00374 | Loss: 0.1821 | Swap Loss: 0.0000 | Grad Loss: 0.3641 | Atten Loss: 0.0000 | Soft Loss: 0.1456 | Time: 3.2974s
F1-Score on valset:       whole 0.9387, part1 0.9388, part2 0.9386
F1-Score on testset:       whole 0.9589, part1 0.9592, part2 0.9585
Epoch 00375 | Loss: 0.1773 | Swap Loss: 0.0000 | Grad Loss: 0.3560 | Atten Loss: 0.0000 | Soft Loss: 0.1417 | Time: 3.1268s
Epoch 00376 | Loss: 0.1823 | Swap Loss: 0.0000 | Grad Loss: 0.3642 | Atten Loss: 0.0000 | Soft Loss: 0.1459 | Time: 3.2365s
Epoch 00377 | Loss: 0.1752 | Swap Loss: 0.0000 | Grad Loss: 0.3543 | Atten Loss: 0.0000 | Soft Loss: 0.1398 | Time: 3.6036s
Epoch 00378 | Loss: 0.1784 | Swap Loss: 0.0000 | Grad Loss: 0.3639 | Atten Loss: 0.0000 | Soft Loss: 0.1420 | Time: 3.3351s
Epoch 00379 | Loss: 0.1783 | Swap Loss: 0.0000 | Grad Loss: 0.3632 | Atten Loss: 0.0000 | Soft Loss: 0.1420 | Time: 3.6178s
F1-Score on valset:       whole 0.9394, part1 0.9396, part2 0.9393
F1-Score on testset:       whole 0.9593, part1 0.9597, part2 0.9590
Epoch 00380 | Loss: 0.1794 | Swap Loss: 0.0000 | Grad Loss: 0.3646 | Atten Loss: 0.0000 | Soft Loss: 0.1430 | Time: 3.4524s
Epoch 00381 | Loss: 0.1813 | Swap Loss: 0.0000 | Grad Loss: 0.3706 | Atten Loss: 0.0000 | Soft Loss: 0.1442 | Time: 3.3689s
Epoch 00382 | Loss: 0.1747 | Swap Loss: 0.0000 | Grad Loss: 0.3570 | Atten Loss: 0.0000 | Soft Loss: 0.1390 | Time: 3.2980s
Epoch 00383 | Loss: 0.1711 | Swap Loss: 0.0000 | Grad Loss: 0.3535 | Atten Loss: 0.0000 | Soft Loss: 0.1358 | Time: 3.2709s
Epoch 00384 | Loss: 0.1703 | Swap Loss: 0.0000 | Grad Loss: 0.3493 | Atten Loss: 0.0000 | Soft Loss: 0.1353 | Time: 3.3034s
F1-Score on valset:       whole 0.9407, part1 0.9411, part2 0.9404
F1-Score on testset:       whole 0.9604, part1 0.9609, part2 0.9598
Epoch 00385 | Loss: 0.1727 | Swap Loss: 0.0000 | Grad Loss: 0.3550 | Atten Loss: 0.0000 | Soft Loss: 0.1372 | Time: 3.4825s
Epoch 00386 | Loss: 0.1714 | Swap Loss: 0.0000 | Grad Loss: 0.3543 | Atten Loss: 0.0000 | Soft Loss: 0.1359 | Time: 3.2490s
Epoch 00387 | Loss: 0.1734 | Swap Loss: 0.0000 | Grad Loss: 0.3616 | Atten Loss: 0.0000 | Soft Loss: 0.1373 | Time: 3.1108s
Epoch 00388 | Loss: 0.1721 | Swap Loss: 0.0000 | Grad Loss: 0.3601 | Atten Loss: 0.0000 | Soft Loss: 0.1361 | Time: 3.3962s
Epoch 00389 | Loss: 0.1746 | Swap Loss: 0.0000 | Grad Loss: 0.3634 | Atten Loss: 0.0000 | Soft Loss: 0.1382 | Time: 3.4077s
F1-Score on valset:       whole 0.9419, part1 0.9420, part2 0.9418
F1-Score on testset:       whole 0.9614, part1 0.9618, part2 0.9611
Epoch 00390 | Loss: 0.1729 | Swap Loss: 0.0000 | Grad Loss: 0.3648 | Atten Loss: 0.0000 | Soft Loss: 0.1364 | Time: 3.1791s
Epoch 00391 | Loss: 0.1707 | Swap Loss: 0.0000 | Grad Loss: 0.3608 | Atten Loss: 0.0000 | Soft Loss: 0.1346 | Time: 3.4223s
Epoch 00392 | Loss: 0.1684 | Swap Loss: 0.0000 | Grad Loss: 0.3562 | Atten Loss: 0.0000 | Soft Loss: 0.1328 | Time: 3.4547s
Epoch 00393 | Loss: 0.1667 | Swap Loss: 0.0000 | Grad Loss: 0.3522 | Atten Loss: 0.0000 | Soft Loss: 0.1314 | Time: 3.0841s
Epoch 00394 | Loss: 0.1682 | Swap Loss: 0.0000 | Grad Loss: 0.3543 | Atten Loss: 0.0000 | Soft Loss: 0.1327 | Time: 3.1505s
F1-Score on valset:       whole 0.9428, part1 0.9430, part2 0.9426
F1-Score on testset:       whole 0.9623, part1 0.9627, part2 0.9619
Epoch 00395 | Loss: 0.1761 | Swap Loss: 0.0000 | Grad Loss: 0.3708 | Atten Loss: 0.0000 | Soft Loss: 0.1391 | Time: 3.4660s
Epoch 00396 | Loss: 0.1678 | Swap Loss: 0.0000 | Grad Loss: 0.3579 | Atten Loss: 0.0000 | Soft Loss: 0.1320 | Time: 3.4476s
Epoch 00397 | Loss: 0.1650 | Swap Loss: 0.0000 | Grad Loss: 0.3538 | Atten Loss: 0.0000 | Soft Loss: 0.1296 | Time: 3.1660s
Epoch 00398 | Loss: 0.1734 | Swap Loss: 0.0000 | Grad Loss: 0.3646 | Atten Loss: 0.0000 | Soft Loss: 0.1369 | Time: 3.2458s
Epoch 00399 | Loss: 0.1618 | Swap Loss: 0.0000 | Grad Loss: 0.3455 | Atten Loss: 0.0000 | Soft Loss: 0.1272 | Time: 3.4088s
F1-Score on valset:       whole 0.9433, part1 0.9435, part2 0.9431
F1-Score on testset:       whole 0.9626, part1 0.9630, part2 0.9621
Epoch 00400 | Loss: 0.1650 | Swap Loss: 0.0000 | Grad Loss: 0.3565 | Atten Loss: 0.0000 | Soft Loss: 0.1294 | Time: 3.3819s
Epoch 00401 | Loss: 0.1614 | Swap Loss: 0.0000 | Grad Loss: 0.3499 | Atten Loss: 0.0000 | Soft Loss: 0.1264 | Time: 3.4418s
Epoch 00402 | Loss: 0.1646 | Swap Loss: 0.0000 | Grad Loss: 0.3580 | Atten Loss: 0.0000 | Soft Loss: 0.1288 | Time: 3.3150s
Epoch 00403 | Loss: 0.1607 | Swap Loss: 0.0000 | Grad Loss: 0.3507 | Atten Loss: 0.0000 | Soft Loss: 0.1256 | Time: 3.3047s
Epoch 00404 | Loss: 0.1610 | Swap Loss: 0.0000 | Grad Loss: 0.3523 | Atten Loss: 0.0000 | Soft Loss: 0.1258 | Time: 3.2273s
F1-Score on valset:       whole 0.9441, part1 0.9442, part2 0.9440
F1-Score on testset:       whole 0.9631, part1 0.9635, part2 0.9627
Epoch 00405 | Loss: 0.1600 | Swap Loss: 0.0000 | Grad Loss: 0.3508 | Atten Loss: 0.0000 | Soft Loss: 0.1249 | Time: 3.4290s
Epoch 00406 | Loss: 0.1588 | Swap Loss: 0.0000 | Grad Loss: 0.3488 | Atten Loss: 0.0000 | Soft Loss: 0.1239 | Time: 3.4546s
Epoch 00407 | Loss: 0.1584 | Swap Loss: 0.0000 | Grad Loss: 0.3490 | Atten Loss: 0.0000 | Soft Loss: 0.1235 | Time: 3.3501s
Epoch 00408 | Loss: 0.1592 | Swap Loss: 0.0000 | Grad Loss: 0.3488 | Atten Loss: 0.0000 | Soft Loss: 0.1244 | Time: 3.4864s
Epoch 00409 | Loss: 0.1577 | Swap Loss: 0.0000 | Grad Loss: 0.3497 | Atten Loss: 0.0000 | Soft Loss: 0.1228 | Time: 3.4893s
F1-Score on valset:       whole 0.9452, part1 0.9451, part2 0.9452
F1-Score on testset:       whole 0.9642, part1 0.9646, part2 0.9637
Epoch 00410 | Loss: 0.1566 | Swap Loss: 0.0000 | Grad Loss: 0.3448 | Atten Loss: 0.0000 | Soft Loss: 0.1222 | Time: 3.3917s
Epoch 00411 | Loss: 0.1558 | Swap Loss: 0.0000 | Grad Loss: 0.3455 | Atten Loss: 0.0000 | Soft Loss: 0.1213 | Time: 3.4549s
Epoch 00412 | Loss: 0.1594 | Swap Loss: 0.0000 | Grad Loss: 0.3539 | Atten Loss: 0.0000 | Soft Loss: 0.1240 | Time: 3.7230s
Epoch 00413 | Loss: 0.1576 | Swap Loss: 0.0000 | Grad Loss: 0.3525 | Atten Loss: 0.0000 | Soft Loss: 0.1224 | Time: 3.4727s
Epoch 00414 | Loss: 0.1596 | Swap Loss: 0.0000 | Grad Loss: 0.3568 | Atten Loss: 0.0000 | Soft Loss: 0.1239 | Time: 3.6450s
F1-Score on valset:       whole 0.9456, part1 0.9459, part2 0.9453
F1-Score on testset:       whole 0.9643, part1 0.9647, part2 0.9640
Epoch 00415 | Loss: 0.1571 | Swap Loss: 0.0000 | Grad Loss: 0.3504 | Atten Loss: 0.0000 | Soft Loss: 0.1220 | Time: 3.4812s
Epoch 00416 | Loss: 0.1548 | Swap Loss: 0.0000 | Grad Loss: 0.3465 | Atten Loss: 0.0000 | Soft Loss: 0.1202 | Time: 3.5043s
Epoch 00417 | Loss: 0.1550 | Swap Loss: 0.0000 | Grad Loss: 0.3496 | Atten Loss: 0.0000 | Soft Loss: 0.1201 | Time: 3.2700s
Epoch 00418 | Loss: 0.1525 | Swap Loss: 0.0000 | Grad Loss: 0.3435 | Atten Loss: 0.0000 | Soft Loss: 0.1181 | Time: 3.2522s
Epoch 00419 | Loss: 0.1513 | Swap Loss: 0.0000 | Grad Loss: 0.3422 | Atten Loss: 0.0000 | Soft Loss: 0.1171 | Time: 3.6660s
F1-Score on valset:       whole 0.9468, part1 0.9468, part2 0.9467
F1-Score on testset:       whole 0.9651, part1 0.9655, part2 0.9648
Epoch 00420 | Loss: 0.1498 | Swap Loss: 0.0000 | Grad Loss: 0.3403 | Atten Loss: 0.0000 | Soft Loss: 0.1157 | Time: 3.2414s
Epoch 00421 | Loss: 0.1485 | Swap Loss: 0.0000 | Grad Loss: 0.3369 | Atten Loss: 0.0000 | Soft Loss: 0.1148 | Time: 3.3297s
Epoch 00422 | Loss: 0.1608 | Swap Loss: 0.0000 | Grad Loss: 0.3595 | Atten Loss: 0.0000 | Soft Loss: 0.1249 | Time: 3.5086s
Epoch 00423 | Loss: 0.1493 | Swap Loss: 0.0000 | Grad Loss: 0.3430 | Atten Loss: 0.0000 | Soft Loss: 0.1150 | Time: 3.3335s
Epoch 00424 | Loss: 0.1461 | Swap Loss: 0.0000 | Grad Loss: 0.3385 | Atten Loss: 0.0000 | Soft Loss: 0.1123 | Time: 3.1362s
F1-Score on valset:       whole 0.9476, part1 0.9477, part2 0.9475
F1-Score on testset:       whole 0.9658, part1 0.9661, part2 0.9656
Epoch 00425 | Loss: 0.1492 | Swap Loss: 0.0000 | Grad Loss: 0.3451 | Atten Loss: 0.0000 | Soft Loss: 0.1147 | Time: 3.3697s
Epoch 00426 | Loss: 0.1485 | Swap Loss: 0.0000 | Grad Loss: 0.3458 | Atten Loss: 0.0000 | Soft Loss: 0.1139 | Time: 3.1037s
Epoch 00427 | Loss: 0.1457 | Swap Loss: 0.0000 | Grad Loss: 0.3366 | Atten Loss: 0.0000 | Soft Loss: 0.1121 | Time: 2.9770s
Epoch 00428 | Loss: 0.1486 | Swap Loss: 0.0000 | Grad Loss: 0.3433 | Atten Loss: 0.0000 | Soft Loss: 0.1142 | Time: 3.3567s
Epoch 00429 | Loss: 0.1484 | Swap Loss: 0.0000 | Grad Loss: 0.3444 | Atten Loss: 0.0000 | Soft Loss: 0.1139 | Time: 3.3206s
F1-Score on valset:       whole 0.9483, part1 0.9484, part2 0.9482
F1-Score on testset:       whole 0.9661, part1 0.9665, part2 0.9657
Epoch 00430 | Loss: 0.1469 | Swap Loss: 0.0000 | Grad Loss: 0.3433 | Atten Loss: 0.0000 | Soft Loss: 0.1126 | Time: 3.4875s
Epoch 00431 | Loss: 0.1437 | Swap Loss: 0.0000 | Grad Loss: 0.3390 | Atten Loss: 0.0000 | Soft Loss: 0.1098 | Time: 3.5112s
Epoch 00432 | Loss: 0.1428 | Swap Loss: 0.0000 | Grad Loss: 0.3378 | Atten Loss: 0.0000 | Soft Loss: 0.1090 | Time: 3.2781s
Epoch 00433 | Loss: 0.1528 | Swap Loss: 0.0000 | Grad Loss: 0.3540 | Atten Loss: 0.0000 | Soft Loss: 0.1174 | Time: 3.4862s
Epoch 00434 | Loss: 0.1466 | Swap Loss: 0.0000 | Grad Loss: 0.3446 | Atten Loss: 0.0000 | Soft Loss: 0.1121 | Time: 3.2594s
F1-Score on valset:       whole 0.9489, part1 0.9490, part2 0.9489
F1-Score on testset:       whole 0.9668, part1 0.9672, part2 0.9663
Epoch 00435 | Loss: 0.1417 | Swap Loss: 0.0000 | Grad Loss: 0.3371 | Atten Loss: 0.0000 | Soft Loss: 0.1080 | Time: 3.3538s
Epoch 00436 | Loss: 0.1418 | Swap Loss: 0.0000 | Grad Loss: 0.3359 | Atten Loss: 0.0000 | Soft Loss: 0.1082 | Time: 3.2822s
Epoch 00437 | Loss: 0.1420 | Swap Loss: 0.0000 | Grad Loss: 0.3406 | Atten Loss: 0.0000 | Soft Loss: 0.1079 | Time: 3.5484s
Epoch 00438 | Loss: 0.1427 | Swap Loss: 0.0000 | Grad Loss: 0.3413 | Atten Loss: 0.0000 | Soft Loss: 0.1086 | Time: 3.2375s
Epoch 00439 | Loss: 0.1432 | Swap Loss: 0.0000 | Grad Loss: 0.3405 | Atten Loss: 0.0000 | Soft Loss: 0.1091 | Time: 3.2286s
F1-Score on valset:       whole 0.9493, part1 0.9494, part2 0.9492
F1-Score on testset:       whole 0.9670, part1 0.9673, part2 0.9666
Epoch 00440 | Loss: 0.1409 | Swap Loss: 0.0000 | Grad Loss: 0.3397 | Atten Loss: 0.0000 | Soft Loss: 0.1069 | Time: 3.5664s
Epoch 00441 | Loss: 0.1455 | Swap Loss: 0.0000 | Grad Loss: 0.3487 | Atten Loss: 0.0000 | Soft Loss: 0.1106 | Time: 3.2713s
Epoch 00442 | Loss: 0.1428 | Swap Loss: 0.0000 | Grad Loss: 0.3425 | Atten Loss: 0.0000 | Soft Loss: 0.1086 | Time: 3.5893s
Epoch 00443 | Loss: 0.1486 | Swap Loss: 0.0000 | Grad Loss: 0.3510 | Atten Loss: 0.0000 | Soft Loss: 0.1135 | Time: 3.5386s
Epoch 00444 | Loss: 0.1397 | Swap Loss: 0.0000 | Grad Loss: 0.3398 | Atten Loss: 0.0000 | Soft Loss: 0.1057 | Time: 3.5333s
F1-Score on valset:       whole 0.9500, part1 0.9500, part2 0.9500
F1-Score on testset:       whole 0.9676, part1 0.9679, part2 0.9673
Epoch 00445 | Loss: 0.1377 | Swap Loss: 0.0000 | Grad Loss: 0.3345 | Atten Loss: 0.0000 | Soft Loss: 0.1042 | Time: 3.3492s
Epoch 00446 | Loss: 0.1408 | Swap Loss: 0.0000 | Grad Loss: 0.3407 | Atten Loss: 0.0000 | Soft Loss: 0.1067 | Time: 3.2539s
Epoch 00447 | Loss: 0.1402 | Swap Loss: 0.0000 | Grad Loss: 0.3385 | Atten Loss: 0.0000 | Soft Loss: 0.1063 | Time: 3.1768s
Epoch 00448 | Loss: 0.1401 | Swap Loss: 0.0000 | Grad Loss: 0.3439 | Atten Loss: 0.0000 | Soft Loss: 0.1057 | Time: 3.2363s
Epoch 00449 | Loss: 0.1359 | Swap Loss: 0.0000 | Grad Loss: 0.3345 | Atten Loss: 0.0000 | Soft Loss: 0.1025 | Time: 3.1786s
F1-Score on valset:       whole 0.9508, part1 0.9509, part2 0.9507
F1-Score on testset:       whole 0.9680, part1 0.9685, part2 0.9676
Epoch 00450 | Loss: 0.1448 | Swap Loss: 0.0000 | Grad Loss: 0.3479 | Atten Loss: 0.0000 | Soft Loss: 0.1100 | Time: 3.3567s
Epoch 00451 | Loss: 0.1377 | Swap Loss: 0.0000 | Grad Loss: 0.3376 | Atten Loss: 0.0000 | Soft Loss: 0.1040 | Time: 3.4135s
Epoch 00452 | Loss: 0.1420 | Swap Loss: 0.0000 | Grad Loss: 0.3468 | Atten Loss: 0.0000 | Soft Loss: 0.1073 | Time: 3.3392s
Epoch 00453 | Loss: 0.1360 | Swap Loss: 0.0000 | Grad Loss: 0.3367 | Atten Loss: 0.0000 | Soft Loss: 0.1023 | Time: 3.4585s
Epoch 00454 | Loss: 0.1365 | Swap Loss: 0.0000 | Grad Loss: 0.3384 | Atten Loss: 0.0000 | Soft Loss: 0.1027 | Time: 3.2804s
F1-Score on valset:       whole 0.9513, part1 0.9514, part2 0.9513
F1-Score on testset:       whole 0.9686, part1 0.9688, part2 0.9683
Epoch 00455 | Loss: 0.1361 | Swap Loss: 0.0000 | Grad Loss: 0.3375 | Atten Loss: 0.0000 | Soft Loss: 0.1024 | Time: 3.1548s
Epoch 00456 | Loss: 0.1319 | Swap Loss: 0.0000 | Grad Loss: 0.3283 | Atten Loss: 0.0000 | Soft Loss: 0.0990 | Time: 3.2570s
Epoch 00457 | Loss: 0.1320 | Swap Loss: 0.0000 | Grad Loss: 0.3300 | Atten Loss: 0.0000 | Soft Loss: 0.0990 | Time: 3.3001s
Epoch 00458 | Loss: 0.1329 | Swap Loss: 0.0000 | Grad Loss: 0.3341 | Atten Loss: 0.0000 | Soft Loss: 0.0995 | Time: 3.2657s
Epoch 00459 | Loss: 0.1312 | Swap Loss: 0.0000 | Grad Loss: 0.3302 | Atten Loss: 0.0000 | Soft Loss: 0.0982 | Time: 3.3638s
F1-Score on valset:       whole 0.9519, part1 0.9521, part2 0.9517
F1-Score on testset:       whole 0.9690, part1 0.9694, part2 0.9686
Epoch 00460 | Loss: 0.1306 | Swap Loss: 0.0000 | Grad Loss: 0.3297 | Atten Loss: 0.0000 | Soft Loss: 0.0977 | Time: 3.0396s
Epoch 00461 | Loss: 0.1314 | Swap Loss: 0.0000 | Grad Loss: 0.3333 | Atten Loss: 0.0000 | Soft Loss: 0.0981 | Time: 3.4249s
Epoch 00462 | Loss: 0.1315 | Swap Loss: 0.0000 | Grad Loss: 0.3336 | Atten Loss: 0.0000 | Soft Loss: 0.0981 | Time: 3.5468s
Epoch 00463 | Loss: 0.1318 | Swap Loss: 0.0000 | Grad Loss: 0.3349 | Atten Loss: 0.0000 | Soft Loss: 0.0983 | Time: 3.6292s
Epoch 00464 | Loss: 0.1271 | Swap Loss: 0.0000 | Grad Loss: 0.3251 | Atten Loss: 0.0000 | Soft Loss: 0.0946 | Time: 3.4893s
F1-Score on valset:       whole 0.9524, part1 0.9526, part2 0.9522
F1-Score on testset:       whole 0.9694, part1 0.9698, part2 0.9691
Epoch 00465 | Loss: 0.1325 | Swap Loss: 0.0000 | Grad Loss: 0.3385 | Atten Loss: 0.0000 | Soft Loss: 0.0986 | Time: 3.3548s
Epoch 00466 | Loss: 0.1299 | Swap Loss: 0.0000 | Grad Loss: 0.3342 | Atten Loss: 0.0000 | Soft Loss: 0.0965 | Time: 3.4688s
Epoch 00467 | Loss: 0.1258 | Swap Loss: 0.0000 | Grad Loss: 0.3261 | Atten Loss: 0.0000 | Soft Loss: 0.0932 | Time: 3.2556s
Epoch 00468 | Loss: 0.1326 | Swap Loss: 0.0000 | Grad Loss: 0.3397 | Atten Loss: 0.0000 | Soft Loss: 0.0986 | Time: 3.4257s
Epoch 00469 | Loss: 0.1310 | Swap Loss: 0.0000 | Grad Loss: 0.3393 | Atten Loss: 0.0000 | Soft Loss: 0.0970 | Time: 3.4182s
F1-Score on valset:       whole 0.9528, part1 0.9527, part2 0.9529
F1-Score on testset:       whole 0.9698, part1 0.9701, part2 0.9694
Epoch 00470 | Loss: 0.1328 | Swap Loss: 0.0000 | Grad Loss: 0.3421 | Atten Loss: 0.0000 | Soft Loss: 0.0985 | Time: 3.3070s
Epoch 00471 | Loss: 0.1277 | Swap Loss: 0.0000 | Grad Loss: 0.3324 | Atten Loss: 0.0000 | Soft Loss: 0.0944 | Time: 3.5024s
Epoch 00472 | Loss: 0.1249 | Swap Loss: 0.0000 | Grad Loss: 0.3277 | Atten Loss: 0.0000 | Soft Loss: 0.0922 | Time: 3.0512s
Epoch 00473 | Loss: 0.1300 | Swap Loss: 0.0000 | Grad Loss: 0.3365 | Atten Loss: 0.0000 | Soft Loss: 0.0964 | Time: 3.4241s
Epoch 00474 | Loss: 0.1309 | Swap Loss: 0.0000 | Grad Loss: 0.3394 | Atten Loss: 0.0000 | Soft Loss: 0.0969 | Time: 2.8456s
F1-Score on valset:       whole 0.9532, part1 0.9532, part2 0.9531
F1-Score on testset:       whole 0.9700, part1 0.9703, part2 0.9696
Epoch 00475 | Loss: 0.1234 | Swap Loss: 0.0000 | Grad Loss: 0.3284 | Atten Loss: 0.0000 | Soft Loss: 0.0906 | Time: 3.2084s
Epoch 00476 | Loss: 0.1223 | Swap Loss: 0.0000 | Grad Loss: 0.3241 | Atten Loss: 0.0000 | Soft Loss: 0.0899 | Time: 3.2868s
Epoch 00477 | Loss: 0.1270 | Swap Loss: 0.0000 | Grad Loss: 0.3333 | Atten Loss: 0.0000 | Soft Loss: 0.0937 | Time: 3.4052s
Epoch 00478 | Loss: 0.1224 | Swap Loss: 0.0000 | Grad Loss: 0.3251 | Atten Loss: 0.0000 | Soft Loss: 0.0899 | Time: 3.3095s
Epoch 00479 | Loss: 0.1291 | Swap Loss: 0.0000 | Grad Loss: 0.3364 | Atten Loss: 0.0000 | Soft Loss: 0.0955 | Time: 3.3356s
F1-Score on valset:       whole 0.9540, part1 0.9541, part2 0.9539
F1-Score on testset:       whole 0.9706, part1 0.9710, part2 0.9702
Epoch 00480 | Loss: 0.1227 | Swap Loss: 0.0000 | Grad Loss: 0.3254 | Atten Loss: 0.0000 | Soft Loss: 0.0902 | Time: 3.3217s
Epoch 00481 | Loss: 0.1231 | Swap Loss: 0.0000 | Grad Loss: 0.3252 | Atten Loss: 0.0000 | Soft Loss: 0.0906 | Time: 3.1712s
Epoch 00482 | Loss: 0.1227 | Swap Loss: 0.0000 | Grad Loss: 0.3279 | Atten Loss: 0.0000 | Soft Loss: 0.0899 | Time: 3.2443s
Epoch 00483 | Loss: 0.1239 | Swap Loss: 0.0000 | Grad Loss: 0.3308 | Atten Loss: 0.0000 | Soft Loss: 0.0908 | Time: 3.3095s
Epoch 00484 | Loss: 0.1226 | Swap Loss: 0.0000 | Grad Loss: 0.3247 | Atten Loss: 0.0000 | Soft Loss: 0.0901 | Time: 3.4848s
F1-Score on valset:       whole 0.9541, part1 0.9541, part2 0.9541
F1-Score on testset:       whole 0.9707, part1 0.9710, part2 0.9704
Epoch 00485 | Loss: 0.1196 | Swap Loss: 0.0000 | Grad Loss: 0.3198 | Atten Loss: 0.0000 | Soft Loss: 0.0876 | Time: 3.2162s
Epoch 00486 | Loss: 0.1220 | Swap Loss: 0.0000 | Grad Loss: 0.3281 | Atten Loss: 0.0000 | Soft Loss: 0.0892 | Time: 3.3807s
Epoch 00487 | Loss: 0.1242 | Swap Loss: 0.0000 | Grad Loss: 0.3311 | Atten Loss: 0.0000 | Soft Loss: 0.0911 | Time: 3.3144s
Epoch 00488 | Loss: 0.1200 | Swap Loss: 0.0000 | Grad Loss: 0.3233 | Atten Loss: 0.0000 | Soft Loss: 0.0877 | Time: 3.2382s
Epoch 00489 | Loss: 0.1181 | Swap Loss: 0.0000 | Grad Loss: 0.3210 | Atten Loss: 0.0000 | Soft Loss: 0.0860 | Time: 3.1118s
F1-Score on valset:       whole 0.9548, part1 0.9548, part2 0.9547
F1-Score on testset:       whole 0.9711, part1 0.9713, part2 0.9708
Epoch 00490 | Loss: 0.1208 | Swap Loss: 0.0000 | Grad Loss: 0.3272 | Atten Loss: 0.0000 | Soft Loss: 0.0881 | Time: 3.3274s
Epoch 00491 | Loss: 0.1202 | Swap Loss: 0.0000 | Grad Loss: 0.3251 | Atten Loss: 0.0000 | Soft Loss: 0.0877 | Time: 3.3866s
Epoch 00492 | Loss: 0.1189 | Swap Loss: 0.0000 | Grad Loss: 0.3225 | Atten Loss: 0.0000 | Soft Loss: 0.0866 | Time: 3.3263s
Epoch 00493 | Loss: 0.1208 | Swap Loss: 0.0000 | Grad Loss: 0.3297 | Atten Loss: 0.0000 | Soft Loss: 0.0879 | Time: 3.0713s
Epoch 00494 | Loss: 0.1196 | Swap Loss: 0.0000 | Grad Loss: 0.3269 | Atten Loss: 0.0000 | Soft Loss: 0.0869 | Time: 3.4230s
F1-Score on valset:       whole 0.9553, part1 0.9553, part2 0.9553
F1-Score on testset:       whole 0.9715, part1 0.9718, part2 0.9711
Epoch 00495 | Loss: 0.1165 | Swap Loss: 0.0000 | Grad Loss: 0.3206 | Atten Loss: 0.0000 | Soft Loss: 0.0845 | Time: 3.1872s
Epoch 00496 | Loss: 0.1169 | Swap Loss: 0.0000 | Grad Loss: 0.3222 | Atten Loss: 0.0000 | Soft Loss: 0.0847 | Time: 3.3523s
Epoch 00497 | Loss: 0.1223 | Swap Loss: 0.0000 | Grad Loss: 0.3322 | Atten Loss: 0.0000 | Soft Loss: 0.0891 | Time: 3.3931s
Epoch 00498 | Loss: 0.1202 | Swap Loss: 0.0000 | Grad Loss: 0.3300 | Atten Loss: 0.0000 | Soft Loss: 0.0872 | Time: 3.4117s
Epoch 00499 | Loss: 0.1163 | Swap Loss: 0.0000 | Grad Loss: 0.3218 | Atten Loss: 0.0000 | Soft Loss: 0.0841 | Time: 3.2370s
F1-Score on valset:       whole 0.9560, part1 0.9560, part2 0.9559
F1-Score on testset:       whole 0.9720, part1 0.9723, part2 0.9717
Epoch 00500 | Loss: 0.1154 | Swap Loss: 0.0000 | Grad Loss: 0.3228 | Atten Loss: 0.0000 | Soft Loss: 0.0831 | Time: 3.2673s
Epoch 00501 | Loss: 0.1198 | Swap Loss: 0.0000 | Grad Loss: 0.3280 | Atten Loss: 0.0000 | Soft Loss: 0.0870 | Time: 3.2733s
Epoch 00502 | Loss: 0.1185 | Swap Loss: 0.0000 | Grad Loss: 0.3276 | Atten Loss: 0.0000 | Soft Loss: 0.0858 | Time: 2.9934s
Epoch 00503 | Loss: 0.1190 | Swap Loss: 0.0000 | Grad Loss: 0.3287 | Atten Loss: 0.0000 | Soft Loss: 0.0861 | Time: 3.1479s
Epoch 00504 | Loss: 0.1152 | Swap Loss: 0.0000 | Grad Loss: 0.3218 | Atten Loss: 0.0000 | Soft Loss: 0.0830 | Time: 3.4134s
F1-Score on valset:       whole 0.9560, part1 0.9559, part2 0.9560
F1-Score on testset:       whole 0.9719, part1 0.9722, part2 0.9716
Epoch 00505 | Loss: 0.1209 | Swap Loss: 0.0000 | Grad Loss: 0.3348 | Atten Loss: 0.0000 | Soft Loss: 0.0874 | Time: 3.2576s
Epoch 00506 | Loss: 0.1140 | Swap Loss: 0.0000 | Grad Loss: 0.3222 | Atten Loss: 0.0000 | Soft Loss: 0.0818 | Time: 2.9731s
Epoch 00507 | Loss: 0.1136 | Swap Loss: 0.0000 | Grad Loss: 0.3209 | Atten Loss: 0.0000 | Soft Loss: 0.0815 | Time: 2.9421s
Epoch 00508 | Loss: 0.1171 | Swap Loss: 0.0000 | Grad Loss: 0.3281 | Atten Loss: 0.0000 | Soft Loss: 0.0843 | Time: 3.0710s
Epoch 00509 | Loss: 0.1123 | Swap Loss: 0.0000 | Grad Loss: 0.3163 | Atten Loss: 0.0000 | Soft Loss: 0.0807 | Time: 3.1361s
F1-Score on valset:       whole 0.9567, part1 0.9568, part2 0.9567
F1-Score on testset:       whole 0.9724, part1 0.9727, part2 0.9720
Epoch 00510 | Loss: 0.1149 | Swap Loss: 0.0000 | Grad Loss: 0.3277 | Atten Loss: 0.0000 | Soft Loss: 0.0821 | Time: 3.3379s
Epoch 00511 | Loss: 0.1108 | Swap Loss: 0.0000 | Grad Loss: 0.3174 | Atten Loss: 0.0000 | Soft Loss: 0.0791 | Time: 7.1927s
Epoch 00512 | Loss: 0.1116 | Swap Loss: 0.0000 | Grad Loss: 0.3147 | Atten Loss: 0.0000 | Soft Loss: 0.0801 | Time: 3.2169s
Epoch 00513 | Loss: 0.1092 | Swap Loss: 0.0000 | Grad Loss: 0.3142 | Atten Loss: 0.0000 | Soft Loss: 0.0778 | Time: 3.0043s
Epoch 00514 | Loss: 0.1147 | Swap Loss: 0.0000 | Grad Loss: 0.3247 | Atten Loss: 0.0000 | Soft Loss: 0.0823 | Time: 3.4224s
F1-Score on valset:       whole 0.9569, part1 0.9568, part2 0.9569
F1-Score on testset:       whole 0.9726, part1 0.9730, part2 0.9723
Epoch 00515 | Loss: 0.1095 | Swap Loss: 0.0000 | Grad Loss: 0.3148 | Atten Loss: 0.0000 | Soft Loss: 0.0781 | Time: 3.3881s
Epoch 00516 | Loss: 0.1109 | Swap Loss: 0.0000 | Grad Loss: 0.3208 | Atten Loss: 0.0000 | Soft Loss: 0.0789 | Time: 3.1770s
Epoch 00517 | Loss: 0.1085 | Swap Loss: 0.0000 | Grad Loss: 0.3138 | Atten Loss: 0.0000 | Soft Loss: 0.0771 | Time: 3.2308s
Epoch 00518 | Loss: 0.1102 | Swap Loss: 0.0000 | Grad Loss: 0.3154 | Atten Loss: 0.0000 | Soft Loss: 0.0786 | Time: 3.4663s
Epoch 00519 | Loss: 0.1134 | Swap Loss: 0.0000 | Grad Loss: 0.3212 | Atten Loss: 0.0000 | Soft Loss: 0.0813 | Time: 3.3336s
F1-Score on valset:       whole 0.9574, part1 0.9575, part2 0.9573
F1-Score on testset:       whole 0.9729, part1 0.9732, part2 0.9726
Epoch 00520 | Loss: 0.1109 | Swap Loss: 0.0000 | Grad Loss: 0.3195 | Atten Loss: 0.0000 | Soft Loss: 0.0789 | Time: 3.4025s
Epoch 00521 | Loss: 0.1063 | Swap Loss: 0.0000 | Grad Loss: 0.3095 | Atten Loss: 0.0000 | Soft Loss: 0.0753 | Time: 3.1824s
Epoch 00522 | Loss: 0.1088 | Swap Loss: 0.0000 | Grad Loss: 0.3155 | Atten Loss: 0.0000 | Soft Loss: 0.0773 | Time: 3.2399s
Epoch 00523 | Loss: 0.1078 | Swap Loss: 0.0000 | Grad Loss: 0.3135 | Atten Loss: 0.0000 | Soft Loss: 0.0765 | Time: 3.3633s
Epoch 00524 | Loss: 0.1068 | Swap Loss: 0.0000 | Grad Loss: 0.3120 | Atten Loss: 0.0000 | Soft Loss: 0.0756 | Time: 3.3457s
F1-Score on valset:       whole 0.9579, part1 0.9580, part2 0.9579
F1-Score on testset:       whole 0.9734, part1 0.9738, part2 0.9730
Epoch 00525 | Loss: 0.1110 | Swap Loss: 0.0000 | Grad Loss: 0.3191 | Atten Loss: 0.0000 | Soft Loss: 0.0791 | Time: 3.4697s
Epoch 00526 | Loss: 0.1110 | Swap Loss: 0.0000 | Grad Loss: 0.3209 | Atten Loss: 0.0000 | Soft Loss: 0.0789 | Time: 3.3060s
Epoch 00527 | Loss: 0.1136 | Swap Loss: 0.0000 | Grad Loss: 0.3287 | Atten Loss: 0.0000 | Soft Loss: 0.0807 | Time: 3.4516s
Epoch 00528 | Loss: 0.1055 | Swap Loss: 0.0000 | Grad Loss: 0.3129 | Atten Loss: 0.0000 | Soft Loss: 0.0742 | Time: 3.6386s
Epoch 00529 | Loss: 0.1059 | Swap Loss: 0.0000 | Grad Loss: 0.3148 | Atten Loss: 0.0000 | Soft Loss: 0.0744 | Time: 3.4339s
F1-Score on valset:       whole 0.9583, part1 0.9584, part2 0.9581
F1-Score on testset:       whole 0.9735, part1 0.9739, part2 0.9731
Epoch 00530 | Loss: 0.1105 | Swap Loss: 0.0000 | Grad Loss: 0.3227 | Atten Loss: 0.0000 | Soft Loss: 0.0783 | Time: 3.3621s
Epoch 00531 | Loss: 0.1062 | Swap Loss: 0.0000 | Grad Loss: 0.3144 | Atten Loss: 0.0000 | Soft Loss: 0.0747 | Time: 3.4209s
Epoch 00532 | Loss: 0.1068 | Swap Loss: 0.0000 | Grad Loss: 0.3187 | Atten Loss: 0.0000 | Soft Loss: 0.0749 | Time: 3.2760s
Epoch 00533 | Loss: 0.1080 | Swap Loss: 0.0000 | Grad Loss: 0.3188 | Atten Loss: 0.0000 | Soft Loss: 0.0762 | Time: 3.2879s
Epoch 00534 | Loss: 0.1061 | Swap Loss: 0.0000 | Grad Loss: 0.3190 | Atten Loss: 0.0000 | Soft Loss: 0.0742 | Time: 3.0540s
F1-Score on valset:       whole 0.9583, part1 0.9585, part2 0.9582
F1-Score on testset:       whole 0.9737, part1 0.9740, part2 0.9733
Epoch 00535 | Loss: 0.1036 | Swap Loss: 0.0000 | Grad Loss: 0.3093 | Atten Loss: 0.0000 | Soft Loss: 0.0727 | Time: 3.3279s
Epoch 00536 | Loss: 0.1025 | Swap Loss: 0.0000 | Grad Loss: 0.3079 | Atten Loss: 0.0000 | Soft Loss: 0.0717 | Time: 3.3631s
Epoch 00537 | Loss: 0.1030 | Swap Loss: 0.0000 | Grad Loss: 0.3099 | Atten Loss: 0.0000 | Soft Loss: 0.0720 | Time: 3.2719s
Epoch 00538 | Loss: 0.1051 | Swap Loss: 0.0000 | Grad Loss: 0.3145 | Atten Loss: 0.0000 | Soft Loss: 0.0737 | Time: 3.1875s
Epoch 00539 | Loss: 0.1052 | Swap Loss: 0.0000 | Grad Loss: 0.3161 | Atten Loss: 0.0000 | Soft Loss: 0.0736 | Time: 2.9378s
F1-Score on valset:       whole 0.9589, part1 0.9590, part2 0.9588
F1-Score on testset:       whole 0.9739, part1 0.9743, part2 0.9735
Epoch 00540 | Loss: 0.1017 | Swap Loss: 0.0000 | Grad Loss: 0.3082 | Atten Loss: 0.0000 | Soft Loss: 0.0709 | Time: 2.9299s
Epoch 00541 | Loss: 0.1038 | Swap Loss: 0.0000 | Grad Loss: 0.3134 | Atten Loss: 0.0000 | Soft Loss: 0.0725 | Time: 3.2793s
Epoch 00542 | Loss: 0.1045 | Swap Loss: 0.0000 | Grad Loss: 0.3164 | Atten Loss: 0.0000 | Soft Loss: 0.0729 | Time: 3.3065s
Epoch 00543 | Loss: 0.1021 | Swap Loss: 0.0000 | Grad Loss: 0.3103 | Atten Loss: 0.0000 | Soft Loss: 0.0711 | Time: 3.2316s
Epoch 00544 | Loss: 0.1038 | Swap Loss: 0.0000 | Grad Loss: 0.3168 | Atten Loss: 0.0000 | Soft Loss: 0.0722 | Time: 3.1441s
F1-Score on valset:       whole 0.9592, part1 0.9595, part2 0.9588
F1-Score on testset:       whole 0.9742, part1 0.9744, part2 0.9739
Epoch 00545 | Loss: 0.1018 | Swap Loss: 0.0000 | Grad Loss: 0.3119 | Atten Loss: 0.0000 | Soft Loss: 0.0706 | Time: 3.2274s
Epoch 00546 | Loss: 0.1054 | Swap Loss: 0.0000 | Grad Loss: 0.3203 | Atten Loss: 0.0000 | Soft Loss: 0.0734 | Time: 3.1511s
Epoch 00547 | Loss: 0.1014 | Swap Loss: 0.0000 | Grad Loss: 0.3085 | Atten Loss: 0.0000 | Soft Loss: 0.0706 | Time: 3.2858s
Epoch 00548 | Loss: 0.0994 | Swap Loss: 0.0000 | Grad Loss: 0.3062 | Atten Loss: 0.0000 | Soft Loss: 0.0688 | Time: 3.1822s
Epoch 00549 | Loss: 0.1010 | Swap Loss: 0.0000 | Grad Loss: 0.3078 | Atten Loss: 0.0000 | Soft Loss: 0.0702 | Time: 3.3176s
F1-Score on valset:       whole 0.9595, part1 0.9596, part2 0.9594
F1-Score on testset:       whole 0.9745, part1 0.9748, part2 0.9741
Epoch 00550 | Loss: 0.1013 | Swap Loss: 0.0000 | Grad Loss: 0.3114 | Atten Loss: 0.0000 | Soft Loss: 0.0702 | Time: 3.3914s
Epoch 00551 | Loss: 0.0995 | Swap Loss: 0.0000 | Grad Loss: 0.3087 | Atten Loss: 0.0000 | Soft Loss: 0.0686 | Time: 3.2226s
Epoch 00552 | Loss: 0.1001 | Swap Loss: 0.0000 | Grad Loss: 0.3100 | Atten Loss: 0.0000 | Soft Loss: 0.0691 | Time: 3.3352s
Epoch 00553 | Loss: 0.1031 | Swap Loss: 0.0000 | Grad Loss: 0.3168 | Atten Loss: 0.0000 | Soft Loss: 0.0714 | Time: 3.1633s
Epoch 00554 | Loss: 0.1012 | Swap Loss: 0.0000 | Grad Loss: 0.3141 | Atten Loss: 0.0000 | Soft Loss: 0.0698 | Time: 3.1301s
F1-Score on valset:       whole 0.9597, part1 0.9598, part2 0.9596
F1-Score on testset:       whole 0.9746, part1 0.9750, part2 0.9742
Epoch 00555 | Loss: 0.1028 | Swap Loss: 0.0000 | Grad Loss: 0.3187 | Atten Loss: 0.0000 | Soft Loss: 0.0709 | Time: 3.3746s
Epoch 00556 | Loss: 0.0988 | Swap Loss: 0.0000 | Grad Loss: 0.3091 | Atten Loss: 0.0000 | Soft Loss: 0.0679 | Time: 3.3377s
Epoch 00557 | Loss: 0.0991 | Swap Loss: 0.0000 | Grad Loss: 0.3095 | Atten Loss: 0.0000 | Soft Loss: 0.0682 | Time: 3.1915s
Epoch 00558 | Loss: 0.0969 | Swap Loss: 0.0000 | Grad Loss: 0.3042 | Atten Loss: 0.0000 | Soft Loss: 0.0665 | Time: 3.5009s
Epoch 00559 | Loss: 0.0962 | Swap Loss: 0.0000 | Grad Loss: 0.3009 | Atten Loss: 0.0000 | Soft Loss: 0.0661 | Time: 3.1265s
F1-Score on valset:       whole 0.9599, part1 0.9601, part2 0.9598
F1-Score on testset:       whole 0.9749, part1 0.9753, part2 0.9746
Epoch 00560 | Loss: 0.0973 | Swap Loss: 0.0000 | Grad Loss: 0.3058 | Atten Loss: 0.0000 | Soft Loss: 0.0667 | Time: 3.3675s
Epoch 00561 | Loss: 0.0965 | Swap Loss: 0.0000 | Grad Loss: 0.3045 | Atten Loss: 0.0000 | Soft Loss: 0.0660 | Time: 3.2978s
Epoch 00562 | Loss: 0.0962 | Swap Loss: 0.0000 | Grad Loss: 0.3033 | Atten Loss: 0.0000 | Soft Loss: 0.0659 | Time: 3.2193s
Epoch 00563 | Loss: 0.0975 | Swap Loss: 0.0000 | Grad Loss: 0.3083 | Atten Loss: 0.0000 | Soft Loss: 0.0667 | Time: 3.4087s
Epoch 00564 | Loss: 0.1024 | Swap Loss: 0.0000 | Grad Loss: 0.3198 | Atten Loss: 0.0000 | Soft Loss: 0.0704 | Time: 3.4117s
F1-Score on valset:       whole 0.9606, part1 0.9609, part2 0.9603
F1-Score on testset:       whole 0.9752, part1 0.9756, part2 0.9747
Epoch 00565 | Loss: 0.0982 | Swap Loss: 0.0000 | Grad Loss: 0.3108 | Atten Loss: 0.0000 | Soft Loss: 0.0671 | Time: 3.2050s
Epoch 00566 | Loss: 0.0947 | Swap Loss: 0.0000 | Grad Loss: 0.3016 | Atten Loss: 0.0000 | Soft Loss: 0.0646 | Time: 3.1676s
Epoch 00567 | Loss: 0.0977 | Swap Loss: 0.0000 | Grad Loss: 0.3089 | Atten Loss: 0.0000 | Soft Loss: 0.0668 | Time: 3.0947s
Epoch 00568 | Loss: 0.0954 | Swap Loss: 0.0000 | Grad Loss: 0.3051 | Atten Loss: 0.0000 | Soft Loss: 0.0649 | Time: 3.4961s
Epoch 00569 | Loss: 0.1003 | Swap Loss: 0.0000 | Grad Loss: 0.3173 | Atten Loss: 0.0000 | Soft Loss: 0.0686 | Time: 3.2844s
F1-Score on valset:       whole 0.9606, part1 0.9606, part2 0.9605
F1-Score on testset:       whole 0.9753, part1 0.9756, part2 0.9749
Epoch 00570 | Loss: 0.0957 | Swap Loss: 0.0000 | Grad Loss: 0.3065 | Atten Loss: 0.0000 | Soft Loss: 0.0651 | Time: 3.1589s
Epoch 00571 | Loss: 0.0948 | Swap Loss: 0.0000 | Grad Loss: 0.3055 | Atten Loss: 0.0000 | Soft Loss: 0.0643 | Time: 3.3253s
Epoch 00572 | Loss: 0.0946 | Swap Loss: 0.0000 | Grad Loss: 0.3036 | Atten Loss: 0.0000 | Soft Loss: 0.0643 | Time: 3.0758s
Epoch 00573 | Loss: 0.0925 | Swap Loss: 0.0000 | Grad Loss: 0.2992 | Atten Loss: 0.0000 | Soft Loss: 0.0625 | Time: 3.2408s
Epoch 00574 | Loss: 0.0938 | Swap Loss: 0.0000 | Grad Loss: 0.3038 | Atten Loss: 0.0000 | Soft Loss: 0.0634 | Time: 3.1797s
F1-Score on valset:       whole 0.9609, part1 0.9612, part2 0.9607
F1-Score on testset:       whole 0.9755, part1 0.9758, part2 0.9753
Epoch 00575 | Loss: 0.0948 | Swap Loss: 0.0000 | Grad Loss: 0.3051 | Atten Loss: 0.0000 | Soft Loss: 0.0643 | Time: 3.3167s
Epoch 00576 | Loss: 0.0945 | Swap Loss: 0.0000 | Grad Loss: 0.3057 | Atten Loss: 0.0000 | Soft Loss: 0.0639 | Time: 3.3570s
Epoch 00577 | Loss: 0.0933 | Swap Loss: 0.0000 | Grad Loss: 0.3024 | Atten Loss: 0.0000 | Soft Loss: 0.0631 | Time: 3.5254s
Epoch 00578 | Loss: 0.0935 | Swap Loss: 0.0000 | Grad Loss: 0.3030 | Atten Loss: 0.0000 | Soft Loss: 0.0632 | Time: 3.1918s
Epoch 00579 | Loss: 0.0987 | Swap Loss: 0.0000 | Grad Loss: 0.3143 | Atten Loss: 0.0000 | Soft Loss: 0.0673 | Time: 3.4056s
F1-Score on valset:       whole 0.9614, part1 0.9616, part2 0.9612
F1-Score on testset:       whole 0.9758, part1 0.9760, part2 0.9755
Epoch 00580 | Loss: 0.0907 | Swap Loss: 0.0000 | Grad Loss: 0.2986 | Atten Loss: 0.0000 | Soft Loss: 0.0609 | Time: 3.3258s
Epoch 00581 | Loss: 0.0929 | Swap Loss: 0.0000 | Grad Loss: 0.3017 | Atten Loss: 0.0000 | Soft Loss: 0.0627 | Time: 3.4093s
Epoch 00582 | Loss: 0.0902 | Swap Loss: 0.0000 | Grad Loss: 0.2979 | Atten Loss: 0.0000 | Soft Loss: 0.0604 | Time: 3.3767s
Epoch 00583 | Loss: 0.0904 | Swap Loss: 0.0000 | Grad Loss: 0.2995 | Atten Loss: 0.0000 | Soft Loss: 0.0605 | Time: 3.0553s
Epoch 00584 | Loss: 0.0911 | Swap Loss: 0.0000 | Grad Loss: 0.3030 | Atten Loss: 0.0000 | Soft Loss: 0.0608 | Time: 3.2453s
F1-Score on valset:       whole 0.9614, part1 0.9616, part2 0.9612
F1-Score on testset:       whole 0.9760, part1 0.9764, part2 0.9756
Epoch 00585 | Loss: 0.0946 | Swap Loss: 0.0000 | Grad Loss: 0.3117 | Atten Loss: 0.0000 | Soft Loss: 0.0634 | Time: 3.1842s
Epoch 00586 | Loss: 0.0895 | Swap Loss: 0.0000 | Grad Loss: 0.2958 | Atten Loss: 0.0000 | Soft Loss: 0.0599 | Time: 3.2162s
Epoch 00587 | Loss: 0.0917 | Swap Loss: 0.0000 | Grad Loss: 0.3022 | Atten Loss: 0.0000 | Soft Loss: 0.0615 | Time: 3.2512s
Epoch 00588 | Loss: 0.0918 | Swap Loss: 0.0000 | Grad Loss: 0.3043 | Atten Loss: 0.0000 | Soft Loss: 0.0614 | Time: 3.0782s
Epoch 00589 | Loss: 0.0895 | Swap Loss: 0.0000 | Grad Loss: 0.2976 | Atten Loss: 0.0000 | Soft Loss: 0.0598 | Time: 3.4103s
F1-Score on valset:       whole 0.9620, part1 0.9622, part2 0.9619
F1-Score on testset:       whole 0.9763, part1 0.9766, part2 0.9760
Epoch 00590 | Loss: 0.0917 | Swap Loss: 0.0000 | Grad Loss: 0.3045 | Atten Loss: 0.0000 | Soft Loss: 0.0612 | Time: 3.0382s
Epoch 00591 | Loss: 0.0884 | Swap Loss: 0.0000 | Grad Loss: 0.2959 | Atten Loss: 0.0000 | Soft Loss: 0.0588 | Time: 3.4045s
Epoch 00592 | Loss: 0.0875 | Swap Loss: 0.0000 | Grad Loss: 0.2912 | Atten Loss: 0.0000 | Soft Loss: 0.0584 | Time: 3.3751s
Epoch 00593 | Loss: 0.0891 | Swap Loss: 0.0000 | Grad Loss: 0.2980 | Atten Loss: 0.0000 | Soft Loss: 0.0593 | Time: 3.2932s
Epoch 00594 | Loss: 0.0903 | Swap Loss: 0.0000 | Grad Loss: 0.3001 | Atten Loss: 0.0000 | Soft Loss: 0.0603 | Time: 3.2452s
F1-Score on valset:       whole 0.9622, part1 0.9624, part2 0.9620
F1-Score on testset:       whole 0.9766, part1 0.9768, part2 0.9764
Epoch 00595 | Loss: 0.0892 | Swap Loss: 0.0000 | Grad Loss: 0.2977 | Atten Loss: 0.0000 | Soft Loss: 0.0595 | Time: 3.3698s
Epoch 00596 | Loss: 0.0850 | Swap Loss: 0.0000 | Grad Loss: 0.2886 | Atten Loss: 0.0000 | Soft Loss: 0.0562 | Time: 3.1255s
Epoch 00597 | Loss: 0.0919 | Swap Loss: 0.0000 | Grad Loss: 0.3063 | Atten Loss: 0.0000 | Soft Loss: 0.0612 | Time: 3.3654s
Epoch 00598 | Loss: 0.0887 | Swap Loss: 0.0000 | Grad Loss: 0.3027 | Atten Loss: 0.0000 | Soft Loss: 0.0584 | Time: 3.2571s
Epoch 00599 | Loss: 0.0920 | Swap Loss: 0.0000 | Grad Loss: 0.3110 | Atten Loss: 0.0000 | Soft Loss: 0.0609 | Time: 3.3250s
F1-Score on valset:       whole 0.9622, part1 0.9624, part2 0.9619
Epoch 00600 | Loss: 0.0877 | Swap Loss: 0.0000 | Grad Loss: 0.2973 | Atten Loss: 0.0000 | Soft Loss: 0.0580 | Time: 3.2508s
Epoch 00601 | Loss: 0.0924 | Swap Loss: 0.0000 | Grad Loss: 0.3100 | Atten Loss: 0.0000 | Soft Loss: 0.0614 | Time: 3.4082s
Epoch 00602 | Loss: 0.0875 | Swap Loss: 0.0000 | Grad Loss: 0.2970 | Atten Loss: 0.0000 | Soft Loss: 0.0578 | Time: 3.3390s
Epoch 00603 | Loss: 0.0882 | Swap Loss: 0.0000 | Grad Loss: 0.3013 | Atten Loss: 0.0000 | Soft Loss: 0.0581 | Time: 3.2946s
Epoch 00604 | Loss: 0.0871 | Swap Loss: 0.0000 | Grad Loss: 0.2963 | Atten Loss: 0.0000 | Soft Loss: 0.0575 | Time: 3.2289s
F1-Score on valset:       whole 0.9625, part1 0.9627, part2 0.9624
F1-Score on testset:       whole 0.9768, part1 0.9772, part2 0.9765
Epoch 00605 | Loss: 0.0862 | Swap Loss: 0.0000 | Grad Loss: 0.2963 | Atten Loss: 0.0000 | Soft Loss: 0.0565 | Time: 3.4207s
Epoch 00606 | Loss: 0.0919 | Swap Loss: 0.0000 | Grad Loss: 0.3088 | Atten Loss: 0.0000 | Soft Loss: 0.0610 | Time: 3.5606s
Epoch 00607 | Loss: 0.0863 | Swap Loss: 0.0000 | Grad Loss: 0.2981 | Atten Loss: 0.0000 | Soft Loss: 0.0565 | Time: 3.2422s
Epoch 00608 | Loss: 0.0869 | Swap Loss: 0.0000 | Grad Loss: 0.2978 | Atten Loss: 0.0000 | Soft Loss: 0.0571 | Time: 3.2516s
Epoch 00609 | Loss: 0.0857 | Swap Loss: 0.0000 | Grad Loss: 0.2945 | Atten Loss: 0.0000 | Soft Loss: 0.0563 | Time: 7.1422s
F1-Score on valset:       whole 0.9629, part1 0.9631, part2 0.9627
F1-Score on testset:       whole 0.9770, part1 0.9773, part2 0.9767
Epoch 00610 | Loss: 0.0838 | Swap Loss: 0.0000 | Grad Loss: 0.2902 | Atten Loss: 0.0000 | Soft Loss: 0.0548 | Time: 3.3133s
Epoch 00611 | Loss: 0.0832 | Swap Loss: 0.0000 | Grad Loss: 0.2901 | Atten Loss: 0.0000 | Soft Loss: 0.0542 | Time: 3.4770s
Epoch 00612 | Loss: 0.0847 | Swap Loss: 0.0000 | Grad Loss: 0.2936 | Atten Loss: 0.0000 | Soft Loss: 0.0554 | Time: 3.0985s
Epoch 00613 | Loss: 0.0903 | Swap Loss: 0.0000 | Grad Loss: 0.3088 | Atten Loss: 0.0000 | Soft Loss: 0.0594 | Time: 3.4631s
Epoch 00614 | Loss: 0.0866 | Swap Loss: 0.0000 | Grad Loss: 0.2996 | Atten Loss: 0.0000 | Soft Loss: 0.0567 | Time: 3.5493s
F1-Score on valset:       whole 0.9631, part1 0.9633, part2 0.9629
F1-Score on testset:       whole 0.9771, part1 0.9773, part2 0.9768
Epoch 00615 | Loss: 0.0875 | Swap Loss: 0.0000 | Grad Loss: 0.3009 | Atten Loss: 0.0000 | Soft Loss: 0.0574 | Time: 3.8736s
Epoch 00616 | Loss: 0.0860 | Swap Loss: 0.0000 | Grad Loss: 0.3005 | Atten Loss: 0.0000 | Soft Loss: 0.0560 | Time: 3.2494s
Epoch 00617 | Loss: 0.0867 | Swap Loss: 0.0000 | Grad Loss: 0.3005 | Atten Loss: 0.0000 | Soft Loss: 0.0566 | Time: 3.4776s
Epoch 00618 | Loss: 0.0881 | Swap Loss: 0.0000 | Grad Loss: 0.3016 | Atten Loss: 0.0000 | Soft Loss: 0.0579 | Time: 3.4950s
Epoch 00619 | Loss: 0.0836 | Swap Loss: 0.0000 | Grad Loss: 0.2929 | Atten Loss: 0.0000 | Soft Loss: 0.0543 | Time: 3.5371s
F1-Score on valset:       whole 0.9631, part1 0.9634, part2 0.9629
F1-Score on testset:       whole 0.9773, part1 0.9775, part2 0.9771
Epoch 00620 | Loss: 0.0813 | Swap Loss: 0.0000 | Grad Loss: 0.2864 | Atten Loss: 0.0000 | Soft Loss: 0.0526 | Time: 2.8702s
Epoch 00621 | Loss: 0.0846 | Swap Loss: 0.0000 | Grad Loss: 0.2955 | Atten Loss: 0.0000 | Soft Loss: 0.0550 | Time: 3.1311s
Epoch 00622 | Loss: 0.0813 | Swap Loss: 0.0000 | Grad Loss: 0.2874 | Atten Loss: 0.0000 | Soft Loss: 0.0525 | Time: 2.9795s
Epoch 00623 | Loss: 0.0825 | Swap Loss: 0.0000 | Grad Loss: 0.2917 | Atten Loss: 0.0000 | Soft Loss: 0.0533 | Time: 3.1690s
Epoch 00624 | Loss: 0.0819 | Swap Loss: 0.0000 | Grad Loss: 0.2895 | Atten Loss: 0.0000 | Soft Loss: 0.0529 | Time: 3.2803s
F1-Score on valset:       whole 0.9637, part1 0.9639, part2 0.9635
F1-Score on testset:       whole 0.9776, part1 0.9778, part2 0.9773
Epoch 00625 | Loss: 0.0840 | Swap Loss: 0.0000 | Grad Loss: 0.2957 | Atten Loss: 0.0000 | Soft Loss: 0.0544 | Time: 3.3667s
Epoch 00626 | Loss: 0.0816 | Swap Loss: 0.0000 | Grad Loss: 0.2900 | Atten Loss: 0.0000 | Soft Loss: 0.0526 | Time: 3.2793s
Epoch 00627 | Loss: 0.0822 | Swap Loss: 0.0000 | Grad Loss: 0.2907 | Atten Loss: 0.0000 | Soft Loss: 0.0531 | Time: 3.4284s
Epoch 00628 | Loss: 0.0799 | Swap Loss: 0.0000 | Grad Loss: 0.2882 | Atten Loss: 0.0000 | Soft Loss: 0.0511 | Time: 2.9563s
Epoch 00629 | Loss: 0.0809 | Swap Loss: 0.0000 | Grad Loss: 0.2887 | Atten Loss: 0.0000 | Soft Loss: 0.0520 | Time: 3.3982s
F1-Score on valset:       whole 0.9639, part1 0.9641, part2 0.9636
F1-Score on testset:       whole 0.9778, part1 0.9781, part2 0.9775
Epoch 00630 | Loss: 0.0816 | Swap Loss: 0.0000 | Grad Loss: 0.2923 | Atten Loss: 0.0000 | Soft Loss: 0.0524 | Time: 3.1064s
Epoch 00631 | Loss: 0.0799 | Swap Loss: 0.0000 | Grad Loss: 0.2875 | Atten Loss: 0.0000 | Soft Loss: 0.0512 | Time: 3.3702s
Epoch 00632 | Loss: 0.0802 | Swap Loss: 0.0000 | Grad Loss: 0.2886 | Atten Loss: 0.0000 | Soft Loss: 0.0513 | Time: 3.2890s
Epoch 00633 | Loss: 0.0821 | Swap Loss: 0.0000 | Grad Loss: 0.2943 | Atten Loss: 0.0000 | Soft Loss: 0.0527 | Time: 3.3237s
Epoch 00634 | Loss: 0.0826 | Swap Loss: 0.0000 | Grad Loss: 0.2960 | Atten Loss: 0.0000 | Soft Loss: 0.0530 | Time: 3.2048s
F1-Score on valset:       whole 0.9638, part1 0.9641, part2 0.9635
Epoch 00635 | Loss: 0.0814 | Swap Loss: 0.0000 | Grad Loss: 0.2923 | Atten Loss: 0.0000 | Soft Loss: 0.0522 | Time: 3.4915s
Epoch 00636 | Loss: 0.0842 | Swap Loss: 0.0000 | Grad Loss: 0.2994 | Atten Loss: 0.0000 | Soft Loss: 0.0542 | Time: 3.3749s
Epoch 00637 | Loss: 0.0780 | Swap Loss: 0.0000 | Grad Loss: 0.2839 | Atten Loss: 0.0000 | Soft Loss: 0.0496 | Time: 3.2548s
Epoch 00638 | Loss: 0.0807 | Swap Loss: 0.0000 | Grad Loss: 0.2927 | Atten Loss: 0.0000 | Soft Loss: 0.0515 | Time: 3.2408s
Epoch 00639 | Loss: 0.0837 | Swap Loss: 0.0000 | Grad Loss: 0.2972 | Atten Loss: 0.0000 | Soft Loss: 0.0540 | Time: 3.2611s
F1-Score on valset:       whole 0.9640, part1 0.9641, part2 0.9639
F1-Score on testset:       whole 0.9779, part1 0.9780, part2 0.9778
Epoch 00640 | Loss: 0.0792 | Swap Loss: 0.0000 | Grad Loss: 0.2872 | Atten Loss: 0.0000 | Soft Loss: 0.0505 | Time: 3.0576s
Epoch 00641 | Loss: 0.0788 | Swap Loss: 0.0000 | Grad Loss: 0.2884 | Atten Loss: 0.0000 | Soft Loss: 0.0499 | Time: 3.2555s
Epoch 00642 | Loss: 0.0809 | Swap Loss: 0.0000 | Grad Loss: 0.2942 | Atten Loss: 0.0000 | Soft Loss: 0.0515 | Time: 3.0278s
Epoch 00643 | Loss: 0.0796 | Swap Loss: 0.0000 | Grad Loss: 0.2913 | Atten Loss: 0.0000 | Soft Loss: 0.0504 | Time: 3.1438s
Epoch 00644 | Loss: 0.0805 | Swap Loss: 0.0000 | Grad Loss: 0.2959 | Atten Loss: 0.0000 | Soft Loss: 0.0509 | Time: 3.0122s
F1-Score on valset:       whole 0.9644, part1 0.9646, part2 0.9643
F1-Score on testset:       whole 0.9781, part1 0.9782, part2 0.9780
Epoch 00645 | Loss: 0.0763 | Swap Loss: 0.0000 | Grad Loss: 0.2817 | Atten Loss: 0.0000 | Soft Loss: 0.0481 | Time: 3.2636s
Epoch 00646 | Loss: 0.0773 | Swap Loss: 0.0000 | Grad Loss: 0.2866 | Atten Loss: 0.0000 | Soft Loss: 0.0486 | Time: 3.4366s
Epoch 00647 | Loss: 0.0801 | Swap Loss: 0.0000 | Grad Loss: 0.2939 | Atten Loss: 0.0000 | Soft Loss: 0.0507 | Time: 3.4454s
Epoch 00648 | Loss: 0.0779 | Swap Loss: 0.0000 | Grad Loss: 0.2887 | Atten Loss: 0.0000 | Soft Loss: 0.0490 | Time: 3.1696s
Epoch 00649 | Loss: 0.0806 | Swap Loss: 0.0000 | Grad Loss: 0.2955 | Atten Loss: 0.0000 | Soft Loss: 0.0511 | Time: 3.2992s
F1-Score on valset:       whole 0.9645, part1 0.9648, part2 0.9642
F1-Score on testset:       whole 0.9781, part1 0.9783, part2 0.9780
Epoch 00650 | Loss: 0.0777 | Swap Loss: 0.0000 | Grad Loss: 0.2897 | Atten Loss: 0.0000 | Soft Loss: 0.0487 | Time: 3.0715s
Epoch 00651 | Loss: 0.0786 | Swap Loss: 0.0000 | Grad Loss: 0.2891 | Atten Loss: 0.0000 | Soft Loss: 0.0497 | Time: 3.4595s
Epoch 00652 | Loss: 0.0771 | Swap Loss: 0.0000 | Grad Loss: 0.2885 | Atten Loss: 0.0000 | Soft Loss: 0.0483 | Time: 3.3392s
Epoch 00653 | Loss: 0.0800 | Swap Loss: 0.0000 | Grad Loss: 0.2964 | Atten Loss: 0.0000 | Soft Loss: 0.0504 | Time: 3.4690s
Epoch 00654 | Loss: 0.0753 | Swap Loss: 0.0000 | Grad Loss: 0.2838 | Atten Loss: 0.0000 | Soft Loss: 0.0469 | Time: 3.2815s
F1-Score on valset:       whole 0.9644, part1 0.9647, part2 0.9642
F1-Score on testset:       whole 0.9782, part1 0.9783, part2 0.9780
Epoch 00655 | Loss: 0.0768 | Swap Loss: 0.0000 | Grad Loss: 0.2865 | Atten Loss: 0.0000 | Soft Loss: 0.0482 | Time: 3.3465s
Epoch 00656 | Loss: 0.0813 | Swap Loss: 0.0000 | Grad Loss: 0.2995 | Atten Loss: 0.0000 | Soft Loss: 0.0514 | Time: 3.5242s
Epoch 00657 | Loss: 0.0778 | Swap Loss: 0.0000 | Grad Loss: 0.2901 | Atten Loss: 0.0000 | Soft Loss: 0.0488 | Time: 3.5482s
Epoch 00658 | Loss: 0.0750 | Swap Loss: 0.0000 | Grad Loss: 0.2812 | Atten Loss: 0.0000 | Soft Loss: 0.0469 | Time: 3.3443s
Epoch 00659 | Loss: 0.0767 | Swap Loss: 0.0000 | Grad Loss: 0.2874 | Atten Loss: 0.0000 | Soft Loss: 0.0480 | Time: 3.2148s
F1-Score on valset:       whole 0.9647, part1 0.9649, part2 0.9646
F1-Score on testset:       whole 0.9784, part1 0.9785, part2 0.9783
Epoch 00660 | Loss: 0.0739 | Swap Loss: 0.0000 | Grad Loss: 0.2791 | Atten Loss: 0.0000 | Soft Loss: 0.0460 | Time: 3.0942s
Epoch 00661 | Loss: 0.0774 | Swap Loss: 0.0000 | Grad Loss: 0.2893 | Atten Loss: 0.0000 | Soft Loss: 0.0485 | Time: 3.3166s
Epoch 00662 | Loss: 0.0757 | Swap Loss: 0.0000 | Grad Loss: 0.2851 | Atten Loss: 0.0000 | Soft Loss: 0.0471 | Time: 3.2536s
Epoch 00663 | Loss: 0.0759 | Swap Loss: 0.0000 | Grad Loss: 0.2863 | Atten Loss: 0.0000 | Soft Loss: 0.0473 | Time: 3.2577s
Epoch 00664 | Loss: 0.0749 | Swap Loss: 0.0000 | Grad Loss: 0.2848 | Atten Loss: 0.0000 | Soft Loss: 0.0464 | Time: 3.2777s
F1-Score on valset:       whole 0.9649, part1 0.9648, part2 0.9649
F1-Score on testset:       whole 0.9785, part1 0.9785, part2 0.9784
Epoch 00665 | Loss: 0.0745 | Swap Loss: 0.0000 | Grad Loss: 0.2831 | Atten Loss: 0.0000 | Soft Loss: 0.0462 | Time: 3.4698s
Epoch 00666 | Loss: 0.0761 | Swap Loss: 0.0000 | Grad Loss: 0.2898 | Atten Loss: 0.0000 | Soft Loss: 0.0471 | Time: 3.4507s
Epoch 00667 | Loss: 0.0749 | Swap Loss: 0.0000 | Grad Loss: 0.2835 | Atten Loss: 0.0000 | Soft Loss: 0.0465 | Time: 3.3444s
Epoch 00668 | Loss: 0.0747 | Swap Loss: 0.0000 | Grad Loss: 0.2830 | Atten Loss: 0.0000 | Soft Loss: 0.0464 | Time: 3.3422s
Epoch 00669 | Loss: 0.0732 | Swap Loss: 0.0000 | Grad Loss: 0.2800 | Atten Loss: 0.0000 | Soft Loss: 0.0452 | Time: 3.1403s
F1-Score on valset:       whole 0.9653, part1 0.9654, part2 0.9651
F1-Score on testset:       whole 0.9787, part1 0.9789, part2 0.9786
Epoch 00670 | Loss: 0.0723 | Swap Loss: 0.0000 | Grad Loss: 0.2755 | Atten Loss: 0.0000 | Soft Loss: 0.0447 | Time: 3.4854s
Epoch 00671 | Loss: 0.0725 | Swap Loss: 0.0000 | Grad Loss: 0.2779 | Atten Loss: 0.0000 | Soft Loss: 0.0447 | Time: 3.3219s
Epoch 00672 | Loss: 0.0740 | Swap Loss: 0.0000 | Grad Loss: 0.2839 | Atten Loss: 0.0000 | Soft Loss: 0.0456 | Time: 3.6542s
Epoch 00673 | Loss: 0.0773 | Swap Loss: 0.0000 | Grad Loss: 0.2917 | Atten Loss: 0.0000 | Soft Loss: 0.0481 | Time: 3.5166s
Epoch 00674 | Loss: 0.0724 | Swap Loss: 0.0000 | Grad Loss: 0.2794 | Atten Loss: 0.0000 | Soft Loss: 0.0445 | Time: 3.4302s
F1-Score on valset:       whole 0.9654, part1 0.9655, part2 0.9653
F1-Score on testset:       whole 0.9788, part1 0.9788, part2 0.9787
Epoch 00675 | Loss: 0.0746 | Swap Loss: 0.0000 | Grad Loss: 0.2879 | Atten Loss: 0.0000 | Soft Loss: 0.0458 | Time: 3.3809s
Epoch 00676 | Loss: 0.0722 | Swap Loss: 0.0000 | Grad Loss: 0.2801 | Atten Loss: 0.0000 | Soft Loss: 0.0442 | Time: 3.4664s
Epoch 00677 | Loss: 0.0732 | Swap Loss: 0.0000 | Grad Loss: 0.2809 | Atten Loss: 0.0000 | Soft Loss: 0.0451 | Time: 3.3973s
Epoch 00678 | Loss: 0.0708 | Swap Loss: 0.0000 | Grad Loss: 0.2756 | Atten Loss: 0.0000 | Soft Loss: 0.0433 | Time: 3.3962s
Epoch 00679 | Loss: 0.0728 | Swap Loss: 0.0000 | Grad Loss: 0.2808 | Atten Loss: 0.0000 | Soft Loss: 0.0447 | Time: 3.1762s
F1-Score on valset:       whole 0.9655, part1 0.9656, part2 0.9653
F1-Score on testset:       whole 0.9789, part1 0.9789, part2 0.9788
Epoch 00680 | Loss: 0.0710 | Swap Loss: 0.0000 | Grad Loss: 0.2780 | Atten Loss: 0.0000 | Soft Loss: 0.0432 | Time: 3.4087s
Epoch 00681 | Loss: 0.0716 | Swap Loss: 0.0000 | Grad Loss: 0.2788 | Atten Loss: 0.0000 | Soft Loss: 0.0437 | Time: 3.3331s
Epoch 00682 | Loss: 0.0742 | Swap Loss: 0.0000 | Grad Loss: 0.2862 | Atten Loss: 0.0000 | Soft Loss: 0.0455 | Time: 3.2551s
Epoch 00683 | Loss: 0.0744 | Swap Loss: 0.0000 | Grad Loss: 0.2869 | Atten Loss: 0.0000 | Soft Loss: 0.0457 | Time: 3.3863s
Epoch 00684 | Loss: 0.0712 | Swap Loss: 0.0000 | Grad Loss: 0.2773 | Atten Loss: 0.0000 | Soft Loss: 0.0434 | Time: 3.1994s
F1-Score on valset:       whole 0.9657, part1 0.9659, part2 0.9655
F1-Score on testset:       whole 0.9791, part1 0.9793, part2 0.9789
Epoch 00685 | Loss: 0.0709 | Swap Loss: 0.0000 | Grad Loss: 0.2794 | Atten Loss: 0.0000 | Soft Loss: 0.0429 | Time: 3.4700s
Epoch 00686 | Loss: 0.0699 | Swap Loss: 0.0000 | Grad Loss: 0.2758 | Atten Loss: 0.0000 | Soft Loss: 0.0423 | Time: 3.3054s
Epoch 00687 | Loss: 0.0729 | Swap Loss: 0.0000 | Grad Loss: 0.2846 | Atten Loss: 0.0000 | Soft Loss: 0.0444 | Time: 3.2770s
Epoch 00688 | Loss: 0.0722 | Swap Loss: 0.0000 | Grad Loss: 0.2841 | Atten Loss: 0.0000 | Soft Loss: 0.0438 | Time: 3.3454s
Epoch 00689 | Loss: 0.0719 | Swap Loss: 0.0000 | Grad Loss: 0.2820 | Atten Loss: 0.0000 | Soft Loss: 0.0437 | Time: 3.1733s
F1-Score on valset:       whole 0.9658, part1 0.9660, part2 0.9657
F1-Score on testset:       whole 0.9792, part1 0.9792, part2 0.9791
Epoch 00690 | Loss: 0.0689 | Swap Loss: 0.0000 | Grad Loss: 0.2723 | Atten Loss: 0.0000 | Soft Loss: 0.0417 | Time: 3.2923s
Epoch 00691 | Loss: 0.0698 | Swap Loss: 0.0000 | Grad Loss: 0.2745 | Atten Loss: 0.0000 | Soft Loss: 0.0424 | Time: 3.4214s
Epoch 00692 | Loss: 0.0707 | Swap Loss: 0.0000 | Grad Loss: 0.2803 | Atten Loss: 0.0000 | Soft Loss: 0.0427 | Time: 3.2834s
Epoch 00693 | Loss: 0.0740 | Swap Loss: 0.0000 | Grad Loss: 0.2883 | Atten Loss: 0.0000 | Soft Loss: 0.0452 | Time: 3.5260s
Epoch 00694 | Loss: 0.0719 | Swap Loss: 0.0000 | Grad Loss: 0.2836 | Atten Loss: 0.0000 | Soft Loss: 0.0436 | Time: 3.0208s
F1-Score on valset:       whole 0.9660, part1 0.9661, part2 0.9659
F1-Score on testset:       whole 0.9793, part1 0.9793, part2 0.9793
Epoch 00695 | Loss: 0.0687 | Swap Loss: 0.0000 | Grad Loss: 0.2750 | Atten Loss: 0.0000 | Soft Loss: 0.0412 | Time: 3.1587s
Epoch 00696 | Loss: 0.0712 | Swap Loss: 0.0000 | Grad Loss: 0.2833 | Atten Loss: 0.0000 | Soft Loss: 0.0428 | Time: 3.3220s
Epoch 00697 | Loss: 0.0745 | Swap Loss: 0.0000 | Grad Loss: 0.2930 | Atten Loss: 0.0000 | Soft Loss: 0.0452 | Time: 3.3212s
Epoch 00698 | Loss: 0.0698 | Swap Loss: 0.0000 | Grad Loss: 0.2801 | Atten Loss: 0.0000 | Soft Loss: 0.0418 | Time: 3.3998s
Epoch 00699 | Loss: 0.0698 | Swap Loss: 0.0000 | Grad Loss: 0.2819 | Atten Loss: 0.0000 | Soft Loss: 0.0416 | Time: 3.2759s
F1-Score on valset:       whole 0.9659, part1 0.9661, part2 0.9657
F1-Score on testset:       whole 0.9792, part1 0.9792, part2 0.9791
Epoch 00700 | Loss: 0.0716 | Swap Loss: 0.0000 | Grad Loss: 0.2820 | Atten Loss: 0.0000 | Soft Loss: 0.0434 | Time: 3.3801s
Epoch 00701 | Loss: 0.0691 | Swap Loss: 0.0000 | Grad Loss: 0.2777 | Atten Loss: 0.0000 | Soft Loss: 0.0413 | Time: 3.2484s
Epoch 00702 | Loss: 0.0727 | Swap Loss: 0.0000 | Grad Loss: 0.2867 | Atten Loss: 0.0000 | Soft Loss: 0.0440 | Time: 3.3696s
Epoch 00703 | Loss: 0.0685 | Swap Loss: 0.0000 | Grad Loss: 0.2758 | Atten Loss: 0.0000 | Soft Loss: 0.0410 | Time: 3.2281s
Epoch 00704 | Loss: 0.0704 | Swap Loss: 0.0000 | Grad Loss: 0.2826 | Atten Loss: 0.0000 | Soft Loss: 0.0422 | Time: 3.2135s
F1-Score on valset:       whole 0.9662, part1 0.9664, part2 0.9660
F1-Score on testset:       whole 0.9794, part1 0.9795, part2 0.9793
Epoch 00705 | Loss: 0.0691 | Swap Loss: 0.0000 | Grad Loss: 0.2788 | Atten Loss: 0.0000 | Soft Loss: 0.0412 | Time: 3.4531s
Epoch 00706 | Loss: 0.0688 | Swap Loss: 0.0000 | Grad Loss: 0.2785 | Atten Loss: 0.0000 | Soft Loss: 0.0409 | Time: 3.2587s
Epoch 00707 | Loss: 0.0705 | Swap Loss: 0.0000 | Grad Loss: 0.2803 | Atten Loss: 0.0000 | Soft Loss: 0.0425 | Time: 3.1711s
Epoch 00708 | Loss: 0.0680 | Swap Loss: 0.0000 | Grad Loss: 0.2742 | Atten Loss: 0.0000 | Soft Loss: 0.0405 | Time: 3.3595s
Epoch 00709 | Loss: 0.0675 | Swap Loss: 0.0000 | Grad Loss: 0.2728 | Atten Loss: 0.0000 | Soft Loss: 0.0402 | Time: 3.2804s
F1-Score on valset:       whole 0.9665, part1 0.9667, part2 0.9664
F1-Score on testset:       whole 0.9797, part1 0.9796, part2 0.9798
Epoch 00710 | Loss: 0.0723 | Swap Loss: 0.0000 | Grad Loss: 0.2908 | Atten Loss: 0.0000 | Soft Loss: 0.0432 | Time: 3.2520s
Epoch 00711 | Loss: 0.0724 | Swap Loss: 0.0000 | Grad Loss: 0.2929 | Atten Loss: 0.0000 | Soft Loss: 0.0431 | Time: 3.3728s
Epoch 00712 | Loss: 0.0710 | Swap Loss: 0.0000 | Grad Loss: 0.2895 | Atten Loss: 0.0000 | Soft Loss: 0.0420 | Time: 2.9758s
Epoch 00713 | Loss: 0.0684 | Swap Loss: 0.0000 | Grad Loss: 0.2790 | Atten Loss: 0.0000 | Soft Loss: 0.0405 | Time: 3.3299s
Epoch 00714 | Loss: 0.0678 | Swap Loss: 0.0000 | Grad Loss: 0.2780 | Atten Loss: 0.0000 | Soft Loss: 0.0400 | Time: 3.3248s
F1-Score on valset:       whole 0.9667, part1 0.9668, part2 0.9665
F1-Score on testset:       whole 0.9795, part1 0.9796, part2 0.9793
Epoch 00715 | Loss: 0.0674 | Swap Loss: 0.0000 | Grad Loss: 0.2756 | Atten Loss: 0.0000 | Soft Loss: 0.0398 | Time: 3.5047s
Epoch 00716 | Loss: 0.0671 | Swap Loss: 0.0000 | Grad Loss: 0.2752 | Atten Loss: 0.0000 | Soft Loss: 0.0395 | Time: 3.2898s
Epoch 00717 | Loss: 0.0706 | Swap Loss: 0.0000 | Grad Loss: 0.2845 | Atten Loss: 0.0000 | Soft Loss: 0.0422 | Time: 3.3902s
Epoch 00718 | Loss: 0.0697 | Swap Loss: 0.0000 | Grad Loss: 0.2825 | Atten Loss: 0.0000 | Soft Loss: 0.0415 | Time: 3.2000s
Epoch 00719 | Loss: 0.0693 | Swap Loss: 0.0000 | Grad Loss: 0.2812 | Atten Loss: 0.0000 | Soft Loss: 0.0412 | Time: 3.4366s
F1-Score on valset:       whole 0.9666, part1 0.9668, part2 0.9664
Epoch 00720 | Loss: 0.0672 | Swap Loss: 0.0000 | Grad Loss: 0.2787 | Atten Loss: 0.0000 | Soft Loss: 0.0393 | Time: 3.4076s
Epoch 00721 | Loss: 0.0659 | Swap Loss: 0.0000 | Grad Loss: 0.2724 | Atten Loss: 0.0000 | Soft Loss: 0.0386 | Time: 3.4623s
Epoch 00722 | Loss: 0.0668 | Swap Loss: 0.0000 | Grad Loss: 0.2750 | Atten Loss: 0.0000 | Soft Loss: 0.0393 | Time: 3.4362s
Epoch 00723 | Loss: 0.0655 | Swap Loss: 0.0000 | Grad Loss: 0.2703 | Atten Loss: 0.0000 | Soft Loss: 0.0385 | Time: 3.3232s
Epoch 00724 | Loss: 0.0654 | Swap Loss: 0.0000 | Grad Loss: 0.2701 | Atten Loss: 0.0000 | Soft Loss: 0.0384 | Time: 3.6079s
F1-Score on valset:       whole 0.9668, part1 0.9670, part2 0.9667
F1-Score on testset:       whole 0.9797, part1 0.9799, part2 0.9796
Epoch 00725 | Loss: 0.0662 | Swap Loss: 0.0000 | Grad Loss: 0.2738 | Atten Loss: 0.0000 | Soft Loss: 0.0388 | Time: 3.2006s
Epoch 00726 | Loss: 0.0680 | Swap Loss: 0.0000 | Grad Loss: 0.2785 | Atten Loss: 0.0000 | Soft Loss: 0.0402 | Time: 3.4642s
Epoch 00727 | Loss: 0.0638 | Swap Loss: 0.0000 | Grad Loss: 0.2669 | Atten Loss: 0.0000 | Soft Loss: 0.0371 | Time: 3.2391s
Epoch 00728 | Loss: 0.0661 | Swap Loss: 0.0000 | Grad Loss: 0.2734 | Atten Loss: 0.0000 | Soft Loss: 0.0387 | Time: 3.6170s
Epoch 00729 | Loss: 0.0665 | Swap Loss: 0.0000 | Grad Loss: 0.2862 | Atten Loss: 0.0000 | Soft Loss: 0.0379 | Time: 3.2317s
F1-Score on valset:       whole 0.9668, part1 0.9670, part2 0.9667
Epoch 00730 | Loss: 0.0708 | Swap Loss: 0.0000 | Grad Loss: 0.2962 | Atten Loss: 0.0000 | Soft Loss: 0.0412 | Time: 3.2923s
Epoch 00731 | Loss: 0.0693 | Swap Loss: 0.0000 | Grad Loss: 0.2897 | Atten Loss: 0.0000 | Soft Loss: 0.0403 | Time: 3.4008s
Epoch 00732 | Loss: 0.0657 | Swap Loss: 0.0000 | Grad Loss: 0.2783 | Atten Loss: 0.0000 | Soft Loss: 0.0378 | Time: 3.5687s
Epoch 00733 | Loss: 0.0649 | Swap Loss: 0.0000 | Grad Loss: 0.2756 | Atten Loss: 0.0000 | Soft Loss: 0.0373 | Time: 3.5208s
Epoch 00734 | Loss: 0.0640 | Swap Loss: 0.0000 | Grad Loss: 0.2709 | Atten Loss: 0.0000 | Soft Loss: 0.0369 | Time: 3.1448s
F1-Score on valset:       whole 0.9672, part1 0.9674, part2 0.9671
F1-Score on testset:       whole 0.9800, part1 0.9800, part2 0.9799
Epoch 00735 | Loss: 0.0633 | Swap Loss: 0.0000 | Grad Loss: 0.2671 | Atten Loss: 0.0000 | Soft Loss: 0.0366 | Time: 3.1270s
Epoch 00736 | Loss: 0.0634 | Swap Loss: 0.0000 | Grad Loss: 0.2680 | Atten Loss: 0.0000 | Soft Loss: 0.0366 | Time: 3.3192s
Epoch 00737 | Loss: 0.0638 | Swap Loss: 0.0000 | Grad Loss: 0.2700 | Atten Loss: 0.0000 | Soft Loss: 0.0368 | Time: 3.3778s
Epoch 00738 | Loss: 0.0672 | Swap Loss: 0.0000 | Grad Loss: 0.2785 | Atten Loss: 0.0000 | Soft Loss: 0.0394 | Time: 3.3163s
Epoch 00739 | Loss: 0.0620 | Swap Loss: 0.0000 | Grad Loss: 0.2641 | Atten Loss: 0.0000 | Soft Loss: 0.0356 | Time: 3.2920s
F1-Score on valset:       whole 0.9672, part1 0.9673, part2 0.9670
F1-Score on testset:       whole 0.9801, part1 0.9801, part2 0.9800
Epoch 00740 | Loss: 0.0648 | Swap Loss: 0.0000 | Grad Loss: 0.2746 | Atten Loss: 0.0000 | Soft Loss: 0.0373 | Time: 3.3161s
Epoch 00741 | Loss: 0.0645 | Swap Loss: 0.0000 | Grad Loss: 0.2719 | Atten Loss: 0.0000 | Soft Loss: 0.0373 | Time: 3.4413s
Epoch 00742 | Loss: 0.0641 | Swap Loss: 0.0000 | Grad Loss: 0.2736 | Atten Loss: 0.0000 | Soft Loss: 0.0367 | Time: 3.4335s
Epoch 00743 | Loss: 0.0628 | Swap Loss: 0.0000 | Grad Loss: 0.2667 | Atten Loss: 0.0000 | Soft Loss: 0.0361 | Time: 3.1698s
Epoch 00744 | Loss: 0.0644 | Swap Loss: 0.0000 | Grad Loss: 0.2736 | Atten Loss: 0.0000 | Soft Loss: 0.0370 | Time: 3.6255s
F1-Score on valset:       whole 0.9675, part1 0.9676, part2 0.9673
F1-Score on testset:       whole 0.9801, part1 0.9802, part2 0.9801
Epoch 00745 | Loss: 0.0630 | Swap Loss: 0.0000 | Grad Loss: 0.2692 | Atten Loss: 0.0000 | Soft Loss: 0.0361 | Time: 3.2648s
Epoch 00746 | Loss: 0.0631 | Swap Loss: 0.0000 | Grad Loss: 0.2689 | Atten Loss: 0.0000 | Soft Loss: 0.0362 | Time: 3.3862s
Epoch 00747 | Loss: 0.0632 | Swap Loss: 0.0000 | Grad Loss: 0.2700 | Atten Loss: 0.0000 | Soft Loss: 0.0362 | Time: 3.2957s
Epoch 00748 | Loss: 0.0618 | Swap Loss: 0.0000 | Grad Loss: 0.2643 | Atten Loss: 0.0000 | Soft Loss: 0.0354 | Time: 3.2180s
Epoch 00749 | Loss: 0.0622 | Swap Loss: 0.0000 | Grad Loss: 0.2658 | Atten Loss: 0.0000 | Soft Loss: 0.0357 | Time: 3.2210s
F1-Score on valset:       whole 0.9676, part1 0.9678, part2 0.9674
F1-Score on testset:       whole 0.9804, part1 0.9804, part2 0.9804
Epoch 00750 | Loss: 0.0623 | Swap Loss: 0.0000 | Grad Loss: 0.2660 | Atten Loss: 0.0000 | Soft Loss: 0.0357 | Time: 3.3012s
Epoch 00751 | Loss: 0.0649 | Swap Loss: 0.0000 | Grad Loss: 0.2739 | Atten Loss: 0.0000 | Soft Loss: 0.0375 | Time: 3.1580s
Epoch 00752 | Loss: 0.0631 | Swap Loss: 0.0000 | Grad Loss: 0.2693 | Atten Loss: 0.0000 | Soft Loss: 0.0361 | Time: 3.6035s
Epoch 00753 | Loss: 0.0636 | Swap Loss: 0.0000 | Grad Loss: 0.2707 | Atten Loss: 0.0000 | Soft Loss: 0.0365 | Time: 3.4067s
Epoch 00754 | Loss: 0.0638 | Swap Loss: 0.0000 | Grad Loss: 0.2724 | Atten Loss: 0.0000 | Soft Loss: 0.0366 | Time: 3.2651s
F1-Score on valset:       whole 0.9676, part1 0.9678, part2 0.9674
Epoch 00755 | Loss: 0.0629 | Swap Loss: 0.0000 | Grad Loss: 0.2724 | Atten Loss: 0.0000 | Soft Loss: 0.0356 | Time: 3.3161s
Epoch 00756 | Loss: 0.0611 | Swap Loss: 0.0000 | Grad Loss: 0.2656 | Atten Loss: 0.0000 | Soft Loss: 0.0345 | Time: 3.2830s
Epoch 00757 | Loss: 0.0621 | Swap Loss: 0.0000 | Grad Loss: 0.2667 | Atten Loss: 0.0000 | Soft Loss: 0.0354 | Time: 2.8830s
Epoch 00758 | Loss: 0.0650 | Swap Loss: 0.0000 | Grad Loss: 0.2771 | Atten Loss: 0.0000 | Soft Loss: 0.0373 | Time: 3.0816s
Epoch 00759 | Loss: 0.0620 | Swap Loss: 0.0000 | Grad Loss: 0.2690 | Atten Loss: 0.0000 | Soft Loss: 0.0351 | Time: 3.2630s
F1-Score on valset:       whole 0.9677, part1 0.9678, part2 0.9675
F1-Score on testset:       whole 0.9804, part1 0.9804, part2 0.9804
Epoch 00760 | Loss: 0.0642 | Swap Loss: 0.0000 | Grad Loss: 0.2757 | Atten Loss: 0.0000 | Soft Loss: 0.0366 | Time: 3.4581s
Epoch 00761 | Loss: 0.0645 | Swap Loss: 0.0000 | Grad Loss: 0.2770 | Atten Loss: 0.0000 | Soft Loss: 0.0368 | Time: 3.3639s
Epoch 00762 | Loss: 0.0616 | Swap Loss: 0.0000 | Grad Loss: 0.2696 | Atten Loss: 0.0000 | Soft Loss: 0.0346 | Time: 3.1774s
Epoch 00763 | Loss: 0.0617 | Swap Loss: 0.0000 | Grad Loss: 0.2685 | Atten Loss: 0.0000 | Soft Loss: 0.0348 | Time: 3.4409s
Epoch 00764 | Loss: 0.0616 | Swap Loss: 0.0000 | Grad Loss: 0.2687 | Atten Loss: 0.0000 | Soft Loss: 0.0348 | Time: 3.3184s
F1-Score on valset:       whole 0.9676, part1 0.9678, part2 0.9674
F1-Score on testset:       whole 0.9804, part1 0.9804, part2 0.9803
Epoch 00765 | Loss: 0.0602 | Swap Loss: 0.0000 | Grad Loss: 0.2650 | Atten Loss: 0.0000 | Soft Loss: 0.0337 | Time: 3.3550s
Epoch 00766 | Loss: 0.0610 | Swap Loss: 0.0000 | Grad Loss: 0.2671 | Atten Loss: 0.0000 | Soft Loss: 0.0343 | Time: 3.3267s
Epoch 00767 | Loss: 0.0608 | Swap Loss: 0.0000 | Grad Loss: 0.2665 | Atten Loss: 0.0000 | Soft Loss: 0.0342 | Time: 3.3754s
Epoch 00768 | Loss: 0.0608 | Swap Loss: 0.0000 | Grad Loss: 0.2670 | Atten Loss: 0.0000 | Soft Loss: 0.0341 | Time: 3.2024s
Epoch 00769 | Loss: 0.0596 | Swap Loss: 0.0000 | Grad Loss: 0.2625 | Atten Loss: 0.0000 | Soft Loss: 0.0334 | Time: 3.2919s
F1-Score on valset:       whole 0.9679, part1 0.9680, part2 0.9678
F1-Score on testset:       whole 0.9806, part1 0.9805, part2 0.9807
Epoch 00770 | Loss: 0.0597 | Swap Loss: 0.0000 | Grad Loss: 0.2636 | Atten Loss: 0.0000 | Soft Loss: 0.0333 | Time: 3.2892s
Epoch 00771 | Loss: 0.0604 | Swap Loss: 0.0000 | Grad Loss: 0.2647 | Atten Loss: 0.0000 | Soft Loss: 0.0339 | Time: 3.2282s
Epoch 00772 | Loss: 0.0621 | Swap Loss: 0.0000 | Grad Loss: 0.2728 | Atten Loss: 0.0000 | Soft Loss: 0.0348 | Time: 3.1510s
Epoch 00773 | Loss: 0.0594 | Swap Loss: 0.0000 | Grad Loss: 0.2632 | Atten Loss: 0.0000 | Soft Loss: 0.0331 | Time: 3.2001s
Epoch 00774 | Loss: 0.0606 | Swap Loss: 0.0000 | Grad Loss: 0.2657 | Atten Loss: 0.0000 | Soft Loss: 0.0340 | Time: 3.1556s
F1-Score on valset:       whole 0.9681, part1 0.9682, part2 0.9679
F1-Score on testset:       whole 0.9806, part1 0.9807, part2 0.9806
Epoch 00775 | Loss: 0.0586 | Swap Loss: 0.0000 | Grad Loss: 0.2614 | Atten Loss: 0.0000 | Soft Loss: 0.0325 | Time: 3.4821s
Epoch 00776 | Loss: 0.0588 | Swap Loss: 0.0000 | Grad Loss: 0.2592 | Atten Loss: 0.0000 | Soft Loss: 0.0329 | Time: 3.3119s
Epoch 00777 | Loss: 0.0621 | Swap Loss: 0.0000 | Grad Loss: 0.2712 | Atten Loss: 0.0000 | Soft Loss: 0.0350 | Time: 3.4210s
Epoch 00778 | Loss: 0.0586 | Swap Loss: 0.0000 | Grad Loss: 0.2613 | Atten Loss: 0.0000 | Soft Loss: 0.0324 | Time: 3.2629s
Epoch 00779 | Loss: 0.0596 | Swap Loss: 0.0000 | Grad Loss: 0.2639 | Atten Loss: 0.0000 | Soft Loss: 0.0332 | Time: 7.3063s
F1-Score on valset:       whole 0.9679, part1 0.9680, part2 0.9678
F1-Score on testset:       whole 0.9807, part1 0.9807, part2 0.9807
Epoch 00780 | Loss: 0.0606 | Swap Loss: 0.0000 | Grad Loss: 0.2700 | Atten Loss: 0.0000 | Soft Loss: 0.0336 | Time: 3.3834s
Epoch 00781 | Loss: 0.0615 | Swap Loss: 0.0000 | Grad Loss: 0.2741 | Atten Loss: 0.0000 | Soft Loss: 0.0341 | Time: 3.4558s
Epoch 00782 | Loss: 0.0590 | Swap Loss: 0.0000 | Grad Loss: 0.2639 | Atten Loss: 0.0000 | Soft Loss: 0.0326 | Time: 3.2159s
Epoch 00783 | Loss: 0.0595 | Swap Loss: 0.0000 | Grad Loss: 0.2650 | Atten Loss: 0.0000 | Soft Loss: 0.0330 | Time: 3.3375s
Epoch 00784 | Loss: 0.0585 | Swap Loss: 0.0000 | Grad Loss: 0.2632 | Atten Loss: 0.0000 | Soft Loss: 0.0321 | Time: 3.3283s
F1-Score on valset:       whole 0.9682, part1 0.9682, part2 0.9682
F1-Score on testset:       whole 0.9807, part1 0.9807, part2 0.9806
Epoch 00785 | Loss: 0.0574 | Swap Loss: 0.0000 | Grad Loss: 0.2586 | Atten Loss: 0.0000 | Soft Loss: 0.0315 | Time: 3.3168s
Epoch 00786 | Loss: 0.0576 | Swap Loss: 0.0000 | Grad Loss: 0.2597 | Atten Loss: 0.0000 | Soft Loss: 0.0316 | Time: 3.2696s
Epoch 00787 | Loss: 0.0588 | Swap Loss: 0.0000 | Grad Loss: 0.2626 | Atten Loss: 0.0000 | Soft Loss: 0.0325 | Time: 3.1335s
Epoch 00788 | Loss: 0.0570 | Swap Loss: 0.0000 | Grad Loss: 0.2582 | Atten Loss: 0.0000 | Soft Loss: 0.0312 | Time: 3.2650s
Epoch 00789 | Loss: 0.0576 | Swap Loss: 0.0000 | Grad Loss: 0.2611 | Atten Loss: 0.0000 | Soft Loss: 0.0315 | Time: 3.3657s
F1-Score on valset:       whole 0.9683, part1 0.9684, part2 0.9681
F1-Score on testset:       whole 0.9808, part1 0.9808, part2 0.9809
Epoch 00790 | Loss: 0.0575 | Swap Loss: 0.0000 | Grad Loss: 0.2585 | Atten Loss: 0.0000 | Soft Loss: 0.0317 | Time: 2.8189s
Epoch 00791 | Loss: 0.0587 | Swap Loss: 0.0000 | Grad Loss: 0.2625 | Atten Loss: 0.0000 | Soft Loss: 0.0324 | Time: 3.1117s
Epoch 00792 | Loss: 0.0583 | Swap Loss: 0.0000 | Grad Loss: 0.2632 | Atten Loss: 0.0000 | Soft Loss: 0.0320 | Time: 3.1114s
Epoch 00793 | Loss: 0.0585 | Swap Loss: 0.0000 | Grad Loss: 0.2632 | Atten Loss: 0.0000 | Soft Loss: 0.0322 | Time: 3.4259s
Epoch 00794 | Loss: 0.0583 | Swap Loss: 0.0000 | Grad Loss: 0.2643 | Atten Loss: 0.0000 | Soft Loss: 0.0319 | Time: 3.0239s
F1-Score on valset:       whole 0.9684, part1 0.9685, part2 0.9682
F1-Score on testset:       whole 0.9810, part1 0.9810, part2 0.9810
Epoch 00795 | Loss: 0.0565 | Swap Loss: 0.0000 | Grad Loss: 0.2566 | Atten Loss: 0.0000 | Soft Loss: 0.0308 | Time: 3.3249s
Epoch 00796 | Loss: 0.0576 | Swap Loss: 0.0000 | Grad Loss: 0.2599 | Atten Loss: 0.0000 | Soft Loss: 0.0316 | Time: 3.2477s
Epoch 00797 | Loss: 0.0567 | Swap Loss: 0.0000 | Grad Loss: 0.2576 | Atten Loss: 0.0000 | Soft Loss: 0.0310 | Time: 3.0772s
Epoch 00798 | Loss: 0.0566 | Swap Loss: 0.0000 | Grad Loss: 0.2578 | Atten Loss: 0.0000 | Soft Loss: 0.0308 | Time: 3.4662s
Epoch 00799 | Loss: 0.0588 | Swap Loss: 0.0000 | Grad Loss: 0.2661 | Atten Loss: 0.0000 | Soft Loss: 0.0322 | Time: 3.1465s
F1-Score on valset:       whole 0.9686, part1 0.9687, part2 0.9685
F1-Score on testset:       whole 0.9810, part1 0.9809, part2 0.9811
Epoch 00800 | Loss: 0.0571 | Swap Loss: 0.0000 | Grad Loss: 0.2614 | Atten Loss: 0.0000 | Soft Loss: 0.0310 | Time: 2.7332s
Epoch 00801 | Loss: 0.0571 | Swap Loss: 0.0000 | Grad Loss: 0.2615 | Atten Loss: 0.0000 | Soft Loss: 0.0309 | Time: 3.2584s
Epoch 00802 | Loss: 0.0587 | Swap Loss: 0.0000 | Grad Loss: 0.2676 | Atten Loss: 0.0000 | Soft Loss: 0.0320 | Time: 3.3630s
Epoch 00803 | Loss: 0.0571 | Swap Loss: 0.0000 | Grad Loss: 0.2615 | Atten Loss: 0.0000 | Soft Loss: 0.0309 | Time: 3.1583s
Epoch 00804 | Loss: 0.0581 | Swap Loss: 0.0000 | Grad Loss: 0.2646 | Atten Loss: 0.0000 | Soft Loss: 0.0316 | Time: 3.3438s
F1-Score on valset:       whole 0.9685, part1 0.9686, part2 0.9684
F1-Score on testset:       whole 0.9810, part1 0.9809, part2 0.9810
Epoch 00805 | Loss: 0.0556 | Swap Loss: 0.0000 | Grad Loss: 0.2552 | Atten Loss: 0.0000 | Soft Loss: 0.0301 | Time: 3.3600s
Epoch 00806 | Loss: 0.0578 | Swap Loss: 0.0000 | Grad Loss: 0.2634 | Atten Loss: 0.0000 | Soft Loss: 0.0314 | Time: 3.2747s
Epoch 00807 | Loss: 0.0574 | Swap Loss: 0.0000 | Grad Loss: 0.2620 | Atten Loss: 0.0000 | Soft Loss: 0.0312 | Time: 3.3201s
Epoch 00808 | Loss: 0.0561 | Swap Loss: 0.0000 | Grad Loss: 0.2585 | Atten Loss: 0.0000 | Soft Loss: 0.0303 | Time: 3.1079s
Epoch 00809 | Loss: 0.0556 | Swap Loss: 0.0000 | Grad Loss: 0.2574 | Atten Loss: 0.0000 | Soft Loss: 0.0298 | Time: 3.0383s
F1-Score on valset:       whole 0.9686, part1 0.9688, part2 0.9684
F1-Score on testset:       whole 0.9811, part1 0.9810, part2 0.9811
Epoch 00810 | Loss: 0.0568 | Swap Loss: 0.0000 | Grad Loss: 0.2613 | Atten Loss: 0.0000 | Soft Loss: 0.0306 | Time: 3.3545s
Epoch 00811 | Loss: 0.0553 | Swap Loss: 0.0000 | Grad Loss: 0.2558 | Atten Loss: 0.0000 | Soft Loss: 0.0297 | Time: 3.2630s
Epoch 00812 | Loss: 0.0543 | Swap Loss: 0.0000 | Grad Loss: 0.2531 | Atten Loss: 0.0000 | Soft Loss: 0.0290 | Time: 3.2339s
Epoch 00813 | Loss: 0.0570 | Swap Loss: 0.0000 | Grad Loss: 0.2619 | Atten Loss: 0.0000 | Soft Loss: 0.0309 | Time: 3.3564s
Epoch 00814 | Loss: 0.0564 | Swap Loss: 0.0000 | Grad Loss: 0.2597 | Atten Loss: 0.0000 | Soft Loss: 0.0304 | Time: 3.3405s
F1-Score on valset:       whole 0.9687, part1 0.9688, part2 0.9686
F1-Score on testset:       whole 0.9811, part1 0.9811, part2 0.9812
Epoch 00815 | Loss: 0.0569 | Swap Loss: 0.0000 | Grad Loss: 0.2625 | Atten Loss: 0.0000 | Soft Loss: 0.0307 | Time: 3.3321s
Epoch 00816 | Loss: 0.0561 | Swap Loss: 0.0000 | Grad Loss: 0.2602 | Atten Loss: 0.0000 | Soft Loss: 0.0301 | Time: 3.2570s
Epoch 00817 | Loss: 0.0576 | Swap Loss: 0.0000 | Grad Loss: 0.2666 | Atten Loss: 0.0000 | Soft Loss: 0.0309 | Time: 3.3713s
Epoch 00818 | Loss: 0.0555 | Swap Loss: 0.0000 | Grad Loss: 0.2576 | Atten Loss: 0.0000 | Soft Loss: 0.0297 | Time: 3.4731s
Epoch 00819 | Loss: 0.0556 | Swap Loss: 0.0000 | Grad Loss: 0.2577 | Atten Loss: 0.0000 | Soft Loss: 0.0298 | Time: 3.5397s
F1-Score on valset:       whole 0.9689, part1 0.9691, part2 0.9688
F1-Score on testset:       whole 0.9814, part1 0.9813, part2 0.9814
Epoch 00820 | Loss: 0.0565 | Swap Loss: 0.0000 | Grad Loss: 0.2616 | Atten Loss: 0.0000 | Soft Loss: 0.0303 | Time: 3.4392s
Epoch 00821 | Loss: 0.0558 | Swap Loss: 0.0000 | Grad Loss: 0.2602 | Atten Loss: 0.0000 | Soft Loss: 0.0298 | Time: 3.2786s
Epoch 00822 | Loss: 0.0547 | Swap Loss: 0.0000 | Grad Loss: 0.2570 | Atten Loss: 0.0000 | Soft Loss: 0.0290 | Time: 3.3611s
Epoch 00823 | Loss: 0.0533 | Swap Loss: 0.0000 | Grad Loss: 0.2506 | Atten Loss: 0.0000 | Soft Loss: 0.0282 | Time: 3.2262s
Epoch 00824 | Loss: 0.0560 | Swap Loss: 0.0000 | Grad Loss: 0.2605 | Atten Loss: 0.0000 | Soft Loss: 0.0300 | Time: 3.4516s
F1-Score on valset:       whole 0.9690, part1 0.9691, part2 0.9689
F1-Score on testset:       whole 0.9814, part1 0.9814, part2 0.9814
Epoch 00825 | Loss: 0.0535 | Swap Loss: 0.0000 | Grad Loss: 0.2518 | Atten Loss: 0.0000 | Soft Loss: 0.0283 | Time: 3.3475s
Epoch 00826 | Loss: 0.0560 | Swap Loss: 0.0000 | Grad Loss: 0.2604 | Atten Loss: 0.0000 | Soft Loss: 0.0299 | Time: 3.3878s
Epoch 00827 | Loss: 0.0573 | Swap Loss: 0.0000 | Grad Loss: 0.2653 | Atten Loss: 0.0000 | Soft Loss: 0.0308 | Time: 3.2754s
Epoch 00828 | Loss: 0.0554 | Swap Loss: 0.0000 | Grad Loss: 0.2587 | Atten Loss: 0.0000 | Soft Loss: 0.0296 | Time: 3.1174s
Epoch 00829 | Loss: 0.0557 | Swap Loss: 0.0000 | Grad Loss: 0.2606 | Atten Loss: 0.0000 | Soft Loss: 0.0297 | Time: 2.8569s
F1-Score on valset:       whole 0.9689, part1 0.9691, part2 0.9688
F1-Score on testset:       whole 0.9814, part1 0.9814, part2 0.9814
Epoch 00830 | Loss: 0.0536 | Swap Loss: 0.0000 | Grad Loss: 0.2540 | Atten Loss: 0.0000 | Soft Loss: 0.0282 | Time: 3.0529s
Epoch 00831 | Loss: 0.0548 | Swap Loss: 0.0000 | Grad Loss: 0.2606 | Atten Loss: 0.0000 | Soft Loss: 0.0288 | Time: 3.3726s
Epoch 00832 | Loss: 0.0556 | Swap Loss: 0.0000 | Grad Loss: 0.2622 | Atten Loss: 0.0000 | Soft Loss: 0.0294 | Time: 3.1762s
Epoch 00833 | Loss: 0.0568 | Swap Loss: 0.0000 | Grad Loss: 0.2658 | Atten Loss: 0.0000 | Soft Loss: 0.0302 | Time: 3.0708s
Epoch 00834 | Loss: 0.0543 | Swap Loss: 0.0000 | Grad Loss: 0.2572 | Atten Loss: 0.0000 | Soft Loss: 0.0286 | Time: 3.0402s
F1-Score on valset:       whole 0.9689, part1 0.9690, part2 0.9689
F1-Score on testset:       whole 0.9814, part1 0.9814, part2 0.9814
Epoch 00835 | Loss: 0.0551 | Swap Loss: 0.0000 | Grad Loss: 0.2582 | Atten Loss: 0.0000 | Soft Loss: 0.0293 | Time: 3.2893s
Epoch 00836 | Loss: 0.0551 | Swap Loss: 0.0000 | Grad Loss: 0.2600 | Atten Loss: 0.0000 | Soft Loss: 0.0291 | Time: 3.3790s
Epoch 00837 | Loss: 0.0541 | Swap Loss: 0.0000 | Grad Loss: 0.2576 | Atten Loss: 0.0000 | Soft Loss: 0.0284 | Time: 3.4255s
Epoch 00838 | Loss: 0.0537 | Swap Loss: 0.0000 | Grad Loss: 0.2550 | Atten Loss: 0.0000 | Soft Loss: 0.0282 | Time: 3.4990s
Epoch 00839 | Loss: 0.0527 | Swap Loss: 0.0000 | Grad Loss: 0.2502 | Atten Loss: 0.0000 | Soft Loss: 0.0277 | Time: 3.2583s
F1-Score on valset:       whole 0.9691, part1 0.9693, part2 0.9690
F1-Score on testset:       whole 0.9815, part1 0.9814, part2 0.9815
Epoch 00840 | Loss: 0.0535 | Swap Loss: 0.0000 | Grad Loss: 0.2537 | Atten Loss: 0.0000 | Soft Loss: 0.0282 | Time: 3.3120s
Epoch 00841 | Loss: 0.0556 | Swap Loss: 0.0000 | Grad Loss: 0.2630 | Atten Loss: 0.0000 | Soft Loss: 0.0293 | Time: 3.2461s
Epoch 00842 | Loss: 0.0530 | Swap Loss: 0.0000 | Grad Loss: 0.2539 | Atten Loss: 0.0000 | Soft Loss: 0.0276 | Time: 3.5538s
Epoch 00843 | Loss: 0.0533 | Swap Loss: 0.0000 | Grad Loss: 0.2551 | Atten Loss: 0.0000 | Soft Loss: 0.0278 | Time: 3.4650s
Epoch 00844 | Loss: 0.0535 | Swap Loss: 0.0000 | Grad Loss: 0.2569 | Atten Loss: 0.0000 | Soft Loss: 0.0278 | Time: 3.2225s
F1-Score on valset:       whole 0.9693, part1 0.9694, part2 0.9691
F1-Score on testset:       whole 0.9815, part1 0.9814, part2 0.9816
Epoch 00845 | Loss: 0.0520 | Swap Loss: 0.0000 | Grad Loss: 0.2512 | Atten Loss: 0.0000 | Soft Loss: 0.0269 | Time: 3.1380s
Epoch 00846 | Loss: 0.0535 | Swap Loss: 0.0000 | Grad Loss: 0.2551 | Atten Loss: 0.0000 | Soft Loss: 0.0280 | Time: 3.3180s
Epoch 00847 | Loss: 0.0521 | Swap Loss: 0.0000 | Grad Loss: 0.2508 | Atten Loss: 0.0000 | Soft Loss: 0.0271 | Time: 3.3800s
Epoch 00848 | Loss: 0.0531 | Swap Loss: 0.0000 | Grad Loss: 0.2540 | Atten Loss: 0.0000 | Soft Loss: 0.0276 | Time: 3.1338s
Epoch 00849 | Loss: 0.0518 | Swap Loss: 0.0000 | Grad Loss: 0.2501 | Atten Loss: 0.0000 | Soft Loss: 0.0268 | Time: 3.4838s
F1-Score on valset:       whole 0.9692, part1 0.9692, part2 0.9691
F1-Score on testset:       whole 0.9815, part1 0.9815, part2 0.9816
Epoch 00850 | Loss: 0.0511 | Swap Loss: 0.0000 | Grad Loss: 0.2479 | Atten Loss: 0.0000 | Soft Loss: 0.0263 | Time: 3.2528s
Epoch 00851 | Loss: 0.0516 | Swap Loss: 0.0000 | Grad Loss: 0.2491 | Atten Loss: 0.0000 | Soft Loss: 0.0267 | Time: 3.4397s
Epoch 00852 | Loss: 0.0543 | Swap Loss: 0.0000 | Grad Loss: 0.2618 | Atten Loss: 0.0000 | Soft Loss: 0.0281 | Time: 3.4197s
Epoch 00853 | Loss: 0.0519 | Swap Loss: 0.0000 | Grad Loss: 0.2520 | Atten Loss: 0.0000 | Soft Loss: 0.0267 | Time: 3.3078s
Epoch 00854 | Loss: 0.0548 | Swap Loss: 0.0000 | Grad Loss: 0.2612 | Atten Loss: 0.0000 | Soft Loss: 0.0286 | Time: 3.4256s
F1-Score on valset:       whole 0.9694, part1 0.9696, part2 0.9692
F1-Score on testset:       whole 0.9816, part1 0.9815, part2 0.9816
Epoch 00855 | Loss: 0.0536 | Swap Loss: 0.0000 | Grad Loss: 0.2584 | Atten Loss: 0.0000 | Soft Loss: 0.0278 | Time: 3.3509s
Epoch 00856 | Loss: 0.0525 | Swap Loss: 0.0000 | Grad Loss: 0.2535 | Atten Loss: 0.0000 | Soft Loss: 0.0271 | Time: 3.3106s
Epoch 00857 | Loss: 0.0529 | Swap Loss: 0.0000 | Grad Loss: 0.2562 | Atten Loss: 0.0000 | Soft Loss: 0.0273 | Time: 3.2473s
Epoch 00858 | Loss: 0.0534 | Swap Loss: 0.0000 | Grad Loss: 0.2569 | Atten Loss: 0.0000 | Soft Loss: 0.0277 | Time: 3.4045s
Epoch 00859 | Loss: 0.0499 | Swap Loss: 0.0000 | Grad Loss: 0.2443 | Atten Loss: 0.0000 | Soft Loss: 0.0255 | Time: 3.2579s
F1-Score on valset:       whole 0.9694, part1 0.9695, part2 0.9693
F1-Score on testset:       whole 0.9816, part1 0.9816, part2 0.9816
Epoch 00860 | Loss: 0.0523 | Swap Loss: 0.0000 | Grad Loss: 0.2536 | Atten Loss: 0.0000 | Soft Loss: 0.0270 | Time: 3.2653s
Epoch 00861 | Loss: 0.0504 | Swap Loss: 0.0000 | Grad Loss: 0.2466 | Atten Loss: 0.0000 | Soft Loss: 0.0257 | Time: 3.0402s
Epoch 00862 | Loss: 0.0523 | Swap Loss: 0.0000 | Grad Loss: 0.2543 | Atten Loss: 0.0000 | Soft Loss: 0.0268 | Time: 3.3487s
Epoch 00863 | Loss: 0.0525 | Swap Loss: 0.0000 | Grad Loss: 0.2537 | Atten Loss: 0.0000 | Soft Loss: 0.0271 | Time: 3.4703s
Epoch 00864 | Loss: 0.0527 | Swap Loss: 0.0000 | Grad Loss: 0.2569 | Atten Loss: 0.0000 | Soft Loss: 0.0270 | Time: 3.3337s
F1-Score on valset:       whole 0.9697, part1 0.9699, part2 0.9695
F1-Score on testset:       whole 0.9818, part1 0.9817, part2 0.9818
Epoch 00865 | Loss: 0.0517 | Swap Loss: 0.0000 | Grad Loss: 0.2537 | Atten Loss: 0.0000 | Soft Loss: 0.0263 | Time: 2.9212s
Epoch 00866 | Loss: 0.0511 | Swap Loss: 0.0000 | Grad Loss: 0.2518 | Atten Loss: 0.0000 | Soft Loss: 0.0259 | Time: 2.8863s
Epoch 00867 | Loss: 0.0513 | Swap Loss: 0.0000 | Grad Loss: 0.2519 | Atten Loss: 0.0000 | Soft Loss: 0.0262 | Time: 3.1643s
Epoch 00868 | Loss: 0.0502 | Swap Loss: 0.0000 | Grad Loss: 0.2475 | Atten Loss: 0.0000 | Soft Loss: 0.0254 | Time: 2.8967s
Epoch 00869 | Loss: 0.0520 | Swap Loss: 0.0000 | Grad Loss: 0.2521 | Atten Loss: 0.0000 | Soft Loss: 0.0268 | Time: 3.2838s
F1-Score on valset:       whole 0.9696, part1 0.9697, part2 0.9694
F1-Score on testset:       whole 0.9817, part1 0.9817, part2 0.9818
Epoch 00870 | Loss: 0.0518 | Swap Loss: 0.0000 | Grad Loss: 0.2546 | Atten Loss: 0.0000 | Soft Loss: 0.0264 | Time: 3.5333s
Epoch 00871 | Loss: 0.0498 | Swap Loss: 0.0000 | Grad Loss: 0.2453 | Atten Loss: 0.0000 | Soft Loss: 0.0253 | Time: 3.2413s
Epoch 00872 | Loss: 0.0510 | Swap Loss: 0.0000 | Grad Loss: 0.2491 | Atten Loss: 0.0000 | Soft Loss: 0.0260 | Time: 3.4580s
Epoch 00873 | Loss: 0.0512 | Swap Loss: 0.0000 | Grad Loss: 0.2517 | Atten Loss: 0.0000 | Soft Loss: 0.0260 | Time: 3.5254s
Epoch 00874 | Loss: 0.0510 | Swap Loss: 0.0000 | Grad Loss: 0.2510 | Atten Loss: 0.0000 | Soft Loss: 0.0259 | Time: 3.1879s
F1-Score on valset:       whole 0.9696, part1 0.9696, part2 0.9696
F1-Score on testset:       whole 0.9819, part1 0.9818, part2 0.9819
Epoch 00875 | Loss: 0.0517 | Swap Loss: 0.0000 | Grad Loss: 0.2546 | Atten Loss: 0.0000 | Soft Loss: 0.0262 | Time: 3.4826s
Epoch 00876 | Loss: 0.0506 | Swap Loss: 0.0000 | Grad Loss: 0.2519 | Atten Loss: 0.0000 | Soft Loss: 0.0254 | Time: 3.3966s
Epoch 00877 | Loss: 0.0492 | Swap Loss: 0.0000 | Grad Loss: 0.2452 | Atten Loss: 0.0000 | Soft Loss: 0.0247 | Time: 3.4895s
Epoch 00878 | Loss: 0.0528 | Swap Loss: 0.0000 | Grad Loss: 0.2570 | Atten Loss: 0.0000 | Soft Loss: 0.0271 | Time: 3.4370s
Epoch 00879 | Loss: 0.0499 | Swap Loss: 0.0000 | Grad Loss: 0.2476 | Atten Loss: 0.0000 | Soft Loss: 0.0251 | Time: 3.4174s
F1-Score on valset:       whole 0.9695, part1 0.9695, part2 0.9695
F1-Score on testset:       whole 0.9818, part1 0.9817, part2 0.9819
Epoch 00880 | Loss: 0.0501 | Swap Loss: 0.0000 | Grad Loss: 0.2485 | Atten Loss: 0.0000 | Soft Loss: 0.0253 | Time: 3.1948s
Epoch 00881 | Loss: 0.0512 | Swap Loss: 0.0000 | Grad Loss: 0.2519 | Atten Loss: 0.0000 | Soft Loss: 0.0260 | Time: 3.4669s
Epoch 00882 | Loss: 0.0516 | Swap Loss: 0.0000 | Grad Loss: 0.2538 | Atten Loss: 0.0000 | Soft Loss: 0.0262 | Time: 3.3472s
Epoch 00883 | Loss: 0.0498 | Swap Loss: 0.0000 | Grad Loss: 0.2475 | Atten Loss: 0.0000 | Soft Loss: 0.0250 | Time: 3.2270s
Epoch 00884 | Loss: 0.0522 | Swap Loss: 0.0000 | Grad Loss: 0.2564 | Atten Loss: 0.0000 | Soft Loss: 0.0266 | Time: 3.2536s
F1-Score on valset:       whole 0.9698, part1 0.9700, part2 0.9696
F1-Score on testset:       whole 0.9819, part1 0.9818, part2 0.9820
Epoch 00885 | Loss: 0.0496 | Swap Loss: 0.0000 | Grad Loss: 0.2490 | Atten Loss: 0.0000 | Soft Loss: 0.0247 | Time: 3.1573s
Epoch 00886 | Loss: 0.0494 | Swap Loss: 0.0000 | Grad Loss: 0.2463 | Atten Loss: 0.0000 | Soft Loss: 0.0247 | Time: 3.2220s
Epoch 00887 | Loss: 0.0486 | Swap Loss: 0.0000 | Grad Loss: 0.2441 | Atten Loss: 0.0000 | Soft Loss: 0.0242 | Time: 3.2151s
Epoch 00888 | Loss: 0.0490 | Swap Loss: 0.0000 | Grad Loss: 0.2456 | Atten Loss: 0.0000 | Soft Loss: 0.0244 | Time: 3.2816s
Epoch 00889 | Loss: 0.0496 | Swap Loss: 0.0000 | Grad Loss: 0.2475 | Atten Loss: 0.0000 | Soft Loss: 0.0248 | Time: 3.3123s
F1-Score on valset:       whole 0.9698, part1 0.9699, part2 0.9697
F1-Score on testset:       whole 0.9819, part1 0.9818, part2 0.9820
Epoch 00890 | Loss: 0.0487 | Swap Loss: 0.0000 | Grad Loss: 0.2449 | Atten Loss: 0.0000 | Soft Loss: 0.0242 | Time: 3.2007s
Epoch 00891 | Loss: 0.0496 | Swap Loss: 0.0000 | Grad Loss: 0.2481 | Atten Loss: 0.0000 | Soft Loss: 0.0248 | Time: 7.1543s
Epoch 00892 | Loss: 0.0473 | Swap Loss: 0.0000 | Grad Loss: 0.2391 | Atten Loss: 0.0000 | Soft Loss: 0.0234 | Time: 3.2683s
Epoch 00893 | Loss: 0.0492 | Swap Loss: 0.0000 | Grad Loss: 0.2453 | Atten Loss: 0.0000 | Soft Loss: 0.0247 | Time: 3.5765s
Epoch 00894 | Loss: 0.0504 | Swap Loss: 0.0000 | Grad Loss: 0.2509 | Atten Loss: 0.0000 | Soft Loss: 0.0253 | Time: 3.2846s
F1-Score on valset:       whole 0.9699, part1 0.9700, part2 0.9698
F1-Score on testset:       whole 0.9821, part1 0.9821, part2 0.9820
Epoch 00895 | Loss: 0.0488 | Swap Loss: 0.0000 | Grad Loss: 0.2467 | Atten Loss: 0.0000 | Soft Loss: 0.0242 | Time: 3.4747s
Epoch 00896 | Loss: 0.0491 | Swap Loss: 0.0000 | Grad Loss: 0.2462 | Atten Loss: 0.0000 | Soft Loss: 0.0245 | Time: 3.4635s
Epoch 00897 | Loss: 0.0489 | Swap Loss: 0.0000 | Grad Loss: 0.2466 | Atten Loss: 0.0000 | Soft Loss: 0.0243 | Time: 3.4832s
Epoch 00898 | Loss: 0.0489 | Swap Loss: 0.0000 | Grad Loss: 0.2470 | Atten Loss: 0.0000 | Soft Loss: 0.0242 | Time: 3.6237s
Epoch 00899 | Loss: 0.0483 | Swap Loss: 0.0000 | Grad Loss: 0.2432 | Atten Loss: 0.0000 | Soft Loss: 0.0240 | Time: 3.4907s
F1-Score on valset:       whole 0.9700, part1 0.9702, part2 0.9699
F1-Score on testset:       whole 0.9821, part1 0.9820, part2 0.9821
Epoch 00900 | Loss: 0.0488 | Swap Loss: 0.0000 | Grad Loss: 0.2464 | Atten Loss: 0.0000 | Soft Loss: 0.0242 | Time: 3.4594s
Epoch 00901 | Loss: 0.0487 | Swap Loss: 0.0000 | Grad Loss: 0.2462 | Atten Loss: 0.0000 | Soft Loss: 0.0241 | Time: 3.2635s
Epoch 00902 | Loss: 0.0500 | Swap Loss: 0.0000 | Grad Loss: 0.2561 | Atten Loss: 0.0000 | Soft Loss: 0.0244 | Time: 3.1852s
Epoch 00903 | Loss: 0.0488 | Swap Loss: 0.0000 | Grad Loss: 0.2506 | Atten Loss: 0.0000 | Soft Loss: 0.0238 | Time: 3.0522s
Epoch 00904 | Loss: 0.0481 | Swap Loss: 0.0000 | Grad Loss: 0.2468 | Atten Loss: 0.0000 | Soft Loss: 0.0235 | Time: 3.3629s
F1-Score on valset:       whole 0.9701, part1 0.9703, part2 0.9698
F1-Score on testset:       whole 0.9820, part1 0.9819, part2 0.9822
Epoch 00905 | Loss: 0.0489 | Swap Loss: 0.0000 | Grad Loss: 0.2477 | Atten Loss: 0.0000 | Soft Loss: 0.0241 | Time: 3.2984s
Epoch 00906 | Loss: 0.0480 | Swap Loss: 0.0000 | Grad Loss: 0.2432 | Atten Loss: 0.0000 | Soft Loss: 0.0237 | Time: 3.2965s
Epoch 00907 | Loss: 0.0496 | Swap Loss: 0.0000 | Grad Loss: 0.2502 | Atten Loss: 0.0000 | Soft Loss: 0.0245 | Time: 3.4770s
Epoch 00908 | Loss: 0.0511 | Swap Loss: 0.0000 | Grad Loss: 0.2560 | Atten Loss: 0.0000 | Soft Loss: 0.0255 | Time: 3.3293s
Epoch 00909 | Loss: 0.0487 | Swap Loss: 0.0000 | Grad Loss: 0.2466 | Atten Loss: 0.0000 | Soft Loss: 0.0241 | Time: 3.4238s
F1-Score on valset:       whole 0.9701, part1 0.9703, part2 0.9700
F1-Score on testset:       whole 0.9821, part1 0.9820, part2 0.9821
Epoch 00910 | Loss: 0.0485 | Swap Loss: 0.0000 | Grad Loss: 0.2460 | Atten Loss: 0.0000 | Soft Loss: 0.0239 | Time: 3.4938s
Epoch 00911 | Loss: 0.0495 | Swap Loss: 0.0000 | Grad Loss: 0.2501 | Atten Loss: 0.0000 | Soft Loss: 0.0245 | Time: 3.3950s
Epoch 00912 | Loss: 0.0481 | Swap Loss: 0.0000 | Grad Loss: 0.2465 | Atten Loss: 0.0000 | Soft Loss: 0.0235 | Time: 3.2815s
Epoch 00913 | Loss: 0.0483 | Swap Loss: 0.0000 | Grad Loss: 0.2475 | Atten Loss: 0.0000 | Soft Loss: 0.0236 | Time: 3.6382s
Epoch 00914 | Loss: 0.0496 | Swap Loss: 0.0000 | Grad Loss: 0.2516 | Atten Loss: 0.0000 | Soft Loss: 0.0244 | Time: 3.4404s
F1-Score on valset:       whole 0.9700, part1 0.9703, part2 0.9698
Epoch 00915 | Loss: 0.0497 | Swap Loss: 0.0000 | Grad Loss: 0.2511 | Atten Loss: 0.0000 | Soft Loss: 0.0246 | Time: 3.1529s
Epoch 00916 | Loss: 0.0469 | Swap Loss: 0.0000 | Grad Loss: 0.2408 | Atten Loss: 0.0000 | Soft Loss: 0.0229 | Time: 3.3791s
Epoch 00917 | Loss: 0.0474 | Swap Loss: 0.0000 | Grad Loss: 0.2432 | Atten Loss: 0.0000 | Soft Loss: 0.0231 | Time: 3.3992s
Epoch 00918 | Loss: 0.0471 | Swap Loss: 0.0000 | Grad Loss: 0.2426 | Atten Loss: 0.0000 | Soft Loss: 0.0229 | Time: 3.1129s
Epoch 00919 | Loss: 0.0485 | Swap Loss: 0.0000 | Grad Loss: 0.2493 | Atten Loss: 0.0000 | Soft Loss: 0.0236 | Time: 3.3278s
F1-Score on valset:       whole 0.9702, part1 0.9703, part2 0.9700
F1-Score on testset:       whole 0.9822, part1 0.9822, part2 0.9822
Epoch 00920 | Loss: 0.0495 | Swap Loss: 0.0000 | Grad Loss: 0.2526 | Atten Loss: 0.0000 | Soft Loss: 0.0243 | Time: 3.2520s
Epoch 00921 | Loss: 0.0481 | Swap Loss: 0.0000 | Grad Loss: 0.2482 | Atten Loss: 0.0000 | Soft Loss: 0.0233 | Time: 3.1848s
Epoch 00922 | Loss: 0.0488 | Swap Loss: 0.0000 | Grad Loss: 0.2500 | Atten Loss: 0.0000 | Soft Loss: 0.0238 | Time: 3.2437s
Epoch 00923 | Loss: 0.0474 | Swap Loss: 0.0000 | Grad Loss: 0.2448 | Atten Loss: 0.0000 | Soft Loss: 0.0229 | Time: 3.4116s
Epoch 00924 | Loss: 0.0492 | Swap Loss: 0.0000 | Grad Loss: 0.2518 | Atten Loss: 0.0000 | Soft Loss: 0.0240 | Time: 3.4152s
F1-Score on valset:       whole 0.9701, part1 0.9703, part2 0.9699
Epoch 00925 | Loss: 0.0480 | Swap Loss: 0.0000 | Grad Loss: 0.2473 | Atten Loss: 0.0000 | Soft Loss: 0.0233 | Time: 3.4306s
Epoch 00926 | Loss: 0.0476 | Swap Loss: 0.0000 | Grad Loss: 0.2457 | Atten Loss: 0.0000 | Soft Loss: 0.0230 | Time: 3.3054s
Epoch 00927 | Loss: 0.0471 | Swap Loss: 0.0000 | Grad Loss: 0.2440 | Atten Loss: 0.0000 | Soft Loss: 0.0227 | Time: 3.2228s
Epoch 00928 | Loss: 0.0485 | Swap Loss: 0.0000 | Grad Loss: 0.2475 | Atten Loss: 0.0000 | Soft Loss: 0.0238 | Time: 3.4540s
Epoch 00929 | Loss: 0.0468 | Swap Loss: 0.0000 | Grad Loss: 0.2426 | Atten Loss: 0.0000 | Soft Loss: 0.0226 | Time: 3.5119s
F1-Score on valset:       whole 0.9704, part1 0.9705, part2 0.9702
F1-Score on testset:       whole 0.9823, part1 0.9823, part2 0.9823
Epoch 00930 | Loss: 0.0491 | Swap Loss: 0.0000 | Grad Loss: 0.2504 | Atten Loss: 0.0000 | Soft Loss: 0.0241 | Time: 3.2237s
Epoch 00931 | Loss: 0.0468 | Swap Loss: 0.0000 | Grad Loss: 0.2421 | Atten Loss: 0.0000 | Soft Loss: 0.0226 | Time: 3.3858s
Epoch 00932 | Loss: 0.0473 | Swap Loss: 0.0000 | Grad Loss: 0.2439 | Atten Loss: 0.0000 | Soft Loss: 0.0229 | Time: 3.5131s
Epoch 00933 | Loss: 0.0471 | Swap Loss: 0.0000 | Grad Loss: 0.2441 | Atten Loss: 0.0000 | Soft Loss: 0.0227 | Time: 3.5843s
Epoch 00934 | Loss: 0.0467 | Swap Loss: 0.0000 | Grad Loss: 0.2432 | Atten Loss: 0.0000 | Soft Loss: 0.0223 | Time: 3.4092s
F1-Score on valset:       whole 0.9704, part1 0.9705, part2 0.9703
F1-Score on testset:       whole 0.9824, part1 0.9824, part2 0.9823
Epoch 00935 | Loss: 0.0478 | Swap Loss: 0.0000 | Grad Loss: 0.2470 | Atten Loss: 0.0000 | Soft Loss: 0.0231 | Time: 3.2679s
Epoch 00936 | Loss: 0.0458 | Swap Loss: 0.0000 | Grad Loss: 0.2394 | Atten Loss: 0.0000 | Soft Loss: 0.0219 | Time: 3.1554s
Epoch 00937 | Loss: 0.0482 | Swap Loss: 0.0000 | Grad Loss: 0.2490 | Atten Loss: 0.0000 | Soft Loss: 0.0233 | Time: 3.4515s
Epoch 00938 | Loss: 0.0483 | Swap Loss: 0.0000 | Grad Loss: 0.2518 | Atten Loss: 0.0000 | Soft Loss: 0.0231 | Time: 3.2113s
Epoch 00939 | Loss: 0.0456 | Swap Loss: 0.0000 | Grad Loss: 0.2406 | Atten Loss: 0.0000 | Soft Loss: 0.0216 | Time: 3.3399s
F1-Score on valset:       whole 0.9703, part1 0.9704, part2 0.9701
F1-Score on testset:       whole 0.9823, part1 0.9823, part2 0.9823
Epoch 00940 | Loss: 0.0485 | Swap Loss: 0.0000 | Grad Loss: 0.2510 | Atten Loss: 0.0000 | Soft Loss: 0.0234 | Time: 3.4062s
Epoch 00941 | Loss: 0.0454 | Swap Loss: 0.0000 | Grad Loss: 0.2387 | Atten Loss: 0.0000 | Soft Loss: 0.0215 | Time: 3.2191s
Epoch 00942 | Loss: 0.0470 | Swap Loss: 0.0000 | Grad Loss: 0.2445 | Atten Loss: 0.0000 | Soft Loss: 0.0225 | Time: 3.1538s
Epoch 00943 | Loss: 0.0450 | Swap Loss: 0.0000 | Grad Loss: 0.2364 | Atten Loss: 0.0000 | Soft Loss: 0.0214 | Time: 3.2150s
Epoch 00944 | Loss: 0.0472 | Swap Loss: 0.0000 | Grad Loss: 0.2447 | Atten Loss: 0.0000 | Soft Loss: 0.0227 | Time: 3.0289s
F1-Score on valset:       whole 0.9704, part1 0.9705, part2 0.9703
F1-Score on testset:       whole 0.9824, part1 0.9823, part2 0.9824
Epoch 00945 | Loss: 0.0451 | Swap Loss: 0.0000 | Grad Loss: 0.2375 | Atten Loss: 0.0000 | Soft Loss: 0.0214 | Time: 3.3837s
Epoch 00946 | Loss: 0.0465 | Swap Loss: 0.0000 | Grad Loss: 0.2427 | Atten Loss: 0.0000 | Soft Loss: 0.0223 | Time: 3.3330s
Epoch 00947 | Loss: 0.0457 | Swap Loss: 0.0000 | Grad Loss: 0.2401 | Atten Loss: 0.0000 | Soft Loss: 0.0217 | Time: 2.9427s
Epoch 00948 | Loss: 0.0472 | Swap Loss: 0.0000 | Grad Loss: 0.2463 | Atten Loss: 0.0000 | Soft Loss: 0.0226 | Time: 3.4077s
Epoch 00949 | Loss: 0.0456 | Swap Loss: 0.0000 | Grad Loss: 0.2398 | Atten Loss: 0.0000 | Soft Loss: 0.0216 | Time: 3.3418s
F1-Score on valset:       whole 0.9705, part1 0.9706, part2 0.9703
F1-Score on testset:       whole 0.9825, part1 0.9825, part2 0.9825
Epoch 00950 | Loss: 0.0456 | Swap Loss: 0.0000 | Grad Loss: 0.2410 | Atten Loss: 0.0000 | Soft Loss: 0.0215 | Time: 3.6533s
Epoch 00951 | Loss: 0.0459 | Swap Loss: 0.0000 | Grad Loss: 0.2454 | Atten Loss: 0.0000 | Soft Loss: 0.0214 | Time: 3.5251s
Epoch 00952 | Loss: 0.0467 | Swap Loss: 0.0000 | Grad Loss: 0.2453 | Atten Loss: 0.0000 | Soft Loss: 0.0222 | Time: 3.1133s
Epoch 00953 | Loss: 0.0465 | Swap Loss: 0.0000 | Grad Loss: 0.2453 | Atten Loss: 0.0000 | Soft Loss: 0.0220 | Time: 3.2809s
Epoch 00954 | Loss: 0.0448 | Swap Loss: 0.0000 | Grad Loss: 0.2374 | Atten Loss: 0.0000 | Soft Loss: 0.0210 | Time: 3.3174s
F1-Score on valset:       whole 0.9706, part1 0.9707, part2 0.9705
F1-Score on testset:       whole 0.9825, part1 0.9825, part2 0.9825
Epoch 00955 | Loss: 0.0449 | Swap Loss: 0.0000 | Grad Loss: 0.2369 | Atten Loss: 0.0000 | Soft Loss: 0.0212 | Time: 3.3438s
Epoch 00956 | Loss: 0.0455 | Swap Loss: 0.0000 | Grad Loss: 0.2403 | Atten Loss: 0.0000 | Soft Loss: 0.0215 | Time: 3.1326s
Epoch 00957 | Loss: 0.0449 | Swap Loss: 0.0000 | Grad Loss: 0.2377 | Atten Loss: 0.0000 | Soft Loss: 0.0211 | Time: 3.3955s
Epoch 00958 | Loss: 0.0464 | Swap Loss: 0.0000 | Grad Loss: 0.2436 | Atten Loss: 0.0000 | Soft Loss: 0.0221 | Time: 3.4087s
Epoch 00959 | Loss: 0.0446 | Swap Loss: 0.0000 | Grad Loss: 0.2372 | Atten Loss: 0.0000 | Soft Loss: 0.0208 | Time: 3.3131s
F1-Score on valset:       whole 0.9707, part1 0.9709, part2 0.9705
F1-Score on testset:       whole 0.9826, part1 0.9826, part2 0.9826
Epoch 00960 | Loss: 0.0442 | Swap Loss: 0.0000 | Grad Loss: 0.2349 | Atten Loss: 0.0000 | Soft Loss: 0.0207 | Time: 3.4365s
Epoch 00961 | Loss: 0.0451 | Swap Loss: 0.0000 | Grad Loss: 0.2384 | Atten Loss: 0.0000 | Soft Loss: 0.0212 | Time: 3.5015s
Epoch 00962 | Loss: 0.0462 | Swap Loss: 0.0000 | Grad Loss: 0.2430 | Atten Loss: 0.0000 | Soft Loss: 0.0219 | Time: 3.2881s
Epoch 00963 | Loss: 0.0469 | Swap Loss: 0.0000 | Grad Loss: 0.2472 | Atten Loss: 0.0000 | Soft Loss: 0.0222 | Time: 3.2006s
Epoch 00964 | Loss: 0.0472 | Swap Loss: 0.0000 | Grad Loss: 0.2470 | Atten Loss: 0.0000 | Soft Loss: 0.0225 | Time: 7.5912s
F1-Score on valset:       whole 0.9707, part1 0.9708, part2 0.9706
Epoch 00965 | Loss: 0.0443 | Swap Loss: 0.0000 | Grad Loss: 0.2372 | Atten Loss: 0.0000 | Soft Loss: 0.0206 | Time: 3.3918s
Epoch 00966 | Loss: 0.0450 | Swap Loss: 0.0000 | Grad Loss: 0.2406 | Atten Loss: 0.0000 | Soft Loss: 0.0209 | Time: 3.2414s
Epoch 00967 | Loss: 0.0444 | Swap Loss: 0.0000 | Grad Loss: 0.2386 | Atten Loss: 0.0000 | Soft Loss: 0.0206 | Time: 3.3596s
Epoch 00968 | Loss: 0.0432 | Swap Loss: 0.0000 | Grad Loss: 0.2333 | Atten Loss: 0.0000 | Soft Loss: 0.0199 | Time: 3.4133s
Epoch 00969 | Loss: 0.0439 | Swap Loss: 0.0000 | Grad Loss: 0.2345 | Atten Loss: 0.0000 | Soft Loss: 0.0204 | Time: 3.2405s
F1-Score on valset:       whole 0.9707, part1 0.9708, part2 0.9706
F1-Score on testset:       whole 0.9826, part1 0.9826, part2 0.9826
Epoch 00970 | Loss: 0.0428 | Swap Loss: 0.0000 | Grad Loss: 0.2300 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 2.7766s
Epoch 00971 | Loss: 0.0434 | Swap Loss: 0.0000 | Grad Loss: 0.2325 | Atten Loss: 0.0000 | Soft Loss: 0.0201 | Time: 3.3206s
Epoch 00972 | Loss: 0.0447 | Swap Loss: 0.0000 | Grad Loss: 0.2386 | Atten Loss: 0.0000 | Soft Loss: 0.0208 | Time: 3.4408s
Epoch 00973 | Loss: 0.0443 | Swap Loss: 0.0000 | Grad Loss: 0.2385 | Atten Loss: 0.0000 | Soft Loss: 0.0205 | Time: 3.1926s
Epoch 00974 | Loss: 0.0433 | Swap Loss: 0.0000 | Grad Loss: 0.2329 | Atten Loss: 0.0000 | Soft Loss: 0.0200 | Time: 3.3428s
F1-Score on valset:       whole 0.9708, part1 0.9709, part2 0.9707
F1-Score on testset:       whole 0.9827, part1 0.9827, part2 0.9827
Epoch 00975 | Loss: 0.0429 | Swap Loss: 0.0000 | Grad Loss: 0.2321 | Atten Loss: 0.0000 | Soft Loss: 0.0197 | Time: 3.2029s
Epoch 00976 | Loss: 0.0438 | Swap Loss: 0.0000 | Grad Loss: 0.2349 | Atten Loss: 0.0000 | Soft Loss: 0.0203 | Time: 3.3036s
Epoch 00977 | Loss: 0.0449 | Swap Loss: 0.0000 | Grad Loss: 0.2403 | Atten Loss: 0.0000 | Soft Loss: 0.0209 | Time: 3.4060s
Epoch 00978 | Loss: 0.0430 | Swap Loss: 0.0000 | Grad Loss: 0.2321 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 3.3956s
Epoch 00979 | Loss: 0.0443 | Swap Loss: 0.0000 | Grad Loss: 0.2377 | Atten Loss: 0.0000 | Soft Loss: 0.0205 | Time: 3.1361s
F1-Score on valset:       whole 0.9709, part1 0.9710, part2 0.9707
F1-Score on testset:       whole 0.9827, part1 0.9828, part2 0.9827
Epoch 00980 | Loss: 0.0435 | Swap Loss: 0.0000 | Grad Loss: 0.2347 | Atten Loss: 0.0000 | Soft Loss: 0.0200 | Time: 3.1926s
Epoch 00981 | Loss: 0.0435 | Swap Loss: 0.0000 | Grad Loss: 0.2339 | Atten Loss: 0.0000 | Soft Loss: 0.0201 | Time: 3.2288s
Epoch 00982 | Loss: 0.0445 | Swap Loss: 0.0000 | Grad Loss: 0.2390 | Atten Loss: 0.0000 | Soft Loss: 0.0206 | Time: 3.2786s
Epoch 00983 | Loss: 0.0439 | Swap Loss: 0.0000 | Grad Loss: 0.2354 | Atten Loss: 0.0000 | Soft Loss: 0.0203 | Time: 3.3913s
Epoch 00984 | Loss: 0.0440 | Swap Loss: 0.0000 | Grad Loss: 0.2372 | Atten Loss: 0.0000 | Soft Loss: 0.0203 | Time: 3.2299s
F1-Score on valset:       whole 0.9710, part1 0.9711, part2 0.9708
F1-Score on testset:       whole 0.9828, part1 0.9828, part2 0.9828
Epoch 00985 | Loss: 0.0439 | Swap Loss: 0.0000 | Grad Loss: 0.2370 | Atten Loss: 0.0000 | Soft Loss: 0.0202 | Time: 3.4275s
Epoch 00986 | Loss: 0.0444 | Swap Loss: 0.0000 | Grad Loss: 0.2398 | Atten Loss: 0.0000 | Soft Loss: 0.0204 | Time: 3.2226s
Epoch 00987 | Loss: 0.0448 | Swap Loss: 0.0000 | Grad Loss: 0.2434 | Atten Loss: 0.0000 | Soft Loss: 0.0204 | Time: 2.8652s
Epoch 00988 | Loss: 0.0441 | Swap Loss: 0.0000 | Grad Loss: 0.2408 | Atten Loss: 0.0000 | Soft Loss: 0.0200 | Time: 3.4518s
Epoch 00989 | Loss: 0.0435 | Swap Loss: 0.0000 | Grad Loss: 0.2380 | Atten Loss: 0.0000 | Soft Loss: 0.0197 | Time: 3.2904s
F1-Score on valset:       whole 0.9708, part1 0.9709, part2 0.9706
F1-Score on testset:       whole 0.9827, part1 0.9827, part2 0.9828
Epoch 00990 | Loss: 0.0434 | Swap Loss: 0.0000 | Grad Loss: 0.2351 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 3.2009s
Epoch 00991 | Loss: 0.0433 | Swap Loss: 0.0000 | Grad Loss: 0.2360 | Atten Loss: 0.0000 | Soft Loss: 0.0197 | Time: 3.4656s
Epoch 00992 | Loss: 0.0428 | Swap Loss: 0.0000 | Grad Loss: 0.2327 | Atten Loss: 0.0000 | Soft Loss: 0.0195 | Time: 3.3512s
Epoch 00993 | Loss: 0.0442 | Swap Loss: 0.0000 | Grad Loss: 0.2394 | Atten Loss: 0.0000 | Soft Loss: 0.0202 | Time: 3.4393s
Epoch 00994 | Loss: 0.0431 | Swap Loss: 0.0000 | Grad Loss: 0.2344 | Atten Loss: 0.0000 | Soft Loss: 0.0196 | Time: 3.2460s
F1-Score on valset:       whole 0.9710, part1 0.9711, part2 0.9708
F1-Score on testset:       whole 0.9828, part1 0.9828, part2 0.9828
Epoch 00995 | Loss: 0.0432 | Swap Loss: 0.0000 | Grad Loss: 0.2352 | Atten Loss: 0.0000 | Soft Loss: 0.0196 | Time: 3.1973s
Epoch 00996 | Loss: 0.0431 | Swap Loss: 0.0000 | Grad Loss: 0.2352 | Atten Loss: 0.0000 | Soft Loss: 0.0196 | Time: 3.4684s
Epoch 00997 | Loss: 0.0421 | Swap Loss: 0.0000 | Grad Loss: 0.2300 | Atten Loss: 0.0000 | Soft Loss: 0.0191 | Time: 3.4848s
Epoch 00998 | Loss: 0.0428 | Swap Loss: 0.0000 | Grad Loss: 0.2326 | Atten Loss: 0.0000 | Soft Loss: 0.0195 | Time: 3.2551s
Epoch 00999 | Loss: 0.0446 | Swap Loss: 0.0000 | Grad Loss: 0.2409 | Atten Loss: 0.0000 | Soft Loss: 0.0205 | Time: 3.2454s
F1-Score on valset:       whole 0.9710, part1 0.9711, part2 0.9708
F1-Score on testset:       whole 0.9829, part1 0.9829, part2 0.9828
Epoch 01000 | Loss: 0.0435 | Swap Loss: 0.0000 | Grad Loss: 0.2373 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 3.4449s
Epoch 01001 | Loss: 0.0425 | Swap Loss: 0.0000 | Grad Loss: 0.2334 | Atten Loss: 0.0000 | Soft Loss: 0.0192 | Time: 3.2170s
Epoch 01002 | Loss: 0.0429 | Swap Loss: 0.0000 | Grad Loss: 0.2357 | Atten Loss: 0.0000 | Soft Loss: 0.0194 | Time: 3.3673s
Epoch 01003 | Loss: 0.0418 | Swap Loss: 0.0000 | Grad Loss: 0.2295 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.2502s
Epoch 01004 | Loss: 0.0424 | Swap Loss: 0.0000 | Grad Loss: 0.2325 | Atten Loss: 0.0000 | Soft Loss: 0.0191 | Time: 3.3359s
F1-Score on valset:       whole 0.9710, part1 0.9711, part2 0.9709
F1-Score on testset:       whole 0.9829, part1 0.9829, part2 0.9829
Epoch 01005 | Loss: 0.0426 | Swap Loss: 0.0000 | Grad Loss: 0.2325 | Atten Loss: 0.0000 | Soft Loss: 0.0193 | Time: 3.2854s
Epoch 01006 | Loss: 0.0421 | Swap Loss: 0.0000 | Grad Loss: 0.2308 | Atten Loss: 0.0000 | Soft Loss: 0.0191 | Time: 3.2734s
Epoch 01007 | Loss: 0.0417 | Swap Loss: 0.0000 | Grad Loss: 0.2285 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.4244s
Epoch 01008 | Loss: 0.0429 | Swap Loss: 0.0000 | Grad Loss: 0.2348 | Atten Loss: 0.0000 | Soft Loss: 0.0194 | Time: 3.2991s
Epoch 01009 | Loss: 0.0437 | Swap Loss: 0.0000 | Grad Loss: 0.2389 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 3.3044s
F1-Score on valset:       whole 0.9711, part1 0.9714, part2 0.9709
F1-Score on testset:       whole 0.9828, part1 0.9828, part2 0.9828
Epoch 01010 | Loss: 0.0432 | Swap Loss: 0.0000 | Grad Loss: 0.2360 | Atten Loss: 0.0000 | Soft Loss: 0.0195 | Time: 3.1370s
Epoch 01011 | Loss: 0.0439 | Swap Loss: 0.0000 | Grad Loss: 0.2398 | Atten Loss: 0.0000 | Soft Loss: 0.0199 | Time: 3.2192s
Epoch 01012 | Loss: 0.0434 | Swap Loss: 0.0000 | Grad Loss: 0.2358 | Atten Loss: 0.0000 | Soft Loss: 0.0198 | Time: 3.1979s
Epoch 01013 | Loss: 0.0431 | Swap Loss: 0.0000 | Grad Loss: 0.2374 | Atten Loss: 0.0000 | Soft Loss: 0.0193 | Time: 3.4687s
Epoch 01014 | Loss: 0.0416 | Swap Loss: 0.0000 | Grad Loss: 0.2311 | Atten Loss: 0.0000 | Soft Loss: 0.0185 | Time: 3.2057s
F1-Score on valset:       whole 0.9712, part1 0.9713, part2 0.9710
F1-Score on testset:       whole 0.9829, part1 0.9828, part2 0.9829
Epoch 01015 | Loss: 0.0422 | Swap Loss: 0.0000 | Grad Loss: 0.2341 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.3787s
Epoch 01016 | Loss: 0.0415 | Swap Loss: 0.0000 | Grad Loss: 0.2291 | Atten Loss: 0.0000 | Soft Loss: 0.0186 | Time: 7.0754s
Epoch 01017 | Loss: 0.0415 | Swap Loss: 0.0000 | Grad Loss: 0.2291 | Atten Loss: 0.0000 | Soft Loss: 0.0186 | Time: 3.5198s
Epoch 01018 | Loss: 0.0423 | Swap Loss: 0.0000 | Grad Loss: 0.2330 | Atten Loss: 0.0000 | Soft Loss: 0.0190 | Time: 3.3618s
Epoch 01019 | Loss: 0.0421 | Swap Loss: 0.0000 | Grad Loss: 0.2332 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.4163s
F1-Score on valset:       whole 0.9711, part1 0.9713, part2 0.9710
Epoch 01020 | Loss: 0.0427 | Swap Loss: 0.0000 | Grad Loss: 0.2361 | Atten Loss: 0.0000 | Soft Loss: 0.0191 | Time: 3.5027s
Epoch 01021 | Loss: 0.0420 | Swap Loss: 0.0000 | Grad Loss: 0.2322 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.3825s
Epoch 01022 | Loss: 0.0421 | Swap Loss: 0.0000 | Grad Loss: 0.2319 | Atten Loss: 0.0000 | Soft Loss: 0.0189 | Time: 3.3987s
Epoch 01023 | Loss: 0.0419 | Swap Loss: 0.0000 | Grad Loss: 0.2324 | Atten Loss: 0.0000 | Soft Loss: 0.0187 | Time: 3.1409s
Epoch 01024 | Loss: 0.0419 | Swap Loss: 0.0000 | Grad Loss: 0.2311 | Atten Loss: 0.0000 | Soft Loss: 0.0188 | Time: 3.3231s
F1-Score on valset:       whole 0.9714, part1 0.9716, part2 0.9711
F1-Score on testset:       whole 0.9829, part1 0.9829, part2 0.9829
Epoch 01025 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2279 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.3604s
Epoch 01026 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2283 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.4318s
Epoch 01027 | Loss: 0.0414 | Swap Loss: 0.0000 | Grad Loss: 0.2309 | Atten Loss: 0.0000 | Soft Loss: 0.0183 | Time: 3.4345s
Epoch 01028 | Loss: 0.0417 | Swap Loss: 0.0000 | Grad Loss: 0.2322 | Atten Loss: 0.0000 | Soft Loss: 0.0185 | Time: 3.1314s
Epoch 01029 | Loss: 0.0408 | Swap Loss: 0.0000 | Grad Loss: 0.2280 | Atten Loss: 0.0000 | Soft Loss: 0.0180 | Time: 3.0766s
F1-Score on valset:       whole 0.9714, part1 0.9716, part2 0.9713
F1-Score on testset:       whole 0.9831, part1 0.9830, part2 0.9831
Epoch 01030 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2282 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.1924s
Epoch 01031 | Loss: 0.0417 | Swap Loss: 0.0000 | Grad Loss: 0.2327 | Atten Loss: 0.0000 | Soft Loss: 0.0184 | Time: 3.2258s
Epoch 01032 | Loss: 0.0403 | Swap Loss: 0.0000 | Grad Loss: 0.2268 | Atten Loss: 0.0000 | Soft Loss: 0.0176 | Time: 3.0626s
Epoch 01033 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2280 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.2794s
Epoch 01034 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2295 | Atten Loss: 0.0000 | Soft Loss: 0.0180 | Time: 3.2628s
F1-Score on valset:       whole 0.9715, part1 0.9717, part2 0.9712
F1-Score on testset:       whole 0.9830, part1 0.9830, part2 0.9830
Epoch 01035 | Loss: 0.0425 | Swap Loss: 0.0000 | Grad Loss: 0.2341 | Atten Loss: 0.0000 | Soft Loss: 0.0191 | Time: 3.5853s
Epoch 01036 | Loss: 0.0410 | Swap Loss: 0.0000 | Grad Loss: 0.2300 | Atten Loss: 0.0000 | Soft Loss: 0.0180 | Time: 3.4243s
Epoch 01037 | Loss: 0.0400 | Swap Loss: 0.0000 | Grad Loss: 0.2247 | Atten Loss: 0.0000 | Soft Loss: 0.0175 | Time: 3.3437s
Epoch 01038 | Loss: 0.0414 | Swap Loss: 0.0000 | Grad Loss: 0.2316 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.3224s
Epoch 01039 | Loss: 0.0419 | Swap Loss: 0.0000 | Grad Loss: 0.2332 | Atten Loss: 0.0000 | Soft Loss: 0.0186 | Time: 3.4735s
F1-Score on valset:       whole 0.9715, part1 0.9717, part2 0.9712
Epoch 01040 | Loss: 0.0397 | Swap Loss: 0.0000 | Grad Loss: 0.2236 | Atten Loss: 0.0000 | Soft Loss: 0.0173 | Time: 3.3188s
Epoch 01041 | Loss: 0.0406 | Swap Loss: 0.0000 | Grad Loss: 0.2279 | Atten Loss: 0.0000 | Soft Loss: 0.0178 | Time: 3.4835s
Epoch 01042 | Loss: 0.0401 | Swap Loss: 0.0000 | Grad Loss: 0.2260 | Atten Loss: 0.0000 | Soft Loss: 0.0175 | Time: 3.4111s
Epoch 01043 | Loss: 0.0409 | Swap Loss: 0.0000 | Grad Loss: 0.2289 | Atten Loss: 0.0000 | Soft Loss: 0.0180 | Time: 3.4462s
Epoch 01044 | Loss: 0.0399 | Swap Loss: 0.0000 | Grad Loss: 0.2247 | Atten Loss: 0.0000 | Soft Loss: 0.0174 | Time: 3.1162s
F1-Score on valset:       whole 0.9715, part1 0.9718, part2 0.9712
F1-Score on testset:       whole 0.9831, part1 0.9832, part2 0.9830
Epoch 01045 | Loss: 0.0399 | Swap Loss: 0.0000 | Grad Loss: 0.2245 | Atten Loss: 0.0000 | Soft Loss: 0.0174 | Time: 3.1130s
Epoch 01046 | Loss: 0.0420 | Swap Loss: 0.0000 | Grad Loss: 0.2343 | Atten Loss: 0.0000 | Soft Loss: 0.0186 | Time: 3.1282s
Epoch 01047 | Loss: 0.0407 | Swap Loss: 0.0000 | Grad Loss: 0.2285 | Atten Loss: 0.0000 | Soft Loss: 0.0179 | Time: 3.0700s
Epoch 01048 | Loss: 0.0407 | Swap Loss: 0.0000 | Grad Loss: 0.2290 | Atten Loss: 0.0000 | Soft Loss: 0.0178 | Time: 3.1890s
Epoch 01049 | Loss: 0.0407 | Swap Loss: 0.0000 | Grad Loss: 0.2294 | Atten Loss: 0.0000 | Soft Loss: 0.0177 | Time: 3.1356s
F1-Score on valset:       whole 0.9714, part1 0.9715, part2 0.9713
Epoch 01050 | Loss: 0.0406 | Swap Loss: 0.0000 | Grad Loss: 0.2292 | Atten Loss: 0.0000 | Soft Loss: 0.0177 | Time: 3.2240s
Epoch 01051 | Loss: 0.0408 | Swap Loss: 0.0000 | Grad Loss: 0.2298 | Atten Loss: 0.0000 | Soft Loss: 0.0178 | Time: 3.5501s
Epoch 01052 | Loss: 0.0432 | Swap Loss: 0.0000 | Grad Loss: 0.2400 | Atten Loss: 0.0000 | Soft Loss: 0.0192 | Time: 3.3466s
Epoch 01053 | Loss: 0.0418 | Swap Loss: 0.0000 | Grad Loss: 0.2343 | Atten Loss: 0.0000 | Soft Loss: 0.0184 | Time: 3.2755s
Epoch 01054 | Loss: 0.0414 | Swap Loss: 0.0000 | Grad Loss: 0.2320 | Atten Loss: 0.0000 | Soft Loss: 0.0182 | Time: 3.3107s
F1-Score on valset:       whole 0.9715, part1 0.9717, part2 0.9713
F1-Score on testset:       whole 0.9832, part1 0.9833, part2 0.9831
Epoch 01055 | Loss: 0.0398 | Swap Loss: 0.0000 | Grad Loss: 0.2259 | Atten Loss: 0.0000 | Soft Loss: 0.0172 | Time: 3.1593s
Epoch 01056 | Loss: 0.0396 | Swap Loss: 0.0000 | Grad Loss: 0.2242 | Atten Loss: 0.0000 | Soft Loss: 0.0171 | Time: 3.4463s
Epoch 01057 | Loss: 0.0407 | Swap Loss: 0.0000 | Grad Loss: 0.2282 | Atten Loss: 0.0000 | Soft Loss: 0.0179 | Time: 3.3983s
Epoch 01058 | Loss: 0.0409 | Swap Loss: 0.0000 | Grad Loss: 0.2312 | Atten Loss: 0.0000 | Soft Loss: 0.0178 | Time: 3.5496s
Epoch 01059 | Loss: 0.0395 | Swap Loss: 0.0000 | Grad Loss: 0.2246 | Atten Loss: 0.0000 | Soft Loss: 0.0170 | Time: 3.4771s
F1-Score on valset:       whole 0.9715, part1 0.9716, part2 0.9713
F1-Score on testset:       whole 0.9831, part1 0.9831, part2 0.9831
Epoch 01060 | Loss: 0.0406 | Swap Loss: 0.0000 | Grad Loss: 0.2281 | Atten Loss: 0.0000 | Soft Loss: 0.0177 | Time: 3.5149s
Epoch 01061 | Loss: 0.0399 | Swap Loss: 0.0000 | Grad Loss: 0.2262 | Atten Loss: 0.0000 | Soft Loss: 0.0173 | Time: 3.1236s
Epoch 01062 | Loss: 0.0404 | Swap Loss: 0.0000 | Grad Loss: 0.2302 | Atten Loss: 0.0000 | Soft Loss: 0.0174 | Time: 3.3398s
Epoch 01063 | Loss: 0.0406 | Swap Loss: 0.0000 | Grad Loss: 0.2302 | Atten Loss: 0.0000 | Soft Loss: 0.0175 | Time: 3.6106s
Epoch 01064 | Loss: 0.0405 | Swap Loss: 0.0000 | Grad Loss: 0.2308 | Atten Loss: 0.0000 | Soft Loss: 0.0175 | Time: 3.2777s
F1-Score on valset:       whole 0.9715, part1 0.9718, part2 0.9713
F1-Score on testset:       whole 0.9832, part1 0.9833, part2 0.9830
Epoch 01065 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2248 | Atten Loss: 0.0000 | Soft Loss: 0.0168 | Time: 3.1999s
Epoch 01066 | Loss: 0.0388 | Swap Loss: 0.0000 | Grad Loss: 0.2220 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.1222s
Epoch 01067 | Loss: 0.0388 | Swap Loss: 0.0000 | Grad Loss: 0.2210 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.1367s
Epoch 01068 | Loss: 0.0404 | Swap Loss: 0.0000 | Grad Loss: 0.2281 | Atten Loss: 0.0000 | Soft Loss: 0.0176 | Time: 3.3279s
Epoch 01069 | Loss: 0.0394 | Swap Loss: 0.0000 | Grad Loss: 0.2260 | Atten Loss: 0.0000 | Soft Loss: 0.0168 | Time: 3.0587s
F1-Score on valset:       whole 0.9716, part1 0.9718, part2 0.9715
F1-Score on testset:       whole 0.9832, part1 0.9833, part2 0.9832
Epoch 01070 | Loss: 0.0394 | Swap Loss: 0.0000 | Grad Loss: 0.2244 | Atten Loss: 0.0000 | Soft Loss: 0.0169 | Time: 3.1481s
Epoch 01071 | Loss: 0.0399 | Swap Loss: 0.0000 | Grad Loss: 0.2247 | Atten Loss: 0.0000 | Soft Loss: 0.0174 | Time: 3.2987s
Epoch 01072 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2227 | Atten Loss: 0.0000 | Soft Loss: 0.0168 | Time: 3.3967s
Epoch 01073 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2239 | Atten Loss: 0.0000 | Soft Loss: 0.0169 | Time: 3.4088s
Epoch 01074 | Loss: 0.0389 | Swap Loss: 0.0000 | Grad Loss: 0.2229 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.2257s
F1-Score on valset:       whole 0.9716, part1 0.9719, part2 0.9714
F1-Score on testset:       whole 0.9833, part1 0.9834, part2 0.9832
Epoch 01075 | Loss: 0.0402 | Swap Loss: 0.0000 | Grad Loss: 0.2283 | Atten Loss: 0.0000 | Soft Loss: 0.0174 | Time: 3.3177s
Epoch 01076 | Loss: 0.0407 | Swap Loss: 0.0000 | Grad Loss: 0.2306 | Atten Loss: 0.0000 | Soft Loss: 0.0177 | Time: 3.1163s
Epoch 01077 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2251 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.1443s
Epoch 01078 | Loss: 0.0394 | Swap Loss: 0.0000 | Grad Loss: 0.2277 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.1853s
Epoch 01079 | Loss: 0.0390 | Swap Loss: 0.0000 | Grad Loss: 0.2230 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.2764s
F1-Score on valset:       whole 0.9715, part1 0.9718, part2 0.9713
Epoch 01080 | Loss: 0.0387 | Swap Loss: 0.0000 | Grad Loss: 0.2220 | Atten Loss: 0.0000 | Soft Loss: 0.0165 | Time: 3.4087s
Epoch 01081 | Loss: 0.0402 | Swap Loss: 0.0000 | Grad Loss: 0.2304 | Atten Loss: 0.0000 | Soft Loss: 0.0171 | Time: 3.4348s
Epoch 01082 | Loss: 0.0386 | Swap Loss: 0.0000 | Grad Loss: 0.2223 | Atten Loss: 0.0000 | Soft Loss: 0.0164 | Time: 3.3463s
Epoch 01083 | Loss: 0.0384 | Swap Loss: 0.0000 | Grad Loss: 0.2206 | Atten Loss: 0.0000 | Soft Loss: 0.0163 | Time: 3.2761s
Epoch 01084 | Loss: 0.0385 | Swap Loss: 0.0000 | Grad Loss: 0.2198 | Atten Loss: 0.0000 | Soft Loss: 0.0165 | Time: 3.2225s
F1-Score on valset:       whole 0.9717, part1 0.9719, part2 0.9715
F1-Score on testset:       whole 0.9833, part1 0.9834, part2 0.9833
Epoch 01085 | Loss: 0.0398 | Swap Loss: 0.0000 | Grad Loss: 0.2273 | Atten Loss: 0.0000 | Soft Loss: 0.0170 | Time: 3.1048s
Epoch 01086 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2246 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.2011s
Epoch 01087 | Loss: 0.0387 | Swap Loss: 0.0000 | Grad Loss: 0.2234 | Atten Loss: 0.0000 | Soft Loss: 0.0163 | Time: 3.3267s
Epoch 01088 | Loss: 0.0382 | Swap Loss: 0.0000 | Grad Loss: 0.2208 | Atten Loss: 0.0000 | Soft Loss: 0.0161 | Time: 3.3260s
Epoch 01089 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2256 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.3334s
F1-Score on valset:       whole 0.9717, part1 0.9719, part2 0.9715
F1-Score on testset:       whole 0.9833, part1 0.9833, part2 0.9833
Epoch 01090 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2256 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.3025s
Epoch 01091 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2251 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.2867s
Epoch 01092 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2246 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.4892s
Epoch 01093 | Loss: 0.0403 | Swap Loss: 0.0000 | Grad Loss: 0.2314 | Atten Loss: 0.0000 | Soft Loss: 0.0171 | Time: 3.4432s
Epoch 01094 | Loss: 0.0384 | Swap Loss: 0.0000 | Grad Loss: 0.2234 | Atten Loss: 0.0000 | Soft Loss: 0.0161 | Time: 3.2689s
F1-Score on valset:       whole 0.9718, part1 0.9721, part2 0.9716
F1-Score on testset:       whole 0.9834, part1 0.9834, part2 0.9833
Epoch 01095 | Loss: 0.0390 | Swap Loss: 0.0000 | Grad Loss: 0.2247 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.4411s
Epoch 01096 | Loss: 0.0395 | Swap Loss: 0.0000 | Grad Loss: 0.2293 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.3718s
Epoch 01097 | Loss: 0.0383 | Swap Loss: 0.0000 | Grad Loss: 0.2222 | Atten Loss: 0.0000 | Soft Loss: 0.0161 | Time: 3.3886s
Epoch 01098 | Loss: 0.0394 | Swap Loss: 0.0000 | Grad Loss: 0.2272 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.4842s
Epoch 01099 | Loss: 0.0381 | Swap Loss: 0.0000 | Grad Loss: 0.2222 | Atten Loss: 0.0000 | Soft Loss: 0.0159 | Time: 3.5136s
F1-Score on valset:       whole 0.9719, part1 0.9720, part2 0.9717
F1-Score on testset:       whole 0.9834, part1 0.9834, part2 0.9834
Epoch 01100 | Loss: 0.0397 | Swap Loss: 0.0000 | Grad Loss: 0.2286 | Atten Loss: 0.0000 | Soft Loss: 0.0168 | Time: 3.5160s
Epoch 01101 | Loss: 0.0419 | Swap Loss: 0.0000 | Grad Loss: 0.2419 | Atten Loss: 0.0000 | Soft Loss: 0.0177 | Time: 3.4557s
Epoch 01102 | Loss: 0.0399 | Swap Loss: 0.0000 | Grad Loss: 0.2330 | Atten Loss: 0.0000 | Soft Loss: 0.0166 | Time: 3.3147s
Epoch 01103 | Loss: 0.0406 | Swap Loss: 0.0000 | Grad Loss: 0.2344 | Atten Loss: 0.0000 | Soft Loss: 0.0172 | Time: 3.4223s
Epoch 01104 | Loss: 0.0395 | Swap Loss: 0.0000 | Grad Loss: 0.2304 | Atten Loss: 0.0000 | Soft Loss: 0.0165 | Time: 3.2302s
F1-Score on valset:       whole 0.9718, part1 0.9720, part2 0.9716
Epoch 01105 | Loss: 0.0381 | Swap Loss: 0.0000 | Grad Loss: 0.2227 | Atten Loss: 0.0000 | Soft Loss: 0.0158 | Time: 3.3163s
Epoch 01106 | Loss: 0.0389 | Swap Loss: 0.0000 | Grad Loss: 0.2267 | Atten Loss: 0.0000 | Soft Loss: 0.0163 | Time: 3.2782s
Epoch 01107 | Loss: 0.0371 | Swap Loss: 0.0000 | Grad Loss: 0.2171 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.3193s
Epoch 01108 | Loss: 0.0382 | Swap Loss: 0.0000 | Grad Loss: 0.2224 | Atten Loss: 0.0000 | Soft Loss: 0.0160 | Time: 3.1502s
Epoch 01109 | Loss: 0.0385 | Swap Loss: 0.0000 | Grad Loss: 0.2230 | Atten Loss: 0.0000 | Soft Loss: 0.0162 | Time: 3.4153s
F1-Score on valset:       whole 0.9720, part1 0.9722, part2 0.9717
F1-Score on testset:       whole 0.9835, part1 0.9835, part2 0.9834
Epoch 01110 | Loss: 0.0396 | Swap Loss: 0.0000 | Grad Loss: 0.2282 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.5003s
Epoch 01111 | Loss: 0.0385 | Swap Loss: 0.0000 | Grad Loss: 0.2250 | Atten Loss: 0.0000 | Soft Loss: 0.0160 | Time: 3.3802s
Epoch 01112 | Loss: 0.0379 | Swap Loss: 0.0000 | Grad Loss: 0.2216 | Atten Loss: 0.0000 | Soft Loss: 0.0157 | Time: 3.1766s
Epoch 01113 | Loss: 0.0382 | Swap Loss: 0.0000 | Grad Loss: 0.2221 | Atten Loss: 0.0000 | Soft Loss: 0.0160 | Time: 2.9993s
Epoch 01114 | Loss: 0.0381 | Swap Loss: 0.0000 | Grad Loss: 0.2228 | Atten Loss: 0.0000 | Soft Loss: 0.0159 | Time: 3.0435s
F1-Score on valset:       whole 0.9719, part1 0.9722, part2 0.9716
F1-Score on testset:       whole 0.9835, part1 0.9835, part2 0.9834
Epoch 01115 | Loss: 0.0402 | Swap Loss: 0.0000 | Grad Loss: 0.2320 | Atten Loss: 0.0000 | Soft Loss: 0.0170 | Time: 3.5262s
Epoch 01116 | Loss: 0.0381 | Swap Loss: 0.0000 | Grad Loss: 0.2236 | Atten Loss: 0.0000 | Soft Loss: 0.0157 | Time: 3.3742s
Epoch 01117 | Loss: 0.0375 | Swap Loss: 0.0000 | Grad Loss: 0.2203 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.4268s
Epoch 01118 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2265 | Atten Loss: 0.0000 | Soft Loss: 0.0165 | Time: 3.3870s
Epoch 01119 | Loss: 0.0393 | Swap Loss: 0.0000 | Grad Loss: 0.2292 | Atten Loss: 0.0000 | Soft Loss: 0.0163 | Time: 3.3640s
F1-Score on valset:       whole 0.9718, part1 0.9721, part2 0.9715
Epoch 01120 | Loss: 0.0397 | Swap Loss: 0.0000 | Grad Loss: 0.2316 | Atten Loss: 0.0000 | Soft Loss: 0.0165 | Time: 3.3330s
Epoch 01121 | Loss: 0.0389 | Swap Loss: 0.0000 | Grad Loss: 0.2289 | Atten Loss: 0.0000 | Soft Loss: 0.0160 | Time: 3.7416s
Epoch 01122 | Loss: 0.0398 | Swap Loss: 0.0000 | Grad Loss: 0.2306 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.6356s
Epoch 01123 | Loss: 0.0370 | Swap Loss: 0.0000 | Grad Loss: 0.2194 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.6121s
Epoch 01124 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2167 | Atten Loss: 0.0000 | Soft Loss: 0.0150 | Time: 3.2025s
F1-Score on valset:       whole 0.9719, part1 0.9721, part2 0.9717
F1-Score on testset:       whole 0.9835, part1 0.9835, part2 0.9834
Epoch 01125 | Loss: 0.0413 | Swap Loss: 0.0000 | Grad Loss: 0.2460 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.5048s
Epoch 01126 | Loss: 0.0415 | Swap Loss: 0.0000 | Grad Loss: 0.2480 | Atten Loss: 0.0000 | Soft Loss: 0.0167 | Time: 3.2329s
Epoch 01127 | Loss: 0.0398 | Swap Loss: 0.0000 | Grad Loss: 0.2366 | Atten Loss: 0.0000 | Soft Loss: 0.0161 | Time: 3.1881s
Epoch 01128 | Loss: 0.0385 | Swap Loss: 0.0000 | Grad Loss: 0.2283 | Atten Loss: 0.0000 | Soft Loss: 0.0157 | Time: 3.1445s
Epoch 01129 | Loss: 0.0371 | Swap Loss: 0.0000 | Grad Loss: 0.2198 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.2524s
F1-Score on valset:       whole 0.9720, part1 0.9721, part2 0.9718
F1-Score on testset:       whole 0.9834, part1 0.9834, part2 0.9835
Epoch 01130 | Loss: 0.0382 | Swap Loss: 0.0000 | Grad Loss: 0.2244 | Atten Loss: 0.0000 | Soft Loss: 0.0158 | Time: 3.2424s
Epoch 01131 | Loss: 0.0380 | Swap Loss: 0.0000 | Grad Loss: 0.2232 | Atten Loss: 0.0000 | Soft Loss: 0.0157 | Time: 3.4286s
Epoch 01132 | Loss: 0.0376 | Swap Loss: 0.0000 | Grad Loss: 0.2228 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.3154s
Epoch 01133 | Loss: 0.0392 | Swap Loss: 0.0000 | Grad Loss: 0.2323 | Atten Loss: 0.0000 | Soft Loss: 0.0159 | Time: 3.1764s
Epoch 01134 | Loss: 0.0395 | Swap Loss: 0.0000 | Grad Loss: 0.2321 | Atten Loss: 0.0000 | Soft Loss: 0.0163 | Time: 3.0745s
F1-Score on valset:       whole 0.9719, part1 0.9721, part2 0.9717
Epoch 01135 | Loss: 0.0391 | Swap Loss: 0.0000 | Grad Loss: 0.2299 | Atten Loss: 0.0000 | Soft Loss: 0.0161 | Time: 3.2776s
Epoch 01136 | Loss: 0.0378 | Swap Loss: 0.0000 | Grad Loss: 0.2247 | Atten Loss: 0.0000 | Soft Loss: 0.0153 | Time: 3.4638s
Epoch 01137 | Loss: 0.0371 | Swap Loss: 0.0000 | Grad Loss: 0.2198 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.3463s
Epoch 01138 | Loss: 0.0369 | Swap Loss: 0.0000 | Grad Loss: 0.2177 | Atten Loss: 0.0000 | Soft Loss: 0.0152 | Time: 3.1962s
Epoch 01139 | Loss: 0.0376 | Swap Loss: 0.0000 | Grad Loss: 0.2214 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.5427s
F1-Score on valset:       whole 0.9721, part1 0.9723, part2 0.9718
F1-Score on testset:       whole 0.9836, part1 0.9836, part2 0.9835
Epoch 01140 | Loss: 0.0364 | Swap Loss: 0.0000 | Grad Loss: 0.2158 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.3255s
Epoch 01141 | Loss: 0.0376 | Swap Loss: 0.0000 | Grad Loss: 0.2209 | Atten Loss: 0.0000 | Soft Loss: 0.0155 | Time: 3.6086s
Epoch 01142 | Loss: 0.0374 | Swap Loss: 0.0000 | Grad Loss: 0.2207 | Atten Loss: 0.0000 | Soft Loss: 0.0153 | Time: 3.6968s
Epoch 01143 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2168 | Atten Loss: 0.0000 | Soft Loss: 0.0150 | Time: 3.4918s
Epoch 01144 | Loss: 0.0366 | Swap Loss: 0.0000 | Grad Loss: 0.2175 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.4080s
F1-Score on valset:       whole 0.9722, part1 0.9724, part2 0.9720
F1-Score on testset:       whole 0.9836, part1 0.9836, part2 0.9836
Epoch 01145 | Loss: 0.0365 | Swap Loss: 0.0000 | Grad Loss: 0.2161 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.0566s
Epoch 01146 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2175 | Atten Loss: 0.0000 | Soft Loss: 0.0150 | Time: 3.0041s
Epoch 01147 | Loss: 0.0376 | Swap Loss: 0.0000 | Grad Loss: 0.2221 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.0609s
Epoch 01148 | Loss: 0.0373 | Swap Loss: 0.0000 | Grad Loss: 0.2204 | Atten Loss: 0.0000 | Soft Loss: 0.0153 | Time: 3.2480s
Epoch 01149 | Loss: 0.0375 | Swap Loss: 0.0000 | Grad Loss: 0.2223 | Atten Loss: 0.0000 | Soft Loss: 0.0152 | Time: 3.1688s
F1-Score on valset:       whole 0.9722, part1 0.9725, part2 0.9720
F1-Score on testset:       whole 0.9836, part1 0.9837, part2 0.9835
Epoch 01150 | Loss: 0.0366 | Swap Loss: 0.0000 | Grad Loss: 0.2171 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.0817s
Epoch 01151 | Loss: 0.0370 | Swap Loss: 0.0000 | Grad Loss: 0.2198 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.4971s
Epoch 01152 | Loss: 0.0362 | Swap Loss: 0.0000 | Grad Loss: 0.2160 | Atten Loss: 0.0000 | Soft Loss: 0.0146 | Time: 3.0480s
Epoch 01153 | Loss: 0.0387 | Swap Loss: 0.0000 | Grad Loss: 0.2294 | Atten Loss: 0.0000 | Soft Loss: 0.0157 | Time: 3.3416s
Epoch 01154 | Loss: 0.0390 | Swap Loss: 0.0000 | Grad Loss: 0.2354 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.1519s
F1-Score on valset:       whole 0.9719, part1 0.9722, part2 0.9716
Epoch 01155 | Loss: 0.0385 | Swap Loss: 0.0000 | Grad Loss: 0.2302 | Atten Loss: 0.0000 | Soft Loss: 0.0155 | Time: 3.5911s
Epoch 01156 | Loss: 0.0382 | Swap Loss: 0.0000 | Grad Loss: 0.2283 | Atten Loss: 0.0000 | Soft Loss: 0.0154 | Time: 3.0612s
Epoch 01157 | Loss: 0.0365 | Swap Loss: 0.0000 | Grad Loss: 0.2187 | Atten Loss: 0.0000 | Soft Loss: 0.0147 | Time: 3.2904s
Epoch 01158 | Loss: 0.0366 | Swap Loss: 0.0000 | Grad Loss: 0.2179 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.0600s
Epoch 01159 | Loss: 0.0373 | Swap Loss: 0.0000 | Grad Loss: 0.2225 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.2780s
F1-Score on valset:       whole 0.9722, part1 0.9724, part2 0.9720
F1-Score on testset:       whole 0.9836, part1 0.9837, part2 0.9835
Epoch 01160 | Loss: 0.0358 | Swap Loss: 0.0000 | Grad Loss: 0.2143 | Atten Loss: 0.0000 | Soft Loss: 0.0143 | Time: 3.3797s
Epoch 01161 | Loss: 0.0378 | Swap Loss: 0.0000 | Grad Loss: 0.2231 | Atten Loss: 0.0000 | Soft Loss: 0.0155 | Time: 3.4337s
Epoch 01162 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2188 | Atten Loss: 0.0000 | Soft Loss: 0.0148 | Time: 3.3783s
Epoch 01163 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2195 | Atten Loss: 0.0000 | Soft Loss: 0.0147 | Time: 3.3369s
Epoch 01164 | Loss: 0.0371 | Swap Loss: 0.0000 | Grad Loss: 0.2206 | Atten Loss: 0.0000 | Soft Loss: 0.0150 | Time: 3.1832s
F1-Score on valset:       whole 0.9722, part1 0.9726, part2 0.9719
F1-Score on testset:       whole 0.9836, part1 0.9837, part2 0.9836
Epoch 01165 | Loss: 0.0368 | Swap Loss: 0.0000 | Grad Loss: 0.2198 | Atten Loss: 0.0000 | Soft Loss: 0.0148 | Time: 3.1567s
Epoch 01166 | Loss: 0.0355 | Swap Loss: 0.0000 | Grad Loss: 0.2129 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.1290s
Epoch 01167 | Loss: 0.0365 | Swap Loss: 0.0000 | Grad Loss: 0.2183 | Atten Loss: 0.0000 | Soft Loss: 0.0147 | Time: 3.3117s
Epoch 01168 | Loss: 0.0362 | Swap Loss: 0.0000 | Grad Loss: 0.2171 | Atten Loss: 0.0000 | Soft Loss: 0.0145 | Time: 3.3147s
Epoch 01169 | Loss: 0.0362 | Swap Loss: 0.0000 | Grad Loss: 0.2177 | Atten Loss: 0.0000 | Soft Loss: 0.0145 | Time: 3.0251s
F1-Score on valset:       whole 0.9722, part1 0.9725, part2 0.9719
F1-Score on testset:       whole 0.9837, part1 0.9837, part2 0.9836
Epoch 01170 | Loss: 0.0354 | Swap Loss: 0.0000 | Grad Loss: 0.2140 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.1606s
Epoch 01171 | Loss: 0.0362 | Swap Loss: 0.0000 | Grad Loss: 0.2171 | Atten Loss: 0.0000 | Soft Loss: 0.0144 | Time: 3.4096s
Epoch 01172 | Loss: 0.0375 | Swap Loss: 0.0000 | Grad Loss: 0.2223 | Atten Loss: 0.0000 | Soft Loss: 0.0152 | Time: 3.3945s
Epoch 01173 | Loss: 0.0373 | Swap Loss: 0.0000 | Grad Loss: 0.2218 | Atten Loss: 0.0000 | Soft Loss: 0.0151 | Time: 3.3456s
Epoch 01174 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2194 | Atten Loss: 0.0000 | Soft Loss: 0.0147 | Time: 2.8448s
F1-Score on valset:       whole 0.9722, part1 0.9724, part2 0.9719
Epoch 01175 | Loss: 0.0369 | Swap Loss: 0.0000 | Grad Loss: 0.2200 | Atten Loss: 0.0000 | Soft Loss: 0.0149 | Time: 3.2251s
Epoch 01176 | Loss: 0.0356 | Swap Loss: 0.0000 | Grad Loss: 0.2142 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.4216s
Epoch 01177 | Loss: 0.0357 | Swap Loss: 0.0000 | Grad Loss: 0.2145 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.3315s
Epoch 01178 | Loss: 0.0362 | Swap Loss: 0.0000 | Grad Loss: 0.2165 | Atten Loss: 0.0000 | Soft Loss: 0.0146 | Time: 3.1263s
Epoch 01179 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2194 | Atten Loss: 0.0000 | Soft Loss: 0.0148 | Time: 3.3799s
F1-Score on valset:       whole 0.9722, part1 0.9725, part2 0.9719
F1-Score on testset:       whole 0.9837, part1 0.9838, part2 0.9836
Epoch 01180 | Loss: 0.0371 | Swap Loss: 0.0000 | Grad Loss: 0.2206 | Atten Loss: 0.0000 | Soft Loss: 0.0150 | Time: 3.4750s
Epoch 01181 | Loss: 0.0358 | Swap Loss: 0.0000 | Grad Loss: 0.2157 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.3458s
Epoch 01182 | Loss: 0.0359 | Swap Loss: 0.0000 | Grad Loss: 0.2162 | Atten Loss: 0.0000 | Soft Loss: 0.0143 | Time: 3.2350s
Epoch 01183 | Loss: 0.0359 | Swap Loss: 0.0000 | Grad Loss: 0.2154 | Atten Loss: 0.0000 | Soft Loss: 0.0143 | Time: 3.2275s
Epoch 01184 | Loss: 0.0356 | Swap Loss: 0.0000 | Grad Loss: 0.2142 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.1579s
F1-Score on valset:       whole 0.9723, part1 0.9725, part2 0.9720
F1-Score on testset:       whole 0.9837, part1 0.9837, part2 0.9837
Epoch 01185 | Loss: 0.0352 | Swap Loss: 0.0000 | Grad Loss: 0.2122 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.0819s
Epoch 01186 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2126 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.3067s
Epoch 01187 | Loss: 0.0356 | Swap Loss: 0.0000 | Grad Loss: 0.2139 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.2808s
Epoch 01188 | Loss: 0.0354 | Swap Loss: 0.0000 | Grad Loss: 0.2139 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.0987s
Epoch 01189 | Loss: 0.0359 | Swap Loss: 0.0000 | Grad Loss: 0.2157 | Atten Loss: 0.0000 | Soft Loss: 0.0143 | Time: 3.1778s
F1-Score on valset:       whole 0.9723, part1 0.9726, part2 0.9720
F1-Score on testset:       whole 0.9837, part1 0.9837, part2 0.9837
Epoch 01190 | Loss: 0.0363 | Swap Loss: 0.0000 | Grad Loss: 0.2189 | Atten Loss: 0.0000 | Soft Loss: 0.0145 | Time: 3.1735s
Epoch 01191 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2139 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.2496s
Epoch 01192 | Loss: 0.0352 | Swap Loss: 0.0000 | Grad Loss: 0.2133 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.2489s
Epoch 01193 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2134 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.2575s
Epoch 01194 | Loss: 0.0355 | Swap Loss: 0.0000 | Grad Loss: 0.2145 | Atten Loss: 0.0000 | Soft Loss: 0.0141 | Time: 3.2546s
F1-Score on valset:       whole 0.9724, part1 0.9726, part2 0.9721
F1-Score on testset:       whole 0.9838, part1 0.9837, part2 0.9839
Epoch 01195 | Loss: 0.0351 | Swap Loss: 0.0000 | Grad Loss: 0.2124 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.1415s
Epoch 01196 | Loss: 0.0368 | Swap Loss: 0.0000 | Grad Loss: 0.2205 | Atten Loss: 0.0000 | Soft Loss: 0.0147 | Time: 3.2131s
Epoch 01197 | Loss: 0.0348 | Swap Loss: 0.0000 | Grad Loss: 0.2101 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.2879s
Epoch 01198 | Loss: 0.0368 | Swap Loss: 0.0000 | Grad Loss: 0.2199 | Atten Loss: 0.0000 | Soft Loss: 0.0148 | Time: 3.5601s
Epoch 01199 | Loss: 0.0363 | Swap Loss: 0.0000 | Grad Loss: 0.2181 | Atten Loss: 0.0000 | Soft Loss: 0.0145 | Time: 3.3426s
F1-Score on valset:       whole 0.9724, part1 0.9726, part2 0.9722
F1-Score on testset:       whole 0.9837, part1 0.9837, part2 0.9837
Epoch 01200 | Loss: 0.0355 | Swap Loss: 0.0000 | Grad Loss: 0.2168 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.2702s
Epoch 01201 | Loss: 0.0369 | Swap Loss: 0.0000 | Grad Loss: 0.2263 | Atten Loss: 0.0000 | Soft Loss: 0.0143 | Time: 3.4859s
Epoch 01202 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2225 | Atten Loss: 0.0000 | Soft Loss: 0.0144 | Time: 3.3377s
Epoch 01203 | Loss: 0.0357 | Swap Loss: 0.0000 | Grad Loss: 0.2175 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.4174s
Epoch 01204 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2148 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.4433s
F1-Score on valset:       whole 0.9724, part1 0.9727, part2 0.9722
F1-Score on testset:       whole 0.9837, part1 0.9837, part2 0.9838
Epoch 01205 | Loss: 0.0367 | Swap Loss: 0.0000 | Grad Loss: 0.2202 | Atten Loss: 0.0000 | Soft Loss: 0.0146 | Time: 3.4513s
Epoch 01206 | Loss: 0.0356 | Swap Loss: 0.0000 | Grad Loss: 0.2176 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.3552s
Epoch 01207 | Loss: 0.0352 | Swap Loss: 0.0000 | Grad Loss: 0.2141 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.3013s
Epoch 01208 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2093 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.3770s
Epoch 01209 | Loss: 0.0348 | Swap Loss: 0.0000 | Grad Loss: 0.2108 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.3523s
F1-Score on valset:       whole 0.9725, part1 0.9728, part2 0.9722
F1-Score on testset:       whole 0.9838, part1 0.9839, part2 0.9838
Epoch 01210 | Loss: 0.0344 | Swap Loss: 0.0000 | Grad Loss: 0.2092 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 3.1170s
Epoch 01211 | Loss: 0.0352 | Swap Loss: 0.0000 | Grad Loss: 0.2133 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.2829s
Epoch 01212 | Loss: 0.0350 | Swap Loss: 0.0000 | Grad Loss: 0.2115 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.4108s
Epoch 01213 | Loss: 0.0344 | Swap Loss: 0.0000 | Grad Loss: 0.2100 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.4736s
Epoch 01214 | Loss: 0.0349 | Swap Loss: 0.0000 | Grad Loss: 0.2126 | Atten Loss: 0.0000 | Soft Loss: 0.0137 | Time: 3.3585s
F1-Score on valset:       whole 0.9724, part1 0.9727, part2 0.9722
Epoch 01215 | Loss: 0.0350 | Swap Loss: 0.0000 | Grad Loss: 0.2127 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.3389s
Epoch 01216 | Loss: 0.0346 | Swap Loss: 0.0000 | Grad Loss: 0.2113 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 3.3564s
Epoch 01217 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2094 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.2475s
Epoch 01218 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2140 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.1773s
Epoch 01219 | Loss: 0.0360 | Swap Loss: 0.0000 | Grad Loss: 0.2181 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.2276s
F1-Score on valset:       whole 0.9724, part1 0.9727, part2 0.9722
Epoch 01220 | Loss: 0.0346 | Swap Loss: 0.0000 | Grad Loss: 0.2122 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.2179s
Epoch 01221 | Loss: 0.0348 | Swap Loss: 0.0000 | Grad Loss: 0.2124 | Atten Loss: 0.0000 | Soft Loss: 0.0136 | Time: 3.3541s
Epoch 01222 | Loss: 0.0354 | Swap Loss: 0.0000 | Grad Loss: 0.2171 | Atten Loss: 0.0000 | Soft Loss: 0.0137 | Time: 3.2165s
Epoch 01223 | Loss: 0.0349 | Swap Loss: 0.0000 | Grad Loss: 0.2141 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 3.1092s
Epoch 01224 | Loss: 0.0350 | Swap Loss: 0.0000 | Grad Loss: 0.2152 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 2.9148s
F1-Score on valset:       whole 0.9723, part1 0.9726, part2 0.9721
Epoch 01225 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2146 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.1935s
Epoch 01226 | Loss: 0.0352 | Swap Loss: 0.0000 | Grad Loss: 0.2137 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.4047s
Epoch 01227 | Loss: 0.0348 | Swap Loss: 0.0000 | Grad Loss: 0.2133 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 3.4038s
Epoch 01228 | Loss: 0.0344 | Swap Loss: 0.0000 | Grad Loss: 0.2104 | Atten Loss: 0.0000 | Soft Loss: 0.0133 | Time: 3.1089s
Epoch 01229 | Loss: 0.0336 | Swap Loss: 0.0000 | Grad Loss: 0.2057 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.1515s
F1-Score on valset:       whole 0.9725, part1 0.9728, part2 0.9723
F1-Score on testset:       whole 0.9838, part1 0.9838, part2 0.9838
Epoch 01230 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2087 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.4393s
Epoch 01231 | Loss: 0.0338 | Swap Loss: 0.0000 | Grad Loss: 0.2068 | Atten Loss: 0.0000 | Soft Loss: 0.0131 | Time: 3.3561s
Epoch 01232 | Loss: 0.0353 | Swap Loss: 0.0000 | Grad Loss: 0.2149 | Atten Loss: 0.0000 | Soft Loss: 0.0138 | Time: 3.4685s
Epoch 01233 | Loss: 0.0345 | Swap Loss: 0.0000 | Grad Loss: 0.2115 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.1720s
Epoch 01234 | Loss: 0.0345 | Swap Loss: 0.0000 | Grad Loss: 0.2119 | Atten Loss: 0.0000 | Soft Loss: 0.0133 | Time: 3.2147s
F1-Score on valset:       whole 0.9725, part1 0.9728, part2 0.9722
Epoch 01235 | Loss: 0.0351 | Swap Loss: 0.0000 | Grad Loss: 0.2151 | Atten Loss: 0.0000 | Soft Loss: 0.0136 | Time: 3.2577s
Epoch 01236 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2102 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.1845s
Epoch 01237 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2107 | Atten Loss: 0.0000 | Soft Loss: 0.0132 | Time: 3.1284s
Epoch 01238 | Loss: 0.0361 | Swap Loss: 0.0000 | Grad Loss: 0.2189 | Atten Loss: 0.0000 | Soft Loss: 0.0142 | Time: 3.4268s
Epoch 01239 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2095 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.1853s
F1-Score on valset:       whole 0.9725, part1 0.9728, part2 0.9722
F1-Score on testset:       whole 0.9838, part1 0.9838, part2 0.9838
Epoch 01240 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2104 | Atten Loss: 0.0000 | Soft Loss: 0.0132 | Time: 3.2699s
Epoch 01241 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2092 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.3329s
Epoch 01242 | Loss: 0.0350 | Swap Loss: 0.0000 | Grad Loss: 0.2135 | Atten Loss: 0.0000 | Soft Loss: 0.0136 | Time: 3.1894s
Epoch 01243 | Loss: 0.0351 | Swap Loss: 0.0000 | Grad Loss: 0.2154 | Atten Loss: 0.0000 | Soft Loss: 0.0136 | Time: 3.2525s
Epoch 01244 | Loss: 0.0355 | Swap Loss: 0.0000 | Grad Loss: 0.2161 | Atten Loss: 0.0000 | Soft Loss: 0.0139 | Time: 3.2294s
F1-Score on valset:       whole 0.9724, part1 0.9727, part2 0.9721
Epoch 01245 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2089 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.4357s
Epoch 01246 | Loss: 0.0348 | Swap Loss: 0.0000 | Grad Loss: 0.2143 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.3101s
Epoch 01247 | Loss: 0.0358 | Swap Loss: 0.0000 | Grad Loss: 0.2180 | Atten Loss: 0.0000 | Soft Loss: 0.0140 | Time: 3.2576s
Epoch 01248 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2092 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.3994s
Epoch 01249 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2084 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.2692s
F1-Score on valset:       whole 0.9726, part1 0.9728, part2 0.9723
F1-Score on testset:       whole 0.9838, part1 0.9839, part2 0.9838
Epoch 01250 | Loss: 0.0346 | Swap Loss: 0.0000 | Grad Loss: 0.2131 | Atten Loss: 0.0000 | Soft Loss: 0.0133 | Time: 3.3172s
Epoch 01251 | Loss: 0.0336 | Swap Loss: 0.0000 | Grad Loss: 0.2070 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.3274s
Epoch 01252 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2086 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.2231s
Epoch 01253 | Loss: 0.0341 | Swap Loss: 0.0000 | Grad Loss: 0.2111 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.3935s
Epoch 01254 | Loss: 0.0333 | Swap Loss: 0.0000 | Grad Loss: 0.2060 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.3292s
F1-Score on valset:       whole 0.9727, part1 0.9729, part2 0.9725
F1-Score on testset:       whole 0.9838, part1 0.9839, part2 0.9837
Epoch 01255 | Loss: 0.0337 | Swap Loss: 0.0000 | Grad Loss: 0.2083 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.3847s
Epoch 01256 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2087 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.0852s
Epoch 01257 | Loss: 0.0333 | Swap Loss: 0.0000 | Grad Loss: 0.2058 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.3281s
Epoch 01258 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2069 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.5103s
Epoch 01259 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2090 | Atten Loss: 0.0000 | Soft Loss: 0.0131 | Time: 3.2978s
F1-Score on valset:       whole 0.9726, part1 0.9729, part2 0.9723
Epoch 01260 | Loss: 0.0336 | Swap Loss: 0.0000 | Grad Loss: 0.2073 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.1073s
Epoch 01261 | Loss: 0.0349 | Swap Loss: 0.0000 | Grad Loss: 0.2139 | Atten Loss: 0.0000 | Soft Loss: 0.0135 | Time: 3.5727s
Epoch 01262 | Loss: 0.0341 | Swap Loss: 0.0000 | Grad Loss: 0.2109 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.4004s
Epoch 01263 | Loss: 0.0337 | Swap Loss: 0.0000 | Grad Loss: 0.2099 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.2720s
Epoch 01264 | Loss: 0.0349 | Swap Loss: 0.0000 | Grad Loss: 0.2151 | Atten Loss: 0.0000 | Soft Loss: 0.0134 | Time: 3.5396s
F1-Score on valset:       whole 0.9726, part1 0.9729, part2 0.9723
Epoch 01265 | Loss: 0.0341 | Swap Loss: 0.0000 | Grad Loss: 0.2120 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.3969s
Epoch 01266 | Loss: 0.0342 | Swap Loss: 0.0000 | Grad Loss: 0.2127 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 3.5237s
Epoch 01267 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2054 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.3100s
Epoch 01268 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2119 | Atten Loss: 0.0000 | Soft Loss: 0.0131 | Time: 3.5440s
Epoch 01269 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2056 | Atten Loss: 0.0000 | Soft Loss: 0.0126 | Time: 3.3395s
F1-Score on valset:       whole 0.9727, part1 0.9729, part2 0.9724
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9840
Epoch 01270 | Loss: 0.0338 | Swap Loss: 0.0000 | Grad Loss: 0.2095 | Atten Loss: 0.0000 | Soft Loss: 0.0128 | Time: 3.0753s
Epoch 01271 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2053 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 2.8694s
Epoch 01272 | Loss: 0.0347 | Swap Loss: 0.0000 | Grad Loss: 0.2154 | Atten Loss: 0.0000 | Soft Loss: 0.0132 | Time: 3.0936s
Epoch 01273 | Loss: 0.0338 | Swap Loss: 0.0000 | Grad Loss: 0.2097 | Atten Loss: 0.0000 | Soft Loss: 0.0128 | Time: 3.4075s
Epoch 01274 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2080 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 2.9408s
F1-Score on valset:       whole 0.9727, part1 0.9729, part2 0.9724
F1-Score on testset:       whole 0.9839, part1 0.9839, part2 0.9838
Epoch 01275 | Loss: 0.0342 | Swap Loss: 0.0000 | Grad Loss: 0.2120 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.2886s
Epoch 01276 | Loss: 0.0330 | Swap Loss: 0.0000 | Grad Loss: 0.2055 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.6371s
Epoch 01277 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2105 | Atten Loss: 0.0000 | Soft Loss: 0.0129 | Time: 7.3276s
Epoch 01278 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2070 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.1771s
Epoch 01279 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2099 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.5512s
F1-Score on valset:       whole 0.9727, part1 0.9730, part2 0.9724
F1-Score on testset:       whole 0.9839, part1 0.9839, part2 0.9839
Epoch 01280 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2093 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.3647s
Epoch 01281 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2022 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.3990s
Epoch 01282 | Loss: 0.0336 | Swap Loss: 0.0000 | Grad Loss: 0.2098 | Atten Loss: 0.0000 | Soft Loss: 0.0126 | Time: 3.3511s
Epoch 01283 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2077 | Atten Loss: 0.0000 | Soft Loss: 0.0126 | Time: 3.3657s
Epoch 01284 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2082 | Atten Loss: 0.0000 | Soft Loss: 0.0127 | Time: 3.4833s
F1-Score on valset:       whole 0.9728, part1 0.9729, part2 0.9726
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9840
Epoch 01285 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2043 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.4403s
Epoch 01286 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2025 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.2893s
Epoch 01287 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2047 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.1947s
Epoch 01288 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2048 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.1327s
Epoch 01289 | Loss: 0.0345 | Swap Loss: 0.0000 | Grad Loss: 0.2127 | Atten Loss: 0.0000 | Soft Loss: 0.0132 | Time: 3.2275s
F1-Score on valset:       whole 0.9727, part1 0.9730, part2 0.9724
Epoch 01290 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2044 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.1605s
Epoch 01291 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2014 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.3095s
Epoch 01292 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2035 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.3221s
Epoch 01293 | Loss: 0.0328 | Swap Loss: 0.0000 | Grad Loss: 0.2049 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.0614s
Epoch 01294 | Loss: 0.0326 | Swap Loss: 0.0000 | Grad Loss: 0.2038 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.2461s
F1-Score on valset:       whole 0.9728, part1 0.9731, part2 0.9726
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9839
Epoch 01295 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2046 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.2608s
Epoch 01296 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2084 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.2779s
Epoch 01297 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2085 | Atten Loss: 0.0000 | Soft Loss: 0.0126 | Time: 3.3385s
Epoch 01298 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2067 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.3683s
Epoch 01299 | Loss: 0.0330 | Swap Loss: 0.0000 | Grad Loss: 0.2055 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.2211s
F1-Score on valset:       whole 0.9729, part1 0.9731, part2 0.9726
F1-Score on testset:       whole 0.9839, part1 0.9839, part2 0.9839
Epoch 01300 | Loss: 0.0326 | Swap Loss: 0.0000 | Grad Loss: 0.2043 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.2649s
Epoch 01301 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2054 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.1768s
Epoch 01302 | Loss: 0.0333 | Swap Loss: 0.0000 | Grad Loss: 0.2076 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.3697s
Epoch 01303 | Loss: 0.0346 | Swap Loss: 0.0000 | Grad Loss: 0.2150 | Atten Loss: 0.0000 | Soft Loss: 0.0131 | Time: 3.3343s
Epoch 01304 | Loss: 0.0330 | Swap Loss: 0.0000 | Grad Loss: 0.2076 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.3768s
F1-Score on valset:       whole 0.9728, part1 0.9731, part2 0.9725
Epoch 01305 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2036 | Atten Loss: 0.0000 | Soft Loss: 0.0120 | Time: 3.1842s
Epoch 01306 | Loss: 0.0340 | Swap Loss: 0.0000 | Grad Loss: 0.2118 | Atten Loss: 0.0000 | Soft Loss: 0.0128 | Time: 3.2088s
Epoch 01307 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2092 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.3432s
Epoch 01308 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2084 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.2513s
Epoch 01309 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2079 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.4991s
F1-Score on valset:       whole 0.9728, part1 0.9731, part2 0.9725
Epoch 01310 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2093 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.3781s
Epoch 01311 | Loss: 0.0330 | Swap Loss: 0.0000 | Grad Loss: 0.2067 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.3721s
Epoch 01312 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2104 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.5088s
Epoch 01313 | Loss: 0.0343 | Swap Loss: 0.0000 | Grad Loss: 0.2148 | Atten Loss: 0.0000 | Soft Loss: 0.0128 | Time: 3.3578s
Epoch 01314 | Loss: 0.0322 | Swap Loss: 0.0000 | Grad Loss: 0.2035 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.2998s
F1-Score on valset:       whole 0.9728, part1 0.9731, part2 0.9726
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9840
Epoch 01315 | Loss: 0.0328 | Swap Loss: 0.0000 | Grad Loss: 0.2065 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.4584s
Epoch 01316 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2081 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.4135s
Epoch 01317 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2094 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.1991s
Epoch 01318 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2107 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.3544s
Epoch 01319 | Loss: 0.0346 | Swap Loss: 0.0000 | Grad Loss: 0.2161 | Atten Loss: 0.0000 | Soft Loss: 0.0130 | Time: 3.5635s
F1-Score on valset:       whole 0.9726, part1 0.9729, part2 0.9723
Epoch 01320 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2080 | Atten Loss: 0.0000 | Soft Loss: 0.0123 | Time: 3.3253s
Epoch 01321 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2066 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.4387s
Epoch 01322 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2102 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.4016s
Epoch 01323 | Loss: 0.0332 | Swap Loss: 0.0000 | Grad Loss: 0.2103 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.3829s
Epoch 01324 | Loss: 0.0333 | Swap Loss: 0.0000 | Grad Loss: 0.2105 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.3391s
F1-Score on valset:       whole 0.9729, part1 0.9731, part2 0.9726
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9839
Epoch 01325 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2085 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.2272s
Epoch 01326 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2067 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.2615s
Epoch 01327 | Loss: 0.0314 | Swap Loss: 0.0000 | Grad Loss: 0.1986 | Atten Loss: 0.0000 | Soft Loss: 0.0116 | Time: 3.2425s
Epoch 01328 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2039 | Atten Loss: 0.0000 | Soft Loss: 0.0120 | Time: 3.5064s
Epoch 01329 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2023 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.1940s
F1-Score on valset:       whole 0.9729, part1 0.9732, part2 0.9726
F1-Score on testset:       whole 0.9840, part1 0.9840, part2 0.9840
Epoch 01330 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2020 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.2755s
Epoch 01331 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2020 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.3918s
Epoch 01332 | Loss: 0.0322 | Swap Loss: 0.0000 | Grad Loss: 0.2024 | Atten Loss: 0.0000 | Soft Loss: 0.0120 | Time: 3.2698s
Epoch 01333 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2027 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.2292s
Epoch 01334 | Loss: 0.0319 | Swap Loss: 0.0000 | Grad Loss: 0.2026 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.4638s
F1-Score on valset:       whole 0.9730, part1 0.9732, part2 0.9728
F1-Score on testset:       whole 0.9841, part1 0.9841, part2 0.9841
Epoch 01335 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2065 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.4566s
Epoch 01336 | Loss: 0.0331 | Swap Loss: 0.0000 | Grad Loss: 0.2088 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.3408s
Epoch 01337 | Loss: 0.0329 | Swap Loss: 0.0000 | Grad Loss: 0.2080 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.4092s
Epoch 01338 | Loss: 0.0326 | Swap Loss: 0.0000 | Grad Loss: 0.2061 | Atten Loss: 0.0000 | Soft Loss: 0.0120 | Time: 3.3663s
Epoch 01339 | Loss: 0.0335 | Swap Loss: 0.0000 | Grad Loss: 0.2091 | Atten Loss: 0.0000 | Soft Loss: 0.0125 | Time: 3.1117s
F1-Score on valset:       whole 0.9729, part1 0.9730, part2 0.9727
Epoch 01340 | Loss: 0.0322 | Swap Loss: 0.0000 | Grad Loss: 0.2038 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.3360s
Epoch 01341 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2030 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.1861s
Epoch 01342 | Loss: 0.0322 | Swap Loss: 0.0000 | Grad Loss: 0.2036 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.3176s
Epoch 01343 | Loss: 0.0330 | Swap Loss: 0.0000 | Grad Loss: 0.2083 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.4877s
Epoch 01344 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2052 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.0949s
F1-Score on valset:       whole 0.9729, part1 0.9731, part2 0.9727
Epoch 01345 | Loss: 0.0319 | Swap Loss: 0.0000 | Grad Loss: 0.2028 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.2038s
Epoch 01346 | Loss: 0.0325 | Swap Loss: 0.0000 | Grad Loss: 0.2068 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.4221s
Epoch 01347 | Loss: 0.0324 | Swap Loss: 0.0000 | Grad Loss: 0.2055 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.3686s
Epoch 01348 | Loss: 0.0334 | Swap Loss: 0.0000 | Grad Loss: 0.2100 | Atten Loss: 0.0000 | Soft Loss: 0.0124 | Time: 3.3348s
Epoch 01349 | Loss: 0.0339 | Swap Loss: 0.0000 | Grad Loss: 0.2135 | Atten Loss: 0.0000 | Soft Loss: 0.0126 | Time: 3.5821s
F1-Score on valset:       whole 0.9730, part1 0.9733, part2 0.9727
F1-Score on testset:       whole 0.9840, part1 0.9841, part2 0.9838
Epoch 01350 | Loss: 0.0328 | Swap Loss: 0.0000 | Grad Loss: 0.2078 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.6936s
Epoch 01351 | Loss: 0.0315 | Swap Loss: 0.0000 | Grad Loss: 0.2012 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.4159s
Epoch 01352 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2009 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.3918s
Epoch 01353 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2033 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.5784s
Epoch 01354 | Loss: 0.0322 | Swap Loss: 0.0000 | Grad Loss: 0.2037 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.3172s
F1-Score on valset:       whole 0.9729, part1 0.9732, part2 0.9726
F1-Score on testset:       whole 0.9841, part1 0.9841, part2 0.9840
Epoch 01355 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2031 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.3995s
Epoch 01356 | Loss: 0.0328 | Swap Loss: 0.0000 | Grad Loss: 0.2078 | Atten Loss: 0.0000 | Soft Loss: 0.0121 | Time: 3.4586s
Epoch 01357 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2036 | Atten Loss: 0.0000 | Soft Loss: 0.0116 | Time: 3.4055s
Epoch 01358 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1981 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.3831s
Epoch 01359 | Loss: 0.0317 | Swap Loss: 0.0000 | Grad Loss: 0.2004 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.2966s
F1-Score on valset:       whole 0.9731, part1 0.9733, part2 0.9728
F1-Score on testset:       whole 0.9841, part1 0.9841, part2 0.9842
Epoch 01360 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2004 | Atten Loss: 0.0000 | Soft Loss: 0.0116 | Time: 3.2748s
Epoch 01361 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1975 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.3321s
Epoch 01362 | Loss: 0.0323 | Swap Loss: 0.0000 | Grad Loss: 0.2035 | Atten Loss: 0.0000 | Soft Loss: 0.0120 | Time: 3.1688s
Epoch 01363 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.1976 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.2623s
Epoch 01364 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2025 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.3870s
F1-Score on valset:       whole 0.9730, part1 0.9732, part2 0.9729
Epoch 01365 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2015 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.3493s
Epoch 01366 | Loss: 0.0318 | Swap Loss: 0.0000 | Grad Loss: 0.2035 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.4272s
Epoch 01367 | Loss: 0.0327 | Swap Loss: 0.0000 | Grad Loss: 0.2081 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.2412s
Epoch 01368 | Loss: 0.0325 | Swap Loss: 0.0000 | Grad Loss: 0.2072 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.4866s
Epoch 01369 | Loss: 0.0312 | Swap Loss: 0.0000 | Grad Loss: 0.1996 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.2209s
F1-Score on valset:       whole 0.9730, part1 0.9732, part2 0.9728
F1-Score on testset:       whole 0.9841, part1 0.9841, part2 0.9841
Epoch 01370 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2024 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.1969s
Epoch 01371 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.1983 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.3763s
Epoch 01372 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1988 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.2936s
Epoch 01373 | Loss: 0.0328 | Swap Loss: 0.0000 | Grad Loss: 0.2065 | Atten Loss: 0.0000 | Soft Loss: 0.0122 | Time: 3.3961s
Epoch 01374 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2007 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.4113s
F1-Score on valset:       whole 0.9731, part1 0.9734, part2 0.9728
F1-Score on testset:       whole 0.9841, part1 0.9842, part2 0.9841
Epoch 01375 | Loss: 0.0323 | Swap Loss: 0.0000 | Grad Loss: 0.2052 | Atten Loss: 0.0000 | Soft Loss: 0.0118 | Time: 3.4110s
Epoch 01376 | Loss: 0.0313 | Swap Loss: 0.0000 | Grad Loss: 0.1998 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.4891s
Epoch 01377 | Loss: 0.0313 | Swap Loss: 0.0000 | Grad Loss: 0.1998 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.2626s
Epoch 01378 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2030 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.2891s
Epoch 01379 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1982 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.4195s
F1-Score on valset:       whole 0.9730, part1 0.9733, part2 0.9728
F1-Score on testset:       whole 0.9842, part1 0.9842, part2 0.9841
Epoch 01380 | Loss: 0.0312 | Swap Loss: 0.0000 | Grad Loss: 0.1994 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.3915s
Epoch 01381 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1961 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.4279s
Epoch 01382 | Loss: 0.0317 | Swap Loss: 0.0000 | Grad Loss: 0.2021 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.5844s
Epoch 01383 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.1976 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.4739s
Epoch 01384 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.1991 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.1729s
F1-Score on valset:       whole 0.9730, part1 0.9733, part2 0.9727
Epoch 01385 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2043 | Atten Loss: 0.0000 | Soft Loss: 0.0117 | Time: 3.4663s
Epoch 01386 | Loss: 0.0312 | Swap Loss: 0.0000 | Grad Loss: 0.1995 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.2910s
Epoch 01387 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.1992 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.3901s
Epoch 01388 | Loss: 0.0318 | Swap Loss: 0.0000 | Grad Loss: 0.2033 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.0409s
Epoch 01389 | Loss: 0.0325 | Swap Loss: 0.0000 | Grad Loss: 0.2057 | Atten Loss: 0.0000 | Soft Loss: 0.0119 | Time: 3.4160s
F1-Score on valset:       whole 0.9731, part1 0.9733, part2 0.9728
F1-Score on testset:       whole 0.9841, part1 0.9841, part2 0.9841
Epoch 01390 | Loss: 0.0311 | Swap Loss: 0.0000 | Grad Loss: 0.2001 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.3230s
Epoch 01391 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1969 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.3021s
Epoch 01392 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2014 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.5063s
Epoch 01393 | Loss: 0.0309 | Swap Loss: 0.0000 | Grad Loss: 0.1986 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.4170s
Epoch 01394 | Loss: 0.0314 | Swap Loss: 0.0000 | Grad Loss: 0.2009 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.4086s
F1-Score on valset:       whole 0.9731, part1 0.9734, part2 0.9729
F1-Score on testset:       whole 0.9841, part1 0.9842, part2 0.9840
Epoch 01395 | Loss: 0.0309 | Swap Loss: 0.0000 | Grad Loss: 0.1979 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.0551s
Epoch 01396 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1965 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.3738s
Epoch 01397 | Loss: 0.0302 | Swap Loss: 0.0000 | Grad Loss: 0.1940 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.2648s
Epoch 01398 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.1997 | Atten Loss: 0.0000 | Soft Loss: 0.0116 | Time: 3.3850s
Epoch 01399 | Loss: 0.0314 | Swap Loss: 0.0000 | Grad Loss: 0.2013 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.3952s
F1-Score on valset:       whole 0.9731, part1 0.9733, part2 0.9728
F1-Score on testset:       whole 0.9842, part1 0.9842, part2 0.9841
Epoch 01400 | Loss: 0.0321 | Swap Loss: 0.0000 | Grad Loss: 0.2058 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.4857s
Epoch 01401 | Loss: 0.0316 | Swap Loss: 0.0000 | Grad Loss: 0.2034 | Atten Loss: 0.0000 | Soft Loss: 0.0113 | Time: 3.4604s
Epoch 01402 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2063 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.2039s
Epoch 01403 | Loss: 0.0319 | Swap Loss: 0.0000 | Grad Loss: 0.2051 | Atten Loss: 0.0000 | Soft Loss: 0.0114 | Time: 3.2883s
Epoch 01404 | Loss: 0.0313 | Swap Loss: 0.0000 | Grad Loss: 0.2023 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.1386s
F1-Score on valset:       whole 0.9731, part1 0.9734, part2 0.9728
F1-Score on testset:       whole 0.9842, part1 0.9842, part2 0.9841
Epoch 01405 | Loss: 0.0313 | Swap Loss: 0.0000 | Grad Loss: 0.2010 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.3966s
Epoch 01406 | Loss: 0.0314 | Swap Loss: 0.0000 | Grad Loss: 0.2015 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.4241s
Epoch 01407 | Loss: 0.0315 | Swap Loss: 0.0000 | Grad Loss: 0.2035 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.2679s
Epoch 01408 | Loss: 0.0303 | Swap Loss: 0.0000 | Grad Loss: 0.1966 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.2382s
Epoch 01409 | Loss: 0.0302 | Swap Loss: 0.0000 | Grad Loss: 0.1953 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.1044s
F1-Score on valset:       whole 0.9732, part1 0.9734, part2 0.9730
F1-Score on testset:       whole 0.9842, part1 0.9843, part2 0.9842
Epoch 01410 | Loss: 0.0308 | Swap Loss: 0.0000 | Grad Loss: 0.1978 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.2859s
Epoch 01411 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1980 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.4147s
Epoch 01412 | Loss: 0.0315 | Swap Loss: 0.0000 | Grad Loss: 0.2031 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.0860s
Epoch 01413 | Loss: 0.0313 | Swap Loss: 0.0000 | Grad Loss: 0.2017 | Atten Loss: 0.0000 | Soft Loss: 0.0112 | Time: 3.5587s
Epoch 01414 | Loss: 0.0309 | Swap Loss: 0.0000 | Grad Loss: 0.1988 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.1786s
F1-Score on valset:       whole 0.9731, part1 0.9733, part2 0.9729
Epoch 01415 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1967 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.1288s
Epoch 01416 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1986 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.3829s
Epoch 01417 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1973 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.1144s
Epoch 01418 | Loss: 0.0320 | Swap Loss: 0.0000 | Grad Loss: 0.2048 | Atten Loss: 0.0000 | Soft Loss: 0.0115 | Time: 3.2509s
Epoch 01419 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1941 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.2973s
F1-Score on valset:       whole 0.9731, part1 0.9734, part2 0.9728
F1-Score on testset:       whole 0.9842, part1 0.9843, part2 0.9841
Epoch 01420 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1972 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 3.3635s
Epoch 01421 | Loss: 0.0304 | Swap Loss: 0.0000 | Grad Loss: 0.1958 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.4128s
Epoch 01422 | Loss: 0.0300 | Swap Loss: 0.0000 | Grad Loss: 0.1940 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.5712s
Epoch 01423 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1985 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.4100s
Epoch 01424 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1946 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.3863s
F1-Score on valset:       whole 0.9732, part1 0.9735, part2 0.9730
F1-Score on testset:       whole 0.9842, part1 0.9842, part2 0.9842
Epoch 01425 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1971 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 3.1811s
Epoch 01426 | Loss: 0.0308 | Swap Loss: 0.0000 | Grad Loss: 0.1979 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.2586s
Epoch 01427 | Loss: 0.0303 | Swap Loss: 0.0000 | Grad Loss: 0.1957 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 2.8790s
Epoch 01428 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1913 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.5420s
Epoch 01429 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1994 | Atten Loss: 0.0000 | Soft Loss: 0.0110 | Time: 3.5660s
F1-Score on valset:       whole 0.9732, part1 0.9736, part2 0.9728
Epoch 01430 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1943 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.4167s
Epoch 01431 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1996 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.3639s
Epoch 01432 | Loss: 0.0293 | Swap Loss: 0.0000 | Grad Loss: 0.1902 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.2620s
Epoch 01433 | Loss: 0.0310 | Swap Loss: 0.0000 | Grad Loss: 0.1993 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.3177s
Epoch 01434 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1946 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.0100s
F1-Score on valset:       whole 0.9732, part1 0.9734, part2 0.9730
Epoch 01435 | Loss: 0.0300 | Swap Loss: 0.0000 | Grad Loss: 0.1942 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 2.9557s
Epoch 01436 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1963 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.2064s
Epoch 01437 | Loss: 0.0300 | Swap Loss: 0.0000 | Grad Loss: 0.1948 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.0747s
Epoch 01438 | Loss: 0.0309 | Swap Loss: 0.0000 | Grad Loss: 0.1976 | Atten Loss: 0.0000 | Soft Loss: 0.0111 | Time: 3.2073s
Epoch 01439 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1945 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.3148s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9730
F1-Score on testset:       whole 0.9843, part1 0.9844, part2 0.9842
Epoch 01440 | Loss: 0.0304 | Swap Loss: 0.0000 | Grad Loss: 0.1956 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.5043s
Epoch 01441 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1971 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 3.5670s
Epoch 01442 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1979 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 7.1281s
Epoch 01443 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1980 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.4117s
Epoch 01444 | Loss: 0.0299 | Swap Loss: 0.0000 | Grad Loss: 0.1944 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.5013s
F1-Score on valset:       whole 0.9732, part1 0.9735, part2 0.9729
F1-Score on testset:       whole 0.9842, part1 0.9842, part2 0.9842
Epoch 01445 | Loss: 0.0302 | Swap Loss: 0.0000 | Grad Loss: 0.1954 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.4212s
Epoch 01446 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1987 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.3419s
Epoch 01447 | Loss: 0.0307 | Swap Loss: 0.0000 | Grad Loss: 0.1987 | Atten Loss: 0.0000 | Soft Loss: 0.0108 | Time: 3.2978s
Epoch 01448 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1980 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.4333s
Epoch 01449 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1951 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.2703s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9730
F1-Score on testset:       whole 0.9843, part1 0.9843, part2 0.9842
Epoch 01450 | Loss: 0.0304 | Swap Loss: 0.0000 | Grad Loss: 0.1973 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.2800s
Epoch 01451 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1964 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.2127s
Epoch 01452 | Loss: 0.0308 | Swap Loss: 0.0000 | Grad Loss: 0.1985 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 3.0802s
Epoch 01453 | Loss: 0.0298 | Swap Loss: 0.0000 | Grad Loss: 0.1937 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 2.9852s
Epoch 01454 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1964 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.0415s
F1-Score on valset:       whole 0.9734, part1 0.9736, part2 0.9731
F1-Score on testset:       whole 0.9843, part1 0.9843, part2 0.9842
Epoch 01455 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1915 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.1508s
Epoch 01456 | Loss: 0.0293 | Swap Loss: 0.0000 | Grad Loss: 0.1907 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.2422s
Epoch 01457 | Loss: 0.0298 | Swap Loss: 0.0000 | Grad Loss: 0.1931 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.1955s
Epoch 01458 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1950 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.1196s
Epoch 01459 | Loss: 0.0289 | Swap Loss: 0.0000 | Grad Loss: 0.1887 | Atten Loss: 0.0000 | Soft Loss: 0.0101 | Time: 3.0841s
F1-Score on valset:       whole 0.9733, part1 0.9735, part2 0.9730
F1-Score on testset:       whole 0.9843, part1 0.9843, part2 0.9842
Epoch 01460 | Loss: 0.0302 | Swap Loss: 0.0000 | Grad Loss: 0.1955 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.5711s
Epoch 01461 | Loss: 0.0292 | Swap Loss: 0.0000 | Grad Loss: 0.1894 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.2152s
Epoch 01462 | Loss: 0.0296 | Swap Loss: 0.0000 | Grad Loss: 0.1921 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.2449s
Epoch 01463 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1971 | Atten Loss: 0.0000 | Soft Loss: 0.0109 | Time: 3.4600s
Epoch 01464 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1946 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.4172s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9730
Epoch 01465 | Loss: 0.0297 | Swap Loss: 0.0000 | Grad Loss: 0.1936 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.2689s
Epoch 01466 | Loss: 0.0291 | Swap Loss: 0.0000 | Grad Loss: 0.1890 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.3235s
Epoch 01467 | Loss: 0.0299 | Swap Loss: 0.0000 | Grad Loss: 0.1934 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.0522s
Epoch 01468 | Loss: 0.0291 | Swap Loss: 0.0000 | Grad Loss: 0.1897 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.0473s
Epoch 01469 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1924 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.1413s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9730
F1-Score on testset:       whole 0.9843, part1 0.9844, part2 0.9842
Epoch 01470 | Loss: 0.0301 | Swap Loss: 0.0000 | Grad Loss: 0.1948 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.2262s
Epoch 01471 | Loss: 0.0299 | Swap Loss: 0.0000 | Grad Loss: 0.1939 | Atten Loss: 0.0000 | Soft Loss: 0.0105 | Time: 3.2228s
Epoch 01472 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1923 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.2384s
Epoch 01473 | Loss: 0.0300 | Swap Loss: 0.0000 | Grad Loss: 0.1953 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.4347s
Epoch 01474 | Loss: 0.0304 | Swap Loss: 0.0000 | Grad Loss: 0.1971 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.2589s
F1-Score on valset:       whole 0.9734, part1 0.9736, part2 0.9731
F1-Score on testset:       whole 0.9843, part1 0.9844, part2 0.9842
Epoch 01475 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1920 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.1285s
Epoch 01476 | Loss: 0.0298 | Swap Loss: 0.0000 | Grad Loss: 0.1940 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.3566s
Epoch 01477 | Loss: 0.0290 | Swap Loss: 0.0000 | Grad Loss: 0.1901 | Atten Loss: 0.0000 | Soft Loss: 0.0100 | Time: 3.3788s
Epoch 01478 | Loss: 0.0294 | Swap Loss: 0.0000 | Grad Loss: 0.1919 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.4163s
Epoch 01479 | Loss: 0.0297 | Swap Loss: 0.0000 | Grad Loss: 0.1940 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.5527s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9731
F1-Score on testset:       whole 0.9842, part1 0.9843, part2 0.9842
Epoch 01480 | Loss: 0.0293 | Swap Loss: 0.0000 | Grad Loss: 0.1910 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.3649s
Epoch 01481 | Loss: 0.0294 | Swap Loss: 0.0000 | Grad Loss: 0.1915 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.3558s
Epoch 01482 | Loss: 0.0294 | Swap Loss: 0.0000 | Grad Loss: 0.1913 | Atten Loss: 0.0000 | Soft Loss: 0.0103 | Time: 3.3802s
Epoch 01483 | Loss: 0.0293 | Swap Loss: 0.0000 | Grad Loss: 0.1910 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.0239s
Epoch 01484 | Loss: 0.0294 | Swap Loss: 0.0000 | Grad Loss: 0.1914 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.1917s
F1-Score on valset:       whole 0.9735, part1 0.9738, part2 0.9731
F1-Score on testset:       whole 0.9843, part1 0.9844, part2 0.9843
Epoch 01485 | Loss: 0.0297 | Swap Loss: 0.0000 | Grad Loss: 0.1927 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.4838s
Epoch 01486 | Loss: 0.0297 | Swap Loss: 0.0000 | Grad Loss: 0.1930 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.0152s
Epoch 01487 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1931 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.2343s
Epoch 01488 | Loss: 0.0289 | Swap Loss: 0.0000 | Grad Loss: 0.1889 | Atten Loss: 0.0000 | Soft Loss: 0.0100 | Time: 3.3437s
Epoch 01489 | Loss: 0.0303 | Swap Loss: 0.0000 | Grad Loss: 0.1956 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.6750s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9731
Epoch 01490 | Loss: 0.0304 | Swap Loss: 0.0000 | Grad Loss: 0.1970 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.2637s
Epoch 01491 | Loss: 0.0305 | Swap Loss: 0.0000 | Grad Loss: 0.1988 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.4429s
Epoch 01492 | Loss: 0.0293 | Swap Loss: 0.0000 | Grad Loss: 0.1923 | Atten Loss: 0.0000 | Soft Loss: 0.0101 | Time: 3.3040s
Epoch 01493 | Loss: 0.0306 | Swap Loss: 0.0000 | Grad Loss: 0.1991 | Atten Loss: 0.0000 | Soft Loss: 0.0107 | Time: 3.5060s
Epoch 01494 | Loss: 0.0302 | Swap Loss: 0.0000 | Grad Loss: 0.1979 | Atten Loss: 0.0000 | Soft Loss: 0.0104 | Time: 3.2900s
F1-Score on valset:       whole 0.9733, part1 0.9736, part2 0.9730
Epoch 01495 | Loss: 0.0297 | Swap Loss: 0.0000 | Grad Loss: 0.1949 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.2255s
Epoch 01496 | Loss: 0.0294 | Swap Loss: 0.0000 | Grad Loss: 0.1927 | Atten Loss: 0.0000 | Soft Loss: 0.0101 | Time: 3.4190s
Epoch 01497 | Loss: 0.0300 | Swap Loss: 0.0000 | Grad Loss: 0.1941 | Atten Loss: 0.0000 | Soft Loss: 0.0106 | Time: 3.3537s
Epoch 01498 | Loss: 0.0295 | Swap Loss: 0.0000 | Grad Loss: 0.1926 | Atten Loss: 0.0000 | Soft Loss: 0.0102 | Time: 3.3233s
Epoch 01499 | Loss: 0.0292 | Swap Loss: 0.0000 | Grad Loss: 0.1916 | Atten Loss: 0.0000 | Soft Loss: 0.0100 | Time: 3.3146s
F1-Score on valset:       whole 0.9734, part1 0.9737, part2 0.9731
F1-Score on testset:       whole 0.9843, part1 0.9844, part2 0.9842
Epoch 01500 | Loss: 0.0292 | Swap Loss: 0.0000 | Grad Loss: 0.1911 | Atten Loss: 0.0000 | Soft Loss: 0.0101 | Time: 3.4604s
=====================