API tools faq
paste
Advertisement
lamiastella

cub proxynca++ train run

lamiastella
Sep 14th, 2021
132
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 44.56 KB | None | 0 0
raw download clone embed print report
  1. running w CUDA 11.1
  2.  
  3. (proxy) [jalal@goku proxynca_pp]$ pwd
  4.  
  5. /scratch3/research/code/fashion/proxynca_pp
  6.  
  7. (proxy) [jalal@goku proxynca_pp]$ CUDA_VISIBLE_DEVICES=0,1 python train.py --dataset cub --config config/cub.json --mode train --apex --seed 0 --workers 12
  8. (1024, 4096)
  9. train.py:12: MatplotlibDeprecationWarning: The 'warn' parameter of use() is deprecated since Matplotlib 3.1 and will be removed in 3.3. If any parameter follows 'warn', they should be pass as keyword, not positionally.
  10. matplotlib.use('agg', warn=False, force=True)
  11. /scratch3/venv/proxy/lib/python3.8/site-packages/torch/nn/functional.py:718: UserWarning: Named tensors and all their associated APIs are an experimental feature and subject to change. Please do not use them for anything important until they are released as stable. (Triggered internally at /pytorch/c10/core/TensorImpl.h:1156.)
  12. return torch.max_pool2d(input, kernel_size, stride, padding, dilation, ceil_mode)
  13. best_epoch 40
  14. ===
  15. Selected optimization level O1: Insert automatic casts around Pytorch functions and Tensor methods.
  16.  
  17. Defaults for this optimization level are:
  18. enabled : True
  19. opt_level : O1
  20. cast_model_type : None
  21. patch_torch_functions : True
  22. keep_batchnorm_fp32 : None
  23. master_weights : None
  24. loss_scale : dynamic
  25. Processing user overrides (additional kwargs that are not None)...
  26. After processing overrides, optimization options are:
  27. enabled : True
  28. opt_level : O1
  29. cast_model_type : None
  30. patch_torch_functions : True
  31. keep_batchnorm_fp32 : None
  32. master_weights : None
  33. loss_scale : dynamic
  34. 2021-09-14 15:31:29,186 Training parameters: {'dataset': 'cub', 'config': 'config/cub.json', 'sz_embedding': 2048, 'sz_batch': 32, 'nb_epochs': 40, 'log_filename': 'cub_cub_train_0', 'nb_workers': 12, 'seed': 0, 'mode': 'train', 'lr_steps': [1000], 'source_dir': '', 'root_dir': '', 'eval_nmi': False, 'recall': [1, 2, 4, 8], 'init_eval': False, 'no_warmup': False, 'apex': True, 'warmup_k': 5}
  35. 2021-09-14 15:31:29,186 Training for 40 epochs.
  36. 90
  37. 2021-09-14 15:31:29,186 **warm up for 5 epochs.**
  38. 2021-09-14 15:31:49,340 warm up ends in 5 epochs
  39. 2021-09-14 15:32:07,282 warm up ends in 4 epochs
  40. 2021-09-14 15:32:25,363 warm up ends in 3 epochs
  41. 2021-09-14 15:32:43,324 warm up ends in 2 epochs
  42. 2021-09-14 15:33:01,336 warm up ends in 1 epochs
  43. 0.004 0.004
  44. it: 90
  45. Adam (
  46. Parameter Group 0
  47. amsgrad: False
  48. betas: (0.9, 0.999)
  49. eps: 1.0
  50. lr: 0.004
  51. weight_decay: 0
  52.  
  53. Parameter Group 1
  54. amsgrad: False
  55. betas: (0.9, 0.999)
  56. eps: 1.0
  57. lr: 0.004
  58. weight_decay: 0
  59.  
  60. Parameter Group 2
  61. amsgrad: False
  62. betas: (0.9, 0.999)
  63. eps: 1.0
  64. lr: 400.0
  65. weight_decay: 0
  66. )
  67. 2021-09-14 15:33:19,358 Epoch: 0, loss: 1.320, time (seconds): 18.02.
  68. 2021-09-14 15:33:19,359 **Validation...**
  69. done collecting prediction
  70. 2021-09-14 15:33:26,697 NMI: 100.000
  71. 2021-09-14 15:33:27,593 R@1 : 78.387
  72. 2021-09-14 15:33:27,632 R@2 : 85.210
  73. 2021-09-14 15:33:27,708 R@4 : 91.092
  74. 2021-09-14 15:33:27,748 R@8 : 95.697
  75. 2021-09-14 15:33:27,748 hmean: 0.8788392688901451
  76. 2021-09-14 15:33:27,748 Eval time: 8.39
  77. 2021-09-14 15:33:27,749 Best val epoch: 0
  78. 2021-09-14 15:33:27,749 Best val hmean: 0.8788392688901451
  79. 2021-09-14 15:33:27,749 Best val nmi: 1
  80. 2021-09-14 15:33:27,749 Best val r1: 0.7838655462184874
  81. 2021-09-14 15:33:27,749 []
  82. 0.004 0.004
  83. it: 180
  84. Adam (
  85. Parameter Group 0
  86. amsgrad: False
  87. betas: (0.9, 0.999)
  88. eps: 1.0
  89. lr: 0.004
  90. weight_decay: 0
  91.  
  92. Parameter Group 1
  93. amsgrad: False
  94. betas: (0.9, 0.999)
  95. eps: 1.0
  96. lr: 0.004
  97. weight_decay: 0
  98.  
  99. Parameter Group 2
  100. amsgrad: False
  101. betas: (0.9, 0.999)
  102. eps: 1.0
  103. lr: 400.0
  104. weight_decay: 0
  105. )
  106. 2021-09-14 15:33:45,796 Epoch: 1, loss: 1.307, time (seconds): 18.05.
  107. 2021-09-14 15:33:45,797 **Validation...**
  108. done collecting prediction
  109. 2021-09-14 15:33:53,058 NMI: 100.000
  110. 2021-09-14 15:33:53,935 R@1 : 79.227
  111. 2021-09-14 15:33:53,976 R@2 : 86.454
  112. 2021-09-14 15:33:54,054 R@4 : 91.832
  113. 2021-09-14 15:33:54,095 R@8 : 96.370
  114. 2021-09-14 15:33:54,095 hmean: 0.8840960240060016
  115. 2021-09-14 15:33:54,095 Eval time: 8.30
  116. 2021-09-14 15:33:54,096 Best val epoch: 1
  117. 2021-09-14 15:33:54,096 Best val hmean: 0.8840960240060016
  118. 2021-09-14 15:33:54,096 Best val nmi: 1
  119. 2021-09-14 15:33:54,097 Best val r1: 0.7922689075630253
  120. 2021-09-14 15:33:54,097 []
  121. 0.004 0.004
  122. it: 270
  123. Adam (
  124. Parameter Group 0
  125. amsgrad: False
  126. betas: (0.9, 0.999)
  127. eps: 1.0
  128. lr: 0.004
  129. weight_decay: 0
  130.  
  131. Parameter Group 1
  132. amsgrad: False
  133. betas: (0.9, 0.999)
  134. eps: 1.0
  135. lr: 0.004
  136. weight_decay: 0
  137.  
  138. Parameter Group 2
  139. amsgrad: False
  140. betas: (0.9, 0.999)
  141. eps: 1.0
  142. lr: 400.0
  143. weight_decay: 0
  144. )
  145. 2021-09-14 15:34:12,151 Epoch: 2, loss: 1.112, time (seconds): 18.05.
  146. 2021-09-14 15:34:12,151 **Validation...**
  147. done collecting prediction
  148. 2021-09-14 15:34:19,374 NMI: 100.000
  149. 2021-09-14 15:34:20,289 R@1 : 79.328
  150. 2021-09-14 15:34:20,329 R@2 : 87.328
  151. 2021-09-14 15:34:20,370 R@4 : 92.067
  152. 2021-09-14 15:34:20,410 R@8 : 95.966
  153. 2021-09-14 15:34:20,410 hmean: 0.8847235238987816
  154. 2021-09-14 15:34:20,410 Eval time: 8.26
  155. 2021-09-14 15:34:20,411 Best val epoch: 2
  156. 2021-09-14 15:34:20,411 Best val hmean: 0.8847235238987816
  157. 2021-09-14 15:34:20,411 Best val nmi: 1
  158. 2021-09-14 15:34:20,411 Best val r1: 0.7932773109243697
  159. 2021-09-14 15:34:20,412 []
  160. 0.004 0.004
  161. it: 360
  162. Adam (
  163. Parameter Group 0
  164. amsgrad: False
  165. betas: (0.9, 0.999)
  166. eps: 1.0
  167. lr: 0.004
  168. weight_decay: 0
  169.  
  170. Parameter Group 1
  171. amsgrad: False
  172. betas: (0.9, 0.999)
  173. eps: 1.0
  174. lr: 0.004
  175. weight_decay: 0
  176.  
  177. Parameter Group 2
  178. amsgrad: False
  179. betas: (0.9, 0.999)
  180. eps: 1.0
  181. lr: 400.0
  182. weight_decay: 0
  183. )
  184. 2021-09-14 15:34:38,466 Epoch: 3, loss: 1.010, time (seconds): 18.05.
  185. 2021-09-14 15:34:38,466 **Validation...**
  186. done collecting prediction
  187. 2021-09-14 15:34:45,685 NMI: 100.000
  188. 2021-09-14 15:34:46,601 R@1 : 80.908
  189. 2021-09-14 15:34:46,642 R@2 : 87.697
  190. 2021-09-14 15:34:46,682 R@4 : 92.773
  191. 2021-09-14 15:34:46,722 R@8 : 96.235
  192. 2021-09-14 15:34:46,722 hmean: 0.8944630248978076
  193. 2021-09-14 15:34:46,722 Eval time: 8.26
  194. 2021-09-14 15:34:46,723 Best val epoch: 3
  195. 2021-09-14 15:34:46,723 Best val hmean: 0.8944630248978076
  196. 2021-09-14 15:34:46,723 Best val nmi: 1
  197. 2021-09-14 15:34:46,723 Best val r1: 0.8090756302521008
  198. 2021-09-14 15:34:46,723 []
  199. 0.004 0.004
  200. it: 450
  201. Adam (
  202. Parameter Group 0
  203. amsgrad: False
  204. betas: (0.9, 0.999)
  205. eps: 1.0
  206. lr: 0.004
  207. weight_decay: 0
  208.  
  209. Parameter Group 1
  210. amsgrad: False
  211. betas: (0.9, 0.999)
  212. eps: 1.0
  213. lr: 0.004
  214. weight_decay: 0
  215.  
  216. Parameter Group 2
  217. amsgrad: False
  218. betas: (0.9, 0.999)
  219. eps: 1.0
  220. lr: 400.0
  221. weight_decay: 0
  222. )
  223. 2021-09-14 15:35:04,854 Epoch: 4, loss: 1.021, time (seconds): 18.13.
  224. 2021-09-14 15:35:04,854 **Validation...**
  225. done collecting prediction
  226. 2021-09-14 15:35:12,026 NMI: 100.000
  227. 2021-09-14 15:35:12,951 R@1 : 79.866
  228. 2021-09-14 15:35:12,991 R@2 : 86.790
  229. 2021-09-14 15:35:13,031 R@4 : 92.773
  230. 2021-09-14 15:35:13,070 R@8 : 96.101
  231. 2021-09-14 15:35:13,070 hmean: 0.888058306858531
  232. 2021-09-14 15:35:13,070 Eval time: 8.22
  233. 2021-09-14 15:35:13,070 Best val epoch: 3
  234. 2021-09-14 15:35:13,070 Best val hmean: 0.8944630248978076
  235. 2021-09-14 15:35:13,070 Best val nmi: 1
  236. 2021-09-14 15:35:13,070 Best val r1: 0.8090756302521008
  237. 2021-09-14 15:35:13,070 []
  238. 0.004 0.004
  239. it: 540
  240. Adam (
  241. Parameter Group 0
  242. amsgrad: False
  243. betas: (0.9, 0.999)
  244. eps: 1.0
  245. lr: 0.004
  246. weight_decay: 0
  247.  
  248. Parameter Group 1
  249. amsgrad: False
  250. betas: (0.9, 0.999)
  251. eps: 1.0
  252. lr: 0.004
  253. weight_decay: 0
  254.  
  255. Parameter Group 2
  256. amsgrad: False
  257. betas: (0.9, 0.999)
  258. eps: 1.0
  259. lr: 400.0
  260. weight_decay: 0
  261. )
  262. 2021-09-14 15:35:31,171 Epoch: 5, loss: 0.936, time (seconds): 18.10.
  263. 2021-09-14 15:35:31,172 **Validation...**
  264. done collecting prediction
  265. 2021-09-14 15:35:38,402 NMI: 100.000
  266. 2021-09-14 15:35:39,297 R@1 : 80.807
  267. 2021-09-14 15:35:39,337 R@2 : 87.765
  268. 2021-09-14 15:35:39,413 R@4 : 93.042
  269. 2021-09-14 15:35:39,453 R@8 : 96.101
  270. 2021-09-14 15:35:39,453 hmean: 0.8938464398587098
  271. 2021-09-14 15:35:39,453 Eval time: 8.28
  272. 2021-09-14 15:35:39,454 Best val epoch: 3
  273. 2021-09-14 15:35:39,454 Best val hmean: 0.8944630248978076
  274. 2021-09-14 15:35:39,455 Best val nmi: 1
  275. 2021-09-14 15:35:39,455 Best val r1: 0.8090756302521008
  276. 2021-09-14 15:35:39,455 []
  277. 0.004 0.004
  278. it: 630
  279. Adam (
  280. Parameter Group 0
  281. amsgrad: False
  282. betas: (0.9, 0.999)
  283. eps: 1.0
  284. lr: 0.004
  285. weight_decay: 0
  286.  
  287. Parameter Group 1
  288. amsgrad: False
  289. betas: (0.9, 0.999)
  290. eps: 1.0
  291. lr: 0.004
  292. weight_decay: 0
  293.  
  294. Parameter Group 2
  295. amsgrad: False
  296. betas: (0.9, 0.999)
  297. eps: 1.0
  298. lr: 400.0
  299. weight_decay: 0
  300. )
  301. 2021-09-14 15:35:57,610 Epoch: 6, loss: 0.987, time (seconds): 18.15.
  302. 2021-09-14 15:35:57,610 **Validation...**
  303. done collecting prediction
  304. 2021-09-14 15:36:04,844 NMI: 100.000
  305. 2021-09-14 15:36:05,857 R@1 : 80.807
  306. 2021-09-14 15:36:05,896 R@2 : 87.697
  307. 2021-09-14 15:36:05,935 R@4 : 92.571
  308. 2021-09-14 15:36:05,975 R@8 : 96.034
  309. 2021-09-14 15:36:05,975 hmean: 0.8938464398587098
  310. 2021-09-14 15:36:05,975 Eval time: 8.37
  311. 2021-09-14 15:36:05,975 Best val epoch: 3
  312. 2021-09-14 15:36:05,975 Best val hmean: 0.8944630248978076
  313. 2021-09-14 15:36:05,975 Best val nmi: 1
  314. 2021-09-14 15:36:05,975 Best val r1: 0.8090756302521008
  315. 2021-09-14 15:36:05,975 []
  316. 0.004 0.004
  317. it: 720
  318. Adam (
  319. Parameter Group 0
  320. amsgrad: False
  321. betas: (0.9, 0.999)
  322. eps: 1.0
  323. lr: 0.004
  324. weight_decay: 0
  325.  
  326. Parameter Group 1
  327. amsgrad: False
  328. betas: (0.9, 0.999)
  329. eps: 1.0
  330. lr: 0.004
  331. weight_decay: 0
  332.  
  333. Parameter Group 2
  334. amsgrad: False
  335. betas: (0.9, 0.999)
  336. eps: 1.0
  337. lr: 400.0
  338. weight_decay: 0
  339. )
  340. 2021-09-14 15:36:24,218 Epoch: 7, loss: 0.781, time (seconds): 18.24.
  341. 2021-09-14 15:36:24,219 **Validation...**
  342. done collecting prediction
  343. 2021-09-14 15:36:31,578 NMI: 100.000
  344. 2021-09-14 15:36:32,546 R@1 : 80.874
  345. 2021-09-14 15:36:32,586 R@2 : 88.269
  346. 2021-09-14 15:36:32,626 R@4 : 92.874
  347. 2021-09-14 15:36:32,666 R@8 : 96.303
  348. 2021-09-14 15:36:32,666 hmean: 0.8942575729418323
  349. 2021-09-14 15:36:32,666 Eval time: 8.45
  350. 2021-09-14 15:36:32,666 Best val epoch: 3
  351. 2021-09-14 15:36:32,666 Best val hmean: 0.8944630248978076
  352. 2021-09-14 15:36:32,666 Best val nmi: 1
  353. 2021-09-14 15:36:32,666 Best val r1: 0.8090756302521008
  354. 2021-09-14 15:36:32,667 []
  355. 0.004 0.004
  356. it: 810
  357. Adam (
  358. Parameter Group 0
  359. amsgrad: False
  360. betas: (0.9, 0.999)
  361. eps: 1.0
  362. lr: 0.004
  363. weight_decay: 0
  364.  
  365. Parameter Group 1
  366. amsgrad: False
  367. betas: (0.9, 0.999)
  368. eps: 1.0
  369. lr: 0.004
  370. weight_decay: 0
  371.  
  372. Parameter Group 2
  373. amsgrad: False
  374. betas: (0.9, 0.999)
  375. eps: 1.0
  376. lr: 400.0
  377. weight_decay: 0
  378. )
  379. 2021-09-14 15:36:51,128 Epoch: 8, loss: 0.868, time (seconds): 18.46.
  380. 2021-09-14 15:36:51,128 **Validation...**
  381. done collecting prediction
  382. 2021-09-14 15:36:58,477 NMI: 100.000
  383. 2021-09-14 15:36:59,487 R@1 : 80.571
  384. 2021-09-14 15:36:59,525 R@2 : 87.933
  385. 2021-09-14 15:36:59,564 R@4 : 92.739
  386. 2021-09-14 15:36:59,603 R@8 : 96.134
  387. 2021-09-14 15:36:59,603 hmean: 0.8924050632911393
  388. 2021-09-14 15:36:59,603 Eval time: 8.47
  389. 2021-09-14 15:36:59,603 Best val epoch: 3
  390. 2021-09-14 15:36:59,603 Best val hmean: 0.8944630248978076
  391. 2021-09-14 15:36:59,603 Best val nmi: 1
  392. 2021-09-14 15:36:59,603 Best val r1: 0.8090756302521008
  393. 2021-09-14 15:36:59,603 []
  394. 0.004 0.0004
  395. it: 900
  396. Adam (
  397. Parameter Group 0
  398. amsgrad: False
  399. betas: (0.9, 0.999)
  400. eps: 1.0
  401. lr: 0.0004
  402. weight_decay: 0
  403.  
  404. Parameter Group 1
  405. amsgrad: False
  406. betas: (0.9, 0.999)
  407. eps: 1.0
  408. lr: 0.0004
  409. weight_decay: 0
  410.  
  411. Parameter Group 2
  412. amsgrad: False
  413. betas: (0.9, 0.999)
  414. eps: 1.0
  415. lr: 40.0
  416. weight_decay: 0
  417. )
  418. 2021-09-14 15:37:17,977 Epoch: 9, loss: 0.755, time (seconds): 18.37.
  419. 2021-09-14 15:37:17,977 **Validation...**
  420. done collecting prediction
  421. 2021-09-14 15:37:25,254 NMI: 100.000
  422. 2021-09-14 15:37:26,131 R@1 : 81.378
  423. 2021-09-14 15:37:26,169 R@2 : 88.303
  424. 2021-09-14 15:37:26,206 R@4 : 93.042
  425. 2021-09-14 15:37:26,244 R@8 : 96.303
  426. 2021-09-14 15:37:26,244 hmean: 0.8973313565604152
  427. 2021-09-14 15:37:26,244 Eval time: 8.27
  428. 2021-09-14 15:37:26,245 Best val epoch: 9
  429. 2021-09-14 15:37:26,245 Best val hmean: 0.8973313565604152
  430. 2021-09-14 15:37:26,245 Best val nmi: 1
  431. 2021-09-14 15:37:26,245 Best val r1: 0.8137815126050421
  432. 2021-09-14 15:37:26,245 [9]
  433. 0.0004 0.0004
  434. it: 990
  435. Adam (
  436. Parameter Group 0
  437. amsgrad: False
  438. betas: (0.9, 0.999)
  439. eps: 1.0
  440. lr: 0.0004
  441. weight_decay: 0
  442.  
  443. Parameter Group 1
  444. amsgrad: False
  445. betas: (0.9, 0.999)
  446. eps: 1.0
  447. lr: 0.0004
  448. weight_decay: 0
  449.  
  450. Parameter Group 2
  451. amsgrad: False
  452. betas: (0.9, 0.999)
  453. eps: 1.0
  454. lr: 40.0
  455. weight_decay: 0
  456. )
  457. 2021-09-14 15:37:44,627 Epoch: 10, loss: 0.733, time (seconds): 18.38.
  458. 2021-09-14 15:37:44,627 **Validation...**
  459. done collecting prediction
  460. 2021-09-14 15:37:51,932 NMI: 100.000
  461. 2021-09-14 15:37:52,816 R@1 : 80.941
  462. 2021-09-14 15:37:52,856 R@2 : 87.966
  463. 2021-09-14 15:37:52,933 R@4 : 92.706
  464. 2021-09-14 15:37:52,973 R@8 : 96.303
  465. 2021-09-14 15:37:52,973 hmean: 0.8946684005201561
  466. 2021-09-14 15:37:52,973 Eval time: 8.35
  467. 2021-09-14 15:37:52,974 Best val epoch: 9
  468. 2021-09-14 15:37:52,974 Best val hmean: 0.8973313565604152
  469. 2021-09-14 15:37:52,974 Best val nmi: 1
  470. 2021-09-14 15:37:52,974 Best val r1: 0.8137815126050421
  471. 2021-09-14 15:37:52,974 [9]
  472. 0.0004 0.0004
  473. it: 1080
  474. Adam (
  475. Parameter Group 0
  476. amsgrad: False
  477. betas: (0.9, 0.999)
  478. eps: 1.0
  479. lr: 0.0004
  480. weight_decay: 0
  481.  
  482. Parameter Group 1
  483. amsgrad: False
  484. betas: (0.9, 0.999)
  485. eps: 1.0
  486. lr: 0.0004
  487. weight_decay: 0
  488.  
  489. Parameter Group 2
  490. amsgrad: False
  491. betas: (0.9, 0.999)
  492. eps: 1.0
  493. lr: 40.0
  494. weight_decay: 0
  495. )
  496. 2021-09-14 15:38:11,371 Epoch: 11, loss: 0.768, time (seconds): 18.40.
  497. 2021-09-14 15:38:11,371 **Validation...**
  498. done collecting prediction
  499. 2021-09-14 15:38:18,555 NMI: 100.000
  500. 2021-09-14 15:38:19,468 R@1 : 80.773
  501. 2021-09-14 15:38:19,508 R@2 : 88.067
  502. 2021-09-14 15:38:19,548 R@4 : 92.908
  503. 2021-09-14 15:38:19,588 R@8 : 96.269
  504. 2021-09-14 15:38:19,588 hmean: 0.8936407586463369
  505. 2021-09-14 15:38:19,588 Eval time: 8.22
  506. 2021-09-14 15:38:19,589 Best val epoch: 9
  507. 2021-09-14 15:38:19,589 Best val hmean: 0.8973313565604152
  508. 2021-09-14 15:38:19,589 Best val nmi: 1
  509. 2021-09-14 15:38:19,589 Best val r1: 0.8137815126050421
  510. 2021-09-14 15:38:19,589 [9]
  511. 0.0004 0.0004
  512. it: 1170
  513. Adam (
  514. Parameter Group 0
  515. amsgrad: False
  516. betas: (0.9, 0.999)
  517. eps: 1.0
  518. lr: 0.0004
  519. weight_decay: 0
  520.  
  521. Parameter Group 1
  522. amsgrad: False
  523. betas: (0.9, 0.999)
  524. eps: 1.0
  525. lr: 0.0004
  526. weight_decay: 0
  527.  
  528. Parameter Group 2
  529. amsgrad: False
  530. betas: (0.9, 0.999)
  531. eps: 1.0
  532. lr: 40.0
  533. weight_decay: 0
  534. )
  535. 2021-09-14 15:38:38,186 Epoch: 12, loss: 0.748, time (seconds): 18.60.
  536. 2021-09-14 15:38:38,186 **Validation...**
  537. done collecting prediction
  538. 2021-09-14 15:38:45,601 NMI: 100.000
  539. 2021-09-14 15:38:46,511 R@1 : 81.109
  540. 2021-09-14 15:38:46,549 R@2 : 88.034
  541. 2021-09-14 15:38:46,587 R@4 : 93.042
  542. 2021-09-14 15:38:46,625 R@8 : 96.403
  543. 2021-09-14 15:38:46,625 hmean: 0.8956941351150705
  544. 2021-09-14 15:38:46,625 Eval time: 8.44
  545. 2021-09-14 15:38:46,626 Best val epoch: 9
  546. 2021-09-14 15:38:46,627 Best val hmean: 0.8973313565604152
  547. 2021-09-14 15:38:46,627 Best val nmi: 1
  548. 2021-09-14 15:38:46,627 Best val r1: 0.8137815126050421
  549. 2021-09-14 15:38:46,627 [9]
  550. 0.0004 0.0004
  551. it: 1260
  552. Adam (
  553. Parameter Group 0
  554. amsgrad: False
  555. betas: (0.9, 0.999)
  556. eps: 1.0
  557. lr: 0.0004
  558. weight_decay: 0
  559.  
  560. Parameter Group 1
  561. amsgrad: False
  562. betas: (0.9, 0.999)
  563. eps: 1.0
  564. lr: 0.0004
  565. weight_decay: 0
  566.  
  567. Parameter Group 2
  568. amsgrad: False
  569. betas: (0.9, 0.999)
  570. eps: 1.0
  571. lr: 40.0
  572. weight_decay: 0
  573. )
  574. 2021-09-14 15:39:04,822 Epoch: 13, loss: 0.674, time (seconds): 18.19.
  575. 2021-09-14 15:39:04,822 **Validation...**
  576. done collecting prediction
  577. 2021-09-14 15:39:12,070 NMI: 100.000
  578. 2021-09-14 15:39:12,960 R@1 : 80.471
  579. 2021-09-14 15:39:12,998 R@2 : 87.731
  580. 2021-09-14 15:39:13,036 R@4 : 93.076
  581. 2021-09-14 15:39:13,074 R@8 : 96.303
  582. 2021-09-14 15:39:13,074 hmean: 0.8917861799217731
  583. 2021-09-14 15:39:13,074 Eval time: 8.25
  584. 2021-09-14 15:39:13,075 Best val epoch: 9
  585. 2021-09-14 15:39:13,075 Best val hmean: 0.8973313565604152
  586. 2021-09-14 15:39:13,075 Best val nmi: 1
  587. 2021-09-14 15:39:13,075 Best val r1: 0.8137815126050421
  588. 2021-09-14 15:39:13,075 [9]
  589. 0.0004 0.0004
  590. it: 1350
  591. Adam (
  592. Parameter Group 0
  593. amsgrad: False
  594. betas: (0.9, 0.999)
  595. eps: 1.0
  596. lr: 0.0004
  597. weight_decay: 0
  598.  
  599. Parameter Group 1
  600. amsgrad: False
  601. betas: (0.9, 0.999)
  602. eps: 1.0
  603. lr: 0.0004
  604. weight_decay: 0
  605.  
  606. Parameter Group 2
  607. amsgrad: False
  608. betas: (0.9, 0.999)
  609. eps: 1.0
  610. lr: 40.0
  611. weight_decay: 0
  612. )
  613. 2021-09-14 15:39:31,257 Epoch: 14, loss: 0.887, time (seconds): 18.18.
  614. 2021-09-14 15:39:31,257 **Validation...**
  615. done collecting prediction
  616. 2021-09-14 15:39:38,584 NMI: 100.000
  617. 2021-09-14 15:39:39,485 R@1 : 80.807
  618. 2021-09-14 15:39:39,523 R@2 : 88.067
  619. 2021-09-14 15:39:39,561 R@4 : 92.874
  620. 2021-09-14 15:39:39,599 R@8 : 96.336
  621. 2021-09-14 15:39:39,599 hmean: 0.8938464398587098
  622. 2021-09-14 15:39:39,599 Eval time: 8.34
  623. 2021-09-14 15:39:39,599 Best val epoch: 9
  624. 2021-09-14 15:39:39,599 Best val hmean: 0.8973313565604152
  625. 2021-09-14 15:39:39,600 Best val nmi: 1
  626. 2021-09-14 15:39:39,600 Best val r1: 0.8137815126050421
  627. 2021-09-14 15:39:39,600 [9]
  628. 0.0004 4e-05
  629. it: 1440
  630. Adam (
  631. Parameter Group 0
  632. amsgrad: False
  633. betas: (0.9, 0.999)
  634. eps: 1.0
  635. lr: 4e-05
  636. weight_decay: 0
  637.  
  638. Parameter Group 1
  639. amsgrad: False
  640. betas: (0.9, 0.999)
  641. eps: 1.0
  642. lr: 4e-05
  643. weight_decay: 0
  644.  
  645. Parameter Group 2
  646. amsgrad: False
  647. betas: (0.9, 0.999)
  648. eps: 1.0
  649. lr: 4.0
  650. weight_decay: 0
  651. )
  652. 2021-09-14 15:39:57,927 Epoch: 15, loss: 0.667, time (seconds): 18.33.
  653. 2021-09-14 15:39:57,927 **Validation...**
  654. done collecting prediction
  655. 2021-09-14 15:40:05,214 NMI: 100.000
  656. 2021-09-14 15:40:06,108 R@1 : 81.546
  657. 2021-09-14 15:40:06,146 R@2 : 88.168
  658. 2021-09-14 15:40:06,184 R@4 : 92.908
  659. 2021-09-14 15:40:06,222 R@8 : 96.471
  660. 2021-09-14 15:40:06,222 hmean: 0.8983521570079616
  661. 2021-09-14 15:40:06,222 Eval time: 8.29
  662. 2021-09-14 15:40:06,222 Best val epoch: 15
  663. 2021-09-14 15:40:06,222 Best val hmean: 0.8983521570079616
  664. 2021-09-14 15:40:06,222 Best val nmi: 1
  665. 2021-09-14 15:40:06,222 Best val r1: 0.8154621848739496
  666. 2021-09-14 15:40:06,222 [9, 15]
  667. 4e-05 4e-05
  668. it: 1530
  669. Adam (
  670. Parameter Group 0
  671. amsgrad: False
  672. betas: (0.9, 0.999)
  673. eps: 1.0
  674. lr: 4e-05
  675. weight_decay: 0
  676.  
  677. Parameter Group 1
  678. amsgrad: False
  679. betas: (0.9, 0.999)
  680. eps: 1.0
  681. lr: 4e-05
  682. weight_decay: 0
  683.  
  684. Parameter Group 2
  685. amsgrad: False
  686. betas: (0.9, 0.999)
  687. eps: 1.0
  688. lr: 4.0
  689. weight_decay: 0
  690. )
  691. 2021-09-14 15:40:24,240 Epoch: 16, loss: 0.797, time (seconds): 18.02.
  692. 2021-09-14 15:40:24,241 **Validation...**
  693. done collecting prediction
  694. 2021-09-14 15:40:31,358 NMI: 100.000
  695. 2021-09-14 15:40:32,286 R@1 : 81.782
  696. 2021-09-14 15:40:32,327 R@2 : 88.303
  697. 2021-09-14 15:40:32,366 R@4 : 92.941
  698. 2021-09-14 15:40:32,406 R@8 : 96.437
  699. 2021-09-14 15:40:32,406 hmean: 0.8997781065088757
  700. 2021-09-14 15:40:32,407 Eval time: 8.17
  701. 2021-09-14 15:40:32,407 Best val epoch: 16
  702. 2021-09-14 15:40:32,407 Best val hmean: 0.8997781065088757
  703. 2021-09-14 15:40:32,407 Best val nmi: 1
  704. 2021-09-14 15:40:32,407 Best val r1: 0.8178151260504202
  705. 2021-09-14 15:40:32,407 [9, 15]
  706. 4e-05 4e-05
  707. it: 1620
  708. Adam (
  709. Parameter Group 0
  710. amsgrad: False
  711. betas: (0.9, 0.999)
  712. eps: 1.0
  713. lr: 4e-05
  714. weight_decay: 0
  715.  
  716. Parameter Group 1
  717. amsgrad: False
  718. betas: (0.9, 0.999)
  719. eps: 1.0
  720. lr: 4e-05
  721. weight_decay: 0
  722.  
  723. Parameter Group 2
  724. amsgrad: False
  725. betas: (0.9, 0.999)
  726. eps: 1.0
  727. lr: 4.0
  728. weight_decay: 0
  729. )
  730. 2021-09-14 15:40:50,689 Epoch: 17, loss: 0.681, time (seconds): 18.28.
  731. 2021-09-14 15:40:50,690 **Validation...**
  732. done collecting prediction
  733. 2021-09-14 15:40:58,040 NMI: 100.000
  734. 2021-09-14 15:40:59,173 R@1 : 81.176
  735. 2021-09-14 15:40:59,213 R@2 : 87.966
  736. 2021-09-14 15:40:59,253 R@4 : 93.076
  737. 2021-09-14 15:40:59,293 R@8 : 96.538
  738. 2021-09-14 15:40:59,293 hmean: 0.8961038961038961
  739. 2021-09-14 15:40:59,293 Eval time: 8.60
  740. 2021-09-14 15:40:59,294 Best val epoch: 16
  741. 2021-09-14 15:40:59,295 Best val hmean: 0.8997781065088757
  742. 2021-09-14 15:40:59,295 Best val nmi: 1
  743. 2021-09-14 15:40:59,295 Best val r1: 0.8178151260504202
  744. 2021-09-14 15:40:59,295 [9, 15]
  745. 4e-05 4e-05
  746. it: 1710
  747. Adam (
  748. Parameter Group 0
  749. amsgrad: False
  750. betas: (0.9, 0.999)
  751. eps: 1.0
  752. lr: 4e-05
  753. weight_decay: 0
  754.  
  755. Parameter Group 1
  756. amsgrad: False
  757. betas: (0.9, 0.999)
  758. eps: 1.0
  759. lr: 4e-05
  760. weight_decay: 0
  761.  
  762. Parameter Group 2
  763. amsgrad: False
  764. betas: (0.9, 0.999)
  765. eps: 1.0
  766. lr: 4.0
  767. weight_decay: 0
  768. )
  769. 2021-09-14 15:41:17,696 Epoch: 18, loss: 0.732, time (seconds): 18.40.
  770. 2021-09-14 15:41:17,696 **Validation...**
  771. done collecting prediction
  772. 2021-09-14 15:41:25,207 NMI: 100.000
  773. 2021-09-14 15:41:26,472 R@1 : 81.311
  774. 2021-09-14 15:41:26,513 R@2 : 87.832
  775. 2021-09-14 15:41:26,553 R@4 : 93.042
  776. 2021-09-14 15:41:26,593 R@8 : 96.403
  777. 2021-09-14 15:41:26,593 hmean: 0.8969225064886911
  778. 2021-09-14 15:41:26,593 Eval time: 8.90
  779. 2021-09-14 15:41:26,594 Best val epoch: 16
  780. 2021-09-14 15:41:26,594 Best val hmean: 0.8997781065088757
  781. 2021-09-14 15:41:26,594 Best val nmi: 1
  782. 2021-09-14 15:41:26,594 Best val r1: 0.8178151260504202
  783. 2021-09-14 15:41:26,594 [9, 15]
  784. 4e-05 4e-05
  785. Gradient overflow. Skipping step, loss scaler 0 reducing loss scale to 65536.0
  786. it: 1800
  787. Adam (
  788. Parameter Group 0
  789. amsgrad: False
  790. betas: (0.9, 0.999)
  791. eps: 1.0
  792. lr: 4e-05
  793. weight_decay: 0
  794.  
  795. Parameter Group 1
  796. amsgrad: False
  797. betas: (0.9, 0.999)
  798. eps: 1.0
  799. lr: 4e-05
  800. weight_decay: 0
  801.  
  802. Parameter Group 2
  803. amsgrad: False
  804. betas: (0.9, 0.999)
  805. eps: 1.0
  806. lr: 4.0
  807. weight_decay: 0
  808. )
  809. 2021-09-14 15:41:45,308 Epoch: 19, loss: 0.827, time (seconds): 18.71.
  810. 2021-09-14 15:41:45,308 **Validation...**
  811. done collecting prediction
  812. 2021-09-14 15:41:52,614 NMI: 100.000
  813. 2021-09-14 15:41:53,741 R@1 : 81.176
  814. 2021-09-14 15:41:53,781 R@2 : 87.966
  815. 2021-09-14 15:41:53,821 R@4 : 93.109
  816. 2021-09-14 15:41:53,860 R@8 : 96.437
  817. 2021-09-14 15:41:53,860 hmean: 0.8961038961038961
  818. 2021-09-14 15:41:53,860 Eval time: 8.55
  819. 2021-09-14 15:41:53,861 Best val epoch: 16
  820. 2021-09-14 15:41:53,861 Best val hmean: 0.8997781065088757
  821. 2021-09-14 15:41:53,861 Best val nmi: 1
  822. 2021-09-14 15:41:53,861 Best val r1: 0.8178151260504202
  823. 2021-09-14 15:41:53,861 [9, 15]
  824. 4e-05 4e-05
  825. it: 1890
  826. Adam (
  827. Parameter Group 0
  828. amsgrad: False
  829. betas: (0.9, 0.999)
  830. eps: 1.0
  831. lr: 4e-05
  832. weight_decay: 0
  833.  
  834. Parameter Group 1
  835. amsgrad: False
  836. betas: (0.9, 0.999)
  837. eps: 1.0
  838. lr: 4e-05
  839. weight_decay: 0
  840.  
  841. Parameter Group 2
  842. amsgrad: False
  843. betas: (0.9, 0.999)
  844. eps: 1.0
  845. lr: 4.0
  846. weight_decay: 0
  847. )
  848. 2021-09-14 15:42:12,802 Epoch: 20, loss: 0.766, time (seconds): 18.94.
  849. 2021-09-14 15:42:12,802 **Validation...**
  850. done collecting prediction
  851. 2021-09-14 15:42:20,243 NMI: 100.000
  852. 2021-09-14 15:42:21,218 R@1 : 81.277
  853. 2021-09-14 15:42:21,258 R@2 : 87.966
  854. 2021-09-14 15:42:21,335 R@4 : 93.042
  855. 2021-09-14 15:42:21,377 R@8 : 96.269
  856. 2021-09-14 15:42:21,377 hmean: 0.896717967735954
  857. 2021-09-14 15:42:21,377 Eval time: 8.57
  858. 2021-09-14 15:42:21,377 Best val epoch: 16
  859. 2021-09-14 15:42:21,377 Best val hmean: 0.8997781065088757
  860. 2021-09-14 15:42:21,377 Best val nmi: 1
  861. 2021-09-14 15:42:21,378 Best val r1: 0.8178151260504202
  862. 2021-09-14 15:42:21,378 [9, 15]
  863. 4e-05 4e-05
  864. it: 1980
  865. Adam (
  866. Parameter Group 0
  867. amsgrad: False
  868. betas: (0.9, 0.999)
  869. eps: 1.0
  870. lr: 4e-05
  871. weight_decay: 0
  872.  
  873. Parameter Group 1
  874. amsgrad: False
  875. betas: (0.9, 0.999)
  876. eps: 1.0
  877. lr: 4e-05
  878. weight_decay: 0
  879.  
  880. Parameter Group 2
  881. amsgrad: False
  882. betas: (0.9, 0.999)
  883. eps: 1.0
  884. lr: 4.0
  885. weight_decay: 0
  886. )
  887. 2021-09-14 15:42:40,025 Epoch: 21, loss: 0.685, time (seconds): 18.65.
  888. 2021-09-14 15:42:40,025 **Validation...**
  889. done collecting prediction
  890. 2021-09-14 15:42:47,683 NMI: 100.000
  891. 2021-09-14 15:42:48,811 R@1 : 81.479
  892. 2021-09-14 15:42:48,852 R@2 : 88.168
  893. 2021-09-14 15:42:48,893 R@4 : 93.445
  894. 2021-09-14 15:42:48,935 R@8 : 96.605
  895. 2021-09-14 15:42:48,935 hmean: 0.8979440637155028
  896. 2021-09-14 15:42:48,935 Eval time: 8.91
  897. 2021-09-14 15:42:48,935 Best val epoch: 16
  898. 2021-09-14 15:42:48,935 Best val hmean: 0.8997781065088757
  899. 2021-09-14 15:42:48,935 Best val nmi: 1
  900. 2021-09-14 15:42:48,936 Best val r1: 0.8178151260504202
  901. 2021-09-14 15:42:48,936 [9, 15]
  902. 4e-05 4.000000000000001e-06
  903. it: 2070
  904. Adam (
  905. Parameter Group 0
  906. amsgrad: False
  907. betas: (0.9, 0.999)
  908. eps: 1.0
  909. lr: 4.000000000000001e-06
  910. weight_decay: 0
  911.  
  912. Parameter Group 1
  913. amsgrad: False
  914. betas: (0.9, 0.999)
  915. eps: 1.0
  916. lr: 4.000000000000001e-06
  917. weight_decay: 0
  918.  
  919. Parameter Group 2
  920. amsgrad: False
  921. betas: (0.9, 0.999)
  922. eps: 1.0
  923. lr: 0.4
  924. weight_decay: 0
  925. )
  926. 2021-09-14 15:43:07,512 Epoch: 22, loss: 0.755, time (seconds): 18.58.
  927. 2021-09-14 15:43:07,513 **Validation...**
  928. done collecting prediction
  929. 2021-09-14 15:43:14,926 NMI: 100.000
  930. 2021-09-14 15:43:15,850 R@1 : 81.176
  931. 2021-09-14 15:43:15,890 R@2 : 87.933
  932. 2021-09-14 15:43:15,930 R@4 : 93.311
  933. 2021-09-14 15:43:15,971 R@8 : 96.403
  934. 2021-09-14 15:43:15,971 hmean: 0.8961038961038961
  935. 2021-09-14 15:43:15,971 Eval time: 8.46
  936. 2021-09-14 15:43:15,971 Best val epoch: 16
  937. 2021-09-14 15:43:15,971 Best val hmean: 0.8997781065088757
  938. 2021-09-14 15:43:15,971 Best val nmi: 1
  939. 2021-09-14 15:43:15,971 Best val r1: 0.8178151260504202
  940. 2021-09-14 15:43:15,971 [9, 15, 22]
  941. 4.000000000000001e-06 4.000000000000001e-06
  942. it: 2160
  943. Adam (
  944. Parameter Group 0
  945. amsgrad: False
  946. betas: (0.9, 0.999)
  947. eps: 1.0
  948. lr: 4.000000000000001e-06
  949. weight_decay: 0
  950.  
  951. Parameter Group 1
  952. amsgrad: False
  953. betas: (0.9, 0.999)
  954. eps: 1.0
  955. lr: 4.000000000000001e-06
  956. weight_decay: 0
  957.  
  958. Parameter Group 2
  959. amsgrad: False
  960. betas: (0.9, 0.999)
  961. eps: 1.0
  962. lr: 0.4
  963. weight_decay: 0
  964. )
  965. 2021-09-14 15:43:34,531 Epoch: 23, loss: 0.824, time (seconds): 18.56.
  966. 2021-09-14 15:43:34,531 **Validation...**
  967. done collecting prediction
  968. 2021-09-14 15:43:41,855 NMI: 100.000
  969. 2021-09-14 15:43:42,946 R@1 : 81.345
  970. 2021-09-14 15:43:42,986 R@2 : 87.966
  971. 2021-09-14 15:43:43,027 R@4 : 93.244
  972. 2021-09-14 15:43:43,067 R@8 : 96.101
  973. 2021-09-14 15:43:43,067 hmean: 0.897126969416126
  974. 2021-09-14 15:43:43,067 Eval time: 8.54
  975. 2021-09-14 15:43:43,068 Best val epoch: 16
  976. 2021-09-14 15:43:43,068 Best val hmean: 0.8997781065088757
  977. 2021-09-14 15:43:43,068 Best val nmi: 1
  978. 2021-09-14 15:43:43,068 Best val r1: 0.8178151260504202
  979. 2021-09-14 15:43:43,068 [9, 15, 22]
  980. 4.000000000000001e-06 4.000000000000001e-06
  981. it: 2250
  982. Adam (
  983. Parameter Group 0
  984. amsgrad: False
  985. betas: (0.9, 0.999)
  986. eps: 1.0
  987. lr: 4.000000000000001e-06
  988. weight_decay: 0
  989.  
  990. Parameter Group 1
  991. amsgrad: False
  992. betas: (0.9, 0.999)
  993. eps: 1.0
  994. lr: 4.000000000000001e-06
  995. weight_decay: 0
  996.  
  997. Parameter Group 2
  998. amsgrad: False
  999. betas: (0.9, 0.999)
  1000. eps: 1.0
  1001. lr: 0.4
  1002. weight_decay: 0
  1003. )
  1004. 2021-09-14 15:44:01,217 Epoch: 24, loss: 0.819, time (seconds): 18.15.
  1005. 2021-09-14 15:44:01,217 **Validation...**
  1006. done collecting prediction
  1007. 2021-09-14 15:44:08,579 NMI: 100.000
  1008. 2021-09-14 15:44:09,533 R@1 : 81.378
  1009. 2021-09-14 15:44:09,572 R@2 : 88.067
  1010. 2021-09-14 15:44:09,610 R@4 : 92.975
  1011. 2021-09-14 15:44:09,648 R@8 : 96.538
  1012. 2021-09-14 15:44:09,649 hmean: 0.8973313565604152
  1013. 2021-09-14 15:44:09,649 Eval time: 8.43
  1014. 2021-09-14 15:44:09,650 Best val epoch: 16
  1015. 2021-09-14 15:44:09,650 Best val hmean: 0.8997781065088757
  1016. 2021-09-14 15:44:09,650 Best val nmi: 1
  1017. 2021-09-14 15:44:09,650 Best val r1: 0.8178151260504202
  1018. 2021-09-14 15:44:09,650 [9, 15, 22]
  1019. 4.000000000000001e-06 4.000000000000001e-06
  1020. it: 2340
  1021. Adam (
  1022. Parameter Group 0
  1023. amsgrad: False
  1024. betas: (0.9, 0.999)
  1025. eps: 1.0
  1026. lr: 4.000000000000001e-06
  1027. weight_decay: 0
  1028.  
  1029. Parameter Group 1
  1030. amsgrad: False
  1031. betas: (0.9, 0.999)
  1032. eps: 1.0
  1033. lr: 4.000000000000001e-06
  1034. weight_decay: 0
  1035.  
  1036. Parameter Group 2
  1037. amsgrad: False
  1038. betas: (0.9, 0.999)
  1039. eps: 1.0
  1040. lr: 0.4
  1041. weight_decay: 0
  1042. )
  1043. 2021-09-14 15:44:27,945 Epoch: 25, loss: 0.788, time (seconds): 18.29.
  1044. 2021-09-14 15:44:27,945 **Validation...**
  1045. done collecting prediction
  1046. 2021-09-14 15:44:35,123 NMI: 100.000
  1047. 2021-09-14 15:44:36,056 R@1 : 81.479
  1048. 2021-09-14 15:44:36,096 R@2 : 87.798
  1049. 2021-09-14 15:44:36,136 R@4 : 93.109
  1050. 2021-09-14 15:44:36,176 R@8 : 96.336
  1051. 2021-09-14 15:44:36,176 hmean: 0.8979440637155028
  1052. 2021-09-14 15:44:36,176 Eval time: 8.23
  1053. 2021-09-14 15:44:36,176 Best val epoch: 16
  1054. 2021-09-14 15:44:36,176 Best val hmean: 0.8997781065088757
  1055. 2021-09-14 15:44:36,176 Best val nmi: 1
  1056. 2021-09-14 15:44:36,176 Best val r1: 0.8178151260504202
  1057. 2021-09-14 15:44:36,176 [9, 15, 22]
  1058. 4.000000000000001e-06 4.000000000000001e-06
  1059. it: 2430
  1060. Adam (
  1061. Parameter Group 0
  1062. amsgrad: False
  1063. betas: (0.9, 0.999)
  1064. eps: 1.0
  1065. lr: 4.000000000000001e-06
  1066. weight_decay: 0
  1067.  
  1068. Parameter Group 1
  1069. amsgrad: False
  1070. betas: (0.9, 0.999)
  1071. eps: 1.0
  1072. lr: 4.000000000000001e-06
  1073. weight_decay: 0
  1074.  
  1075. Parameter Group 2
  1076. amsgrad: False
  1077. betas: (0.9, 0.999)
  1078. eps: 1.0
  1079. lr: 0.4
  1080. weight_decay: 0
  1081. )
  1082. 2021-09-14 15:44:54,340 Epoch: 26, loss: 0.765, time (seconds): 18.16.
  1083. 2021-09-14 15:44:54,340 **Validation...**
  1084. done collecting prediction
  1085. 2021-09-14 15:45:01,659 NMI: 100.000
  1086. 2021-09-14 15:45:02,596 R@1 : 81.546
  1087. 2021-09-14 15:45:02,636 R@2 : 88.370
  1088. 2021-09-14 15:45:02,676 R@4 : 93.042
  1089. 2021-09-14 15:45:02,716 R@8 : 96.336
  1090. 2021-09-14 15:45:02,716 hmean: 0.8983521570079616
  1091. 2021-09-14 15:45:02,716 Eval time: 8.38
  1092. 2021-09-14 15:45:02,716 Best val epoch: 16
  1093. 2021-09-14 15:45:02,716 Best val hmean: 0.8997781065088757
  1094. 2021-09-14 15:45:02,716 Best val nmi: 1
  1095. 2021-09-14 15:45:02,716 Best val r1: 0.8178151260504202
  1096. 2021-09-14 15:45:02,716 [9, 15, 22]
  1097. 4.000000000000001e-06 4.000000000000001e-07
  1098. it: 2520
  1099. Adam (
  1100. Parameter Group 0
  1101. amsgrad: False
  1102. betas: (0.9, 0.999)
  1103. eps: 1.0
  1104. lr: 4.000000000000001e-07
  1105. weight_decay: 0
  1106.  
  1107. Parameter Group 1
  1108. amsgrad: False
  1109. betas: (0.9, 0.999)
  1110. eps: 1.0
  1111. lr: 4.000000000000001e-07
  1112. weight_decay: 0
  1113.  
  1114. Parameter Group 2
  1115. amsgrad: False
  1116. betas: (0.9, 0.999)
  1117. eps: 1.0
  1118. lr: 0.04000000000000001
  1119. weight_decay: 0
  1120. )
  1121. 2021-09-14 15:45:20,921 Epoch: 27, loss: 0.755, time (seconds): 18.20.
  1122. 2021-09-14 15:45:20,921 **Validation...**
  1123. done collecting prediction
  1124. 2021-09-14 15:45:28,399 NMI: 100.000
  1125. 2021-09-14 15:45:29,288 R@1 : 81.513
  1126. 2021-09-14 15:45:29,328 R@2 : 88.067
  1127. 2021-09-14 15:45:29,368 R@4 : 93.109
  1128. 2021-09-14 15:45:29,408 R@8 : 96.370
  1129. 2021-09-14 15:45:29,408 hmean: 0.8981481481481481
  1130. 2021-09-14 15:45:29,408 Eval time: 8.49
  1131. 2021-09-14 15:45:29,408 Best val epoch: 16
  1132. 2021-09-14 15:45:29,408 Best val hmean: 0.8997781065088757
  1133. 2021-09-14 15:45:29,408 Best val nmi: 1
  1134. 2021-09-14 15:45:29,408 Best val r1: 0.8178151260504202
  1135. 2021-09-14 15:45:29,408 [9, 15, 22, 27]
  1136. 4.000000000000001e-07 4.000000000000001e-07
  1137. it: 2610
  1138. Adam (
  1139. Parameter Group 0
  1140. amsgrad: False
  1141. betas: (0.9, 0.999)
  1142. eps: 1.0
  1143. lr: 4.000000000000001e-07
  1144. weight_decay: 0
  1145.  
  1146. Parameter Group 1
  1147. amsgrad: False
  1148. betas: (0.9, 0.999)
  1149. eps: 1.0
  1150. lr: 4.000000000000001e-07
  1151. weight_decay: 0
  1152.  
  1153. Parameter Group 2
  1154. amsgrad: False
  1155. betas: (0.9, 0.999)
  1156. eps: 1.0
  1157. lr: 0.04000000000000001
  1158. weight_decay: 0
  1159. )
  1160. 2021-09-14 15:45:47,778 Epoch: 28, loss: 0.762, time (seconds): 18.37.
  1161. 2021-09-14 15:45:47,778 **Validation...**
  1162. done collecting prediction
  1163. 2021-09-14 15:45:55,173 NMI: 100.000
  1164. 2021-09-14 15:45:56,090 R@1 : 81.513
  1165. 2021-09-14 15:45:56,130 R@2 : 87.832
  1166. 2021-09-14 15:45:56,169 R@4 : 92.941
  1167. 2021-09-14 15:45:56,209 R@8 : 96.269
  1168. 2021-09-14 15:45:56,209 hmean: 0.8981481481481481
  1169. 2021-09-14 15:45:56,209 Eval time: 8.43
  1170. 2021-09-14 15:45:56,209 Best val epoch: 16
  1171. 2021-09-14 15:45:56,209 Best val hmean: 0.8997781065088757
  1172. 2021-09-14 15:45:56,209 Best val nmi: 1
  1173. 2021-09-14 15:45:56,209 Best val r1: 0.8178151260504202
  1174. 2021-09-14 15:45:56,209 [9, 15, 22, 27]
  1175. 4.000000000000001e-07 4.000000000000001e-07
  1176. it: 2700
  1177. Adam (
  1178. Parameter Group 0
  1179. amsgrad: False
  1180. betas: (0.9, 0.999)
  1181. eps: 1.0
  1182. lr: 4.000000000000001e-07
  1183. weight_decay: 0
  1184.  
  1185. Parameter Group 1
  1186. amsgrad: False
  1187. betas: (0.9, 0.999)
  1188. eps: 1.0
  1189. lr: 4.000000000000001e-07
  1190. weight_decay: 0
  1191.  
  1192. Parameter Group 2
  1193. amsgrad: False
  1194. betas: (0.9, 0.999)
  1195. eps: 1.0
  1196. lr: 0.04000000000000001
  1197. weight_decay: 0
  1198. )
  1199. 2021-09-14 15:46:14,510 Epoch: 29, loss: 0.745, time (seconds): 18.30.
  1200. 2021-09-14 15:46:14,510 **Validation...**
  1201. done collecting prediction
  1202. 2021-09-14 15:46:21,755 NMI: 100.000
  1203. 2021-09-14 15:46:22,688 R@1 : 80.975
  1204. 2021-09-14 15:46:22,730 R@2 : 87.597
  1205. 2021-09-14 15:46:22,771 R@4 : 93.042
  1206. 2021-09-14 15:46:22,812 R@8 : 96.538
  1207. 2021-09-14 15:46:22,812 hmean: 0.8948736998514115
  1208. 2021-09-14 15:46:22,812 Eval time: 8.30
  1209. 2021-09-14 15:46:22,812 Best val epoch: 16
  1210. 2021-09-14 15:46:22,812 Best val hmean: 0.8997781065088757
  1211. 2021-09-14 15:46:22,812 Best val nmi: 1
  1212. 2021-09-14 15:46:22,812 Best val r1: 0.8178151260504202
  1213. 2021-09-14 15:46:22,812 [9, 15, 22, 27]
  1214. 4.000000000000001e-07 4.000000000000001e-07
  1215. it: 2790
  1216. Adam (
  1217. Parameter Group 0
  1218. amsgrad: False
  1219. betas: (0.9, 0.999)
  1220. eps: 1.0
  1221. lr: 4.000000000000001e-07
  1222. weight_decay: 0
  1223.  
  1224. Parameter Group 1
  1225. amsgrad: False
  1226. betas: (0.9, 0.999)
  1227. eps: 1.0
  1228. lr: 4.000000000000001e-07
  1229. weight_decay: 0
  1230.  
  1231. Parameter Group 2
  1232. amsgrad: False
  1233. betas: (0.9, 0.999)
  1234. eps: 1.0
  1235. lr: 0.04000000000000001
  1236. weight_decay: 0
  1237. )
  1238. 2021-09-14 15:46:42,180 Epoch: 30, loss: 0.677, time (seconds): 19.37.
  1239. 2021-09-14 15:46:42,180 **Validation...**
  1240. done collecting prediction
  1241. 2021-09-14 15:46:49,730 NMI: 100.000
  1242. 2021-09-14 15:46:50,758 R@1 : 81.008
  1243. 2021-09-14 15:46:50,800 R@2 : 88.000
  1244. 2021-09-14 15:46:50,840 R@4 : 93.277
  1245. 2021-09-14 15:46:50,881 R@8 : 96.370
  1246. 2021-09-14 15:46:50,881 hmean: 0.8950789229340761
  1247. 2021-09-14 15:46:50,881 Eval time: 8.70
  1248. 2021-09-14 15:46:50,882 Best val epoch: 16
  1249. 2021-09-14 15:46:50,882 Best val hmean: 0.8997781065088757
  1250. 2021-09-14 15:46:50,882 Best val nmi: 1
  1251. 2021-09-14 15:46:50,882 Best val r1: 0.8178151260504202
  1252. 2021-09-14 15:46:50,882 [9, 15, 22, 27]
  1253. 4.000000000000001e-07 4.000000000000001e-07
  1254. it: 2880
  1255. Adam (
  1256. Parameter Group 0
  1257. amsgrad: False
  1258. betas: (0.9, 0.999)
  1259. eps: 1.0
  1260. lr: 4.000000000000001e-07
  1261. weight_decay: 0
  1262.  
  1263. Parameter Group 1
  1264. amsgrad: False
  1265. betas: (0.9, 0.999)
  1266. eps: 1.0
  1267. lr: 4.000000000000001e-07
  1268. weight_decay: 0
  1269.  
  1270. Parameter Group 2
  1271. amsgrad: False
  1272. betas: (0.9, 0.999)
  1273. eps: 1.0
  1274. lr: 0.04000000000000001
  1275. weight_decay: 0
  1276. )
  1277. 2021-09-14 15:47:09,836 Epoch: 31, loss: 0.731, time (seconds): 18.95.
  1278. 2021-09-14 15:47:09,836 **Validation...**
  1279. done collecting prediction
  1280. 2021-09-14 15:47:17,502 NMI: 100.000
  1281. 2021-09-14 15:47:18,400 R@1 : 81.244
  1282. 2021-09-14 15:47:18,441 R@2 : 88.067
  1283. 2021-09-14 15:47:18,480 R@4 : 93.076
  1284. 2021-09-14 15:47:18,520 R@8 : 96.403
  1285. 2021-09-14 15:47:18,520 hmean: 0.896513353115727
  1286. 2021-09-14 15:47:18,521 Eval time: 8.68
  1287. 2021-09-14 15:47:18,522 Best val epoch: 16
  1288. 2021-09-14 15:47:18,522 Best val hmean: 0.8997781065088757
  1289. 2021-09-14 15:47:18,522 Best val nmi: 1
  1290. 2021-09-14 15:47:18,522 Best val r1: 0.8178151260504202
  1291. 2021-09-14 15:47:18,522 [9, 15, 22, 27]
  1292. 4.000000000000001e-07 4.0000000000000014e-08
  1293. it: 2970
  1294. Adam (
  1295. Parameter Group 0
  1296. amsgrad: False
  1297. betas: (0.9, 0.999)
  1298. eps: 1.0
  1299. lr: 4.0000000000000014e-08
  1300. weight_decay: 0
  1301.  
  1302. Parameter Group 1
  1303. amsgrad: False
  1304. betas: (0.9, 0.999)
  1305. eps: 1.0
  1306. lr: 4.0000000000000014e-08
  1307. weight_decay: 0
  1308.  
  1309. Parameter Group 2
  1310. amsgrad: False
  1311. betas: (0.9, 0.999)
  1312. eps: 1.0
  1313. lr: 0.004000000000000001
  1314. weight_decay: 0
  1315. )
  1316. 2021-09-14 15:47:37,259 Epoch: 32, loss: 0.709, time (seconds): 18.74.
  1317. 2021-09-14 15:47:37,259 **Validation...**
  1318. done collecting prediction
  1319. 2021-09-14 15:47:44,815 NMI: 100.000
  1320. 2021-09-14 15:47:45,771 R@1 : 81.210
  1321. 2021-09-14 15:47:45,811 R@2 : 88.303
  1322. 2021-09-14 15:47:45,852 R@4 : 93.412
  1323. 2021-09-14 15:47:45,892 R@8 : 96.403
  1324. 2021-09-14 15:47:45,892 hmean: 0.8963086625857911
  1325. 2021-09-14 15:47:45,892 Eval time: 8.63
  1326. 2021-09-14 15:47:45,893 Best val epoch: 16
  1327. 2021-09-14 15:47:45,894 Best val hmean: 0.8997781065088757
  1328. 2021-09-14 15:47:45,894 Best val nmi: 1
  1329. 2021-09-14 15:47:45,894 Best val r1: 0.8178151260504202
  1330. 2021-09-14 15:47:45,894 [9, 15, 22, 27, 32]
  1331. 4.0000000000000014e-08 4.0000000000000014e-08
  1332. it: 3060
  1333. Adam (
  1334. Parameter Group 0
  1335. amsgrad: False
  1336. betas: (0.9, 0.999)
  1337. eps: 1.0
  1338. lr: 4.0000000000000014e-08
  1339. weight_decay: 0
  1340.  
  1341. Parameter Group 1
  1342. amsgrad: False
  1343. betas: (0.9, 0.999)
  1344. eps: 1.0
  1345. lr: 4.0000000000000014e-08
  1346. weight_decay: 0
  1347.  
  1348. Parameter Group 2
  1349. amsgrad: False
  1350. betas: (0.9, 0.999)
  1351. eps: 1.0
  1352. lr: 0.004000000000000001
  1353. weight_decay: 0
  1354. )
  1355. 2021-09-14 15:48:05,102 Epoch: 33, loss: 0.840, time (seconds): 19.21.
  1356. 2021-09-14 15:48:05,102 **Validation...**
  1357. done collecting prediction
  1358. 2021-09-14 15:48:12,688 NMI: 100.000
  1359. 2021-09-14 15:48:13,614 R@1 : 81.277
  1360. 2021-09-14 15:48:13,652 R@2 : 87.630
  1361. 2021-09-14 15:48:13,690 R@4 : 93.008
  1362. 2021-09-14 15:48:13,729 R@8 : 96.403
  1363. 2021-09-14 15:48:13,729 hmean: 0.896717967735954
  1364. 2021-09-14 15:48:13,729 Eval time: 8.63
  1365. 2021-09-14 15:48:13,730 Best val epoch: 16
  1366. 2021-09-14 15:48:13,730 Best val hmean: 0.8997781065088757
  1367. 2021-09-14 15:48:13,730 Best val nmi: 1
  1368. 2021-09-14 15:48:13,730 Best val r1: 0.8178151260504202
  1369. 2021-09-14 15:48:13,730 [9, 15, 22, 27, 32]
  1370. 4.0000000000000014e-08 4.0000000000000014e-08
  1371. it: 3150
  1372. Adam (
  1373. Parameter Group 0
  1374. amsgrad: False
  1375. betas: (0.9, 0.999)
  1376. eps: 1.0
  1377. lr: 4.0000000000000014e-08
  1378. weight_decay: 0
  1379.  
  1380. Parameter Group 1
  1381. amsgrad: False
  1382. betas: (0.9, 0.999)
  1383. eps: 1.0
  1384. lr: 4.0000000000000014e-08
  1385. weight_decay: 0
  1386.  
  1387. Parameter Group 2
  1388. amsgrad: False
  1389. betas: (0.9, 0.999)
  1390. eps: 1.0
  1391. lr: 0.004000000000000001
  1392. weight_decay: 0
  1393. )
  1394. 2021-09-14 15:48:32,067 Epoch: 34, loss: 0.787, time (seconds): 18.34.
  1395. 2021-09-14 15:48:32,067 **Validation...**
  1396. done collecting prediction
  1397. 2021-09-14 15:48:39,650 NMI: 100.000
  1398. 2021-09-14 15:48:40,735 R@1 : 81.076
  1399. 2021-09-14 15:48:40,775 R@2 : 87.933
  1400. 2021-09-14 15:48:40,816 R@4 : 92.975
  1401. 2021-09-14 15:48:40,855 R@8 : 96.471
  1402. 2021-09-14 15:48:40,856 hmean: 0.8954891405234825
  1403. 2021-09-14 15:48:40,856 Eval time: 8.79
  1404. 2021-09-14 15:48:40,856 Best val epoch: 16
  1405. 2021-09-14 15:48:40,856 Best val hmean: 0.8997781065088757
  1406. 2021-09-14 15:48:40,856 Best val nmi: 1
  1407. 2021-09-14 15:48:40,856 Best val r1: 0.8178151260504202
  1408. 2021-09-14 15:48:40,856 [9, 15, 22, 27, 32]
  1409. 4.0000000000000014e-08 4.0000000000000014e-08
  1410. it: 3240
  1411. Adam (
  1412. Parameter Group 0
  1413. amsgrad: False
  1414. betas: (0.9, 0.999)
  1415. eps: 1.0
  1416. lr: 4.0000000000000014e-08
  1417. weight_decay: 0
  1418.  
  1419. Parameter Group 1
  1420. amsgrad: False
  1421. betas: (0.9, 0.999)
  1422. eps: 1.0
  1423. lr: 4.0000000000000014e-08
  1424. weight_decay: 0
  1425.  
  1426. Parameter Group 2
  1427. amsgrad: False
  1428. betas: (0.9, 0.999)
  1429. eps: 1.0
  1430. lr: 0.004000000000000001
  1431. weight_decay: 0
  1432. )
  1433. 2021-09-14 15:48:59,369 Epoch: 35, loss: 0.692, time (seconds): 18.51.
  1434. 2021-09-14 15:48:59,369 **Validation...**
  1435. done collecting prediction
  1436. 2021-09-14 15:49:06,660 NMI: 100.000
  1437. 2021-09-14 15:49:07,579 R@1 : 80.874
  1438. 2021-09-14 15:49:07,619 R@2 : 87.832
  1439. 2021-09-14 15:49:07,659 R@4 : 92.874
  1440. 2021-09-14 15:49:07,699 R@8 : 96.269
  1441. 2021-09-14 15:49:07,700 hmean: 0.8942575729418323
  1442. 2021-09-14 15:49:07,700 Eval time: 8.33
  1443. 2021-09-14 15:49:07,700 Best val epoch: 16
  1444. 2021-09-14 15:49:07,700 Best val hmean: 0.8997781065088757
  1445. 2021-09-14 15:49:07,700 Best val nmi: 1
  1446. 2021-09-14 15:49:07,700 Best val r1: 0.8178151260504202
  1447. 2021-09-14 15:49:07,700 [9, 15, 22, 27, 32]
  1448. 4.0000000000000014e-08 4.0000000000000014e-08
  1449. it: 3330
  1450. Adam (
  1451. Parameter Group 0
  1452. amsgrad: False
  1453. betas: (0.9, 0.999)
  1454. eps: 1.0
  1455. lr: 4.0000000000000014e-08
  1456. weight_decay: 0
  1457.  
  1458. Parameter Group 1
  1459. amsgrad: False
  1460. betas: (0.9, 0.999)
  1461. eps: 1.0
  1462. lr: 4.0000000000000014e-08
  1463. weight_decay: 0
  1464.  
  1465. Parameter Group 2
  1466. amsgrad: False
  1467. betas: (0.9, 0.999)
  1468. eps: 1.0
  1469. lr: 0.004000000000000001
  1470. weight_decay: 0
  1471. )
  1472. 2021-09-14 15:49:26,121 Epoch: 36, loss: 0.691, time (seconds): 18.42.
  1473. 2021-09-14 15:49:26,121 **Validation...**
  1474. done collecting prediction
  1475. 2021-09-14 15:49:33,421 NMI: 100.000
  1476. 2021-09-14 15:49:34,407 R@1 : 81.176
  1477. 2021-09-14 15:49:34,447 R@2 : 88.034
  1478. 2021-09-14 15:49:34,488 R@4 : 93.109
  1479. 2021-09-14 15:49:34,529 R@8 : 96.336
  1480. 2021-09-14 15:49:34,529 hmean: 0.8961038961038961
  1481. 2021-09-14 15:49:34,529 Eval time: 8.41
  1482. 2021-09-14 15:49:34,530 Best val epoch: 16
  1483. 2021-09-14 15:49:34,530 Best val hmean: 0.8997781065088757
  1484. 2021-09-14 15:49:34,530 Best val nmi: 1
  1485. 2021-09-14 15:49:34,530 Best val r1: 0.8178151260504202
  1486. 2021-09-14 15:49:34,530 [9, 15, 22, 27, 32]
  1487. 4.0000000000000014e-08 4.000000000000002e-09
  1488. it: 3420
  1489. Adam (
  1490. Parameter Group 0
  1491. amsgrad: False
  1492. betas: (0.9, 0.999)
  1493. eps: 1.0
  1494. lr: 4.000000000000002e-09
  1495. weight_decay: 0
  1496.  
  1497. Parameter Group 1
  1498. amsgrad: False
  1499. betas: (0.9, 0.999)
  1500. eps: 1.0
  1501. lr: 4.000000000000002e-09
  1502. weight_decay: 0
  1503.  
  1504. Parameter Group 2
  1505. amsgrad: False
  1506. betas: (0.9, 0.999)
  1507. eps: 1.0
  1508. lr: 0.00040000000000000013
  1509. weight_decay: 0
  1510. )
  1511. 2021-09-14 15:49:52,989 Epoch: 37, loss: 0.811, time (seconds): 18.46.
  1512. 2021-09-14 15:49:52,990 **Validation...**
  1513. done collecting prediction
  1514. 2021-09-14 15:50:00,352 NMI: 100.000
  1515. 2021-09-14 15:50:01,311 R@1 : 81.076
  1516. 2021-09-14 15:50:01,351 R@2 : 87.664
  1517. 2021-09-14 15:50:01,391 R@4 : 93.143
  1518. 2021-09-14 15:50:01,432 R@8 : 96.471
  1519. 2021-09-14 15:50:01,432 hmean: 0.8954891405234825
  1520. 2021-09-14 15:50:01,432 Eval time: 8.44
  1521. 2021-09-14 15:50:01,433 Best val epoch: 16
  1522. 2021-09-14 15:50:01,433 Best val hmean: 0.8997781065088757
  1523. 2021-09-14 15:50:01,433 Best val nmi: 1
  1524. 2021-09-14 15:50:01,433 Best val r1: 0.8178151260504202
  1525. 2021-09-14 15:50:01,433 [9, 15, 22, 27, 32, 37]
  1526. 4.000000000000002e-09 4.000000000000002e-09
  1527. it: 3510
  1528. Adam (
  1529. Parameter Group 0
  1530. amsgrad: False
  1531. betas: (0.9, 0.999)
  1532. eps: 1.0
  1533. lr: 4.000000000000002e-09
  1534. weight_decay: 0
  1535.  
  1536. Parameter Group 1
  1537. amsgrad: False
  1538. betas: (0.9, 0.999)
  1539. eps: 1.0
  1540. lr: 4.000000000000002e-09
  1541. weight_decay: 0
  1542.  
  1543. Parameter Group 2
  1544. amsgrad: False
  1545. betas: (0.9, 0.999)
  1546. eps: 1.0
  1547. lr: 0.00040000000000000013
  1548. weight_decay: 0
  1549. )
  1550. 2021-09-14 15:50:19,806 Epoch: 38, loss: 0.731, time (seconds): 18.37.
  1551. 2021-09-14 15:50:19,807 **Validation...**
  1552. done collecting prediction
  1553. 2021-09-14 15:50:27,175 NMI: 100.000
  1554. 2021-09-14 15:50:28,225 R@1 : 81.109
  1555. 2021-09-14 15:50:28,266 R@2 : 88.067
  1556. 2021-09-14 15:50:28,307 R@4 : 93.345
  1557. 2021-09-14 15:50:28,348 R@8 : 96.403
  1558. 2021-09-14 15:50:28,348 hmean: 0.8956941351150705
  1559. 2021-09-14 15:50:28,348 Eval time: 8.54
  1560. 2021-09-14 15:50:28,348 Best val epoch: 16
  1561. 2021-09-14 15:50:28,348 Best val hmean: 0.8997781065088757
  1562. 2021-09-14 15:50:28,348 Best val nmi: 1
  1563. 2021-09-14 15:50:28,348 Best val r1: 0.8178151260504202
  1564. 2021-09-14 15:50:28,348 [9, 15, 22, 27, 32, 37]
  1565. 4.000000000000002e-09 4.000000000000002e-09
  1566. it: 3600
  1567. Adam (
  1568. Parameter Group 0
  1569. amsgrad: False
  1570. betas: (0.9, 0.999)
  1571. eps: 1.0
  1572. lr: 4.000000000000002e-09
  1573. weight_decay: 0
  1574.  
  1575. Parameter Group 1
  1576. amsgrad: False
  1577. betas: (0.9, 0.999)
  1578. eps: 1.0
  1579. lr: 4.000000000000002e-09
  1580. weight_decay: 0
  1581.  
  1582. Parameter Group 2
  1583. amsgrad: False
  1584. betas: (0.9, 0.999)
  1585. eps: 1.0
  1586. lr: 0.00040000000000000013
  1587. weight_decay: 0
  1588. )
  1589. 2021-09-14 15:50:46,873 Epoch: 39, loss: 0.903, time (seconds): 18.52.
  1590. 2021-09-14 15:50:46,874 **Validation...**
  1591. done collecting prediction
  1592. 2021-09-14 15:50:54,384 NMI: 100.000
  1593. 2021-09-14 15:50:55,323 R@1 : 81.681
  1594. 2021-09-14 15:50:55,362 R@2 : 88.000
  1595. 2021-09-14 15:50:55,402 R@4 : 92.672
  1596. 2021-09-14 15:50:55,441 R@8 : 96.471
  1597. 2021-09-14 15:50:55,441 hmean: 0.8991674375578168
  1598. 2021-09-14 15:50:55,441 Eval time: 8.57
  1599. 2021-09-14 15:50:55,442 Best val epoch: 16
  1600. 2021-09-14 15:50:55,442 Best val hmean: 0.8997781065088757
  1601. 2021-09-14 15:50:55,442 Best val nmi: 1
  1602. 2021-09-14 15:50:55,442 Best val r1: 0.8178151260504202
  1603. 2021-09-14 15:50:55,442 [9, 15, 22, 27, 32, 37]
  1604. lr_steps [9, 15, 22, 27, 32, 37]
  1605. 2021-09-14 15:50:55,443 Total training time (minutes): 19.44.
  1606.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!