API tools faq
paste
oktavpua

Untitled

oktavpua
Sep 8th, 2020 (edited)
41
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 22.67 KB | None | 0 0
raw download clone embed print report
  1. Sep 7 16:25:44 epyc0 python3: Connected to https://epyc0:5000
  2. Sep 7 16:25:44 epyc0 python3: 2020-09-07 16:25:44,599 - blockflow - INFO - Project 50 - Processing instance 164757 at node 361/Compute (35), episode 52
  3. Sep 7 16:25:45 epyc0 python3: 2020-09-07 16:25:45,026 - blockflow - INFO - Project 50 - Processing instance 164758 at node 308/Compute (28), episode 52
  4. Sep 7 16:25:45 epyc0 python3: 2020-09-07 16:25:45,577 - blockflow - INFO - Project 50 - Processing instance 164759 at node 283/Split files, episode 52
  5. Sep 7 16:25:45 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133494 InitPrio=4294820241 usec=2279
  6. Sep 7 16:25:45 epyc0 python3: 2020-09-07 16:25:45,699 - blockflow - INFO - Project 50 - Instance 164757: Submitted batch job 133494
  7. Sep 7 16:25:45 epyc0 slurmctld[6132]: sched: Allocate JobId=133494 NodeList=epyc-node003 #CPUs=8 Partition=debug
  8. Sep 7 16:25:46 epyc0 python3: 2020-09-07 16:25:46,140 - blockflow - INFO - Project 50 - Processing instance 164760 at node 361/Compute (35), episode 52
  9. Sep 7 16:25:46 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133495 InitPrio=4294820240 usec=873
  10. Sep 7 16:25:46 epyc0 python3: 2020-09-07 16:25:46,285 - blockflow - INFO - Project 50 - Instance 164758: Submitted batch job 133495
  11. Sep 7 16:25:46 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133496 InitPrio=4294820189 usec=551
  12. Sep 7 16:25:46 epyc0 python3: 2020-09-07 16:25:46,737 - blockflow - INFO - Project 50 - Instance 164759: Submitted batch job 133496
  13. Sep 7 16:25:46 epyc0 python3: 2020-09-07 16:25:46,761 - blockflow - INFO - Project 50 - Processing instance 164761 at node 308/Compute (28), episode 52
  14. Sep 7 16:25:47 epyc0 python3: 2020-09-07 16:25:47,370 - blockflow - INFO - Project 50 - Processing instance 164762 at node 283/Split files, episode 52
  15. Sep 7 16:25:47 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133497 InitPrio=4294820238 usec=857
  16. Sep 7 16:25:47 epyc0 python3: 2020-09-07 16:25:47,437 - blockflow - INFO - Project 50 - Instance 164760: Submitted batch job 133497
  17. Sep 7 16:25:47 epyc0 python3: 2020-09-07 16:25:47,884 - blockflow - INFO - Project 50 - Processing instance 164763 at node 361/Compute (35), episode 52
  18. Sep 7 16:25:48 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133498 InitPrio=4294820237 usec=796
  19. Sep 7 16:25:48 epyc0 python3: 2020-09-07 16:25:48,054 - blockflow - INFO - Project 50 - Instance 164761: Submitted batch job 133498
  20. Sep 7 16:25:48 epyc0 python3: 2020-09-07 16:25:48,436 - blockflow - INFO - Project 50 - Processing instance 164764 at node 308/Compute (28), episode 52
  21. Sep 7 16:25:48 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133499 InitPrio=4294820186 usec=1066
  22. Sep 7 16:25:48 epyc0 python3: 2020-09-07 16:25:48,649 - blockflow - INFO - Project 50 - Instance 164762: Submitted batch job 133499
  23. Sep 7 16:25:48 epyc0 slurmctld[6132]: sched: Allocate JobId=133495 NodeList=epyc-node001 #CPUs=16 Partition=debug
  24. Sep 7 16:25:48 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133500 InitPrio=4294820235 usec=711
  25. Sep 7 16:25:48 epyc0 python3: 2020-09-07 16:25:48,923 - blockflow - INFO - Project 50 - Instance 164763: Submitted batch job 133500
  26. Sep 7 16:25:49 epyc0 python3: 2020-09-07 16:25:49,034 - blockflow - INFO - Project 50 - Processing instance 164765 at node 283/Split files, episode 52
  27. Sep 7 16:25:49 epyc0 python3: 2020-09-07 16:25:49,541 - blockflow - INFO - Project 50 - Processing instance 164766 at node 361/Compute (35), episode 52
  28. Sep 7 16:25:49 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133501 InitPrio=4294820234 usec=884
  29. Sep 7 16:25:49 epyc0 python3: 2020-09-07 16:25:49,748 - blockflow - INFO - Project 50 - Instance 164764: Submitted batch job 133501
  30. Sep 7 16:25:50 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133502 InitPrio=4294820183 usec=679
  31. Sep 7 16:25:50 epyc0 python3: 2020-09-07 16:25:50,445 - blockflow - INFO - Project 50 - Instance 164765: Submitted batch job 133502
  32. Sep 7 16:25:50 epyc0 python3: 2020-09-07 16:25:50,508 - blockflow - INFO - Project 50 - Processing instance 164767 at node 308/Compute (28), episode 52
  33. Sep 7 16:25:50 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133503 InitPrio=4294820232 usec=823
  34. Sep 7 16:25:50 epyc0 python3: 2020-09-07 16:25:50,931 - blockflow - INFO - Project 50 - Instance 164766: Submitted batch job 133503
  35. Sep 7 16:25:51 epyc0 python3: 2020-09-07 16:25:51,338 - blockflow - INFO - Project 50 - Processing instance 164768 at node 283/Split files, episode 52
  36. Sep 7 16:25:52 epyc0 python3: 2020-09-07 16:25:52,096 - blockflow - INFO - Project 50 - Processing instance 164769 at node 361/Compute (35), episode 52
  37. Sep 7 16:25:52 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133504 InitPrio=4294820231 usec=1145
  38. Sep 7 16:25:52 epyc0 python3: 2020-09-07 16:25:52,646 - blockflow - INFO - Project 50 - Processing instance 164770 at node 308/Compute (28), episode 52
  39. Sep 7 16:25:52 epyc0 python3: 2020-09-07 16:25:52,671 - blockflow - INFO - Project 50 - Instance 164767: Submitted batch job 133504
  40. Sep 7 16:25:52 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133505 InitPrio=4294820180 usec=676
  41. Sep 7 16:25:52 epyc0 python3: 2020-09-07 16:25:52,949 - blockflow - INFO - Project 50 - Instance 164768: Submitted batch job 133505
  42. Sep 7 16:25:53 epyc0 python3: 2020-09-07 16:25:53,330 - blockflow - INFO - Project 50 - Processing instance 164771 at node 283/Split files, episode 52
  43. Sep 7 16:25:53 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133506 InitPrio=4294820229 usec=714
  44. Sep 7 16:25:53 epyc0 python3: 2020-09-07 16:25:53,364 - blockflow - INFO - Project 50 - Instance 164769: Submitted batch job 133506
  45. Sep 7 16:25:53 epyc0 python3: 2020-09-07 16:25:53,899 - blockflow - INFO - Project 50 - Processing instance 164772 at node 361/Compute (35), episode 52
  46. Sep 7 16:25:53 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133507 InitPrio=4294820228 usec=540
  47. Sep 7 16:25:54 epyc0 python3: 2020-09-07 16:25:53,999 - blockflow - INFO - Project 50 - Instance 164770: Submitted batch job 133507
  48. Sep 7 16:25:54 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133508 InitPrio=4294820177 usec=566
  49. Sep 7 16:25:54 epyc0 python3: 2020-09-07 16:25:54,404 - blockflow - INFO - Project 50 - Instance 164771: Submitted batch job 133508
  50. Sep 7 16:25:54 epyc0 python3: 2020-09-07 16:25:54,468 - blockflow - INFO - Project 50 - Processing instance 164773 at node 308/Compute (28), episode 52
  51. Sep 7 16:25:54 epyc0 python3: 2020-09-07 16:25:54,982 - blockflow - INFO - Project 50 - Processing instance 164774 at node 283/Split files, episode 52
  52. Sep 7 16:25:55 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133509 InitPrio=4294820226 usec=862
  53. Sep 7 16:25:55 epyc0 python3: 2020-09-07 16:25:55,150 - blockflow - INFO - Project 50 - Instance 164772: Submitted batch job 133509
  54. Sep 7 16:25:55 epyc0 python3: 2020-09-07 16:25:55,400 - blockflow - INFO - Project 50 - Processing instance 164775 at node 361/Compute (35), episode 52
  55. Sep 7 16:25:55 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133510 InitPrio=4294820225 usec=497
  56. Sep 7 16:25:55 epyc0 python3: 2020-09-07 16:25:55,615 - blockflow - INFO - Project 50 - Instance 164773: Submitted batch job 133510
  57. Sep 7 16:25:55 epyc0 python3: 2020-09-07 16:25:55,914 - blockflow - INFO - Project 50 - Processing instance 164776 at node 308/Compute (28), episode 52
  58. Sep 7 16:25:56 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133511 InitPrio=4294820174 usec=760
  59. Sep 7 16:25:56 epyc0 python3: 2020-09-07 16:25:56,064 - blockflow - INFO - Project 50 - Instance 164774: Submitted batch job 133511
  60. Sep 7 16:25:56 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133512 InitPrio=4294820223 usec=711
  61. Sep 7 16:25:56 epyc0 python3: 2020-09-07 16:25:56,669 - blockflow - INFO - Project 50 - Instance 164775: Submitted batch job 133512
  62. Sep 7 16:25:57 epyc0 python3: 2020-09-07 16:25:57,359 - blockflow - INFO - Project 50 - Processing instance 164777 at node 283/Split files, episode 52
  63. Sep 7 16:25:57 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133513 InitPrio=4294820222 usec=595
  64. Sep 7 16:25:57 epyc0 python3: 2020-09-07 16:25:57,825 - blockflow - INFO - Project 50 - Instance 164776: Submitted batch job 133513
  65. Sep 7 16:25:58 epyc0 python3: 2020-09-07 16:25:58,404 - blockflow - INFO - Project 50 - Processing instance 164778 at node 361/Compute (35), episode 52
  66. Sep 7 16:25:59 epyc0 python3: 2020-09-07 16:25:59,381 - blockflow - INFO - Project 50 - Processing instance 164779 at node 308/Compute (28), episode 52
  67. Sep 7 16:25:59 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133514 InitPrio=4294820171 usec=469
  68. Sep 7 16:25:59 epyc0 python3: 2020-09-07 16:25:59,704 - blockflow - INFO - Project 50 - Instance 164777: Submitted batch job 133514
  69. Sep 7 16:26:00 epyc0 python3: 2020-09-07 16:26:00,592 - blockflow - INFO - Project 50 - Processing instance 164780 at node 283/Split files, episode 52
  70. Sep 7 16:26:00 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133515 InitPrio=4294820220 usec=692
  71. Sep 7 16:26:00 epyc0 python3: 2020-09-07 16:26:00,908 - blockflow - INFO - Project 50 - Instance 164778: Submitted batch job 133515
  72. Sep 7 16:26:01 epyc0 python3: 2020-09-07 16:26:01,790 - blockflow - INFO - Project 50 - Processing instance 164781 at node 361/Compute (35), episode 52
  73. Sep 7 16:26:02 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133516 InitPrio=4294820219 usec=694
  74. Sep 7 16:26:02 epyc0 python3: 2020-09-07 16:26:02,240 - blockflow - INFO - Project 50 - Instance 164779: Submitted batch job 133516
  75. Sep 7 16:26:03 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133517 InitPrio=4294820168 usec=863
  76. Sep 7 16:26:03 epyc0 python3: 2020-09-07 16:26:03,121 - blockflow - INFO - Project 50 - Instance 164780: Submitted batch job 133517
  77. Sep 7 16:26:03 epyc0 python3: 2020-09-07 16:26:03,278 - blockflow - INFO - Project 50 - Processing instance 164782 at node 308/Compute (28), episode 52
  78. Sep 7 16:26:04 epyc0 python3: 2020-09-07 16:26:04,368 - blockflow - INFO - Project 50 - Processing instance 164783 at node 283/Split files, episode 52
  79. Sep 7 16:26:04 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133518 InitPrio=4294820217 usec=803
  80. Sep 7 16:26:04 epyc0 python3: 2020-09-07 16:26:04,690 - blockflow - INFO - Project 50 - Instance 164781: Submitted batch job 133518
  81. Sep 7 16:26:05 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133519 InitPrio=4294820216 usec=698
  82. Sep 7 16:26:05 epyc0 python3: 2020-09-07 16:26:05,790 - blockflow - INFO - Project 50 - Processing instance 164784 at node 361/Compute (35), episode 52
  83. Sep 7 16:26:05 epyc0 python3: 2020-09-07 16:26:05,794 - blockflow - INFO - Project 50 - Instance 164782: Submitted batch job 133519
  84. Sep 7 16:26:06 epyc0 python3: 2020-09-07 16:26:06,621 - blockflow - INFO - Project 50 - Processing instance 164785 at node 308/Compute (28), episode 52
  85. Sep 7 16:26:07 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133520 InitPrio=4294820165 usec=748
  86. Sep 7 16:26:07 epyc0 python3: 2020-09-07 16:26:07,211 - blockflow - INFO - Project 50 - Instance 164783: Submitted batch job 133520
  87. Sep 7 16:26:07 epyc0 python3: 2020-09-07 16:26:07,992 - blockflow - INFO - Project 50 - Processing instance 164786 at node 283/Split files, episode 52
  88. Sep 7 16:26:08 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133521 InitPrio=4294820214 usec=1025
  89. Sep 7 16:26:08 epyc0 python3: 2020-09-07 16:26:08,116 - blockflow - INFO - Project 50 - Instance 164784: Submitted batch job 133521
  90. Sep 7 16:26:10 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133522 InitPrio=4294820213 usec=685
  91. Sep 7 16:26:10 epyc0 python3: 2020-09-07 16:26:10,059 - blockflow - INFO - Project 50 - Instance 164785: Submitted batch job 133522
  92.  
  93. Sep 7 16:26:10 epyc0 slurmctld[6132]: _slurm_rpc_submit_batch_job: JobId=133523 InitPrio=4294820162 usec=961
  94. Sep 7 16:26:10 epyc0 python3: 2020-09-07 16:26:10,988 - blockflow - INFO - Project 50 - Instance 164786: Submitted batch job 133523
  95. Sep 7 16:26:42 epyc0 slurmctld[6132]: _job_complete: JobId=133494 WEXITSTATUS 0
  96. Sep 7 16:26:42 epyc0 slurmctld[6132]: _job_complete: JobId=133494 done
  97. Sep 7 16:26:42 epyc0 slurmctld[6132]: sched: Allocate JobId=133497 NodeList=epyc-node003 #CPUs=8 Partition=debug
  98. Sep 7 16:26:43 epyc0 slurmctld[6132]: _job_complete: JobId=133495 WEXITSTATUS 0
  99. Sep 7 16:26:43 epyc0 slurmctld[6132]: _job_complete: JobId=133495 done
  100. Sep 7 16:26:43 epyc0 slurmctld[6132]: sched: Allocate JobId=133498 NodeList=epyc-node001 #CPUs=16 Partition=debug
  101. Sep 7 16:27:18 epyc0 slurmctld[6132]: _job_complete: JobId=133497 WEXITSTATUS 0
  102. Sep 7 16:27:18 epyc0 slurmctld[6132]: _job_complete: JobId=133497 done
  103. Sep 7 16:27:18 epyc0 slurmctld[6132]: sched: Allocate JobId=133500 NodeList=epyc-node003 #CPUs=8 Partition=debug
  104. Sep 7 16:27:19 epyc0 python3: 2020-09-07 16:27:19,513 - blockflow - INFO - Project 44 - Removing stale instance /opt/rndnet_schedulers/rndnet_scheduler_gepyc/44/3009
  105. Sep 7 16:27:19 epyc0 python3: exception calling callback for <Future at 0x7f243c5af5f8 state=finished raised HTTPError>
  106. Sep 7 16:27:19 epyc0 python3: Traceback (most recent call last):
  107. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/concurrent/futures/_base.py", line 324, in _invoke_callbacks
  108. Sep 7 16:27:19 epyc0 python3: callback(self)
  109. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/site-packages/rndnet_scheduler/base.py", line 25, in ignore_future
  110. Sep 7 16:27:19 epyc0 python3: f.result()
  111. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/concurrent/futures/_base.py", line 425, in result
  112. Sep 7 16:27:19 epyc0 python3: return self.__get_result()
  113. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
  114. Sep 7 16:27:19 epyc0 python3: raise self._exception
  115. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/concurrent/futures/thread.py", line 56, in run
  116. Sep 7 16:27:19 epyc0 python3: result = self.fn(*self.args, **self.kwargs)
  117. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/site-packages/rndnet_scheduler/base.py", line 150, in remove_stale
  118. Sep 7 16:27:19 epyc0 python3: log_info(self.server, int(i.parent.name), f'Removing stale instance {i}')
  119. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/site-packages/rndnet_common/log.py", line 20, in log_info
  120. Sep 7 16:27:19 epyc0 python3: level='info', message=message)
  121. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/site-packages/rndnet_common/server.py", line 40, in wrap
  122. Sep 7 16:27:19 epyc0 python3: r.raise_for_status()
  123. Sep 7 16:27:19 epyc0 python3: File "/opt/rndnet/conda-env/smaster-modules/lib/python3.6/site-packages/requests/models.py", line 941, in raise_for_status
  124. Sep 7 16:27:19 epyc0 python3: raise HTTPError(http_error_msg, response=self)
  125. Sep 7 16:27:19 epyc0 python3: requests.exceptions.HTTPError: 400 Client Error: BAD REQUEST for url: https://epyc0:5000/api/projects/44/log
  126. Sep 7 16:27:20 epyc0 slurmctld[6132]: _job_complete: JobId=133498 WEXITSTATUS 0
  127. Sep 7 16:27:20 epyc0 slurmctld[6132]: _job_complete: JobId=133498 done
  128. Sep 7 16:27:20 epyc0 slurmctld[6132]: sched: Allocate JobId=133501 NodeList=epyc-node001 #CPUs=16 Partition=debug
  129.  
  130. Sep 7 16:27:52 epyc0 slurmctld[6132]: _job_complete: JobId=133500 WEXITSTATUS 0
  131. Sep 7 16:27:52 epyc0 slurmctld[6132]: _job_complete: JobId=133500 done
  132. Sep 7 16:27:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133503 NodeList=epyc-node003 #CPUs=8 Partition=debug
  133. Sep 7 16:27:53 epyc0 slurmctld[6132]: _job_complete: JobId=133501 WEXITSTATUS 0
  134. Sep 7 16:27:53 epyc0 slurmctld[6132]: _job_complete: JobId=133501 done
  135. Sep 7 16:27:53 epyc0 slurmctld[6132]: sched: Allocate JobId=133504 NodeList=epyc-node001 #CPUs=16 Partition=debug
  136.  
  137. Sep 7 16:28:24 epyc0 slurmctld[6132]: _job_complete: JobId=133503 WEXITSTATUS 0
  138. Sep 7 16:28:24 epyc0 slurmctld[6132]: _job_complete: JobId=133503 done
  139. Sep 7 16:28:24 epyc0 slurmctld[6132]: sched: Allocate JobId=133506 NodeList=epyc-node003 #CPUs=8 Partition=debug
  140. Sep 7 16:28:29 epyc0 slurmctld[6132]: _job_complete: JobId=133504 WEXITSTATUS 0
  141. Sep 7 16:28:29 epyc0 slurmctld[6132]: _job_complete: JobId=133504 done
  142. Sep 7 16:28:29 epyc0 slurmctld[6132]: sched: Allocate JobId=133507 NodeList=epyc-node001 #CPUs=16 Partition=debug
  143. Sep 7 16:28:53 epyc0 slurmctld[6132]: _job_complete: JobId=133506 WEXITSTATUS 0
  144. Sep 7 16:28:53 epyc0 slurmctld[6132]: _job_complete: JobId=133506 done
  145. Sep 7 16:28:53 epyc0 slurmctld[6132]: sched: Allocate JobId=133509 NodeList=epyc-node003 #CPUs=8 Partition=debug
  146. Sep 7 16:29:13 epyc0 slurmctld[6132]: _job_complete: JobId=133507 WEXITSTATUS 0
  147. Sep 7 16:29:13 epyc0 slurmctld[6132]: _job_complete: JobId=133507 done
  148. Sep 7 16:29:13 epyc0 slurmctld[6132]: sched: Allocate JobId=133510 NodeList=epyc-node001 #CPUs=16 Partition=debug
  149.  
  150. Sep 7 16:29:29 epyc0 slurmctld[6132]: _job_complete: JobId=133509 WEXITSTATUS 0
  151. Sep 7 16:29:29 epyc0 slurmctld[6132]: _job_complete: JobId=133509 done
  152. Sep 7 16:29:29 epyc0 slurmctld[6132]: sched: Allocate JobId=133512 NodeList=epyc-node003 #CPUs=8 Partition=debug
  153. Sep 7 16:29:49 epyc0 slurmctld[6132]: _job_complete: JobId=133510 WEXITSTATUS 0
  154. Sep 7 16:29:49 epyc0 slurmctld[6132]: _job_complete: JobId=133510 done
  155. Sep 7 16:29:49 epyc0 slurmctld[6132]: sched: Allocate JobId=133513 NodeList=epyc-node001 #CPUs=16 Partition=debug
  156. Sep 7 16:30:01 epyc0 systemd: Starting Poll log processing...
  157. Sep 7 16:30:01 epyc0 systemd: Started Session 116838 of user root.
  158. Sep 7 16:30:02 epyc0 systemd: Started Poll log processing.
  159. Sep 7 16:30:03 epyc0 slurmctld[6132]: _job_complete: JobId=133512 WEXITSTATUS 0
  160. Sep 7 16:30:03 epyc0 slurmctld[6132]: _job_complete: JobId=133512 done
  161. Sep 7 16:30:03 epyc0 slurmctld[6132]: sched: Allocate JobId=133515 NodeList=epyc-node003 #CPUs=8 Partition=debug
  162.  
  163. Sep 7 16:30:29 epyc0 slurmctld[6132]: _job_complete: JobId=133513 WEXITSTATUS 0
  164. Sep 7 16:30:29 epyc0 slurmctld[6132]: _job_complete: JobId=133513 done
  165. Sep 7 16:30:29 epyc0 slurmctld[6132]: sched: Allocate JobId=133516 NodeList=epyc-node001 #CPUs=16 Partition=debug
  166. Sep 7 16:30:33 epyc0 slurmctld[6132]: _job_complete: JobId=133515 WEXITSTATUS 0
  167. Sep 7 16:30:33 epyc0 slurmctld[6132]: _job_complete: JobId=133515 done
  168. Sep 7 16:30:33 epyc0 slurmctld[6132]: sched: Allocate JobId=133518 NodeList=epyc-node003 #CPUs=8 Partition=debug
  169. Sep 7 16:31:04 epyc0 slurmctld[6132]: _job_complete: JobId=133518 WEXITSTATUS 0
  170. Sep 7 16:31:04 epyc0 slurmctld[6132]: _job_complete: JobId=133518 done
  171. Sep 7 16:31:04 epyc0 slurmctld[6132]: sched: Allocate JobId=133519 NodeList=epyc-node003 #CPUs=8 Partition=debug
  172. Sep 7 16:31:07 epyc0 slurmctld[6132]: _job_complete: JobId=133516 WEXITSTATUS 0
  173. Sep 7 16:31:07 epyc0 slurmctld[6132]: _job_complete: JobId=133516 done
  174. Sep 7 16:31:07 epyc0 slurmctld[6132]: sched: Allocate JobId=133521 NodeList=epyc-node001 #CPUs=16 Partition=debug
  175.  
  176. Sep 7 16:31:25 epyc0 slurmctld[6132]: _job_complete: JobId=133519 WEXITSTATUS 0
  177. Sep 7 16:31:25 epyc0 slurmctld[6132]: _job_complete: JobId=133519 done
  178. Sep 7 16:31:25 epyc0 slurmctld[6132]: sched: Allocate JobId=133522 NodeList=epyc-node003 #CPUs=8 Partition=debug
  179. Sep 7 16:31:51 epyc0 slurmctld[6132]: _job_complete: JobId=133522 WEXITSTATUS 0
  180. Sep 7 16:31:51 epyc0 slurmctld[6132]: _job_complete: JobId=133522 done
  181. Sep 7 16:31:51 epyc0 slurmctld[6132]: sched: Allocate JobId=133496 NodeList=epyc-node003 #CPUs=3 Partition=debug
  182. Sep 7 16:31:51 epyc0 slurmctld[6132]: sched: Allocate JobId=133499 NodeList=epyc-node003 #CPUs=3 Partition=debug
  183. Sep 7 16:31:52 epyc0 slurmctld[6132]: _job_complete: JobId=133521 WEXITSTATUS 0
  184. Sep 7 16:31:52 epyc0 slurmctld[6132]: _job_complete: JobId=133521 done
  185. Sep 7 16:31:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133502 NodeList=epyc-node001 #CPUs=3 Partition=debug
  186. Sep 7 16:31:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133505 NodeList=epyc-node001 #CPUs=3 Partition=debug
  187. Sep 7 16:31:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133508 NodeList=epyc-node001 #CPUs=3 Partition=debug
  188. Sep 7 16:31:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133511 NodeList=epyc-node001 #CPUs=3 Partition=debug
  189. Sep 7 16:31:52 epyc0 slurmctld[6132]: sched: Allocate JobId=133514 NodeList=epyc-node001 #CPUs=3 Partition=debug
  190.  
  191. Sep 7 16:35:34 epyc0 slurmctld[6132]: _job_complete: JobId=133514 WEXITSTATUS 0
  192. Sep 7 16:35:34 epyc0 slurmctld[6132]: _job_complete: JobId=133514 done
  193. Sep 7 16:35:34 epyc0 slurmctld[6132]: sched: Allocate JobId=133517 NodeList=epyc-node001 #CPUs=3 Partition=debug
  194.  
  195. Sep 7 16:55:04 epyc0 systemd: Starting Check pmlogger instances are running...
  196. Sep 7 16:55:10 epyc0 systemd: Started Check pmlogger instances are running.
  197. Sep 7 17:25:06 epyc0 systemd: Starting Check pmlogger instances are running...
  198. Sep 7 17:25:12 epyc0 systemd: Started Check pmlogger instances are running.
  199. Sep 7 18:27:42 epyc0 slurmctld[6132]: _job_complete: JobId=133496 WEXITSTATUS 0
  200. Sep 7 18:27:42 epyc0 slurmctld[6132]: _job_complete: JobId=133496 done
  201. Sep 7 18:27:42 epyc0 slurmctld[6132]: sched: Allocate JobId=133520 NodeList=epyc-node003 #CPUs=3 Partition=debug
  202. Sep 7 18:30:00 epyc0 systemd: Starting Poll log processing...
  203. Sep 7 18:30:00 epyc0 systemd: Started Poll log processing.
  204. Sep 7 18:32:23 epyc0 slurmctld[6132]: _job_complete: JobId=133505 WEXITSTATUS 0
  205. Sep 7 18:32:23 epyc0 slurmctld[6132]: _job_complete: JobId=133505 done
  206. Sep 7 18:32:24 epyc0 slurmctld[6132]: sched: Allocate JobId=133523 NodeList=epyc-node001 #CPUs=3 Partition=debug
  207. Sep 7 18:33:27 epyc0 slurmctld[6132]: _job_complete: JobId=133502 WEXITSTATUS 0
  208. Sep 7 18:33:27 epyc0 slurmctld[6132]: _job_complete: JobId=133502 done
  209.  
  210. Sep 7 18:36:57 epyc0 slurmctld[6132]: _job_complete: JobId=133511 WEXITSTATUS 0
  211. Sep 7 18:36:57 epyc0 slurmctld[6132]: _job_complete: JobId=133511 done
  212. Sep 7 18:37:47 epyc0 slurmctld[6132]: _job_complete: JobId=133508 WEXITSTATUS 0
  213. Sep 7 18:37:47 epyc0 slurmctld[6132]: _job_complete: JobId=133508 done
  214.  
  215. Sep 7 18:40:28 epyc0 slurmctld[6132]: _job_complete: JobId=133517 WEXITSTATUS 0
  216. Sep 7 18:40:28 epyc0 slurmctld[6132]: _job_complete: JobId=133517 done
  217. Sep 7 19:03:18 epyc0 slurmctld[6132]: _job_complete: JobId=133499 WEXITSTATUS 1
  218. Sep 7 19:03:18 epyc0 slurmctld[6132]: _job_complete: JobId=133499 done
  219. Sep 7 20:31:32 epyc0 slurmctld[6132]: _job_complete: JobId=133520 WEXITSTATUS 0
  220. Sep 7 20:31:32 epyc0 slurmctld[6132]: _job_complete: JobId=133520 done
  221. Sep 7 21:02:17 epyc0 slurmctld[6132]: _job_complete: JobId=133523 WEXITSTATUS 0
  222. Sep 7 21:02:17 epyc0 slurmctld[6132]: _job_complete: JobId=133523 done
  223.  
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!