API tools faq
paste
Advertisement
khisanthax

node1syslog

khisanthax
Feb 29th, 2024
26
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 58.88 KB | Software | 0 0
raw download clone embed print report
  1. Feb 29 08:35:40 proxmox920 pveproxy[2569802]: Clearing outdated entries from certificate cache
  2. Feb 29 08:37:20 proxmox920 pveproxy[2561895]: worker exit
  3. Feb 29 08:37:21 proxmox920 pveproxy[2410]: worker 2561895 finished
  4. Feb 29 08:37:21 proxmox920 pveproxy[2410]: starting 1 worker(s)
  5. Feb 29 08:37:21 proxmox920 pveproxy[2410]: worker 2607288 started
  6. Feb 29 08:37:40 proxmox920 pveproxy[2607288]: Clearing outdated entries from certificate cache
  7. Feb 29 08:41:33 proxmox920 pmxcfs[1535]: [dcdb] notice: data verification successful
  8. Feb 29 08:44:31 proxmox920 pvedaemon[313582]: <root@pam> successful auth for user 'root@pam'
  9. Feb 29 08:51:36 proxmox920 pveproxy[2569802]: worker exit
  10. Feb 29 08:51:37 proxmox920 pveproxy[2410]: worker 2569802 finished
  11. Feb 29 08:51:37 proxmox920 pveproxy[2410]: starting 1 worker(s)
  12. Feb 29 08:51:37 proxmox920 pveproxy[2410]: worker 2616074 started
  13. Feb 29 08:51:46 proxmox920 pveproxy[2616074]: Clearing outdated entries from certificate cache
  14. Feb 29 08:56:41 proxmox920 corosync[1617]: [KNET ] link: host: 5 link: 0 is down
  15. Feb 29 08:56:41 proxmox920 corosync[1617]: [KNET ] host: host: 5 (passive) best link: 0 (pri: 1)
  16. Feb 29 08:56:41 proxmox920 corosync[1617]: [KNET ] host: host: 5 has no active links
  17. Feb 29 08:56:42 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (1)
  18. Feb 29 08:56:43 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  19. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  20. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  21. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  22. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  23. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  24. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  25. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  26. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  27. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  28. Feb 29 08:56:48 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (2)
  29. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  30. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  31. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  32. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  33. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  34. Feb 29 08:56:48 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  35. Feb 29 08:56:50 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  36. Feb 29 08:56:50 proxmox920 corosync[1617]: [QUORUM] Sync left[1]: 5
  37. Feb 29 08:56:50 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.16ec) was formed. Members left: 5
  38. Feb 29 08:56:50 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 5
  39. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  40. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  41. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  42. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  43. Feb 29 08:56:50 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  44. Feb 29 08:56:50 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  45. Feb 29 08:56:50 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  46. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: received sync request (epoch 1/1981/00000007)
  47. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/00000007)
  48. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: received all states
  49. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: leader is 1/1981
  50. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: synced members: 1/1981, 3/1535, 4/1756, 6/1096
  51. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  52. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 11
  53. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: received all states
  54. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  55. Feb 29 08:56:50 proxmox920 pmxcfs[1535]: [status] notice: dfsm_deliver_queue: queue length 71
  56. Feb 29 08:56:50 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (3)
  57. Feb 29 08:56:53 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  58. Feb 29 08:56:54 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (4)
  59. Feb 29 08:56:55 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (5)
  60. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  61. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  62. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  63. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  64. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  65. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  66. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  67. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  68. Feb 29 08:56:56 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  69. Feb 29 08:56:58 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  70. Feb 29 08:56:58 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  71. Feb 29 08:56:58 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  72. Feb 29 08:56:58 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  73. Feb 29 08:56:58 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  74. Feb 29 08:56:59 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  75. Feb 29 08:56:59 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  76. Feb 29 08:56:59 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (6)
  77. Feb 29 08:57:00 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (7)
  78. Feb 29 08:57:01 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (8)
  79. Feb 29 08:57:02 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (9)
  80. Feb 29 08:57:03 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  81. Feb 29 08:57:03 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.16f0) was formed. Members
  82. Feb 29 08:57:03 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  83. Feb 29 08:57:03 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  84. Feb 29 08:57:03 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  85. Feb 29 08:57:09 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (10)
  86. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  87. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  88. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  89. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  90. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  91. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  92. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  93. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  94. Feb 29 08:57:09 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  95. Feb 29 08:57:10 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (11)
  96. Feb 29 08:57:11 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (12)
  97. Feb 29 08:57:11 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  98. Feb 29 08:57:12 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (13)
  99. Feb 29 08:57:12 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  100. Feb 29 08:57:13 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (14)
  101. Feb 29 08:57:14 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (15)
  102. Feb 29 08:57:17 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (16)
  103. Feb 29 08:57:18 proxmox920 corosync[1617]: [QUORUM] Sync members[1]: 3
  104. Feb 29 08:57:18 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  105. Feb 29 08:57:18 proxmox920 corosync[1617]: [TOTEM ] A new membership (3.16f4) was formed. Members left: 1 4 6
  106. Feb 29 08:57:18 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  107. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  108. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  109. Feb 29 08:57:18 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  110. Feb 29 08:57:18 proxmox920 corosync[1617]: [QUORUM] This node is within the non-primary component and will NOT provide any services.
  111. Feb 29 08:57:18 proxmox920 corosync[1617]: [QUORUM] Members[1]: 3
  112. Feb 29 08:57:18 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  113. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [status] notice: node lost quorum
  114. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] crit: received write while not quorate - trigger resync
  115. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] crit: leaving CPG group
  116. Feb 29 08:57:18 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  117. Feb 29 08:57:18 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  118. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] notice: start cluster connection
  119. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_join failed: 14
  120. Feb 29 08:57:18 proxmox920 pve-ha-lrm[2419]: lost lock 'ha_agent_proxmox920_lock - cfs lock update failed - Device or resource busy
  121. Feb 29 08:57:18 proxmox920 pmxcfs[1535]: [dcdb] crit: can't initialize service
  122. Feb 29 08:57:18 proxmox920 pve-ha-crm[1670]: status change slave => wait_for_quorum
  123. Feb 29 08:57:19 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  124. Feb 29 08:57:19 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  125. Feb 29 08:57:19 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  126. Feb 29 08:57:19 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  127. Feb 29 08:57:19 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  128. Feb 29 08:57:19 proxmox920 pve-ha-lrm[2419]: status change active => lost_agent_lock
  129. Feb 29 08:57:20 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  130. Feb 29 08:57:20 proxmox920 corosync[1617]: [QUORUM] Sync joined[3]: 1 4 6
  131. Feb 29 08:57:20 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.16f8) was formed. Members joined: 1 4 6
  132. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  133. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  134. Feb 29 08:57:20 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  135. Feb 29 08:57:20 proxmox920 corosync[1617]: [QUORUM] This node is within the primary component and will provide service.
  136. Feb 29 08:57:20 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  137. Feb 29 08:57:20 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  138. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: node has quorum
  139. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/00000009)
  140. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: received all states
  141. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  142. Feb 29 08:57:20 proxmox920 pmxcfs[1535]: [status] notice: dfsm_deliver_queue: queue length 12
  143. Feb 29 08:57:22 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (17)
  144. Feb 29 08:57:23 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (18)
  145. Feb 29 08:57:23 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  146. Feb 29 08:57:23 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  147. Feb 29 08:57:23 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  148. Feb 29 08:57:23 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  149. Feb 29 08:57:24 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (19)
  150. Feb 29 08:57:24 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  151. Feb 29 08:57:24 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 0
  152. Feb 29 08:57:24 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 0
  153. Feb 29 08:57:24 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  154. Feb 29 08:57:24 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  155. Feb 29 08:57:24 proxmox920 corosync[1617]: [QB ] request returned error (/dev/shm/qb-1617-1535-31-cXQRUg/qb): Bad message (74)
  156. Feb 29 08:57:25 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (20)
  157. Feb 29 08:57:25 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  158. Feb 29 08:57:26 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_local_get failed: 2
  159. Feb 29 08:57:26 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  160. Feb 29 08:57:26 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  161. Feb 29 08:57:27 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (21)
  162. Feb 29 08:57:27 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  163. Feb 29 08:57:27 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  164. Feb 29 08:57:28 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (22)
  165. Feb 29 08:57:28 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  166. Feb 29 08:57:28 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  167. Feb 29 08:57:29 proxmox920 pvestatd[1637]: SynoPBS2: error fetching datastores - 500 Can't connect to 192.168.2.84:8007 (Connection timed out)
  168. Feb 29 08:57:29 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  169. Feb 29 08:57:29 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 9
  170. Feb 29 08:57:30 proxmox920 pve-ha-crm[1670]: status change wait_for_quorum => slave
  171. Feb 29 08:57:30 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  172. Feb 29 08:57:30 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  173. Feb 29 08:57:30 proxmox920 corosync[1617]: [QB ] request returned error (/dev/shm/qb-1617-1535-31-SfWsNw/qb): Bad message (74)
  174. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  175. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  176. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  177. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  178. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  179. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  180. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  181. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  182. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  183. Feb 29 08:57:30 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (23)
  184. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  185. Feb 29 08:57:30 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  186. Feb 29 08:57:32 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_local_get failed: 2
  187. Feb 29 08:57:32 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  188. Feb 29 08:57:32 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 2
  189. Feb 29 08:57:32 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 11315 ms
  190. Feb 29 08:57:32 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (24)
  191. Feb 29 08:57:33 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (25)
  192. Feb 29 08:57:34 proxmox920 pvestatd[1637]: status update time (12.300 seconds)
  193. Feb 29 08:57:34 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (26)
  194. Feb 29 08:57:36 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: -960526692
  195. Feb 29 08:57:36 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: -960526692
  196. Feb 29 08:57:36 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 0
  197. Feb 29 08:57:36 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_send_message failed: 0
  198. Feb 29 08:57:36 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (27)
  199. Feb 29 08:57:37 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (28)
  200. Feb 29 08:57:37 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 16967 ms
  201. Feb 29 08:57:38 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  202. Feb 29 08:57:38 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  203. Feb 29 08:57:38 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  204. Feb 29 08:57:39 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  205. Feb 29 08:57:39 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  206. Feb 29 08:57:39 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  207. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  208. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  209. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  210. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  211. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  212. Feb 29 08:57:40 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  213. Feb 29 08:57:41 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (29)
  214. Feb 29 08:57:42 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (30)
  215. Feb 29 08:57:42 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 21968 ms
  216. Feb 29 08:57:43 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (31)
  217. Feb 29 08:57:44 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  218. Feb 29 08:57:44 proxmox920 corosync[1617]: [QUORUM] Sync joined[3]: 1 4 6
  219. Feb 29 08:57:44 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  220. Feb 29 08:57:44 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.1710) was formed. Members joined: 1 4 6 left: 1 4 6
  221. Feb 29 08:57:44 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  222. Feb 29 08:57:44 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  223. Feb 29 08:57:44 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  224. Feb 29 08:57:44 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  225. Feb 29 08:57:44 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  226. Feb 29 08:57:44 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  227. Feb 29 08:57:44 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  228. Feb 29 08:57:44 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  229. Feb 29 08:57:44 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  230. Feb 29 08:57:45 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (32)
  231. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: received sync request (epoch 1/1981/00000009)
  232. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/0000000B)
  233. Feb 29 08:57:46 proxmox920 corosync[1617]: [TOTEM ] Retransmit List: 16
  234. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: received all states
  235. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: leader is 1/1981
  236. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: synced members: 1/1981, 4/1756, 6/1096
  237. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: waiting for updates from leader
  238. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 7
  239. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [status] notice: received all states
  240. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  241. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [status] notice: dfsm_deliver_queue: queue length 67
  242. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: update complete - trying to commit (got 7 inode updates)
  243. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  244. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_sync_queue: queue length 4
  245. Feb 29 08:57:46 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 3
  246. Feb 29 08:57:46 proxmox920 pve-ha-lrm[2419]: successfully acquired lock 'ha_agent_proxmox920_lock'
  247. Feb 29 08:57:46 proxmox920 pve-ha-lrm[2419]: status change lost_agent_lock => active
  248. Feb 29 08:57:50 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (33)
  249. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  250. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  251. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  252. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  253. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  254. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  255. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  256. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  257. Feb 29 08:57:50 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  258. Feb 29 08:57:51 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (34)
  259. Feb 29 08:57:51 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3713 ms
  260. Feb 29 08:57:53 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  261. Feb 29 08:57:53 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (35)
  262. Feb 29 08:57:54 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (36)
  263. Feb 29 08:57:55 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (37)
  264. Feb 29 08:57:57 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (38)
  265. Feb 29 08:57:58 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (39)
  266. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  267. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  268. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  269. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  270. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  271. Feb 29 08:57:58 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  272. Feb 29 08:58:00 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (40)
  273. Feb 29 08:58:01 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (41)
  274. Feb 29 08:58:02 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  275. Feb 29 08:58:02 proxmox920 corosync[1617]: [QUORUM] Sync joined[3]: 1 4 6
  276. Feb 29 08:58:02 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  277. Feb 29 08:58:02 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.1718) was formed. Members joined: 1 4 6 left: 1 4 6
  278. Feb 29 08:58:02 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  279. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  280. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  281. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  282. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  283. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  284. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  285. Feb 29 08:58:02 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  286. Feb 29 08:58:02 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  287. Feb 29 08:58:02 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  288. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: received sync request (epoch 1/1981/0000000B)
  289. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/0000000D)
  290. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: received all states
  291. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: leader is 1/1981
  292. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: synced members: 1/1981, 4/1756, 6/1096
  293. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: waiting for updates from leader
  294. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 11
  295. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: received all states
  296. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  297. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [status] notice: dfsm_deliver_queue: queue length 53
  298. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: update complete - trying to commit (got 6 inode updates)
  299. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  300. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_sync_queue: queue length 9
  301. Feb 29 08:58:02 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 3
  302. Feb 29 08:58:02 proxmox920 pvestatd[1637]: status update time (8.333 seconds)
  303. Feb 29 08:58:05 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (42)
  304. Feb 29 08:58:06 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (43)
  305. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  306. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  307. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  308. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  309. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  310. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  311. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  312. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  313. Feb 29 08:58:06 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  314. Feb 29 08:58:07 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  315. Feb 29 08:58:07 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  316. Feb 29 08:58:07 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  317. Feb 29 08:58:07 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  318. Feb 29 08:58:07 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  319. Feb 29 08:58:08 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (44)
  320. Feb 29 08:58:10 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  321. Feb 29 08:58:12 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  322. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  323. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  324. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  325. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  326. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  327. Feb 29 08:58:14 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  328. Feb 29 08:58:18 proxmox920 corosync[1617]: [QUORUM] Sync members[1]: 3
  329. Feb 29 08:58:18 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  330. Feb 29 08:58:18 proxmox920 corosync[1617]: [TOTEM ] A new membership (3.171c) was formed. Members left: 1 4 6
  331. Feb 29 08:58:18 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  332. Feb 29 08:58:18 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  333. Feb 29 08:58:18 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  334. Feb 29 08:58:18 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  335. Feb 29 08:58:18 proxmox920 corosync[1617]: [QUORUM] This node is within the non-primary component and will NOT provide any services.
  336. Feb 29 08:58:18 proxmox920 corosync[1617]: [QUORUM] Members[1]: 3
  337. Feb 29 08:58:18 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  338. Feb 29 08:58:18 proxmox920 pmxcfs[1535]: [status] notice: node lost quorum
  339. Feb 29 08:58:18 proxmox920 pmxcfs[1535]: [dcdb] crit: received write while not quorate - trigger resync
  340. Feb 29 08:58:18 proxmox920 pmxcfs[1535]: [dcdb] crit: leaving CPG group
  341. Feb 29 08:58:19 proxmox920 pmxcfs[1535]: [dcdb] notice: start cluster connection
  342. Feb 29 08:58:19 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_join failed: 14
  343. Feb 29 08:58:19 proxmox920 pmxcfs[1535]: [dcdb] crit: can't initialize service
  344. Feb 29 08:58:19 proxmox920 pve-ha-lrm[2419]: lost lock 'ha_agent_proxmox920_lock - cfs lock update failed - Device or resource busy
  345. Feb 29 08:58:19 proxmox920 pve-ha-lrm[2419]: status change active => lost_agent_lock
  346. Feb 29 08:58:19 proxmox920 pve-ha-crm[1670]: status change slave => wait_for_quorum
  347. Feb 29 08:58:21 proxmox920 pvestatd[1637]: SynoPBS2: error fetching datastores - 500 Can't connect to 192.168.2.84:8007 (Connection timed out)
  348. Feb 29 08:58:25 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  349. Feb 29 08:58:25 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  350. Feb 29 08:58:31 proxmox920 pvestatd[1637]: storage 'ShadowGate' is not online
  351. Feb 29 08:58:36 proxmox920 pvestatd[1637]: status update time (22.234 seconds)
  352. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] rx: host: 4 link: 0 is up
  353. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  354. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] rx: host: 1 link: 0 is up
  355. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  356. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  357. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  358. Feb 29 08:58:39 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  359. Feb 29 08:58:39 proxmox920 corosync[1617]: [QUORUM] Sync members[3]: 1 3 4
  360. Feb 29 08:58:39 proxmox920 corosync[1617]: [QUORUM] Sync joined[2]: 1 4
  361. Feb 29 08:58:39 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.1728) was formed. Members joined: 1 4
  362. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756
  363. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  364. Feb 29 08:58:39 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  365. Feb 29 08:58:39 proxmox920 corosync[1617]: [QUORUM] This node is within the primary component and will provide service.
  366. Feb 29 08:58:39 proxmox920 corosync[1617]: [QUORUM] Members[3]: 1 3 4
  367. Feb 29 08:58:39 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  368. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: node has quorum
  369. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/00000011)
  370. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: received all states
  371. Feb 29 08:58:39 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  372. Feb 29 08:58:44 proxmox920 pve-ha-lrm[2419]: successfully acquired lock 'ha_agent_proxmox920_lock'
  373. Feb 29 08:58:44 proxmox920 pve-ha-lrm[2419]: status change lost_agent_lock => active
  374. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535
  375. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  376. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: received sync request (epoch 1/1981/00000013)
  377. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: received all states
  378. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: leader is 3/1535
  379. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: synced members: 3/1535
  380. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: start sending inode updates
  381. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: sent all (3) updates
  382. Feb 29 08:58:45 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  383. Feb 29 08:58:48 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (45)
  384. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  385. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  386. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  387. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  388. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  389. Feb 29 08:58:48 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  390. Feb 29 08:58:50 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  391. Feb 29 08:58:52 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  392. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] rx: host: 4 link: 0 is up
  393. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  394. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] rx: host: 6 link: 0 is up
  395. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  396. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] rx: host: 1 link: 0 is up
  397. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  398. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  399. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  400. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  401. Feb 29 08:58:52 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  402. Feb 29 08:58:52 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (46)
  403. Feb 29 08:58:54 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (47)
  404. Feb 29 08:58:55 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  405. Feb 29 08:58:55 proxmox920 corosync[1617]: [QUORUM] Sync joined[1]: 6
  406. Feb 29 08:58:55 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.172c) was formed. Members joined: 6
  407. Feb 29 08:58:56 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535, 6/1096
  408. Feb 29 08:58:56 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  409. Feb 29 08:58:56 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  410. Feb 29 08:58:56 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  411. Feb 29 08:58:56 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  412. Feb 29 08:58:56 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  413. Feb 29 08:58:56 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  414. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  415. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  416. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  417. Feb 29 08:58:57 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (48)
  418. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  419. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  420. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  421. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  422. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  423. Feb 29 08:58:57 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  424. Feb 29 08:58:59 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (50)
  425. Feb 29 08:59:00 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (51)
  426. Feb 29 08:59:01 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  427. Feb 29 08:59:01 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (52)
  428. Feb 29 08:59:02 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  429. Feb 29 08:59:02 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (53)
  430. Feb 29 08:59:03 proxmox920 pvestatd[1637]: SynoPBS: error fetching datastores - 500 Can't connect to 192.168.2.84:8007 (Connection timed out)
  431. Feb 29 08:59:03 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (54)
  432. Feb 29 08:59:04 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (55)
  433. Feb 29 08:59:05 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (56)
  434. Feb 29 08:59:06 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (57)
  435. Feb 29 08:59:07 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (58)
  436. Feb 29 08:59:08 proxmox920 corosync[1617]: [QUORUM] Sync members[1]: 3
  437. Feb 29 08:59:08 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  438. Feb 29 08:59:08 proxmox920 corosync[1617]: [TOTEM ] A new membership (3.1730) was formed. Members left: 1 4 6
  439. Feb 29 08:59:08 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  440. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  441. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  442. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: dfsm_deliver_queue: queue length 6
  443. Feb 29 08:59:08 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  444. Feb 29 08:59:08 proxmox920 corosync[1617]: [QUORUM] This node is within the non-primary component and will NOT provide any services.
  445. Feb 29 08:59:08 proxmox920 corosync[1617]: [QUORUM] Members[1]: 3
  446. Feb 29 08:59:08 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  447. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: remove message from non-member 1/1981
  448. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: remove message from non-member 1/1981
  449. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] notice: remove message from non-member 1/1981
  450. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: node lost quorum
  451. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  452. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  453. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: dfsm_deliver_queue: queue length 47
  454. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  455. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  456. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  457. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  458. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  459. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  460. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  461. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  462. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  463. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  464. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 4/1756
  465. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  466. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  467. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  468. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  469. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  470. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  471. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  472. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  473. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  474. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  475. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [status] notice: remove message from non-member 1/1981
  476. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] crit: received write while not quorate - trigger resync
  477. Feb 29 08:59:08 proxmox920 pmxcfs[1535]: [dcdb] crit: leaving CPG group
  478. Feb 29 08:59:08 proxmox920 pve-ha-crm[1670]: status change wait_for_quorum => slave
  479. Feb 29 08:59:08 proxmox920 pve-ha-crm[1670]: status change slave => wait_for_quorum
  480. Feb 29 08:59:08 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (59)
  481. Feb 29 08:59:09 proxmox920 pmxcfs[1535]: [dcdb] notice: start cluster connection
  482. Feb 29 08:59:09 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_join failed: 14
  483. Feb 29 08:59:09 proxmox920 pmxcfs[1535]: [dcdb] crit: can't initialize service
  484. Feb 29 08:59:09 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (60)
  485. Feb 29 08:59:10 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (61)
  486. Feb 29 08:59:11 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (62)
  487. Feb 29 08:59:13 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (63)
  488. Feb 29 08:59:13 proxmox920 pvestatd[1637]: storage 'ShadowGate' is not online
  489. Feb 29 08:59:14 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (64)
  490. Feb 29 08:59:14 proxmox920 pvescheduler[2620199]: replication: cfs-lock 'file-replication_cfg' error: no quorum!
  491. Feb 29 08:59:14 proxmox920 pvescheduler[2620200]: jobs: cfs-lock 'file-jobs_cfg' error: no quorum!
  492. Feb 29 08:59:15 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (65)
  493. Feb 29 08:59:15 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  494. Feb 29 08:59:15 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  495. Feb 29 08:59:16 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (66)
  496. Feb 29 08:59:17 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (67)
  497. Feb 29 08:59:18 proxmox920 pvestatd[1637]: status update time (21.959 seconds)
  498. Feb 29 08:59:18 proxmox920 pve-ha-lrm[2419]: lost lock 'ha_agent_proxmox920_lock - cfs lock update failed - Permission denied
  499. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] rx: host: 6 link: 0 is up
  500. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  501. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] rx: host: 1 link: 0 is up
  502. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  503. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  504. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  505. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] rx: host: 4 link: 0 is up
  506. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  507. Feb 29 08:59:19 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  508. Feb 29 08:59:20 proxmox920 corosync[1617]: [QUORUM] Sync members[4]: 1 3 4 6
  509. Feb 29 08:59:20 proxmox920 corosync[1617]: [QUORUM] Sync joined[3]: 1 4 6
  510. Feb 29 08:59:20 proxmox920 corosync[1617]: [TOTEM ] A new membership (1.1734) was formed. Members joined: 1 4 6
  511. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  512. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: starting data syncronisation
  513. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: members: 1/1981, 3/1535, 4/1756, 6/1096
  514. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: starting data syncronisation
  515. Feb 29 08:59:20 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  516. Feb 29 08:59:20 proxmox920 corosync[1617]: [QUORUM] This node is within the primary component and will provide service.
  517. Feb 29 08:59:20 proxmox920 corosync[1617]: [QUORUM] Members[4]: 1 3 4 6
  518. Feb 29 08:59:20 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  519. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: node has quorum
  520. Feb 29 08:59:20 proxmox920 corosync[1617]: [KNET ] pmtud: Global data MTU changed to: 1397
  521. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: received sync request (epoch 1/1981/00000017)
  522. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: received sync request (epoch 1/1981/00000014)
  523. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: received all states
  524. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: leader is 1/1981
  525. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: synced members: 1/1981, 4/1756, 6/1096
  526. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: waiting for updates from leader
  527. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: received all states
  528. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [status] notice: all data is up to date
  529. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: update complete - trying to commit (got 8 inode updates)
  530. Feb 29 08:59:20 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  531. Feb 29 08:59:20 proxmox920 pve-ha-lrm[2419]: successfully acquired lock 'ha_agent_proxmox920_lock'
  532. Feb 29 08:59:29 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (68)
  533. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  534. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  535. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  536. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  537. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  538. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  539. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  540. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  541. Feb 29 08:59:29 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  542. Feb 29 08:59:30 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (69)
  543. Feb 29 08:59:31 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (70)
  544. Feb 29 08:59:31 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 3712 ms
  545. Feb 29 08:59:32 proxmox920 corosync[1617]: [TOTEM ] A processor failed, forming new configuration: token timed out (4950ms), waiting 5940ms for consensus.
  546. Feb 29 08:59:33 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (71)
  547. Feb 29 08:59:34 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (72)
  548. Feb 29 08:59:35 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (73)
  549. Feb 29 08:59:36 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (74)
  550. Feb 29 08:59:37 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (75)
  551. Feb 29 08:59:38 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (76)
  552. Feb 29 08:59:38 proxmox920 corosync[1617]: [QUORUM] Sync members[1]: 3
  553. Feb 29 08:59:38 proxmox920 corosync[1617]: [QUORUM] Sync left[3]: 1 4 6
  554. Feb 29 08:59:38 proxmox920 corosync[1617]: [TOTEM ] A new membership (3.1738) was formed. Members left: 1 4 6
  555. Feb 29 08:59:38 proxmox920 corosync[1617]: [TOTEM ] Failed to receive the leave message. failed: 1 4 6
  556. Feb 29 08:59:38 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  557. Feb 29 08:59:38 proxmox920 pmxcfs[1535]: [status] notice: members: 3/1535
  558. Feb 29 08:59:38 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  559. Feb 29 08:59:38 proxmox920 pmxcfs[1535]: [status] notice: node lost quorum
  560. Feb 29 08:59:38 proxmox920 corosync[1617]: [QUORUM] This node is within the non-primary component and will NOT provide any services.
  561. Feb 29 08:59:38 proxmox920 corosync[1617]: [QUORUM] Members[1]: 3
  562. Feb 29 08:59:38 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  563. Feb 29 08:59:38 proxmox920 pmxcfs[1535]: [dcdb] crit: received write while not quorate - trigger resync
  564. Feb 29 08:59:38 proxmox920 pmxcfs[1535]: [dcdb] crit: leaving CPG group
  565. Feb 29 08:59:39 proxmox920 pmxcfs[1535]: [dcdb] notice: start cluster connection
  566. Feb 29 08:59:39 proxmox920 pmxcfs[1535]: [dcdb] crit: cpg_join failed: 14
  567. Feb 29 08:59:39 proxmox920 pve-ha-crm[1670]: status change wait_for_quorum => slave
  568. Feb 29 08:59:39 proxmox920 pve-ha-lrm[2419]: lost lock 'ha_agent_proxmox920_lock - cfs lock update failed - Device or resource busy
  569. Feb 29 08:59:39 proxmox920 pmxcfs[1535]: [dcdb] crit: can't initialize service
  570. Feb 29 08:59:39 proxmox920 pve-ha-lrm[2419]: status change active => lost_agent_lock
  571. Feb 29 08:59:39 proxmox920 pve-ha-crm[1670]: status change slave => wait_for_quorum
  572. Feb 29 08:59:39 proxmox920 pvestatd[1637]: SynoPBS2: error fetching datastores - 500 Can't connect to 192.168.2.84:8007 (Connection timed out)
  573. Feb 29 08:59:39 proxmox920 pvestatd[1637]: status update time (11.083 seconds)
  574. Feb 29 08:59:39 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (77)
  575. Feb 29 08:59:40 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (78)
  576. Feb 29 08:59:41 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (79)
  577. Feb 29 08:59:42 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (80)
  578. Feb 29 08:59:43 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (81)
  579. Feb 29 08:59:44 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (82)
  580. Feb 29 08:59:45 proxmox920 pmxcfs[1535]: [dcdb] notice: members: 3/1535
  581. Feb 29 08:59:45 proxmox920 pmxcfs[1535]: [dcdb] notice: all data is up to date
  582. Feb 29 08:59:45 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (83)
  583. Feb 29 08:59:46 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (84)
  584. Feb 29 08:59:47 proxmox920 pvestatd[1637]: SynoPBS: error fetching datastores - 500 Can't connect to 192.168.2.84:8007 (Connection timed out)
  585. Feb 29 08:59:47 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (85)
  586. Feb 29 08:59:48 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (86)
  587. Feb 29 08:59:49 proxmox920 pvestatd[1637]: status update time (10.256 seconds)
  588. Feb 29 08:59:51 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (87)
  589. Feb 29 08:59:52 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (88)
  590. Feb 29 08:59:54 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (89)
  591. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] rx: host: 6 link: 0 is up
  592. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 6 joined
  593. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  594. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] rx: host: 1 link: 0 is up
  595. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 1 joined
  596. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] rx: host: 4 link: 0 is up
  597. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] link: Resetting MTU for link 0 because host 4 joined
  598. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  599. Feb 29 08:59:56 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  600. Feb 29 08:59:58 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (90)
  601. Feb 29 08:59:59 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (91)
  602. Feb 29 09:00:00 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (92)
  603. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] link: host: 6 link: 0 is down
  604. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] link: host: 1 link: 0 is down
  605. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] link: host: 4 link: 0 is down
  606. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 6 (passive) best link: 0 (pri: 1)
  607. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 6 has no active links
  608. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1)
  609. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 1 has no active links
  610. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 4 (passive) best link: 0 (pri: 1)
  611. Feb 29 09:00:00 proxmox920 corosync[1617]: [KNET ] host: host: 4 has no active links
  612. Feb 29 09:00:01 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (93)
  613. Feb 29 09:00:02 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (94)
  614. Feb 29 09:00:05 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (95)
  615. Feb 29 09:00:06 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (96)
  616. Feb 29 09:00:07 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (97)
  617. Feb 29 09:00:08 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (98)
  618. Feb 29 09:00:08 proxmox920 corosync[1617]: [TOTEM ] Token has not been received in 12345 ms
  619. Feb 29 09:00:09 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (99)
  620. Feb 29 09:00:09 proxmox920 corosync[1617]: [QUORUM] Sync members[1]: 3
  621. Feb 29 09:00:09 proxmox920 corosync[1617]: [TOTEM ] A new membership (3.173c) was formed. Members
  622. Feb 29 09:00:09 proxmox920 corosync[1617]: [VOTEQ ] Unable to determine origin of the qdevice register call!
  623. Feb 29 09:00:09 proxmox920 corosync[1617]: [QUORUM] Members[1]: 3
  624. Feb 29 09:00:09 proxmox920 corosync[1617]: [MAIN ] Completed service synchronization, ready to provide service.
  625. Feb 29 09:00:10 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (101)
  626. Feb 29 09:00:11 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (102)
  627. Feb 29 09:00:12 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (103)
  628. Feb 29 09:00:13 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (104)
  629. Feb 29 09:00:14 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (105)
  630. Feb 29 09:00:14 proxmox920 pvescheduler[2620640]: jobs: cfs-lock 'file-jobs_cfg' error: no quorum!
  631. Feb 29 09:00:14 proxmox920 pvescheduler[2620639]: replication: cfs-lock 'file-replication_cfg' error: no quorum!
  632. Feb 29 09:00:15 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (106)
  633. Feb 29 09:00:16 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (107)
  634. Feb 29 09:00:17 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (108)
  635. Feb 29 09:00:18 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (109)
  636. Feb 29 09:00:19 proxmox920 kernel: bnx2x: [bnx2x_hw_stats_update:871(enp1s0f3)]NIG timer max (110)
  637. Feb 29 09:00:21 proxmox920 watchdog-mux[1124]: client watchdog expired - disable watchdog updates
  638. -- Reboot --
  639.  
  640.  
  641.  
Tags: syslog
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!