API tools faq
paste
digimer

Untitled

digimer
Jul 14th, 2020
147
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 270.68 KB | None | 0 0
raw download clone embed print report
  1. [root@el8-a01n01 ~]# cat /var/log/pacemaker/el8-a01n01/pacemaker.log.drbd-down-cluster-down-ok-after
  2. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  3. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (get_cluster_type) info: Detected an active 'corosync' cluster
  4. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (mcp_read_config) info: Reading configure for stack: corosync
  5. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (main) notice: Starting Pacemaker 2.0.3-5.el8_2.1 | build=4b1f869f0f features: generated-manpages agent-manpages ncurses libqb-logging libqb-ipc systemd nagios corosync-native atomic-attrd acls
  6. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (main) info: Maximum core file size is: 18446744073709551615
  7. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (qb_ipcs_us_publish) info: server name: pacemakerd
  8. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to lrmd IPC: Connection refused
  9. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to cib_ro IPC: Connection refused
  10. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to crmd IPC: Connection refused
  11. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to attrd IPC: Connection refused
  12. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to pengine IPC: Connection refused
  13. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk__ipc_is_authentic_process_active) info: Could not connect to stonith-ng IPC: Connection refused
  14. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Created entry 43f2a803-da53-4279-8a7c-163841c74b7e/0x55f1e70978c0 for node el8-a01n01/1 (1 total)
  15. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  16. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Node 1 has uuid 1
  17. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  18. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (cluster_connect_quorum) warning: Quorum lost
  19. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Created entry fcfbdeb7-0310-4b7f-99c4-301d97d11dc4/0x55f1e7099860 for node el8-a01n02/2 (2 total)
  20. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  21. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_get_peer) info: Node 2 has uuid 2
  22. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Using uid=189 and group=189 for process pacemaker-based
  23. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7330 for process pacemaker-based
  24. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7331 for process pacemaker-fenced
  25. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7332 for process pacemaker-execd
  26. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Using uid=189 and group=189 for process pacemaker-attrd
  27. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7333 for process pacemaker-attrd
  28. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Using uid=189 and group=189 for process pacemaker-schedulerd
  29. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7334 for process pacemaker-schedulerd
  30. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Using uid=189 and group=189 for process pacemaker-controld
  31. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (start_child) info: Forked child 7335 for process pacemaker-controld
  32. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (main) notice: Pacemaker daemon successfully started and accepting connections
  33. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_quorum_notification) info: Quorum still lost | membership=184 members=1
  34. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=pcmk_quorum_notification
  35. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (crm_reap_unseen_nodes) info: State of node el8-a01n02[2] is still unknown
  36. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_cpg_membership) info: Group pacemakerd event 0: node 1 pid 7329 joined via cpg_join
  37. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_cpg_membership) info: Group pacemakerd event 0: el8-a01n01 (node 1 pid 7329) is member
  38. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  39. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (main) notice: Starting Pacemaker CIB manager
  40. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (get_cluster_type) info: Verifying cluster type: 'corosync'
  41. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (get_cluster_type) info: Assuming an active 'corosync' cluster
  42. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (retrieveCib) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
  43. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  44. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (main) notice: Starting Pacemaker fencer
  45. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (get_cluster_type) info: Verifying cluster type: 'corosync'
  46. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (get_cluster_type) info: Assuming an active 'corosync' cluster
  47. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  48. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  49. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (main) notice: Starting Pacemaker scheduler
  50. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (qb_ipcs_us_publish) info: server name: pengine
  51. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (main) notice: Pacemaker scheduler successfully started and accepting connections
  52. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-execd [7332] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  53. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-execd [7332] (main) notice: Starting Pacemaker local executor
  54. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_us_publish) info: server name: lrmd
  55. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-execd [7332] (main) notice: Pacemaker local executor successfully started and accepting connections
  56. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  57. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-attrd [7333] (main) notice: Starting Pacemaker node attribute manager
  58. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Created entry 1b38f2c4-10f8-45f3-8a05-497ea8d1af2f/0x5556c125ed60 for node el8-a01n01/1 (1 total)
  59. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  60. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Node 1 has uuid 1
  61. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  62. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  63. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-fenced [7331] (init_cs_connection_once) info: Connection to 'corosync': established
  64. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  65. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-controld [7335] (main) notice: Starting Pacemaker controller
  66. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_log) info: Input I_STARTUP received in state S_STARTING from crmd_init
  67. Jul 14 22:18:33 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  68. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Created entry 013eba3f-f8ee-4baf-81c2-de58b97d3cbe/0x55ac132a5ef0 for node el8-a01n01/1 (1 total)
  69. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  70. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Node 1 has uuid 1
  71. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  72. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  73. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (init_cs_connection_once) info: Connection to 'corosync': established
  74. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_publish) info: server name: cib_ro
  75. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_publish) info: server name: cib_rw
  76. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_publish) info: server name: cib_shm
  77. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (main) notice: Pacemaker CIB manager successfully started and accepting connections
  78. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (pcmk_cpg_membership) info: Group cib event 0: node 1 pid 7330 joined via cpg_join
  79. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (pcmk_cpg_membership) info: Group cib event 0: el8-a01n01 (node 1 pid 7330) is member
  80. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-21.raw
  81. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Wrote version 0.15.0 of the CIB to disk (digest: ebc4019e128491fe42d0179b85b82cf6)
  82. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.UakxZA (digest: /var/lib/pacemaker/cib/cib.4HcrQX)
  83. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (main) info: CIB connection active
  84. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (get_cluster_type) info: Verifying cluster type: 'corosync'
  85. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (get_cluster_type) info: Assuming an active 'corosync' cluster
  86. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  87. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Created entry 0c28072e-97a8-4b55-a615-30854e38abb0/0x557da867ba20 for node el8-a01n01/1 (1 total)
  88. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  89. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Node 1 has uuid 1
  90. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  91. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  92. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (init_cs_connection_once) info: Connection to 'corosync': established
  93. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (main) info: Cluster connection active
  94. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='el8-a01n01']/transient_attributes
  95. Jul 14 22:18:34 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='el8-a01n01']/transient_attributes to all (origin=local/attrd/2)
  96. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_cs_flush) info: Sent 0 CPG messages (1 remaining, last=0): Try again (6)
  97. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (qb_ipcs_us_publish) info: server name: attrd
  98. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
  99. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_cpg_membership) info: Group pacemakerd event 1: node 2 pid 1564 joined via cluster join
  100. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_cpg_membership) info: Group pacemakerd event 1: el8-a01n01 (node 1 pid 7329) is member
  101. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_cpg_membership) info: Group pacemakerd event 1: el8-a01n02 (node 2 pid 1564) is member
  102. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  103. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (crm_cs_flush) info: Sent 0 CPG messages (1 remaining, last=7): Try again (6)
  104. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_cs_flush) info: Sent 0 CPG messages (1 remaining, last=0): Try again (6)
  105. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (pcmk_cpg_membership) info: Group cib event 1: node 2 pid 1565 joined via cluster join
  106. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (pcmk_cpg_membership) info: Group cib event 1: el8-a01n01 (node 1 pid 7330) is member
  107. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (setup_cib) info: Watching for stonith topology changes
  108. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (qb_ipcs_us_publish) info: server name: stonith-ng
  109. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (main) notice: Pacemaker fencer successfully started and accepting connections
  110. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 1 pid 7331 joined via cpg_join
  111. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (pcmk_cpg_membership) info: Group stonith-ng event 0: el8-a01n01 (node 1 pid 7331) is member
  112. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (pcmk_cpg_membership) info: Group attrd event 0: node 1 pid 7333 joined via cpg_join
  113. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (pcmk_cpg_membership) info: Group attrd event 0: el8-a01n01 (node 1 pid 7333) is member
  114. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (pcmk_cpg_membership) info: Group stonith-ng event 1: node 2 pid 1566 joined via cluster join
  115. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (pcmk_cpg_membership) info: Group stonith-ng event 1: el8-a01n01 (node 1 pid 7331) is member
  116. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_quorum_notification) notice: Quorum acquired | membership=188 members=2
  117. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemakerd [7329] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=pcmk_quorum_notification
  118. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Created entry f3a02ded-1c06-48fc-beaf-6325bca22b22/0x55ac132acbb0 for node el8-a01n02/2 (2 total)
  119. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  120. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Node 2 has uuid 2
  121. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (pcmk_cpg_membership) info: Group cib event 1: el8-a01n02 (node 2 pid 1565) is member
  122. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  123. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  124. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (get_cluster_type) info: Verifying cluster type: 'corosync'
  125. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (get_cluster_type) info: Assuming an active 'corosync' cluster
  126. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  127. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Created entry 5b877f60-706c-4434-85b9-5de45f33f77d/0x55f1537e3e20 for node el8-a01n01/1 (1 total)
  128. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  129. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Cluster node el8-a01n01 is now in unknown state
  130. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (pcmk_cpg_membership) info: Group attrd event 1: node 2 pid 1568 joined via cpg_join
  131. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (pcmk_cpg_membership) info: Group attrd event 1: el8-a01n01 (node 1 pid 7333) is member
  132. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Created entry 1962055c-18e3-4e30-9d64-bfc7054f0fa4/0x5556c1366990 for node el8-a01n02/2 (2 total)
  133. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  134. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Node 1 has uuid 1
  135. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  136. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Node el8-a01n01 is now a peer | DC=<none> old=0x0000000 new=0x4000000
  137. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
  138. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (init_cs_connection_once) info: Connection to 'corosync': established
  139. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_get_peer) info: Node 2 has uuid 2
  140. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (pcmk_cpg_membership) info: Group stonith-ng event 1: el8-a01n02 (node 2 pid 1566) is member
  141. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  142. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  143. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Created entry b484872e-6f28-41f4-807d-41e1483cabda/0x557da85717b0 for node el8-a01n02/2 (2 total)
  144. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  145. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_get_peer) info: Node 2 has uuid 2
  146. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (pcmk_cpg_membership) info: Group attrd event 1: el8-a01n02 (node 2 pid 1568) is member
  147. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  148. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  149. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (init_cib_cache_cb) info: Updating device list from the cib: init
  150. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (cib_devices_update) info: Updating devices to version 0.15.0
  151. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (cluster_connect_quorum) notice: Quorum acquired
  152. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_peer_update) notice: Setting #attrd-protocol[el8-a01n02]: (unset) -> 2 | from el8-a01n02
  153. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_start_election_if_needed) info: Starting an election to determine the writer
  154. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Created entry f4f8c8f4-9aa2-48a2-80f8-e11f4b5fc933/0x55f1537e6700 for node el8-a01n02/2 (2 total)
  155. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  156. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Cluster node el8-a01n02 is now in unknown state
  157. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_get_peer) info: Node 2 has uuid 2
  158. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n02']/transient_attributes: OK (rc=0, origin=el8-a01n02/attrd/2, version=0.15.0)
  159. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (election_count_vote) info: election-attrd round 1 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  160. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_ha_control) info: Connected to the cluster
  161. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (lrmd_ipc_connect) info: Connecting to executor
  162. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (crm_client_new) debug: Connecting 0x55732b4f1fb0 for uid=189 gid=189 pid=7335 id=7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a
  163. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (handle_new_connection) debug: IPC credentials authenticated (/dev/shm/qb-7332-7335-9-NPbmWF/qb)
  164. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_shm_connect) debug: connecting to client [7335]
  165. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  166. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  167. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
  168. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  169. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed register operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  170. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_control) info: Connection to the executor established
  171. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_started) info: Delaying start, no membership data (0000000000100000)
  172. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_started) info: Delaying start, no membership data (0000000000100000)
  173. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_quorum_notification) info: Quorum retained | membership=188 members=2
  174. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=pcmk_quorum_notification
  175. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Cluster node el8-a01n01 is now member (was in unknown state)
  176. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=pcmk_quorum_notification
  177. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Cluster node el8-a01n02 is now member (was in unknown state)
  178. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_started) info: Delaying start, Config not read (0000000000000040)
  179. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (qb_ipcs_us_publish) info: server name: crmd
  180. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_started) notice: Pacemaker controller successfully started and accepting connections
  181. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
  182. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
  183. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_cs_flush) info: Sent 3 CPG messages (0 remaining, last=3): OK (1)
  184. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_peer_update) notice: Setting #attrd-protocol[el8-a01n01]: (unset) -> 2 | from el8-a01n01
  185. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (election_count_vote) info: election-attrd round 2 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  186. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_peer_message) info: Processing sync-response from el8-a01n02
  187. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_cs_flush) info: Sent 2 CPG messages (0 remaining, last=2): OK (1)
  188. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n01']/transient_attributes: OK (rc=0, origin=el8-a01n01/attrd/2, version=0.15.0)
  189. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n01/crmd/4, version=0.15.0)
  190. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (action_synced_wait) info: Managed fence_virsh_metadata_1 process 7382 exited with rc=0
  191. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (stonith_device_register) notice: Added 'virsh_node1' to the device list (1 active devices)
  192. Jul 14 22:18:35 el8-a01n01.digimer.ca pacemaker-fenced [7331] (stonith_device_register) notice: Added 'virsh_node2' to the device list (2 active devices)
  193. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/4, version=0.15.0)
  194. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_cpg_membership) info: Group crmd event 0: node 1 pid 7335 joined via cpg_join
  195. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_cpg_membership) info: Group crmd event 0: el8-a01n01 (node 1 pid 7335) is member
  196. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_cpg_membership) info: Group crmd event 1: node 2 pid 1570 joined via cpg_join
  197. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_cpg_membership) info: Group crmd event 1: el8-a01n01 (node 1 pid 7335) is member
  198. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (pcmk_cpg_membership) info: Group crmd event 1: el8-a01n02 (node 2 pid 1570) is member
  199. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  200. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (peer_update_callback) info: Node el8-a01n02 is now a peer | DC=<none> old=0x0000000 new=0x4000000
  201. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
  202. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
  203. Jul 14 22:18:36 el8-a01n01.digimer.ca pacemaker-controld [7335] (te_connect_stonith) notice: Fencer successfully connected
  204. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_timer_popped) info: Election Trigger just popped | input=I_DC_TIMEOUT time=20000ms
  205. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_log) warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped
  206. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_state_transition) info: State transition S_PENDING -> S_ELECTION | input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped
  207. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (election_count_vote) info: election-DC round 1 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  208. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_state_transition) notice: State transition S_ELECTION -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote
  209. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_dc_release) info: DC role released
  210. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_te_control) info: Transitioner is now inactive
  211. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_log) info: Input I_RELEASE_SUCCESS received in state S_PENDING from do_dc_release
  212. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=el8-a01n02/crmd/8, version=0.15.0)
  213. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (update_dc) info: Set DC to el8-a01n02 (3.3.0)
  214. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_expected) info: update_dc: Node el8-a01n02[2] - expected state is now member (was (null))
  215. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/10, version=0.15.0)
  216. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/12, version=0.15.0)
  217. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/14, version=0.15.0)
  218. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_replace) info: Digest matched on replace from el8-a01n02: 2efe3adb921c1da251a57d1a819d3e7a
  219. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_replace) info: Replaced 0.15.0 with 0.15.0 from el8-a01n02
  220. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=el8-a01n02/crmd/17, version=0.15.0)
  221. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_log) info: Input I_NOT_DC received in state S_PENDING from do_cl_join_finalize_respond
  222. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_state_transition) notice: State transition S_PENDING -> S_NOT_DC | input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond
  223. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/18, version=0.15.0)
  224. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/19, version=0.15.0)
  225. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n01']/lrm: OK (rc=0, origin=el8-a01n02/crmd/20, version=0.15.0)
  226. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.0 2
  227. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.1 (null)
  228. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=1
  229. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status: <node_state id="1" uname="el8-a01n01" in_ccm="true" crmd="online" crm-debug-origin="do_lrm_query_internal"/>
  230. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm id="1">
  231. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_resources/>
  232. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm>
  233. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </node_state>
  234. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/21, version=0.15.1)
  235. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n02']/lrm: OK (rc=0, origin=el8-a01n02/crmd/22, version=0.15.1)
  236. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.1 2
  237. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.2 (null)
  238. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=2
  239. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status: <node_state id="2" uname="el8-a01n02" in_ccm="true" crmd="online" crm-debug-origin="do_lrm_query_internal"/>
  240. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm id="2">
  241. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_resources/>
  242. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm>
  243. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </node_state>
  244. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/23, version=0.15.2)
  245. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-22.raw
  246. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Wrote version 0.15.0 of the CIB to disk (digest: 82d7477d0ff671fbf6bcda5e74ef2f1d)
  247. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.uFpK26 (digest: /var/lib/pacemaker/cib/cib.EQQ3px)
  248. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/26, version=0.15.2)
  249. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.2 2
  250. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.3 (null)
  251. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=3
  252. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
  253. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
  254. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/27, version=0.15.3)
  255. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.3 2
  256. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.4 (null)
  257. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=4, @dc-uuid=2
  258. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=el8-a01n02/crmd/28, version=0.15.4)
  259. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.4 2
  260. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.5 (null)
  261. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=5
  262. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
  263. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="virsh_node1" type="fence_virsh" class="stonith"/>
  264. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node1_last_0" operation_key="virsh_node1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="5:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;5:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-statu
  265. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  266. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/30, version=0.15.5)
  267. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'virsh_node1' not in cache
  268. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  269. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_rsc_register) info: Cached agent information for 'virsh_node1'
  270. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=1
  271. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  272. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=1:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node1_monitor_0
  273. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.5 2
  274. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.6 (null)
  275. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=6
  276. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="virsh_node2" type="fence_virsh" class="stonith"/>
  277. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node2_last_0" operation_key="virsh_node2_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="6:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;6:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-statu
  278. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  279. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/31, version=0.15.6)
  280. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.6 2
  281. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.7 (null)
  282. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=7
  283. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:7;5:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=5, @rc-code=7, @op-status=0, @exec-time=5
  284. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/32, version=0.15.7)
  285. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.7 2
  286. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.8 (null)
  287. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=8
  288. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:7;6:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=9, @rc-code=7, @op-status=0
  289. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/33, version=0.15.8)
  290. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.8 2
  291. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.9 (null)
  292. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=9
  293. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="hypervisor" type="libvirtd" class="systemd"/>
  294. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="hypervisor_last_0" operation_key="hypervisor_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="7:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;7:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-status=
  295. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  296. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/34, version=0.15.9)
  297. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.9 2
  298. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.10 (null)
  299. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=10
  300. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="drbd" type="drbd" class="systemd"/>
  301. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="drbd_last_0" operation_key="drbd_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="8:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;8:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-status="-1" interva
  302. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  303. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/35, version=0.15.10)
  304. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.10 2
  305. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.11 (null)
  306. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=11
  307. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:7;7:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=14, @rc-code=7, @op-status=0, @exec-time=45
  308. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/36, version=0.15.11)
  309. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.11 2
  310. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.12 (null)
  311. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=12
  312. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:7;8:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=19, @rc-code=7, @op-status=0, @exec-time=37
  313. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/37, version=0.15.12)
  314. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (action_synced_wait) info: Managed fence_virsh_metadata_1 process 8638 exited with rc=0
  315. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/9)
  316. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=5, reply=1, notify=0
  317. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:virsh_node1 action:monitor call_id:5
  318. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (stonith_api_signon) debug: Attempting fencer connection by pacemaker-execd with mainloop
  319. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.12 2
  320. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.13 (null)
  321. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=13
  322. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_update_resource
  323. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="virsh_node1" type="fence_virsh" class="stonith"/>
  324. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node1_last_0" operation_key="virsh_node1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="1:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;1:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-statu
  325. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  326. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/9, version=0.15.13)
  327. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  328. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  329. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  330. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (stonith_api_signon) debug: Connection to fencer by pacemaker-execd succeeded (registration token: 440e6f7f-2fe1-4a52-a5de-26ed4986c329)
  331. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:5 exit-code:7 exec-time:5ms queue-time:0ms
  332. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'virsh_node2' not in cache
  333. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  334. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_rsc_register) info: Cached agent information for 'virsh_node2'
  335. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=1
  336. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  337. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=2:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node2_monitor_0
  338. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/10)
  339. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=9, reply=1, notify=0
  340. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:virsh_node2 action:monitor call_id:9
  341. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:virsh_node2 action:monitor call_id:9 exit-code:7 exec-time:0ms queue-time:0ms
  342. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.13 2
  343. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.14 (null)
  344. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=14
  345. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="virsh_node2" type="fence_virsh" class="stonith"/>
  346. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node2_last_0" operation_key="virsh_node2_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="2:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;2:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-statu
  347. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  348. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of probe operation for virsh_node1 on el8-a01n01: 7 (not running) | call=5 key=virsh_node1_monitor_0 confirmed=true cib-update=11
  349. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/10, version=0.15.14)
  350. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/11)
  351. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.14 2
  352. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.15 (null)
  353. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=15
  354. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:7;1:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=5, @rc-code=7, @op-status=0, @exec-time=5
  355. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/11, version=0.15.15)
  356. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/12)
  357. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of probe operation for virsh_node2 on el8-a01n01: 7 (not running) | call=9 key=virsh_node2_monitor_0 confirmed=true cib-update=12
  358. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.15 2
  359. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.16 (null)
  360. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=16
  361. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:7;2:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=9, @rc-code=7, @op-status=0
  362. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/12, version=0.15.16)
  363. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=9:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node1_start_0
  364. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/13)
  365. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=10, reply=1, notify=0
  366. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:virsh_node1 action:start call_id:10
  367. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.16 2
  368. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.17 (null)
  369. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=17
  370. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @operation_key=virsh_node1_start_0, @operation=start, @transition-key=9:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;9:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0
  371. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/13, version=0.15.17)
  372. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.17 2
  373. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.18 (null)
  374. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=18
  375. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_start_0, @operation=start, @transition-key=11:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;11:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1
  376. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/38, version=0.15.18)
  377. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'hypervisor' not in cache
  378. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  379. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'hypervisor:0' not in cache
  380. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  381. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_rsc_register) info: Cached agent information for 'hypervisor'
  382. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=1
  383. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  384. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=3:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e op=hypervisor_monitor_0
  385. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/14)
  386. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=15, reply=1, notify=0
  387. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:15
  388. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.18 2
  389. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.19 (null)
  390. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=19
  391. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="hypervisor" type="libvirtd" class="systemd"/>
  392. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="hypervisor_last_0" operation_key="hypervisor_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="3:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;3:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-status=
  393. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  394. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/14, version=0.15.19)
  395. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  396. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  397. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:15 exit-code:7 exec-time:78ms queue-time:0ms
  398. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of probe operation for hypervisor on el8-a01n01: 7 (not running) | call=15 key=hypervisor_monitor_0 confirmed=true cib-update=15
  399. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/15)
  400. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.19 2
  401. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.20 (null)
  402. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=20
  403. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:7;3:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=15, @rc-code=7, @op-status=0, @exec-time=78
  404. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/15, version=0.15.20)
  405. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'drbd' not in cache
  406. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  407. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_get_rsc_info) info: Agent information for 'drbd:0' not in cache
  408. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  409. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_rsc_register) info: Cached agent information for 'drbd'
  410. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=1
  411. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  412. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=4:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e op=drbd_monitor_0
  413. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=20, reply=1, notify=0
  414. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:drbd action:monitor call_id:20
  415. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit drbd named 'drbd'
  416. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/16)
  417. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.20 2
  418. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  419. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.21 (null)
  420. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=21
  421. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="drbd" type="drbd" class="systemd"/>
  422. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <lrm_rsc_op id="drbd_last_0" operation_key="drbd_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="4:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;4:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-status="-1" interva
  423. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </lrm_resource>
  424. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/16, version=0.15.21)
  425. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.21 2
  426. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.22 (null)
  427. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=22
  428. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_start_0, @operation=start, @transition-key=15:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;15:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0
  429. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/39, version=0.15.22)
  430. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:drbd action:monitor call_id:20 exit-code:7 exec-time:16ms queue-time:0ms
  431. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of probe operation for drbd on el8-a01n01: 7 (not running) | call=20 key=drbd_monitor_0 confirmed=true cib-update=17
  432. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/17)
  433. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.22 2
  434. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.23 (null)
  435. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=23
  436. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:7;4:0:7:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=20, @rc-code=7, @op-status=0, @exec-time=16
  437. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/17, version=0.15.23)
  438. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=13:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=hypervisor_start_0
  439. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/18)
  440. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=21, reply=1, notify=0
  441. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:hypervisor action:start call_id:21
  442. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous start op on systemd unit libvirtd named 'hypervisor'
  443. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.23 2
  444. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.24 (null)
  445. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=24
  446. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_start_0, @operation=start, @transition-key=13:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;13:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0
  447. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/18, version=0.15.24)
  448. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec_with_unit) debug: Calling StartUnit for hypervisor: /org/freedesktop/systemd1/unit/libvirtd_2eservice
  449. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_exec_result) info: Call to start passed: /org/freedesktop/systemd1/job/980
  450. Jul 14 22:18:56 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: hypervisor start may still be in progress: re-scheduling (elapsed=341ms, remaining=99659ms, start_delay=2000ms)
  451. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.24 2
  452. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.25 (null)
  453. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=25
  454. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;11:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=20, @rc-code=0, @op-status=0, @exec-time=810
  455. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/40, version=0.15.25)
  456. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.25 2
  457. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.26 (null)
  458. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=26
  459. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']: <lrm_rsc_op id="virsh_node2_monitor_60000" operation_key="virsh_node2_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="12:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;12:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-
  460. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/41, version=0.15.26)
  461. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) info: finished - rsc:virsh_node1 action:start call_id:10 exit-code:0 exec-time:962ms queue-time:1ms
  462. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/19)
  463. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of start operation for virsh_node1 on el8-a01n01: 0 (ok) | call=10 key=virsh_node1_start_0 confirmed=true cib-update=19
  464. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.26 2
  465. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.27 (null)
  466. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=27
  467. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:0;9:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=10, @rc-code=0, @op-status=0, @exec-time=962, @queue-time=1
  468. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/19, version=0.15.27)
  469. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=10:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node1_monitor_60000
  470. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
  471. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=22, reply=1, notify=0
  472. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:virsh_node1 action:monitor call_id:22
  473. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.27 2
  474. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.28 (null)
  475. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=28
  476. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']: <lrm_rsc_op id="virsh_node1_monitor_60000" operation_key="virsh_node1_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="10:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;10:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-
  477. Jul 14 22:18:57 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/20, version=0.15.28)
  478. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.28 2
  479. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.29 (null)
  480. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=29
  481. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_monitor_60000']: @transition-magic=0:0;12:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=22, @rc-code=0, @op-status=0, @exec-time=765
  482. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/42, version=0.15.29)
  483. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.29 2
  484. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.30 (null)
  485. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=30
  486. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @operation_key=drbd_start_0, @operation=start, @transition-key=23:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;23:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765138, @last-run=1594765138, @exec-time=0
  487. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/43, version=0.15.30)
  488. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:22 exit-code:0 exec-time:870ms queue-time:1ms
  489. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of monitor operation for virsh_node1 on el8-a01n01: 0 (ok) | call=22 key=virsh_node1_monitor_60000 confirmed=false cib-update=21
  490. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/21)
  491. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.30 2
  492. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.31 (null)
  493. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=31
  494. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_monitor_60000']: @transition-magic=0:0;10:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=22, @rc-code=0, @op-status=0, @exec-time=870, @queue-time=1
  495. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/21, version=0.15.31)
  496. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=21:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=drbd_start_0
  497. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=23, reply=1, notify=0
  498. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:drbd action:start call_id:23
  499. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/22)
  500. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.31 2
  501. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.32 (null)
  502. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=32
  503. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous start op on systemd unit drbd named 'drbd'
  504. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @operation_key=drbd_start_0, @operation=start, @transition-key=21:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;21:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765138, @last-run=1594765138, @exec-time=0
  505. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/22, version=0.15.32)
  506. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec_with_unit) debug: Calling StartUnit for drbd: /org/freedesktop/systemd1/unit/drbd_2eservice
  507. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_exec_result) info: Call to start passed: /org/freedesktop/systemd1/job/1064
  508. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: drbd start may still be in progress: re-scheduling (elapsed=214ms, remaining=99786ms, start_delay=2000ms)
  509. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.32 2
  510. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.33 (null)
  511. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=33
  512. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;15:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=21, @rc-code=0, @op-status=0, @exec-time=2275
  513. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/44, version=0.15.33)
  514. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.33 2
  515. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.34 (null)
  516. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=34
  517. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']: <lrm_rsc_op id="hypervisor_monitor_60000" operation_key="hypervisor_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="16:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;16:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01
  518. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/45, version=0.15.34)
  519. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.34 2
  520. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.35 (null)
  521. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=35
  522. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_monitor_60000']: @transition-magic=0:0;16:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=24, @rc-code=0, @op-status=0, @exec-time=5
  523. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/46, version=0.15.35)
  524. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:21
  525. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  526. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  527. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: hypervisor start is now complete (elapsed=2346ms, remaining=97654ms): ok (0)
  528. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:21 exit-code:0 exec-time:2346ms queue-time:0ms
  529. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of start operation for hypervisor on el8-a01n01: 0 (ok) | call=21 key=hypervisor_start_0 confirmed=true cib-update=23
  530. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/23)
  531. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.35 2
  532. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.36 (null)
  533. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=36
  534. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;13:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=21, @rc-code=0, @op-status=0, @exec-time=2346
  535. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/23, version=0.15.36)
  536. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=14:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=hypervisor_monitor_60000
  537. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=24, reply=1, notify=0
  538. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:24
  539. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  540. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
  541. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  542. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.36 2
  543. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.37 (null)
  544. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=37
  545. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']: <lrm_rsc_op id="hypervisor_monitor_60000" operation_key="hypervisor_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="14:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;14:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01
  546. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:24 exit-code:0 exec-time:10ms queue-time:0ms
  547. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of monitor operation for hypervisor on el8-a01n01: 0 (ok) | call=24 key=hypervisor_monitor_60000 confirmed=false cib-update=25
  548. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/24, version=0.15.37)
  549. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/25)
  550. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.37 2
  551. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.38 (null)
  552. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=38
  553. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_monitor_60000']: @transition-magic=0:0;14:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=24, @rc-code=0, @op-status=0, @exec-time=10
  554. Jul 14 22:18:58 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/25, version=0.15.38)
  555. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.38 2
  556. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.39 (null)
  557. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=39
  558. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:0;23:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=23, @rc-code=0, @op-status=0, @exec-time=2267
  559. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/47, version=0.15.39)
  560. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.39 2
  561. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.40 (null)
  562. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=40
  563. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']: <lrm_rsc_op id="drbd_monitor_60000" operation_key="drbd_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="24:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;24:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n02" call-id="-1"
  564. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/48, version=0.15.40)
  565. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.40 2
  566. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.41 (null)
  567. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=41
  568. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_monitor_60000']: @transition-magic=0:0;24:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=25, @rc-code=0, @op-status=0, @exec-time=4
  569. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/49, version=0.15.41)
  570. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:drbd action:monitor call_id:23
  571. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit drbd named 'drbd'
  572. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  573. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: drbd start is now complete (elapsed=2218ms, remaining=97782ms): ok (0)
  574. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:drbd action:monitor call_id:23 exit-code:0 exec-time:2218ms queue-time:1ms
  575. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of start operation for drbd on el8-a01n01: 0 (ok) | call=23 key=drbd_start_0 confirmed=true cib-update=26
  576. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/26)
  577. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.41 2
  578. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.42 (null)
  579. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=42
  580. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:0;21:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=23, @rc-code=0, @op-status=0, @exec-time=2218, @queue-time=1
  581. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/26, version=0.15.42)
  582. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=22:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=drbd_monitor_60000
  583. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=25, reply=1, notify=0
  584. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:drbd action:monitor call_id:25
  585. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit drbd named 'drbd'
  586. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/27)
  587. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.42 2
  588. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.43 (null)
  589. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=43
  590. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']: <lrm_rsc_op id="drbd_monitor_60000" operation_key="drbd_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="22:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" transition-magic="-1:193;22:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e" exit-reason="" on_node="el8-a01n01" call-id="-1"
  591. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/27, version=0.15.43)
  592. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  593. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:drbd action:monitor call_id:25 exit-code:0 exec-time:6ms queue-time:0ms
  594. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of monitor operation for drbd on el8-a01n01: 0 (ok) | call=25 key=drbd_monitor_60000 confirmed=false cib-update=28
  595. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
  596. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.43 2
  597. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.15.44 (null)
  598. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=44
  599. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_monitor_60000']: @transition-magic=0:0;22:0:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=25, @rc-code=0, @op-status=0, @exec-time=6
  600. Jul 14 22:19:00 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/28, version=0.15.44)
  601. Jul 14 22:19:05 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_procfs_pid_of) info: Found pacemaker-based active as process 7330
  602. Jul 14 22:19:05 el8-a01n01.digimer.ca pacemaker-controld [7335] (throttle_send_command) info: New throttle mode: negligible load (was undetermined)
  603. Jul 14 22:19:05 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_ping) info: Reporting our current digest to el8-a01n02: 6d5e9e37570d7b60632f978059877856 for 0.15.44 (0x55ac13439280 0)
  604. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_apply_diff operation for section 'all' to all (origin=local/cibadmin/2)
  605. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.15.44 2
  606. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.0 3d93222d8ce2098e91b58274347b8c85
  607. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @epoch=16, @num_updates=0
  608. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/configuration/resources/clone[@id='drbd-clone']/primitive[@id='drbd']/meta_attributes[@id='drbd-meta_attributes']: <nvpair id="drbd-meta_attributes-target-role" name="target-role" value="Stopped"/>
  609. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=el8-a01n01/cibadmin/2, version=0.16.0)
  610. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-fenced [7331] (update_cib_stonith_devices_v2) info: Updating device list from the cib: create meta_attributes[@id='drbd-meta_attributes']
  611. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-fenced [7331] (cib_devices_update) info: Updating devices to version 0.16.0
  612. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-23.raw
  613. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Wrote version 0.16.0 of the CIB to disk (digest: 9ac5ee247228cbebb26d752a5874dee5)
  614. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.7zU6I6 (digest: /var/lib/pacemaker/cib/cib.L3Y9CQ)
  615. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (cancel_recurring_action) info: Cancelling systemd operation drbd_status_60000
  616. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:drbd action:monitor call_id:25 exit-code:0 exec-time:0ms queue-time:0ms
  617. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_cancel operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  618. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=19:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=drbd_stop_0
  619. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=27, reply=1, notify=0
  620. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:drbd action:stop call_id:27
  621. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous stop op on systemd unit drbd named 'drbd'
  622. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.0 2
  623. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.1 (null)
  624. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=1
  625. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @operation_key=drbd_stop_0, @operation=stop, @transition-key=20:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;20:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765184, @last-run=1594765184, @exec-time=0
  626. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/51, version=0.16.1)
  627. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
  628. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.1 2
  629. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.2 (null)
  630. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=2
  631. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @operation_key=drbd_stop_0, @operation=stop, @transition-key=19:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;19:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765184, @last-run=1594765184, @exec-time=0, @queue-time=0
  632. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/29, version=0.16.2)
  633. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec_with_unit) debug: Calling StopUnit for drbd: /org/freedesktop/systemd1/unit/drbd_2eservice
  634. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) info: Result of monitor operation for drbd on el8-a01n01: Cancelled | call=25 key=drbd_monitor_60000 confirmed=true
  635. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_exec_result) info: Call to stop passed: /org/freedesktop/systemd1/job/1158
  636. Jul 14 22:19:44 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: drbd stop may still be in progress: re-scheduling (elapsed=236ms, remaining=99764ms, start_delay=2000ms)
  637. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.2 2
  638. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.3 (null)
  639. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=3
  640. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:0;20:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=27, @rc-code=0, @op-status=0, @exec-time=2205
  641. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/52, version=0.16.3)
  642. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:drbd action:monitor call_id:27
  643. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit drbd named 'drbd'
  644. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  645. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: drbd stop is now complete (elapsed=2244ms, remaining=97756ms): not running (7)
  646. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:drbd action:monitor call_id:27 exit-code:0 exec-time:2244ms queue-time:0ms
  647. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of stop operation for drbd on el8-a01n01: 0 (ok) | call=27 key=drbd_stop_0 confirmed=true cib-update=30
  648. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/30)
  649. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.3 2
  650. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.4 (null)
  651. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=4
  652. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:0;19:1:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=27, @rc-code=0, @op-status=0, @exec-time=2244
  653. Jul 14 22:19:46 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/30, version=0.16.4)
  654. Jul 14 22:19:51 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_ping) info: Reporting our current digest to el8-a01n02: c9fc5e41d0d91479ef3a8c683462f6ab for 0.16.4 (0x55ac13453a80 0)
  655. Jul 14 22:19:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:virsh_node1 action:monitor call_id:22
  656. Jul 14 22:19:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (recurring_action_timer) debug: Scheduling another invocation of hypervisor_status_60000
  657. Jul 14 22:19:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  658. Jul 14 22:19:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  659. Jul 14 22:19:58 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:24 exit-code:0 exec-time:0ms queue-time:0ms
  660. Jul 14 22:19:59 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:22 exit-code:0 exec-time:706ms queue-time:0ms
  661. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_expected) info: handle_request: Node el8-a01n02[2] - expected state is now down (was member)
  662. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_peer_update) notice: Setting shutdown[el8-a01n02]: (unset) -> 1594765206 | from el8-a01n02
  663. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.4 2
  664. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.5 (null)
  665. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=5
  666. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']: <transient_attributes id="2"/>
  667. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <instance_attributes id="status-2">
  668. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <nvpair id="status-2-shutdown" name="shutdown" value="1594765206"/>
  669. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </instance_attributes>
  670. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </transient_attributes>
  671. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/attrd/4, version=0.16.5)
  672. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.5 2
  673. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.6 (null)
  674. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=6
  675. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_stop_0, @operation=stop, @transition-key=7:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;7:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765206, @last-run=1594765206, @exec-time=0
  676. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/54, version=0.16.6)
  677. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.6 2
  678. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.7 (null)
  679. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=7
  680. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;7:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=29, @rc-code=0, @op-status=0
  681. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/55, version=0.16.7)
  682. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=8:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node2_start_0
  683. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
  684. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.7 2
  685. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.8 (null)
  686. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=8
  687. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_start_0, @operation=start, @transition-key=8:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;8:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765206, @last-run=1594765206
  688. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/31, version=0.16.8)
  689. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=28, reply=1, notify=0
  690. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:virsh_node2 action:start call_id:28
  691. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.8 2
  692. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.9 (null)
  693. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=9
  694. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_stop_0, @operation=stop, @transition-key=12:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;12:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765206, @last-run=1594765206, @exec-time=0
  695. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/56, version=0.16.9)
  696. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemakerd [7329] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  697. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_shutdown_worker) notice: Shutting down Pacemaker
  698. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-controld | sent signal 15 to process 7335
  699. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  700. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_shutdown) notice: Shutting down cluster resource manager | limit=1200000ms
  701. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_shutdown_req) info: Sending shutdown request to all peers (DC is el8-a01n02)
  702. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_update_peer_expected) info: handle_request: Node el8-a01n01[1] - expected state is now down (was (null))
  703. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_peer_update) notice: Setting shutdown[el8-a01n01]: (unset) -> 1594765206 | from el8-a01n02
  704. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.9 2
  705. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.10 (null)
  706. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=10
  707. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']: <transient_attributes id="1"/>
  708. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <instance_attributes id="status-1">
  709. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ <nvpair id="status-1-shutdown" name="shutdown" value="1594765206"/>
  710. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </instance_attributes>
  711. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: ++ </transient_attributes>
  712. Jul 14 22:20:06 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/attrd/5, version=0.16.10)
  713. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) info: finished - rsc:virsh_node2 action:start call_id:28 exit-code:0 exec-time:697ms queue-time:0ms
  714. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of start operation for virsh_node2 on el8-a01n01: 0 (ok) | call=28 key=virsh_node2_start_0 confirmed=true cib-update=32
  715. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/32)
  716. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.10 2
  717. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.11 (null)
  718. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=11
  719. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;8:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=28, @rc-code=0, @op-status=0, @exec-time=697
  720. Jul 14 22:20:07 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/32, version=0.16.11)
  721. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.11 2
  722. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.12 (null)
  723. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=12
  724. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;12:2:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=31, @rc-code=0, @op-status=0, @exec-time=2198
  725. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/57, version=0.16.12)
  726. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:22 exit-code:0 exec-time:0ms queue-time:0ms
  727. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_cancel operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  728. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=3:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node1_stop_0
  729. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=30, reply=1, notify=0
  730. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/33)
  731. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:virsh_node1 action:stop call_id:30
  732. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) info: Result of monitor operation for virsh_node1 on el8-a01n01: Cancelled | call=22 key=virsh_node1_monitor_60000 confirmed=true
  733. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) info: finished - rsc:virsh_node1 action:stop call_id:30 exit-code:0 exec-time:0ms queue-time:1ms
  734. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=4:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=virsh_node2_stop_0
  735. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.12 2
  736. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.13 (null)
  737. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=13
  738. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=31, reply=1, notify=0
  739. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @operation_key=virsh_node1_stop_0, @operation=stop, @transition-key=3:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;3:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765208, @last-run=1594765208, @exec-time=0, @q
  740. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:virsh_node2 action:stop call_id:31
  741. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of stop operation for virsh_node1 on el8-a01n01: 0 (ok) | call=30 key=virsh_node1_stop_0 confirmed=true cib-update=35
  742. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/33, version=0.16.13)
  743. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) info: finished - rsc:virsh_node2 action:stop call_id:31 exit-code:0 exec-time:1ms queue-time:0ms
  744. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/34)
  745. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/35)
  746. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (cancel_recurring_action) info: Cancelling systemd operation hypervisor_status_60000
  747. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:24 exit-code:0 exec-time:0ms queue-time:0ms
  748. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_cancel operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=0, reply=1, notify=0
  749. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_rsc_op) info: Performing key=5:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e op=hypervisor_stop_0
  750. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 7a9d5d39-04c6-4f24-bb8c-bf00ea6fb29a: rc=33, reply=1, notify=0
  751. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.13 2
  752. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) info: executing - rsc:hypervisor action:stop call_id:33
  753. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.14 (null)
  754. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=14
  755. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous stop op on systemd unit libvirtd named 'hypervisor'
  756. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_stop_0, @operation=stop, @transition-key=4:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;4:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765208, @last-run=1594765208, @exec-time=0
  757. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/34, version=0.16.14)
  758. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.14 2
  759. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.15 (null)
  760. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=15
  761. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:0;3:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=30, @rc-code=0, @op-status=0, @queue-time=1
  762. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/35, version=0.16.15)
  763. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/36)
  764. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.15 2
  765. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.16 (null)
  766. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=16
  767. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_stop_0, @operation=stop, @transition-key=5:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @transition-magic=-1:193;5:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765208, @last-run=1594765208, @exec-time=0
  768. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/36, version=0.16.16)
  769. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec_with_unit) debug: Calling StopUnit for hypervisor: /org/freedesktop/systemd1/unit/libvirtd_2eservice
  770. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/37)
  771. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.16 2
  772. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.17 (null)
  773. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=17
  774. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;4:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=31, @rc-code=0, @op-status=0, @exec-time=1
  775. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/37, version=0.16.17)
  776. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of stop operation for virsh_node2 on el8-a01n01: 0 (ok) | call=31 key=virsh_node2_stop_0 confirmed=true cib-update=37
  777. Jul 14 22:20:08 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) info: Result of monitor operation for hypervisor on el8-a01n01: Cancelled | call=24 key=hypervisor_monitor_60000 confirmed=true
  778. Jul 14 22:20:09 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_exec_result) info: Call to stop passed: /org/freedesktop/systemd1/job/1165
  779. Jul 14 22:20:09 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: hypervisor stop may still be in progress: re-scheduling (elapsed=256ms, remaining=99744ms, start_delay=2000ms)
  780. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:33
  781. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  782. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  783. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (action_complete) debug: hypervisor stop is now complete (elapsed=2260ms, remaining=97740ms): not running (7)
  784. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:33 exit-code:0 exec-time:2260ms queue-time:0ms
  785. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (process_lrm_event) notice: Result of stop operation for hypervisor on el8-a01n01: 0 (ok) | call=33 key=hypervisor_stop_0 confirmed=true cib-update=38
  786. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/38)
  787. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.17 2
  788. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.18 (null)
  789. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=18
  790. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;5:3:0:22298a5d-b80a-4cd7-adde-aba652405a4e, @call-id=33, @rc-code=0, @op-status=0, @exec-time=2260
  791. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/38, version=0.16.18)
  792. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (handle_request) info: Shutting down
  793. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_state_transition) notice: State transition S_NOT_DC -> S_STOPPING | input=I_STOP cause=C_HA_MESSAGE origin=route_message
  794. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (tengine_stonith_connection_destroy) info: Fencing daemon disconnected
  795. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_control) info: Disconnecting from the executor
  796. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (lrmd_api_disconnect) info: Disconnecting IPC local executor connection
  797. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_dispatch_connection_request) debug: HUP conn (/dev/shm/qb-7332-7335-9-NPbmWF/qb)
  798. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_disconnect) debug: qb_ipcs_disconnect(/dev/shm/qb-7332-7335-9-NPbmWF/qb) state:2
  799. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (crm_client_destroy) debug: Destroying 0 events
  800. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-7332-7335-9-NPbmWF/qb-response-lrmd-header
  801. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-7332-7335-9-NPbmWF/qb-event-lrmd-header
  802. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-7332-7335-9-NPbmWF/qb-request-lrmd-header
  803. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (lrmd_ipc_connection_destroy) info: IPC connection destroyed
  804. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (lrm_connection_destroy) info: Disconnected from executor
  805. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (lrmd_api_disconnect) info: Disconnecting IPC local executor connection
  806. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_lrm_control) notice: Disconnected from the executor
  807. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  808. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (terminate_cs_connection) notice: Disconnected from Corosync
  809. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_ha_control) info: Disconnected from the cluster
  810. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_cib_control) info: Disconnecting from the CIB manager
  811. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crmd_cib_connection_destroy) info: Connection to the CIB manager terminated
  812. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_cib_control) notice: Disconnected from the CIB manager
  813. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  814. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_exit) info: Performing A_EXIT_0 - gracefully exiting the controller
  815. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (do_exit) info: [pacemaker-controld] stopped (0)
  816. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crmd_exit) info: Dropping I_TERMINATE: [ state=S_STOPPING cause=C_FSA_INTERNAL origin=do_stop ]
  817. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crmd_cs_destroy) info: Corosync connection closed
  818. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crmd_cs_destroy) info: Corosync connection closed
  819. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crmd_init) info: pacemaker-controld[7335] exiting with status 0 (OK)
  820. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-controld [7335] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  821. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-controld[7335] exited with status 0 (OK)
  822. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  823. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  824. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-schedulerd[7334] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  825. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-schedulerd | sent signal 15 to process 7334
  826. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-schedulerd[7334] exited with status 0 (OK)
  827. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-attrd | sent signal 15 to process 7333
  828. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: --- 0.16.18 2
  829. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: Diff: +++ 0.16.19 (null)
  830. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib: @num_updates=19
  831. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_dc_release, @expected=down
  832. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  833. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-attrd [7333] (main) info: Shutting down attribute manager
  834. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-attrd [7333] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  835. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-attrd [7333] (attrd_cib_destroy_cb) info: Connection disconnection complete
  836. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-attrd [7333] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  837. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_event_sendv) warning: new_event_notification (/dev/shm/qb-7330-7333-11-tDbJZG/qb): Broken pipe (32)
  838. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_notify_send_one) warning: Notification of client attrd/43138264-95a2-4437-86af-201b04e3f29b failed
  839. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/59, version=0.16.19)
  840. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-attrd[7333] exited with status 0 (OK)
  841. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-execd | sent signal 15 to process 7332
  842. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  843. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (lrmd_exit) info: Terminating with 0 clients
  844. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (stonith_api_del_notification) debug: Removing callback for st_notify_disconnect events
  845. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (stonith_api_signoff) debug: Disconnecting from the fencer
  846. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcc_disconnect) debug: qb_ipcc_disconnect()
  847. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-7331-7332-12-dwnItX/qb-request-stonith-ng-header
  848. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-7331-7332-12-dwnItX/qb-response-stonith-ng-header
  849. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-7331-7332-12-dwnItX/qb-event-stonith-ng-header
  850. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  851. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (qb_ipcs_unref) debug: qb_ipcs_unref() - destroying
  852. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-execd [7332] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  853. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-execd[7332] exited with status 0 (OK)
  854. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-fenced | sent signal 15 to process 7331
  855. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  856. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-fenced [7331] (stonith_shutdown) info: Terminating with 0 clients
  857. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-fenced [7331] (cib_connection_destroy) info: Connection to the CIB manager closed
  858. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-fenced [7331] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  859. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-fenced [7331] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  860. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-fenced[7331] exited with status 0 (OK)
  861. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (stop_child) notice: Stopping pacemaker-based | sent signal 15 to process 7330
  862. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  863. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_shutdown) info: Disconnected 0 clients
  864. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_shutdown) info: All clients disconnected (0)
  865. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (initiate_exit) info: Sending disconnect notification to 2 peers...
  866. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_shutdown_req) info: Peer el8-a01n01 is requesting to shut down
  867. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_process_shutdown_req) info: Peer el8-a01n01 has acknowledged our shutdown request
  868. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (terminate_cib) info: cib_process_shutdown_req: Exiting from mainloop...
  869. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  870. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (terminate_cs_connection) notice: Disconnected from Corosync
  871. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_get_peer) info: Created entry 847cbb6c-98da-4969-a88d-905f74eee34a/0x55ac132a6470 for node el8-a01n01/0 (1 total)
  872. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cib_peer_update_callback) info: No more peers
  873. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (terminate_cib) info: cib_peer_update_callback: Exiting from mainloop...
  874. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  875. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (cluster_disconnect_cpg) info: No CPG connection
  876. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (terminate_cs_connection) notice: Disconnected from Corosync
  877. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  878. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  879. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  880. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemaker-based [7330] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  881. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_child_exit) info: pacemaker-based[7330] exited with status 0 (OK)
  882. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (pcmk_shutdown_worker) notice: Shutdown complete
  883. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  884. Jul 14 22:20:11 el8-a01n01.digimer.ca pacemakerd [7329] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  885. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  886. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (get_cluster_type) info: Detected an active 'corosync' cluster
  887. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (mcp_read_config) info: Reading configure for stack: corosync
  888. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (main) notice: Starting Pacemaker 2.0.3-5.el8_2.1 | build=4b1f869f0f features: generated-manpages agent-manpages ncurses libqb-logging libqb-ipc systemd nagios corosync-native atomic-attrd acls
  889. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (main) info: Maximum core file size is: 18446744073709551615
  890. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (qb_ipcs_us_publish) info: server name: pacemakerd
  891. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to lrmd IPC: Connection refused
  892. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to cib_ro IPC: Connection refused
  893. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to crmd IPC: Connection refused
  894. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to attrd IPC: Connection refused
  895. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to pengine IPC: Connection refused
  896. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk__ipc_is_authentic_process_active) info: Could not connect to stonith-ng IPC: Connection refused
  897. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Created entry a19fdd37-84d7-4118-a441-04031cc8cee3/0x55fc80c66860 for node el8-a01n01/1 (1 total)
  898. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  899. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Node 1 has uuid 1
  900. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  901. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (cluster_connect_quorum) warning: Quorum lost
  902. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Created entry e88f167c-3b4c-4309-a210-288f26823f9c/0x55fc80c68800 for node el8-a01n02/2 (2 total)
  903. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  904. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_get_peer) info: Node 2 has uuid 2
  905. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Using uid=189 and group=189 for process pacemaker-based
  906. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14953 for process pacemaker-based
  907. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14954 for process pacemaker-fenced
  908. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14955 for process pacemaker-execd
  909. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Using uid=189 and group=189 for process pacemaker-attrd
  910. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14956 for process pacemaker-attrd
  911. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Using uid=189 and group=189 for process pacemaker-schedulerd
  912. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14957 for process pacemaker-schedulerd
  913. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Using uid=189 and group=189 for process pacemaker-controld
  914. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (start_child) info: Forked child 14958 for process pacemaker-controld
  915. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (main) notice: Pacemaker daemon successfully started and accepting connections
  916. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_quorum_notification) info: Quorum still lost | membership=193 members=1
  917. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=pcmk_quorum_notification
  918. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (crm_reap_unseen_nodes) info: State of node el8-a01n02[2] is still unknown
  919. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_cpg_membership) info: Group pacemakerd event 0: node 1 pid 14952 joined via cpg_join
  920. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_cpg_membership) info: Group pacemakerd event 0: el8-a01n01 (node 1 pid 14952) is member
  921. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  922. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (main) notice: Starting Pacemaker scheduler
  923. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (qb_ipcs_us_publish) info: server name: pengine
  924. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (main) notice: Pacemaker scheduler successfully started and accepting connections
  925. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  926. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (main) notice: Starting Pacemaker fencer
  927. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (get_cluster_type) info: Verifying cluster type: 'corosync'
  928. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (get_cluster_type) info: Assuming an active 'corosync' cluster
  929. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  930. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  931. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (main) notice: Starting Pacemaker CIB manager
  932. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (get_cluster_type) info: Verifying cluster type: 'corosync'
  933. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (get_cluster_type) info: Assuming an active 'corosync' cluster
  934. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (retrieveCib) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
  935. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  936. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-attrd [14956] (main) notice: Starting Pacemaker node attribute manager
  937. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  938. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-controld [14958] (main) notice: Starting Pacemaker controller
  939. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_log) info: Input I_STARTUP received in state S_STARTING from crmd_init
  940. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-execd [14955] (crm_log_init) info: Changed active directory to /var/lib/pacemaker/cores
  941. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-execd [14955] (main) notice: Starting Pacemaker local executor
  942. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_us_publish) info: server name: lrmd
  943. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-execd [14955] (main) notice: Pacemaker local executor successfully started and accepting connections
  944. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Created entry e9b081a8-013f-4438-a286-71a6a1aeef76/0x5579a28fcd60 for node el8-a01n01/1 (1 total)
  945. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  946. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  947. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Created entry da54e080-ca2f-4a23-b8f2-8bf8445c53b8/0x561964eeb320 for node el8-a01n01/1 (1 total)
  948. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  949. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Node 1 has uuid 1
  950. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  951. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  952. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-fenced [14954] (init_cs_connection_once) info: Connection to 'corosync': established
  953. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Node 1 has uuid 1
  954. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  955. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  956. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (init_cs_connection_once) info: Connection to 'corosync': established
  957. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_publish) info: server name: cib_ro
  958. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_publish) info: server name: cib_rw
  959. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_publish) info: server name: cib_shm
  960. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (main) notice: Pacemaker CIB manager successfully started and accepting connections
  961. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 0: node 1 pid 14953 joined via cpg_join
  962. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 0: el8-a01n01 (node 1 pid 14953) is member
  963. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-24.raw
  964. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_write_with_digest) info: Wrote version 0.16.0 of the CIB to disk (digest: 71670f38eb62dc5320749c7be8e07fc8)
  965. Jul 14 22:20:22 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.JOtAEd (digest: /var/lib/pacemaker/cib/cib.IqkRpL)
  966. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_cpg_membership) info: Group pacemakerd event 1: node 2 pid 2196 joined via cluster join
  967. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_cpg_membership) info: Group pacemakerd event 1: el8-a01n01 (node 1 pid 14952) is member
  968. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_cpg_membership) info: Group pacemakerd event 1: el8-a01n02 (node 2 pid 2196) is member
  969. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  970. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (crm_cs_flush) info: Sent 0 CPG messages (1 remaining, last=7): Try again (6)
  971. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_quorum_notification) notice: Quorum acquired | membership=197 members=2
  972. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemakerd [14952] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=pcmk_quorum_notification
  973. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 1: node 2 pid 2197 joined via cluster join
  974. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 1: el8-a01n01 (node 1 pid 14953) is member
  975. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Created entry c8f2cda8-094b-4e09-b8c0-993444881423/0x561964ef0aa0 for node el8-a01n02/2 (2 total)
  976. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  977. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_get_peer) info: Node 2 has uuid 2
  978. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 1: el8-a01n02 (node 2 pid 2197) is member
  979. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  980. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  981. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (get_cluster_type) info: Verifying cluster type: 'corosync'
  982. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (get_cluster_type) info: Assuming an active 'corosync' cluster
  983. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  984. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (main) info: CIB connection active
  985. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (get_cluster_type) info: Verifying cluster type: 'corosync'
  986. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (get_cluster_type) info: Assuming an active 'corosync' cluster
  987. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_cluster_connect) notice: Connecting to cluster infrastructure: corosync
  988. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Created entry c87d554a-70ed-47b3-a0a8-356e10aae50e/0x55b5f201deb0 for node el8-a01n01/1 (1 total)
  989. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  990. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Cluster node el8-a01n01 is now in unknown state
  991. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Created entry 11f4468a-c4ad-4023-8fa4-45da18cf7a35/0x55cf12635a20 for node el8-a01n01/1 (1 total)
  992. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Node 1 is now known as el8-a01n01
  993. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Node 1 has uuid 1
  994. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  995. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Node el8-a01n01 is now a peer | DC=<none> old=0x0000000 new=0x4000000
  996. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
  997. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (init_cs_connection_once) info: Connection to 'corosync': established
  998. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Node 1 has uuid 1
  999. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_update_peer_proc) info: cluster_connect_cpg: Node el8-a01n01[1] - corosync-cpg is now online
  1000. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
  1001. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (init_cs_connection_once) info: Connection to 'corosync': established
  1002. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n02']/transient_attributes: OK (rc=0, origin=el8-a01n02/attrd/2, version=0.16.0)
  1003. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (main) info: Cluster connection active
  1004. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_erase_attrs) info: Clearing transient attributes from CIB | xpath=//node_state[@uname='el8-a01n01']/transient_attributes
  1005. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_delete operation for section //node_state[@uname='el8-a01n01']/transient_attributes to all (origin=local/attrd/2)
  1006. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (cluster_connect_quorum) notice: Quorum acquired
  1007. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n01']/transient_attributes: OK (rc=0, origin=el8-a01n01/attrd/2, version=0.16.0)
  1008. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (setup_cib) info: Watching for stonith topology changes
  1009. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (qb_ipcs_us_publish) info: server name: stonith-ng
  1010. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (main) notice: Pacemaker fencer successfully started and accepting connections
  1011. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (pcmk_cpg_membership) info: Group stonith-ng event 0: node 1 pid 14954 joined via cpg_join
  1012. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (pcmk_cpg_membership) info: Group stonith-ng event 0: el8-a01n01 (node 1 pid 14954) is member
  1013. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (init_cib_cache_cb) info: Updating device list from the cib: init
  1014. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (qb_ipcs_us_publish) info: server name: attrd
  1015. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (main) notice: Pacemaker node attribute manager successfully started and accepting connections
  1016. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (pcmk_cpg_membership) info: Group attrd event 0: node 1 pid 14956 joined via cpg_join
  1017. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (pcmk_cpg_membership) info: Group attrd event 0: el8-a01n01 (node 1 pid 14956) is member
  1018. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (cib_devices_update) info: Updating devices to version 0.16.0
  1019. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Created entry 0f770a3c-3710-4a5e-82ad-12ab42870de9/0x55b5f2020790 for node el8-a01n02/2 (2 total)
  1020. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  1021. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Cluster node el8-a01n02 is now in unknown state
  1022. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_get_peer) info: Node 2 has uuid 2
  1023. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/4, version=0.16.0)
  1024. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Created entry 6b9dbb5e-b9c5-450d-a9ba-525ef70debb9/0x55cf1263c060 for node el8-a01n02/2 (2 total)
  1025. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  1026. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_get_peer) info: Node 2 has uuid 2
  1027. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (pcmk_cpg_membership) info: Group attrd event 0: el8-a01n02 (node 2 pid 2200) is member
  1028. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  1029. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  1030. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_peer_update) notice: Setting #attrd-protocol[el8-a01n02]: (unset) -> 2 | from el8-a01n02
  1031. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_start_election_if_needed) info: Starting an election to determine the writer
  1032. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (election_count_vote) info: election-attrd round 1 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  1033. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_peer_update) notice: Setting #attrd-protocol[el8-a01n01]: (unset) -> 2 | from el8-a01n01
  1034. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (election_count_vote) info: election-attrd round 2 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  1035. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_ha_control) info: Connected to the cluster
  1036. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/4)
  1037. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_peer_message) info: Processing sync-response from el8-a01n02
  1038. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (lrmd_ipc_connect) info: Connecting to executor
  1039. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (crm_client_new) debug: Connecting 0x5559575bbfb0 for uid=189 gid=189 pid=14958 id=5125103c-578c-42d5-9219-4148b4fc6cd0
  1040. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (handle_new_connection) debug: IPC credentials authenticated (/dev/shm/qb-14955-14958-9-DajKTi/qb)
  1041. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_shm_connect) debug: connecting to client [14958]
  1042. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1043. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1044. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1045. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n01/crmd/4, version=0.16.0)
  1046. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed register operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1047. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_control) info: Connection to the executor established
  1048. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_started) info: Delaying start, no membership data (0000000000100000)
  1049. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_started) info: Delaying start, no membership data (0000000000100000)
  1050. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_quorum_notification) info: Quorum retained | membership=197 members=2
  1051. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_state_iter) notice: Node el8-a01n01 state is now member | nodeid=1 previous=unknown source=pcmk_quorum_notification
  1052. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Cluster node el8-a01n01 is now member (was in unknown state)
  1053. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=pcmk_quorum_notification
  1054. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Cluster node el8-a01n02 is now member (was in unknown state)
  1055. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_started) info: Delaying start, Config not read (0000000000000040)
  1056. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (qb_ipcs_us_publish) info: server name: crmd
  1057. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_started) notice: Pacemaker controller successfully started and accepting connections
  1058. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_log) info: Input I_PENDING received in state S_STARTING from do_started
  1059. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_state_transition) notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
  1060. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (action_synced_wait) info: Managed fence_virsh_metadata_1 process 15024 exited with rc=0
  1061. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (stonith_device_register) notice: Added 'virsh_node1' to the device list (1 active devices)
  1062. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (stonith_device_register) notice: Added 'virsh_node2' to the device list (2 active devices)
  1063. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (pcmk_cpg_membership) info: Group stonith-ng event 1: node 2 pid 2198 joined via cluster join
  1064. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (pcmk_cpg_membership) info: Group stonith-ng event 1: el8-a01n01 (node 1 pid 14954) is member
  1065. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Created entry 89e9195b-a893-42a1-b09b-5163ad360fe4/0x5579a2a25af0 for node el8-a01n02/2 (2 total)
  1066. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Node 2 is now known as el8-a01n02
  1067. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_get_peer) info: Node 2 has uuid 2
  1068. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (pcmk_cpg_membership) info: Group stonith-ng event 1: el8-a01n02 (node 2 pid 2198) is member
  1069. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  1070. Jul 14 22:20:23 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
  1071. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_cpg_membership) info: Group crmd event 0: node 1 pid 14958 joined via cpg_join
  1072. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_cpg_membership) info: Group crmd event 0: el8-a01n01 (node 1 pid 14958) is member
  1073. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_cpg_membership) info: Group crmd event 1: node 2 pid 2202 joined via cpg_join
  1074. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_cpg_membership) info: Group crmd event 1: el8-a01n01 (node 1 pid 14958) is member
  1075. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (pcmk_cpg_membership) info: Group crmd event 1: el8-a01n02 (node 2 pid 2202) is member
  1076. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now online
  1077. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (peer_update_callback) info: Node el8-a01n02 is now a peer | DC=<none> old=0x0000000 new=0x4000000
  1078. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 5 seconds
  1079. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (te_trigger_stonith_history_sync) info: Fence history will be synchronized cluster-wide within 30 seconds
  1080. Jul 14 22:20:24 el8-a01n01.digimer.ca pacemaker-controld [14958] (te_connect_stonith) notice: Fencer successfully connected
  1081. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (election_count_vote) info: election-DC round 1 (owner node ID 2) lost: vote from el8-a01n02 (Uptime)
  1082. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_log) info: Input I_PENDING received in state S_PENDING from do_election_count_vote
  1083. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (update_dc) info: Set DC to el8-a01n02 (3.3.0)
  1084. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_expected) info: update_dc: Node el8-a01n02[2] - expected state is now member (was (null))
  1085. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=el8-a01n02/crmd/8, version=0.16.0)
  1086. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/10, version=0.16.0)
  1087. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/12, version=0.16.0)
  1088. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=el8-a01n02/crmd/14, version=0.16.0)
  1089. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_replace) info: Digest matched on replace from el8-a01n02: be52010831fd154fc90da9ca9708e392
  1090. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_replace) info: Replaced 0.16.0 with 0.16.0 from el8-a01n02
  1091. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_replace operation for section 'all': OK (rc=0, origin=el8-a01n02/crmd/17, version=0.16.0)
  1092. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_log) info: Input I_NOT_DC received in state S_PENDING from do_cl_join_finalize_respond
  1093. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_state_transition) notice: State transition S_PENDING -> S_NOT_DC | input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond
  1094. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/18, version=0.16.0)
  1095. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/19, version=0.16.0)
  1096. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n02']/lrm: OK (rc=0, origin=el8-a01n02/crmd/20, version=0.16.0)
  1097. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.0 2
  1098. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.1 (null)
  1099. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=1
  1100. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status: <node_state id="2" uname="el8-a01n02" in_ccm="true" crmd="online" crm-debug-origin="do_lrm_query_internal"/>
  1101. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm id="2">
  1102. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_resources/>
  1103. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm>
  1104. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </node_state>
  1105. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/21, version=0.16.1)
  1106. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_delete operation for section //node_state[@uname='el8-a01n01']/lrm: OK (rc=0, origin=el8-a01n02/crmd/22, version=0.16.1)
  1107. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.1 2
  1108. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.2 (null)
  1109. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=2
  1110. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status: <node_state id="1" uname="el8-a01n01" in_ccm="true" crmd="online" crm-debug-origin="do_lrm_query_internal"/>
  1111. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm id="1">
  1112. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_resources/>
  1113. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm>
  1114. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </node_state>
  1115. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/23, version=0.16.2)
  1116. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_backup) info: Archived previous version as /var/lib/pacemaker/cib/cib-25.raw
  1117. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section nodes: OK (rc=0, origin=el8-a01n02/crmd/26, version=0.16.2)
  1118. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.2 2
  1119. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.3 (null)
  1120. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=3
  1121. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
  1122. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_state_transition, @join=member, @expected=member
  1123. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/27, version=0.16.3)
  1124. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.3 2
  1125. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.4 (null)
  1126. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=4, @dc-uuid=2
  1127. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section cib: OK (rc=0, origin=el8-a01n02/crmd/28, version=0.16.4)
  1128. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_write_with_digest) info: Wrote version 0.16.0 of the CIB to disk (digest: 17149bee2ab28b054d280a7e9e1e7493)
  1129. Jul 14 22:20:44 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_file_write_with_digest) info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.WdIR5j (digest: /var/lib/pacemaker/cib/cib.ZOqELV)
  1130. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.4 2
  1131. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.5 (null)
  1132. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=5
  1133. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_update_resource
  1134. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="virsh_node1" type="fence_virsh" class="stonith"/>
  1135. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node1_last_0" operation_key="virsh_node1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="5:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;5:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-stat
  1136. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1137. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'virsh_node1' not in cache
  1138. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1139. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/31, version=0.16.5)
  1140. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_rsc_register) info: Cached agent information for 'virsh_node1'
  1141. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=1
  1142. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1143. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=1:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node1_monitor_0
  1144. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.5 2
  1145. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.6 (null)
  1146. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=6
  1147. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="virsh_node2" type="fence_virsh" class="stonith"/>
  1148. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node2_last_0" operation_key="virsh_node2_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="6:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;6:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-stat
  1149. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1150. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/32, version=0.16.6)
  1151. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.6 2
  1152. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.7 (null)
  1153. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=7
  1154. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:7;5:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=5, @rc-code=7, @op-status=0, @exec-time=10, @queue-time=1
  1155. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/33, version=0.16.7)
  1156. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.7 2
  1157. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.8 (null)
  1158. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=8
  1159. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:7;6:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=9, @rc-code=7, @op-status=0
  1160. Jul 14 22:20:45 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/34, version=0.16.8)
  1161. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.8 2
  1162. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.9 (null)
  1163. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=9
  1164. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="hypervisor" type="libvirtd" class="systemd"/>
  1165. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="hypervisor_last_0" operation_key="hypervisor_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="7:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;7:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-status
  1166. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1167. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/35, version=0.16.9)
  1168. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.9 2
  1169. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.10 (null)
  1170. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=10
  1171. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources: <lrm_resource id="drbd" type="drbd" class="systemd"/>
  1172. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="drbd_last_0" operation_key="drbd_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="8:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;8:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n02" call-id="-1" rc-code="193" op-status="-1" interv
  1173. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1174. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/36, version=0.16.10)
  1175. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.10 2
  1176. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.11 (null)
  1177. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=11
  1178. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:7;7:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=14, @rc-code=7, @op-status=0, @exec-time=63, @queue-time=1
  1179. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/37, version=0.16.11)
  1180. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.11 2
  1181. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.12 (null)
  1182. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=12
  1183. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:7;8:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=19, @rc-code=7, @op-status=0, @exec-time=58
  1184. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/38, version=0.16.12)
  1185. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (action_synced_wait) info: Managed fence_virsh_metadata_1 process 15809 exited with rc=0
  1186. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/8)
  1187. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=5, reply=1, notify=0
  1188. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:virsh_node1 action:monitor call_id:5
  1189. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (stonith_api_signon) debug: Attempting fencer connection by pacemaker-execd with mainloop
  1190. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.12 2
  1191. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.13 (null)
  1192. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=13
  1193. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']: @crm-debug-origin=do_update_resource
  1194. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="virsh_node1" type="fence_virsh" class="stonith"/>
  1195. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node1_last_0" operation_key="virsh_node1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="1:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;1:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-stat
  1196. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1197. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/8, version=0.16.13)
  1198. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1199. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1200. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_open_2) debug: shm size:131085; real_size:135168; rb->word_size:33792
  1201. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (stonith_api_signon) debug: Connection to fencer by pacemaker-execd succeeded (registration token: b20e9c24-c0a7-4dbe-94b6-1f965223c156)
  1202. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:5 exit-code:7 exec-time:7ms queue-time:0ms
  1203. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of probe operation for virsh_node1 on el8-a01n01: 7 (not running) | call=5 key=virsh_node1_monitor_0 confirmed=true cib-update=9
  1204. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/9)
  1205. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.13 2
  1206. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'virsh_node2' not in cache
  1207. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1208. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.14 (null)
  1209. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=14
  1210. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:7;1:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=5, @rc-code=7, @op-status=0, @last-rc-change=1594765246, @last-run=1594765246, @exec-time=7
  1211. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_rsc_register) info: Cached agent information for 'virsh_node2'
  1212. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=1
  1213. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/9, version=0.16.14)
  1214. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1215. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=2:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node2_monitor_0
  1216. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=9, reply=1, notify=0
  1217. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/10)
  1218. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:virsh_node2 action:monitor call_id:9
  1219. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:virsh_node2 action:monitor call_id:9 exit-code:7 exec-time:0ms queue-time:0ms
  1220. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of probe operation for virsh_node2 on el8-a01n01: 7 (not running) | call=9 key=virsh_node2_monitor_0 confirmed=true cib-update=11
  1221. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.14 2
  1222. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.15 (null)
  1223. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=15
  1224. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="virsh_node2" type="fence_virsh" class="stonith"/>
  1225. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="virsh_node2_last_0" operation_key="virsh_node2_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="2:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;2:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-stat
  1226. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1227. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=9:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node1_start_0
  1228. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/10, version=0.16.15)
  1229. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/11)
  1230. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/12)
  1231. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=10, reply=1, notify=0
  1232. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:virsh_node1 action:start call_id:10
  1233. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.15 2
  1234. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.16 (null)
  1235. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=16
  1236. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:7;2:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=9, @rc-code=7, @op-status=0
  1237. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/11, version=0.16.16)
  1238. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.16 2
  1239. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.17 (null)
  1240. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=17
  1241. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @operation_key=virsh_node1_start_0, @operation=start, @transition-key=9:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;9:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0
  1242. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/12, version=0.16.17)
  1243. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.17 2
  1244. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.18 (null)
  1245. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=18
  1246. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_start_0, @operation=start, @transition-key=11:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;11:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765246, @last-run=1594765246
  1247. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/39, version=0.16.18)
  1248. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'hypervisor' not in cache
  1249. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1250. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'hypervisor:0' not in cache
  1251. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1252. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_rsc_register) info: Cached agent information for 'hypervisor'
  1253. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=1
  1254. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1255. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=3:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=hypervisor_monitor_0
  1256. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=15, reply=1, notify=0
  1257. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:15
  1258. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/13)
  1259. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.18 2
  1260. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.19 (null)
  1261. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=19
  1262. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="hypervisor" type="libvirtd" class="systemd"/>
  1263. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="hypervisor_last_0" operation_key="hypervisor_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="3:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;3:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-status
  1264. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1265. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  1266. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/13, version=0.16.19)
  1267. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  1268. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:15 exit-code:7 exec-time:14ms queue-time:2ms
  1269. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of probe operation for hypervisor on el8-a01n01: 7 (not running) | call=15 key=hypervisor_monitor_0 confirmed=true cib-update=14
  1270. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/14)
  1271. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.19 2
  1272. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.20 (null)
  1273. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=20
  1274. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:7;3:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=15, @rc-code=7, @op-status=0, @exec-time=14, @queue-time=2
  1275. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/14, version=0.16.20)
  1276. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'drbd' not in cache
  1277. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1278. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_get_rsc_info) info: Agent information for 'drbd:0' not in cache
  1279. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1280. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_rsc_register) info: Cached agent information for 'drbd'
  1281. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_register operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=1
  1282. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_info operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1283. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=4:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=drbd_monitor_0
  1284. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.20 2
  1285. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.21 (null)
  1286. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=21
  1287. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_start_0, @operation=start, @transition-key=15:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;15:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765246, @last-run=1594765246, @exec-time=0,
  1288. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/40, version=0.16.21)
  1289. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/15)
  1290. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.21 2
  1291. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=20, reply=1, notify=0
  1292. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.22 (null)
  1293. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=22
  1294. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources: <lrm_resource id="drbd" type="drbd" class="systemd"/>
  1295. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <lrm_rsc_op id="drbd_last_0" operation_key="drbd_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="4:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;4:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a01n01" call-id="-1" rc-code="193" op-status="-1" interv
  1296. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:drbd action:monitor call_id:20
  1297. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </lrm_resource>
  1298. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit drbd named 'drbd'
  1299. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/15, version=0.16.22)
  1300. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  1301. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:drbd action:monitor call_id:20 exit-code:7 exec-time:19ms queue-time:0ms
  1302. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of probe operation for drbd on el8-a01n01: 7 (not running) | call=20 key=drbd_monitor_0 confirmed=true cib-update=16
  1303. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/16)
  1304. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.22 2
  1305. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.23 (null)
  1306. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=23
  1307. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='drbd']/lrm_rsc_op[@id='drbd_last_0']: @transition-magic=0:7;4:0:7:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=20, @rc-code=7, @op-status=0, @exec-time=19
  1308. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/16, version=0.16.23)
  1309. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=13:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=hypervisor_start_0
  1310. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=21, reply=1, notify=0
  1311. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:hypervisor action:start call_id:21
  1312. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous start op on systemd unit libvirtd named 'hypervisor'
  1313. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/17)
  1314. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec_with_unit) debug: Calling StartUnit for hypervisor: /org/freedesktop/systemd1/unit/libvirtd_2eservice
  1315. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.23 2
  1316. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.24 (null)
  1317. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=24
  1318. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_start_0, @operation=start, @transition-key=13:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;13:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0, @queue-time=0
  1319. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/17, version=0.16.24)
  1320. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_exec_result) info: Call to start passed: /org/freedesktop/systemd1/job/1336
  1321. Jul 14 22:20:46 el8-a01n01.digimer.ca pacemaker-execd [14955] (action_complete) debug: hypervisor start may still be in progress: re-scheduling (elapsed=305ms, remaining=99695ms, start_delay=2000ms)
  1322. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.24 2
  1323. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.25 (null)
  1324. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=25
  1325. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;11:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=20, @rc-code=0, @op-status=0, @exec-time=791
  1326. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/41, version=0.16.25)
  1327. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.25 2
  1328. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.26 (null)
  1329. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=26
  1330. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']: <lrm_rsc_op id="virsh_node2_monitor_60000" operation_key="virsh_node2_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="12:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;12:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8
  1331. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/42, version=0.16.26)
  1332. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) info: finished - rsc:virsh_node1 action:start call_id:10 exit-code:0 exec-time:922ms queue-time:0ms
  1333. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of start operation for virsh_node1 on el8-a01n01: 0 (ok) | call=10 key=virsh_node1_start_0 confirmed=true cib-update=18
  1334. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/18)
  1335. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.26 2
  1336. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.27 (null)
  1337. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=27
  1338. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:0;9:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=10, @rc-code=0, @op-status=0, @exec-time=922
  1339. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/18, version=0.16.27)
  1340. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=10:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node1_monitor_60000
  1341. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/19)
  1342. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=22, reply=1, notify=0
  1343. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:virsh_node1 action:monitor call_id:22
  1344. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.27 2
  1345. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.28 (null)
  1346. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=28
  1347. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']: <lrm_rsc_op id="virsh_node1_monitor_60000" operation_key="virsh_node1_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="10:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;10:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8
  1348. Jul 14 22:20:47 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/19, version=0.16.28)
  1349. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.28 2
  1350. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.29 (null)
  1351. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=29
  1352. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_monitor_60000']: @transition-magic=0:0;12:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=22, @rc-code=0, @op-status=0, @exec-time=743
  1353. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/43, version=0.16.29)
  1354. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:22 exit-code:0 exec-time:903ms queue-time:0ms
  1355. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of monitor operation for virsh_node1 on el8-a01n01: 0 (ok) | call=22 key=virsh_node1_monitor_60000 confirmed=false cib-update=20
  1356. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
  1357. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.29 2
  1358. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.30 (null)
  1359. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=30
  1360. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_monitor_60000']: @transition-magic=0:0;10:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=22, @rc-code=0, @op-status=0, @exec-time=903
  1361. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/20, version=0.16.30)
  1362. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.30 2
  1363. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.31 (null)
  1364. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=31
  1365. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;15:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=21, @rc-code=0, @op-status=0, @exec-time=2234, @queue-time=1
  1366. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/44, version=0.16.31)
  1367. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.31 2
  1368. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.32 (null)
  1369. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=32
  1370. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']: <lrm_rsc_op id="hypervisor_monitor_60000" operation_key="hypervisor_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="16:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;16:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a0
  1371. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/45, version=0.16.32)
  1372. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.32 2
  1373. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.33 (null)
  1374. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=33
  1375. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_monitor_60000']: @transition-magic=0:0;16:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=23, @rc-code=0, @op-status=0, @exec-time=7
  1376. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/46, version=0.16.33)
  1377. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:21
  1378. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  1379. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  1380. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (action_complete) debug: hypervisor start is now complete (elapsed=2312ms, remaining=97688ms): ok (0)
  1381. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:21 exit-code:0 exec-time:2312ms queue-time:1ms
  1382. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of start operation for hypervisor on el8-a01n01: 0 (ok) | call=21 key=hypervisor_start_0 confirmed=true cib-update=21
  1383. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/21)
  1384. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.33 2
  1385. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.34 (null)
  1386. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=34
  1387. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;13:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=21, @rc-code=0, @op-status=0, @exec-time=2312, @queue-time=1
  1388. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/21, version=0.16.34)
  1389. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=14:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=hypervisor_monitor_60000
  1390. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=23, reply=1, notify=0
  1391. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:23
  1392. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  1393. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/22)
  1394. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  1395. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.34 2
  1396. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.35 (null)
  1397. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=35
  1398. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']: <lrm_rsc_op id="hypervisor_monitor_60000" operation_key="hypervisor_monitor_60000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.3.0" transition-key="14:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" transition-magic="-1:193;14:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9" exit-reason="" on_node="el8-a0
  1399. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/22, version=0.16.35)
  1400. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:23 exit-code:0 exec-time:4ms queue-time:0ms
  1401. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of monitor operation for hypervisor on el8-a01n01: 0 (ok) | call=23 key=hypervisor_monitor_60000 confirmed=false cib-update=23
  1402. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/23)
  1403. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.35 2
  1404. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.36 (null)
  1405. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=36
  1406. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_monitor_60000']: @transition-magic=0:0;14:0:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=23, @rc-code=0, @op-status=0, @exec-time=4
  1407. Jul 14 22:20:48 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/23, version=0.16.36)
  1408. Jul 14 22:20:53 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_procfs_pid_of) info: Found pacemaker-based active as process 14953
  1409. Jul 14 22:20:53 el8-a01n01.digimer.ca pacemaker-controld [14958] (throttle_send_command) info: New throttle mode: negligible load (was undetermined)
  1410. Jul 14 22:20:53 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_ping) info: Reporting our current digest to el8-a01n02: f89b1d2175a83990aeb829badbe52c67 for 0.16.36 (0x561964aff660 0)
  1411. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_expected) info: handle_request: Node el8-a01n02[2] - expected state is now down (was member)
  1412. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_peer_update) notice: Setting shutdown[el8-a01n02]: (unset) -> 1594765270 | from el8-a01n02
  1413. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.36 2
  1414. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.37 (null)
  1415. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=37
  1416. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='2']: <transient_attributes id="2"/>
  1417. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <instance_attributes id="status-2">
  1418. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <nvpair id="status-2-shutdown" name="shutdown" value="1594765270"/>
  1419. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </instance_attributes>
  1420. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </transient_attributes>
  1421. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/attrd/4, version=0.16.37)
  1422. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.37 2
  1423. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.38 (null)
  1424. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=38
  1425. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_stop_0, @operation=stop, @transition-key=7:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;7:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765270, @last-run=1594765270, @exec-time=0
  1426. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/48, version=0.16.38)
  1427. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.38 2
  1428. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.39 (null)
  1429. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=39
  1430. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;7:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=25, @rc-code=0, @op-status=0
  1431. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=8:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node2_start_0
  1432. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/49, version=0.16.39)
  1433. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=24, reply=1, notify=0
  1434. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:virsh_node2 action:start call_id:24
  1435. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.39 2
  1436. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.40 (null)
  1437. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=40
  1438. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_stop_0, @operation=stop, @transition-key=10:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;10:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765270, @last-run=1594765270, @exec-time=0, @q
  1439. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/50, version=0.16.40)
  1440. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/24)
  1441. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemakerd [14952] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1442. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_shutdown_worker) notice: Shutting down Pacemaker
  1443. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-controld | sent signal 15 to process 14958
  1444. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1445. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_shutdown) notice: Shutting down cluster resource manager | limit=1200000ms
  1446. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_shutdown_req) info: Sending shutdown request to all peers (DC is el8-a01n02)
  1447. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_update_peer_expected) info: handle_request: Node el8-a01n01[1] - expected state is now down (was (null))
  1448. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_peer_update) notice: Setting shutdown[el8-a01n01]: (unset) -> 1594765270 | from el8-a01n02
  1449. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.40 2
  1450. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.41 (null)
  1451. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=41
  1452. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_start_0, @operation=start, @transition-key=8:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;8:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765270, @last-run=1594765270
  1453. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/24, version=0.16.41)
  1454. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.41 2
  1455. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.42 (null)
  1456. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=42
  1457. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ /cib/status/node_state[@id='1']: <transient_attributes id="1"/>
  1458. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <instance_attributes id="status-1">
  1459. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ <nvpair id="status-1-shutdown" name="shutdown" value="1594765270"/>
  1460. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </instance_attributes>
  1461. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: ++ </transient_attributes>
  1462. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/attrd/5, version=0.16.42)
  1463. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) info: finished - rsc:virsh_node2 action:start call_id:24 exit-code:0 exec-time:749ms queue-time:0ms
  1464. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of start operation for virsh_node2 on el8-a01n01: 0 (ok) | call=24 key=virsh_node2_start_0 confirmed=true cib-update=25
  1465. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/25)
  1466. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.42 2
  1467. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.43 (null)
  1468. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=43
  1469. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;8:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=24, @rc-code=0, @op-status=0, @exec-time=749
  1470. Jul 14 22:21:10 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/25, version=0.16.43)
  1471. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.43 2
  1472. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.44 (null)
  1473. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=44
  1474. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;10:1:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=27, @rc-code=0, @op-status=0, @exec-time=2237
  1475. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/51, version=0.16.44)
  1476. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:virsh_node1 action:monitor call_id:22 exit-code:0 exec-time:0ms queue-time:0ms
  1477. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_cancel operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1478. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=3:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node1_stop_0
  1479. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/26)
  1480. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=26, reply=1, notify=0
  1481. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:virsh_node1 action:stop call_id:26
  1482. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) info: finished - rsc:virsh_node1 action:stop call_id:26 exit-code:0 exec-time:0ms queue-time:0ms
  1483. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.44 2
  1484. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.45 (null)
  1485. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=45
  1486. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @operation_key=virsh_node1_stop_0, @operation=stop, @transition-key=3:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;3:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765272, @last-run=1594765272, @exec-time=0
  1487. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) info: Result of monitor operation for virsh_node1 on el8-a01n01: Cancelled | call=22 key=virsh_node1_monitor_60000 confirmed=true
  1488. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/26, version=0.16.45)
  1489. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of stop operation for virsh_node1 on el8-a01n01: 0 (ok) | call=26 key=virsh_node1_stop_0 confirmed=true cib-update=27
  1490. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/27)
  1491. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=4:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=virsh_node2_stop_0
  1492. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=27, reply=1, notify=0
  1493. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:virsh_node2 action:stop call_id:27
  1494. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) info: finished - rsc:virsh_node2 action:stop call_id:27 exit-code:0 exec-time:0ms queue-time:0ms
  1495. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.45 2
  1496. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.46 (null)
  1497. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=46
  1498. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node1']/lrm_rsc_op[@id='virsh_node1_last_0']: @transition-magic=0:0;3:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=26, @rc-code=0, @op-status=0
  1499. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of stop operation for virsh_node2 on el8-a01n01: 0 (ok) | call=27 key=virsh_node2_stop_0 confirmed=true cib-update=29
  1500. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/27, version=0.16.46)
  1501. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/28)
  1502. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (cancel_recurring_action) info: Cancelling systemd operation hypervisor_status_60000
  1503. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:23 exit-code:0 exec-time:0ms queue-time:0ms
  1504. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_cancel operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=0, reply=1, notify=0
  1505. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_rsc_op) info: Performing key=5:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9 op=hypervisor_stop_0
  1506. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/29)
  1507. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (process_lrmd_message) debug: Processed lrmd_rsc_exec operation from 5125103c-578c-42d5-9219-4148b4fc6cd0: rc=29, reply=1, notify=0
  1508. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) info: executing - rsc:hypervisor action:stop call_id:29
  1509. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous stop op on systemd unit libvirtd named 'hypervisor'
  1510. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) info: Result of monitor operation for hypervisor on el8-a01n01: Cancelled | call=23 key=hypervisor_monitor_60000 confirmed=true
  1511. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.46 2
  1512. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.47 (null)
  1513. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=47
  1514. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @operation_key=virsh_node2_stop_0, @operation=stop, @transition-key=4:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;4:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765272, @last-run=1594765272, @exec-time=0
  1515. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec_with_unit) debug: Calling StopUnit for hypervisor: /org/freedesktop/systemd1/unit/libvirtd_2eservice
  1516. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/28, version=0.16.47)
  1517. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.47 2
  1518. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.48 (null)
  1519. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=48
  1520. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virsh_node2']/lrm_rsc_op[@id='virsh_node2_last_0']: @transition-magic=0:0;4:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=27, @rc-code=0, @op-status=0
  1521. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/29, version=0.16.48)
  1522. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/30)
  1523. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.48 2
  1524. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.49 (null)
  1525. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=49
  1526. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @operation_key=hypervisor_stop_0, @operation=stop, @transition-key=5:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @transition-magic=-1:193;5:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=-1, @rc-code=193, @op-status=-1, @last-rc-change=1594765272, @last-run=1594765272, @exec-time=0, @que
  1527. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/30, version=0.16.49)
  1528. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_exec_result) info: Call to stop passed: /org/freedesktop/systemd1/job/1426
  1529. Jul 14 22:21:12 el8-a01n01.digimer.ca pacemaker-execd [14955] (action_complete) debug: hypervisor stop may still be in progress: re-scheduling (elapsed=198ms, remaining=99802ms, start_delay=2000ms)
  1530. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_execute) debug: executing - rsc:hypervisor action:monitor call_id:29
  1531. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (systemd_unit_exec) debug: Performing asynchronous status op on systemd unit libvirtd named 'hypervisor'
  1532. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (pcmk_dbus_get_property) debug: Calling: GetAll on org.freedesktop.systemd1
  1533. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (action_complete) debug: hypervisor stop is now complete (elapsed=2203ms, remaining=97797ms): not running (7)
  1534. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (log_finished) debug: finished - rsc:hypervisor action:monitor call_id:29 exit-code:0 exec-time:2203ms queue-time:0ms
  1535. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Forwarding cib_modify operation for section status to all (origin=local/crmd/31)
  1536. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (process_lrm_event) notice: Result of stop operation for hypervisor on el8-a01n01: 0 (ok) | call=29 key=hypervisor_stop_0 confirmed=true cib-update=31
  1537. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.49 2
  1538. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.50 (null)
  1539. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=50
  1540. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='hypervisor']/lrm_rsc_op[@id='hypervisor_last_0']: @transition-magic=0:0;5:2:0:adab90af-4d5d-488e-8027-cf0e0ac80cd9, @call-id=29, @rc-code=0, @op-status=0, @exec-time=2203
  1541. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n01/crmd/31, version=0.16.50)
  1542. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (handle_request) info: Shutting down
  1543. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_state_transition) notice: State transition S_NOT_DC -> S_STOPPING | input=I_STOP cause=C_HA_MESSAGE origin=route_message
  1544. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (tengine_stonith_connection_destroy) info: Fencing daemon disconnected
  1545. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_control) info: Disconnecting from the executor
  1546. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (lrmd_api_disconnect) info: Disconnecting IPC local executor connection
  1547. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (lrmd_ipc_connection_destroy) info: IPC connection destroyed
  1548. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (lrm_connection_destroy) info: Disconnected from executor
  1549. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (lrmd_api_disconnect) info: Disconnecting IPC local executor connection
  1550. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_lrm_control) notice: Disconnected from the executor
  1551. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  1552. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_dispatch_connection_request) debug: HUP conn (/dev/shm/qb-14955-14958-9-DajKTi/qb)
  1553. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_disconnect) debug: qb_ipcs_disconnect(/dev/shm/qb-14955-14958-9-DajKTi/qb) state:2
  1554. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (crm_client_destroy) debug: Destroying 0 events
  1555. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-14955-14958-9-DajKTi/qb-response-lrmd-header
  1556. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-14955-14958-9-DajKTi/qb-event-lrmd-header
  1557. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Free'ing ringbuffer: /dev/shm/qb-14955-14958-9-DajKTi/qb-request-lrmd-header
  1558. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (terminate_cs_connection) notice: Disconnected from Corosync
  1559. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_ha_control) info: Disconnected from the cluster
  1560. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_cib_control) info: Disconnecting from the CIB manager
  1561. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crmd_cib_connection_destroy) info: Connection to the CIB manager terminated
  1562. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_cib_control) notice: Disconnected from the CIB manager
  1563. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1564. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_exit) info: Performing A_EXIT_0 - gracefully exiting the controller
  1565. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (do_exit) info: [pacemaker-controld] stopped (0)
  1566. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crmd_exit) info: Dropping I_TERMINATE: [ state=S_STOPPING cause=C_FSA_INTERNAL origin=do_stop ]
  1567. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crmd_cs_destroy) info: Corosync connection closed
  1568. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crmd_cs_destroy) info: Corosync connection closed
  1569. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crmd_init) info: pacemaker-controld[14958] exiting with status 0 (OK)
  1570. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-controld [14958] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  1571. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-controld[14958] exited with status 0 (OK)
  1572. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-schedulerd | sent signal 15 to process 14957
  1573. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1574. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1575. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-schedulerd[14957] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  1576. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-schedulerd[14957] exited with status 0 (OK)
  1577. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-attrd | sent signal 15 to process 14956
  1578. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1579. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-attrd [14956] (main) info: Shutting down attribute manager
  1580. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-attrd [14956] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1581. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-attrd [14956] (attrd_cib_destroy_cb) info: Connection disconnection complete
  1582. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-attrd [14956] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  1583. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: --- 0.16.50 2
  1584. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: Diff: +++ 0.16.51 (null)
  1585. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib: @num_updates=51
  1586. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_perform_op) info: + /cib/status/node_state[@id='2']: @crm-debug-origin=do_dc_release, @expected=down
  1587. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-attrd[14956] exited with status 0 (OK)
  1588. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-execd | sent signal 15 to process 14955
  1589. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1590. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (lrmd_exit) info: Terminating with 0 clients
  1591. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (stonith_api_del_notification) debug: Removing callback for st_notify_disconnect events
  1592. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (stonith_api_signoff) debug: Disconnecting from the fencer
  1593. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcc_disconnect) debug: qb_ipcc_disconnect()
  1594. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-14954-14955-12-M4eiAk/qb-request-stonith-ng-header
  1595. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-14954-14955-12-M4eiAk/qb-response-stonith-ng-header
  1596. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_rb_close_helper) debug: Closing ringbuffer: /dev/shm/qb-14954-14955-12-M4eiAk/qb-event-stonith-ng-header
  1597. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1598. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (qb_ipcs_unref) debug: qb_ipcs_unref() - destroying
  1599. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-execd [14955] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  1600. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-execd[14955] exited with status 0 (OK)
  1601. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-fenced | sent signal 15 to process 14954
  1602. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1603. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-fenced [14954] (stonith_shutdown) info: Terminating with 0 clients
  1604. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-fenced [14954] (cib_connection_destroy) info: Connection to the CIB manager closed
  1605. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-fenced [14954] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1606. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_event_sendv) warning: new_event_notification (/dev/shm/qb-14953-14956-11-3i7Ugc/qb): Broken pipe (32)
  1607. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_notify_send_one) warning: Notification of client attrd/0fae3a85-ac60-4a43-af94-30ea8585d317 failed
  1608. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_event_sendv) warning: new_event_notification (/dev/shm/qb-14953-14954-13-AS0Bwn/qb): Broken pipe (32)
  1609. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_notify_send_one) warning: Notification of client stonithd/1510c981-5b24-4295-9677-0ba36a5b674d failed
  1610. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_request) info: Completed cib_modify operation for section status: OK (rc=0, origin=el8-a01n02/crmd/53, version=0.16.51)
  1611. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-fenced [14954] (crm_xml_cleanup) info: Cleaning up memory from libxml2
  1612. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_process_shutdown_req) info: Peer el8-a01n02 is requesting to shut down
  1613. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 2: el8-a01n02 (node 2 pid 2197) left via cpg_leave
  1614. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_proc) info: pcmk_cpg_membership: Node el8-a01n02[2] - corosync-cpg is now offline
  1615. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_update_peer_state_iter) notice: Node el8-a01n02 state is now lost | nodeid=2 previous=member source=crm_update_peer_proc
  1616. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_reap_dead_member) info: Removing node with name el8-a01n02 and id 2 from membership cache
  1617. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (reap_crm_member) notice: Purged 1 peer with id=2 and/or uname=el8-a01n02 from the membership cache
  1618. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (pcmk_cpg_membership) info: Group cib event 2: el8-a01n01 (node 1 pid 14953) is member
  1619. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-fenced[14954] exited with status 0 (OK)
  1620. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (stop_child) notice: Stopping pacemaker-based | sent signal 15 to process 14953
  1621. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_signal_dispatch) notice: Caught 'Terminated' signal | 15 (invoking handler)
  1622. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_shutdown) info: Disconnected 0 clients
  1623. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cib_shutdown) info: All clients disconnected (0)
  1624. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (terminate_cib) info: initiate_exit: Exiting from mainloop...
  1625. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  1626. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (terminate_cs_connection) notice: Disconnected from Corosync
  1627. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (crm_cluster_disconnect) info: Disconnecting from cluster infrastructure: corosync
  1628. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (cluster_disconnect_cpg) info: No CPG connection
  1629. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (terminate_cs_connection) notice: Disconnected from Corosync
  1630. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1631. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1632. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemaker-based [14953] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1633. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_child_exit) info: pacemaker-based[14953] exited with status 0 (OK)
  1634. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (pcmk_shutdown_worker) notice: Shutdown complete
  1635. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (qb_ipcs_us_withdraw) info: withdrawing server sockets
  1636. Jul 14 22:21:14 el8-a01n01.digimer.ca pacemakerd [14952] (crm_xml_cleanup) info: Cleaning up memory from libxml2
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!