Advertisement
amartin

corosync.log from storage1 with debug

Nov 1st, 2012
623
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 212.89 KB | None | 0 0
  1. Nov 01 05:48:59 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  2. drbd[30242]: 2012/11/01_05:48:59 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  3. Nov 01 05:48:59 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30272-17)
  4. Nov 01 05:48:59 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30272-17)
  5. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  6. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  7. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  8. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  9. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  10. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  11. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  12. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  13. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  14. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  15. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  16. Nov 01 05:48:59 [30272] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  17. Nov 01 05:48:59 [30272] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  18. Nov 01 05:48:59 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30272-12)
  19. Nov 01 05:48:59 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30272-12)
  20. Nov 01 05:48:59 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  21. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  22. Nov 01 05:48:59 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  23. Nov 01 05:48:59 [30272] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  24. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  25. Nov 01 05:48:59 [30272] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  26. Nov 01 05:48:59 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30272-17)
  27. Nov 01 05:48:59 [30272] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  28. Nov 01 05:48:59 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30272-17) state:2
  29. Nov 01 05:48:59 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30272-12)
  30. Nov 01 05:48:59 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30272-12) state:2
  31. drbd[30242]: 2012/11/01_05:48:59 DEBUG: drives: Exit code 0
  32. drbd[30242]: 2012/11/01_05:48:59 DEBUG: drives: Command output:
  33. Nov 01 05:48:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30242 - exited with rc=0
  34. Nov 01 05:48:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30242 [ ]
  35. Nov 01 05:49:01 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30305-17)
  36. Nov 01 05:49:01 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30305-17)
  37. Nov 01 05:49:01 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30305-17)
  38. Nov 01 05:49:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30305-17) state:2
  39. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] IPC credentials authenticated (9108-30322-31)
  40. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] connecting to client [30322]
  41. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  42. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  43. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  44. Nov 01 05:49:01 [9089] storage1 corosync debug [MAIN ] connection created
  45. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] lib_init_fn: conn=0x7f76db4a3680
  46. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] HUP conn (9108-30322-31)
  47. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] qb_ipcs_disconnect(9108-30322-31) state:2
  48. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  49. Nov 01 05:49:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  50. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] exit_fn for conn=0x7f76db4a3680
  51. Nov 01 05:49:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  52. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-9108-30322-31-header
  53. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-9108-30322-31-header
  54. Nov 01 05:49:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-9108-30322-31-header
  55. Nov 01 05:49:05 [30353] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  56. Nov 01 05:49:05 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30353-12)
  57. Nov 01 05:49:05 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30353-12)
  58. Nov 01 05:49:05 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  59. Nov 01 05:49:05 [30353] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  60. Nov 01 05:49:05 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  61. Nov 01 05:49:05 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30353-12)
  62. Nov 01 05:49:05 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30353-12) state:2
  63. Nov 01 05:49:05 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30207 - exited with rc=0
  64. Nov 01 05:49:15 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  65. Nov 01 05:49:19 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  66. drbd[30415]: 2012/11/01_05:49:19 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  67. Nov 01 05:49:19 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30445-17)
  68. Nov 01 05:49:19 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30445-17)
  69. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  70. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  71. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  72. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  73. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  74. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  75. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  76. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  77. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  78. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  79. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  80. Nov 01 05:49:19 [30445] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  81. Nov 01 05:49:19 [30445] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  82. Nov 01 05:49:19 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30445-12)
  83. Nov 01 05:49:19 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30445-12)
  84. Nov 01 05:49:19 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  85. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  86. Nov 01 05:49:19 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  87. Nov 01 05:49:19 [30445] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  88. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  89. Nov 01 05:49:19 [30445] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  90. Nov 01 05:49:19 [30445] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  91. Nov 01 05:49:19 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30445-17)
  92. Nov 01 05:49:19 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30445-17) state:2
  93. Nov 01 05:49:19 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30445-12)
  94. Nov 01 05:49:19 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30445-12) state:2
  95. drbd[30415]: 2012/11/01_05:49:19 DEBUG: drives: Exit code 0
  96. drbd[30415]: 2012/11/01_05:49:19 DEBUG: drives: Command output:
  97. Nov 01 05:49:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30415 - exited with rc=0
  98. Nov 01 05:49:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30415 [ ]
  99. Nov 01 05:49:22 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  100. Nov 01 05:49:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30468 - exited with rc=0
  101. Nov 01 05:49:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30468 [ nfsd running ]
  102. Nov 01 05:49:25 [30475] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  103. Nov 01 05:49:25 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30475-12)
  104. Nov 01 05:49:25 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30475-12)
  105. Nov 01 05:49:25 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  106. Nov 01 05:49:25 [30475] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  107. Nov 01 05:49:25 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  108. Nov 01 05:49:25 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30475-12)
  109. Nov 01 05:49:25 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30475-12) state:2
  110. Nov 01 05:49:25 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30380 - exited with rc=0
  111. Nov 01 05:49:35 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  112. Nov 01 05:49:39 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  113. drbd[30540]: 2012/11/01_05:49:39 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  114. Nov 01 05:49:39 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30570-17)
  115. Nov 01 05:49:39 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30570-17)
  116. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  117. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  118. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  119. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  120. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  121. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  122. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  123. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  124. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  125. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  126. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  127. Nov 01 05:49:39 [30570] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  128. Nov 01 05:49:39 [30570] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  129. Nov 01 05:49:39 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30570-12)
  130. Nov 01 05:49:39 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30570-12)
  131. Nov 01 05:49:39 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  132. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  133. Nov 01 05:49:39 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  134. Nov 01 05:49:39 [30570] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  135. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  136. Nov 01 05:49:39 [30570] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  137. Nov 01 05:49:39 [30570] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  138. Nov 01 05:49:39 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30570-17)
  139. Nov 01 05:49:39 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30570-17) state:2
  140. Nov 01 05:49:39 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30570-12)
  141. Nov 01 05:49:39 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30570-12) state:2
  142. drbd[30540]: 2012/11/01_05:49:39 DEBUG: drives: Exit code 0
  143. drbd[30540]: 2012/11/01_05:49:39 DEBUG: drives: Command output:
  144. Nov 01 05:49:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30540 - exited with rc=0
  145. Nov 01 05:49:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30540 [ ]
  146. Nov 01 05:49:45 [30598] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  147. Nov 01 05:49:45 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30598-12)
  148. Nov 01 05:49:45 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30598-12)
  149. Nov 01 05:49:45 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  150. Nov 01 05:49:45 [30598] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  151. Nov 01 05:49:45 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  152. Nov 01 05:49:45 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30598-12)
  153. Nov 01 05:49:45 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30598-12) state:2
  154. Nov 01 05:49:45 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30505 - exited with rc=0
  155. Nov 01 05:49:52 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  156. Nov 01 05:49:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30625 - exited with rc=0
  157. Nov 01 05:49:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30625 [ nfsd running ]
  158. Nov 01 05:49:55 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  159. Nov 01 05:49:59 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  160. drbd[30662]: 2012/11/01_05:49:59 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  161. Nov 01 05:49:59 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30692-17)
  162. Nov 01 05:49:59 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30692-17)
  163. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  164. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  165. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  166. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  167. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  168. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  169. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  170. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  171. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  172. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  173. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  174. Nov 01 05:49:59 [30692] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  175. Nov 01 05:49:59 [30692] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  176. Nov 01 05:49:59 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30692-12)
  177. Nov 01 05:49:59 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30692-12)
  178. Nov 01 05:49:59 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  179. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  180. Nov 01 05:49:59 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  181. Nov 01 05:49:59 [30692] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  182. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  183. Nov 01 05:49:59 [30692] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  184. Nov 01 05:49:59 [30692] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  185. Nov 01 05:49:59 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30692-17)
  186. Nov 01 05:49:59 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30692-17) state:2
  187. Nov 01 05:49:59 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30692-12)
  188. Nov 01 05:49:59 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30692-12) state:2
  189. drbd[30662]: 2012/11/01_05:49:59 DEBUG: drives: Exit code 0
  190. drbd[30662]: 2012/11/01_05:49:59 DEBUG: drives: Command output:
  191. Nov 01 05:49:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30662 - exited with rc=0
  192. Nov 01 05:49:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30662 [ ]
  193. Nov 01 05:50:01 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30712-17)
  194. Nov 01 05:50:01 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30712-17)
  195. Nov 01 05:50:01 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30712-17)
  196. Nov 01 05:50:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30712-17) state:2
  197. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] IPC credentials authenticated (9108-30735-31)
  198. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] connecting to client [30735]
  199. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  200. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  201. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  202. Nov 01 05:50:01 [9089] storage1 corosync debug [MAIN ] connection created
  203. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] lib_init_fn: conn=0x7f76db4897e0
  204. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] HUP conn (9108-30735-31)
  205. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] qb_ipcs_disconnect(9108-30735-31) state:2
  206. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  207. Nov 01 05:50:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  208. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] exit_fn for conn=0x7f76db4897e0
  209. Nov 01 05:50:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  210. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-9108-30735-31-header
  211. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-9108-30735-31-header
  212. Nov 01 05:50:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-9108-30735-31-header
  213. Nov 01 05:50:05 [30773] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  214. Nov 01 05:50:05 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30773-12)
  215. Nov 01 05:50:05 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30773-12)
  216. Nov 01 05:50:05 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  217. Nov 01 05:50:05 [30773] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  218. Nov 01 05:50:05 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  219. Nov 01 05:50:05 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30773-12)
  220. Nov 01 05:50:05 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30773-12) state:2
  221. Nov 01 05:50:05 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30627 - exited with rc=0
  222. Nov 01 05:50:15 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  223. Nov 01 05:50:19 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  224. drbd[30835]: 2012/11/01_05:50:19 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  225. Nov 01 05:50:19 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30865-17)
  226. Nov 01 05:50:19 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30865-17)
  227. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  228. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  229. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  230. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  231. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  232. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  233. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  234. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  235. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  236. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  237. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  238. Nov 01 05:50:19 [30865] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  239. Nov 01 05:50:19 [30865] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  240. Nov 01 05:50:19 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30865-12)
  241. Nov 01 05:50:19 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30865-12)
  242. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  243. Nov 01 05:50:19 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  244. Nov 01 05:50:19 [30865] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  245. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  246. Nov 01 05:50:19 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  247. Nov 01 05:50:19 [30865] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  248. Nov 01 05:50:19 [30865] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  249. Nov 01 05:50:19 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30865-17)
  250. Nov 01 05:50:19 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30865-17) state:2
  251. Nov 01 05:50:19 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30865-12)
  252. Nov 01 05:50:19 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30865-12) state:2
  253. drbd[30835]: 2012/11/01_05:50:19 DEBUG: drives: Exit code 0
  254. drbd[30835]: 2012/11/01_05:50:19 DEBUG: drives: Command output:
  255. Nov 01 05:50:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30835 - exited with rc=0
  256. Nov 01 05:50:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30835 [ ]
  257. Nov 01 05:50:22 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  258. Nov 01 05:50:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30888 - exited with rc=0
  259. Nov 01 05:50:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:30888 [ nfsd running ]
  260. Nov 01 05:50:25 [30895] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  261. Nov 01 05:50:25 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30895-12)
  262. Nov 01 05:50:25 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30895-12)
  263. Nov 01 05:50:25 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  264. Nov 01 05:50:25 [30895] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  265. Nov 01 05:50:25 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  266. Nov 01 05:50:25 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30895-12)
  267. Nov 01 05:50:25 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30895-12) state:2
  268. Nov 01 05:50:25 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30800 - exited with rc=0
  269. Nov 01 05:50:35 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  270. Nov 01 05:50:39 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  271. drbd[30961]: 2012/11/01_05:50:39 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  272. Nov 01 05:50:39 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-30991-17)
  273. Nov 01 05:50:39 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-30991-17)
  274. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  275. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  276. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  277. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  278. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  279. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  280. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  281. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  282. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  283. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  284. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  285. Nov 01 05:50:39 [30991] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  286. Nov 01 05:50:39 [30991] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  287. Nov 01 05:50:39 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-30991-12)
  288. Nov 01 05:50:39 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-30991-12)
  289. Nov 01 05:50:39 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  290. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  291. Nov 01 05:50:39 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  292. Nov 01 05:50:39 [30991] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  293. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  294. Nov 01 05:50:39 [30991] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  295. Nov 01 05:50:39 [30991] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  296. Nov 01 05:50:39 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-30991-17)
  297. Nov 01 05:50:39 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-30991-17) state:2
  298. Nov 01 05:50:39 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-30991-12)
  299. Nov 01 05:50:39 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-30991-12) state:2
  300. drbd[30961]: 2012/11/01_05:50:39 DEBUG: drives: Exit code 0
  301. drbd[30961]: 2012/11/01_05:50:39 DEBUG: drives: Command output:
  302. Nov 01 05:50:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30961 - exited with rc=0
  303. Nov 01 05:50:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:30961 [ ]
  304. Nov 01 05:50:45 [31019] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  305. Nov 01 05:50:45 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31019-12)
  306. Nov 01 05:50:45 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31019-12)
  307. Nov 01 05:50:45 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  308. Nov 01 05:50:45 [31019] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  309. Nov 01 05:50:45 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  310. Nov 01 05:50:45 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31019-12)
  311. Nov 01 05:50:45 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31019-12) state:2
  312. Nov 01 05:50:45 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:30925 - exited with rc=0
  313. Nov 01 05:50:52 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  314. Nov 01 05:50:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31046 - exited with rc=0
  315. Nov 01 05:50:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31046 [ nfsd running ]
  316. Nov 01 05:50:55 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  317. Nov 01 05:50:59 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  318. drbd[31083]: 2012/11/01_05:50:59 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  319. Nov 01 05:50:59 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31113-17)
  320. Nov 01 05:50:59 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31113-17)
  321. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  322. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  323. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  324. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  325. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  326. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  327. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  328. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  329. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  330. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  331. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  332. Nov 01 05:50:59 [31113] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  333. Nov 01 05:50:59 [31113] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  334. Nov 01 05:50:59 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31113-12)
  335. Nov 01 05:50:59 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31113-12)
  336. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  337. Nov 01 05:50:59 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  338. Nov 01 05:50:59 [31113] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  339. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  340. Nov 01 05:50:59 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  341. Nov 01 05:50:59 [31113] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  342. Nov 01 05:50:59 [31113] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  343. Nov 01 05:50:59 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31113-17)
  344. Nov 01 05:50:59 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31113-17) state:2
  345. Nov 01 05:50:59 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31113-12)
  346. Nov 01 05:50:59 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31113-12) state:2
  347. drbd[31083]: 2012/11/01_05:50:59 DEBUG: drives: Exit code 0
  348. drbd[31083]: 2012/11/01_05:50:59 DEBUG: drives: Command output:
  349. Nov 01 05:50:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31083 - exited with rc=0
  350. Nov 01 05:50:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31083 [ ]
  351. Nov 01 05:51:01 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31133-17)
  352. Nov 01 05:51:01 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31133-17)
  353. Nov 01 05:51:01 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31133-17)
  354. Nov 01 05:51:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31133-17) state:2
  355. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] IPC credentials authenticated (9108-31150-31)
  356. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] connecting to client [31150]
  357. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  358. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  359. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  360. Nov 01 05:51:01 [9089] storage1 corosync debug [MAIN ] connection created
  361. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] lib_init_fn: conn=0x7f76db4897e0
  362. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] HUP conn (9108-31150-31)
  363. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] qb_ipcs_disconnect(9108-31150-31) state:2
  364. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  365. Nov 01 05:51:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  366. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] exit_fn for conn=0x7f76db4897e0
  367. Nov 01 05:51:01 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  368. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-9108-31150-31-header
  369. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-9108-31150-31-header
  370. Nov 01 05:51:01 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-9108-31150-31-header
  371. Nov 01 05:51:05 [31194] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  372. Nov 01 05:51:05 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31194-12)
  373. Nov 01 05:51:05 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31194-12)
  374. Nov 01 05:51:05 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  375. Nov 01 05:51:05 [31194] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  376. Nov 01 05:51:05 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  377. Nov 01 05:51:05 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31194-12)
  378. Nov 01 05:51:05 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31194-12) state:2
  379. Nov 01 05:51:05 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31048 - exited with rc=0
  380. Nov 01 05:51:15 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  381. Nov 01 05:51:19 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  382. drbd[31256]: 2012/11/01_05:51:19 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  383. Nov 01 05:51:19 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31286-17)
  384. Nov 01 05:51:19 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31286-17)
  385. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  386. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  387. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  388. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  389. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  390. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  391. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  392. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  393. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  394. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  395. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  396. Nov 01 05:51:19 [31286] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  397. Nov 01 05:51:19 [31286] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  398. Nov 01 05:51:19 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31286-12)
  399. Nov 01 05:51:19 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31286-12)
  400. Nov 01 05:51:19 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  401. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  402. Nov 01 05:51:19 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  403. Nov 01 05:51:19 [31286] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  404. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  405. Nov 01 05:51:19 [31286] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  406. Nov 01 05:51:19 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31286-17)
  407. Nov 01 05:51:19 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31286-17) state:2
  408. Nov 01 05:51:19 [31286] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  409. Nov 01 05:51:19 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31286-12)
  410. Nov 01 05:51:19 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31286-12) state:2
  411. drbd[31256]: 2012/11/01_05:51:19 DEBUG: drives: Exit code 0
  412. drbd[31256]: 2012/11/01_05:51:19 DEBUG: drives: Command output:
  413. Nov 01 05:51:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31256 - exited with rc=0
  414. Nov 01 05:51:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31256 [ ]
  415. Nov 01 05:51:22 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  416. Nov 01 05:51:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31309 - exited with rc=0
  417. Nov 01 05:51:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31309 [ nfsd running ]
  418. Nov 01 05:51:25 [31316] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  419. Nov 01 05:51:25 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31316-12)
  420. Nov 01 05:51:25 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31316-12)
  421. Nov 01 05:51:25 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  422. Nov 01 05:51:25 [31316] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  423. Nov 01 05:51:25 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  424. Nov 01 05:51:25 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31316-12)
  425. Nov 01 05:51:25 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31316-12) state:2
  426. Nov 01 05:51:25 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31221 - exited with rc=0
  427. Nov 01 05:51:35 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  428. Nov 01 05:51:39 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  429. drbd[31381]: 2012/11/01_05:51:39 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  430. Nov 01 05:51:39 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31411-17)
  431. Nov 01 05:51:39 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31411-17)
  432. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  433. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  434. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  435. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  436. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  437. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  438. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  439. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  440. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  441. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  442. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  443. Nov 01 05:51:39 [31411] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  444. Nov 01 05:51:39 [31411] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  445. Nov 01 05:51:39 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31411-12)
  446. Nov 01 05:51:39 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31411-12)
  447. Nov 01 05:51:39 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  448. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  449. Nov 01 05:51:39 [31411] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  450. Nov 01 05:51:39 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  451. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  452. Nov 01 05:51:39 [31411] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  453. Nov 01 05:51:39 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31411-17)
  454. Nov 01 05:51:39 [31411] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  455. Nov 01 05:51:39 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31411-17) state:2
  456. Nov 01 05:51:39 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31411-12)
  457. Nov 01 05:51:39 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31411-12) state:2
  458. drbd[31381]: 2012/11/01_05:51:39 DEBUG: drives: Exit code 0
  459. drbd[31381]: 2012/11/01_05:51:39 DEBUG: drives: Command output:
  460. Nov 01 05:51:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31381 - exited with rc=0
  461. Nov 01 05:51:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31381 [ ]
  462. Nov 01 05:51:45 [31439] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  463. Nov 01 05:51:45 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31439-12)
  464. Nov 01 05:51:45 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31439-12)
  465. Nov 01 05:51:45 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  466. Nov 01 05:51:45 [31439] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  467. Nov 01 05:51:45 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  468. Nov 01 05:51:45 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31439-12)
  469. Nov 01 05:51:45 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31439-12) state:2
  470. Nov 01 05:51:45 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31346 - exited with rc=0
  471. Nov 01 05:51:52 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  472. Nov 01 05:51:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31453 - exited with rc=0
  473. Nov 01 05:51:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31453 [ nfsd running ]
  474. Nov 01 05:51:55 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  475. Nov 01 05:51:59 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  476. drbd[31503]: 2012/11/01_05:51:59 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  477. Nov 01 05:51:59 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31533-17)
  478. Nov 01 05:51:59 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31533-17)
  479. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  480. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  481. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  482. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  483. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  484. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  485. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  486. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  487. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  488. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  489. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  490. Nov 01 05:51:59 [31533] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  491. Nov 01 05:51:59 [31533] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  492. Nov 01 05:51:59 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31533-12)
  493. Nov 01 05:51:59 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31533-12)
  494. Nov 01 05:51:59 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  495. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  496. Nov 01 05:51:59 [31533] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  497. Nov 01 05:51:59 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  498. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  499. Nov 01 05:51:59 [31533] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  500. Nov 01 05:51:59 [31533] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  501. Nov 01 05:51:59 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31533-17)
  502. Nov 01 05:51:59 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31533-17) state:2
  503. Nov 01 05:51:59 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31533-12)
  504. Nov 01 05:51:59 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31533-12) state:2
  505. drbd[31503]: 2012/11/01_05:51:59 DEBUG: drives: Exit code 0
  506. drbd[31503]: 2012/11/01_05:51:59 DEBUG: drives: Command output:
  507. Nov 01 05:51:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31503 - exited with rc=0
  508. Nov 01 05:51:59 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31503 [ ]
  509. Nov 01 05:52:01 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31553-17)
  510. Nov 01 05:52:01 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31553-17)
  511. Nov 01 05:52:01 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31553-17)
  512. Nov 01 05:52:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31553-17) state:2
  513. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] IPC credentials authenticated (9108-31570-31)
  514. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] connecting to client [31570]
  515. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  516. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  517. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  518. Nov 01 05:52:02 [9089] storage1 corosync debug [MAIN ] connection created
  519. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] lib_init_fn: conn=0x7f76db4897e0
  520. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] HUP conn (9108-31570-31)
  521. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] qb_ipcs_disconnect(9108-31570-31) state:2
  522. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  523. Nov 01 05:52:02 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  524. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] exit_fn for conn=0x7f76db4897e0
  525. Nov 01 05:52:02 [9089] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  526. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-9108-31570-31-header
  527. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-9108-31570-31-header
  528. Nov 01 05:52:02 [9089] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-9108-31570-31-header
  529. Nov 01 05:52:05 [31614] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  530. Nov 01 05:52:05 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31614-12)
  531. Nov 01 05:52:05 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31614-12)
  532. Nov 01 05:52:05 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  533. Nov 01 05:52:05 [31614] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  534. Nov 01 05:52:05 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  535. Nov 01 05:52:05 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31614-12)
  536. Nov 01 05:52:05 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31614-12) state:2
  537. Nov 01 05:52:05 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31468 - exited with rc=0
  538. Nov 01 05:52:15 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  539. Nov 01 05:52:19 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  540. drbd[31676]: 2012/11/01_05:52:19 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  541. Nov 01 05:52:19 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31706-17)
  542. Nov 01 05:52:19 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31706-17)
  543. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  544. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  545. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  546. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  547. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  548. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  549. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  550. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  551. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  552. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  553. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  554. Nov 01 05:52:19 [31706] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  555. Nov 01 05:52:19 [31706] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  556. Nov 01 05:52:19 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31706-12)
  557. Nov 01 05:52:19 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31706-12)
  558. Nov 01 05:52:19 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  559. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  560. Nov 01 05:52:19 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  561. Nov 01 05:52:19 [31706] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  562. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  563. Nov 01 05:52:19 [31706] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  564. Nov 01 05:52:19 [31706] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  565. Nov 01 05:52:19 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31706-17)
  566. Nov 01 05:52:19 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31706-17) state:2
  567. Nov 01 05:52:19 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31706-12)
  568. Nov 01 05:52:19 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31706-12) state:2
  569. drbd[31676]: 2012/11/01_05:52:19 DEBUG: drives: Exit code 0
  570. drbd[31676]: 2012/11/01_05:52:19 DEBUG: drives: Command output:
  571. Nov 01 05:52:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31676 - exited with rc=0
  572. Nov 01 05:52:19 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31676 [ ]
  573. Nov 01 05:52:22 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  574. Nov 01 05:52:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31716 - exited with rc=0
  575. Nov 01 05:52:22 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31716 [ nfsd running ]
  576. Nov 01 05:52:25 [31736] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  577. Nov 01 05:52:25 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31736-12)
  578. Nov 01 05:52:25 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31736-12)
  579. Nov 01 05:52:25 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  580. Nov 01 05:52:25 [31736] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  581. Nov 01 05:52:25 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  582. Nov 01 05:52:25 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31736-12)
  583. Nov 01 05:52:25 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31736-12) state:2
  584. Nov 01 05:52:25 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31641 - exited with rc=0
  585. Nov 01 05:52:35 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  586. Nov 01 05:52:39 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  587. drbd[31801]: 2012/11/01_05:52:39 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  588. Nov 01 05:52:39 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31831-17)
  589. Nov 01 05:52:39 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31831-17)
  590. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  591. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  592. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  593. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  594. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  595. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  596. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  597. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  598. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  599. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  600. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  601. Nov 01 05:52:39 [31831] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  602. Nov 01 05:52:39 [31831] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  603. Nov 01 05:52:39 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31831-12)
  604. Nov 01 05:52:39 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31831-12)
  605. Nov 01 05:52:39 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  606. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  607. Nov 01 05:52:39 [31831] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  608. Nov 01 05:52:39 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  609. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  610. Nov 01 05:52:39 [31831] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  611. Nov 01 05:52:39 [31831] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  612. Nov 01 05:52:39 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31831-17)
  613. Nov 01 05:52:39 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31831-17) state:2
  614. Nov 01 05:52:39 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31831-12)
  615. Nov 01 05:52:39 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31831-12) state:2
  616. drbd[31801]: 2012/11/01_05:52:39 DEBUG: drives: Exit code 0
  617. drbd[31801]: 2012/11/01_05:52:39 DEBUG: drives: Command output:
  618. Nov 01 05:52:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31801 - exited with rc=0
  619. Nov 01 05:52:39 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31801 [ ]
  620. Nov 01 05:52:45 [31859] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  621. Nov 01 05:52:45 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31859-12)
  622. Nov 01 05:52:45 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31859-12)
  623. Nov 01 05:52:45 [9139] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  624. Nov 01 05:52:45 [31859] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  625. Nov 01 05:52:45 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: 5000, Stored: 5000
  626. Nov 01 05:52:45 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31859-12)
  627. Nov 01 05:52:45 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31859-12) state:2
  628. Nov 01 05:52:45 [9138] storage1 lrmd: debug: operation_finished: p_ping_monitor_10000:31766 - exited with rc=0
  629. Nov 01 05:52:52 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_daemon_nfs-kernel-server_status_30000
  630. Nov 01 05:52:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31873 - exited with rc=0
  631. Nov 01 05:52:52 [9138] storage1 lrmd: debug: operation_finished: p_daemon_nfs-kernel-server_status_30000:31873 [ nfsd running ]
  632. Nov 01 05:52:55 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_ping_monitor_10000
  633. Nov 01 05:52:59 [9138] storage1 lrmd: debug: recurring_action_timer: Scheduling another invokation of p_drbd_drives_monitor_20000
  634. drbd[31923]: 2012/11/01_05:53:00 DEBUG: drives: Calling /usr/sbin/crm_master -Q -l reboot -v 10000
  635. Nov 01 05:53:00 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31953-17)
  636. Nov 01 05:53:00 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31953-17)
  637. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: cib_native_signon_raw: Connection to CIB successful
  638. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <nodes >
  639. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="402732042" uname="storagequorum" >
  640. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <instance_attributes id="storagequorum-instance_attributes" >
  641. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <nvpair id="storagequorum-instance_attributes-standby" name="standby" value="on" />
  642. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section </instance_attributes>
  643. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section </node>
  644. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2499884042" uname="storage1" />
  645. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="2483106826" uname="storage0" />
  646. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section <node id="16777343" uname="localhost" />
  647. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: query_node_uuid: Result section </nodes>
  648. Nov 01 05:53:00 [31953] storage1 crm_attribute: info: determine_host: Mapped storage1 to 2499884042
  649. Nov 01 05:53:00 [31953] storage1 crm_attribute: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  650. Nov 01 05:53:00 [9139] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (9139-31953-12)
  651. Nov 01 05:53:00 [9139] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (9139-31953-12)
  652. Nov 01 05:53:00 [9139] storage1 attrd: debug: attrd_local_callback: update message from crm_attribute: master-p_drbd_drives=10000
  653. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: attrd_update_delegate: Sent update: master-p_drbd_drives=10000 for storage1
  654. Nov 01 05:53:00 [9139] storage1 attrd: debug: attrd_local_callback: Supplied: 10000, Current: 10000, Stored: 10000
  655. Nov 01 05:53:00 [31953] storage1 crm_attribute: info: main: Update master-p_drbd_drives=10000 sent via attrd
  656. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: cib_native_signoff: Signing out of the CIB Service
  657. Nov 01 05:53:00 [31953] storage1 crm_attribute: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  658. Nov 01 05:53:00 [31953] storage1 crm_attribute: info: crm_xml_cleanup: Cleaning up memory from libxml2
  659. Nov 01 05:53:00 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31953-17)
  660. Nov 01 05:53:00 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31953-17) state:2
  661. Nov 01 05:53:00 [9139] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9139-31953-12)
  662. Nov 01 05:53:00 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-31953-12) state:2
  663. drbd[31923]: 2012/11/01_05:53:00 DEBUG: drives: Exit code 0
  664. drbd[31923]: 2012/11/01_05:53:00 DEBUG: drives: Command output:
  665. Nov 01 05:53:00 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31923 - exited with rc=0
  666. Nov 01 05:53:00 [9138] storage1 lrmd: debug: operation_finished: p_drbd_drives_monitor_20000:31923 [ ]
  667. Nov 01 05:53:01 [9135] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (9135-31970-17)
  668. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (9135-31970-17)
  669. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (9135-31970-17)
  670. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-31970-17) state:2
  671. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: qb_ipc_us_ready: poll(fd 7) got POLLHUP
  672. Nov 01 05:53:01 [9139] storage1 attrd: debug: qb_ipc_us_ready: poll(fd 6) got POLLHUP
  673. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: qb_ipc_us_ready: poll(fd 6) got POLLHUP
  674. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  675. Nov 01 05:53:01 [9139] storage1 attrd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  676. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 8) got POLLHUP
  677. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  678. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipc_us_ready: poll(fd 6) got POLLHUP
  679. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  680. Nov 01 05:53:01 [9139] storage1 attrd: error: pcmk_cpg_dispatch: Connection to the CPG API failed: 2
  681. Nov 01 05:53:01 [9135] storage1 cib: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  682. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: cfg_connection_destroy: Connection destroyed
  683. Nov 01 05:53:01 [9141] storage1 crmd: info: crmd_quorum_destroy: connection closed
  684. Nov 01 05:53:01 [9137] storage1 stonith-ng: error: pcmk_cpg_dispatch: Connection to the CPG API failed: 2
  685. Nov 01 05:53:01 [9139] storage1 attrd: crit: attrd_ais_destroy: Lost connection to Corosync service!
  686. Nov 01 05:53:01 [9135] storage1 cib: error: pcmk_cpg_dispatch: Connection to the CPG API failed: 2
  687. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: qb_ipc_us_ready: poll(fd 8) got POLLHUP
  688. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  689. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 7) got POLLHUP
  690. Nov 01 05:53:01 [9137] storage1 stonith-ng: error: stonith_peer_ais_destroy: AIS connection terminated
  691. Nov 01 05:53:01 [9139] storage1 attrd: notice: main: Exiting...
  692. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  693. Nov 01 05:53:01 [9135] storage1 cib: error: cib_ais_destroy: Corosync connection lost! Exiting.
  694. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: cpg_connection_destroy: Connection destroyed
  695. Nov 01 05:53:01 [9137] storage1 stonith-ng: info: stonith_shutdown: Terminating with 2 clients
  696. Nov 01 05:53:01 [9135] storage1 cib: debug: uninitializeCib: Deallocating the CIB.
  697. Nov 01 05:53:01 [9139] storage1 attrd: notice: main: Disconnecting client 0x24e0b00, pid=9141...
  698. Nov 01 05:53:01 [9133] storage1 pacemakerd: notice: pcmk_shutdown_worker: Shuting down Pacemaker
  699. Nov 01 05:53:01 [9141] storage1 crmd: error: pcmk_cpg_dispatch: Connection to the CPG API failed: 2
  700. Nov 01 05:53:01 [9139] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9139-9141-10) state:2
  701. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: cib_native_signoff: Signing out of the CIB Service
  702. Nov 01 05:53:01 [9141] storage1 crmd: info: crmd_ais_destroy: connection closed
  703. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  704. Nov 01 05:53:01 [9133] storage1 pacemakerd: notice: stop_child: Stopping crmd: Sent -15 to process 9141
  705. Nov 01 05:53:01 [9141] storage1 crmd: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
  706. Nov 01 05:53:01 [9139] storage1 attrd: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  707. Nov 01 05:53:01 [9139] storage1 attrd: info: qb_ipcs_us_withdraw: withdrawing server sockets
  708. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  709. Nov 01 05:53:01 [9139] storage1 attrd: debug: cib_native_signoff: Signing out of the CIB Service
  710. Nov 01 05:53:01 [9141] storage1 crmd: notice: crm_shutdown: Requesting shutdown, upper limit is 1200000ms
  711. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9137-9138-13) state:2
  712. Nov 01 05:53:01 [9139] storage1 attrd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  713. Nov 01 05:53:01 [9141] storage1 crmd: debug: crm_timer_start: Started Shutdown Escalation (I_STOP:1200000ms), src=85
  714. Nov 01 05:53:01 [9141] storage1 crmd: debug: s_crmd_fsa: Processing I_SHUTDOWN: [ state=S_NOT_DC cause=C_SHUTDOWN origin=crm_shutdown ]
  715. Nov 01 05:53:01 [9141] storage1 crmd: info: do_shutdown_req: Sending shutdown request to storagequorum
  716. Nov 01 05:53:01 [9137] storage1 stonith-ng: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9137-9141-10) state:2
  717. Nov 01 05:53:01 [9139] storage1 attrd: debug: cib_native_signoff: Signing out of the CIB Service
  718. Nov 01 05:53:01 [9139] storage1 attrd: error: attrd_cib_connection_destroy: Connection to the CIB terminated...
  719. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  720. Nov 01 05:53:01 [9137] storage1 stonith-ng: info: qb_ipcs_us_withdraw: withdrawing server sockets
  721. Nov 01 05:53:01 [9137] storage1 stonith-ng: info: crm_xml_cleanup: Cleaning up memory from libxml2
  722. Nov 01 05:53:01 [9141] storage1 crmd: error: send_ais_text: Sending message 63 via cpg: FAILED (rc=2): Library error: Transport endpoint is not connected (107)
  723. Nov 01 05:53:01 [9141] storage1 crmd: debug: s_crmd_fsa: Processing I_ERROR: [ state=S_NOT_DC cause=C_FSA_INTERNAL origin=do_shutdown_req ]
  724. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipc_us_ready: poll(fd 10) got POLLHUP
  725. Nov 01 05:53:01 [9137] storage1 stonith-ng: info: main: Done
  726. Nov 01 05:53:01 [9141] storage1 crmd: error: do_log: FSA: Input I_ERROR from do_shutdown_req() received in state S_NOT_DC
  727. Nov 01 05:53:01 [9138] storage1 lrmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  728. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipc_us_ready: poll(fd 9) got POLLHUP
  729. Nov 01 05:53:01 [9141] storage1 crmd: notice: do_state_transition: State transition S_NOT_DC -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_shutdown_req ]
  730. Nov 01 05:53:01 [9138] storage1 lrmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  731. Nov 01 05:53:01 [9141] storage1 crmd: error: do_recover: Action A_RECOVER (0000000001000000) not supported
  732. Nov 01 05:53:01 [9141] storage1 crmd: debug: s_crmd_fsa: Processing I_TERMINATE: [ state=S_RECOVERY cause=C_FSA_INTERNAL origin=do_recover ]
  733. Nov 01 05:53:01 [9138] storage1 lrmd: error: crm_ipc_read: Connection to stonith-ng failed
  734. Nov 01 05:53:01 [9141] storage1 crmd: error: do_log: FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY
  735. Nov 01 05:53:01 [9141] storage1 crmd: info: do_state_transition: State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ]
  736. Nov 01 05:53:01 [9141] storage1 crmd: info: do_shutdown: Disconnecting STONITH...
  737. Nov 01 05:53:01 [9138] storage1 lrmd: error: mainloop_gio_callback: Connection to stonith-ng[0x2410080] closed (I/O condition=17)
  738. Nov 01 05:53:01 [9141] storage1 crmd: debug: stonith_api_signoff: Signing out of the STONITH Service
  739. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  740. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  741. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipc_us_ready: poll(fd 10) got POLLHUP
  742. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 12) got POLLHUP
  743. Nov 01 05:53:01 [9138] storage1 lrmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  744. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  745. Nov 01 05:53:01 [9138] storage1 lrmd: debug: get_xpath_object: No match for //st_notify_disconnect in /notify
  746. Nov 01 05:53:01 [9141] storage1 crmd: debug: get_xpath_object: No match for //st_notify_disconnect in /notify
  747. Nov 01 05:53:01 [9141] storage1 crmd: info: tengine_stonith_connection_destroy: Fencing daemon disconnected
  748. Nov 01 05:53:01 [9138] storage1 lrmd: error: stonith_connection_destroy_cb: LRMD lost STONITH connection
  749. Nov 01 05:53:01 [9141] storage1 crmd: debug: verify_stopped: Checking for active resources before exit
  750. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Cancelling op 94 for p_drbd_drives (p_drbd_drives:94)
  751. Nov 01 05:53:01 [9135] storage1 cib: debug: uninitializeCib: The CIB has been deallocated.
  752. Nov 01 05:53:01 [9135] storage1 cib: info: terminate_cib: cib_ais_destroy: Exiting fast...
  753. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  754. Nov 01 05:53:01 [9135] storage1 cib: info: qb_ipcs_us_withdraw: withdrawing server sockets
  755. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: pcmk_child_exit: Child process attrd exited (pid=9139, rc=1)
  756. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  757. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-9139-15) state:2
  758. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000110312 (was 00000000000000000000000000111312)
  759. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-9137-13) state:2
  760. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  761. Nov 01 05:53:01 [9135] storage1 cib: info: qb_ipcs_us_withdraw: withdrawing server sockets
  762. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  763. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9135-9141-11) state:2
  764. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-cib_shm-response-9135-9141-11-header
  765. Nov 01 05:53:01 [9138] storage1 lrmd: info: cancel_recurring_action: Cancelling operation p_drbd_drives_monitor_20000
  766. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-cib_shm-event-9135-9141-11-header
  767. Nov 01 05:53:01 [9133] storage1 pacemakerd: info: pcmk_child_exit: Child process stonith-ng exited (pid=9137, rc=0)
  768. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000010312 (was 00000000000000000000000000110312)
  769. Nov 01 05:53:01 [9135] storage1 cib: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-cib_shm-request-9135-9141-11-header
  770. Nov 01 05:53:01 [9138] storage1 lrmd: debug: process_lrmd_message: Processed lrmd_rsc_cancel operation from ef19f2ec-455a-4908-9652-a34c6feeed99: rc=0, reply=1, notify=0, exit=0
  771. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  772. Nov 01 05:53:01 [9135] storage1 cib: info: qb_ipcs_us_withdraw: withdrawing server sockets
  773. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Op 94 for p_drbd_drives (p_drbd_drives:94): cancelled
  774. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Cancelling op 98 for p_daemon_nfs-kernel-server (p_daemon_nfs-kernel-server:98)
  775. Nov 01 05:53:01 [9138] storage1 lrmd: info: cancel_recurring_action: Cancelling operation p_daemon_nfs-kernel-server_status_30000
  776. Nov 01 05:53:01 [9138] storage1 lrmd: debug: process_lrmd_message: Processed lrmd_rsc_cancel operation from ef19f2ec-455a-4908-9652-a34c6feeed99: rc=0, reply=1, notify=0, exit=0
  777. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Op 98 for p_daemon_nfs-kernel-server (p_daemon_nfs-kernel-server:98): cancelled
  778. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Cancelling op 96 for p_ping (p_ping:96)
  779. Nov 01 05:53:01 [9138] storage1 lrmd: info: services_action_cancel: Cancelling op: p_ping_monitor_10000 will occur once operation completes
  780. Nov 01 05:53:01 [9138] storage1 lrmd: debug: process_lrmd_message: Processed lrmd_rsc_cancel operation from ef19f2ec-455a-4908-9652-a34c6feeed99: rc=0, reply=1, notify=0, exit=0
  781. Nov 01 05:53:01 [9141] storage1 crmd: debug: cancel_op: Op 96 for p_ping (p_ping:96): cancelled
  782. Nov 01 05:53:01 [9141] storage1 crmd: error: verify_stopped: Resource stonithstorage0 was active at shutdown. You may ignore this error if it is unmanaged.
  783. Nov 01 05:53:01 [9141] storage1 crmd: info: lrmd_api_disconnect: Disconnecting from lrmd service
  784. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  785. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-lrmd-request-9138-9141-7-header
  786. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipcs_dispatch_connection_request: HUP conn (9138-9141-7)
  787. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(9138-9141-7) state:2
  788. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-lrmd-response-9138-9141-7-header
  789. Nov 01 05:53:01 [9138] storage1 lrmd: info: lrmd_ipc_destroy: LRMD client disconnecting 0x2403c00 - name: crmd id: ef19f2ec-455a-4908-9652-a34c6feeed99
  790. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-lrmd-event-9138-9141-7-header
  791. Nov 01 05:53:01 [9138] storage1 lrmd: info: services_action_cancel: Cancelling op: p_ping_monitor_10000 will occur once operation completes
  792. Nov 01 05:53:01 [9141] storage1 crmd: info: lrmd_connection_destroy: connection destroyed
  793. Nov 01 05:53:01 [9141] storage1 crmd: info: lrm_connection_destroy: LRM Connection disconnected
  794. Nov 01 05:53:01 [9141] storage1 crmd: info: do_lrm_control: Disconnected from the LRM
  795. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-lrmd-response-9138-9141-7-header
  796. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-lrmd-event-9138-9141-7-header
  797. Nov 01 05:53:01 [9141] storage1 crmd: info: crm_cluster_disconnect: Disconnecting from cluster infrastructure: corosync
  798. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_rb_close: Free'ing ringbuffer: /dev/shm/qb-lrmd-request-9138-9141-7-header
  799. Nov 01 05:53:01 [9141] storage1 crmd: notice: terminate_cs_connection: Disconnecting from Corosync
  800. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  801. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  802. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  803. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 7) got POLLHUP
  804. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  805. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cpg-request-9108-9141-29-header
  806. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cpg-response-9108-9141-29-header
  807. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: pcmk_child_exit: Child process cib exited (pid=9135, rc=64)
  808. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cpg-event-9108-9141-29-header
  809. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000010212 (was 00000000000000000000000000010312)
  810. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  811. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  812. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 8) got POLLHUP
  813. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  814. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-quorum-request-9108-9141-30-header
  815. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-quorum-response-9108-9141-30-header
  816. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-quorum-event-9108-9141-30-header
  817. Nov 01 05:53:01 [9141] storage1 crmd: info: crm_cluster_disconnect: Disconnected from corosync
  818. Nov 01 05:53:01 [9141] storage1 crmd: info: do_ha_control: Disconnected from the cluster
  819. Nov 01 05:53:01 [9141] storage1 crmd: info: do_cib_control: Disconnecting CIB
  820. Nov 01 05:53:01 [9141] storage1 crmd: debug: cib_client_del_notify_callback: Removing callback for cib_diff_notify events
  821. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 6) got POLLHUP
  822. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  823. Nov 01 05:53:01 [9141] storage1 crmd: notice: crm_ipc_send: Connection to cib_shm closed
  824. Nov 01 05:53:01 [9141] storage1 crmd: notice: crm_ipc_send: Connection to cib_shm closed
  825. Nov 01 05:53:01 [9141] storage1 crmd: error: cib_native_perform_op_delegate: Couldn't perform cib_slave operation (timeout=120s): -107: Transport endpoint is not connected (107)
  826. Nov 01 05:53:01 [9141] storage1 crmd: error: cib_native_perform_op_delegate: CIB disconnected
  827. Nov 01 05:53:01 [9141] storage1 crmd: debug: cib_native_signoff: Signing out of the CIB Service
  828. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  829. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 6) got POLLHUP
  830. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  831. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cib_shm-request-9135-9141-11-header
  832. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cib_shm-response-9135-9141-11-header
  833. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_rb_force_close: Force free'ing ringbuffer: /dev/shm/qb-cib_shm-event-9135-9141-11-header
  834. Nov 01 05:53:01 [9141] storage1 crmd: info: crmd_cib_connection_destroy: Connection to the CIB terminated...
  835. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  836. Nov 01 05:53:01 [9141] storage1 crmd: info: qb_ipcs_us_withdraw: withdrawing server sockets
  837. Nov 01 05:53:01 [9141] storage1 crmd: debug: verify_stopped: Checking for active resources before exit
  838. Nov 01 05:53:01 [9141] storage1 crmd: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd
  839. Nov 01 05:53:01 [9141] storage1 crmd: error: do_exit: Could not recover from internal error
  840. Nov 01 05:53:01 [9141] storage1 crmd: info: do_exit: [crmd] stopped (2)
  841. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  842. Nov 01 05:53:01 [9141] storage1 crmd: debug: qb_ipc_us_ready: poll(fd 15) got POLLHUP
  843. Nov 01 05:53:01 [9141] storage1 crmd: debug: _check_connection_state: interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
  844. Nov 01 05:53:01 [9141] storage1 crmd: info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ]
  845. Nov 01 05:53:01 [9141] storage1 crmd: debug: free_mem: Number of connected clients: 0
  846. Nov 01 05:53:01 [9141] storage1 crmd: info: lrmd_api_disconnect: Disconnecting from lrmd service
  847. Nov 01 05:53:01 [9141] storage1 crmd: info: crm_xml_cleanup: Cleaning up memory from libxml2
  848. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: pcmk_child_exit: Child process crmd exited (pid=9141, rc=2)
  849. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000010012 (was 00000000000000000000000000010212)
  850. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  851. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: crmd confirmed stopped
  852. Nov 01 05:53:01 [9133] storage1 pacemakerd: notice: stop_child: Stopping pengine: Sent -15 to process 9140
  853. Nov 01 05:53:01 [9140] storage1 pengine: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
  854. Nov 01 05:53:01 [9140] storage1 pengine: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  855. Nov 01 05:53:01 [9140] storage1 pengine: info: qb_ipcs_us_withdraw: withdrawing server sockets
  856. Nov 01 05:53:01 [9133] storage1 pacemakerd: info: pcmk_child_exit: Child process pengine exited (pid=9140, rc=0)
  857. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000000012 (was 00000000000000000000000000010012)
  858. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  859. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: pengine confirmed stopped
  860. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: attrd confirmed stopped
  861. Nov 01 05:53:01 [9133] storage1 pacemakerd: notice: stop_child: Stopping lrmd: Sent -15 to process 9138
  862. Nov 01 05:53:01 [9138] storage1 lrmd: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
  863. Nov 01 05:53:01 [9138] storage1 lrmd: info: lrmd_shutdown: Terminating with 0 clients
  864. Nov 01 05:53:01 [9138] storage1 lrmd: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  865. Nov 01 05:53:01 [9138] storage1 lrmd: info: qb_ipcs_us_withdraw: withdrawing server sockets
  866. Nov 01 05:53:01 [9133] storage1 pacemakerd: info: pcmk_child_exit: Child process lrmd exited (pid=9138, rc=0)
  867. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000000002 (was 00000000000000000000000000000012)
  868. Nov 01 05:53:01 [9133] storage1 pacemakerd: error: send_cpg_message: Sending message via cpg FAILED: (rc=9) Bad handle
  869. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: lrmd confirmed stopped
  870. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: stonith-ng confirmed stopped
  871. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: pcmk_shutdown_worker: cib confirmed stopped
  872. Nov 01 05:53:01 [9133] storage1 pacemakerd: notice: pcmk_shutdown_worker: Shutdown complete
  873. Nov 01 05:53:01 [9133] storage1 pacemakerd: debug: qb_ipcs_unref: qb_ipcs_unref() - destroying
  874. Nov 01 05:53:01 [9133] storage1 pacemakerd: info: qb_ipcs_us_withdraw: withdrawing server sockets
  875. Nov 01 05:53:01 [9133] storage1 pacemakerd: info: main: Exiting pacemakerd
  876. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] Token Timeout (1000 ms) retransmit timeout (238 ms)
  877. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] token hold (180 ms) retransmits before loss (4 retrans)
  878. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] join (50 ms) send_join (0 ms) consensus (1200 ms) merge (200 ms)
  879. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] downcheck (1000 ms) fail to recv const (2500 msgs)
  880. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] seqno unchanged const (30 rotations) Maximum network MTU 1401
  881. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] window size per rotation (50 messages) maximum messages per rotation (17 messages)
  882. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] missed count const (5 messages)
  883. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] send threads (0 threads)
  884. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP token expired timeout (238 ms)
  885. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP token problem counter (2000 ms)
  886. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP threshold (10 problem count)
  887. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP multicast threshold (100 problem count)
  888. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP automatic recovery check timeout (1000 ms)
  889. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] RRP mode set to active.
  890. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] heartbeat_failures_allowed (0)
  891. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] max_network_delay (50 ms)
  892. Nov 01 05:53:02 [32038] storage1 corosync debug [TOTEM ] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
  893. Nov 01 05:53:02 [32038] storage1 corosync notice [TOTEM ] Initializing transport (UDP/IP Multicast).
  894. Nov 01 05:53:02 [32038] storage1 corosync notice [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none
  895. Nov 01 05:53:02 [32038] storage1 corosync notice [TOTEM ] Initializing transport (UDP/IP Multicast).
  896. Nov 01 05:53:02 [32038] storage1 corosync notice [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none
  897. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Receive multicast socket recv buffer size (262142 bytes).
  898. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Transmit multicast socket send buffer size (262142 bytes).
  899. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Local receive multicast loop socket recv buffer size (262142 bytes).
  900. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Local transmit multicast loop socket send buffer size (262142 bytes).
  901. Nov 01 05:53:03 [32038] storage1 corosync notice [TOTEM ] The network interface [10.52.1.149] is now up.
  902. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Created or loaded sequence id 1c19f8.10.52.1.149 for this ring.
  903. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync configuration map access [0]
  904. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Initializing IPC on cmap [0]
  905. Nov 01 05:53:03 [32038] storage1 corosync info [QB ] server name: cmap
  906. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync configuration service [1]
  907. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Initializing IPC on cfg [1]
  908. Nov 01 05:53:03 [32038] storage1 corosync info [QB ] server name: cfg
  909. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2]
  910. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Initializing IPC on cpg [2]
  911. Nov 01 05:53:03 [32038] storage1 corosync info [QB ] server name: cpg
  912. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync profile loading service [4]
  913. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] NOT Initializing IPC on pload [4]
  914. Nov 01 05:53:03 [32038] storage1 corosync notice [QUORUM] Using quorum provider corosync_votequorum
  915. Nov 01 05:53:03 [32038] storage1 corosync debug [QUORUM] Reading configuration (runtime: 0)
  916. Nov 01 05:53:03 [32038] storage1 corosync debug [QUORUM] No nodelist defined or our node is not in the nodelist
  917. Nov 01 05:53:03 [32038] storage1 corosync debug [QUORUM] total_votes=1, expected_votes=3
  918. Nov 01 05:53:03 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  919. Nov 01 05:53:03 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  920. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5]
  921. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Initializing IPC on votequorum [5]
  922. Nov 01 05:53:03 [32038] storage1 corosync info [QB ] server name: votequorum
  923. Nov 01 05:53:03 [32038] storage1 corosync notice [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3]
  924. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Initializing IPC on quorum [3]
  925. Nov 01 05:53:03 [32038] storage1 corosync info [QB ] server name: quorum
  926. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Receive multicast socket recv buffer size (262142 bytes).
  927. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Transmit multicast socket send buffer size (262142 bytes).
  928. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Local receive multicast loop socket recv buffer size (262142 bytes).
  929. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Local transmit multicast loop socket send buffer size (262142 bytes).
  930. Nov 01 05:53:03 [32038] storage1 corosync notice [TOTEM ] The network interface [192.168.7.149] is now up.
  931. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] entering GATHER state from 15.
  932. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Creating commit token because I am the rep.
  933. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Saving state aru 0 high seq received 0
  934. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Storing new sequence id for ring 1c19fc
  935. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] entering COMMIT state.
  936. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  937. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] entering RECOVERY state.
  938. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] position [0] member 10.52.1.149:
  939. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] previous ring seq 1c19f8 rep 10.52.1.149
  940. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] aru 0 high delivered 0 received flag 1
  941. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Did not need to originate any messages in recovery.
  942. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  943. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  944. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  945. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  946. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  947. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  948. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  949. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  950. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  951. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  952. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
  953. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  954. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] got commit token
  955. Nov 01 05:53:03 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  956. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Denied connection, corosync is not ready
  957. Nov 01 05:53:03 [32038] storage1 corosync error [QB ] Error in connection setup (32039-32046-24): Resource temporarily unavailable (11)
  958. Nov 01 05:53:03 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32046-24) state:0
  959. Nov 01 05:53:03 [32038] storage1 corosync debug [MAIN ] Denied connection, corosync is not ready
  960. Nov 01 05:53:03 [32038] storage1 corosync error [QB ] Error in connection setup (32039-32048-25): Resource temporarily unavailable (11)
  961. Nov 01 05:53:03 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32048-25) state:0
  962. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] The token was lost in the RECOVERY state.
  963. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Restoring instance->my_aru 0 my high seq received 0
  964. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering GATHER state from 5.
  965. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Creating commit token because I am the rep.
  966. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Storing new sequence id for ring 1c1a00
  967. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering COMMIT state.
  968. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  969. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering RECOVERY state.
  970. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] position [0] member 10.52.1.149:
  971. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] previous ring seq 1c19f8 rep 10.52.1.149
  972. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] aru 0 high delivered 0 received flag 1
  973. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Did not need to originate any messages in recovery.
  974. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  975. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  976. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  977. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  978. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  979. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  980. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  981. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  982. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  983. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Sending initial ORF token
  984. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
  985. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  986. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
  987. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  988. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
  989. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  990. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0
  991. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Resetting old ring state
  992. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] recovery to regular 1-0
  993. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] Member joined: r(0) ip(10.52.1.149) r(1) ip(192.168.7.149)
  994. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  995. Nov 01 05:53:04 [32038] storage1 corosync notice [QUORUM] Members[1]: -1795083254
  996. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering OPERATIONAL state.
  997. Nov 01 05:53:04 [32038] storage1 corosync notice [TOTEM ] A processor joined or left the membership and a new membership (10.52.1.149:1841664) was formed.
  998. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  999. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2499884042]: votes: 1, expected: 3 flags: 8
  1000. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1001. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=1, expected_votes=3
  1002. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1003. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1004. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2499884042]: votes: 1, expected: 3 flags: 8
  1005. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1006. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=1, expected_votes=3
  1007. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1008. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1009. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1010. Nov 01 05:53:04 [32038] storage1 corosync debug [SYNC ] Committing synchronization for corosync configuration map access
  1011. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] Single node sync -> no action
  1012. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] comparing: sender r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ; members(old:0 left:0)
  1013. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] chosen downlist: sender r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ; members(old:0 left:0)
  1014. Nov 01 05:53:04 [32038] storage1 corosync debug [SYNC ] Committing synchronization for corosync cluster closed process group service v1.01
  1015. Nov 01 05:53:04 [32038] storage1 corosync notice [MAIN ] Completed service synchronization, ready to provide service.
  1016. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering GATHER state from 11.
  1017. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1018. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Saving state aru 5 high seq received 5
  1019. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Storing new sequence id for ring 1c1a04
  1020. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering COMMIT state.
  1021. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1022. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1023. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1024. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering RECOVERY state.
  1025. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] TRANS [0] member 10.52.1.149:
  1026. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] position [0] member 10.52.1.24:
  1027. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] previous ring seq 1c19fc rep 10.52.1.24
  1028. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] aru d high delivered d received flag 1
  1029. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] position [1] member 10.52.1.148:
  1030. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] previous ring seq 1c19fc rep 10.52.1.24
  1031. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] aru d high delivered d received flag 1
  1032. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] position [2] member 10.52.1.149:
  1033. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] previous ring seq 1c1a00 rep 10.52.1.149
  1034. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] aru 5 high delivered 5 received flag 1
  1035. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Did not need to originate any messages in recovery.
  1036. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1037. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] got commit token
  1038. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru ffffffff
  1039. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  1040. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
  1041. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  1042. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
  1043. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  1044. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
  1045. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] install seq 0 aru 0 high seq received 0
  1046. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0
  1047. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] Resetting old ring state
  1048. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] recovery to regular 1-0
  1049. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1050. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] Member joined: r(0) ip(10.52.1.24) r(1) ip(192.168.7.24)
  1051. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] Member joined: r(0) ip(10.52.1.148) r(1) ip(192.168.7.148)
  1052. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1053. Nov 01 05:53:04 [32038] storage1 corosync notice [QUORUM] Members[3]: 402732042 -1811860470 -1795083254
  1054. Nov 01 05:53:04 [32038] storage1 corosync debug [TOTEM ] entering OPERATIONAL state.
  1055. Nov 01 05:53:04 [32038] storage1 corosync notice [TOTEM ] A processor joined or left the membership and a new membership (10.52.1.24:1841668) was formed.
  1056. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2483106826
  1057. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2483106826]: votes: 1, expected: 3 flags: 1
  1058. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1059. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=2, expected_votes=3
  1060. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2483106826 state=1, votes=1, expected=3
  1061. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1062. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] lowest node id: -1811860470 us: -1795083254
  1063. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] quorum regained, resuming activity
  1064. Nov 01 05:53:04 [32038] storage1 corosync notice [QUORUM] This node is within the primary component and will provide service.
  1065. Nov 01 05:53:04 [32038] storage1 corosync notice [QUORUM] Members[3]: 402732042 -1811860470 -1795083254
  1066. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2483106826
  1067. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1068. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2483106826
  1069. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2483106826]: votes: 1, expected: 3 flags: 1
  1070. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1071. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2483106826
  1072. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1073. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1074. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2499884042]: votes: 1, expected: 3 flags: 8
  1075. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1076. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=2, expected_votes=3
  1077. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2483106826 state=1, votes=1, expected=3
  1078. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1079. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] lowest node id: -1811860470 us: -1795083254
  1080. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1081. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1082. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1083. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[2499884042]: votes: 1, expected: 3 flags: 0
  1084. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1085. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=2, expected_votes=3
  1086. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2483106826 state=1, votes=1, expected=3
  1087. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1088. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] lowest node id: -1811860470 us: -1795083254
  1089. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 2499884042
  1090. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1091. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 402732042
  1092. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[402732042]: votes: 1, expected: 3 flags: 1
  1093. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1094. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] total_votes=3, expected_votes=3
  1095. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2483106826 state=1, votes=1, expected=3
  1096. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 2499884042 state=1, votes=1, expected=3
  1097. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] node 402732042 state=1, votes=1, expected=3
  1098. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] lowest node id: -1811860470 us: -1795083254
  1099. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 402732042
  1100. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1101. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 402732042
  1102. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[402732042]: votes: 1, expected: 3 flags: 1
  1103. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
  1104. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] got nodeinfo message from cluster node 402732042
  1105. Nov 01 05:53:04 [32038] storage1 corosync debug [QUORUM] nodeinfo message[0]: votes: 0, expected: 0 flags: 0
  1106. Nov 01 05:53:04 [32038] storage1 corosync debug [SYNC ] Committing synchronization for corosync configuration map access
  1107. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] My config version is 0 -> no action
  1108. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] got joinlist message from node 1801340a
  1109. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] comparing: sender r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) ; members(old:2 left:0)
  1110. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] comparing: sender r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) ; members(old:2 left:0)
  1111. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] comparing: sender r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ; members(old:1 left:0)
  1112. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] chosen downlist: sender r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) ; members(old:2 left:0)
  1113. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] got joinlist message from node 9401340a
  1114. Nov 01 05:53:04 [32038] storage1 corosync debug [SYNC ] Committing synchronization for corosync cluster closed process group service v1.01
  1115. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[0] group:crmd\x00, ip:r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) , pid:19031
  1116. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[1] group:attrd\x00, ip:r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) , pid:19029
  1117. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[2] group:stonith-ng\x00, ip:r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) , pid:19027
  1118. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[3] group:cib\x00, ip:r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) , pid:19025
  1119. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[4] group:pcmk\x00, ip:r(0) ip(10.52.1.148) r(1) ip(192.168.7.148) , pid:19023
  1120. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[5] group:crmd\x00, ip:r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) , pid:17871
  1121. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[6] group:attrd\x00, ip:r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) , pid:17869
  1122. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[7] group:stonith-ng\x00, ip:r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) , pid:17867
  1123. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[8] group:cib\x00, ip:r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) , pid:17865
  1124. Nov 01 05:53:04 [32038] storage1 corosync debug [CPG ] joinlist_messages[9] group:pcmk\x00, ip:r(0) ip(10.52.1.24) r(1) ip(192.168.7.24) , pid:17863
  1125. Nov 01 05:53:04 [32038] storage1 corosync notice [MAIN ] Completed service synchronization, ready to provide service.
  1126. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32050-26)
  1127. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] connecting to client [32050]
  1128. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1129. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1130. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1131. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] connection created
  1132. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] HUP conn (32039-32050-26)
  1133. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32050-26) state:2
  1134. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1135. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1136. Nov 01 05:53:04 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1137. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cfg-response-32039-32050-26-header
  1138. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cfg-event-32039-32050-26-header
  1139. Nov 01 05:53:04 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cfg-request-32039-32050-26-header
  1140. Nov 01 05:53:05 [32055] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 5 retries remaining
  1141. Nov 01 05:53:05 [32055] storage1 attrd_updater: info: crm_ipc_connect: Could not establish attrd connection: Connection refused (32)
  1142. Nov 01 05:53:05 [32055] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 4 retries remaining
  1143. Nov 01 05:53:05 [32055] storage1 attrd_updater: info: crm_ipc_connect: Could not establish attrd connection: Connection refused (32)
  1144. Nov 01 05:53:06 [32055] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 3 retries remaining
  1145. Nov 01 05:53:06 [32055] storage1 attrd_updater: info: crm_ipc_connect: Could not establish attrd connection: Connection refused (32)
  1146. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32074-26)
  1147. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32074]
  1148. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1149. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1150. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1151. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1152. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc3ca700
  1153. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32074-27)
  1154. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32074]
  1155. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1156. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1157. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1158. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1159. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc3cb9d0
  1160. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] HUP conn (32039-32074-27)
  1161. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32074-27) state:2
  1162. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1163. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1164. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc3cb9d0
  1165. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1166. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32074-27-header
  1167. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32074-27-header
  1168. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32074-27-header
  1169. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] HUP conn (32039-32074-26)
  1170. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32074-26) state:2
  1171. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1172. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1173. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc3ca700
  1174. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1175. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32074-26-header
  1176. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: read_config: User configured file based logging and explicitly disabled syslog.
  1177. Nov 01 05:53:06 [32074] storage1 pacemakerd: notice: main: Starting Pacemaker 1.1.8 (Build: 1f8858c): generated-manpages agent-manpages ncurses libqb-logging libqb-ipc lha-fencing upstart systemd corosync-native snmp libesmtp
  1178. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32074-26-header
  1179. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: main: Maximum core file size is: 18446744073709551615
  1180. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: qb_ipcs_us_publish: server name: pacemakerd
  1181. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32074-26-header
  1182. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32074-26)
  1183. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32074]
  1184. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1185. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1186. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1187. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1188. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1189. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1190. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1191. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: cluster_connect_cfg: Our nodeid: -1795083254
  1192. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32074-27)
  1193. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32074]
  1194. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1195. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1196. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1197. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1198. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1199. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] lib_init_fn: conn=0x7fb8bc3ca700, cpd=0x7fb8bc3cd4e4
  1200. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1201. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1202. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: cluster_connect_cpg: Our nodeid: -1795083254
  1203. Nov 01 05:53:06 [32074] storage1 pacemakerd: notice: update_node_processes: 0x11d6580 Node 2499884042 now known as storage1, was:
  1204. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000000002 (was 00000000000000000000000000000000)
  1205. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] got procjoin message from cluster node -1795083254 (r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ) for pid 32074
  1206. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32076 for process cib
  1207. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000000102 (was 00000000000000000000000000000002)
  1208. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32078 for process stonith-ng
  1209. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000100102 (was 00000000000000000000000000000102)
  1210. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32079 for process lrmd
  1211. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000100112 (was 00000000000000000000000000100102)
  1212. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
  1213. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: get_cluster_type: Cluster type is: 'corosync'
  1214. Nov 01 05:53:06 [32078] storage1 stonith-ng: notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
  1215. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32080 for process attrd
  1216. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000101112 (was 00000000000000000000000000100112)
  1217. Nov 01 05:53:06 [32076] storage1 cib: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
  1218. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32078-28)
  1219. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32078]
  1220. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32081 for process pengine
  1221. Nov 01 05:53:06 [32076] storage1 cib: info: get_cluster_type: Cluster type is: 'corosync'
  1222. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000111112 (was 00000000000000000000000000101112)
  1223. Nov 01 05:53:06 [32076] storage1 cib: info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
  1224. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: start_child: Forked child 32082 for process crmd
  1225. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage1 now has process list: 00000000000000000000000000111312 (was 00000000000000000000000000111112)
  1226. Nov 01 05:53:06 [32074] storage1 pacemakerd: info: main: Starting mainloop
  1227. Nov 01 05:53:06 [32074] storage1 pacemakerd: notice: update_node_processes: 0x13da8c0 Node 2483106826 now known as storage0, was:
  1228. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storage0 now has process list: 00000000000000000000000000111312 (was 00000000000000000000000000000000)
  1229. Nov 01 05:53:06 [32074] storage1 pacemakerd: notice: update_node_processes: 0x13da100 Node 402732042 now known as storagequorum, was:
  1230. Nov 01 05:53:06 [32074] storage1 pacemakerd: debug: update_node_processes: Node storagequorum now has process list: 00000000000000000000000000111312 (was 00000000000000000000000000000000)
  1231. Nov 01 05:53:06 [32076] storage1 cib: info: validate_with_relaxng: Creating RNG parser context
  1232. Nov 01 05:53:06 [32079] storage1 lrmd: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
  1233. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
  1234. Nov 01 05:53:06 [32079] storage1 lrmd: info: qb_ipcs_us_publish: server name: lrmd
  1235. Nov 01 05:53:06 [32079] storage1 lrmd: info: main: Starting
  1236. Nov 01 05:53:06 [32080] storage1 attrd: info: main: Starting up
  1237. Nov 01 05:53:06 [32080] storage1 attrd: info: get_cluster_type: Cluster type is: 'corosync'
  1238. Nov 01 05:53:06 [32080] storage1 attrd: notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
  1239. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1240. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1241. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1242. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1243. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1244. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1245. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1246. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] lib_init_fn: conn=0x7fb8bc3cfda0, cpd=0x7fb8bc3d03c4
  1247. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32080-29)
  1248. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32080]
  1249. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1250. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1251. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1252. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1253. Nov 01 05:53:06 [32082] storage1 crmd: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
  1254. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] lib_init_fn: conn=0x7fb8bc3d17e0, cpd=0x7fb8bc3d1ea4
  1255. Nov 01 05:53:06 [32080] storage1 attrd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1256. Nov 01 05:53:06 [32082] storage1 crmd: notice: main: CRM Git Version: 1f8858c
  1257. Nov 01 05:53:06 [32080] storage1 attrd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1258. Nov 01 05:53:06 [32080] storage1 attrd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1259. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: crm_get_peer: Creating entry for node (null)/2499884042
  1260. Nov 01 05:53:06 [32080] storage1 attrd: debug: crm_get_peer: Creating entry for node (null)/2499884042
  1261. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_get_peer: Node <null> now has id: 2499884042
  1262. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_get_peer: Node <null> now has id: 2499884042
  1263. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_update_peer_proc: init_cpg_connection: Node (null)[-1795083254] - corosync-cpg is now online
  1264. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: init_cs_connection_once: Connection to 'corosync': established
  1265. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_update_peer_proc: init_cpg_connection: Node (null)[-1795083254] - corosync-cpg is now online
  1266. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_get_peer: Node 2499884042 is now known as storage1
  1267. Nov 01 05:53:06 [32080] storage1 attrd: info: init_cs_connection_once: Connection to 'corosync': established
  1268. Nov 01 05:53:06 [32082] storage1 crmd: debug: crmd_init: Starting crmd
  1269. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_get_peer: Node 2499884042 has uuid 2499884042
  1270. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_get_peer: Node 2499884042 is now known as storage1
  1271. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_get_peer: Node 2499884042 has uuid 2499884042
  1272. Nov 01 05:53:06 [32080] storage1 attrd: info: main: Cluster connection active
  1273. Nov 01 05:53:06 [32080] storage1 attrd: info: qb_ipcs_us_publish: server name: attrd
  1274. Nov 01 05:53:06 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_STARTUP: [ state=S_STARTING cause=C_STARTUP origin=crmd_init ]
  1275. Nov 01 05:53:06 [32082] storage1 crmd: debug: do_log: FSA: Input I_STARTUP from crmd_init() received in state S_STARTING
  1276. Nov 01 05:53:06 [32080] storage1 attrd: info: main: Accepting attribute updates
  1277. Nov 01 05:53:06 [32082] storage1 crmd: debug: do_startup: Registering Signal Handlers
  1278. Nov 01 05:53:06 [32082] storage1 crmd: debug: do_startup: Creating CIB and LRM objects
  1279. Nov 01 05:53:06 [32080] storage1 attrd: notice: main: Starting mainloop...
  1280. Nov 01 05:53:06 [32082] storage1 crmd: info: get_cluster_type: Cluster type is: 'corosync'
  1281. Nov 01 05:53:06 [32082] storage1 crmd: info: crm_ipc_connect: Could not establish cib_shm connection: Connection refused (111)
  1282. Nov 01 05:53:06 [32082] storage1 crmd: debug: cib_native_signon_raw: Connection unsuccessful (0 (nil))
  1283. Nov 01 05:53:06 [32082] storage1 crmd: debug: cib_native_signon_raw: Connection to CIB failed: Transport endpoint is not connected
  1284. Nov 01 05:53:06 [32082] storage1 crmd: debug: cib_native_signoff: Signing out of the CIB Service
  1285. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] got procjoin message from cluster node -1795083254 (r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ) for pid 32078
  1286. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] got procjoin message from cluster node -1795083254 (r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ) for pid 32080
  1287. Nov 01 05:53:06 [32080] storage1 attrd: info: pcmk_cpg_membership: Joined[0.0] attrd.-1795083254
  1288. Nov 01 05:53:06 [32080] storage1 attrd: debug: crm_get_peer: Creating entry for node (null)/402732042
  1289. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_get_peer: Node <null> now has id: 402732042
  1290. Nov 01 05:53:06 [32080] storage1 attrd: info: pcmk_cpg_membership: Member[0.0] attrd.402732042
  1291. Nov 01 05:53:06 [32078] storage1 stonith-ng: info: crm_ipc_connect: Could not establish cib_rw connection: Connection refused (111)
  1292. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[402732042] - corosync-cpg is now online
  1293. Nov 01 05:53:06 [32080] storage1 attrd: debug: crm_get_peer: Creating entry for node (null)/2483106826
  1294. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_get_peer: Node <null> now has id: 2483106826
  1295. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: cib_native_signon_raw: Connection unsuccessful (0 (nil))
  1296. Nov 01 05:53:06 [32080] storage1 attrd: info: pcmk_cpg_membership: Member[0.1] attrd.-1811860470
  1297. Nov 01 05:53:06 [32080] storage1 attrd: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[-1811860470] - corosync-cpg is now online
  1298. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: cib_native_signon_raw: Connection to CIB failed: Transport endpoint is not connected
  1299. Nov 01 05:53:06 [32080] storage1 attrd: info: pcmk_cpg_membership: Member[0.2] attrd.-1795083254
  1300. Nov 01 05:53:06 [32078] storage1 stonith-ng: debug: cib_native_signoff: Signing out of the CIB Service
  1301. Nov 01 05:53:06 [32081] storage1 pengine: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
  1302. Nov 01 05:53:06 [32081] storage1 pengine: debug: main: Checking for old instances of pengine
  1303. Nov 01 05:53:06 [32081] storage1 pengine: info: crm_ipc_connect: Could not establish pengine connection: Connection refused (111)
  1304. Nov 01 05:53:06 [32081] storage1 pengine: debug: main: Terminating previous instance
  1305. Nov 01 05:53:06 [32081] storage1 pengine: debug: main: Init server comms
  1306. Nov 01 05:53:06 [32081] storage1 pengine: info: qb_ipcs_us_publish: server name: pengine
  1307. Nov 01 05:53:06 [32081] storage1 pengine: info: main: Starting pengine
  1308. Nov 01 05:53:06 [32076] storage1 cib: debug: activateCibXml: Triggering CIB write for start op
  1309. Nov 01 05:53:06 [32076] storage1 cib: info: startCib: CIB Initialization completed successfully
  1310. Nov 01 05:53:06 [32076] storage1 cib: notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
  1311. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32076-30)
  1312. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] connecting to client [32076]
  1313. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1314. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1315. Nov 01 05:53:06 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1316. Nov 01 05:53:06 [32038] storage1 corosync debug [MAIN ] connection created
  1317. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] lib_init_fn: conn=0x7fb8bc3d81f0, cpd=0x7fb8bc3d8d74
  1318. Nov 01 05:53:06 [32076] storage1 cib: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1319. Nov 01 05:53:06 [32076] storage1 cib: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1320. Nov 01 05:53:06 [32076] storage1 cib: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1321. Nov 01 05:53:06 [32076] storage1 cib: debug: crm_get_peer: Creating entry for node (null)/2499884042
  1322. Nov 01 05:53:06 [32076] storage1 cib: info: crm_get_peer: Node <null> now has id: 2499884042
  1323. Nov 01 05:53:06 [32076] storage1 cib: info: crm_update_peer_proc: init_cpg_connection: Node (null)[-1795083254] - corosync-cpg is now online
  1324. Nov 01 05:53:06 [32076] storage1 cib: info: init_cs_connection_once: Connection to 'corosync': established
  1325. Nov 01 05:53:06 [32076] storage1 cib: info: crm_get_peer: Node 2499884042 is now known as storage1
  1326. Nov 01 05:53:06 [32076] storage1 cib: info: crm_get_peer: Node 2499884042 has uuid 2499884042
  1327. Nov 01 05:53:06 [32076] storage1 cib: info: qb_ipcs_us_publish: server name: cib_ro
  1328. Nov 01 05:53:06 [32076] storage1 cib: info: qb_ipcs_us_publish: server name: cib_rw
  1329. Nov 01 05:53:06 [32076] storage1 cib: info: qb_ipcs_us_publish: server name: cib_shm
  1330. Nov 01 05:53:06 [32076] storage1 cib: info: cib_init: Starting cib mainloop
  1331. Nov 01 05:53:06 [32038] storage1 corosync debug [CPG ] got procjoin message from cluster node -1795083254 (r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ) for pid 32076
  1332. Nov 01 05:53:06 [32076] storage1 cib: info: pcmk_cpg_membership: Joined[0.0] cib.-1795083254
  1333. Nov 01 05:53:06 [32076] storage1 cib: debug: crm_get_peer: Creating entry for node (null)/402732042
  1334. Nov 01 05:53:06 [32076] storage1 cib: info: crm_get_peer: Node <null> now has id: 402732042
  1335. Nov 01 05:53:06 [32076] storage1 cib: info: pcmk_cpg_membership: Member[0.0] cib.402732042
  1336. Nov 01 05:53:06 [32076] storage1 cib: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[402732042] - corosync-cpg is now online
  1337. Nov 01 05:53:06 [32076] storage1 cib: debug: crm_get_peer: Creating entry for node (null)/2483106826
  1338. Nov 01 05:53:06 [32076] storage1 cib: info: crm_get_peer: Node <null> now has id: 2483106826
  1339. Nov 01 05:53:06 [32076] storage1 cib: info: pcmk_cpg_membership: Member[0.1] cib.-1811860470
  1340. Nov 01 05:53:06 [32076] storage1 cib: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[-1811860470] - corosync-cpg is now online
  1341. Nov 01 05:53:06 [32076] storage1 cib: info: pcmk_cpg_membership: Member[0.2] cib.-1795083254
  1342. Nov 01 05:53:07 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32078-11)
  1343. Nov 01 05:53:07 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-32078-11)
  1344. Nov 01 05:53:07 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32082-13)
  1345. Nov 01 05:53:07 [32076] storage1 cib: debug: qb_ipcs_shm_connect: connecting to client [32082]
  1346. Nov 01 05:53:07 [32076] storage1 cib: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1347. Nov 01 05:53:07 [32076] storage1 cib: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1348. Nov 01 05:53:07 [32076] storage1 cib: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1349. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1350. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1351. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: cib_native_signon_raw: Connection to CIB successful
  1352. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:524288; real_size:524288; rb->word_size:131072
  1353. Nov 01 05:53:07 [32076] storage1 cib: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for crmd (04ed2d7b-d0e9-4049-be9c-8682e33d720a): on
  1354. Nov 01 05:53:07 [32078] storage1 stonith-ng: notice: setup_cib: Watching for stonith topology changes
  1355. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: qb_ipcs_us_publish: server name: stonith-ng
  1356. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: main: Starting stonith-ng mainloop
  1357. Nov 01 05:53:07 [32082] storage1 crmd: debug: cib_native_signon_raw: Connection to CIB successful
  1358. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: pcmk_cpg_membership: Joined[0.0] stonith-ng.-1795083254
  1359. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: crm_get_peer: Creating entry for node (null)/402732042
  1360. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node <null> now has id: 402732042
  1361. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: pcmk_cpg_membership: Member[0.0] stonith-ng.402732042
  1362. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[402732042] - corosync-cpg is now online
  1363. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: st_peer_update_callback: Broadcasting our uname because of node 402732042
  1364. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: crm_get_peer: Creating entry for node (null)/2483106826
  1365. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node <null> now has id: 2483106826
  1366. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: pcmk_cpg_membership: Member[0.1] stonith-ng.-1811860470
  1367. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[-1811860470] - corosync-cpg is now online
  1368. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: st_peer_update_callback: Broadcasting our uname because of node 2483106826
  1369. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: pcmk_cpg_membership: Member[0.2] stonith-ng.-1795083254
  1370. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node 2483106826 is now known as storage0
  1371. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: st_peer_update_callback: Broadcasting our uname because of node 2483106826
  1372. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node 2483106826 has uuid 2483106826
  1373. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node 402732042 is now known as storagequorum
  1374. Nov 01 05:53:07 [32078] storage1 stonith-ng: debug: st_peer_update_callback: Broadcasting our uname because of node 402732042
  1375. Nov 01 05:53:07 [32078] storage1 stonith-ng: info: crm_get_peer: Node 402732042 has uuid 402732042
  1376. Nov 01 05:53:07 [32076] storage1 cib: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for crmd (164ec415-f12e-41b6-8b99-58f35b7228ab): on
  1377. Nov 01 05:53:07 [32076] storage1 cib: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for crmd (164ec415-f12e-41b6-8b99-58f35b7228ab): on
  1378. Nov 01 05:53:07 [32082] storage1 crmd: info: do_cib_control: CIB connection established
  1379. Nov 01 05:53:07 [32082] storage1 crmd: notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
  1380. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-31)
  1381. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1382. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1383. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1384. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1385. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1386. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1387. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1388. Nov 01 05:53:07 [32038] storage1 corosync debug [CPG ] lib_init_fn: conn=0x7fb8bc3ce320, cpd=0x7fb8bc3ce894
  1389. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1390. Nov 01 05:53:07 [32082] storage1 crmd: debug: crm_get_peer: Creating entry for node (null)/2499884042
  1391. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node <null> now has id: 2499884042
  1392. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_update_peer_proc: init_cpg_connection: Node (null)[-1795083254] - corosync-cpg is now online
  1393. Nov 01 05:53:07 [32082] storage1 crmd: info: init_cs_connection_once: Connection to 'corosync': established
  1394. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 2499884042 is now known as storage1
  1395. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storage1 is now (null)
  1396. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 2499884042 has uuid 2499884042
  1397. Nov 01 05:53:07 [32082] storage1 crmd: debug: init_quorum_connection: Configuring Pacemaker to obtain quorum from Corosync
  1398. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-32)
  1399. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1400. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1401. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1402. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1403. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1404. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1405. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1406. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1407. Nov 01 05:53:07 [32038] storage1 corosync debug [CPG ] got procjoin message from cluster node -1795083254 (r(0) ip(10.52.1.149) r(1) ip(192.168.7.149) ) for pid 32082
  1408. Nov 01 05:53:07 [32082] storage1 crmd: notice: init_quorum_connection: Quorum acquired
  1409. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-33)
  1410. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1411. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1412. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1413. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1414. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1415. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1416. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1417. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1418. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1419. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  1420. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1421. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1422. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1423. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] HUP conn (32039-32082-33)
  1424. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32082-33) state:2
  1425. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1426. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1427. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1428. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1429. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1430. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1431. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1432. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-33)
  1433. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1434. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1435. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1436. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1437. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1438. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1439. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1440. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1441. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1442. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  1443. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1444. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1445. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1446. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] HUP conn (32039-32082-33)
  1447. Nov 01 05:53:07 [32082] storage1 crmd: info: do_ha_control: Connected to the cluster
  1448. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32082-33) state:2
  1449. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1450. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1451. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1452. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1453. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1454. Nov 01 05:53:07 [32082] storage1 crmd: debug: do_lrm_control: Connecting to the LRM
  1455. Nov 01 05:53:07 [32082] storage1 crmd: info: lrmd_api_connect: Connecting to lrmd
  1456. Nov 01 05:53:07 [32079] storage1 lrmd: info: lrmd_ipc_accept: Accepting client connection: 0xec1c00 pid=32082 for uid=107 gid=0
  1457. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1458. Nov 01 05:53:07 [32079] storage1 lrmd: debug: handle_new_connection: IPC credentials authenticated (32079-32082-7)
  1459. Nov 01 05:53:07 [32079] storage1 lrmd: debug: qb_ipcs_shm_connect: connecting to client [32082]
  1460. Nov 01 05:53:07 [32079] storage1 lrmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1461. Nov 01 05:53:07 [32079] storage1 lrmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1462. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1463. Nov 01 05:53:07 [32079] storage1 lrmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1464. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1465. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1466. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:20480; real_size:20480; rb->word_size:5120
  1467. Nov 01 05:53:07 [32079] storage1 lrmd: debug: process_lrmd_message: Processed register operation from f0b42b02-ba29-4145-8bf0-993927ad38ff: rc=0, reply=0, notify=0, exit=0
  1468. Nov 01 05:53:07 [32082] storage1 crmd: debug: do_lrm_control: LRM connection established
  1469. Nov 01 05:53:07 [32082] storage1 crmd: info: do_started: Delaying start, no membership data (0000000000100000)
  1470. Nov 01 05:53:07 [32082] storage1 crmd: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
  1471. Nov 01 05:53:07 [32082] storage1 crmd: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
  1472. Nov 01 05:53:07 [32076] storage1 cib: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/3, version=0.144.1): OK (rc=0)
  1473. Nov 01 05:53:07 [32082] storage1 crmd: info: pcmk_quorum_notification: Membership 1841668: quorum retained (3)
  1474. Nov 01 05:53:07 [32082] storage1 crmd: debug: pcmk_quorum_notification: Member[0] 402732042
  1475. Nov 01 05:53:07 [32082] storage1 crmd: debug: crm_get_peer: Creating entry for node (null)/402732042
  1476. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node <null> now has id: 402732042
  1477. Nov 01 05:53:07 [32082] storage1 crmd: info: pcmk_quorum_notification: Obtaining name for new node 402732042
  1478. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-33)
  1479. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1480. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1481. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1482. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1483. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1484. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1485. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1486. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1487. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1488. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-34)
  1489. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1490. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1491. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1492. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1493. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1494. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1495. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1496. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1497. Nov 01 05:53:07 [32082] storage1 crmd: notice: corosync_node_name: Inferred node name 'storagequorum' for nodeid 402732042 from DNS
  1498. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  1499. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1500. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1501. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1502. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 402732042 is now known as storagequorum
  1503. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] HUP conn (32039-32082-33)
  1504. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storagequorum is now (null)
  1505. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32082-33) state:2
  1506. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 402732042 has uuid 402732042
  1507. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1508. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1509. Nov 01 05:53:07 [32082] storage1 crmd: notice: crm_update_peer_state: pcmk_quorum_notification: Node storagequorum[402732042] - state is now member
  1510. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1511. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storagequorum is now member (was (null))
  1512. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1513. Nov 01 05:53:07 [32082] storage1 crmd: debug: pcmk_quorum_notification: Member[1] -1811860470
  1514. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1515. Nov 01 05:53:07 [32082] storage1 crmd: debug: crm_get_peer: Creating entry for node (null)/2483106826
  1516. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node <null> now has id: 2483106826
  1517. Nov 01 05:53:07 [32082] storage1 crmd: info: pcmk_quorum_notification: Obtaining name for new node 2483106826
  1518. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1519. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1520. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-33)
  1521. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1522. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1523. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1524. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1525. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1526. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1527. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1528. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1529. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1530. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32082-35)
  1531. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] connecting to client [32082]
  1532. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1533. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1534. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1535. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] connection created
  1536. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1537. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1538. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_open: shm size:1048576; real_size:1048576; rb->word_size:262144
  1539. Nov 01 05:53:07 [32082] storage1 crmd: notice: corosync_node_name: Inferred node name 'storage0' for nodeid 2483106826 from DNS
  1540. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_ipcc_disconnect: qb_ipcc_disconnect()
  1541. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1542. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1543. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] HUP conn (32039-32082-33)
  1544. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32082-33) state:2
  1545. Nov 01 05:53:07 [32082] storage1 crmd: debug: qb_rb_close: Closing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1546. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1547. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1548. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 2483106826 is now known as storage0
  1549. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1550. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storage0 is now (null)
  1551. Nov 01 05:53:07 [32082] storage1 crmd: info: crm_get_peer: Node 2483106826 has uuid 2483106826
  1552. Nov 01 05:53:07 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1553. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32082-33-header
  1554. Nov 01 05:53:07 [32082] storage1 crmd: notice: crm_update_peer_state: pcmk_quorum_notification: Node storage0[2483106826] - state is now member
  1555. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storage0 is now member (was (null))
  1556. Nov 01 05:53:07 [32082] storage1 crmd: debug: pcmk_quorum_notification: Member[2] -1795083254
  1557. Nov 01 05:53:07 [32082] storage1 crmd: notice: crm_update_peer_state: pcmk_quorum_notification: Node storage1[2499884042] - state is now member
  1558. Nov 01 05:53:07 [32082] storage1 crmd: info: peer_update_callback: storage1 is now member (was (null))
  1559. Nov 01 05:53:07 [32082] storage1 crmd: debug: post_cache_update: Updated cache after membership event 1841668.
  1560. Nov 01 05:53:07 [32082] storage1 crmd: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
  1561. Nov 01 05:53:07 [32082] storage1 crmd: info: do_started: Delaying start, Config not read (0000000000000040)
  1562. Nov 01 05:53:07 [32082] storage1 crmd: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
  1563. Nov 01 05:53:07 [32082] storage1 crmd: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x200000002, stalled=true
  1564. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32082-33-header
  1565. Nov 01 05:53:07 [32082] storage1 crmd: debug: config_query_callback: Call 4 : Parsing CIB options
  1566. Nov 01 05:53:07 [32082] storage1 crmd: debug: config_query_callback: Shutdown escalation occurs after: 1200000ms
  1567. Nov 01 05:53:07 [32082] storage1 crmd: debug: config_query_callback: Checking for expired actions every 900000ms
  1568. Nov 01 05:53:07 [32082] storage1 crmd: debug: do_started: Init server comms
  1569. Nov 01 05:53:07 [32082] storage1 crmd: info: qb_ipcs_us_publish: server name: crmd
  1570. Nov 01 05:53:07 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32082-33-header
  1571. Nov 01 05:53:07 [32082] storage1 crmd: notice: do_started: The local CRM is operational
  1572. Nov 01 05:53:07 [32082] storage1 crmd: debug: do_election_check: Ignore election check: we not in an election
  1573. Nov 01 05:53:07 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_PENDING: [ state=S_STARTING cause=C_FSA_INTERNAL origin=do_started ]
  1574. Nov 01 05:53:07 [32082] storage1 crmd: debug: do_log: FSA: Input I_PENDING from do_started() received in state S_STARTING
  1575. Nov 01 05:53:07 [32082] storage1 crmd: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
  1576. Nov 01 05:53:07 [32076] storage1 cib: info: crm_get_peer: Node 402732042 is now known as storagequorum
  1577. Nov 01 05:53:07 [32076] storage1 cib: info: crm_get_peer: Node 402732042 has uuid 402732042
  1578. Nov 01 05:53:07 [32076] storage1 cib: info: cib_process_diff: Diff 0.144.136 -> 0.144.137 from storagequorum not applied to 0.144.1: current "num_updates" is less than required
  1579. Nov 01 05:53:07 [32076] storage1 cib: info: cib_server_process_diff: Requesting re-sync from peer
  1580. Nov 01 05:53:07 [32076] storage1 cib: info: cib_process_replace: Digest matched on replace from storagequorum: 192c557a6e3c64906f4577534aaa8af7
  1581. Nov 01 05:53:07 [32076] storage1 cib: info: cib_process_replace: Replaced 0.144.1 with 0.144.137 from storagequorum
  1582. Nov 01 05:53:07 [32076] storage1 cib: debug: activateCibXml: Triggering CIB write for cib_replace op
  1583. Nov 01 05:53:07 [32076] storage1 cib: info: cib_replace_notify: Replaced: 0.144.1 -> 0.144.137 from storagequorum
  1584. Nov 01 05:53:08 [32055] storage1 attrd_updater: info: attrd_update_delegate: Connecting to cluster... 2 retries remaining
  1585. Nov 01 05:53:08 [32080] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (32080-32055-8)
  1586. Nov 01 05:53:08 [32080] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (32080-32055-8)
  1587. Nov 01 05:53:08 [32055] storage1 attrd_updater: debug: attrd_update_delegate: Sent update: p_ping=5000 for localhost
  1588. Nov 01 05:53:08 [32080] storage1 attrd: debug: attrd_local_callback: update message from attrd_updater: p_ping=5000
  1589. Nov 01 05:53:08 [32080] storage1 attrd: info: find_hash_entry: Creating hash entry for p_ping
  1590. Nov 01 05:53:08 [32080] storage1 attrd: debug: attrd_local_callback: Supplied: 5000, Current: (null), Stored: (null)
  1591. Nov 01 05:53:08 [32080] storage1 attrd: debug: attrd_local_callback: New value of p_ping is 5000
  1592. Nov 01 05:53:08 [32080] storage1 attrd: debug: qb_ipcs_dispatch_connection_request: HUP conn (32080-32055-8)
  1593. Nov 01 05:53:08 [32080] storage1 attrd: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32080-32055-8) state:2
  1594. Nov 01 05:53:08 [32082] storage1 crmd: debug: do_cl_join_query: Querying for a DC
  1595. Nov 01 05:53:08 [32082] storage1 crmd: debug: crm_timer_start: Started Election Trigger (I_DC_TIMEOUT:20000ms), src=14
  1596. Nov 01 05:53:08 [32082] storage1 crmd: debug: do_cib_replaced: Updating the CIB after a replace: DC=false
  1597. Nov 01 05:53:08 [32082] storage1 crmd: info: pcmk_cpg_membership: Joined[0.0] crmd.-1795083254
  1598. Nov 01 05:53:08 [32082] storage1 crmd: info: pcmk_cpg_membership: Member[0.0] crmd.402732042
  1599. Nov 01 05:53:08 [32082] storage1 crmd: info: crm_update_peer_proc: pcmk_cpg_membership: Node storagequorum[402732042] - corosync-cpg is now online
  1600. Nov 01 05:53:08 [32082] storage1 crmd: info: peer_update_callback: Client storagequorum/peer now has status [online] (DC=<null>)
  1601. Nov 01 05:53:08 [32082] storage1 crmd: info: pcmk_cpg_membership: Member[0.1] crmd.-1811860470
  1602. Nov 01 05:53:08 [32082] storage1 crmd: info: crm_update_peer_proc: pcmk_cpg_membership: Node storage0[-1811860470] - corosync-cpg is now online
  1603. Nov 01 05:53:08 [32082] storage1 crmd: info: peer_update_callback: Client storage0/peer now has status [online] (DC=<null>)
  1604. Nov 01 05:53:08 [32082] storage1 crmd: info: pcmk_cpg_membership: Member[0.2] crmd.-1795083254
  1605. Nov 01 05:53:08 [32082] storage1 crmd: debug: handle_request: Raising I_JOIN_OFFER: join-89
  1606. Nov 01 05:53:08 [32082] storage1 crmd: debug: handle_request: Raising I_JOIN_OFFER: join-90
  1607. Nov 01 05:53:08 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
  1608. Nov 01 05:53:08 [32082] storage1 crmd: info: update_dc: Set DC to storagequorum (3.0.6)
  1609. Nov 01 05:53:08 [32082] storage1 crmd: debug: do_cl_join_offer_respond: do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
  1610. Nov 01 05:53:08 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
  1611. Nov 01 05:53:08 [32082] storage1 crmd: debug: do_cl_join_offer_respond: do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
  1612. Nov 01 05:53:08 [32082] storage1 crmd: debug: te_connect_stonith: Attempting connection to fencing daemon...
  1613. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: handle_new_connection: IPC credentials authenticated (32078-32082-10)
  1614. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: qb_ipcs_us_connect: connecting to client (32078-32082-10)
  1615. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: stonith_command: Processing register from crmd.32082 ( 0)
  1616. Nov 01 05:53:09 [32082] storage1 crmd: debug: stonith_api_signon: Connection to STONITH successful
  1617. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: stonith_command: Processing st_notify from crmd.32082 ( 0)
  1618. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: stonith_command: Setting st_notify_disconnect callbacks for crmd.32082 (561a7748-a100-48df-88a4-995128f9418c): ON
  1619. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: stonith_command: Processing st_notify from crmd.32082 ( 0)
  1620. Nov 01 05:53:09 [32078] storage1 stonith-ng: debug: stonith_command: Setting st_notify_fence callbacks for crmd.32082 (561a7748-a100-48df-88a4-995128f9418c): ON
  1621. Nov 01 05:53:09 [32082] storage1 crmd: debug: join_query_callback: Respond to join offer join-90
  1622. Nov 01 05:53:09 [32082] storage1 crmd: debug: join_query_callback: Acknowledging storagequorum as our DC
  1623. Nov 01 05:53:09 [32082] storage1 crmd: debug: handle_request: Raising I_JOIN_RESULT: join-90
  1624. Nov 01 05:53:09 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_JOIN_RESULT: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
  1625. Nov 01 05:53:09 [32082] storage1 crmd: debug: do_cl_join_finalize_respond: Confirming join join-90: join_ack_nack
  1626. Nov 01 05:53:09 [32082] storage1 crmd: debug: do_cl_join_finalize_respond: join-90: Join complete. Sending local LRM status to storagequorum
  1627. Nov 01 05:53:09 [32082] storage1 crmd: info: erase_status_tag: Deleting xpath: //node_state[@uname='storage1']/transient_attributes
  1628. Nov 01 05:53:09 [32082] storage1 crmd: info: update_attrd: Connecting to attrd... 5 retries remaining
  1629. Nov 01 05:53:09 [32080] storage1 attrd: debug: handle_new_connection: IPC credentials authenticated (32080-32082-8)
  1630. Nov 01 05:53:09 [32080] storage1 attrd: debug: qb_ipcs_us_connect: connecting to client (32080-32082-8)
  1631. Nov 01 05:53:09 [32082] storage1 crmd: debug: attrd_update_delegate: Sent update: terminate=(null) for storage1
  1632. Nov 01 05:53:09 [32082] storage1 crmd: debug: attrd_update_delegate: Sent update: shutdown=(null) for storage1
  1633. Nov 01 05:53:09 [32080] storage1 attrd: debug: attrd_local_callback: update message from crmd: terminate=<null>
  1634. Nov 01 05:53:09 [32080] storage1 attrd: info: find_hash_entry: Creating hash entry for terminate
  1635. Nov 01 05:53:09 [32080] storage1 attrd: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
  1636. Nov 01 05:53:09 [32082] storage1 crmd: debug: attrd_update_delegate: Sent update: (null)=(null) for localhost
  1637. Nov 01 05:53:09 [32082] storage1 crmd: debug: s_crmd_fsa: Processing I_NOT_DC: [ state=S_PENDING cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
  1638. Nov 01 05:53:09 [32082] storage1 crmd: debug: do_log: FSA: Input I_NOT_DC from do_cl_join_finalize_respond() received in state S_PENDING
  1639. Nov 01 05:53:09 [32080] storage1 attrd: debug: attrd_local_callback: update message from crmd: shutdown=<null>
  1640. Nov 01 05:53:09 [32080] storage1 attrd: info: find_hash_entry: Creating hash entry for shutdown
  1641. Nov 01 05:53:09 [32080] storage1 attrd: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
  1642. Nov 01 05:53:09 [32082] storage1 crmd: notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
  1643. Nov 01 05:53:09 [32080] storage1 attrd: notice: attrd_local_callback: Sending full refresh (origin=crmd)
  1644. Nov 01 05:53:09 [32080] storage1 attrd: notice: attrd_trigger_update: Sending flush op to all hosts for: p_ping (5000)
  1645. Nov 01 05:53:09 [32076] storage1 cib: info: cib_process_replace: Digest matched on replace from storagequorum: 192c557a6e3c64906f4577534aaa8af7
  1646. Nov 01 05:53:09 [32076] storage1 cib: info: cib_process_replace: Replaced 0.144.137 with 0.144.137 from storagequorum
  1647. Nov 01 05:53:09 [32080] storage1 attrd: info: crm_get_peer: Node 2483106826 is now known as storage0
  1648. Nov 01 05:53:09 [32080] storage1 attrd: info: crm_get_peer: Node 2483106826 has uuid 2483106826
  1649. Nov 01 05:53:09 [32080] storage1 attrd: info: attrd_perform_update: Delaying operation p_ping=5000: cib not connected
  1650. Nov 01 05:53:09 [32080] storage1 attrd: info: attrd_perform_update: Delaying operation p_ping=5000: cib not connected
  1651. Nov 01 05:53:09 [32076] storage1 cib: debug: activateCibXml: Triggering CIB write for cib_replace op
  1652. Nov 01 05:53:09 [32080] storage1 attrd: info: find_hash_entry: Creating hash entry for master-p_drbd_drives
  1653. Nov 01 05:53:09 [32080] storage1 attrd: info: attrd_perform_update: Delaying operation master-p_drbd_drives=<null>: cib not connected
  1654. Nov 01 05:53:09 [32080] storage1 attrd: info: find_hash_entry: Creating hash entry for probe_complete
  1655. Nov 01 05:53:09 [32076] storage1 cib: info: crm_get_peer: Node 2483106826 is now known as storage0
  1656. Nov 01 05:53:09 [32080] storage1 attrd: info: attrd_perform_update: Delaying operation probe_complete=<null>: cib not connected
  1657. Nov 01 05:53:09 [32076] storage1 cib: info: crm_get_peer: Node 2483106826 has uuid 2483106826
  1658. Nov 01 05:53:10 [32082] storage1 crmd: debug: erase_xpath_callback: Deletion of "//node_state[@uname='storage1']/transient_attributes": OK (rc=0)
  1659. Nov 01 05:53:10 [32080] storage1 attrd: info: crm_get_peer: Node 402732042 is now known as storagequorum
  1660. Nov 01 05:53:10 [32080] storage1 attrd: info: crm_get_peer: Node 402732042 has uuid 402732042
  1661. Nov 01 05:53:10 [32080] storage1 attrd: info: attrd_perform_update: Delaying operation probe_complete=<null>: cib not connected
  1662. Nov 01 05:53:11 [32080] storage1 attrd: debug: cib_connect: CIB signon attempt 1
  1663. Nov 01 05:53:11 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32080-15)
  1664. Nov 01 05:53:11 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-32080-15)
  1665. Nov 01 05:53:11 [32080] storage1 attrd: debug: cib_native_signon_raw: Connection to CIB successful
  1666. Nov 01 05:53:11 [32080] storage1 attrd: info: cib_connect: Connected to the CIB after 1 signon attempts
  1667. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for attrd (0189c569-a167-4cf0-80bd-f1d3f0d34c37): on
  1668. Nov 01 05:53:11 [32080] storage1 attrd: info: cib_connect: Sending full refresh now that we're connected to the cib
  1669. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='2499884042']//transient_attributes//nvpair[@name='shutdown'] does not exist
  1670. Nov 01 05:53:11 [32080] storage1 attrd: warning: attrd_cib_callback: Update shutdown=(null) failed: No such device or address
  1671. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='2499884042']//transient_attributes//nvpair[@name='p_ping'] does not exist
  1672. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
  1673. Nov 01 05:53:11 [32080] storage1 attrd: notice: attrd_perform_update: Sent update 5: p_ping=5000
  1674. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='2499884042']//transient_attributes//nvpair[@name='master-p_drbd_drives'] does not exist
  1675. Nov 01 05:53:11 [32080] storage1 attrd: warning: attrd_cib_callback: Update master-p_drbd_drives=(null) failed: No such device or address
  1676. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='2499884042']//transient_attributes//nvpair[@name='terminate'] does not exist
  1677. Nov 01 05:53:11 [32080] storage1 attrd: warning: attrd_cib_callback: Update terminate=(null) failed: No such device or address
  1678. Nov 01 05:53:11 [32076] storage1 cib: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='2499884042']//transient_attributes//nvpair[@name='probe_complete'] does not exist
  1679. Nov 01 05:53:11 [32080] storage1 attrd: warning: attrd_cib_callback: Update probe_complete=(null) failed: No such device or address
  1680. Nov 01 05:53:11 [32080] storage1 attrd: debug: attrd_cib_callback: Update 5 for p_ping=5000 passed
  1681. Nov 01 05:54:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32225-17)
  1682. Nov 01 05:54:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-32225-17)
  1683. Nov 01 05:54:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-32225-17)
  1684. Nov 01 05:54:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-32225-17) state:2
  1685. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32242-33)
  1686. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] connecting to client [32242]
  1687. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1688. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1689. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1690. Nov 01 05:54:01 [32038] storage1 corosync debug [MAIN ] connection created
  1691. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1692. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-32242-33)
  1693. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32242-33) state:2
  1694. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1695. Nov 01 05:54:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1696. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1697. Nov 01 05:54:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1698. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32242-33-header
  1699. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32242-33-header
  1700. Nov 01 05:54:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32242-33-header
  1701. Nov 01 05:55:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32442-17)
  1702. Nov 01 05:55:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-32442-17)
  1703. Nov 01 05:55:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-32442-17)
  1704. Nov 01 05:55:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-32442-17) state:2
  1705. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32459-33)
  1706. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] connecting to client [32459]
  1707. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1708. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1709. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1710. Nov 01 05:55:01 [32038] storage1 corosync debug [MAIN ] connection created
  1711. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1712. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-32459-33)
  1713. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32459-33) state:2
  1714. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1715. Nov 01 05:55:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1716. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1717. Nov 01 05:55:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1718. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32459-33-header
  1719. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32459-33-header
  1720. Nov 01 05:55:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32459-33-header
  1721. Nov 01 05:56:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-32654-17)
  1722. Nov 01 05:56:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-32654-17)
  1723. Nov 01 05:56:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-32654-17)
  1724. Nov 01 05:56:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-32654-17) state:2
  1725. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-32671-33)
  1726. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] connecting to client [32671]
  1727. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1728. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1729. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1730. Nov 01 05:56:01 [32038] storage1 corosync debug [MAIN ] connection created
  1731. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1732. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-32671-33)
  1733. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-32671-33) state:2
  1734. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1735. Nov 01 05:56:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1736. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1737. Nov 01 05:56:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1738. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-32671-33-header
  1739. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-32671-33-header
  1740. Nov 01 05:56:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-32671-33-header
  1741. Nov 01 05:57:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-402-17)
  1742. Nov 01 05:57:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-402-17)
  1743. Nov 01 05:57:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-402-17)
  1744. Nov 01 05:57:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-402-17) state:2
  1745. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-419-33)
  1746. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] connecting to client [419]
  1747. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1748. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1749. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1750. Nov 01 05:57:01 [32038] storage1 corosync debug [MAIN ] connection created
  1751. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1752. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-419-33)
  1753. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-419-33) state:2
  1754. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1755. Nov 01 05:57:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1756. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1757. Nov 01 05:57:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1758. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-419-33-header
  1759. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-419-33-header
  1760. Nov 01 05:57:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-419-33-header
  1761. Nov 01 05:58:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-619-17)
  1762. Nov 01 05:58:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-619-17)
  1763. Nov 01 05:58:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-619-17)
  1764. Nov 01 05:58:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-619-17) state:2
  1765. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-637-33)
  1766. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] connecting to client [637]
  1767. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1768. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1769. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1770. Nov 01 05:58:01 [32038] storage1 corosync debug [MAIN ] connection created
  1771. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1772. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-637-33)
  1773. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-637-33) state:2
  1774. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1775. Nov 01 05:58:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1776. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1777. Nov 01 05:58:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1778. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-637-33-header
  1779. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-637-33-header
  1780. Nov 01 05:58:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-637-33-header
  1781. Nov 01 05:59:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-836-17)
  1782. Nov 01 05:59:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-836-17)
  1783. Nov 01 05:59:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-836-17)
  1784. Nov 01 05:59:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-836-17) state:2
  1785. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-856-33)
  1786. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] connecting to client [856]
  1787. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1788. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1789. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1790. Nov 01 05:59:01 [32038] storage1 corosync debug [MAIN ] connection created
  1791. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1792. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-856-33)
  1793. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-856-33) state:2
  1794. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1795. Nov 01 05:59:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1796. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1797. Nov 01 05:59:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1798. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-856-33-header
  1799. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-856-33-header
  1800. Nov 01 05:59:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-856-33-header
  1801. Nov 01 06:00:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-1053-17)
  1802. Nov 01 06:00:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-1053-17)
  1803. Nov 01 06:00:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-1053-17)
  1804. Nov 01 06:00:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-1053-17) state:2
  1805. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-1070-33)
  1806. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] connecting to client [1070]
  1807. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1808. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1809. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1810. Nov 01 06:00:01 [32038] storage1 corosync debug [MAIN ] connection created
  1811. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1812. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-1070-33)
  1813. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-1070-33) state:2
  1814. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1815. Nov 01 06:00:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1816. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1817. Nov 01 06:00:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1818. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-1070-33-header
  1819. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-1070-33-header
  1820. Nov 01 06:00:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-1070-33-header
  1821. Nov 01 06:01:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-1277-17)
  1822. Nov 01 06:01:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-1277-17)
  1823. Nov 01 06:01:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-1277-17)
  1824. Nov 01 06:01:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-1277-17) state:2
  1825. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-1294-33)
  1826. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] connecting to client [1294]
  1827. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1828. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1829. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1830. Nov 01 06:01:01 [32038] storage1 corosync debug [MAIN ] connection created
  1831. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1832. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] HUP conn (32039-1294-33)
  1833. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-1294-33) state:2
  1834. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1835. Nov 01 06:01:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1836. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1837. Nov 01 06:01:01 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1838. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-1294-33-header
  1839. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-1294-33-header
  1840. Nov 01 06:01:01 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-1294-33-header
  1841. Nov 01 06:02:01 [32076] storage1 cib: debug: handle_new_connection: IPC credentials authenticated (32076-1489-17)
  1842. Nov 01 06:02:01 [32076] storage1 cib: debug: qb_ipcs_us_connect: connecting to client (32076-1489-17)
  1843. Nov 01 06:02:01 [32076] storage1 cib: debug: qb_ipcs_dispatch_connection_request: HUP conn (32076-1489-17)
  1844. Nov 01 06:02:01 [32076] storage1 cib: debug: qb_ipcs_disconnect: qb_ipcs_disconnect(32076-1489-17) state:2
  1845. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] IPC credentials authenticated (32039-1506-33)
  1846. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] connecting to client [1506]
  1847. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1848. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1849. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] shm size:1048576; real_size:1048576; rb->word_size:262144
  1850. Nov 01 06:02:02 [32038] storage1 corosync debug [MAIN ] connection created
  1851. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] lib_init_fn: conn=0x7fb8bc8dbc80
  1852. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] HUP conn (32039-1506-33)
  1853. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] qb_ipcs_disconnect(32039-1506-33) state:2
  1854. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] epoll_ctl(del): Bad file descriptor (9)
  1855. Nov 01 06:02:02 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_closed()
  1856. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] exit_fn for conn=0x7fb8bc8dbc80
  1857. Nov 01 06:02:02 [32038] storage1 corosync debug [MAIN ] cs_ipcs_connection_destroyed()
  1858. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-32039-1506-33-header
  1859. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-32039-1506-33-header
  1860. Nov 01 06:02:02 [32038] storage1 corosync debug [QB ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-32039-1506-33-header
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement