storage1 corosync log (11/2/12)

Nov 02 12:52:01 [28099] storage1        cib:    debug: handle_new_connection: 	IPC credentials authenticated (28099-28537-19)
Nov 02 12:52:01 [28099] storage1        cib:    debug: qb_ipcs_us_connect: 	connecting to client (28099-28537-19)
Nov 02 12:52:01 [28099] storage1        cib:    debug: qb_ipcs_dispatch_connection_request: 	HUP conn (28099-28537-19)
Nov 02 12:52:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-28537-19) state:2
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] IPC credentials authenticated (28065-28554-30)
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] connecting to client [28554]
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] shm size:1048576; real_size:1048576; rb->word_size:262144
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] shm size:1048576; real_size:1048576; rb->word_size:262144
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] shm size:1048576; real_size:1048576; rb->word_size:262144
Nov 02 12:52:01 [28065] storage1 corosync debug   [MAIN  ] connection created
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] lib_init_fn: conn=0x7f5176188410
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] HUP conn (28065-28554-30)
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] qb_ipcs_disconnect(28065-28554-30) state:2
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] epoll_ctl(del): Bad file descriptor (9)
Nov 02 12:52:01 [28065] storage1 corosync debug   [MAIN  ] cs_ipcs_connection_closed()
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] exit_fn for conn=0x7f5176188410
Nov 02 12:52:01 [28065] storage1 corosync debug   [MAIN  ] cs_ipcs_connection_destroyed()
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-response-28065-28554-30-header
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-event-28065-28554-30-header
Nov 02 12:52:01 [28065] storage1 corosync debug   [QB    ] Free'ing ringbuffer: /dev/shm/qb-cmap-request-28065-28554-30-header
Nov 02 12:53:01 [28099] storage1        cib:    debug: handle_new_connection: 	IPC credentials authenticated (28099-28679-19)
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_us_connect: 	connecting to client (28099-28679-19)
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_dispatch_connection_request: 	HUP conn (28099-28679-19)
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-28679-19) state:2
Nov 02 12:53:01 [28103] storage1      attrd:    debug: qb_ipc_us_ready: 	poll(fd 6) got POLLHUP
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: qb_ipc_us_ready: 	poll(fd 6) got POLLHUP
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipc_us_ready: 	poll(fd 6) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 8) got POLLHUP
Nov 02 12:53:01 [28103] storage1      attrd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: qb_ipc_us_ready: 	poll(fd 7) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28099] storage1        cib:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:     info: crmd_quorum_destroy: 	connection closed
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28103] storage1      attrd:    error: pcmk_cpg_dispatch: 	Connection to the CPG API failed: 2
Nov 02 12:53:01 [28099] storage1        cib:    error: pcmk_cpg_dispatch: 	Connection to the CPG API failed: 2
Nov 02 12:53:01 [28101] storage1 stonith-ng:    error: pcmk_cpg_dispatch: 	Connection to the CPG API failed: 2
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 7) got POLLHUP
Nov 02 12:53:01 [28103] storage1      attrd:     crit: attrd_ais_destroy: 	Lost connection to Corosync service!
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: cfg_connection_destroy: 	Connection destroyed
Nov 02 12:53:01 [28101] storage1 stonith-ng:    error: stonith_peer_ais_destroy: 	AIS connection terminated
Nov 02 12:53:01 [28099] storage1        cib:    error: cib_ais_destroy: 	Corosync connection lost!  Exiting.
Nov 02 12:53:01 [28101] storage1 stonith-ng:     info: stonith_shutdown: 	Terminating with  1 clients
Nov 02 12:53:01 [28099] storage1        cib:    debug: uninitializeCib: 	Deallocating the CIB.
Nov 02 12:53:01 [28103] storage1      attrd:   notice: main: 	Exiting...
Nov 02 12:53:01 [28105] storage1       crmd:    error: pcmk_cpg_dispatch: 	Connection to the CPG API failed: 2
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: qb_ipc_us_ready: 	poll(fd 8) got POLLHUP
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: cib_native_signoff: 	Signing out of the CIB Service
Nov 02 12:53:01 [28105] storage1       crmd:     info: crmd_ais_destroy: 	connection closed
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28103] storage1      attrd:   notice: main: 	Disconnecting client 0x1ebee80, pid=28105...
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28103] storage1      attrd:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28103-28105-8) state:2
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: cpg_connection_destroy: 	Connection destroyed
Nov 02 12:53:01 [28097] storage1 pacemakerd:   notice: pcmk_shutdown_worker: 	Shuting down Pacemaker
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28103] storage1      attrd:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28101] storage1 stonith-ng:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28101-28105-10) state:2
Nov 02 12:53:01 [28103] storage1      attrd:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28097] storage1 pacemakerd:   notice: stop_child: 	Stopping crmd: Sent -15 to process 28105
Nov 02 12:53:01 [28103] storage1      attrd:    debug: cib_native_signoff: 	Signing out of the CIB Service
Nov 02 12:53:01 [28103] storage1      attrd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28101] storage1 stonith-ng:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28101] storage1 stonith-ng:     info: crm_xml_cleanup: 	Cleaning up memory from libxml2
Nov 02 12:53:01 [28103] storage1      attrd:    debug: cib_native_signoff: 	Signing out of the CIB Service
Nov 02 12:53:01 [28103] storage1      attrd:    error: attrd_cib_connection_destroy: 	Connection to the CIB terminated...
Nov 02 12:53:01 [28101] storage1 stonith-ng:     info: main: 	Done
Nov 02 12:53:01 [28105] storage1       crmd:     info: crm_signal_dispatch: 	Invoking handler for signal 15: Terminated
Nov 02 12:53:01 [28105] storage1       crmd:   notice: crm_shutdown: 	Requesting shutdown, upper limit is 1200000ms
Nov 02 12:53:01 [28105] storage1       crmd:    debug: crm_timer_start: 	Started Shutdown Escalation (I_STOP:1200000ms), src=19
Nov 02 12:53:01 [28105] storage1       crmd:    debug: s_crmd_fsa: 	Processing I_SHUTDOWN: [ state=S_NOT_DC cause=C_SHUTDOWN origin=crm_shutdown ]
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_shutdown_req: 	Sending shutdown request to storagequorum
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:    error: send_ais_text: 	Sending message 4 via cpg: FAILED (rc=2): Library error: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: s_crmd_fsa: 	Processing I_ERROR: [ state=S_NOT_DC cause=C_FSA_INTERNAL origin=do_shutdown_req ]
Nov 02 12:53:01 [28105] storage1       crmd:    error: do_log: 	FSA: Input I_ERROR from do_shutdown_req() received in state S_NOT_DC
Nov 02 12:53:01 [28105] storage1       crmd:   notice: do_state_transition: 	State transition S_NOT_DC -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_shutdown_req ]
Nov 02 12:53:01 [28105] storage1       crmd:    error: do_recover: 	Action A_RECOVER (0000000001000000) not supported
Nov 02 12:53:01 [28105] storage1       crmd:    debug: s_crmd_fsa: 	Processing I_TERMINATE: [ state=S_RECOVERY cause=C_FSA_INTERNAL origin=do_recover ]
Nov 02 12:53:01 [28099] storage1        cib:    debug: uninitializeCib: 	The CIB has been deallocated.
Nov 02 12:53:01 [28105] storage1       crmd:    error: do_log: 	FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY
Nov 02 12:53:01 [28099] storage1        cib:     info: terminate_cib: 	cib_ais_destroy: Exiting fast...
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_state_transition: 	State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ]
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_shutdown: 	Disconnecting STONITH...
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-2700-15) state:2
Nov 02 12:53:01 [28105] storage1       crmd:    debug: stonith_api_signoff: 	Signing out of the STONITH Service
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 14) got POLLHUP
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: pcmk_child_exit: 	Child process attrd exited (pid=28103, rc=1)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000110312 (was 00000000000000000000000000111312)
Nov 02 12:53:01 [28099] storage1        cib:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-28103-17) state:2
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-28101-13) state:2
Nov 02 12:53:01 [28105] storage1       crmd:    debug: get_xpath_object: 	No match for //st_notify_disconnect in /notify
Nov 02 12:53:01 [28099] storage1        cib:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28105] storage1       crmd:     info: tengine_stonith_connection_destroy: 	Fencing daemon disconnected
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28099-28105-11) state:2
Nov 02 12:53:01 [28105] storage1       crmd:    debug: verify_stopped: 	Checking for active resources before exit
Nov 02 12:53:01 [28105] storage1       crmd:     info: lrmd_api_disconnect: 	Disconnecting from lrmd service
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-cib_shm-response-28099-28105-11-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28097] storage1 pacemakerd:     info: pcmk_child_exit: 	Child process stonith-ng exited (pid=28101, rc=0)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_close: 	Closing ringbuffer: /dev/shm/qb-lrmd-request-28102-28105-7-header
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000010312 (was 00000000000000000000000000110312)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_close: 	Closing ringbuffer: /dev/shm/qb-lrmd-response-28102-28105-7-header
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_ipcs_dispatch_connection_request: 	HUP conn (28102-28105-7)
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-cib_shm-event-28099-28105-11-header
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_ipcs_disconnect: 	qb_ipcs_disconnect(28102-28105-7) state:2
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_close: 	Closing ringbuffer: /dev/shm/qb-lrmd-event-28102-28105-7-header
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28102] storage1       lrmd:     info: lrmd_ipc_destroy: 	LRMD client disconnecting 0x22cac00 - name: crmd id: 6572cfc6-b940-4d86-9101-e2d738cd99c6
Nov 02 12:53:01 [28105] storage1       crmd:     info: lrmd_connection_destroy: 	connection destroyed
Nov 02 12:53:01 [28105] storage1       crmd:     info: lrm_connection_destroy: 	LRM Connection disconnected
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-lrmd-response-28102-28105-7-header
Nov 02 12:53:01 [28099] storage1        cib:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-cib_shm-request-28099-28105-11-header
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_lrm_control: 	Disconnected from the LRM
Nov 02 12:53:01 [28105] storage1       crmd:     info: crm_cluster_disconnect: 	Disconnecting from cluster infrastructure: corosync
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-lrmd-event-28102-28105-7-header
Nov 02 12:53:01 [28105] storage1       crmd:   notice: terminate_cs_connection: 	Disconnecting from Corosync
Nov 02 12:53:01 [28099] storage1        cib:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_rb_close: 	Free'ing ringbuffer: /dev/shm/qb-lrmd-request-28102-28105-7-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 7) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cpg-request-28065-28105-28-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cpg-response-28065-28105-28-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cpg-event-28065-28105-28-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 8) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-quorum-request-28065-28105-29-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-quorum-response-28065-28105-29-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-quorum-event-28065-28105-29-header
Nov 02 12:53:01 [28105] storage1       crmd:     info: crm_cluster_disconnect: 	Disconnected from corosync
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_ha_control: 	Disconnected from the cluster
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_cib_control: 	Disconnecting CIB
Nov 02 12:53:01 [28105] storage1       crmd:    debug: cib_client_del_notify_callback: 	Removing callback for cib_diff_notify events
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 6) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:   notice: crm_ipc_send: 	Connection to cib_shm closed
Nov 02 12:53:01 [28105] storage1       crmd:   notice: crm_ipc_send: 	Connection to cib_shm closed
Nov 02 12:53:01 [28105] storage1       crmd:    error: cib_native_perform_op_delegate: 	Couldn't perform cib_slave operation (timeout=120s): -107: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: pcmk_child_exit: 	Child process cib exited (pid=28099, rc=64)
Nov 02 12:53:01 [28105] storage1       crmd:    error: cib_native_perform_op_delegate: 	CIB disconnected
Nov 02 12:53:01 [28105] storage1       crmd:    debug: cib_native_signoff: 	Signing out of the CIB Service
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000010212 (was 00000000000000000000000000010312)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 6) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cib_shm-request-28099-28105-11-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cib_shm-response-28099-28105-11-header
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_rb_force_close: 	Force free'ing ringbuffer: /dev/shm/qb-cib_shm-event-28099-28105-11-header
Nov 02 12:53:01 [28105] storage1       crmd:     info: crmd_cib_connection_destroy: 	Connection to the CIB terminated...
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28105] storage1       crmd:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28105] storage1       crmd:    debug: verify_stopped: 	Checking for active resources before exit
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_exit: 	Performing A_EXIT_0 - gracefully exiting the CRMd
Nov 02 12:53:01 [28105] storage1       crmd:    error: do_exit: 	Could not recover from internal error
Nov 02 12:53:01 [28105] storage1       crmd:     info: do_exit: 	[crmd] stopped (2)
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipcc_disconnect: 	qb_ipcc_disconnect()
Nov 02 12:53:01 [28105] storage1       crmd:    debug: qb_ipc_us_ready: 	poll(fd 16) got POLLHUP
Nov 02 12:53:01 [28105] storage1       crmd:    debug: _check_connection_state: 	interpreting result -107 as a disconnect: Transport endpoint is not connected (107)
Nov 02 12:53:01 [28105] storage1       crmd:     info: free_mem: 	Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ]
Nov 02 12:53:01 [28105] storage1       crmd:    debug: free_mem: 	Number of connected clients: 0
Nov 02 12:53:01 [28105] storage1       crmd:     info: lrmd_api_disconnect: 	Disconnecting from lrmd service
Nov 02 12:53:01 [28105] storage1       crmd:     info: crm_xml_cleanup: 	Cleaning up memory from libxml2
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: pcmk_child_exit: 	Child process crmd exited (pid=28105, rc=2)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000010012 (was 00000000000000000000000000010212)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	crmd confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:   notice: stop_child: 	Stopping pengine: Sent -15 to process 28104
Nov 02 12:53:01 [28104] storage1    pengine:     info: crm_signal_dispatch: 	Invoking handler for signal 15: Terminated
Nov 02 12:53:01 [28104] storage1    pengine:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28104] storage1    pengine:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28097] storage1 pacemakerd:     info: pcmk_child_exit: 	Child process pengine exited (pid=28104, rc=0)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000000012 (was 00000000000000000000000000010012)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	pengine confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	attrd confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:   notice: stop_child: 	Stopping lrmd: Sent -15 to process 28102
Nov 02 12:53:01 [28102] storage1       lrmd:     info: crm_signal_dispatch: 	Invoking handler for signal 15: Terminated
Nov 02 12:53:01 [28102] storage1       lrmd:     info: lrmd_shutdown: 	Terminating with  0 clients
Nov 02 12:53:01 [28102] storage1       lrmd:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28102] storage1       lrmd:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28097] storage1 pacemakerd:     info: pcmk_child_exit: 	Child process lrmd exited (pid=28102, rc=0)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: update_node_processes: 	Node storage1 now has process list: 00000000000000000000000000000002 (was 00000000000000000000000000000012)
Nov 02 12:53:01 [28097] storage1 pacemakerd:    error: send_cpg_message: 	Sending message via cpg FAILED: (rc=9) Bad handle
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	lrmd confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	stonith-ng confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: pcmk_shutdown_worker: 	cib confirmed stopped
Nov 02 12:53:01 [28097] storage1 pacemakerd:   notice: pcmk_shutdown_worker: 	Shutdown complete
Nov 02 12:53:01 [28097] storage1 pacemakerd:    debug: qb_ipcs_unref: 	qb_ipcs_unref() - destroying
Nov 02 12:53:01 [28097] storage1 pacemakerd:     info: qb_ipcs_us_withdraw: 	withdrawing server sockets
Nov 02 12:53:01 [28097] storage1 pacemakerd:     info: main: 	Exiting pacemakerd