Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 171 173
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 173
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 173
Sep 25 17:03:10 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 177
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 177
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Result of notify operation for vms04-storage on vms04: 0 (ok)
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 178
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 178
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Result of notify operation for vms03-storage on vms04: 0 (ok)
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 17b
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Transition aborted by status-1-master-vms04-storage doing create master-vms04-storage=10000: Transient attribute change
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Transition 4 (Complete=23, Pending=0, Fired=0, Skipped=2, Incomplete=9, Source=/var/lib/pacemaker/pengine/pe-input-1263.bz2): Stopped
Sep 25 17:03:10 vms04 pengine[14039]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 pengine[14039]:  notice:  * Promote    vms04-storage:1     ( Slave -> Master vms03 )
Sep 25 17:03:10 vms04 pengine[14039]:  notice:  * Start      dlm:0               (                 vms03 )
Sep 25 17:03:10 vms04 pengine[14039]:  notice:  * Start      dlm:1               (                 vms04 )
Sep 25 17:03:10 vms04 pengine[14039]:  notice:  * Start      clvmd:0             (                 vms03 )
Sep 25 17:03:10 vms04 pengine[14039]:  notice:  * Start      clvmd:1             (                 vms04 )
Sep 25 17:03:10 vms04 pengine[14039]:  notice: Calculated transition 5, saving inputs in /var/lib/pacemaker/pengine/pe-input-1264.bz2
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Initiating notify operation vms04-storage_pre_notify_promote_0 locally on vms04
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Initiating notify operation vms04-storage_pre_notify_promote_0 on vms03
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Result of notify operation for vms04-storage on vms04: 0 (ok)
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 182 184
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 184
Sep 25 17:03:10 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 crmd[14040]:  notice: Initiating promote operation vms04-storage_promote_0 on vms03
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 189
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 189
Sep 25 17:03:10 vms04 corosync[2736]: [TOTEM ] Retransmit List: 189
Sep 25 17:03:10 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:10 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:10 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:10 vms04 kernel: block drbd1: peer( Secondary -> Primary )
Sep 25 17:03:11 vms04 crmd[14040]:  notice: Initiating notify operation vms04-storage_post_notify_promote_0 locally on vms04
Sep 25 17:03:11 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:11 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:11 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:11 vms04 crmd[14040]:  notice: Initiating notify operation vms04-storage_post_notify_promote_0 on vms03
Sep 25 17:03:11 vms04 corosync[2736]: [TOTEM ] Marking ringid 1 interface 192.168.1.24 FAULTY
Sep 25 17:03:11 vms04 corosync[2736]: [TOTEM ] Retransmit List: 190
Sep 25 17:03:11 vms04 corosync[2736]: [TOTEM ] Retransmit List: 192
Sep 25 17:03:11 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:11 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:11 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:11 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:11 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:11 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:11 vms04 crmd[14040]:  notice: Result of notify operation for vms04-storage on vms04: 0 (ok)
Sep 25 17:03:11 vms04 crmd[14040]:  notice: Initiating start operation dlm_start_0 on vms03
Sep 25 17:03:11 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:11 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:11 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Automatically recovered ring 1
Sep 25 17:03:12 vms04 crmd[14040]:  notice: Initiating monitor operation dlm_monitor_30000 on vms03
Sep 25 17:03:12 vms04 crmd[14040]:  notice: Initiating start operation dlm:1_start_0 locally on vms04
Sep 25 17:03:12 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1a4
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1a4
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1a4
Sep 25 17:03:12 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1a7
Sep 25 17:03:12 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:12 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:12 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:12 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:12 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:12 vms04 kernel: DLM installed
Sep 25 17:03:12 vms04 dlm_controld[19196]: 320 dlm_controld 4.0.7 started
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b0
Sep 25 17:03:12 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b0
Sep 25 17:03:13 vms04 crmd[14040]:  notice: Result of start operation for dlm on vms04: 0 (ok)
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b1
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b1
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b1
Sep 25 17:03:13 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:13 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:13 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:13 vms04 crmd[14040]:  notice: Initiating monitor operation dlm:1_monitor_30000 locally on vms04
Sep 25 17:03:13 vms04 crmd[14040]:  notice: Initiating start operation clvmd_start_0 on vms03
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b4
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1b4 1b6
Sep 25 17:03:13 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:13 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:13 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:13 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:13 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:13 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:13 vms04 corosync[2736]: [TOTEM ] Retransmit List: 1ba
Sep 25 17:03:13 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:03:13 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:03:13 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:03:19 vms04 corosync[2736]: [TOTEM ] Marking ringid 1 interface 192.168.1.24 FAULTY
Sep 25 17:03:45 vms04 instsvcdrv: Failed to unload module ipmi_si (while preparing to disable kipmi0 thread) : ipmi driver may be in use
Sep 25 17:04:43 vms04 crmd[14040]: warning: Action 73 (clvmd_start_0) on vms03 failed (target: 0 vs. rc: 1): Error
Sep 25 17:04:43 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:04:43 vms04 crmd[14040]:  notice: Transition aborted by operation clvmd_start_0 'modify' on vms03: Event failed
Sep 25 17:04:43 vms04 crmd[14040]: warning: Action 73 (clvmd_start_0) on vms03 failed (target: 0 vs. rc: 1): Error
Sep 25 17:04:43 vms04 crmd[14040]:  notice: Transition 5 (Complete=19, Pending=0, Fired=0, Skipped=0, Incomplete=4, Source=/var/lib/pacemaker/pengine/pe-input-1264.bz2): Complete
Sep 25 17:04:43 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:04:43 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:04:43 vms04 pengine[14039]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:04:43 vms04 pengine[14039]: warning: Processing failed op start for clvmd:0 on vms03: unknown error (1)
Sep 25 17:04:43 vms04 pengine[14039]: warning: Processing failed op start for clvmd:0 on vms03: unknown error (1)
Sep 25 17:04:43 vms04 pengine[14039]:  notice:  * Recover    clvmd:0             (                 vms03 )
Sep 25 17:04:43 vms04 pengine[14039]:  notice:  * Start      clvmd:1             (                 vms04 )
Sep 25 17:04:43 vms04 pengine[14039]:  notice: Calculated transition 6, saving inputs in /var/lib/pacemaker/pengine/pe-input-1265.bz2
Sep 25 17:04:43 vms04 pengine[14039]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:04:43 vms04 pengine[14039]: warning: Processing failed op start for clvmd:0 on vms03: unknown error (1)
Sep 25 17:04:43 vms04 pengine[14039]: warning: Processing failed op start for clvmd:0 on vms03: unknown error (1)
Sep 25 17:04:43 vms04 pengine[14039]: warning: Forcing clvmd-clone away from vms03 after 1000000 failures (max=1000000)
Sep 25 17:04:43 vms04 pengine[14039]: warning: Forcing clvmd-clone away from vms03 after 1000000 failures (max=1000000)
Sep 25 17:04:43 vms04 pengine[14039]:  notice:  * Stop       clvmd:0             (                 vms03 )   due to node availability
Sep 25 17:04:43 vms04 pengine[14039]:  notice:  * Start      clvmd:1             (                 vms04 )
Sep 25 17:04:43 vms04 pengine[14039]:  notice: Calculated transition 7, saving inputs in /var/lib/pacemaker/pengine/pe-input-1266.bz2
Sep 25 17:04:43 vms04 crmd[14040]:  notice: Initiating stop operation clvmd_stop_0 on vms03
Sep 25 17:04:43 vms04 stonith-ng[14036]:  notice: On loss of CCM Quorum: Ignore
Sep 25 17:04:43 vms04 stonith-ng[14036]: warning: No template/tag named 'clvmd'
Sep 25 17:04:43 vms04 stonith-ng[14036]:   error: Constraint 'colocation-clvmd-dlm-clone-INFINITY': Invalid reference to 'clvmd'
Sep 25 17:04:56 vms04 pacemakerd[14034]:  notice: Caught 'Terminated' signal
Sep 25 17:04:56 vms04 pacemakerd[14034]:  notice: Shutting down Pacemaker
Sep 25 17:04:56 vms04 systemd: Stopping Pacemaker High Availability Cluster Manager...
Sep 25 17:04:56 vms04 pacemakerd[14034]:  notice: Stopping crmd
Sep 25 17:04:56 vms04 crmd[14040]:  notice: Caught 'Terminated' signal
Sep 25 17:04:56 vms04 crmd[14040]:  notice: Shutting down cluster resource manager
Sep 25 17:04:56 vms04 crmd[14040]: warning: Input I_SHUTDOWN received in state S_TRANSITION_ENGINE from crm_shutdown
Sep 25 17:04:56 vms04 crmd[14040]:  notice: Transition aborted by status-2-shutdown doing create shutdown=1537909496: Transient attribute change

^C