API tools faq
paste
Advertisement
Guest User

Untitled

a guest
May 12th, 2015
504
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 74.17 KB | None | 0 0
raw download clone embed print report
  1. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: sock was shut down by peer
  2. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: peer( Secondary -> Unknown ) conn( Connected -> BrokenPipe ) pdsk( UpToDate -> DUnknown ) susp( 0 -> 1 )
  3. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: short read (expected size 16)
  4. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: meta connection shut down by peer.
  5. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: asender terminated
  6. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: Terminating drbd_a_kvm-1
  7. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: Connection closed
  8. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: conn( BrokenPipe -> Unconnected )
  9. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: helper command: /sbin/drbdadm fence-peer kvm-1
  10. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: receiver terminated
  11. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: Restarting receiver thread
  12. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: receiver (re)started
  13. May 11 19:31:36 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  14. May 11 19:31:37 cluster-1 cib[3626]: notice: cib:diff: ++ <rsc_location rsc="kvm-1-ms-drbd" id="drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd">
  15. May 11 19:31:37 cluster-1 cib[3626]: notice: cib:diff: ++ <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-1-rule-kvm-1-ms-drbd">
  16. May 11 19:31:37 cluster-1 cib[3626]: notice: cib:diff: ++ <expression attribute="#uname" operation="ne" value="cluster-1.localhost.localdomain" id="drbd-fence-by-handler-kvm-1-expr-kvm-1-ms-drbd"/>
  17. May 11 19:31:37 cluster-1 crm-fence-peer.sh[24205]: INFO peer is reachable, my disk is UpToDate UpToDate: placed constraint 'drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd'
  18. May 11 19:31:37 cluster-1 kernel: drbd kvm-1: helper command: /sbin/drbdadm fence-peer kvm-1 exit code 4 (0x400)
  19. May 11 19:31:37 cluster-1 kernel: drbd kvm-1: fence-peer helper returned 4 (peer was fenced)
  20. May 11 19:31:37 cluster-1 kernel: drbd kvm-1: pdsk( DUnknown -> Outdated )
  21. May 11 19:31:37 cluster-1 kernel: block drbd1: new current UUID 769FC6FBE8D35C2B:A14B7F8EA4619E0D:23081FF347581F9B:23071FF347581F9B
  22. May 11 19:31:37 cluster-1 kernel: block drbd1001: new current UUID 5B2FBAEBC52AE29D:2D6E16C0C67126AB:83AC5C99605A6CBC:0000000000000004
  23. May 11 19:31:37 cluster-1 kernel: drbd kvm-1: susp( 1 -> 0 )
  24. May 11 19:31:37 cluster-1 kernel: drbd kvm-1: initial packet S crossed
  25. May 11 19:31:41 cluster-1 kernel: drbd kvm-1: initial packet M crossed
  26. May 11 19:31:50 cluster-1 kernel: drbd kvm-1: Handshake successful: Agreed network protocol version 101
  27. May 11 19:31:50 cluster-1 kernel: drbd kvm-1: Agreed to support TRIM on protocol level
  28. May 11 19:31:50 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> WFReportParams )
  29. May 11 19:31:50 cluster-1 kernel: drbd kvm-1: Starting asender thread (from drbd_r_kvm-1 [3991])
  30. May 11 19:31:51 cluster-1 kernel: block drbd1: drbd_sync_handshake:
  31. May 11 19:31:51 cluster-1 kernel: block drbd1: self 769FC6FBE8D35C2B:A14B7F8EA4619E0D:23081FF347581F9B:23071FF347581F9B bits:309 flags:0
  32. May 11 19:31:51 cluster-1 kernel: block drbd1: peer A14B7F8EA4619E0C:0000000000000000:23081FF347581F9A:23071FF347581F9B bits:0 flags:0
  33. May 11 19:31:51 cluster-1 kernel: block drbd1: uuid_compare()=1 by rule 70
  34. May 11 19:31:51 cluster-1 kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Consistent )
  35. May 11 19:31:51 cluster-1 kernel: block drbd1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 112(1), total 112; compression: 100.0%
  36. May 11 19:31:51 cluster-1 kernel: block drbd1001: drbd_sync_handshake:
  37. May 11 19:31:51 cluster-1 kernel: block drbd1001: self 5B2FBAEBC52AE29D:2D6E16C0C67126AB:83AC5C99605A6CBC:0000000000000004 bits:0 flags:0
  38. May 11 19:31:51 cluster-1 kernel: block drbd1001: peer 2D6E16C0C67126AA:0000000000000000:83AC5C99605A6CBC:0000000000000004 bits:0 flags:4
  39. May 11 19:31:51 cluster-1 kernel: block drbd1001: uuid_compare()=1 by rule 70
  40. May 11 19:31:51 cluster-1 kernel: block drbd1001: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Consistent )
  41. May 11 19:31:51 cluster-1 kernel: block drbd1001: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  42. May 11 19:31:51 cluster-1 kernel: block drbd1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 112(1), total 112; compression: 100.0%
  43. May 11 19:31:51 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1
  44. May 11 19:31:51 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1 exit code 0 (0x0)
  45. May 11 19:31:51 cluster-1 kernel: block drbd1: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )
  46. May 11 19:31:51 cluster-1 kernel: block drbd1: Began resync as SyncSource (will sync 1252 KB [313 bits set]).
  47. May 11 19:31:51 cluster-1 kernel: block drbd1: updated sync UUID 769FC6FBE8D35C2B:A14C7F8EA4619E0D:A14B7F8EA4619E0D:23081FF347581F9B
  48. May 11 19:31:51 cluster-1 kernel: block drbd1001: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  49. May 11 19:31:51 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001
  50. May 11 19:31:51 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001 exit code 0 (0x0)
  51. May 11 19:31:51 cluster-1 kernel: block drbd1001: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )
  52. May 11 19:31:51 cluster-1 kernel: block drbd1001: Began resync as SyncSource (will sync 0 KB [0 bits set]).
  53. May 11 19:31:51 cluster-1 kernel: block drbd1001: updated sync UUID 5B2FBAEBC52AE29D:2D6F16C0C67126AB:2D6E16C0C67126AB:83AC5C99605A6CBC
  54. May 11 19:31:53 cluster-1 cib[3626]: notice: cib:diff: -- <rsc_location rsc="kvm-1-ms-drbd" id="drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd">
  55. May 11 19:31:53 cluster-1 cib[3626]: notice: cib:diff: -- <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-1-rule-kvm-1-ms-drbd">
  56. May 11 19:31:53 cluster-1 cib[3626]: notice: cib:diff: -- <expression attribute="#uname" operation="ne" value="cluster-1.localhost.localdomain" id="drbd-fence-by-handler-kvm-1-expr-kvm-1-ms-drbd"/>
  57. May 11 19:31:54 cluster-1 kernel: block drbd1001: Resync done (total 2 sec; paused 0 sec; 0 K/sec)
  58. May 11 19:31:54 cluster-1 kernel: block drbd1001: updated UUIDs 5B2FBAEBC52AE29D:0000000000000000:2D6F16C0C67126AB:2D6E16C0C67126AB
  59. May 11 19:31:54 cluster-1 kernel: block drbd1001: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
  60. May 11 19:31:58 cluster-1 kernel: drbd kvm-2: sock was shut down by peer
  61. May 11 19:31:58 cluster-1 kernel: drbd kvm-2: peer( Primary -> Unknown ) conn( Connected -> BrokenPipe ) pdsk( UpToDate -> DUnknown )
  62. May 11 19:31:58 cluster-1 kernel: drbd kvm-2: short read (expected size 16)
  63. May 11 19:31:58 cluster-1 kernel: drbd kvm-2: asender terminated
  64. May 11 19:31:58 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  65. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: Connection closed
  66. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: conn( BrokenPipe -> Unconnected )
  67. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: receiver terminated
  68. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  69. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: receiver (re)started
  70. May 11 19:31:59 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  71. May 11 19:31:59 cluster-1 cib[3626]: notice: cib:diff: ++ <rsc_location rsc="kvm-2-ms-drbd" id="drbd-fence-by-handler-kvm-2-kvm-2-ms-drbd">
  72. May 11 19:31:59 cluster-1 cib[3626]: notice: cib:diff: ++ <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-2-rule-kvm-2-ms-drbd">
  73. May 11 19:31:59 cluster-1 cib[3626]: notice: cib:diff: ++ <expression attribute="#uname" operation="ne" value="cluster-2.localhost.localdomain" id="drbd-fence-by-handler-kvm-2-expr-kvm-2-ms-drbd"/>
  74. May 11 19:32:01 cluster-1 kernel: drbd kvm-2: initial packet S crossed
  75. May 11 19:32:17 cluster-1 attrd[3629]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-2-drbd (1000)
  76. May 11 19:32:17 cluster-1 attrd[3629]: notice: attrd_perform_update: Sent update 425: master-kvm-2-drbd=1000
  77. May 11 19:32:19 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  78. May 11 19:32:19 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  79. May 11 19:32:19 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  80. May 11 19:32:19 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  81. May 11 19:32:19 cluster-1 kernel: block drbd2: drbd_sync_handshake:
  82. May 11 19:32:19 cluster-1 kernel: block drbd2: self 9D3E0C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3 bits:0 flags:0
  83. May 11 19:32:19 cluster-1 kernel: block drbd2: peer 6E5C450B07DF3037:9D3E0C2FDFB072F7:C32A3D82C41A77A2:C3293D82C41A77A3 bits:4 flags:0
  84. May 11 19:32:19 cluster-1 kernel: block drbd2: uuid_compare()=-1 by rule 50
  85. May 11 19:32:19 cluster-1 kernel: block drbd2: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) disk( UpToDate -> Outdated ) pdsk( DUnknown -> UpToDate )
  86. May 11 19:32:19 cluster-1 kernel: block drbd1002: drbd_sync_handshake:
  87. May 11 19:32:19 cluster-1 kernel: block drbd1002: self F0F8FD640903F016:0000000000000000:EA39FB96E1799C34:0000000000000004 bits:0 flags:0
  88. May 11 19:32:19 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F83:F0F8FD640903F017:EA39FB96E1799C35:0000000000000004 bits:0 flags:0
  89. May 11 19:32:19 cluster-1 kernel: block drbd1002: uuid_compare()=-1 by rule 50
  90. May 11 19:32:19 cluster-1 kernel: block drbd1002: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) disk( UpToDate -> Outdated ) pdsk( DUnknown -> UpToDate )
  91. May 11 19:32:19 cluster-1 kernel: block drbd2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 30(1), total 30; compression: 100.0%
  92. May 11 19:32:19 cluster-1 kernel: block drbd2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 30(1), total 30; compression: 100.0%
  93. May 11 19:32:19 cluster-1 kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID )
  94. May 11 19:32:19 cluster-1 kernel: block drbd1002: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  95. May 11 19:32:19 cluster-1 kernel: block drbd1002: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  96. May 11 19:32:19 cluster-1 kernel: block drbd1002: conn( WFBitMapT -> WFSyncUUID )
  97. May 11 19:32:20 cluster-1 kernel: block drbd2: updated sync uuid 9D3F0C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3
  98. May 11 19:32:20 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2
  99. May 11 19:32:20 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2 exit code 0 (0x0)
  100. May 11 19:32:20 cluster-1 kernel: block drbd2: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent )
  101. May 11 19:32:20 cluster-1 kernel: block drbd2: Began resync as SyncTarget (will sync 16 KB [4 bits set]).
  102. May 11 19:32:20 cluster-1 kernel: block drbd1002: updated sync uuid F0F9FD640903F016:0000000000000000:EA39FB96E1799C34:0000000000000004
  103. May 11 19:32:20 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002
  104. May 11 19:32:20 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002 exit code 0 (0x0)
  105. May 11 19:32:20 cluster-1 kernel: block drbd1002: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent )
  106. May 11 19:32:20 cluster-1 kernel: block drbd1002: Began resync as SyncTarget (will sync 0 KB [0 bits set]).
  107. May 11 19:32:20 cluster-1 kernel: block drbd1002: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
  108. May 11 19:32:20 cluster-1 kernel: block drbd1002: updated UUIDs 11F6D938CED83F82:0000000000000000:F0F9FD640903F016:F0F8FD640903F017
  109. May 11 19:32:20 cluster-1 kernel: block drbd1002: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate )
  110. May 11 19:32:20 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002
  111. May 11 19:32:20 cluster-1 cib[3626]: notice: cib:diff: -- <rsc_location rsc="kvm-2-ms-drbd" id="drbd-fence-by-handler-kvm-2-kvm-2-ms-drbd">
  112. May 11 19:32:20 cluster-1 cib[3626]: notice: cib:diff: -- <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-2-rule-kvm-2-ms-drbd">
  113. May 11 19:32:20 cluster-1 cib[3626]: notice: cib:diff: -- <expression attribute="#uname" operation="ne" value="cluster-2.localhost.localdomain" id="drbd-fence-by-handler-kvm-2-expr-kvm-2-ms-drbd"/>
  114. May 11 19:32:20 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002 exit code 0 (0x0)
  115. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  116. May 11 19:32:21 cluster-1 kernel: block drbd2: conn( SyncTarget -> NetworkFailure )
  117. May 11 19:32:21 cluster-1 kernel: block drbd1002: conn( Connected -> NetworkFailure )
  118. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: peer( Primary -> Unknown ) pdsk( UpToDate -> DUnknown )
  119. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: asender terminated
  120. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  121. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: Connection closed
  122. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  123. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: receiver terminated
  124. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  125. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: receiver (re)started
  126. May 11 19:32:21 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  127. May 11 19:32:33 cluster-1 kernel: drbd kvm-1: sock was shut down by peer
  128. May 11 19:32:33 cluster-1 kernel: block drbd1: conn( SyncSource -> BrokenPipe )
  129. May 11 19:32:33 cluster-1 kernel: block drbd1001: conn( Connected -> BrokenPipe ) pdsk( UpToDate -> DUnknown )
  130. May 11 19:32:33 cluster-1 kernel: drbd kvm-1: peer( Secondary -> Unknown ) susp( 0 -> 1 )
  131. May 11 19:32:33 cluster-1 kernel: drbd kvm-1: short read (expected size 16)
  132. May 11 19:32:33 cluster-1 kernel: drbd kvm-1: asender terminated
  133. May 11 19:32:33 cluster-1 kernel: drbd kvm-1: Terminating drbd_a_kvm-1
  134. May 11 19:32:37 cluster-1 kernel: block drbd1: _drbd_send_page: size=4096 len=984 sent=-32
  135. May 11 19:32:37 cluster-1 kernel: block drbd1: drbd_send_block() failed
  136. May 11 19:32:37 cluster-1 kernel: drbd kvm-1: Connection closed
  137. May 11 19:32:37 cluster-1 kernel: drbd kvm-1: conn( BrokenPipe -> Unconnected ) susp( 0 -> 1 )
  138. May 11 19:32:37 cluster-1 kernel: drbd kvm-1: receiver terminated
  139. May 11 19:32:37 cluster-1 kernel: drbd kvm-1: helper command: /sbin/drbdadm fence-peer kvm-1
  140. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: Restarting receiver thread
  141. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: receiver (re)started
  142. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  143. May 11 19:32:38 cluster-1 cib[3626]: notice: cib:diff: ++ <rsc_location rsc="kvm-1-ms-drbd" id="drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd">
  144. May 11 19:32:38 cluster-1 cib[3626]: notice: cib:diff: ++ <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-1-rule-kvm-1-ms-drbd">
  145. May 11 19:32:38 cluster-1 cib[3626]: notice: cib:diff: ++ <expression attribute="#uname" operation="ne" value="cluster-1.localhost.localdomain" id="drbd-fence-by-handler-kvm-1-expr-kvm-1-ms-drbd"/>
  146. May 11 19:32:38 cluster-1 crm-fence-peer.sh[24586]: INFO peer is reachable, my disk is UpToDate UpToDate: placed constraint 'drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd'
  147. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: helper command: /sbin/drbdadm fence-peer kvm-1 exit code 4 (0x400)
  148. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: fence-peer helper returned 4 (peer was fenced)
  149. May 11 19:32:38 cluster-1 kernel: block drbd1: pdsk( Inconsistent -> Outdated )
  150. May 11 19:32:38 cluster-1 kernel: block drbd1001: pdsk( DUnknown -> Outdated )
  151. May 11 19:32:38 cluster-1 kernel: block drbd1001: new current UUID 2ADD08DA5230570F:5B2FBAEBC52AE29D:2D6F16C0C67126AB:2D6E16C0C67126AB
  152. May 11 19:32:38 cluster-1 kernel: drbd kvm-1: susp( 1 -> 0 )
  153. May 11 19:32:45 cluster-1 kernel: drbd kvm-1: Handshake successful: Agreed network protocol version 101
  154. May 11 19:32:45 cluster-1 kernel: drbd kvm-1: Agreed to support TRIM on protocol level
  155. May 11 19:32:45 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> WFReportParams )
  156. May 11 19:32:45 cluster-1 kernel: drbd kvm-1: Starting asender thread (from drbd_r_kvm-1 [3991])
  157. May 11 19:32:46 cluster-1 kernel: block drbd1: drbd_sync_handshake:
  158. May 11 19:32:46 cluster-1 kernel: block drbd1: self 769FC6FBE8D35C2B:A14C7F8EA4619E0D:A14B7F8EA4619E0D:23081FF347581F9B bits:833 flags:0
  159. May 11 19:32:46 cluster-1 kernel: block drbd1: peer A14C7F8EA4619E0C:0000000000000000:23081FF347581F9A:23071FF347581F9B bits:304 flags:0
  160. May 11 19:32:46 cluster-1 kernel: block drbd1: uuid_compare()=1 by rule 70
  161. May 11 19:32:46 cluster-1 kernel: block drbd1: Becoming sync source due to disk states.
  162. May 11 19:32:46 cluster-1 kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent )
  163. May 11 19:32:46 cluster-1 kernel: block drbd1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 200(1), total 200; compression: 100.0%
  164. May 11 19:32:46 cluster-1 kernel: block drbd1001: drbd_sync_handshake:
  165. May 11 19:32:46 cluster-1 kernel: block drbd1001: self 2ADD08DA5230570F:5B2FBAEBC52AE29D:2D6F16C0C67126AB:2D6E16C0C67126AB bits:0 flags:0
  166. May 11 19:32:46 cluster-1 kernel: block drbd1001: peer 5B2FBAEBC52AE29C:0000000000000000:2D6F16C0C67126AA:2D6E16C0C67126AB bits:0 flags:4
  167. May 11 19:32:46 cluster-1 kernel: block drbd1001: uuid_compare()=1 by rule 70
  168. May 11 19:32:46 cluster-1 kernel: block drbd1001: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Consistent )
  169. May 11 19:32:46 cluster-1 kernel: block drbd1001: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  170. May 11 19:32:48 cluster-1 attrd[3629]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-2-drbd (<null>)
  171. May 11 19:32:48 cluster-1 attrd[3629]: notice: attrd_perform_update: Sent delete 427: node=1, attr=master-kvm-2-drbd, id=<n/a>, set=(null), section=status
  172. May 11 19:32:53 cluster-1 kernel: block drbd1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 200(1), total 200; compression: 100.0%
  173. May 11 19:32:53 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1
  174. May 11 19:32:53 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1 exit code 0 (0x0)
  175. May 11 19:32:53 cluster-1 kernel: block drbd1: conn( WFBitMapS -> SyncSource )
  176. May 11 19:32:53 cluster-1 kernel: block drbd1: Began resync as SyncSource (will sync 4148 KB [1037 bits set]).
  177. May 11 19:32:53 cluster-1 kernel: block drbd1: updated sync UUID 769FC6FBE8D35C2B:A14D7F8EA4619E0D:A14C7F8EA4619E0D:A14B7F8EA4619E0D
  178. May 11 19:32:53 cluster-1 kernel: block drbd1001: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  179. May 11 19:32:53 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001
  180. May 11 19:32:53 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001 exit code 0 (0x0)
  181. May 11 19:32:53 cluster-1 kernel: block drbd1001: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )
  182. May 11 19:32:53 cluster-1 kernel: block drbd1001: Began resync as SyncSource (will sync 0 KB [0 bits set]).
  183. May 11 19:32:53 cluster-1 kernel: block drbd1001: updated sync UUID 2ADD08DA5230570F:5B30BAEBC52AE29D:5B2FBAEBC52AE29D:2D6F16C0C67126AB
  184. May 11 19:32:54 cluster-1 kernel: drbd kvm-2: initial packet S crossed
  185. May 11 19:32:55 cluster-1 kernel: drbd kvm-1: sock was shut down by peer
  186. May 11 19:32:55 cluster-1 kernel: drbd kvm-1: peer( Secondary -> Unknown ) conn( SyncSource -> BrokenPipe )
  187. May 11 19:32:55 cluster-1 kernel: drbd kvm-1: short read (expected size 16)
  188. May 11 19:32:55 cluster-1 kernel: drbd kvm-1: asender terminated
  189. May 11 19:32:55 cluster-1 kernel: drbd kvm-1: Terminating drbd_a_kvm-1
  190. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  191. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  192. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  193. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  194. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: sock was shut down by peer
  195. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: conn( WFReportParams -> BrokenPipe )
  196. May 11 19:32:56 cluster-1 kernel: drbd kvm-2: short read (expected size 16)
  197. May 11 19:32:58 cluster-1 kernel: block drbd1: _drbd_send_page: size=4096 len=368 sent=-32
  198. May 11 19:32:58 cluster-1 kernel: block drbd1: drbd_send_block() failed
  199. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: Connection closed
  200. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: conn( BrokenPipe -> Unconnected )
  201. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: receiver terminated
  202. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: Restarting receiver thread
  203. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: receiver (re)started
  204. May 11 19:32:58 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  205. May 11 19:33:00 cluster-1 kernel: drbd kvm-1: Handshake successful: Agreed network protocol version 101
  206. May 11 19:33:00 cluster-1 kernel: drbd kvm-1: Agreed to support TRIM on protocol level
  207. May 11 19:33:00 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> WFReportParams )
  208. May 11 19:33:00 cluster-1 kernel: drbd kvm-1: Starting asender thread (from drbd_r_kvm-1 [3991])
  209. May 11 19:33:00 cluster-1 kernel: block drbd1: drbd_sync_handshake:
  210. May 11 19:33:00 cluster-1 kernel: block drbd1: self 769FC6FBE8D35C2B:A14D7F8EA4619E0D:A14C7F8EA4619E0D:A14B7F8EA4619E0D bits:1222 flags:0
  211. May 11 19:33:00 cluster-1 kernel: block drbd1: peer A14D7F8EA4619E0C:0000000000000000:23081FF347581F9A:23071FF347581F9B bits:1036 flags:0
  212. May 11 19:33:00 cluster-1 kernel: block drbd1: uuid_compare()=1 by rule 70
  213. May 11 19:33:00 cluster-1 kernel: block drbd1: Becoming sync source due to disk states.
  214. May 11 19:33:00 cluster-1 kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS )
  215. May 11 19:33:00 cluster-1 kernel: block drbd1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 267(1), total 267; compression: 100.0%
  216. May 11 19:33:00 cluster-1 kernel: block drbd1001: drbd_sync_handshake:
  217. May 11 19:33:00 cluster-1 kernel: block drbd1001: self 2ADD08DA5230570F:5B30BAEBC52AE29D:5B2FBAEBC52AE29D:2D6F16C0C67126AB bits:0 flags:0
  218. May 11 19:33:00 cluster-1 kernel: block drbd1001: peer 5B30BAEBC52AE29C:0000000000000000:2D6F16C0C67126AA:2D6E16C0C67126AB bits:0 flags:4
  219. May 11 19:33:00 cluster-1 kernel: block drbd1001: uuid_compare()=1 by rule 70
  220. May 11 19:33:00 cluster-1 kernel: block drbd1001: Becoming sync source due to disk states.
  221. May 11 19:33:00 cluster-1 kernel: block drbd1001: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS )
  222. May 11 19:33:00 cluster-1 kernel: block drbd1001: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  223. May 11 19:33:01 cluster-1 kernel: block drbd1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 267(1), total 267; compression: 100.0%
  224. May 11 19:33:01 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1
  225. May 11 19:33:01 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1 exit code 0 (0x0)
  226. May 11 19:33:01 cluster-1 kernel: block drbd1: conn( WFBitMapS -> SyncSource )
  227. May 11 19:33:01 cluster-1 kernel: block drbd1: Began resync as SyncSource (will sync 4948 KB [1237 bits set]).
  228. May 11 19:33:01 cluster-1 kernel: block drbd1: updated sync UUID 769FC6FBE8D35C2B:A14E7F8EA4619E0D:A14D7F8EA4619E0D:A14C7F8EA4619E0D
  229. May 11 19:33:01 cluster-1 kernel: block drbd1001: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  230. May 11 19:33:01 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001
  231. May 11 19:33:01 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001 exit code 0 (0x0)
  232. May 11 19:33:01 cluster-1 kernel: block drbd1001: conn( WFBitMapS -> SyncSource )
  233. May 11 19:33:01 cluster-1 kernel: block drbd1001: Began resync as SyncSource (will sync 0 KB [0 bits set]).
  234. May 11 19:33:01 cluster-1 kernel: block drbd1001: updated sync UUID 2ADD08DA5230570F:5B31BAEBC52AE29D:5B30BAEBC52AE29D:5B2FBAEBC52AE29D
  235. May 11 19:33:02 cluster-1 cib[3626]: notice: cib:diff: -- <rsc_location rsc="kvm-1-ms-drbd" id="drbd-fence-by-handler-kvm-1-kvm-1-ms-drbd">
  236. May 11 19:33:02 cluster-1 cib[3626]: notice: cib:diff: -- <rule role="Master" score="-INFINITY" id="drbd-fence-by-handler-kvm-1-rule-kvm-1-ms-drbd">
  237. May 11 19:33:02 cluster-1 cib[3626]: notice: cib:diff: -- <expression attribute="#uname" operation="ne" value="cluster-1.localhost.localdomain" id="drbd-fence-by-handler-kvm-1-expr-kvm-1-ms-drbd"/>
  238. May 11 19:33:02 cluster-1 kernel: drbd kvm-1: PingAck did not arrive in time.
  239. May 11 19:33:02 cluster-1 kernel: drbd kvm-1: peer( Secondary -> Unknown ) conn( SyncSource -> NetworkFailure )
  240. May 11 19:33:03 cluster-1 kernel: drbd kvm-1: asender terminated
  241. May 11 19:33:03 cluster-1 kernel: drbd kvm-1: Terminating drbd_a_kvm-1
  242. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: asender terminated
  243. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  244. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: Connection closed
  245. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: conn( BrokenPipe -> Unconnected )
  246. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: receiver terminated
  247. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  248. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: receiver (re)started
  249. May 11 19:33:06 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  250. May 11 19:33:14 cluster-1 kernel: drbd kvm-2: initial packet S crossed
  251. May 11 19:33:16 cluster-1 kernel: drbd kvm-2: initial packet M crossed
  252. May 11 19:33:16 cluster-1 kernel: block drbd1: _drbd_send_page: size=4096 len=1240 sent=-32
  253. May 11 19:33:16 cluster-1 kernel: drbd kvm-1: sock_sendmsg returned -32
  254. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: Connection closed
  255. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: conn( NetworkFailure -> Unconnected )
  256. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: receiver terminated
  257. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: Restarting receiver thread
  258. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: receiver (re)started
  259. May 11 19:33:17 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  260. May 11 19:33:18 cluster-1 kernel: drbd kvm-2: sock_recvmsg returned -11
  261. May 11 19:33:18 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> BrokenPipe )
  262. May 11 19:33:18 cluster-1 kernel: drbd kvm-2: short read (expected size 8)
  263. May 11 19:33:18 cluster-1 kernel: drbd kvm-2: Connection closed
  264. May 11 19:33:18 cluster-1 kernel: drbd kvm-2: conn( BrokenPipe -> Unconnected )
  265. May 11 19:33:19 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  266. May 11 19:33:24 cluster-1 kernel: drbd kvm-1: initial packet S crossed
  267. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  268. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  269. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  270. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  271. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  272. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: conn( WFReportParams -> NetworkFailure )
  273. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: asender terminated
  274. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  275. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Connection closed
  276. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  277. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: receiver terminated
  278. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  279. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: receiver (re)started
  280. May 11 19:33:30 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  281. May 11 19:33:35 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  282. May 11 19:33:35 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  283. May 11 19:33:35 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  284. May 11 19:33:35 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  285. May 11 19:33:37 cluster-1 kernel: block drbd2: drbd_sync_handshake:
  286. May 11 19:33:37 cluster-1 kernel: block drbd2: self 9D3F0C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3 bits:0 flags:0
  287. May 11 19:33:37 cluster-1 kernel: block drbd2: peer 6E5C450B07DF3037:9D3F0C2FDFB072F7:9D3E0C2FDFB072F7:C32A3D82C41A77A2 bits:65 flags:0
  288. May 11 19:33:37 cluster-1 kernel: block drbd2: uuid_compare()=-1 by rule 50
  289. May 11 19:33:37 cluster-1 kernel: block drbd2: Becoming sync target due to disk states.
  290. May 11 19:33:37 cluster-1 kernel: block drbd2: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  291. May 11 19:33:37 cluster-1 kernel: block drbd1002: drbd_sync_handshake:
  292. May 11 19:33:37 cluster-1 kernel: block drbd1002: self 11F6D938CED83F82:0000000000000000:F0F9FD640903F016:F0F8FD640903F017 bits:0 flags:0
  293. May 11 19:33:37 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F83:F0F9FD640903F017:F0F8FD640903F017:EA39FB96E1799C35 bits:0 flags:0
  294. May 11 19:33:37 cluster-1 kernel: block drbd1002: was SyncTarget, peer missed the resync finished event, corrected peer:
  295. May 11 19:33:37 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F83:0000000000000000:F0F9FD640903F017:F0F8FD640903F017 bits:0 flags:0
  296. May 11 19:33:37 cluster-1 kernel: block drbd1002: uuid_compare()=-1 by rule 35
  297. May 11 19:33:37 cluster-1 kernel: block drbd1002: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) disk( UpToDate -> Outdated ) pdsk( DUnknown -> UpToDate )
  298. May 11 19:33:37 cluster-1 kernel: block drbd2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 79(1), total 79; compression: 100.0%
  299. May 11 19:33:37 cluster-1 kernel: block drbd2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 79(1), total 79; compression: 100.0%
  300. May 11 19:33:37 cluster-1 kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID )
  301. May 11 19:33:37 cluster-1 kernel: block drbd1002: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  302. May 11 19:33:37 cluster-1 kernel: block drbd1002: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  303. May 11 19:33:37 cluster-1 kernel: block drbd1002: conn( WFBitMapT -> WFSyncUUID )
  304. May 11 19:33:38 cluster-1 kernel: block drbd2: updated sync uuid 9D400C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3
  305. May 11 19:33:38 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2
  306. May 11 19:33:38 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2 exit code 0 (0x0)
  307. May 11 19:33:38 cluster-1 kernel: block drbd2: conn( WFSyncUUID -> SyncTarget )
  308. May 11 19:33:38 cluster-1 kernel: block drbd2: Began resync as SyncTarget (will sync 264 KB [66 bits set]).
  309. May 11 19:33:38 cluster-1 kernel: block drbd1002: updated sync uuid CB5AFF970BA8F8CA:0000000000000000:F0F9FD640903F016:F0F8FD640903F017
  310. May 11 19:33:38 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002
  311. May 11 19:33:38 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002 exit code 0 (0x0)
  312. May 11 19:33:38 cluster-1 kernel: block drbd1002: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent )
  313. May 11 19:33:38 cluster-1 kernel: block drbd1002: Began resync as SyncTarget (will sync 0 KB [0 bits set]).
  314. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  315. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: peer( Primary -> Unknown ) conn( SyncTarget -> NetworkFailure ) pdsk( UpToDate -> DUnknown )
  316. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: asender terminated
  317. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  318. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: Connection closed
  319. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  320. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: receiver terminated
  321. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  322. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: receiver (re)started
  323. May 11 19:33:39 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  324. May 11 19:33:41 cluster-1 kernel: drbd kvm-1: sock_recvmsg returned -11
  325. May 11 19:33:41 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> BrokenPipe )
  326. May 11 19:33:41 cluster-1 kernel: drbd kvm-1: short read (expected size 8)
  327. May 11 19:33:41 cluster-1 kernel: drbd kvm-1: Connection closed
  328. May 11 19:33:41 cluster-1 kernel: drbd kvm-1: conn( BrokenPipe -> Unconnected )
  329. May 11 19:33:42 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  330. May 11 19:33:46 cluster-1 kernel: drbd kvm-2: initial packet S crossed
  331. May 11 19:33:48 cluster-1 kernel: drbd kvm-2: initial packet M crossed
  332. May 11 19:33:53 cluster-1 kernel: drbd kvm-1: sock_recvmsg returned -11
  333. May 11 19:33:53 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> BrokenPipe )
  334. May 11 19:33:53 cluster-1 kernel: drbd kvm-1: short read (expected size 8)
  335. May 11 19:33:53 cluster-1 kernel: drbd kvm-1: Connection closed
  336. May 11 19:33:53 cluster-1 kernel: drbd kvm-1: conn( BrokenPipe -> Unconnected )
  337. May 11 19:33:54 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  338. May 11 19:33:55 cluster-1 kernel: drbd kvm-1: initial packet S crossed
  339. May 11 19:34:03 cluster-1 kernel: drbd kvm-1: Handshake successful: Agreed network protocol version 101
  340. May 11 19:34:03 cluster-1 kernel: drbd kvm-1: Agreed to support TRIM on protocol level
  341. May 11 19:34:03 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> WFReportParams )
  342. May 11 19:34:03 cluster-1 kernel: drbd kvm-1: Starting asender thread (from drbd_r_kvm-1 [3991])
  343. May 11 19:34:03 cluster-1 kernel: block drbd1: drbd_sync_handshake:
  344. May 11 19:34:03 cluster-1 kernel: block drbd1: self 769FC6FBE8D35C2B:A14E7F8EA4619E0D:A14D7F8EA4619E0D:A14C7F8EA4619E0D bits:2412 flags:0
  345. May 11 19:34:03 cluster-1 kernel: block drbd1: peer A14E7F8EA4619E0C:0000000000000000:23081FF347581F9A:23071FF347581F9B bits:1234 flags:0
  346. May 11 19:34:03 cluster-1 kernel: block drbd1: uuid_compare()=1 by rule 70
  347. May 11 19:34:03 cluster-1 kernel: block drbd1: Becoming sync source due to disk states.
  348. May 11 19:34:03 cluster-1 kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS )
  349. May 11 19:34:03 cluster-1 kernel: block drbd1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 434(1), total 434; compression: 100.0%
  350. May 11 19:34:03 cluster-1 kernel: block drbd1001: drbd_sync_handshake:
  351. May 11 19:34:03 cluster-1 kernel: block drbd1001: self 2ADD08DA5230570F:5B31BAEBC52AE29D:5B30BAEBC52AE29D:5B2FBAEBC52AE29D bits:0 flags:0
  352. May 11 19:34:03 cluster-1 kernel: block drbd1001: peer 2ADD08DA5230570E:0000000000000000:5B31BAEBC52AE29C:5B30BAEBC52AE29D bits:0 flags:4
  353. May 11 19:34:03 cluster-1 kernel: block drbd1001: was SyncSource, missed the resync finished event, corrected myself:
  354. May 11 19:34:03 cluster-1 kernel: block drbd1001: self 2ADD08DA5230570F:0000000000000000:5B31BAEBC52AE29D:5B30BAEBC52AE29D bits:0 flags:0
  355. May 11 19:34:03 cluster-1 kernel: block drbd1001: uuid_compare()=1 by rule 34
  356. May 11 19:34:03 cluster-1 kernel: block drbd1001: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Inconsistent -> Consistent )
  357. May 11 19:34:03 cluster-1 kernel: block drbd1001: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  358. May 11 19:34:04 cluster-1 kernel: block drbd1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 434(1), total 434; compression: 100.0%
  359. May 11 19:34:04 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1
  360. May 11 19:34:04 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1 exit code 0 (0x0)
  361. May 11 19:34:04 cluster-1 kernel: block drbd1: conn( WFBitMapS -> SyncSource )
  362. May 11 19:34:04 cluster-1 kernel: block drbd1: Began resync as SyncSource (will sync 9668 KB [2417 bits set]).
  363. May 11 19:34:04 cluster-1 kernel: block drbd1: updated sync UUID 769FC6FBE8D35C2B:A14F7F8EA4619E0D:A14E7F8EA4619E0D:A14D7F8EA4619E0D
  364. May 11 19:34:04 cluster-1 kernel: block drbd1001: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  365. May 11 19:34:04 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001
  366. May 11 19:34:04 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001 exit code 0 (0x0)
  367. May 11 19:34:04 cluster-1 kernel: block drbd1001: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )
  368. May 11 19:34:04 cluster-1 kernel: block drbd1001: Began resync as SyncSource (will sync 0 KB [0 bits set]).
  369. May 11 19:34:05 cluster-1 kernel: block drbd1001: updated sync UUID 2ADD08DA5230570F:A7AF076DDD613FE8:5B31BAEBC52AE29D:5B30BAEBC52AE29D
  370. May 11 19:34:07 cluster-1 kernel: block drbd1001: Resync done (total 2 sec; paused 0 sec; 0 K/sec)
  371. May 11 19:34:07 cluster-1 kernel: block drbd1001: updated UUIDs 2ADD08DA5230570F:0000000000000000:A7AF076DDD613FE8:5B31BAEBC52AE29D
  372. May 11 19:34:07 cluster-1 kernel: block drbd1001: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
  373. May 11 19:34:08 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  374. May 11 19:34:08 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  375. May 11 19:34:08 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  376. May 11 19:34:08 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  377. May 11 19:34:09 cluster-1 kernel: block drbd2: drbd_sync_handshake:
  378. May 11 19:34:09 cluster-1 kernel: block drbd2: self 9D400C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3 bits:59 flags:0
  379. May 11 19:34:09 cluster-1 kernel: block drbd2: peer 6E5C450B07DF3037:9D400C2FDFB072F7:9D3F0C2FDFB072F7:9D3E0C2FDFB072F7 bits:64 flags:0
  380. May 11 19:34:09 cluster-1 kernel: block drbd2: uuid_compare()=-1 by rule 50
  381. May 11 19:34:09 cluster-1 kernel: block drbd2: Becoming sync target due to disk states.
  382. May 11 19:34:09 cluster-1 kernel: block drbd2: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  383. May 11 19:34:10 cluster-1 kernel: block drbd1002: drbd_sync_handshake:
  384. May 11 19:34:10 cluster-1 kernel: block drbd1002: self CB5AFF970BA8F8CA:0000000000000000:F0F9FD640903F016:F0F8FD640903F017 bits:0 flags:0
  385. May 11 19:34:10 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F83:CB5AFF970BA8F8CB:F0F9FD640903F017:F0F8FD640903F017 bits:0 flags:0
  386. May 11 19:34:10 cluster-1 kernel: block drbd1002: uuid_compare()=-1 by rule 50
  387. May 11 19:34:10 cluster-1 kernel: block drbd1002: Becoming sync target due to disk states.
  388. May 11 19:34:10 cluster-1 kernel: block drbd1002: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  389. May 11 19:34:16 cluster-1 kernel: block drbd2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 87(1), total 87; compression: 100.0%
  390. May 11 19:34:16 cluster-1 kernel: block drbd2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 87(1), total 87; compression: 100.0%
  391. May 11 19:34:16 cluster-1 kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID )
  392. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: sock was shut down by peer
  393. May 11 19:34:20 cluster-1 kernel: block drbd1: conn( SyncSource -> BrokenPipe )
  394. May 11 19:34:20 cluster-1 kernel: block drbd1001: conn( Connected -> BrokenPipe ) pdsk( UpToDate -> DUnknown )
  395. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: peer( Secondary -> Unknown ) susp( 0 -> 1 )
  396. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: short read (expected size 16)
  397. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: meta connection shut down by peer.
  398. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: asender terminated
  399. May 11 19:34:20 cluster-1 kernel: drbd kvm-1: Terminating drbd_a_kvm-1
  400. May 11 19:34:21 cluster-1 attrd[3629]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-2-drbd (10)
  401. May 11 19:34:21 cluster-1 attrd[3629]: notice: attrd_perform_update: Sent update 433: master-kvm-2-drbd=10
  402. May 11 19:34:28 cluster-1 kernel: block drbd1: drbd_send_block() failed
  403. May 11 19:34:28 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  404. May 11 19:34:28 cluster-1 kernel: block drbd2: conn( WFSyncUUID -> NetworkFailure )
  405. May 11 19:34:28 cluster-1 kernel: block drbd1002: conn( WFBitMapT -> NetworkFailure )
  406. May 11 19:34:28 cluster-1 kernel: drbd kvm-2: peer( Primary -> Unknown ) pdsk( UpToDate -> DUnknown )
  407. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: asender terminated
  408. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  409. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: Connection closed
  410. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  411. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: receiver terminated
  412. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  413. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: receiver (re)started
  414. May 11 19:34:29 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  415. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  416. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  417. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  418. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  419. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: sock was shut down by peer
  420. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: conn( WFReportParams -> BrokenPipe )
  421. May 11 19:34:47 cluster-1 kernel: drbd kvm-2: short read (expected size 16)
  422. May 11 19:34:53 cluster-1 attrd[3629]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-2-drbd (<null>)
  423. May 11 19:34:53 cluster-1 attrd[3629]: notice: attrd_perform_update: Sent delete 435: node=1, attr=master-kvm-2-drbd, id=<n/a>, set=(null), section=status
  424. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: asender terminated
  425. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  426. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: Connection closed
  427. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: conn( BrokenPipe -> Unconnected )
  428. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: receiver terminated
  429. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  430. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: receiver (re)started
  431. May 11 19:34:57 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  432. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  433. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  434. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  435. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  436. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  437. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: conn( WFReportParams -> NetworkFailure )
  438. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: asender terminated
  439. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  440. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Connection closed
  441. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  442. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: receiver terminated
  443. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  444. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: receiver (re)started
  445. May 11 19:35:10 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  446. May 11 19:35:26 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  447. May 11 19:35:26 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  448. May 11 19:35:26 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  449. May 11 19:35:26 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3997])
  450. May 11 19:35:26 cluster-1 kernel: block drbd2: drbd_sync_handshake:
  451. May 11 19:35:26 cluster-1 kernel: block drbd2: self 9D400C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3 bits:64 flags:0
  452. May 11 19:35:26 cluster-1 kernel: block drbd2: peer 6E5C450B07DF3037:9D400C2FDFB072F7:9D3F0C2FDFB072F7:9D3E0C2FDFB072F7 bits:90 flags:0
  453. May 11 19:35:26 cluster-1 kernel: block drbd2: uuid_compare()=-1 by rule 50
  454. May 11 19:35:26 cluster-1 kernel: block drbd2: Becoming sync target due to disk states.
  455. May 11 19:35:26 cluster-1 kernel: block drbd2: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  456. May 11 19:35:27 cluster-1 kernel: block drbd1002: drbd_sync_handshake:
  457. May 11 19:35:27 cluster-1 kernel: block drbd1002: self CB5AFF970BA8F8CA:0000000000000000:F0F9FD640903F016:F0F8FD640903F017 bits:0 flags:0
  458. May 11 19:35:27 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F83:CB5AFF970BA8F8CB:F0F9FD640903F017:F0F8FD640903F017 bits:0 flags:0
  459. May 11 19:35:27 cluster-1 kernel: block drbd1002: uuid_compare()=-1 by rule 50
  460. May 11 19:35:27 cluster-1 kernel: block drbd1002: Becoming sync target due to disk states.
  461. May 11 19:35:27 cluster-1 kernel: block drbd1002: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  462. May 11 19:35:35 cluster-1 kernel: block drbd2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 98(1), total 98; compression: 100.0%
  463. May 11 19:35:35 cluster-1 kernel: block drbd2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 98(1), total 98; compression: 100.0%
  464. May 11 19:35:35 cluster-1 kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID )
  465. May 11 19:35:35 cluster-1 kernel: block drbd1002: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  466. May 11 19:35:35 cluster-1 kernel: block drbd1002: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
  467. May 11 19:35:35 cluster-1 kernel: block drbd1002: conn( WFBitMapT -> WFSyncUUID )
  468. May 11 19:35:35 cluster-1 kernel: block drbd2: updated sync uuid 9D410C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3
  469. May 11 19:35:35 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2
  470. May 11 19:35:35 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2 exit code 0 (0x0)
  471. May 11 19:35:35 cluster-1 kernel: block drbd2: conn( WFSyncUUID -> SyncTarget )
  472. May 11 19:35:35 cluster-1 kernel: block drbd2: Began resync as SyncTarget (will sync 380 KB [95 bits set]).
  473. May 11 19:35:35 cluster-1 kernel: block drbd1002: updated sync uuid CB5BFF970BA8F8CA:0000000000000000:F0F9FD640903F016:F0F8FD640903F017
  474. May 11 19:35:35 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002
  475. May 11 19:35:35 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002 exit code 0 (0x0)
  476. May 11 19:35:35 cluster-1 kernel: block drbd1002: conn( WFSyncUUID -> SyncTarget )
  477. May 11 19:35:35 cluster-1 kernel: block drbd1002: Began resync as SyncTarget (will sync 0 KB [0 bits set]).
  478. May 11 19:35:36 cluster-1 kernel: block drbd1002: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
  479. May 11 19:35:36 cluster-1 kernel: block drbd1002: updated UUIDs 11F6D938CED83F82:0000000000000000:CB5BFF970BA8F8CA:CB5AFF970BA8F8CB
  480. May 11 19:35:36 cluster-1 kernel: block drbd1002: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate )
  481. May 11 19:35:36 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002
  482. May 11 19:35:36 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002 exit code 0 (0x0)
  483. May 11 19:35:54 cluster-1 kernel: drbd kvm-2: PingAck did not arrive in time.
  484. May 11 19:35:54 cluster-1 kernel: block drbd2: conn( SyncTarget -> NetworkFailure )
  485. May 11 19:35:54 cluster-1 kernel: block drbd1002: conn( Connected -> NetworkFailure )
  486. May 11 19:35:54 cluster-1 kernel: drbd kvm-2: peer( Primary -> Unknown ) pdsk( UpToDate -> DUnknown )
  487. May 11 19:35:54 cluster-1 kernel: drbd kvm-2: error receiving RSDataReply, e: -5 l: 32768!
  488. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: asender terminated
  489. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: Terminating drbd_a_kvm-2
  490. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: Connection closed
  491. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: conn( NetworkFailure -> Unconnected )
  492. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: receiver terminated
  493. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: Restarting receiver thread
  494. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: receiver (re)started
  495. May 11 19:35:55 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  496. May 11 21:34:11 cluster-1 pengine[3630]: notice: LogActions: Stop kvm-1-drbd:0 (cluster-2.localhost.localdomain)
  497. May 11 21:34:11 cluster-1 pengine[3630]: notice: LogActions: Demote kvm-2-drbd:0 (Master -> Stopped cluster-2.localhost.localdomain)
  498. May 11 21:34:11 cluster-1 crmd[3631]: notice: te_rsc_command: Initiating action 112: notify kvm-1-drbd_pre_notify_stop_0 on cluster-2.localhost.localdomain
  499. May 11 21:34:11 cluster-1 crmd[3631]: notice: te_rsc_command: Initiating action 113: notify kvm-1-drbd_pre_notify_stop_0 on cluster-1.localhost.localdomain (local)
  500. May 11 21:34:11 cluster-1 crmd[3631]: notice: te_rsc_command: Initiating action 124: notify kvm-2-drbd_pre_notify_demote_0 on cluster-2.localhost.localdomain
  501. May 11 21:34:11 cluster-1 crmd[3631]: notice: te_rsc_command: Initiating action 126: notify kvm-2-drbd_pre_notify_demote_0 on cluster-1.localhost.localdomain (local)
  502. May 11 21:34:11 cluster-1 crmd[3631]: notice: process_lrm_event: LRM operation kvm-2-drbd_notify_0 (call=181, rc=0, cib-update=0, confirmed=true) ok
  503. May 11 21:34:11 cluster-1 crmd[3631]: notice: process_lrm_event: LRM operation kvm-1-drbd_notify_0 (call=180, rc=0, cib-update=0, confirmed=true) ok
  504. May 11 21:34:53 cluster-1 pengine[9273]: notice: LogActions: Start kvm-1-drbd:0 (cluster-1.localhost.localdomain)
  505. May 11 21:34:53 cluster-1 pengine[9273]: notice: LogActions: Start kvm-2-drbd:0 (cluster-1.localhost.localdomain)
  506. May 11 21:34:53 cluster-1 crmd[9274]: notice: te_rsc_command: Initiating action 8: monitor kvm-1-drbd:0_monitor_0 on cluster-1.localhost.localdomain (local)
  507. May 11 21:34:53 cluster-1 crmd[9274]: notice: te_rsc_command: Initiating action 10: monitor kvm-2-drbd:0_monitor_0 on cluster-1.localhost.localdomain (local)
  508. May 11 21:34:53 cluster-1 attrd[9272]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-1-drbd (10000)
  509. May 11 21:34:53 cluster-1 attrd[9272]: notice: attrd_perform_update: Sent update 4: master-kvm-1-drbd=10000
  510. May 11 21:34:54 cluster-1 crmd[9274]: notice: process_lrm_event: LRM operation kvm-1-drbd_monitor_0 (call=24, rc=8, cib-update=26, confirmed=true) master
  511. May 11 21:34:54 cluster-1 crmd[9274]: notice: process_lrm_event: cluster-1.localhost.localdomain-kvm-1-drbd_monitor_0:24 [ \n ]
  512. May 11 21:34:54 cluster-1 crmd[9274]: notice: process_lrm_event: LRM operation kvm-2-drbd_monitor_0 (call=33, rc=0, cib-update=27, confirmed=true) ok
  513. May 11 21:34:54 cluster-1 crmd[9274]: warning: status_from_rc: Action 8 (kvm-1-drbd:0_monitor_0) on cluster-1.localhost.localdomain failed (target: 7 vs. rc: 8): Error
  514. May 11 21:34:54 cluster-1 crmd[9274]: warning: status_from_rc: Action 10 (kvm-2-drbd:0_monitor_0) on cluster-1.localhost.localdomain failed (target: 7 vs. rc: 0): Error
  515. May 11 21:34:59 cluster-1 pengine[9273]: notice: unpack_rsc_op: Operation monitor found resource kvm-1-drbd:0 active in master mode on cluster-1.localhost.localdomain
  516. May 11 21:34:59 cluster-1 crmd[9274]: notice: te_rsc_command: Initiating action 24: monitor kvm-1-drbd_monitor_29000 on cluster-1.localhost.localdomain (local)
  517. May 11 21:34:59 cluster-1 crmd[9274]: notice: te_rsc_command: Initiating action 54: monitor kvm-2-drbd_monitor_31000 on cluster-1.localhost.localdomain (local)
  518. May 11 21:35:00 cluster-1 crmd[9274]: notice: process_lrm_event: LRM operation kvm-1-drbd_monitor_29000 (call=41, rc=8, cib-update=41, confirmed=false) master
  519. May 11 21:35:00 cluster-1 crmd[9274]: notice: process_lrm_event: cluster-1.localhost.localdomain-kvm-1-drbd_monitor_29000:41 [ \n ]
  520. May 11 21:35:00 cluster-1 crmd[9274]: notice: process_lrm_event: LRM operation kvm-2-drbd_monitor_31000 (call=43, rc=0, cib-update=42, confirmed=false) ok
  521. May 11 21:35:01 cluster-1 pengine[9273]: notice: unpack_rsc_op: Operation monitor found resource kvm-1-drbd:0 active in master mode on cluster-1.localhost.localdomain
  522. May 11 21:35:24 cluster-1 systemd-udevd: worker [9423] /devices/virtual/block/drbd1001 timeout; kill it
  523. May 11 21:35:24 cluster-1 systemd-udevd: seq 5335 '/devices/virtual/block/drbd1001' killed
  524. May 11 21:40:15 cluster-1 kernel: drbd: module verification failed: signature and/or required key missing - tainting kernel
  525. May 11 21:40:15 cluster-1 kernel: drbd: events: mcg drbd: 4
  526. May 11 21:40:15 cluster-1 kernel: drbd: initialized. Version: 8.4.5 (api:1/proto:86-101)
  527. May 11 21:40:15 cluster-1 kernel: drbd: GIT-hash: 1d360bde0e095d495786eaeb2a1ac76888e4db96 build by mockbuild@, 2014-08-17 22:54:26
  528. May 11 21:40:15 cluster-1 kernel: drbd: registered as block device major 147
  529. May 11 21:40:47 cluster-1 kernel: drbd kvm-1: Starting worker thread (from drbdsetup-84 [3452])
  530. May 11 21:40:47 cluster-1 kernel: block drbd1: disk( Diskless -> Attaching )
  531. May 11 21:40:47 cluster-1 kernel: drbd kvm-1: Method to ensure write ordering: drain
  532. May 11 21:40:47 cluster-1 kernel: block drbd1: max BIO size = 1048576
  533. May 11 21:40:47 cluster-1 kernel: block drbd1: Adjusting my ra_pages to backing device's (32 -> 512)
  534. May 11 21:40:47 cluster-1 kernel: block drbd1: drbd_bm_resize called with capacity == 125825208
  535. May 11 21:40:47 cluster-1 kernel: block drbd1: resync bitmap: bits=15728151 words=245753 pages=480
  536. May 11 21:40:47 cluster-1 kernel: block drbd1: size = 60 GB (62912604 KB)
  537. May 11 21:40:47 cluster-1 kernel: block drbd1: recounting of set bits took additional 1 jiffies
  538. May 11 21:40:47 cluster-1 kernel: block drbd1: 13 GB (3469847 bits) marked out-of-sync by on disk bit-map.
  539. May 11 21:40:47 cluster-1 kernel: block drbd1: disk( Attaching -> UpToDate ) pdsk( DUnknown -> Outdated )
  540. May 11 21:40:47 cluster-1 kernel: block drbd1: attached to UUIDs 769FC6FBE8D35C2B:A14F7F8EA4619E0D:A14E7F8EA4619E0D:A14D7F8EA4619E0D
  541. May 11 21:40:48 cluster-1 kernel: block drbd1001: disk( Diskless -> Attaching )
  542. May 11 21:40:48 cluster-1 kernel: block drbd1001: max BIO size = 1048576
  543. May 11 21:40:48 cluster-1 kernel: block drbd1001: Adjusting my ra_pages to backing device's (32 -> 512)
  544. May 11 21:40:48 cluster-1 kernel: block drbd1001: drbd_bm_resize called with capacity == 20970808
  545. May 11 21:40:48 cluster-1 kernel: block drbd1001: resync bitmap: bits=2621351 words=40959 pages=80
  546. May 11 21:40:48 cluster-1 kernel: block drbd1001: size = 10 GB (10485404 KB)
  547. May 11 21:40:48 cluster-1 kernel: block drbd1001: recounting of set bits took additional 0 jiffies
  548. May 11 21:40:48 cluster-1 kernel: block drbd1001: 116 MB (29607 bits) marked out-of-sync by on disk bit-map.
  549. May 11 21:40:48 cluster-1 kernel: block drbd1001: disk( Attaching -> Consistent )
  550. May 11 21:40:48 cluster-1 kernel: block drbd1001: attached to UUIDs 2ADD08DA5230570F:0000000000000000:A7AF076DDD613FE8:5B31BAEBC52AE29D
  551. May 11 21:40:48 cluster-1 kernel: drbd kvm-1: conn( StandAlone -> Unconnected )
  552. May 11 21:40:48 cluster-1 kernel: drbd kvm-1: Starting receiver thread (from drbd_w_kvm-1 [3454])
  553. May 11 21:40:48 cluster-1 kernel: drbd kvm-1: receiver (re)started
  554. May 11 21:40:48 cluster-1 kernel: drbd kvm-1: conn( Unconnected -> WFConnection )
  555. May 11 21:46:33 cluster-1 kernel: drbd kvm-2: Starting worker thread (from drbdsetup-84 [3646])
  556. May 11 21:46:33 cluster-1 kernel: block drbd2: disk( Diskless -> Attaching )
  557. May 11 21:46:33 cluster-1 kernel: drbd kvm-2: Method to ensure write ordering: drain
  558. May 11 21:46:33 cluster-1 kernel: block drbd2: max BIO size = 1048576
  559. May 11 21:46:33 cluster-1 kernel: block drbd2: Adjusting my ra_pages to backing device's (32 -> 512)
  560. May 11 21:46:33 cluster-1 kernel: block drbd2: drbd_bm_resize called with capacity == 83883448
  561. May 11 21:46:33 cluster-1 kernel: block drbd2: resync bitmap: bits=10485431 words=163835 pages=320
  562. May 11 21:46:33 cluster-1 kernel: block drbd2: size = 40 GB (41941724 KB)
  563. May 11 21:46:34 cluster-1 kernel: block drbd2: recounting of set bits took additional 0 jiffies
  564. May 11 21:46:34 cluster-1 kernel: block drbd2: 120 KB (30 bits) marked out-of-sync by on disk bit-map.
  565. May 11 21:46:34 cluster-1 kernel: block drbd2: disk( Attaching -> Inconsistent )
  566. May 11 21:46:34 cluster-1 kernel: block drbd2: attached to UUIDs 9D410C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3
  567. May 11 21:46:34 cluster-1 kernel: block drbd1002: disk( Diskless -> Attaching )
  568. May 11 21:46:34 cluster-1 kernel: block drbd1002: max BIO size = 1048576
  569. May 11 21:46:34 cluster-1 kernel: block drbd1002: Adjusting my ra_pages to backing device's (32 -> 512)
  570. May 11 21:46:34 cluster-1 kernel: block drbd1002: drbd_bm_resize called with capacity == 20970808
  571. May 11 21:46:34 cluster-1 kernel: block drbd1002: resync bitmap: bits=2621351 words=40959 pages=80
  572. May 11 21:46:34 cluster-1 kernel: block drbd1002: size = 10 GB (10485404 KB)
  573. May 11 21:46:34 cluster-1 kernel: block drbd1002: recounting of set bits took additional 0 jiffies
  574. May 11 21:46:34 cluster-1 kernel: block drbd1002: 0 KB (0 bits) marked out-of-sync by on disk bit-map.
  575. May 11 21:46:34 cluster-1 kernel: block drbd1002: disk( Attaching -> Consistent )
  576. May 11 21:46:34 cluster-1 kernel: block drbd1002: attached to UUIDs 11F6D938CED83F82:0000000000000000:CB5BFF970BA8F8CA:CB5AFF970BA8F8CB
  577. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: conn( StandAlone -> Unconnected )
  578. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: Starting receiver thread (from drbd_w_kvm-2 [3648])
  579. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: receiver (re)started
  580. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: conn( Unconnected -> WFConnection )
  581. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: Handshake successful: Agreed network protocol version 101
  582. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: Agreed to support TRIM on protocol level
  583. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: conn( WFConnection -> WFReportParams )
  584. May 11 21:46:34 cluster-1 kernel: drbd kvm-2: Starting asender thread (from drbd_r_kvm-2 [3655])
  585. May 11 21:46:34 cluster-1 kernel: block drbd2: drbd_sync_handshake:
  586. May 11 21:46:34 cluster-1 kernel: block drbd2: self 9D410C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3 bits:30 flags:0
  587. May 11 21:46:34 cluster-1 kernel: block drbd2: peer 6E5C450B07DF3036:9D410C2FDFB072F7:9D400C2FDFB072F7:9D3F0C2FDFB072F7 bits:3470007 flags:2
  588. May 11 21:46:34 cluster-1 kernel: block drbd2: uuid_compare()=-1 by rule 50
  589. May 11 21:46:34 cluster-1 kernel: block drbd2: Becoming sync target due to disk states.
  590. May 11 21:46:34 cluster-1 kernel: block drbd2: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
  591. May 11 21:46:34 cluster-1 kernel: block drbd1002: drbd_sync_handshake:
  592. May 11 21:46:34 cluster-1 kernel: block drbd1002: self 11F6D938CED83F82:0000000000000000:CB5BFF970BA8F8CA:CB5AFF970BA8F8CB bits:0 flags:0
  593. May 11 21:46:34 cluster-1 kernel: block drbd1002: peer 11F6D938CED83F82:0000000000000000:CB5BFF970BA8F8CB:CB5AFF970BA8F8CB bits:25511 flags:2
  594. May 11 21:46:34 cluster-1 kernel: block drbd1002: uuid_compare()=-1 by rule 40
  595. May 11 21:46:34 cluster-1 kernel: block drbd1002: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapT ) disk( Consistent -> Outdated ) pdsk( DUnknown -> UpToDate )
  596. May 11 21:46:34 cluster-1 kernel: block drbd2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 4398(2), total 4398; compression: 99.7%
  597. May 11 21:46:34 cluster-1 kernel: block drbd2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 4398(2), total 4398; compression: 99.7%
  598. May 11 21:46:34 cluster-1 kernel: block drbd2: conn( WFBitMapT -> WFSyncUUID )
  599. May 11 21:46:34 cluster-1 kernel: block drbd1002: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 45(1), total 45; compression: 100.0%
  600. May 11 21:46:34 cluster-1 kernel: block drbd1002: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 45(1), total 45; compression: 100.0%
  601. May 11 21:46:34 cluster-1 kernel: block drbd1002: conn( WFBitMapT -> WFSyncUUID )
  602. May 11 21:46:35 cluster-1 kernel: block drbd2: updated sync uuid 9D420C2FDFB072F6:0000000000000000:C32A3D82C41A77A3:C3293D82C41A77A3
  603. May 11 21:46:35 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2
  604. May 11 21:46:35 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm before-resync-target minor-2 exit code 0 (0x0)
  605. May 11 21:46:35 cluster-1 kernel: block drbd2: conn( WFSyncUUID -> SyncTarget )
  606. May 11 21:46:35 cluster-1 kernel: block drbd2: Began resync as SyncTarget (will sync 13880028 KB [3470007 bits set]).
  607. May 11 21:46:35 cluster-1 kernel: block drbd1002: updated sync uuid 040121AFF89CFC76:0000000000000000:CB5BFF970BA8F8CA:CB5AFF970BA8F8CB
  608. May 11 21:46:35 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002
  609. May 11 21:46:35 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm before-resync-target minor-1002 exit code 0 (0x0)
  610. May 11 21:46:35 cluster-1 kernel: block drbd1002: conn( WFSyncUUID -> SyncTarget ) disk( Outdated -> Inconsistent )
  611. May 11 21:46:35 cluster-1 kernel: block drbd1002: Began resync as SyncTarget (will sync 102044 KB [25511 bits set]).
  612. May 11 21:46:50 cluster-1 kernel: block drbd1002: Resync done (total 15 sec; paused 0 sec; 6800 K/sec)
  613. May 11 21:46:50 cluster-1 kernel: block drbd1002: updated UUIDs 11F6D938CED83F82:0000000000000000:040121AFF89CFC76:CB5BFF970BA8F8CB
  614. May 11 21:46:50 cluster-1 kernel: block drbd1002: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate )
  615. May 11 21:46:50 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002
  616. May 11 21:46:51 cluster-1 kernel: block drbd1002: helper command: /sbin/drbdadm after-resync-target minor-1002 exit code 1 (0x100)
  617. May 11 21:50:42 cluster-1 kernel: block drbd2: Resync done (total 247 sec; paused 0 sec; 56192 K/sec)
  618. May 11 21:50:42 cluster-1 kernel: block drbd2: updated UUIDs 6E5C450B07DF3036:0000000000000000:9D420C2FDFB072F6:9D410C2FDFB072F7
  619. May 11 21:50:42 cluster-1 kernel: block drbd2: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate )
  620. May 11 21:50:42 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm after-resync-target minor-2
  621. May 11 21:50:42 cluster-1 kernel: block drbd2: helper command: /sbin/drbdadm after-resync-target minor-2 exit code 1 (0x100)
  622. May 11 21:51:08 cluster-1 kernel: drbd kvm-1: Handshake successful: Agreed network protocol version 101
  623. May 11 21:51:08 cluster-1 kernel: drbd kvm-1: Agreed to support TRIM on protocol level
  624. May 11 21:51:08 cluster-1 kernel: drbd kvm-1: conn( WFConnection -> WFReportParams )
  625. May 11 21:51:08 cluster-1 kernel: drbd kvm-1: Starting asender thread (from drbd_r_kvm-1 [3462])
  626. May 11 21:51:08 cluster-1 kernel: block drbd1: drbd_sync_handshake:
  627. May 11 21:51:08 cluster-1 kernel: block drbd1: self 769FC6FBE8D35C2A:A14F7F8EA4619E0D:A14E7F8EA4619E0D:A14D7F8EA4619E0D bits:3469847 flags:0
  628. May 11 21:51:08 cluster-1 kernel: block drbd1: peer A14F7F8EA4619E0C:0000000000000000:23081FF347581F9A:23071FF347581F9B bits:2416 flags:0
  629. May 11 21:51:08 cluster-1 kernel: block drbd1: uuid_compare()=1 by rule 70
  630. May 11 21:51:08 cluster-1 kernel: block drbd1: Becoming sync source due to disk states.
  631. May 11 21:51:08 cluster-1 kernel: block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent )
  632. May 11 21:51:08 cluster-1 kernel: block drbd1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 4635(2), total 4635; compression: 99.8%
  633. May 11 21:51:08 cluster-1 kernel: block drbd1001: drbd_sync_handshake:
  634. May 11 21:51:08 cluster-1 kernel: block drbd1001: self 2ADD08DA5230570E:0000000000000000:A7AF076DDD613FE8:5B31BAEBC52AE29D bits:29607 flags:0
  635. May 11 21:51:08 cluster-1 kernel: block drbd1001: peer 2ADD08DA5230570E:0000000000000000:A7AF076DDD613FE8:5B31BAEBC52AE29D bits:0 flags:0
  636. May 11 21:51:08 cluster-1 kernel: block drbd1001: uuid_compare()=1 by rule 40
  637. May 11 21:51:08 cluster-1 kernel: block drbd1001: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) disk( Consistent -> UpToDate ) pdsk( DUnknown -> Consistent )
  638. May 11 21:51:08 cluster-1 kernel: block drbd1001: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 45(1), total 45; compression: 100.0%
  639. May 11 21:51:08 cluster-1 kernel: block drbd1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 4635(2), total 4635; compression: 99.8%
  640. May 11 21:51:08 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1
  641. May 11 21:51:08 cluster-1 kernel: block drbd1: helper command: /sbin/drbdadm before-resync-source minor-1 exit code 0 (0x0)
  642. May 11 21:51:08 cluster-1 kernel: block drbd1: conn( WFBitMapS -> SyncSource )
  643. May 11 21:51:08 cluster-1 kernel: block drbd1: Began resync as SyncSource (will sync 13879388 KB [3469847 bits set]).
  644. May 11 21:51:08 cluster-1 kernel: block drbd1: updated sync UUID 769FC6FBE8D35C2A:A1507F8EA4619E0D:A14F7F8EA4619E0D:A14E7F8EA4619E0D
  645. May 11 21:51:08 cluster-1 kernel: block drbd1001: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 45(1), total 45; compression: 100.0%
  646. May 11 21:51:08 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001
  647. May 11 21:51:08 cluster-1 kernel: block drbd1001: helper command: /sbin/drbdadm before-resync-source minor-1001 exit code 0 (0x0)
  648. May 11 21:51:08 cluster-1 kernel: block drbd1001: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )
  649. May 11 21:51:08 cluster-1 kernel: block drbd1001: Began resync as SyncSource (will sync 118428 KB [29607 bits set]).
  650. May 11 21:51:08 cluster-1 kernel: block drbd1001: updated sync UUID 2ADD08DA5230570E:C7F5B6B5775E4BC5:A7AF076DDD613FE8:5B31BAEBC52AE29D
  651. May 11 21:51:26 cluster-1 kernel: block drbd1001: Resync done (total 17 sec; paused 0 sec; 6964 K/sec)
  652. May 11 21:51:26 cluster-1 kernel: block drbd1001: updated UUIDs 2ADD08DA5230570E:0000000000000000:C7F5B6B5775E4BC5:A7AF076DDD613FE8
  653. May 11 21:51:26 cluster-1 kernel: block drbd1001: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
  654. May 11 21:54:43 cluster-1 kernel: block drbd1: Resync done (total 215 sec; paused 0 sec; 64552 K/sec)
  655. May 11 21:54:43 cluster-1 kernel: block drbd1: updated UUIDs 769FC6FBE8D35C2A:0000000000000000:A1507F8EA4619E0D:A14F7F8EA4619E0D
  656. May 11 21:54:43 cluster-1 kernel: block drbd1: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
  657. May 11 21:55:42 cluster-1 pengine[4932]: notice: LogActions: Start kvm-1-drbd:0 (cluster-1.localhost.localdomain)
  658. May 11 21:55:42 cluster-1 pengine[4932]: notice: LogActions: Start kvm-1-drbd:1 (cluster-2.localhost.localdomain)
  659. May 11 21:55:42 cluster-1 pengine[4932]: notice: LogActions: Start kvm-2-drbd:0 (cluster-1.localhost.localdomain)
  660. May 11 21:55:42 cluster-1 pengine[4932]: notice: LogActions: Start kvm-2-drbd:1 (cluster-2.localhost.localdomain)
  661. May 11 21:55:42 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 8: monitor kvm-1-drbd:0_monitor_0 on cluster-1.localhost.localdomain (local)
  662. May 11 21:55:42 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 17: monitor kvm-1-drbd:1_monitor_0 on cluster-2.localhost.localdomain
  663. May 11 21:55:42 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 10: monitor kvm-2-drbd:0_monitor_0 on cluster-1.localhost.localdomain (local)
  664. May 11 21:55:42 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 19: monitor kvm-2-drbd:1_monitor_0 on cluster-2.localhost.localdomain
  665. May 11 21:55:42 cluster-1 attrd[4931]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-1-drbd (10000)
  666. May 11 21:55:42 cluster-1 attrd[4931]: notice: attrd_perform_update: Sent update 6: master-kvm-1-drbd=10000
  667. May 11 21:55:42 cluster-1 attrd[4931]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-kvm-2-drbd (10000)
  668. May 11 21:55:42 cluster-1 attrd[4931]: notice: attrd_perform_update: Sent update 9: master-kvm-2-drbd=10000
  669. May 11 21:55:43 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-1-drbd_monitor_0 (call=24, rc=0, cib-update=30, confirmed=true) ok
  670. May 11 21:55:43 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-2-drbd_monitor_0 (call=33, rc=0, cib-update=31, confirmed=true) ok
  671. May 11 21:55:43 cluster-1 crmd[4933]: warning: status_from_rc: Action 17 (kvm-1-drbd:1_monitor_0) on cluster-2.localhost.localdomain failed (target: 7 vs. rc: 0): Error
  672. May 11 21:55:43 cluster-1 crmd[4933]: warning: status_from_rc: Action 19 (kvm-2-drbd:1_monitor_0) on cluster-2.localhost.localdomain failed (target: 7 vs. rc: 0): Error
  673. May 11 21:55:43 cluster-1 crmd[4933]: warning: status_from_rc: Action 8 (kvm-1-drbd:0_monitor_0) on cluster-1.localhost.localdomain failed (target: 7 vs. rc: 0): Error
  674. May 11 21:55:43 cluster-1 crmd[4933]: warning: status_from_rc: Action 10 (kvm-2-drbd:0_monitor_0) on cluster-1.localhost.localdomain failed (target: 7 vs. rc: 0): Error
  675. May 11 21:55:43 cluster-1 pengine[4932]: notice: LogActions: Promote kvm-1-drbd:0 (Slave -> Master cluster-1.localhost.localdomain)
  676. May 11 21:55:43 cluster-1 pengine[4932]: notice: LogActions: Promote kvm-2-drbd:1 (Slave -> Master cluster-2.localhost.localdomain)
  677. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 104: notify kvm-1-drbd_pre_notify_promote_0 on cluster-1.localhost.localdomain (local)
  678. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 106: notify kvm-1-drbd_pre_notify_promote_0 on cluster-2.localhost.localdomain
  679. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 116: notify kvm-2-drbd_pre_notify_promote_0 on cluster-1.localhost.localdomain (local)
  680. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 118: notify kvm-2-drbd_pre_notify_promote_0 on cluster-2.localhost.localdomain
  681. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-1-drbd_notify_0 (call=41, rc=0, cib-update=0, confirmed=true) ok
  682. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-2-drbd_notify_0 (call=42, rc=0, cib-update=0, confirmed=true) ok
  683. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 27: promote kvm-1-drbd_promote_0 on cluster-1.localhost.localdomain (local)
  684. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 63: promote kvm-2-drbd_promote_0 on cluster-2.localhost.localdomain
  685. May 11 21:55:44 cluster-1 kernel: block drbd2: peer( Secondary -> Primary )
  686. May 11 21:55:44 cluster-1 kernel: block drbd1: role( Secondary -> Primary )
  687. May 11 21:55:44 cluster-1 kernel: block drbd1001: role( Secondary -> Primary )
  688. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-1-drbd_promote_0 (call=43, rc=0, cib-update=39, confirmed=true) ok
  689. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 105: notify kvm-1-drbd_post_notify_promote_0 on cluster-1.localhost.localdomain (local)
  690. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 107: notify kvm-1-drbd_post_notify_promote_0 on cluster-2.localhost.localdomain
  691. May 11 21:55:44 cluster-1 kernel: block drbd1002: peer( Secondary -> Primary )
  692. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 117: notify kvm-2-drbd_post_notify_promote_0 on cluster-1.localhost.localdomain (local)
  693. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 119: notify kvm-2-drbd_post_notify_promote_0 on cluster-2.localhost.localdomain
  694. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-1-drbd_notify_0 (call=46, rc=0, cib-update=0, confirmed=true) ok
  695. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 28: monitor kvm-1-drbd_monitor_29000 on cluster-1.localhost.localdomain (local)
  696. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 31: monitor kvm-1-drbd_monitor_31000 on cluster-2.localhost.localdomain
  697. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-2-drbd_notify_0 (call=47, rc=0, cib-update=0, confirmed=true) ok
  698. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 60: monitor kvm-2-drbd_monitor_31000 on cluster-1.localhost.localdomain (local)
  699. May 11 21:55:44 cluster-1 crmd[4933]: notice: te_rsc_command: Initiating action 64: monitor kvm-2-drbd_monitor_29000 on cluster-2.localhost.localdomain
  700. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-1-drbd_monitor_29000 (call=49, rc=8, cib-update=40, confirmed=false) master
  701. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: cluster-1.localhost.localdomain-kvm-1-drbd_monitor_29000:49 [ \n ]
  702. May 11 21:55:44 cluster-1 crmd[4933]: notice: process_lrm_event: LRM operation kvm-2-drbd_monitor_31000 (call=50, rc=0, cib-update=41, confirmed=false) ok
  703. May 11 22:21:01 cluster-1 lvm[26949]: Monitoring snapshot rootvg-drbd--vm--backup--snapshot
  704. May 11 22:53:28 cluster-1 lvm[26949]: No longer monitoring snapshot rootvg-drbd--vm--backup--snapshot
  705. May 11 22:53:30 cluster-1 lvm[26949]: Monitoring snapshot rootvg-drbd--vm--backup--snapshot
  706. May 11 22:55:28 cluster-1 lvm[26949]: No longer monitoring snapshot rootvg-drbd--vm--backup--snapshot
  707. May 11 22:55:29 cluster-1 lvm[26949]: Monitoring snapshot rootvg-drbd--vm--backup--snapshot
  708. May 11 23:14:59 cluster-1 lvm[26949]: No longer monitoring snapshot rootvg-drbd--vm--backup--snapshot
  709. May 11 23:15:00 cluster-1 lvm[26949]: Monitoring snapshot rootvg-drbd--vm--backup--snapshot
  710. May 11 23:16:57 cluster-1 lvm[26949]: No longer monitoring snapshot rootvg-drbd--vm--backup--snapshot
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!