Guest User

[CASE-7] node1 log

a guest
Feb 26th, 2016
98
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. Node1
  2.  
  3. Feb 26 18:25:49 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self 15F5D43C9A0B7F26:0000000000000000:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:0 flags:0
  4. Feb 26 18:25:49 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer 15F5D43C9A0B7F26:FFFFFFFFFFFFFFFF:351C9E61C6B06FB6:0000000000000000 bits:0 flags:20
  5. Feb 26 18:25:49 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=0 by rule 38
  6. Feb 26 18:25:49 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
  7. Feb 26 18:26:35 drbd9-01 kernel: drbd r0 drbd9-03: sock_recvmsg returned -11
  8. Feb 26 18:26:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  9. Feb 26 18:26:35 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  10. Feb 26 18:26:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  11. Feb 26 18:26:36 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  12. Feb 26 18:26:41 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 3687696482 (primary_nodes=0, weak_nodes=0)
  13. Feb 26 18:26:41 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 3687696482
  14. Feb 26 18:26:42 drbd9-01 kernel: drbd r0 tcp:drbd9-03: dtt_send_page: size=80 len=80 sent=-104
  15. Feb 26 18:26:42 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> NetworkFailure )
  16. Feb 26 18:26:42 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  17. Feb 26 18:26:42 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  18. Feb 26 18:26:42 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.31
  19. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  20. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  21. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protoco/l level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  22. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1717])
  23. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> NetworkFailure )
  24. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  25. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  26. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  27. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  28. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  29. Feb 26 18:26:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  30. Feb 26 18:26:44 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  31. Feb 26 18:26:44 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  32. Feb 26 18:26:44 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1717])
  33. Feb 26 18:26:44 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 2103542594 (0->2 499/146)
  34. Feb 26 18:26:44 drbd9-01 kernel: drbd r0: State change 2103542594: primary_nodes=0, weak_nodes=0
  35. Feb 26 18:26:44 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 2103542594 (0ms)
  36. Feb 26 18:26:44 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  37. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  38. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  39. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (2603DB27E7D1C272) for nodes 3 4
  40. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=3
  41. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=4
  42. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  43. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self 15F5D43C9A0B7F26:0000000000000000:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:0 flags:0
  44. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer 15F5D43C9A0B7F26:FFFFFFFFFFFFFFFF:2603DB27E7D1C272:0000000000000000 bits:0 flags:20
  45. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=0 by rule 38
  46. Feb 26 18:26:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
  47. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2750423004 (primary_nodes=0, weak_nodes=0)
  48. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 2750423004
  49. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connected -> TearDown ) peer( Secondary -> Unknown )
  50. Feb 26 18:26:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  51. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  52. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  53. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  54. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: conn( TearDown -> Unconnected )
  55. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  56. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  57. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 620245561 (primary_nodes=0, weak_nodes=0)
  58. Feb 26 18:26:45 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 620245561
  59. Feb 26 18:27:05 drbd9-01 kernel: drbd r0 drbd9-03: sock_recvmsg returned -11
  60. Feb 26 18:27:05 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  61. Feb 26 18:27:05 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  62. Feb 26 18:27:05 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  63. Feb 26 18:27:06 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  64. Feb 26 18:27:14 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 683403703 (primary_nodes=0, weak_nodes=0)
  65. Feb 26 18:27:14 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 683403703
  66. Feb 26 18:27:15 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.31
  67. Feb 26 18:27:15 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.31
  68. Feb 26 18:27:17 drbd9-01 kernel: drbd r0 drbd9-03: sock_recvmsg returned -11
  69. Feb 26 18:27:17 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  70. Feb 26 18:27:17 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  71. Feb 26 18:27:17 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  72. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  73. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  74. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  75. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1717])
  76. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> NetworkFailure )
  77. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  78. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  79. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  80. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  81. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  82. Feb 26 18:27:18 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  83. Feb 26 18:27:19 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  84. Feb 26 18:27:19 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  85. Feb 26 18:27:19 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1717])
  86. Feb 26 18:27:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 4127012051 (0->2 499/146)
  87. Feb 26 18:27:19 drbd9-01 kernel: drbd r0: State change 4127012051: primary_nodes=0, weak_nodes=0
  88. Feb 26 18:27:19 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 4127012051 (20ms)
  89. Feb 26 18:27:19 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  90. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  91. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  92. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (2603DB27E7D1C272) for nodes 3 4
  93. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=3
  94. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=4
  95. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  96. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self 15F5D43C9A0B7F26:0000000000000000:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:0 flags:0
  97. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer 15F5D43C9A0B7F26:0000000000000000:2603DB27E7D1C272:0000000000000000 bits:0 flags:120
  98. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=0 by rule 38
  99. Feb 26 18:27:19 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
  100. Feb 26 18:27:37 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 208582347 (0->-1 3/1)
  101. Feb 26 18:27:37 drbd9-01 kernel: drbd r0: State change 208582347: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  102. Feb 26 18:27:37 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 208582347 (0ms)
  103. Feb 26 18:27:37 drbd9-01 kernel: drbd r0: role( Secondary -> Primary )
  104. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: unexpected
  105. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: In UUIDs from node 1 found equal UUID (351C9E61C6B06FB6) for nodes 3 4
  106. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=3
  107. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=4
  108. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  109. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (2603DB27E7D1C272) for nodes 3 4
  110. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=3
  111. Feb 26 18:27:37 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=4
  112.  
  113.  
  114.  
  115. mount!!!!!!!!!!!!!!!!!!
  116.  
  117.  
  118.  
  119. Feb 26 18:27:56 drbd9-01 kernel: EXT4-fs (drbd1): mounting ext3 file system using the ext4 subsystem
  120. Feb 26 18:27:56 drbd9-01 kernel: EXT4-fs (drbd1): mounted filesystem with ordered data mode. Opts: (null)
  121. Feb 26 18:27:56 drbd9-01 dbus-daemon: dbus[932]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  122. Feb 26 18:27:56 drbd9-01 dbus[932]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  123. Feb 26 18:27:56 drbd9-01 systemd: Starting Hostname Service...
  124. Feb 26 18:27:56 drbd9-01 dbus-daemon: dbus[932]: [system] Successfully activated service 'org.freedesktop.hostname1'
  125. Feb 26 18:27:56 drbd9-01 dbus[932]: [system] Successfully activated service 'org.freedesktop.hostname1'
  126. Feb 26 18:27:56 drbd9-01 systemd: Started Hostname Service.
  127. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 329347875 (0->1 496/176)
  128. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: State change 329347875: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  129. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 329347875 (1ms)
  130. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate -> Consistent ) repl( Established -> StartingSyncS )
  131. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1: bitmap WRITE of 153 pages took 9 ms
  132. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Consistent -> Outdated )
  133. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source
  134. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Outdated -> Inconsistent )
  135. Feb 26 18:28:17 drbd9-01 drbdadm[36846]: Don't know which config file belongs to resource r0, trying default ones...
  136. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  137. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl( StartingSyncS -> SyncSource )
  138. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as SyncSource (will sync 4998328 KB [1249582 bits set]).
  139. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 2733829546 (0->2 496/176)
  140. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: State change 2733829546: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  141. Feb 26 18:28:17 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 2733829546 (0ms)
  142. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> Consistent ) repl( Established -> StartingSyncS )
  143. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1: bitmap WRITE of 153 pages took 10 ms
  144. Feb 26 18:28:17 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Consistent -> Outdated )
  145. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source
  146. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Outdated -> Inconsistent )
  147. Feb 26 18:28:18 drbd9-01 drbdadm[36849]: Don't know which config file belongs to resource r0, trying default ones...
  148. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  149. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: repl( StartingSyncS -> SyncSource )
  150. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Began resync as SyncSource (will sync 4998328 KB [1249582 bits set]).
  151. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-04: pdsk( DUnknown -> Inconsistent )
  152. Feb 26 18:28:18 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-05: pdsk( DUnknown -> Inconsistent )
  153. Feb 26 18:30:01 drbd9-01 systemd: Starting Session 368 of user root.
  154. Feb 26 18:30:01 drbd9-01 systemd: Started Session 368 of user root.
  155. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  156. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (15F5D43C9A0B7F26) for nodes 3 4
  157. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=3
  158. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=4
  159. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Resync done (total 130 sec; paused 0 sec; 38448 K/sec)
  160. Feb 26 18:30:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  161. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: unexpected
  162. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: In UUIDs from node 1 found equal UUID (15F5D43C9A0B7F26) for nodes 3 4
  163. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=3
  164. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=4
  165. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Resync done (total 133 sec; paused 0 sec; 37580 K/sec)
  166. Feb 26 18:30:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  167.  
  168.  
  169. Network disable!!!!!!!!!!!!!!!!!!!!!
  170.  
  171. Feb 26 18:32:37 drbd9-01 kernel: vmxnet3 0000:04:00.0 eth1: NIC Link is Down
  172. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: PingAck did not arrive in time.
  173. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown )
  174. Feb 26 18:32:41 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  175. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  176. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  177.  
  178. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: PingAck did not arrive in time.
  179.  
  180. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown )
  181. Feb 26 18:32:41 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  182. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  183. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  184. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  185. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  186. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  187. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  188. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  189. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  190. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  191. Feb 26 18:32:41 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  192.  
  193.  
  194. Feb 26 18:32:57 drbd9-01 kernel: vmxnet3 0000:04:00.0 eth1: NIC Link is Up 10000 Mbps
  195.  
  196.  
  197. Feb 26 18:33:00 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  198. Feb 26 18:33:00 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  199. Feb 26 18:33:00 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1717])
  200. Feb 26 18:33:00 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 2265317532 (0->2 499/145)
  201. Feb 26 18:33:00 drbd9-01 kernel: drbd r0: State change 2265317532: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA
  202. Feb 26 18:33:00 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 2265317532 (0ms)
  203. Feb 26 18:33:00 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  204. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  205. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  206. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (15F5D43C9A0B7F26) for nodes 3 4
  207. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=3
  208. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have A9F0F625EF8BF07E for node_id=4
  209. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  210. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self 15F5D43C9A0B7F26:0000000000000000:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:0 flags:0
  211. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer 15F5D43C9A0B7F26:0000000000000000:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:100
  212. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=0 by rule 38
  213. Feb 26 18:33:00 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
  214. Feb 26 18:33:24 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4127932492 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  215. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
  216. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  217. Feb 26 18:33:33 drbd9-01 kernel: drbd r0: ASSERTION twopc_parent FAILED in twopc_end_nested
  218. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  219. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  220. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4127932492
  221. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 736373838 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  222. Feb 26 18:33:33 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 736373838
  223. Feb 26 18:33:34 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  224. Feb 26 18:33:34 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2905864915 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  225. Feb 26 18:33:34 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2905864915
  226. Feb 26 18:33:34 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1264025253 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  227. Feb 26 18:33:34 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1264025253
  228. Feb 26 18:33:37 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1696483929 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  229. Feb 26 18:33:37 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1696483929
  230. Feb 26 18:33:42 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3028844404 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  231. Feb 26 18:33:42 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3028844404
  232. Feb 26 18:33:43 drbd9-01 kernel: drbd r0 drbd9-02: sock was shut down by peer
  233. Feb 26 18:33:43 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  234. Feb 26 18:33:43 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  235. Feb 26 18:33:43 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  236. Feb 26 18:33:43 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.21
  237. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  238. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  239. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  240. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [1715])
  241. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> NetworkFailure )
  242. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  243. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  244. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  245. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  246. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  247. Feb 26 18:33:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  248. Feb 26 18:33:45 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  249. Feb 26 18:33:45 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  250. Feb 26 18:33:45 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [1715])
  251. Feb 26 18:33:45 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 202060381 (0->1 499/145)
  252. Feb 26 18:33:45 drbd9-01 kernel: drbd r0: State change 202060381: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  253. Feb 26 18:33:45 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 202060381 (1ms)
  254. Feb 26 18:33:45 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  255. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  256. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: unexpected
  257. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: In UUIDs from node 1 found equal UUID (15F5D43C9A0B7F26) for nodes 3 4
  258. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=3
  259. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=4
  260. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: drbd_sync_handshake:
  261. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self 15F5D43C9A0B7F26:0000000000000000:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:0 flags:0
  262. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer 15F5D43C9A0B7F26:FFFFFFFFFFFFFFFF:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:0
  263. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=0 by rule 38
  264. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1: Becoming sync source due to disk states.
  265. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown -> Outdated ) repl( Off -> WFBitMapS )
  266. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
  267. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
  268. Feb 26 18:33:45 drbd9-01 drbdadm[36983]: Don't know which config file belongs to resource r0, trying default ones...
  269. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source
  270. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  271. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )
  272. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as SyncSource (will sync 0 KB [0 bits set]).
  273. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
  274. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  275. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: unexpected
  276. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: In UUIDs from node 1 found equal UUID (15F5D43C9A0B7F26) for nodes 3 4
  277. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=3
  278. Feb 26 18:33:45 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have A9F0F625EF8BF07E for node_id=4
  279. Feb 26 18:33:46 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3560067254 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  280. Feb 26 18:33:46 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3560067254
  281. Feb 26 18:33:49 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3499444799 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  282. Feb 26 18:33:49 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3499444799
  283. Feb 26 18:33:58 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1499230488 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  284. Feb 26 18:33:58 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1499230488
  285. Feb 26 18:34:05 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1988657507 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  286. Feb 26 18:34:05 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1988657507
  287. Feb 26 18:34:12 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1830613693 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  288. Feb 26 18:34:12 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1830613693
  289. Feb 26 18:34:16 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3472824171 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  290. Feb 26 18:34:16 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3472824171
  291. Feb 26 18:34:23 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2003518388 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  292. Feb 26 18:34:23 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2003518388
  293. Feb 26 18:34:29 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2872586560 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  294. Feb 26 18:34:29 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2872586560
  295. Feb 26 18:34:36 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 192783146 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  296. Feb 26 18:34:36 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 192783146
  297. Feb 26 18:34:43 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3017968589 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  298. Feb 26 18:34:43 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3017968589
  299. Feb 26 18:34:48 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2103455658 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  300. Feb 26 18:34:48 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2103455658
  301. Feb 26 18:34:56 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2170927023 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  302. Feb 26 18:34:56 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2170927023
  303. Feb 26 18:34:57 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1173042560 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  304. Feb 26 18:34:57 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1173042560
  305. Feb 26 18:35:04 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3923345721 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  306. Feb 26 18:35:04 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3923345721
  307. Feb 26 18:35:07 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2962791380 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  308. Feb 26 18:35:07 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2962791380
  309. Feb 26 18:35:12 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2059240641 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  310. Feb 26 18:35:12 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2059240641
  311. Feb 26 18:35:20 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 953230976 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  312. Feb 26 18:35:20 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 953230976
  313. Feb 26 18:35:20 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 516175354 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  314. Feb 26 18:35:20 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 516175354
  315. Feb 26 18:35:28 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3830064125 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  316. Feb 26 18:35:28 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3830064125
  317. Feb 26 18:35:32 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4278418275 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  318. Feb 26 18:35:32 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4278418275
  319. Feb 26 18:35:36 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2587216505 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  320. Feb 26 18:35:36 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2587216505
  321. Feb 26 18:35:42 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2421676245 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  322. Feb 26 18:35:42 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2421676245
  323. Feb 26 18:35:44 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1155148395 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  324. Feb 26 18:35:44 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1155148395
  325. Feb 26 18:35:45 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4236434574 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  326. Feb 26 18:35:45 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4236434574
  327. Feb 26 18:35:47 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1783213420 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  328. Feb 26 18:35:47 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1783213420
  329. Feb 26 18:35:48 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2325110552 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  330. Feb 26 18:35:48 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2325110552
  331. Feb 26 18:35:52 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2216963373 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  332. Feb 26 18:35:52 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2216963373
  333. Feb 26 18:35:53 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1072294531 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  334. Feb 26 18:35:53 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1072294531
  335. Feb 26 18:35:59 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4237505305 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  336. Feb 26 18:35:59 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4237505305
  337. Feb 26 18:36:02 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 271816173 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  338. Feb 26 18:36:02 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 271816173
  339. Feb 26 18:36:08 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2533839464 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  340. Feb 26 18:36:08 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2533839464
  341. Feb 26 18:36:14 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3606934239 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  342. Feb 26 18:36:14 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3606934239
  343. Feb 26 18:36:22 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 983721643 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  344. Feb 26 18:36:22 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 983721643
  345. Feb 26 18:36:24 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 661765498 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  346. Feb 26 18:36:24 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 661765498
  347. Feb 26 18:36:25 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1657392586 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  348. Feb 26 18:36:25 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1657392586
  349. Feb 26 18:36:31 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2357617602 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  350. Feb 26 18:36:31 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2357617602
  351. Feb 26 18:36:33 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 905347632 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  352. Feb 26 18:36:33 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 905347632
  353. Feb 26 18:36:38 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1539036085 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  354. Feb 26 18:36:38 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1539036085
  355. Feb 26 18:36:41 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3407485329 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  356. Feb 26 18:36:41 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3407485329
  357. Feb 26 18:36:47 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 621469889 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  358. Feb 26 18:36:47 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 621469889
  359. Feb 26 18:36:53 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1544542665 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  360. Feb 26 18:36:53 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1544542665
  361. Feb 26 18:37:01 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1806218545 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  362. Feb 26 18:37:01 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1806218545
  363. Feb 26 18:37:06 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2318514728 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  364. Feb 26 18:37:06 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2318514728
  365. Feb 26 18:37:12 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3234375198 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  366. Feb 26 18:37:12 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3234375198
  367. Feb 26 18:37:16 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 975113547 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  368. Feb 26 18:37:16 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 975113547
  369. Feb 26 18:37:17 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3094546250 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  370. Feb 26 18:37:17 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3094546250
  371. Feb 26 18:37:21 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3250393572 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  372. Feb 26 18:37:21 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3250393572
  373. Feb 26 18:37:22 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3661432340 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  374. Feb 26 18:37:22 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3661432340
  375. Feb 26 18:37:28 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2282588060 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  376. Feb 26 18:37:28 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2282588060
  377. Feb 26 18:37:32 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4014327130 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  378. Feb 26 18:37:32 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4014327130
  379. Feb 26 18:37:39 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 571867440 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  380. Feb 26 18:37:39 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 571867440
  381. Feb 26 18:37:43 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3516582956 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  382. Feb 26 18:37:43 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3516582956
  383. Feb 26 18:37:49 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4292968949 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  384. Feb 26 18:37:49 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4292968949
  385. Feb 26 18:37:54 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3935421702 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  386. Feb 26 18:37:54 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3935421702
  387. Feb 26 18:37:57 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1326207274 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  388. Feb 26 18:37:57 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1326207274
  389. Feb 26 18:38:01 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3661155097 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  390. Feb 26 18:38:01 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3661155097
  391. Feb 26 18:38:05 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 104161368 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  392. Feb 26 18:38:05 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 104161368
  393. Feb 26 18:38:07 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 422285090 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  394. Feb 26 18:38:07 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 422285090
  395. Feb 26 18:38:17 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2706459626 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  396. Feb 26 18:38:17 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2706459626
  397. Feb 26 18:38:22 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 519992869 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  398. Feb 26 18:38:22 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 519992869
  399. Feb 26 18:38:26 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 413766697 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  400. Feb 26 18:38:26 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 413766697
  401. Feb 26 18:38:31 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3430510247 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  402. Feb 26 18:38:31 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3430510247
  403. Feb 26 18:38:32 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2266865952 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  404. Feb 26 18:38:32 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2266865952
  405. Feb 26 18:38:39 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2377129242 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  406. Feb 26 18:38:39 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2377129242
  407. Feb 26 18:38:42 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2160023316 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  408. Feb 26 18:38:42 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2160023316
  409. Feb 26 18:38:49 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 571211202 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  410. Feb 26 18:38:49 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 571211202
  411. Feb 26 18:38:56 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1127143557 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  412. Feb 26 18:38:56 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1127143557
  413. Feb 26 18:39:02 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1240761710 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  414. Feb 26 18:39:02 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1240761710
  415. Feb 26 18:39:08 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1675500083 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  416. Feb 26 18:39:08 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1675500083
  417. Feb 26 18:39:17 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2718483551 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  418. Feb 26 18:39:17 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2718483551
  419. Feb 26 18:39:25 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3872798115 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  420. Feb 26 18:39:25 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3872798115
  421. Feb 26 18:39:33 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4016494118 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  422. Feb 26 18:39:33 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4016494118
  423. Feb 26 18:39:33 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2999253673 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  424. Feb 26 18:39:33 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2999253673
  425. Feb 26 18:39:36 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 684281626 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  426. Feb 26 18:39:36 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 684281626
  427. Feb 26 18:39:41 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3108402569 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  428. Feb 26 18:39:41 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3108402569
  429. Feb 26 18:39:44 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2560220061 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  430. Feb 26 18:39:44 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2560220061
  431. Feb 26 18:39:54 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 611248467 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  432. Feb 26 18:39:54 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 611248467
  433. Feb 26 18:39:57 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1532026530 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  434. Feb 26 18:39:57 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1532026530
  435. Feb 26 18:40:01 drbd9-01 systemd: Starting Session 369 of user root.
  436. Feb 26 18:40:01 drbd9-01 systemd: Started Session 369 of user root.
  437. Feb 26 18:40:05 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3086691970 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  438. Feb 26 18:40:05 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3086691970
  439. Feb 26 18:40:12 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 2499805130 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  440. Feb 26 18:40:12 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 2499805130
  441. Feb 26 18:40:16 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1116660183 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  442. Feb 26 18:40:16 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1116660183
  443. Feb 26 18:40:22 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 256981273 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  444. Feb 26 18:40:22 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 256981273
  445. Feb 26 18:40:28 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4278699290 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  446. Feb 26 18:40:28 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 4278699290
  447. Feb 26 18:40:36 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 181018252 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  448. Feb 26 18:40:36 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 181018252
  449. Feb 26 18:40:38 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3960951220 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  450. Feb 26 18:40:38 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3960951220
  451. Feb 26 18:40:39 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 356215126 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  452. Feb 26 18:40:39 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 356215126
  453. Feb 26 18:40:41 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1214575198 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  454. Feb 26 18:40:41 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1214575198
  455. Feb 26 18:40:44 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 3809382274 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  456. Feb 26 18:40:44 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 3809382274
  457. Feb 26 18:40:47 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1067963 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  458. Feb 26 18:40:47 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 1067963
  459. Feb 26 18:40:51 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 164038313 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)
  460. Feb 26 18:40:51 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state change 164038313
RAW Paste Data