Guest User

[CASE-26] Node1 log

a guest
Feb 27th, 2016
96
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. Node1
  2.  
  3. Feb 27 15:18:52 drbd9-01 kernel: drbd: initialized. Version: 9.0.1-1 (api:2/proto:86-111)
  4. Feb 27 15:18:52 drbd9-01 kernel: drbd: GIT-hash: f57acfc22d29a95697e683fb6bbacd9a1ad4348e build by root@drbd9-01, 2016-02-16 17:26:06
  5. Feb 27 15:18:52 drbd9-01 kernel: drbd: registered as block device major 147
  6. Feb 27 15:19:30 drbd9-01 kernel: drbd r0: Starting worker thread (from drbdsetup [6649])
  7. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: disk( Diskless -> Attaching )
  8. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: Maximum number of peer devices = 4
  9. Feb 27 15:19:30 drbd9-01 kernel: drbd r0: Method to ensure write ordering: flush
  10. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  11. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: drbd_bm_resize called with capacity == 9996656
  12. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: resync bitmap: bits=1249582 words=78100 pages=153
  13. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: size = 4881 MB (4998328 KB)
  14. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: recounting of set bits took additional 0ms
  15. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: disk( Attaching -> UpToDate )
  16. Feb 27 15:19:30 drbd9-01 kernel: drbd r0/0 drbd1: attached to current UUID: E22074C65B6BE5A3
  17. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-02: Starting sender thread (from drbdsetup [6660])
  18. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-03: Starting sender thread (from drbdsetup [6666])
  19. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-04: Starting sender thread (from drbdsetup [6669])
  20. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-05: Starting sender thread (from drbdsetup [6672])
  21. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-02: conn( StandAlone -> Unconnected )
  22. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-02: Starting receiver thread (from drbd_w_r0 [6650])
  23. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-03: conn( StandAlone -> Unconnected )
  24. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-03: Starting receiver thread (from drbd_w_r0 [6650])
  25. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  26. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-04: conn( StandAlone -> Unconnected )
  27. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-04: Starting receiver thread (from drbd_w_r0 [6650])
  28. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  29. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-05: conn( StandAlone -> Unconnected )
  30. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-05: Starting receiver thread (from drbd_w_r0 [6650])
  31. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-04: conn( Unconnected -> Connecting )
  32. Feb 27 15:19:31 drbd9-01 kernel: drbd r0 drbd9-05: conn( Unconnected -> Connecting )
  33. Feb 27 15:19:31 drbd9-01 dbus-daemon: dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  34. Feb 27 15:19:31 drbd9-01 dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  35. Feb 27 15:19:31 drbd9-01 systemd: Starting Hostname Service...
  36. Feb 27 15:19:31 drbd9-01 dbus-daemon: dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  37. Feb 27 15:19:31 drbd9-01 dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  38. Feb 27 15:19:31 drbd9-01 systemd: Started Hostname Service.
  39. Feb 27 15:20:01 drbd9-01 systemd: Starting Session 30 of user root.
  40. Feb 27 15:20:01 drbd9-01 systemd: Started Session 30 of user root.
  41. Feb 27 15:20:03 drbd9-01 kernel: drbd r0 tcp:drbd9-02: Receiver busy; rejecting incoming connection
  42. Feb 27 15:20:08 drbd9-01 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
  43. Feb 27 15:20:08 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  44. Feb 27 15:20:08 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  45. Feb 27 15:20:08 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  46. Feb 27 15:20:09 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  47. Feb 27 15:20:16 drbd9-01 kernel: drbd r0 drbd9-02: sock was shut down by peer
  48. Feb 27 15:20:16 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  49. Feb 27 15:20:16 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  50. Feb 27 15:20:16 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  51. Feb 27 15:20:16 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.21
  52. Feb 27 15:20:17 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  53. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  54. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  55. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  56. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> NetworkFailure )
  57. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  58. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  59. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  60. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  61. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  62. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  63. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  64. Feb 27 15:20:18 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet M crossed
  65. Feb 27 15:20:19 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  66. Feb 27 15:20:19 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet M crossed
  67. Feb 27 15:20:20 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  68. Feb 27 15:20:20 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  69. Feb 27 15:20:20 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  70. Feb 27 15:20:20 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 1141787372 (0->1 499/146)
  71. Feb 27 15:20:20 drbd9-01 kernel: drbd r0: State change 1141787372: primary_nodes=0, weak_nodes=0
  72. Feb 27 15:20:20 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 1141787372 (0ms)
  73. Feb 27 15:20:20 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  74. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  75. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1: Node 3 (drbd9-04) synced up to node 1 (drbd9-02). copying bitmap slot 0 to 2.
  76. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1: Node 4 (drbd9-05) synced up to node 1 (drbd9-02). copying bitmap slot 0 to 3.
  77. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: drbd_sync_handshake:
  78. Feb 27 15:20:20 drbd9-01 drbdadm[6715]: Don't know which config file belongs to resource r0, trying default ones...
  79. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self E22074C65B6BE5A2:15F5D43C9A0B7F26:351C9E61C6B06FB6:A9F0F625EF8BF07E bits:3072 flags:0
  80. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer 15F5D43C9A0B7F26:FFFFFFFFFFFFFFFF:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:20
  81. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=2 by rule 70
  82. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown -> Consistent ) repl( Off -> WFBitMapS )
  83. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0%
  84. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Consistent -> Outdated )
  85. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0%
  86. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source
  87. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  88. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )
  89. Feb 27 15:20:20 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as SyncSource (will sync 12288 KB [3072 bits set]).
  90. Feb 27 15:20:26 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: updated UUIDs E22074C65B6BE5A2:0000000000000000:15F5D43C9A0B7F26:351C9E61C6B06FB6
  91. Feb 27 15:20:26 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Resync done (total 5 sec; paused 0 sec; 2456 K/sec)
  92. Feb 27 15:20:26 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  93. Feb 27 15:20:27 drbd9-01 kernel: drbd r0 drbd9-03: sock_recvmsg returned -11
  94. Feb 27 15:20:27 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  95. Feb 27 15:20:27 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  96. Feb 27 15:20:27 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  97. Feb 27 15:20:28 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  98. Feb 27 15:20:33 drbd9-01 kernel: drbd r0 drbd9-03: sock was reset by peer
  99. Feb 27 15:20:33 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  100. Feb 27 15:20:33 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  101. Feb 27 15:20:33 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  102. Feb 27 15:20:33 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.31
  103. Feb 27 15:20:34 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  104. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  105. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  106. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [6679])
  107. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> NetworkFailure )
  108. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  109. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  110. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  111. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  112. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  113. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  114. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  115. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  116. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [6679])
  117. Feb 27 15:20:35 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 1560647561 (0->2 499/146)
  118. Feb 27 15:20:35 drbd9-01 kernel: drbd r0: State change 1560647561: primary_nodes=0, weak_nodes=0
  119. Feb 27 15:20:35 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 1560647561 (2ms)
  120. Feb 27 15:20:35 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  121. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  122. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  123. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self E22074C65B6BE5A2:15F5D43C9A0B7F26:15F5D43C9A0B7F26:351C9E61C6B06FB6 bits:3072 flags:0
  124. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer 15F5D43C9A0B7F26:FFFFFFFFFFFFFFFF:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:20
  125. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=2 by rule 70
  126. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> Consistent ) repl( Off -> WFBitMapS )
  127. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0%
  128. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Consistent -> Outdated )
  129. Feb 27 15:20:35 drbd9-01 drbdadm[6730]: Don't know which config file belongs to resource r0, trying default ones...
  130. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0%
  131. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source
  132. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  133. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )
  134. Feb 27 15:20:35 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Began resync as SyncSource (will sync 12288 KB [3072 bits set]).
  135. Feb 27 15:20:41 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: updated UUIDs E22074C65B6BE5A2:0000000000000000:15F5D43C9A0B7F26:351C9E61C6B06FB6
  136. Feb 27 15:20:41 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Resync done (total 5 sec; paused 0 sec; 2456 K/sec)
  137. Feb 27 15:20:41 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  138. Feb 27 15:20:44 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 1633789795 (primary_nodes=0, weak_nodes=0)
  139. Feb 27 15:20:44 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 1633789795
  140. Feb 27 15:21:00 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 403447232 (0->-1 3/1)
  141. Feb 27 15:21:00 drbd9-01 kernel: drbd r0: State change 403447232: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  142. Feb 27 15:21:00 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 403447232 (1ms)
  143.  
  144. !!! Primary
  145.  
  146. Feb 27 15:21:00 drbd9-01 kernel: drbd r0: role( Secondary -> Primary )
  147.  
  148.  
  149. !!!! mount
  150.  
  151.  
  152. Feb 27 15:21:06 drbd9-01 kernel: EXT4-fs (drbd1): mounting ext3 file system using the ext4 subsystem
  153. Feb 27 15:21:06 drbd9-01 kernel: EXT4-fs (drbd1): mounted filesystem with ordered data mode. Opts: (null)
  154. Feb 27 15:22:01 drbd9-01 kernel: vmxnet3 0000:04:00.0 eth1: NIC Link is Up 10000 Mbps
  155. Feb 27 15:22:01 drbd9-01 kernel: vmxnet3 0000:04:00.0 eth1: NIC Link is Up 10000 Mbps
  156. Feb 27 15:22:30 drbd9-01 gnome-session: ** (gnome-system-monitor:6809): WARNING **: SELinux was found but is not enabled.
  157. Feb 27 15:28:58 drbd9-01 dbus-daemon: dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  158. Feb 27 15:28:58 drbd9-01 dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  159. Feb 27 15:28:58 drbd9-01 systemd: Starting Hostname Service...
  160. Feb 27 15:28:58 drbd9-01 dbus-daemon: dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  161. Feb 27 15:28:58 drbd9-01 dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  162. Feb 27 15:28:58 drbd9-01 systemd: Started Hostname Service.
  163. Feb 27 15:29:17 drbd9-01 gnome-session: (gnome-settings-daemon:2394): color-plugin-WARNING **: unable to get EDID for xrandr-Virtual1: unable to get EDID for output
  164. Feb 27 15:30:01 drbd9-01 systemd: Starting Session 31 of user root.
  165. Feb 27 15:30:01 drbd9-01 systemd: Started Session 31 of user root.
  166. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 3209941343 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  167. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 3209941343
  168. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connected -> TearDown ) peer( Secondary -> Unknown )
  169. Feb 27 15:30:38 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  170. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  171. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  172. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 tcp:drbd9-02: dtt_send_page: size=4096 len=3232 sent=-32
  173. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1027644695 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  174. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 1027644695
  175. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  176. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: conn( TearDown -> Unconnected )
  177. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  178. Feb 27 15:30:38 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  179. Feb 27 15:30:39 drbd9-01 kernel: drbd r0/0 drbd1: new current UUID: 0919D9953F1BDA47 weak: FFFFFFFFFFFFFFFA
  180. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1213429059 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE)
  181. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 1213429059
  182. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connected -> TearDown ) peer( Secondary -> Unknown )
  183. Feb 27 15:30:43 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  184. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  185. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  186. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 tcp:drbd9-03: dtt_send_page: size=4096 len=416 sent=-32
  187. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  188. Feb 27 15:30:43 drbd9-01 kernel: drbd r0/0 drbd1: new current UUID: 4784B438C8271CE9 weak: FFFFFFFFFFFFFFFE
  189. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( TearDown -> Unconnected )
  190. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  191. Feb 27 15:30:43 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  192. Feb 27 15:30:52 drbd9-01 kernel: drbd r0 drbd9-03: sock_recvmsg returned -11
  193. Feb 27 15:30:52 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> BrokenPipe )
  194. Feb 27 15:30:52 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  195. Feb 27 15:30:52 drbd9-01 kernel: drbd r0 drbd9-03: conn( BrokenPipe -> Unconnected )
  196. Feb 27 15:30:53 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  197. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  198. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  199. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [6679])
  200. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> NetworkFailure )
  201. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
  202. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  203. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
  204. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  205. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: Restarting receiver thread
  206. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  207. Feb 27 15:30:59 drbd9-01 kernel: drbd r0 tcp:drbd9-03: initial packet S crossed
  208. Feb 27 15:31:08 drbd9-01 kernel: drbd r0 tcp:drbd9-03: initial packet M crossed
  209. Feb 27 15:31:09 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  210. Feb 27 15:31:09 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  211. Feb 27 15:31:09 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [6679])
  212. Feb 27 15:31:10 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 2217952973 (0->2 499/145)
  213. Feb 27 15:31:10 drbd9-01 kernel: drbd r0: State change 2217952973: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA
  214. Feb 27 15:31:10 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 2217952973 (1ms)
  215. Feb 27 15:31:10 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  216. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  217. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  218. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self 4784B438C8271CE9:0919D9953F1BDA47:15F5D43C9A0B7F26:351C9E61C6B06FB6 bits:194628 flags:0
  219. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer 0919D9953F1BDA46:FFFFFFFFFFFFFFFF:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:0
  220. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=2 by rule 70
  221. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> Outdated ) repl( Off -> WFBitMapS )
  222. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 87(1), total 87; compression: 100.0%
  223. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 87(1), total 87; compression: 100.0%
  224. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source
  225. Feb 27 15:31:10 drbd9-01 drbdadm[6997]: Don't know which config file belongs to resource r0, trying default ones...
  226. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  227. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )
  228. Feb 27 15:31:10 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Began resync as SyncSource (will sync 778512 KB [194628 bits set]).
  229. Feb 27 15:31:41 drbd9-01 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
  230. Feb 27 15:31:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  231. Feb 27 15:31:41 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  232. Feb 27 15:31:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  233. Feb 27 15:31:42 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  234. Feb 27 15:31:51 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 1430478748 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  235. Feb 27 15:31:51 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 1430478748
  236. Feb 27 15:31:51 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  237. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  238. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  239. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  240. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> NetworkFailure )
  241. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  242. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  243. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  244. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  245. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  246. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  247. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  248. Feb 27 15:31:52 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet M crossed
  249. Feb 27 15:31:53 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  250. Feb 27 15:31:53 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  251. Feb 27 15:31:53 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  252. Feb 27 15:31:54 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 726597188 (0->1 499/145)
  253. Feb 27 15:31:54 drbd9-01 kernel: drbd r0: State change 726597188: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  254. Feb 27 15:31:54 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 726597188 (3ms)
  255. Feb 27 15:31:54 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  256. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  257. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: drbd_sync_handshake:
  258. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self 4784B438C8271CE9:E22074C65B6BE5A2:15F5D43C9A0B7F26:351C9E61C6B06FB6 bits:216629 flags:0
  259. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer E22074C65B6BE5A2:0000000000000000:15F5D43C9A0B7F26:0000000000000000 bits:0 flags:104
  260. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=2 by rule 70
  261. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown -> Inconsistent ) repl( Off -> WFBitMapS )
  262. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 149(1), total 149; compression: 100.0%
  263. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 149(1), total 149; compression: 100.0%
  264. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source
  265. Feb 27 15:31:54 drbd9-01 drbdadm[7027]: Don't know which config file belongs to resource r0, trying default ones...
  266. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  267. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl( WFBitMapS -> SyncSource )
  268. Feb 27 15:31:54 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as SyncSource (will sync 866516 KB [216629 bits set]).
  269. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state change 68598278 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  270. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 drbd9-02: Committing remote state change 68598278
  271. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connected -> TearDown ) peer( Secondary -> Unknown )
  272. Feb 27 15:32:28 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl( SyncSource -> Off )
  273. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  274. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  275. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 tcp:drbd9-02: dtt_send_page: size=4096 len=840 sent=-32
  276. Feb 27 15:32:28 drbd9-01 kernel: drbd r0 tcp:drbd9-02: dtt_send_page: size=40 len=40 sent=-32
  277. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4108599517 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  278. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 4108599517
  279. Feb 27 15:32:29 drbd9-01 kernel: drbd r0/0 drbd1: ASSERTION list_empty(&device->read_ee) FAILED in drbd_disconnected
  280. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  281. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-02: conn( TearDown -> Unconnected )
  282. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  283. Feb 27 15:32:29 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  284. Feb 27 15:32:33 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4150891090 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  285. Feb 27 15:32:34 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 4150891090
  286. Feb 27 15:32:35 drbd9-01 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
  287. Feb 27 15:32:35 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  288. Feb 27 15:32:35 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  289. Feb 27 15:32:35 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  290. Feb 27 15:32:36 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  291. Feb 27 15:32:45 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  292. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  293. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  294. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  295. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> NetworkFailure )
  296. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  297. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  298. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  299. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  300. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  301. Feb 27 15:32:46 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  302. Feb 27 15:32:47 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S crossed
  303. Feb 27 15:32:48 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  304. Feb 27 15:32:48 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  305. Feb 27 15:32:48 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  306. Feb 27 15:33:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 56227800 (0->1 499/145)
  307. Feb 27 15:33:16 drbd9-01 kernel: drbd r0: State change 56227800: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  308. Feb 27 15:33:16 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 56227800 (27867ms)
  309. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  310. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: meta connection shut down by peer.
  311. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown )
  312. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  313. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  314. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: sock was shut down by peer
  315. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  316. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  317. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  318. Feb 27 15:33:40 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  319. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: updated UUIDs 4784B438C8271CE9:0000000000000000:0919D9953F1BDA46:15F5D43C9A0B7F26
  320. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  321. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (919D9953F1BDA46) for nodes 1 3
  322. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have E22074C65B6BE5A2 for node_id=1
  323. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have 15F5D43C9A0B7F26 for node_id=3
  324. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Resync done (total 210 sec; paused 0 sec; 3704 K/sec)
  325. Feb 27 15:34:40 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )
  326. Feb 27 15:38:31 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 965909546 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  327. Feb 27 15:38:31 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 965909546
  328. Feb 27 15:38:40 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state change 4129867644 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFA)
  329. Feb 27 15:38:40 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state change 4129867644
  330. Feb 27 15:38:42 drbd9-01 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
  331. Feb 27 15:38:42 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  332. Feb 27 15:38:42 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  333. Feb 27 15:38:42 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  334. Feb 27 15:38:43 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  335. Feb 27 15:38:49 drbd9-01 kernel: drbd r0 drbd9-02: sock was shut down by peer
  336. Feb 27 15:38:49 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> BrokenPipe )
  337. Feb 27 15:38:49 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  338. Feb 27 15:38:49 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe -> Unconnected )
  339. Feb 27 15:38:49 drbd9-01 kernel: drbd r0 tcp:drbd9-05: Closing unexpected connection from 100.100.10.21
  340. Feb 27 15:38:50 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  341. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  342. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  343. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  344. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> NetworkFailure )
  345. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
  346. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv thread
  347. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
  348. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure -> Unconnected )
  349. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver thread
  350. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected -> Connecting )
  351. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful: Agreed network protocol version 111
  352. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  353. Feb 27 15:38:51 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread (from drbd_r_r0 [6677])
  354. Feb 27 15:38:52 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 498620098 (0->1 499/145)
  355. Feb 27 15:38:52 drbd9-01 kernel: drbd r0: State change 498620098: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8
  356. Feb 27 15:38:52 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 498620098 (1ms)
  357. Feb 27 15:38:52 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
  358. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support WRITE_SAME
  359. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: drbd_sync_handshake:
  360. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self 4784B438C8271CE9:E22074C65B6BE5A2:0919D9953F1BDA46:15F5D43C9A0B7F26 bits:340829 flags:0
  361. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer E22074C65B6BE5A2:FFFFFFFFFFFFFFFF:15F5D43C9A0B7F26:0000000000000000 bits:162107 flags:4
  362. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=2 by rule 70
  363. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl( Off -> WFBitMapS ) resync-susp( no -> peer )
  364. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 148(1), total 148; compression: 100.0%
  365. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 130(1), total 130; compression: 100.0%
  366. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source
  367. Feb 27 15:38:52 drbd9-01 drbdadm[7236]: Don't know which config file belongs to resource r0, trying default ones...
  368. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)
  369. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl( WFBitMapS -> PausedSyncS )
  370. Feb 27 15:38:52 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as PausedSyncS (will sync 1413312 KB [353328 bits set]).
  371. Feb 27 15:40:01 drbd9-01 systemd: Starting Session 32 of user root.
  372. Feb 27 15:40:01 drbd9-01 systemd: Started Session 32 of user root.
  373. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: unexpected
  374. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: In UUIDs from node 2 found equal UUID (919D9953F1BDA46) for nodes 3 4
  375. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have 15F5D43C9A0B7F26 for node_id=3
  376. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: I have 15F5D43C9A0B7F26 for node_id=4
  377. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Resync done (total 115 sec; paused 0 sec; 12288 K/sec)
  378. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate ) repl( PausedSyncS -> Established )
  379. Feb 27 15:40:47 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: resync-susp( peer -> no )
  380. Feb 27 15:46:14 drbd9-01 dbus-daemon: dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  381. Feb 27 15:46:14 drbd9-01 dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  382. Feb 27 15:46:14 drbd9-01 systemd: Starting Hostname Service...
  383. Feb 27 15:46:14 drbd9-01 dbus-daemon: dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  384. Feb 27 15:46:14 drbd9-01 dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  385. Feb 27 15:46:14 drbd9-01 systemd: Started Hostname Service.
  386. Feb 27 15:50:01 drbd9-01 systemd: Starting Session 33 of user root.
  387. Feb 27 15:50:01 drbd9-01 systemd: Started Session 33 of user root.
  388. Feb 27 16:00:01 drbd9-01 systemd: Starting Session 34 of user root.
  389. Feb 27 16:00:01 drbd9-01 systemd: Started Session 34 of user root.
  390. Feb 27 16:01:01 drbd9-01 systemd: Starting Session 35 of user root.
  391. Feb 27 16:01:01 drbd9-01 systemd: Started Session 35 of user root.
  392. Feb 27 16:10:01 drbd9-01 systemd: Starting Session 36 of user root.
  393. Feb 27 16:10:01 drbd9-01 systemd: Started Session 36 of user root.
  394. Feb 27 16:10:29 drbd9-01 dbus-daemon: dbus[944]: [system] Activating via systemd: service name='net.reactivated.Fprint' unit='fprintd.service'
  395. Feb 27 16:10:29 drbd9-01 dbus[944]: [system] Activating via systemd: service name='net.reactivated.Fprint' unit='fprintd.service'
  396. Feb 27 16:10:29 drbd9-01 systemd: Starting Fingerprint Authentication Daemon...
  397. Feb 27 16:10:29 drbd9-01 dbus-daemon: dbus[944]: [system] Successfully activated service 'net.reactivated.Fprint'
  398. Feb 27 16:10:29 drbd9-01 dbus[944]: [system] Successfully activated service 'net.reactivated.Fprint'
  399. Feb 27 16:10:29 drbd9-01 systemd: Started Fingerprint Authentication Daemon.
  400. Feb 27 16:10:29 drbd9-01 fprintd: Launching FprintObject
  401. Feb 27 16:10:29 drbd9-01 fprintd: ** Message: D-Bus service launched with name: net.reactivated.Fprint
  402. Feb 27 16:10:29 drbd9-01 fprintd: ** Message: entering main loop
  403. Feb 27 16:10:29 drbd9-01 dbus-daemon: dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  404. Feb 27 16:10:29 drbd9-01 dbus[944]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  405. Feb 27 16:10:29 drbd9-01 systemd: Starting Hostname Service...
  406. Feb 27 16:10:29 drbd9-01 dbus-daemon: dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  407. Feb 27 16:10:29 drbd9-01 dbus[944]: [system] Successfully activated service 'org.freedesktop.hostname1'
  408. Feb 27 16:10:29 drbd9-01 systemd: Started Hostname Service.
RAW Paste Data