Guest User

[CASE-41] ahead_secondary.txt

a guest
Apr 20th, 2016
91
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.88 KB | None | 0 0
  1. version: 9.0.2-1 (api:2/proto:86-111)
  2. GIT-hash: bdcc2a765a9a80c8b263c011a6508cb6e0c3e4d2 build by root@drbd9-04, 2016-04-20 17:38:59
  3. Transports (api:14): tcp (1.0.0)
  4.  
  5.  
  6. [root@drbd9-04 ~]# tail -f /var/log/messages | grep "drbd"
  7. Apr 20 18:21:28 drbd9-04 systemd: Started Hostname Service.
  8. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: PingAck did not arrive in time.
  9. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: conn( Connected -> NetworkFailure ) peer( Primary -> Unknown )
  10. Apr 20 18:21:36 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> DUnknown ) repl( Behind -> Off )
  11. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: ack_receiver terminated
  12. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  13. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: Connection closed
  14. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: conn( NetworkFailure -> Unconnected )
  15. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: Restarting receiver thread
  16. Apr 20 18:21:36 drbd9-04 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  17. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  18. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  19. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [1691])
  20. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state change 3573631356 (primary_nodes=0, weak_nodes=0)
  21. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: Committing remote state change 3573631356
  22. Apr 20 18:21:42 drbd9-04 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Primary )
  23. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  24. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: self 4603B73BD0E1AF68:0000000000000000:D569D49A8856B904:1C0061DB90E19FE0 bits:138759 flags:0
  25. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: peer 4603B73BD0E1AF69:0000000000000000:D569D49A8856B904:919E3AB15C33EA8C bits:168335 flags:120
  26. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=0 by rule 38
  27. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1: Becoming sync target due to disk states.
  28. Apr 20 18:21:42 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT )
  29. Apr 20 18:26:49 drbd9-04 dbus-daemon: dbus[920]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  30. Apr 20 18:26:49 drbd9-04 dbus[920]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  31. Apr 20 18:26:49 drbd9-04 systemd: Starting Hostname Service...
  32. Apr 20 18:26:49 drbd9-04 dbus-daemon: dbus[920]: [system] Successfully activated service 'org.freedesktop.hostname1'
  33. Apr 20 18:26:49 drbd9-04 dbus[920]: [system] Successfully activated service 'org.freedesktop.hostname1'
  34. Apr 20 18:26:49 drbd9-04 systemd: Started Hostname Service.
  35. Apr 20 18:28:20 drbd9-04 systemd: Starting Cleanup of Temporary Directories...
  36. Apr 20 18:28:20 drbd9-04 systemd: Started Cleanup of Temporary Directories.
  37. Apr 20 18:30:01 drbd9-04 systemd: Starting Session 4 of user root.
  38. Apr 20 18:30:01 drbd9-04 systemd: Started Session 4 of user root.
  39. Apr 20 18:30:50 drbd9-04 kernel: drbd r0: Preparing cluster-wide state change 1677017691 (1->0 496/16)
  40. Apr 20 18:30:50 drbd9-04 kernel: drbd r0: State change 1677017691: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFE
  41. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: Cluster is now split
  42. Apr 20 18:30:50 drbd9-04 kernel: drbd r0: Committing cluster-wide state change 1677017691 (0ms)
  43. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: conn( Connected -> Disconnecting ) peer( Primary -> Unknown )
  44. Apr 20 18:30:50 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate -> DUnknown ) repl( WFBitMapT -> Off )
  45. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: ack_receiver terminated
  46. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: Terminating ack_recv thread
  47. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: Connection closed
  48. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: conn( Disconnecting -> StandAlone )
  49. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: Terminating receiver thread
  50. Apr 20 18:30:50 drbd9-04 kernel: drbd r0 drbd9-03: Terminating sender thread
  51. Apr 20 18:30:50 drbd9-04 kernel: drbd r0/0 drbd1: disk( Inconsistent -> Detaching )
  52. Apr 20 18:30:50 drbd9-04 kernel: drbd r0/0 drbd1: disk( Detaching -> Diskless )
  53. Apr 20 18:30:50 drbd9-04 kernel: drbd r0/0 drbd1: drbd_bm_resize called with capacity == 0
  54. Apr 20 18:30:50 drbd9-04 kernel: drbd r0: Terminating worker thread
  55. Apr 20 18:31:02 drbd9-04 kernel: drbd r0: Starting worker thread (from drbdsetup [3061])
  56. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: disk( Diskless -> Attaching )
  57. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: Maximum number of peer devices = 1
  58. Apr 20 18:31:02 drbd9-04 kernel: drbd r0: Method to ensure write ordering: flush
  59. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: Adjusting my ra_pages to backing device's (32 -> 1024)
  60. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: drbd_bm_resize called with capacity == 9997568
  61. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: resync bitmap: bits=1249696 words=19527 pages=39
  62. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: size = 4882 MB (4998784 KB)
  63. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: recounting of set bits took additional 0ms
  64. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: disk( Attaching -> Inconsistent )
  65. Apr 20 18:31:02 drbd9-04 kernel: drbd r0/0 drbd1: attached to current UUID: 4603B73BD0E1AF68
  66. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: Starting sender thread (from drbdsetup [3071])
  67. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: conn( StandAlone -> Unconnected )
  68. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: Starting receiver thread (from drbd_w_r0 [3062])
  69. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: conn( Unconnected -> Connecting )
  70. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: Handshake successful: Agreed network protocol version 111
  71. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: Feature flags enabled on protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
  72. Apr 20 18:31:02 drbd9-04 kernel: drbd r0 drbd9-03: Starting ack_recv thread (from drbd_r_r0 [3077])
  73. Apr 20 18:31:03 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state change 3341379820 (primary_nodes=0, weak_nodes=0)
  74. Apr 20 18:31:03 drbd9-04 kernel: drbd r0 drbd9-03: Committing remote state change 3341379820
  75. Apr 20 18:31:03 drbd9-04 kernel: drbd r0 drbd9-03: conn( Connecting -> Connected ) peer( Unknown -> Primary )
  76. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: drbd_sync_handshake:
  77. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: self 4603B73BD0E1AF68:0000000000000000:D569D49A8856B904:1C0061DB90E19FE0 bits:138759 flags:0
  78. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: peer 4603B73BD0E1AF69:0000000000000000:D569D49A8856B904:919E3AB15C33EA8C bits:642367 flags:120
  79. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: uuid_compare()=0 by rule 38
  80. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: Becoming sync target due to disk states.
  81. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT )
  82. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 117(1), total 117; compression: 100.0%
  83. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 117(1), total 117; compression: 100.0%
  84. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-target
  85. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: helper command: /sbin/drbdadm before-resync-target exit code 0 (0x0)
  86. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: repl( WFBitMapT -> SyncTarget )
  87. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: Began resync as SyncTarget (will sync 2572796 KB [643199 bits set]).
  88. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  89. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  90. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  91. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  92. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  93. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  94. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  95. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  96. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  97. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  98. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  99. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  100. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  101. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  102. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  103. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  104. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  105. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  106. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  107. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  108. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  109. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  110. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  111. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  112. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1: ASSERT FAILED cstate = SyncTarget, expected: WFSyncUUID|WFBitMapT|Behind
  113. Apr 20 18:31:03 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: repl( SyncTarget -> Behind )
  114. Apr 20 18:36:47 drbd9-04 dbus-daemon: dbus[920]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  115. Apr 20 18:36:47 drbd9-04 dbus[920]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
  116. Apr 20 18:36:47 drbd9-04 systemd: Starting Hostname Service...
  117. Apr 20 18:36:47 drbd9-04 dbus-daemon: dbus[920]: [system] Successfully activated service 'org.freedesktop.hostname1'
  118. Apr 20 18:36:47 drbd9-04 dbus[920]: [system] Successfully activated service 'org.freedesktop.hostname1'
  119. Apr 20 18:36:47 drbd9-04 systemd: Started Hostname Service.
Add Comment
Please, Sign In to add comment