API tools faq
paste
Advertisement
digimer

Untitled

digimer
Jan 17th, 2021
98
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.44 KB | None | 0 0
raw download clone embed print report
  1. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: PingAck did not arrive in time.
  2. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: conn( Connected -> NetworkFailure ) peer( Primary -> Unknown )
  3. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test/0 drbd0: disk( UpToDate -> Consistent )
  4. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test/0 drbd0 el8-a01n01: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
  5. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: ack_receiver terminated
  6. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: Terminating ack_recv thread
  7. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Preparing cluster-wide state change 4192485936 (1->-1 0/0)
  8. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Committing cluster-wide state change 4192485936 (0ms)
  9. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test/0 drbd0: disk( Consistent -> UpToDate )
  10. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: Restarting sender thread
  11. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: Connection closed
  12. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: helper command: /sbin/drbdadm disconnected
  13. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: helper command: /sbin/drbdadm disconnected exit code 0
  14. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: conn( NetworkFailure -> Unconnected )
  15. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: Restarting receiver thread
  16. Jan 18 02:04:05 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: conn( Unconnected -> Connecting )
  17. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Node el8-a01n01 state is now member
  18. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Node el8-a01n01 state is now member
  19. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-based[490045]: notice: Node el8-a01n01 state is now member
  20. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: State transition S_IDLE -> S_INTEGRATION
  21. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-attrd[490048]: notice: Node el8-a01n01 state is now member
  22. Jan 18 02:11:52 el8-a01n02.alteeve.ca pacemaker-attrd[490048]: notice: Setting #attrd-protocol[el8-a01n01]: (unset) -> 2
  23. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-schedulerd[490049]: notice: * Move virsh_node2_pulsar ( el8-a01n02 -> el8-a01n01 )
  24. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-schedulerd[490049]: notice: Calculated transition 65, saving inputs in /var/lib/pacemaker/pengine/pe-input-105.bz2
  25. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating monitor operation virsh_node1_pulsar_monitor_0 on el8-a01n01
  26. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating stop operation virsh_node2_pulsar_stop_0 locally on el8-a01n02
  27. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating monitor operation virsh_node2_pulsar_monitor_0 on el8-a01n01
  28. Jan 18 02:11:54 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Result of stop operation for virsh_node2_pulsar on el8-a01n02: ok
  29. Jan 18 02:11:55 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating start operation virsh_node2_pulsar_start_0 on el8-a01n01
  30. Jan 18 02:11:55 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating monitor operation virsh_node2_pulsar_monitor_60000 on el8-a01n01
  31. Jan 18 02:11:56 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Transition 65 (Complete=5, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-105.bz2): Complete
  32. Jan 18 02:11:56 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE
  33. Jan 18 02:23:20 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: helper command: /sbin/drbdadm fence-peer
  34. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653232]: 115; DRBD pacemaker's stonith handler invoked.
  35. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653234]: 125; DRBD Environment variable: [DRBD_NODE_ID_0] -> [el8-a01n01]
  36. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653236]: 125; DRBD Environment variable: [DRBD_NODE_ID_1] -> [el8-a01n02]
  37. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653239]: 133; DRBD Environment variable: [DRBD_MINOR] -> [0]
  38. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653242]: 133; DRBD Environment variable: [DRBD_MY_NODE_ID] -> [1]
  39. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653244]: 133; DRBD Environment variable: [DRBD_NODE_ID_0] -> [el8-a01n01]
  40. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653246]: 133; DRBD Environment variable: [DRBD_NODE_ID_1] -> [el8-a01n02]
  41. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653248]: 133; DRBD Environment variable: [DRBD_PEER_ADDRESS] -> [10.101.10.1]
  42. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653251]: 133; DRBD Environment variable: [DRBD_PEER_AF] -> [ipv4]
  43. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653255]: 133; DRBD Environment variable: [DRBD_PEER_NODE_ID] -> [0]
  44. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653258]: 133; DRBD Environment variable: [DRBD_RESOURCE] -> [srv01-test]
  45. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653261]: 263; Calling: [/usr/bin/getent hosts 10.101.10.1]
  46. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653267]: 270; Output: [10.101.10.1 el8-a01n01.sn1]
  47. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653269]: 274; >> target_host: [el8-a01n01.sn1]
  48. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653271]: 278; << target_host: [el8-a01n01]
  49. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653274]: 284; Return code: [0]
  50. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653277]: 305; Found the pacemaker name of the target node: [el8-a01n01]
  51. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653279]: 327; quorate: [1]
  52. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653281]: 343; Checking the status of target node: [el8-a01n01].
  53. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653283]: 352; The node: [el8-a01n01] is: [member/member] (join/expected). Proceeding with the fence action.
  54. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653285]: 179; Calling: [/usr/sbin/drbdadm status all]
  55. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653289]: 213; local_dstate: [UpToDate]
  56. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653291]: 238; Return code: [0]
  57. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653293]: 241; local_all_uptodate: [1], peer_all_uptodate: [1]
  58. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653295]: 155; Ready to fence: [el8-a01n01]
  59. Jan 18 02:23:20 el8-a01n02.alteeve.ca fence_pacemaker[653297]: 547; Calling: [/usr/sbin/stonith_admin --fence el8-a01n01 --verbose; RC=0; /usr/sbin/crm_error ; /usr/bin/echo rc:]
  60. Jan 18 02:23:20 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Client stonith_admin.653299.04e4c337 wants to fence (off) 'el8-a01n01' with device '(any)'
  61. Jan 18 02:23:20 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Requesting peer fencing (off) targeting el8-a01n01
  62. Jan 18 02:23:20 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: virsh_node2_pulsar is not eligible to fence (off) el8-a01n01: static-list
  63. Jan 18 02:23:20 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: virsh_node1_pulsar is eligible to fence (off) el8-a01n01: static-list
  64. Jan 18 02:23:20 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Requesting that el8-a01n02 perform 'off' action targeting el8-a01n01 using 'virsh_node1_pulsar'
  65. Jan 18 02:23:22 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Operation 'off' [653300] (call 2 from stonith_admin.653299) for host 'el8-a01n01' with device 'virsh_node1_pulsar' returned: 0 (OK)
  66. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-based[490045]: notice: Node el8-a01n01 state is now lost
  67. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-based[490045]: notice: Purged 1 peer with id=1 and/or uname=el8-a01n01 from the membership cache
  68. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-attrd[490048]: notice: Node el8-a01n01 state is now lost
  69. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-attrd[490048]: notice: Removing all el8-a01n01 attributes for peer loss
  70. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-attrd[490048]: notice: Purged 1 peer with id=1 and/or uname=el8-a01n01 from the membership cache
  71. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Node el8-a01n01 state is now lost
  72. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-controld[490050]: warning: Stonith/shutdown of node el8-a01n01 was not expected
  73. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: State transition S_IDLE -> S_POLICY_ENGINE
  74. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-controld[490050]: warning: Stonith/shutdown of node el8-a01n01 was not expected
  75. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Node el8-a01n01 state is now lost
  76. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Purged 1 peer with id=1 and/or uname=el8-a01n01 from the membership cache
  77. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Action 'off' targeting el8-a01n01 using virsh_node1_pulsar on behalf of stonith_admin.653299@el8-a01n02: OK
  78. Jan 18 02:23:23 el8-a01n02.alteeve.ca pacemaker-fenced[490046]: notice: Operation 'off' targeting el8-a01n01 on el8-a01n02 for stonith_admin.653299@el8-a01n02.4e47fbd8: OK
  79. Jan 18 02:23:23 el8-a01n02.alteeve.ca fence_pacemaker[653317]: 554; Output: [OK]
  80. Jan 18 02:23:23 el8-a01n02.alteeve.ca fence_pacemaker[653319]: 554; Output: [rc:0]
  81. Jan 18 02:23:23 el8-a01n02.alteeve.ca fence_pacemaker[653321]: 563; start_time: [1610936603], end_time: [1610936903]
  82. Jan 18 02:23:23 el8-a01n02.alteeve.ca fence_pacemaker[653324]: 523; Checking the status of target node: [el8-a01n01].
  83. Jan 18 02:23:23 el8-a01n02.alteeve.ca fence_pacemaker[653326]: 532; The node: [el8-a01n01] is: [down/member] (join/expected). It has not yet been fenced.
  84. Jan 18 02:23:24 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Peer el8-a01n01 was terminated (off) by el8-a01n02 on behalf of stonith_admin.653299: OK
  85. Jan 18 02:23:25 el8-a01n02.alteeve.ca pacemaker-schedulerd[490049]: notice: * Start virsh_node2_pulsar ( el8-a01n02 )
  86. Jan 18 02:23:25 el8-a01n02.alteeve.ca pacemaker-schedulerd[490049]: notice: Calculated transition 66, saving inputs in /var/lib/pacemaker/pengine/pe-input-106.bz2
  87. Jan 18 02:23:25 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating start operation virsh_node2_pulsar_start_0 locally on el8-a01n02
  88. Jan 18 02:23:25 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Result of start operation for virsh_node2_pulsar on el8-a01n02: ok
  89. Jan 18 02:23:25 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Initiating monitor operation virsh_node2_pulsar_monitor_60000 locally on el8-a01n02
  90. Jan 18 02:23:26 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Result of monitor operation for virsh_node2_pulsar on el8-a01n02: ok
  91. Jan 18 02:23:26 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: Transition 66 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-106.bz2): Complete
  92. Jan 18 02:23:26 el8-a01n02.alteeve.ca pacemaker-controld[490050]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE
  93. Jan 18 02:23:28 el8-a01n02.alteeve.ca fence_pacemaker[653335]: 523; Checking the status of target node: [el8-a01n01].
  94. Jan 18 02:23:28 el8-a01n02.alteeve.ca fence_pacemaker[653337]: 527; The node: [el8-a01n01] has been fenced successfully.
  95. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: helper command: /sbin/drbdadm fence-peer exit code 7 (0x700)
  96. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test el8-a01n01: fence-peer helper returned 7 (peer was stonithed)
  97. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test/0 drbd0 el8-a01n01: pdsk( DUnknown -> Outdated )
  98. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Preparing cluster-wide state change 1240686179 (1->-1 3/1)
  99. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Committing cluster-wide state change 1240686179 (1ms)
  100. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: role( Secondary -> Primary )
  101. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: role( Primary -> Secondary )
  102. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Preparing cluster-wide state change 3546961431 (1->-1 3/1)
  103. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Committing cluster-wide state change 3546961431 (1ms)
  104. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: role( Secondary -> Primary )
  105. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: role( Primary -> Secondary )
  106. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Preparing cluster-wide state change 998660632 (1->-1 3/1)
  107. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: Committing cluster-wide state change 998660632 (1ms)
  108. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test: role( Secondary -> Primary )
  109. Jan 18 02:23:28 el8-a01n02.alteeve.ca kernel: drbd srv01-test/0 drbd0: new current UUID: 4DD97D3D5C69EEDD weak: FFFFFFFFFFFFFFFD
  110.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!