Advertisement
yannism

drbd9 on pve issues

Feb 13th, 2017
411
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.71 KB | None | 0 0
  1.  
  2. drbdadm version: Version: 8.9.10 (api:2)
  3. GIT-hash: 54df7406bd33851eb5fdde48362754bfd71e0500 build by buildsystem@linbit, 2017-01-09 16:07:22
  4.  
  5. root@pve3:/var/lib/drbd.d# drbdmanage shutdown
  6. You are going to shut down the drbdmanaged server process on this node.
  7. Please confirm:
  8. yes/no: yes
  9.  
  10. root@pve3:/var/lib/drbd.d# drbdmanage startup
  11. Attempting to startup the server through D-Bus activation...
  12. D-Bus connection successful, server is running and reachable
  13.  
  14. root@pve3:/var/lib/drbd.d# drbdmanage n
  15. Waiting for server: ...............
  16. No nodes defined
  17. root@pve3:/var/lib/drbd.d# drbdadm status
  18. .drbdctrl role:Secondary
  19. volume:0 disk:Outdated
  20. volume:1 disk:Outdated
  21. pve1 connection:Connecting
  22. pve2 connection:Connecting
  23.  
  24. vm-115-disk-1 role:Primary
  25. disk:UpToDate
  26. pve1 connection:StandAlone
  27. pve2 connection:StandAlone
  28.  
  29. root@pve3:/var/lib/drbd.d# drbd-overview
  30. 0:.drbdctrl/0 Conn(pve3)/C'ng(pve2,pve1) Seco(pve3)/Unkn(pve2,pve1) Outd(pve3)/DUnk(pve1,pve2)
  31. 1:.drbdctrl/1 Conn(pve3)/C'ng(pve2,pve1) Seco(pve3)/Unkn(pve1,pve2) Outd(pve3)/DUnk(pve2,pve1)
  32. 100:vm-115-disk-1/0 Conn(pve3)/StAl(pve1,pve2) Prim(pve3)/Unkn(pve1,pve2) UpTo(pve3)/DUnk(pve1)/Inco(pve2)
  33. 101:vm-115-disk-2/0 Connected(1*) Secondary(1*) UpToDate(1*)
  34.  
  35. root@pve3:/var/lib/drbd.d# drbdmanage a
  36.  
  37. Error: Cannot connect to the drbdmanaged process using DBus
  38. The DBus subsystem returned the following error description:
  39. org.freedesktop.DBus.Python.TypeError: Traceback (most recent call last):
  40. File "/usr/lib/python2.7/dist-packages/dbus/service.py", line 751, in _message_cb
  41. _method_reply_return(connection, message, method_name, signature, *retval)
  42. File "/usr/lib/python2.7/dist-packages/dbus/service.py", line 254, in _method_reply_return
  43. reply.append(signature=signature, *retval)
  44. TypeError: 'int' object is not iterable
  45.  
  46. root@pve3:/var/lib/drbd.d# drbdmanage v
  47. Waiting for server: ...............
  48. No resources defined
  49.  
  50.  
  51. root@pve3:/var/lib/drbd.d# tail -n 20 /var/log/syslog
  52. Feb 13 16:23:46 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: outdated-wfc-timeout implicitly set to degr-wfc-timeout (2s)
  53. Feb 13 16:23:46 pve3 drbdmanaged[19695]: WARNING Resource '.drbdctrl': wait-connect-resource not finished within 2 seconds
  54. Feb 13 16:23:46 pve3 drbdmanaged[19695]: INFO Leader election by wait for connections
  55. Feb 13 16:23:46 pve3 drbdmanaged[19695]: INFO DrbdAdm: Running external command: drbdsetup wait-connect-resource --wait-after-sb=yes --wfc-timeout=2 .drbdctrl
  56. Feb 13 16:23:48 pve3 drbdmanaged[19695]: ERROR DrbdAdm: External command 'drbdsetup': Exit code 5
  57. Feb 13 16:23:48 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: degr-wfc-timeout has to be shorter than wfc-timeout
  58. Feb 13 16:23:48 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: degr-wfc-timeout implicitly set to wfc-timeout (2s)
  59. Feb 13 16:23:48 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: outdated-wfc-timeout has to be shorter than degr-wfc-timeout
  60. Feb 13 16:23:48 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: outdated-wfc-timeout implicitly set to degr-wfc-timeout (2s)
  61. Feb 13 16:23:48 pve3 drbdmanaged[19695]: WARNING Resource '.drbdctrl': wait-connect-resource not finished within 2 seconds
  62. Feb 13 16:23:48 pve3 drbdmanaged[19695]: INFO Leader election by wait for connections
  63. Feb 13 16:23:48 pve3 drbdmanaged[19695]: INFO DrbdAdm: Running external command: drbdsetup wait-connect-resource --wait-after-sb=yes --wfc-timeout=2 .drbdctrl
  64. Feb 13 16:23:50 pve3 drbdmanaged[19695]: ERROR DrbdAdm: External command 'drbdsetup': Exit code 5
  65. Feb 13 16:23:50 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: degr-wfc-timeout has to be shorter than wfc-timeout
  66. Feb 13 16:23:50 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: degr-wfc-timeout implicitly set to wfc-timeout (2s)
  67. Feb 13 16:23:50 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: outdated-wfc-timeout has to be shorter than degr-wfc-timeout
  68. Feb 13 16:23:50 pve3 drbdmanaged[19695]: ERROR drbdsetup/stderr: outdated-wfc-timeout implicitly set to degr-wfc-timeout (2s)
  69. Feb 13 16:23:50 pve3 drbdmanaged[19695]: WARNING Resource '.drbdctrl': wait-connect-resource not finished within 2 seconds
  70. ------------------------------------------------------------------------------------------------------------------------------------------------------
  71.  
  72. root@pve2:~# drbdmanage resume-all
  73. Operation completed successfully
  74. root@pve2:~# drbdadm status
  75. .drbdctrl role:Secondary
  76. volume:0 disk:UpToDate
  77. volume:1 disk:UpToDate
  78. pve1 role:Primary
  79. volume:0 peer-disk:UpToDate
  80. volume:1 peer-disk:UpToDate
  81.  
  82. vm-115-disk-1 role:Primary
  83. disk:UpToDate
  84. pve1 role:Secondary
  85. peer-disk:UpToDate
  86.  
  87. root@pve2:~# drbd-overview
  88. 0:.drbdctrl/0 Connected(2*) Second/Primar UpToDa/UpToDa
  89. 1:.drbdctrl/1 Connected(2*) Second/Primar UpToDa/UpToDa
  90.  
  91. 100:vm-115-disroot@pve2:~# drbdmanage n
  92. +------------------------------------------------------------------------------------------------------------+
  93. | Name | Pool Size | Pool Free | | State |
  94. |------------------------------------------------------------------------------------------------------------|
  95. | pve1 | 15260 | 2618 | | ok |
  96. | pve2 | 15260 | 0 | | pending actions: adjust connections |
  97. +------------------------------------------------------------------------------------------------------------+
  98. k-1/0 Connected(2*) Primar/Second UpToDa/UpToDa
  99.  
  100.  
  101. root@pve2:~# drbdmanage v
  102. +------------------------------------------------------------------------------------------------------------+
  103. | Name | Vol ID | Size | Minor | | State |
  104. |------------------------------------------------------------------------------------------------------------|
  105. | vm-115-disk-2 | 0 | 1 GiB | 101 | | ok |
  106. | vm-115-disk-1 | 0 | 13 GiB | 100 | | ok |
  107. +------------------------------------------------------------------------------------------------------------+
  108.  
  109. root@pve2:~# drbdmanage a
  110. +------------------------------------------------------------------------------------------------------------+
  111. | Node | Resource | Vol ID | | State |
  112. |------------------------------------------------------------------------------------------------------------|
  113. | pve1 | vm-115-disk-1 | * | | ok |
  114. | pve2 | vm-115-disk-2 | * | | disconnected, pending actions: decommission |
  115. | pve2 | vm-115-disk-1 | * | | pending actions: commission |
  116. | pve2 | vm-115-disk-1 | 0 | | pending actions: commission, attach |
  117. +------------------------------------------------------------------------------------------------------------+
  118.  
  119. Feb 13 16:35:41 pve2 org.drbd.drbdmanaged[2449]: Logical volume drbdpool/vm-115-disk-1_00 is used by another device.
  120. Feb 13 16:35:44 pve2 drbdmanaged[3512]: ERROR ThinLV: Removal of an existing volume 'vm-115-disk-1_00' failed, aborting
  121. Feb 13 16:35:44 pve2 drbdmanaged[3512]: ERROR DrbdManager: Failed to create block device for resource 'vm-115-disk-1' volume 0
  122. Feb 13 16:37:14 pve2 drbdmanaged[3512]: INFO DrbdAdm: Running external command: drbdadm -vvv adjust .drbdctrl
  123. Feb 13 16:37:14 pve2 drbdmanaged[3512]: INFO DrbdAdm: External command 'drbdadm': Exit code 0
  124. Feb 13 16:37:14 pve2 drbdmanaged[3512]: WARNING ThinLV: Volume 'vm-115-disk-1_00' exists already, attempting to remove it.
  125. Feb 13 16:37:14 pve2 drbdmanaged[3512]: WARNING ThinLV: Attempt 1 of 2: Removal of volume 'vm-115-disk-1_00' failed.
  126. Feb 13 16:37:15 pve2 org.drbd.drbdmanaged[2449]: Logical volume drbdpool/vm-115-disk-1_00 is used by another device.
  127. Feb 13 16:37:16 pve2 drbdmanaged[3512]: WARNING ThinLV: Attempt 2 of 2: Removal of volume 'vm-115-disk-1_00' failed.
  128. Feb 13 16:37:19 pve2 org.drbd.drbdmanaged[2449]: Logical volume drbdpool/vm-115-disk-1_00 is used by another device.
  129. Feb 13 16:37:22 pve2 drbdmanaged[3512]: ERROR ThinLV: Removal of an existing volume 'vm-115-disk-1_00' failed, aborting
  130. Feb 13 16:37:22 pve2 drbdmanaged[3512]: ERROR DrbdManager: Failed to create block device for resource 'vm-115-disk-1' volume 0
  131. Feb 13 16:37:26 pve2 drbdmanaged[3512]: INFO DrbdAdm: Running external command: drbdadm -vvv adjust .drbdctrl
  132. Feb 13 16:37:26 pve2 drbdmanaged[3512]: INFO DrbdAdm: External command 'drbdadm': Exit code 0
  133. Feb 13 16:37:28 pve2 drbdmanaged[3512]: WARNING ThinLV: Volume 'vm-115-disk-1_00' exists already, attempting to remove it.
  134. Feb 13 16:37:28 pve2 drbdmanaged[3512]: WARNING ThinLV: Attempt 1 of 2: Removal of volume 'vm-115-disk-1_00' failed.
  135. Feb 13 16:37:31 pve2 org.drbd.drbdmanaged[2449]: Logical volume drbdpool/vm-115-disk-1_00 is used by another device.
  136. Feb 13 16:37:36 pve2 drbdmanaged[3512]: WARNING ThinLV: Attempt 2 of 2: Removal of volume 'vm-115-disk-1_00' failed.
  137. Feb 13 16:37:42 pve2 org.drbd.drbdmanaged[2449]: Logical volume drbdpool/vm-115-disk-1_00 is used by another device.
  138. Feb 13 16:37:44 pve2 drbdmanaged[3512]: ERROR ThinLV: Removal of an existing volume 'vm-115-disk-1_00' failed, aborting
  139. Feb 13 16:37:44 pve2 drbdmanaged[3512]: ERROR DrbdManager: Failed to create block device for resource 'vm-115-disk-1' volume
  140.  
  141. ---------------------------------------------------------------------------------------------------------------------------------------
  142. root@pve1:~# drbd-overview
  143. 0:.drbdctrl/0 Connected(2*) Primar/Second UpToDa/UpToDa
  144. 1:.drbdctrl/1 Connected(2*) Primar/Second UpToDa/UpToDa
  145. 100:vm-115-disk-1/0 Connected(2*) Second/Primar UpToDa/UpToDa
  146.  
  147. root@pve1:~# drbdadm status
  148. .drbdctrl role:Primary
  149. volume:0 disk:UpToDate
  150. volume:1 disk:UpToDate
  151. pve2 role:Secondary
  152. volume:0 peer-disk:UpToDate
  153. volume:1 peer-disk:UpToDate
  154.  
  155. vm-115-disk-1 role:Secondary
  156. disk:UpToDate
  157. pve2 role:Primary
  158. peer-disk:UpToDate
  159.  
  160. root@pve1:~# drbdmanage n
  161. +------------------------------------------------------------------------------------------------------------+
  162. | Name | Pool Size | Pool Free | | State |
  163. |------------------------------------------------------------------------------------------------------------|
  164. | pve1 | 15260 | 2610 | | ok |
  165. | pve2 | 15260 | 0 | | pending actions: adjust connections |
  166. +------------------------------------------------------------------------------------------------------------+
  167.  
  168. root@pve1:~# drbdmanage v
  169. +------------------------------------------------------------------------------------------------------------+
  170. | Name | Vol ID | Size | Minor | | State |
  171. |------------------------------------------------------------------------------------------------------------|
  172. | vm-115-disk-2 | 0 | 1 GiB | 101 | | ok |
  173. | vm-115-disk-1 | 0 | 13 GiB | 100 | | ok |
  174. +------------------------------------------------------------------------------------------------------------+
  175.  
  176. root@pve1:~# drbdmanage a
  177. +------------------------------------------------------------------------------------------------------------+
  178. | Node | Resource | Vol ID | | State |
  179. |------------------------------------------------------------------------------------------------------------|
  180. | pve1 | vm-115-disk-1 | * | | ok |
  181. | pve2 | vm-115-disk-2 | * | | disconnected, pending actions: decommission |
  182. | pve2 | vm-115-disk-1 | * | | pending actions: commission |
  183. | pve2 | vm-115-disk-1 | 0 | | pending actions: commission, attach |
  184. +------------------------------------------------------------------------------------------------------------+
  185.  
  186. Feb 13 15:12:00 pve1 drbdmanaged[3730]: INFO updating storage pool information
  187. Feb 13 16:33:55 pve1 drbdmanaged[3730]: INFO updating storage pool information
  188. Feb 13 16:34:09 pve1 drbdmanaged[3730]: INFO updating storage pool information
  189. Feb 13 16:34:38 pve1 drbdmanaged[3730]: INFO updating storage pool information
  190. Feb 13 16:34:50 pve1 drbdmanaged[3730]: INFO updating storage pool information
  191. Feb 13 16:36:09 pve1 drbdmanaged[3730]: INFO updating storage pool information
  192. Feb 13 16:36:43 pve1 drbdmanaged[3730]: INFO updating storage pool information
  193. Feb 13 16:37:11 pve1 drbdmanaged[3730]: INFO updating storage pool information
  194. Feb 13 16:38:13 pve1 drbdmanaged[3730]: INFO updating storage pool information
  195. Feb 13 16:38:42 pve1 drbdmanaged[3730]: INFO updating storage pool information
  196. Feb 13 16:39:11 pve1 drbdmanaged[3730]: INFO updating storage pool information
  197. Feb 13 16:39:22 pve1 drbdmanaged[3730]: INFO updating storage pool information
  198. Feb 13 16:40:39 pve1 drbdmanaged[3730]: INFO updating storage pool information
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement