API tools faq
paste
Advertisement
Guest User

nova-error-ceph

a guest
Dec 16th, 2019
74
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.92 KB | None | 0 0
raw download clone embed print report
  1. 2019-12-16 16:04:05.841 10535 INFO nova.compute.manager [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] [instance: e835d71a-d8e0-494c-a4a7-579c943998ab] instance snapshotting
  2. 2019-12-16 16:04:05.842 10535 WARNING nova.compute.manager [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] [instance: e835d71a-d8e0-494c-a4a7-579c943998ab] trying to snapshot a non-running instance: (state: 4 expected: 1)
  3. 2019-12-16 16:04:05.933 10535 INFO nova.virt.libvirt.driver [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] [instance: e835d71a-d8e0-494c-a4a7-579c943998ab] Beginning cold snapshot process
  4. 2019-12-16 16:04:45.413 10535 INFO nova.compute.resource_tracker [req-4ed98290-c219-4f22-b363-6a2d1c74c6d9 - - - - -] Final resource view: name=cn-440382.tcloud.loc phys_ram=391884MB used_ram=86528MB phys_disk=593119GB used_disk=840GB total_vcpus=40 used_vcpus=56 pci_stats=[]
  5. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] Failed to snapshot image: PermissionError: [errno 1] error unprotecting snapshot e835d71a-d8e0-494c-a4a7-579c943998ab_disk@41de3c1f346d44d3af768974846884fb
  6. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver Traceback (most recent call last):
  7. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1994, in snapshot
  8. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver instance.image_ref)
  9. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 1069, in direct_snapshot
  10. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver self.cleanup_direct_snapshot(location)
  11. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 1091, in cleanup_direct_snapshot
  12. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver ignore_errors=ignore_errors)
  13. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 403, in remove_snap
  14. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver vol.unprotect_snap(name)
  15. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
  16. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver result = proxy_call(self._autowrap, f, *args, **kwargs)
  17. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
  18. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver rv = execute(f, *args, **kwargs)
  19. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
  20. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver six.reraise(c, e, tb)
  21. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
  22. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver rv = meth(*args, **kwargs)
  23. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver File "rbd.pyx", line 1908, in rbd.Image.unprotect_snap (/builddir/build/BUILD/ceph-12.2.11/build/src/pybind/rbd/pyrex/rbd.c:17058)
  24. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver PermissionError: [errno 1] error unprotecting snapshot e835d71a-d8e0-494c-a4a7-579c943998ab_disk@41de3c1f346d44d3af768974846884fb
  25. 2019-12-16 16:05:13.679 10535 ERROR nova.virt.libvirt.driver
  26. 2019-12-16 16:05:14.891 10535 INFO nova.compute.manager [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] [instance: e835d71a-d8e0-494c-a4a7-579c943998ab] Successfully reverted task state from image_uploading on failure for instance.
  27. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server [req-d26721ef-a876-41ce-9bc6-dc1afdf62907 4d403d8024611dccb65af5d182b4e1771dea52d9b8835de0c0e42a8ca91cd67a be6ea4496e5d47ae9b160f3f930cfb31 - a4c9f54d87564f09ae81b074f502831f a4c9f54d87564f09ae81b074f502831f] Exception during message handling: PermissionError: [errno 1] error unprotecting snapshot e835d71a-d8e0-494c-a4a7-579c943998ab_disk@41de3c1f346d44d3af768974846884fb
  28. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
  29. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming
  30. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
  31. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
  32. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
  33. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
  34. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
  35. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 76, in wrapped
  36. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server function_name, call_dict, binary)
  37. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  38. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.force_reraise()
  39. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  40. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
  41. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 67, in wrapped
  42. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw)
  43. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 187, in decorated_function
  44. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server "Error: %s", e, instance=instance)
  45. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  46. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.force_reraise()
  47. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  48. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
  49. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 157, in decorated_function
  50. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)
  51. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1000, in decorated_function
  52. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)
  53. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 215, in decorated_function
  54. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info())
  55. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  56. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.force_reraise()
  57. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  58. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
  59. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 203, in decorated_function
  60. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)
  61. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 244, in decorated_function
  62. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server image_id, instance=instance)
  63. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  64. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.force_reraise()
  65. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  66. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
  67. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 231, in decorated_function
  68. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server *args, **kwargs)
  69. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3356, in snapshot_instance
  70. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server task_states.IMAGE_SNAPSHOT)
  71. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3388, in _snapshot_instance
  72. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server update_task_state)
  73. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2072, in snapshot
  74. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server ignore_errors=True)
  75. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  76. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.force_reraise()
  77. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  78. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
  79. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1994, in snapshot
  80. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server instance.image_ref)
  81. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 1069, in direct_snapshot
  82. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server self.cleanup_direct_snapshot(location)
  83. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 1091, in cleanup_direct_snapshot
  84. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server ignore_errors=ignore_errors)
  85. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 403, in remove_snap
  86. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server vol.unprotect_snap(name)
  87. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
  88. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server result = proxy_call(self._autowrap, f, *args, **kwargs)
  89. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
  90. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server rv = execute(f, *args, **kwargs)
  91. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
  92. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server six.reraise(c, e, tb)
  93. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
  94. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server rv = meth(*args, **kwargs)
  95. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server File "rbd.pyx", line 1908, in rbd.Image.unprotect_snap (/builddir/build/BUILD/ceph-12.2.11/build/src/pybind/rbd/pyrex/rbd.c:17058)
  96. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server PermissionError: [errno 1] error unprotecting snapshot e835d71a-d8e0-494c-a4a7-579c943998ab_disk@41de3c1f346d44d3af768974846884fb
  97. 2019-12-16 16:05:14.931 10535 ERROR oslo_messaging.rpc.server
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!