API tools faq
paste
Advertisement
Guest User

rabbitmq issues

a guest
Jan 19th, 2017
522
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 70.00 KB | None | 0 0
raw download clone embed print report
  1. 2017-01-19 13:12:46.845 4129 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:12:46] "OPTIONS / HTTP/1.0" 200 262 0.000811
  2. 2017-01-19 13:12:49.836 4102 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  3. 2017-01-19 13:12:49.838 4100 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  4. 2017-01-19 13:12:49.838 4142 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  5. 2017-01-19 13:12:49.840 4143 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  6. 2017-01-19 13:12:50.289 4102 INFO neutron.wsgi [req-90518430-103f-4c8a-a870-b3bd475e0136 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/extensions.json HTTP/1.1" 200 7231 0.454738
  7. 2017-01-19 13:12:50.312 4092 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  8. 2017-01-19 13:12:50.340 4102 INFO neutron.wsgi [req-ab4d301e-8ec0-410d-a924-7a54bd9ddbca 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/quotas/3cd786db6f75426abf0b96c2f4d0c26f.json HTTP/1.1" 200 745 0.030124
  9. 2017-01-19 13:12:50.393 4100 INFO neutron.wsgi [req-62ab7d3f-0360-444e-901e-cf71cdeab9a4 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/subnets.json HTTP/1.1" 200 1376 0.556261
  10. 2017-01-19 13:12:50.395 4102 INFO neutron.wsgi [req-6d8c5531-2ac5-4048-a741-c09fd7109f56 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/security-groups.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 1836 0.051691
  11. 2017-01-19 13:12:50.422 4142 INFO neutron.wsgi [req-17e14d6f-22c3-4442-8264-633796bf2a6f 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/networks.json?router%3Aexternal=True HTTP/1.1" 200 880 0.585224
  12. 2017-01-19 13:12:50.757 4092 INFO neutron.wsgi [req-4ec3f391-39b5-4041-b0f2-e3dcd0acd038 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:50] "GET /v2.0/floatingips.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 227 0.446329
  13. 2017-01-19 13:12:50.763 4125 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  14. 2017-01-19 13:12:51.130 4092 INFO neutron.wsgi [req-55399589-1f94-4f5f-84a5-fece400af0b4 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:51] "GET /v2.0/networks.json?shared=False HTTP/1.1" 200 1524 0.782338
  15. 2017-01-19 13:12:51.136 4113 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  16. 2017-01-19 13:12:51.136 4113 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  17. 2017-01-19 13:12:51.171 4125 INFO neutron.wsgi [req-41639291-d55c-40ab-884e-d2ceee5585c8 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:51] "GET /v2.0/ports.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 1857 0.408532
  18. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall [req-2ac4b1d6-3ec9-409d-aa8e-28c671f1c63c - - - - -] Fixed interval looping call 'networking_cisco.plugins.cisco.service_plugins.cisco_router_plugin.CiscoRouterPlugin._process_backlogged_routers' failed
  19. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall Traceback (most recent call last):
  20. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/oslo_service/loopingcall.py", line 136, in _run_loop
  21. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall result = func(*self.args, **self.kw)
  22. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 271, in inner
  23. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall return f(*args, **kwargs)
  24. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1105, in _process_backlogged_routers
  25. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self.ensure_global_router_cleanup()
  26. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1162, in ensure_global_router_cleanup
  27. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall global_routers = l3plugin.get_routers(e_context, filters=filters)
  28. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/neutron/db/l3_db.py", line 527, in get_routers
  29. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall page_reverse=page_reverse)
  30. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 307, in _get_collection
  31. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall page_reverse=page_reverse)
  32. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 290, in _get_collection_query
  33. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall collection = self._model_query(context, model)
  34. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 177, in _model_query
  35. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall query = query_hook(context, model, query)
  36. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 154, in _cisco_router_model_hook
  37. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self._add_namespace_binding(context, original_query.first())
  38. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 145, in _add_namespace_binding
  39. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall context.session.add(r_hd_b_db)
  40. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 490, in __exit__
  41. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self.rollback()
  42. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
  43. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall compat.reraise(exc_type, exc_value, exc_tb)
  44. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 487, in __exit__
  45. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self.commit()
  46. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 392, in commit
  47. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self._prepare_impl()
  48. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl
  49. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self.session.flush()
  50. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2019, in flush
  51. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self._flush(objects)
  52. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2137, in _flush
  53. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall transaction.rollback(_capture_exception=True)
  54. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
  55. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall compat.reraise(exc_type, exc_value, exc_tb)
  56. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2101, in _flush
  57. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall flush_context.execute()
  58. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
  59. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall rec.execute(self)
  60. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
  61. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall uow
  62. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj
  63. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall mapper, table, insert)
  64. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 767, in _emit_insert_statements
  65. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall execute(statement, multiparams)
  66. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
  67. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall return meth(self, multiparams, params)
  68. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
  69. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall return connection._execute_clauseelement(self, multiparams, params)
  70. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
  71. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall compiled_sql, distilled_params
  72. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
  73. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall context)
  74. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
  75. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall util.raise_from_cause(newraise, exc_info)
  76. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
  77. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall reraise(type(exception), exception, tb=exc_tb, cause=cause)
  78. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
  79. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall context)
  80. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
  81. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall cursor.execute(statement, parameters)
  82. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 219, in execute
  83. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall self.errorhandler(self, exc, value)
  84. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 38, in defaulterrorhandler
  85. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall raise errorvalue
  86. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall DBDuplicateEntry: (_mysql_exceptions.IntegrityError) (1062, "Duplicate entry 'ef311f59-3204-4bc1-9480-c558aef25975-00000000-0000-0000-0000-000' for key 'PRIMARY'") [SQL: u'INSERT INTO cisco_router_mappings (router_id, role, router_type_id, inflated_slot_need, auto_schedule, share_hosting_device, hosting_device_id) VALUES (%s, %s, %s, %s, %s, %s, %s)'] [parameters: ('ef311f59-3204-4bc1-9480-c558aef25975', None, '00000000-0000-0000-0000-000000000537', 0, 1, 1, None)]
  87. 2017-01-19 13:12:51.185 4143 ERROR oslo.service.loopingcall
  88. 2017-01-19 13:12:51.190 4092 INFO neutron.wsgi [req-c5d7bb4f-acd9-4766-9539-bac998251509 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:51] "GET /v2.0/routers.json HTTP/1.1" 200 858 0.835630
  89. 2017-01-19 13:12:51.208 4143 INFO neutron.wsgi [req-0f66d16e-75a2-4e9d-ab37-47952b2cbecd 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:51] "GET /v2.0/routers.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f&search_opts=None HTTP/1.1" 200 858 1.369519
  90. 2017-01-19 13:12:51.607 4113 INFO neutron.wsgi [req-660bdfa4-00b5-46e1-b4e2-cc3e64590280 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:51] "GET /v2.0/networks.json?shared=True HTTP/1.1" 200 224 0.472347
  91. 2017-01-19 13:12:53.869 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  92. Type Last heartbeat host
  93. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  94. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  95. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  96. 2017-01-19 13:12:56.635 4148 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  97. 2017-01-19 13:12:56.635 4124 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  98. 2017-01-19 13:12:56.647 4148 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:12:56] "OPTIONS / HTTP/1.0" 200 262 0.000525
  99. 2017-01-19 13:12:56.922 4102 INFO neutron.wsgi [req-10375db3-341d-491e-bb61-e259a1ceea64 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:56] "GET /v2.0/routers.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f&search_opts=None HTTP/1.1" 200 858 0.289236
  100. 2017-01-19 13:12:57.082 4148 INFO neutron.wsgi [req-8ae45f08-8798-47c8-ae98-462b092b1dc0 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:57] "GET /v2.0/networks.json?router%3Aexternal=True HTTP/1.1" 200 880 0.449169
  101. 2017-01-19 13:12:57.093 4124 INFO neutron.wsgi [req-462c1c0a-8240-407b-9649-c435c99ff42e 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:12:57] "GET /v2.0/subnets.json HTTP/1.1" 200 1376 0.459846
  102. 2017-01-19 13:12:57.129 4147 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  103. 2017-01-19 13:12:58.699 4147 INFO networking_cisco.plugins.cisco.db.l3.l3_router_appliance_db [req-5d5bd680-03e7-4168-b4aa-e427b0ca0d15 - - - - -] Synchronizing router (scheduling) backlog
  104. 2017-01-19 13:12:59.193 4147 WARNING oslo.messaging._drivers.impl_rabbit [req-3bb5ee9d-a003-408e-a898-eb3c70bcc58b 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] Process forked after connection established! This can result in unpredictable behavior. See: http://docs.openstack.org/developer/oslo.messaging/transport.html
  105. 2017-01-19 13:12:59.202 4209 ERROR oslo.messaging._drivers.impl_rabbit [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] Failed to publish message to topic 'reply_8b464585fa9044cfa6b6eaee5e352885': Received 0x00 while expecting 0xce
  106. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] Exception during message handling: Received 0x00 while expecting 0xce
  107. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
  108. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
  109. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher incoming.message))
  110. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 122, in reply
  111. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher log_failure=log_failure)
  112. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 97, in _send_reply
  113. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher conn.direct_send(self.reply_q, msg)
  114. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1226, in direct_send
  115. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher exchange, msg, routing_key=msg_id)
  116. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1116, in _ensure_publishing
  117. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher self.ensure(method, retry=retry, error_callback=_error_callback)
  118. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 763, in ensure
  119. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher ret, channel = autoretry_method()
  120. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 436, in _ensured
  121. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher return fun(*args, **kwargs)
  122. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 508, in __call__
  123. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher return fun(*args, channel=channels[0], **kwargs), channels[0]
  124. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 739, in execute_method
  125. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher method()
  126. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1201, in _publish_and_raises_on_missing_exchange
  127. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher timeout=timeout)
  128. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1147, in _publish
  129. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher compression=self.kombu_compression)
  130. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 172, in publish
  131. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher routing_key, mandatory, immediate, exchange, declare)
  132. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 188, in _publish
  133. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher mandatory=mandatory, immediate=immediate,
  134. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/amqp/channel.py", line 2129, in basic_publish_confirm
  135. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher self.wait([(60, 80), (60, 120)])
  136. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 67, in wait
  137. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher self.channel_id, allowed_methods, timeout)
  138. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 241, in _wait_method
  139. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher channel, method_sig, args, content = read_timeout(timeout)
  140. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 330, in read_timeout
  141. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher return self.method_reader.read_method()
  142. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 189, in read_method
  143. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher raise m
  144. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher UnexpectedFrame: Received 0x00 while expecting 0xce
  145. 2017-01-19 13:12:59.203 4209 ERROR oslo_messaging.rpc.dispatcher
  146. 2017-01-19 13:12:59.210 4209 ERROR oslo_messaging._drivers.common [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] Returning exception Received 0x00 while expecting 0xce to caller
  147. 2017-01-19 13:12:59.211 4209 ERROR oslo_messaging._drivers.common [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 122, in reply\n log_failure=log_failure)\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 97, in _send_reply\n conn.direct_send(self.reply_q, msg)\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1226, in direct_send\n exchange, msg, routing_key=msg_id)\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1116, in _ensure_publishing\n self.ensure(method, retry=retry, error_callback=_error_callback)\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 763, in ensure\n ret, channel = autoretry_method()\n', ' File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 436, in _ensured\n return fun(*args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 508, in __call__\n return fun(*args, channel=channels[0], **kwargs), channels[0]\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 739, in execute_method\n method()\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1201, in _publish_and_raises_on_missing_exchange\n timeout=timeout)\n', ' File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1147, in _publish\n compression=self.kombu_compression)\n', ' File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 172, in publish\n routing_key, mandatory, immediate, exchange, declare)\n', ' File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 188, in _publish\n mandatory=mandatory, immediate=immediate,\n', ' File "/usr/lib/python2.7/dist-packages/amqp/channel.py", line 2129, in basic_publish_confirm\n self.wait([(60, 80), (60, 120)])\n', ' File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 67, in wait\n self.channel_id, allowed_methods, timeout)\n', ' File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 241, in _wait_method\n channel, method_sig, args, content = read_timeout(timeout)\n', ' File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 330, in read_timeout\n return self.method_reader.read_method()\n', ' File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 189, in read_method\n raise m\n', 'UnexpectedFrame: Received 0x00 while expecting 0xce\n']
  148. 2017-01-19 13:13:06.734 4124 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:06] "OPTIONS / HTTP/1.0" 200 262 0.000607
  149. 2017-01-19 13:13:08.872 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  150. Type Last heartbeat host
  151. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  152. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  153. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  154. 2017-01-19 13:13:16.618 4124 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:16] "OPTIONS / HTTP/1.0" 200 262 0.000896
  155. 2017-01-19 13:13:23.874 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  156. Type Last heartbeat host
  157. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  158. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  159. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  160. 2017-01-19 13:13:26.872 4124 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:26] "OPTIONS / HTTP/1.0" 200 262 0.000806
  161. 2017-01-19 13:13:36.609 4124 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:36] "OPTIONS / HTTP/1.0" 200 262 0.000492
  162. 2017-01-19 13:13:38.874 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  163. Type Last heartbeat host
  164. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  165. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  166. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  167. 2017-01-19 13:13:46.668 4124 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:46] "OPTIONS / HTTP/1.0" 200 262 0.000845
  168. 2017-01-19 13:13:53.877 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  169. Type Last heartbeat host
  170. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  171. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  172. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  173. 2017-01-19 13:13:56.906 4138 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:13:56] "OPTIONS / HTTP/1.0" 200 262 0.000884
  174. 2017-01-19 13:13:57.659 4138 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  175. 2017-01-19 13:13:57.662 4102 INFO neutron.wsgi [req-2e11bf27-8a81-43cf-a340-78b716e2a37d 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:57] "GET /v2.0/extensions.json HTTP/1.1" 200 7231 0.006085
  176. 2017-01-19 13:13:57.689 4107 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  177. 2017-01-19 13:13:57.710 4097 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  178. 2017-01-19 13:13:57.713 4139 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option.
  179. 2017-01-19 13:13:57.773 4092 INFO neutron.wsgi [req-6bee0a54-642f-4a7d-b457-88600fc2c69d 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:57] "GET /v2.0/security-groups.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 1836 0.071017
  180. 2017-01-19 13:13:57.899 4124 INFO neutron.wsgi [req-407484cd-c4c6-4ee3-9fa8-6bfbba083afb 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:57] "GET /v2.0/subnets.json HTTP/1.1" 200 1376 0.235910
  181. 2017-01-19 13:13:58.149 4100 INFO neutron.wsgi [req-94723239-2ca0-451d-ad4d-2a3706f6fc8a 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/networks.json?router%3Aexternal=True HTTP/1.1" 200 880 0.484342
  182. 2017-01-19 13:13:58.170 4139 INFO neutron.wsgi [req-fec38d36-5bb0-4add-b772-6adf8b0b1154 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/networks.json?shared=False HTTP/1.1" 200 1524 0.458406
  183. 2017-01-19 13:13:58.174 4107 INFO neutron.wsgi [req-b73f4af1-8948-4d45-9d33-377d365634bd 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/floatingips.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 227 0.485819
  184. 2017-01-19 13:13:58.225 4139 INFO neutron.wsgi [req-04b81572-5cf1-4dd6-86cc-9b3c9d7a8f93 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/ports.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 1857 0.047745
  185. 2017-01-19 13:13:58.386 4148 INFO neutron.wsgi [req-15bfaccb-2862-4c08-92be-0bf770ddbe00 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/networks.json?shared=True HTTP/1.1" 200 224 0.210268
  186. 2017-01-19 13:13:58.409 4097 INFO neutron.wsgi [req-49c26731-cb4e-4cbd-8b44-5c0238563f26 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/routers.json HTTP/1.1" 200 698 0.700482
  187. 2017-01-19 13:13:58.458 4138 INFO neutron.wsgi [req-94c75299-c07e-4a94-8e91-2d5e54319135 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/quotas/3cd786db6f75426abf0b96c2f4d0c26f.json HTTP/1.1" 200 745 0.776478
  188. 2017-01-19 13:13:58.481 4138 INFO neutron.wsgi [req-3e2ec199-7833-40ea-9e17-94d8374a8c14 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:13:58] "GET /v2.0/routers.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f&search_opts=None HTTP/1.1" 200 698 0.823501
  189. 2017-01-19 13:14:06.815 4142 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:14:06] "OPTIONS / HTTP/1.0" 200 262 0.002721
  190. 2017-01-19 13:14:08.879 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  191. Type Last heartbeat host
  192. Open vSwitch agent 2017-01-19 04:18:45 node-35.noiro.lab
  193. Open vSwitch agent 2017-01-19 04:18:09 node-36.noiro.lab
  194. Open vSwitch agent 2017-01-19 04:18:10 node-37.noiro.lab
  195. 2017-01-19 13:14:17.050 4102 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:14:17] "OPTIONS / HTTP/1.0" 200 262 0.000983
  196. 2017-01-19 13:14:23.881 2357 WARNING neutron.db.agents_db [req-47aed733-b99c-4666-8799-413678720ebf - - - - -] Agent healthcheck: found 3 dead agents out of 12:
  197. Type Last heartbeat host
  198.  
  199. then later....
  200.  
  201.  
  202. 2017-01-19 13:19:13.496 4100 INFO neutron.wsgi [req-e1d32027-e317-47d6-96fb-122dbcf655af 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] 192.168.0.2 - - [19/Jan/2017 13:19:13] "GET /v2.0/routers.json?tenant_id=3cd786db6f75426abf0b96c2f4d0c26f HTTP/1.1" 200 698 0.278604
  203. 2017-01-19 13:19:17.302 4102 INFO neutron.wsgi [-] 192.168.0.2 - - [19/Jan/2017 13:19:17] "OPTIONS / HTTP/1.0" 200 262 0.000846
  204. 2017-01-19 13:19:19.287 4211 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  205. 2017-01-19 13:19:19.287 4209 ERROR oslo.messaging._drivers.impl_rabbit [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  206. 2017-01-19 13:19:19.287 4190 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  207. 2017-01-19 13:19:19.287 4233 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  208. 2017-01-19 13:19:19.287 4199 ERROR oslo.messaging._drivers.impl_rabbit [req-13398ea5-db07-4da0-b0cc-c40983d8e769 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  209. 2017-01-19 13:19:19.287 4155 ERROR oslo.messaging._drivers.impl_rabbit [req-fa4563ea-0395-4a5b-8f34-b6848083e01b - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  210. 2017-01-19 13:19:19.287 4217 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  211. 2017-01-19 13:19:19.287 4202 ERROR oslo.messaging._drivers.impl_rabbit [req-f9ec9998-0ee0-4dd3-a8cb-ef008db9001b - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  212. 2017-01-19 13:19:19.288 4124 ERROR oslo.messaging._drivers.impl_rabbit [req-71ffb3df-f519-4468-ba48-6ede42b1eb67 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  213. 2017-01-19 13:19:19.288 4170 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  214. 2017-01-19 13:19:19.288 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  215. 2017-01-19 13:19:19.289 4211 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  216. 2017-01-19 13:19:19.289 4154 ERROR oslo.messaging._drivers.impl_rabbit [req-bc111c58-bde5-4d21-8f79-24bfc185c92c - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  217. 2017-01-19 13:19:19.290 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  218. 2017-01-19 13:19:19.289 4200 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  219. 2017-01-19 13:19:19.290 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  220. 2017-01-19 13:19:19.290 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  221. 2017-01-19 13:19:19.291 4196 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  222. 2017-01-19 13:19:19.292 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  223. 2017-01-19 13:19:19.292 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  224. 2017-01-19 13:19:19.293 4162 ERROR oslo.messaging._drivers.impl_rabbit [req-358655f0-550d-4131-adb9-ff5e7f3f3afe - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  225. 2017-01-19 13:19:19.293 4196 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  226. 2017-01-19 13:19:19.293 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  227. 2017-01-19 13:19:19.294 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  228. 2017-01-19 13:19:19.293 4220 ERROR oslo.messaging._drivers.impl_rabbit [req-b3bf086a-f8d6-41c8-8db8-0471cb81d1a2 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  229. 2017-01-19 13:19:19.293 4199 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  230. 2017-01-19 13:19:19.294 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  231. 2017-01-19 13:19:19.294 4196 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  232. 2017-01-19 13:19:19.291 4179 ERROR oslo.messaging._drivers.impl_rabbit [req-2c5c4353-cc94-493f-b1a6-2ddeb21c1df7 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  233. 2017-01-19 13:19:19.293 4139 ERROR oslo.messaging._drivers.impl_rabbit [req-b83721d1-c142-4677-a052-67dde7bd0fe0 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  234. 2017-01-19 13:19:19.294 4175 ERROR oslo.messaging._drivers.impl_rabbit [req-ad03c210-a165-4420-994c-b9e8cb41f9de - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  235. 2017-01-19 13:19:19.296 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  236. 2017-01-19 13:19:19.296 4193 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  237. 2017-01-19 13:19:19.298 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  238. 2017-01-19 13:19:19.299 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  239. 2017-01-19 13:19:19.299 4193 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  240. 2017-01-19 13:19:19.299 4159 ERROR oslo.messaging._drivers.impl_rabbit [req-9de6a35d-001e-4e19-8ad8-891fa3240dd9 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  241. 2017-01-19 13:19:19.300 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  242. 2017-01-19 13:19:19.299 4179 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  243. 2017-01-19 13:19:19.300 4147 ERROR oslo.messaging._drivers.impl_rabbit [req-3bb5ee9d-a003-408e-a898-eb3c70bcc58b 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  244. 2017-01-19 13:19:19.301 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  245. 2017-01-19 13:19:19.300 4202 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  246. 2017-01-19 13:19:19.301 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  247. 2017-01-19 13:19:19.301 4159 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  248. 2017-01-19 13:19:19.291 4180 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  249. 2017-01-19 13:19:19.288 4184 ERROR oslo.messaging._drivers.impl_rabbit [req-b12f4db5-564a-4358-bc2e-b54cc5762376 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  250. 2017-01-19 13:19:19.302 4202 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  251. 2017-01-19 13:19:19.302 4159 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  252. 2017-01-19 13:19:19.302 4200 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  253. 2017-01-19 13:19:19.303 4159 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  254. 2017-01-19 13:19:19.303 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  255. 2017-01-19 13:19:19.303 4180 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  256. 2017-01-19 13:19:19.303 4184 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  257. 2017-01-19 13:19:19.288 4192 ERROR oslo.messaging._drivers.impl_rabbit [req-c3bdbee9-1ae9-47a5-b099-780905d17517 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  258. 2017-01-19 13:19:19.304 4187 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  259. 2017-01-19 13:19:19.305 4205 ERROR oslo.messaging._drivers.impl_rabbit [req-4633c51a-7337-441f-b5db-838ffef1bd31 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  260. 2017-01-19 13:19:19.306 4192 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  261. 2017-01-19 13:19:19.307 4165 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  262. 2017-01-19 13:19:19.308 4193 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  263. 2017-01-19 13:19:19.308 4158 ERROR oslo.messaging._drivers.impl_rabbit [req-2b5ddcb6-a7ed-478d-a9a0-49001f2e66f6 - - - - -] AMQP server 192.168.0.3:5673 closed the connection. Check login credentials: Socket closed
  264. 2017-01-19 13:19:19.309 4162 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  265. 2017-01-19 13:19:19.310 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  266. 2017-01-19 13:19:19.311 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  267. 2017-01-19 13:19:19.311 4202 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  268. 2017-01-19 13:19:19.311 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  269. 2017-01-19 13:19:19.312 4162 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  270. 2017-01-19 13:19:19.311 4165 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  271. 2017-01-19 13:19:19.311 4158 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  272. 2017-01-19 13:19:19.312 4200 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  273. 2017-01-19 13:19:19.312 4180 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  274. 2017-01-19 13:19:19.312 4170 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  275. 2017-01-19 13:19:19.313 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  276. 2017-01-19 13:19:19.313 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  277. 2017-01-19 13:19:19.313 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  278. 2017-01-19 13:19:19.313 4200 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  279. 2017-01-19 13:19:19.313 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  280. 2017-01-19 13:19:19.314 4187 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  281. 2017-01-19 13:19:19.314 4158 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  282. 2017-01-19 13:19:19.315 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  283. 2017-01-19 13:19:19.315 4192 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  284. 2017-01-19 13:19:19.315 4184 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  285. 2017-01-19 13:19:19.315 4187 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  286. 2017-01-19 13:19:19.313 4165 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  287. 2017-01-19 13:19:19.317 4205 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  288. 2017-01-19 13:19:19.317 4192 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  289. 2017-01-19 13:19:19.318 4192 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  290. 2017-01-19 13:19:19.319 4162 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  291. 2017-01-19 13:19:19.319 4211 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  292.  
  293.  
  294. etc....
  295.  
  296. and
  297. 2017-01-19 13:19:19.346 4180 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'. Trying again in 1 seconds.
  298. 2017-01-19 13:19:20.296 4199 ERROR oslo.messaging._drivers.impl_rabbit [req-13398ea5-db07-4da0-b0cc-c40983d8e769 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  299. 2017-01-19 13:19:20.301 4209 ERROR oslo.messaging._drivers.impl_rabbit [req-e96a9357-b5be-42ff-8f09-e2840ea21420 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  300. 2017-01-19 13:19:20.306 4217 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  301. 2017-01-19 13:19:20.306 4155 ERROR oslo.messaging._drivers.impl_rabbit [req-fa4563ea-0395-4a5b-8f34-b6848083e01b - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  302. 2017-01-19 13:19:20.312 4175 ERROR oslo.messaging._drivers.impl_rabbit [req-ad03c210-a165-4420-994c-b9e8cb41f9de - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  303. 2017-01-19 13:19:20.312 4220 ERROR oslo.messaging._drivers.impl_rabbit [req-b3bf086a-f8d6-41c8-8db8-0471cb81d1a2 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  304. 2017-01-19 13:19:20.316 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  305. 2017-01-19 13:19:20.316 4190 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  306. 2017-01-19 13:19:20.317 4154 ERROR oslo.messaging._drivers.impl_rabbit [req-bc111c58-bde5-4d21-8f79-24bfc185c92c - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  307. 2017-01-19 13:19:20.317 4139 ERROR oslo.messaging._drivers.impl_rabbit [req-b83721d1-c142-4677-a052-67dde7bd0fe0 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  308. 2017-01-19 13:19:20.320 4199 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  309. 2017-01-19 13:19:20.326 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  310. 2017-01-19 13:19:20.331 4202 ERROR oslo.messaging._drivers.impl_rabbit [req-f9ec9998-0ee0-4dd3-a8cb-ef008db9001b - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  311. 2017-01-19 13:19:20.332 4211 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  312. 2017-01-19 13:19:20.335 4200 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  313. 2017-01-19 13:19:20.337 4184 ERROR oslo.messaging._drivers.impl_rabbit [req-b12f4db5-564a-4358-bc2e-b54cc5762376 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  314. 2017-01-19 13:19:20.343 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  315. 2017-01-19 13:19:20.326 4147 ERROR oslo.messaging._drivers.impl_rabbit [req-3bb5ee9d-a003-408e-a898-eb3c70bcc58b 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  316. 2017-01-19 13:19:20.347 4170 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  317. 2017-01-19 13:19:20.354 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  318. 2017-01-19 13:19:20.357 4196 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  319. 2017-01-19 13:19:20.360 4187 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  320. 2017-01-19 13:19:20.365 4179 ERROR oslo.messaging._drivers.impl_rabbit [req-2c5c4353-cc94-493f-b1a6-2ddeb21c1df7 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  321. 2017-01-19 13:19:20.368 4233 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  322. 2017-01-19 13:19:20.368 4165 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  323. 2017-01-19 13:19:20.393 4159 ERROR oslo.messaging._drivers.impl_rabbit [req-9de6a35d-001e-4e19-8ad8-891fa3240dd9 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  324. 2017-01-19 13:19:20.387 4124 ERROR oslo.messaging._drivers.impl_rabbit [req-71ffb3df-f519-4468-ba48-6ede42b1eb67 7578346480624dd8bf7ad79994e9e2bf 3cd786db6f75426abf0b96c2f4d0c26f - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  325. 2017-01-19 13:19:20.413 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  326. 2017-01-19 13:19:20.414 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  327. 2017-01-19 13:19:20.421 4162 ERROR oslo.messaging._drivers.impl_rabbit [req-358655f0-550d-4131-adb9-ff5e7f3f3afe - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  328. 2017-01-19 13:19:20.422 4199 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  329. 2017-01-19 13:19:20.427 4170 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  330. 2017-01-19 13:19:20.429 4170 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  331. 2017-01-19 13:19:20.429 4170 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  332. 2017-01-19 13:19:20.430 4170 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  333. 2017-01-19 13:19:20.432 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  334. 2017-01-19 13:19:20.433 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  335. 2017-01-19 13:19:20.434 4155 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  336. 2017-01-19 13:19:20.435 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  337. 2017-01-19 13:19:20.435 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  338. 2017-01-19 13:19:20.435 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  339. 2017-01-19 13:19:20.436 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  340. 2017-01-19 13:19:20.436 4209 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  341. 2017-01-19 13:19:20.437 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  342. 2017-01-19 13:19:20.437 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  343. 2017-01-19 13:19:20.438 4217 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  344. 2017-01-19 13:19:20.438 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  345. 2017-01-19 13:19:20.439 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  346. 2017-01-19 13:19:20.440 4220 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  347. 2017-01-19 13:19:20.441 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  348. 2017-01-19 13:19:20.441 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  349. 2017-01-19 13:19:20.442 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  350. 2017-01-19 13:19:20.443 4192 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  351. 2017-01-19 13:19:20.445 4192 ERROR oslo.messaging._drivers.impl_rabbit [req-c3bdbee9-1ae9-47a5-b099-780905d17517 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  352. 2017-01-19 13:19:20.447 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  353. 2017-01-19 13:19:20.448 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  354. 2017-01-19 13:19:20.448 4175 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  355. 2017-01-19 13:19:20.448 4190 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  356. 2017-01-19 13:19:20.448 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  357. 2017-01-19 13:19:20.448 4180 ERROR oslo.messaging._drivers.impl_rabbit [req-24f85ccb-05bd-4e28-a43b-0410069dadf5 - - - - -] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  358. 2017-01-19 13:19:20.449 4154 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  359. 2017-01-19 13:19:20.449 2357 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  360. 2017-01-19 13:19:20.450 4180 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  361. 2017-01-19 13:19:20.450 4180 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
  362. 2017-01-19 13:19:20.450 4159 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.3:5673 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!