Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2016-03-24 14:09:40.876 5012 INFO neutron.common.config [-] Logging enabled!
- 2016-03-24 14:09:40.876 5012 INFO neutron.common.config [-] /usr/bin/neutron-l3-agent version 7.0.1
- 2016-03-24 14:09:40.960 5012 WARNING oslo_config.cfg [-] Option "use_namespaces" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-24 14:09:40.970 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 14:09:40.985 5012 ERROR oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-24 14:09:42.002 5012 ERROR oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-24 14:09:43.019 5012 ERROR oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-24 14:09:44.044 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Reconnected to AMQP server on 172.16.91.143:5672
- 2016-03-24 14:09:44.046 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Connected to AMQP server on 172.16.91.143:5672
- 2016-03-24 14:09:44.059 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 14:09:44.076 5012 ERROR oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-24 14:09:45.093 5012 ERROR oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-24 14:09:46.121 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Reconnected to AMQP server on 172.16.91.142:5672
- 2016-03-24 14:09:46.123 5012 INFO oslo.messaging._drivers.impl_rabbit [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] Connected to AMQP server on 172.16.91.142:5672
- 2016-03-24 14:10:46.134 5012 WARNING neutron.agent.l3.agent [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] l3-agent cannot check service plugins enabled on the neutron server. Retrying. Detail message: Timed out waiting for a reply to message ID 3670f79e551e4d199460600f76ae87ac
- 2016-03-24 14:11:46.140 5012 WARNING neutron.agent.l3.agent [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] l3-agent cannot check service plugins enabled on the neutron server. Retrying. Detail message: Timed out waiting for a reply to message ID b92a1e940e0042869ee4768e7f0569a7
- 2016-03-24 14:12:46.146 5012 WARNING neutron.agent.l3.agent [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] l3-agent cannot check service plugins enabled on the neutron server. Retrying. Detail message: Timed out waiting for a reply to message ID cb081ed1dcec405f826b2646ec716ed7
- 2016-03-24 14:13:46.152 5012 WARNING neutron.agent.l3.agent [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] l3-agent cannot check service plugins enabled on the neutron server. Retrying. Detail message: Timed out waiting for a reply to message ID 46ebf56840f34b1c942bbb213e685f8e
- 2016-03-24 14:14:46.159 5012 CRITICAL neutron [req-87a07f82-f741-4094-b75e-ffd573427afb - - - - -] MessagingTimeout: Timed out waiting for a reply to message ID 8761dddb330f40c79d1bbf362c3eda72
- 2016-03-24 14:14:46.159 5012 ERROR neutron Traceback (most recent call last):
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/bin/neutron-l3-agent", line 10, in <module>
- 2016-03-24 14:14:46.159 5012 ERROR neutron sys.exit(main())
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/cmd/eventlet/agents/l3.py", line 17, in main
- 2016-03-24 14:14:46.159 5012 ERROR neutron l3_agent.main()
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/agent/l3_agent.py", line 53, in main
- 2016-03-24 14:14:46.159 5012 ERROR neutron manager=manager)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/service.py", line 301, in create
- 2016-03-24 14:14:46.159 5012 ERROR neutron periodic_fuzzy_delay=periodic_fuzzy_delay)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/service.py", line 234, in __init__
- 2016-03-24 14:14:46.159 5012 ERROR neutron self.manager = manager_class(host=host, *args, **kwargs)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 613, in __init__
- 2016-03-24 14:14:46.159 5012 ERROR neutron super(L3NATAgentWithStateReport, self).__init__(host=host, conf=conf)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 217, in __init__
- 2016-03-24 14:14:46.159 5012 ERROR neutron continue
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
- 2016-03-24 14:14:46.159 5012 ERROR neutron six.reraise(self.type_, self.value, self.tb)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 197, in __init__
- 2016-03-24 14:14:46.159 5012 ERROR neutron self.plugin_rpc.get_service_plugin_list(self.context))
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 129, in get_service_plugin_list
- 2016-03-24 14:14:46.159 5012 ERROR neutron return cctxt.call(context, 'get_service_plugin_list')
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
- 2016-03-24 14:14:46.159 5012 ERROR neutron retry=self.retry)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
- 2016-03-24 14:14:46.159 5012 ERROR neutron timeout=timeout, retry=retry)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
- 2016-03-24 14:14:46.159 5012 ERROR neutron retry=retry)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
- 2016-03-24 14:14:46.159 5012 ERROR neutron result = self._waiter.wait(msg_id, timeout)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
- 2016-03-24 14:14:46.159 5012 ERROR neutron message = self.waiters.get(msg_id, timeout=timeout)
- 2016-03-24 14:14:46.159 5012 ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
- 2016-03-24 14:14:46.159 5012 ERROR neutron 'to message ID %s' % msg_id)
- 2016-03-24 14:14:46.159 5012 ERROR neutron MessagingTimeout: Timed out waiting for a reply to message ID 8761dddb330f40c79d1bbf362c3eda72
- 2016-03-24 14:14:46.159 5012 ERROR neutron
- 2016-03-24 15:38:20.357 7374 INFO neutron.common.config [-] Logging enabled!
- 2016-03-24 15:38:20.366 7374 INFO neutron.common.config [-] /usr/bin/neutron-l3-agent version 7.0.1
- 2016-03-24 15:38:20.452 7374 WARNING oslo_config.cfg [-] Option "use_namespaces" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-24 15:38:20.460 7374 INFO oslo.messaging._drivers.impl_rabbit [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.477 7374 INFO oslo.messaging._drivers.impl_rabbit [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.491 7374 INFO oslo.messaging._drivers.impl_rabbit [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.506 7374 INFO oslo.messaging._drivers.impl_rabbit [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.562 7374 WARNING oslo_config.cfg [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Option "external_network_bridge" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-24 15:38:20.586 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.598 7374 WARNING oslo_log.versionutils [-] Deprecated: WritableLogger() is deprecated as of Liberty and may be removed in Mitaka. It will not be superseded.
- 2016-03-24 15:38:20.599 7374 INFO eventlet.wsgi.server [-] (7374) wsgi starting up on http:///:v/
- 2016-03-24 15:38:20.602 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.645 7374 INFO neutron.agent.l3.agent [-] L3 agent started
- 2016-03-24 15:38:20.656 7374 INFO oslo.messaging._drivers.impl_rabbit [req-4a3412a4-2cf4-4cab-ba1e-0276a3255853 - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-24 15:38:20.677 7374 INFO oslo.messaging._drivers.impl_rabbit [req-4a3412a4-2cf4-4cab-ba1e-0276a3255853 - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 15:43:38.366 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.
- 2016-03-25 15:43:38.489 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.
- 2016-03-25 15:43:44.229 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:43:44.382 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: timed out. Trying again in 1 seconds.
- 2016-03-25 15:43:44.505 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: timed out. Trying again in 1 seconds.
- 2016-03-25 15:43:50.400 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.143:5672 is unreachable: timed out. Trying again in 1 seconds.
- 2016-03-25 15:43:50.519 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.142:5672 is unreachable: timed out. Trying again in 1 seconds.
- 2016-03-25 15:43:56.416 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: timed out. Trying again in 2 seconds.
- 2016-03-25 15:43:56.534 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: timed out. Trying again in 2 seconds.
- 2016-03-25 15:43:59.230 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:44:01.448 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 15:44:01.570 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 15:44:04.012 7374 WARNING oslo.service.loopingcall [-] Function 'neutron.agent.l3.agent.L3NATAgentWithStateReport._report_state' run outlasted interval by 73.00 sec
- 2016-03-25 15:44:14.231 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:44:29.233 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:44:44.236 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:44:59.238 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:45:14.239 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:45:29.241 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:45:44.242 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:45:59.243 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:46:14.244 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:46:29.245 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:46:44.246 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:46:59.247 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:47:14.247 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:47:29.248 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:47:44.249 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:47:59.250 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:48:14.251 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:48:29.252 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:48:44.254 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:48:59.254 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:49:14.255 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:49:29.257 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:49:44.259 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:49:59.260 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:50:14.262 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:50:29.264 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:50:44.265 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:50:59.266 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:51:14.267 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:51:29.268 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:51:44.270 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:51:59.271 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:52:14.273 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:52:29.274 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:52:44.275 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:52:59.276 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:53:14.278 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:53:29.279 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:53:44.280 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:53:59.281 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:54:14.282 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:54:29.284 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:54:44.286 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:54:57.762 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.
- 2016-03-25 15:54:57.862 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.
- 2016-03-25 15:54:58.778 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-25 15:54:58.873 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-25 15:54:59.287 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:54:59.807 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.142:5672
- 2016-03-25 15:54:59.895 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.142:5672
- 2016-03-25 15:55:04.019 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.
- 2016-03-25 15:55:05.036 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-25 15:55:06.054 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.141:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-25 15:55:07.077 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.143:5672
- 2016-03-25 15:55:14.288 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:55:29.289 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed
- 2016-03-25 15:55:44.290 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
- 2016-03-25 15:55:59.306 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 111] ECONNREFUSED
- 2016-03-25 15:56:14.323 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 111] ECONNREFUSED
- 2016-03-25 15:56:29.338 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 111] ECONNREFUSED
- 2016-03-25 15:56:34.021 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.143:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.
- 2016-03-25 15:56:35.039 7374 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 172.16.91.143:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
- 2016-03-25 15:56:36.059 7374 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.142:5672
- 2016-03-25 15:56:44.355 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 111] ECONNREFUSED
- 2016-03-25 15:56:59.372 7374 INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 111] ECONNREFUSED
- 2016-03-25 17:14:56.541 7374 INFO oslo_service.service [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] Caught SIGTERM, exiting
- 2016-03-25 17:14:56.542 7374 WARNING oslo_messaging.server [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] start/stop/wait must be called in the same thread
- 2016-03-25 17:14:56.543 7374 WARNING oslo_messaging.server [req-52d89dcf-2823-4ae8-97c5-1e0dd8ff522e - - - - -] start/stop/wait must be called in the same thread
- 2016-03-25 17:17:02.904 7152 INFO neutron.common.config [-] Logging enabled!
- 2016-03-25 17:17:02.904 7152 INFO neutron.common.config [-] /usr/bin/neutron-l3-agent version 7.0.1
- 2016-03-25 17:17:02.939 7152 WARNING oslo_config.cfg [-] Option "use_namespaces" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-25 17:17:02.946 7152 INFO oslo.messaging._drivers.impl_rabbit [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:17:02.962 7152 INFO oslo.messaging._drivers.impl_rabbit [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:17:02.974 7152 INFO oslo.messaging._drivers.impl_rabbit [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:17:02.989 7152 INFO oslo.messaging._drivers.impl_rabbit [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:17:04.040 7152 WARNING oslo_config.cfg [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Option "external_network_bridge" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-25 17:17:04.076 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:17:04.093 7152 WARNING oslo_log.versionutils [-] Deprecated: WritableLogger() is deprecated as of Liberty and may be removed in Mitaka. It will not be superseded.
- 2016-03-25 17:17:04.093 7152 INFO eventlet.wsgi.server [-] (7152) wsgi starting up on http:///:v/
- 2016-03-25 17:17:04.096 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent [-] Failed reporting state!
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent Traceback (most recent call last):
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 659, in _report_state
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent self.use_call)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/rpc.py", line 86, in report_state
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent return method(context, 'report_state', **kwargs)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent retry=self.retry)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent timeout=timeout, retry=retry)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent retry=retry)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent result = self._waiter.wait(msg_id, timeout)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent message = self.waiters.get(msg_id, timeout=timeout)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent 'to message ID %s' % msg_id)
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent MessagingTimeout: Timed out waiting for a reply to message ID a23fa5207d9b440183833eb78c9ef8fa
- 2016-03-25 17:18:04.095 7152 ERROR neutron.agent.l3.agent
- 2016-03-25 17:18:04.133 7152 WARNING oslo.service.loopingcall [-] Function 'neutron.agent.l3.agent.L3NATAgentWithStateReport._report_state' run outlasted interval by 30.07 sec
- 2016-03-25 17:19:21.116 7152 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : a23fa5207d9b440183833eb78c9ef8fa
- 2016-03-25 17:19:21.118 7152 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : a23fa5207d9b440183833eb78c9ef8fa
- 2016-03-25 17:20:04.099 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:20:05.121 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:23:05.123 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:23:06.144 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:26:06.145 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:26:07.165 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:29:07.167 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:29:08.189 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:32:08.190 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:32:09.211 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:35:09.212 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:35:10.233 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:38:10.234 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:38:11.256 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:41:11.258 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:41:12.278 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:44:12.280 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:44:13.303 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:47:13.304 7152 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:47:14.324 7152 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:49:36.462 7152 INFO oslo_service.service [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] Caught SIGTERM, exiting
- 2016-03-25 17:49:36.463 7152 WARNING oslo_messaging.server [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] start/stop/wait must be called in the same thread
- 2016-03-25 17:49:36.463 7152 WARNING oslo_messaging.server [req-7fd4cd0a-123f-4cca-b2f8-e30324d38866 - - - - -] start/stop/wait must be called in the same thread
- 2016-03-25 17:52:21.417 21291 INFO neutron.common.config [-] Logging enabled!
- 2016-03-25 17:52:21.417 21291 INFO neutron.common.config [-] /usr/bin/neutron-l3-agent version 7.0.1
- 2016-03-25 17:52:21.452 21291 WARNING oslo_config.cfg [-] Option "use_namespaces" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-25 17:52:21.460 21291 INFO oslo.messaging._drivers.impl_rabbit [req-1790f83a-e4d8-46a5-95a4-17370954df0d - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:52:21.477 21291 INFO oslo.messaging._drivers.impl_rabbit [req-1790f83a-e4d8-46a5-95a4-17370954df0d - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:52:21.494 21291 INFO oslo.messaging._drivers.impl_rabbit [req-1790f83a-e4d8-46a5-95a4-17370954df0d - - - - -] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:52:21.519 21291 INFO oslo.messaging._drivers.impl_rabbit [req-1790f83a-e4d8-46a5-95a4-17370954df0d - - - - -] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:52:21.570 21291 WARNING oslo_config.cfg [req-1790f83a-e4d8-46a5-95a4-17370954df0d - - - - -] Option "external_network_bridge" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
- 2016-03-25 17:52:21.599 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:52:21.614 21291 WARNING oslo_log.versionutils [-] Deprecated: WritableLogger() is deprecated as of Liberty and may be removed in Mitaka. It will not be superseded.
- 2016-03-25 17:52:21.614 21291 INFO eventlet.wsgi.server [-] (21291) wsgi starting up on http:///:v/
- 2016-03-25 17:52:21.618 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:55:21.619 21291 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:55:22.641 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 17:58:22.642 21291 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 17:58:23.664 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 18:01:23.665 21291 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 18:01:24.687 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 18:04:24.688 21291 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 18:04:25.707 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
- 2016-03-25 18:07:25.709 21291 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server 172.16.91.141:5672 closed the connection. Check login credentials: Socket closed
- 2016-03-25 18:07:26.730 21291 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnected to AMQP server on 172.16.91.141:5672
Advertisement
Add Comment
Please, Sign In to add comment