Advertisement
Guest User

Untitled

a guest
Mar 24th, 2017
108
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.64 KB | None | 0 0
  1. CELERY = dict(
  2. broker_url=[
  3. 'amqp://guest@rabbitmq1:5672',
  4. 'amqp://guest@rabbitmq2:5672',
  5. 'amqp://guest@rabbitmq3:5672',
  6. ],
  7. celery_queue_ha_policy='all',
  8. ...
  9. )
  10.  
  11. rabbitmqctl stop_app
  12.  
  13. [2017-03-17 15:10:28,084: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@rabbitmq1:5672//: [Errno 111] Connection refused.
  14. Will retry using next failover.
  15.  
  16. [2017-03-17 15:10:28,300: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'product': 'RabbitMQ', 'copyright': 'Copyright (C) 2007-2016 Pivotal Software, Inc.', 'capabilities': {'exchange_exchange_bindings': True, 'connection.blocked': True, 'authentication_failure_close': True, 'direct_reply_to': True, 'basic.nack': True, 'per_consumer_qos': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'publisher_confirms': True}, 'cluster_name': 'rabbit@rabbitmq1', 'platform': 'Erlang/OTP', 'version': '3.6.6'}, mechanisms: [u'PLAIN', u'AMQPLAIN'], locales: [u'en_US']
  17. [2017-03-17 15:10:28,302: DEBUG/MainProcess] ^-- substep ok
  18. [2017-03-17 15:10:28,303: DEBUG/MainProcess] | Consumer: Starting Mingle
  19. [2017-03-17 15:10:28,303: INFO/MainProcess] mingle: searching for neighbors
  20. [2017-03-17 15:10:28,303: DEBUG/MainProcess] using channel_id: 1
  21. [2017-03-17 15:10:28,318: DEBUG/MainProcess] Channel open
  22. [2017-03-17 15:10:28,470: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
  23. Traceback (most recent call last):
  24. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/consumer.py", line 318, in start
  25. blueprint.start(self)
  26. File "/usr/local/lib/python2.7/site-packages/celery/bootsteps.py", line 119, in start
  27. step.start(parent)
  28. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 38, in start
  29. self.sync(c)
  30. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 42, in sync
  31. replies = self.send_hello(c)
  32. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 55, in send_hello
  33. replies = inspect.hello(c.hostname, our_revoked._data) or {}
  34. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 129, in hello
  35. return self._request('hello', from_node=from_node, revoked=revoked)
  36. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 81, in _request
  37. timeout=self.timeout, reply=True,
  38. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 436, in broadcast
  39. limit, callback, channel=channel,
  40. File "/usr/local/lib/python2.7/site-packages/kombu/pidbox.py", line 315, in _broadcast
  41. serializer=serializer)
  42. File "/usr/local/lib/python2.7/site-packages/kombu/pidbox.py", line 290, in _publish
  43. serializer=serializer,
  44. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 181, in publish
  45. exchange_name, declare,
  46. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 187, in _publish
  47. channel = self.channel
  48. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 209, in _get_channel
  49. channel = self._channel = channel()
  50. File "/usr/local/lib/python2.7/site-packages/kombu/utils/functional.py", line 38, in __call__
  51. value = self.__value__ = self.__contract__()
  52. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 224, in <lambda>
  53. channel = ChannelPromise(lambda: connection.default_channel)
  54. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 819, in default_channel
  55. self.connection
  56. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 802, in connection
  57. self._connection = self._establish_connection()
  58. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 757, in _establish_connection
  59. conn = self.transport.establish_connection()
  60. File "/usr/local/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection
  61. conn.connect()
  62. File "/usr/local/lib/python2.7/site-packages/amqp/connection.py", line 294, in connect
  63. self.transport.connect()
  64. File "/usr/local/lib/python2.7/site-packages/amqp/transport.py", line 120, in connect
  65. self._connect(self.host, self.port, self.connect_timeout)
  66. File "/usr/local/lib/python2.7/site-packages/amqp/transport.py", line 161, in _connect
  67. self.sock.connect(sa)
  68. File "/usr/local/lib/python2.7/socket.py", line 228, in meth
  69. return getattr(self._sock,name)(*args)
  70. error: [Errno 111] Connection refused
  71. [2017-03-17 15:10:28,508: DEBUG/MainProcess] Closed channel #1
  72. [2017-03-17 15:10:28,570: DEBUG/MainProcess] | Consumer: Restarting event loop...
  73. [2017-03-17 15:10:28,572: DEBUG/MainProcess] | Consumer: Restarting Gossip...
  74. [2017-03-17 15:10:28,575: DEBUG/MainProcess] | Consumer: Restarting Heart...
  75. [2017-03-17 15:10:28,648: DEBUG/MainProcess] | Consumer: Restarting Control...
  76. [2017-03-17 15:10:28,655: DEBUG/MainProcess] | Consumer: Restarting Tasks...
  77. [2017-03-17 15:10:28,655: DEBUG/MainProcess] Canceling task consumer...
  78. [2017-03-17 15:10:28,655: DEBUG/MainProcess] | Consumer: Restarting Mingle...
  79. [2017-03-17 15:10:28,655: DEBUG/MainProcess] | Consumer: Restarting Events...
  80. [2017-03-17 15:10:28,672: DEBUG/MainProcess] | Consumer: Restarting Connection...
  81. [2017-03-17 15:10:28,673: DEBUG/MainProcess] | Consumer: Starting Connection
  82. [2017-03-17 15:10:28,947: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@rabbitmq1:5672//: [Errno 111] Connection refused.
  83. Will retry using next failover.
  84.  
  85. [2017-03-17 15:10:29,345: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'product': 'RabbitMQ', 'copyright': 'Copyright (C) 2007-2016 Pivotal Software, Inc.', 'capabilities': {'exchange_exchange_bindings': True, 'connection.blocked': True, 'authentication_failure_close': True, 'direct_reply_to': True, 'basic.nack': True, 'per_consumer_qos': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'publisher_confirms': True}, 'cluster_name': 'rabbit@rabbitmq1', 'platform': 'Erlang/OTP', 'version': '3.6.6'}, mechanisms: [u'PLAIN', u'AMQPLAIN'], locales: [u'en_US']
  86. [2017-03-17 15:10:29,506: INFO/MainProcess] Connected to amqp://guest:**@rabbitmq2:5672//
  87. [2017-03-17 15:10:29,535: DEBUG/MainProcess] ^-- substep ok
  88. [2017-03-17 15:10:29,569: DEBUG/MainProcess] | Consumer: Starting Events
  89. [2017-03-17 15:10:29,682: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@rabbitmq1:5672//: [Errno 111] Connection refused.
  90. Will retry using next failover.
  91.  
  92. [2017-03-17 15:10:29,740: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'product': 'RabbitMQ', 'copyright': 'Copyright (C) 2007-2016 Pivotal Software, Inc.', 'capabilities': {'exchange_exchange_bindings': True, 'connection.blocked': True, 'authentication_failure_close': True, 'direct_reply_to': True, 'basic.nack': True, 'per_consumer_qos': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'publisher_confirms': True}, 'cluster_name': 'rabbit@rabbitmq1', 'platform': 'Erlang/OTP', 'version': '3.6.6'}, mechanisms: [u'PLAIN', u'AMQPLAIN'], locales: [u'en_US']
  93. [2017-03-17 15:10:29,768: DEBUG/MainProcess] ^-- substep ok
  94. [2017-03-17 15:10:29,770: DEBUG/MainProcess] | Consumer: Starting Mingle
  95. [2017-03-17 15:10:29,770: INFO/MainProcess] mingle: searching for neighbors
  96. [2017-03-17 15:10:29,771: DEBUG/MainProcess] using channel_id: 1
  97. [2017-03-17 15:10:29,795: DEBUG/MainProcess] Channel open
  98. [2017-03-17 15:10:29,874: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
  99. Traceback (most recent call last):
  100. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/consumer.py", line 318, in start
  101. blueprint.start(self)
  102. File "/usr/local/lib/python2.7/site-packages/celery/bootsteps.py", line 119, in start
  103. step.start(parent)
  104. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 38, in start
  105. self.sync(c)
  106. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 42, in sync
  107. replies = self.send_hello(c)
  108. File "/usr/local/lib/python2.7/site-packages/celery/worker/consumer/mingle.py", line 55, in send_hello
  109. replies = inspect.hello(c.hostname, our_revoked._data) or {}
  110. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 129, in hello
  111. return self._request('hello', from_node=from_node, revoked=revoked)
  112. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 81, in _request
  113. timeout=self.timeout, reply=True,
  114. File "/usr/local/lib/python2.7/site-packages/celery/app/control.py", line 436, in broadcast
  115. limit, callback, channel=channel,
  116. File "/usr/local/lib/python2.7/site-packages/kombu/pidbox.py", line 315, in _broadcast
  117. serializer=serializer)
  118. File "/usr/local/lib/python2.7/site-packages/kombu/pidbox.py", line 290, in _publish
  119. serializer=serializer,
  120. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 181, in publish
  121. exchange_name, declare,
  122. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 187, in _publish
  123. channel = self.channel
  124. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 209, in _get_channel
  125. channel = self._channel = channel()
  126. File "/usr/local/lib/python2.7/site-packages/kombu/utils/functional.py", line 38, in __call__
  127. value = self.__value__ = self.__contract__()
  128. File "/usr/local/lib/python2.7/site-packages/kombu/messaging.py", line 224, in <lambda>
  129. channel = ChannelPromise(lambda: connection.default_channel)
  130. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 819, in default_channel
  131. self.connection
  132. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 802, in connection
  133. self._connection = self._establish_connection()
  134. File "/usr/local/lib/python2.7/site-packages/kombu/connection.py", line 757, in _establish_connection
  135. conn = self.transport.establish_connection()
  136. File "/usr/local/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection
  137. conn.connect()
  138. File "/usr/local/lib/python2.7/site-packages/amqp/connection.py", line 294, in connect
  139. self.transport.connect()
  140. File "/usr/local/lib/python2.7/site-packages/amqp/transport.py", line 120, in connect
  141. self._connect(self.host, self.port, self.connect_timeout)
  142. File "/usr/local/lib/python2.7/site-packages/amqp/transport.py", line 161, in _connect
  143. self.sock.connect(sa)
  144. File "/usr/local/lib/python2.7/socket.py", line 228, in meth
  145. return getattr(self._sock,name)(*args)
  146. error: [Errno 111] Connection refused
  147. [2017-03-17 15:10:29,887: DEBUG/MainProcess] Closed channel #1
  148. [2017-03-17 15:10:29,907: DEBUG/MainProcess] | Consumer: Restarting event loop...
  149. [2017-03-17 15:10:29,908: DEBUG/MainProcess] | Consumer: Restarting Gossip...
  150. [2017-03-17 15:10:29,908: DEBUG/MainProcess] | Consumer: Restarting Heart...
  151. [2017-03-17 15:10:29,908: DEBUG/MainProcess] | Consumer: Restarting Control...
  152. [2017-03-17 15:10:29,909: DEBUG/MainProcess] | Consumer: Restarting Tasks...
  153. [2017-03-17 15:10:29,910: DEBUG/MainProcess] Canceling task consumer...
  154. [2017-03-17 15:10:29,911: DEBUG/MainProcess] | Consumer: Restarting Mingle...
  155. [2017-03-17 15:10:29,912: DEBUG/MainProcess] | Consumer: Restarting Events...
  156. [2017-03-17 15:10:29,953: DEBUG/MainProcess] | Consumer: Restarting Connection...
  157. [2017-03-17 15:10:29,954: DEBUG/MainProcess] | Consumer: Starting Connection
  158. [2017-03-17 15:10:30,036: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@rabbitmq1:5672//: [Errno 111] Connection refused.
  159. Will retry using next failover.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement