API tools faq
paste
Advertisement
metalcated

mongo db service crash after attempt to install errata

metalcated
Feb 13th, 2018
132
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 80.79 KB | None | 0 0
raw download clone embed print report
  1. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) Task RMI (succeeded): Succeeded
  2. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) sn : d44b7328-5161-4c0e-8e1a-4c2660fe6943
  3. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) origin : None
  4. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) timestamp : 2018-02-14T01:50:05Z
  5. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) user data : {'task_id': 'a7396e6b-cb65-47cd-aef4-3bb03c6a9228', 'consumer_id': 'ab5a3162-0d61-4ff6-9221-521c00f1130e'}
  6. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) retval:
  7. Feb 13 20:50:05 foreman.domain.local pulp[4136]: pulp.server.agent.direct.services:INFO: (4136-56288) {'reboot': {'scheduled': False, 'details': {}}, 'details': {'erratum': {'details': {'resolved': [], 'failed': [], 'deps': []}, 'succeeded': True}}, 'succeeded': True, 'num_changes': 0}
  8. Feb 13 20:50:05 foreman.domain.local pulp[4136]: py.warnings:WARNING: (4136-56288) /usr/lib/python2.7/site-packages/mongoengine/queryset/base.py:461: DeprecationWarning: update is deprecated. Use replace_one, update_one or update_many instead.
  9. Feb 13 20:50:05 foreman.domain.local pulp[4136]: py.warnings:WARNING: (4136-56288) upsert=upsert, **write_concern)
  10. Feb 13 20:50:05 foreman.domain.local pulp[4136]: py.warnings:WARNING: (4136-56288)
  11. Feb 13 20:50:05 foreman.domain.local systemd[1]: mongod.service: main process exited, code=exited, status=14/n/a
  12. Feb 13 20:50:05 foreman.domain.local systemd[1]: Unit mongod.service entered failed state.
  13. Feb 13 20:50:05 foreman.domain.local systemd[1]: mongod.service failed.
  14. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) {'result': {'retval': {'reboot': {'scheduled': False, 'details': {}}, 'details': {'erratum': {'details': {'resolved': [], 'failed': [], 'deps': []}, 'succeeded': True}}, 'succeeded': True, 'num_changes': 0}}, 'version': '2.0', 'routing': [None, 'pulp.task'], 'timestamp': '2018-02-14T01:50:05Z', 'data': {'task_id': 'a7396e6b-cb65-47cd-aef4-3bb03c6a9228', 'consumer_id': 'ab5a3162-0d61-4ff6-9221-521c00f1130e'}, 'sn': 'd44b7328-5161-4c0e-8e1a-4c2660fe6943'}
  15. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) Traceback (most recent call last):
  16. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/gofer/rmi/async.py", line 96, in dispatch
  17. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) reply.notify(self.listener)
  18. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/gofer/rmi/async.py", line 160, in notify
  19. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) listener.succeeded(self)
  20. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/pulp/server/agent/direct/services.py", line 199, in succeeded
  21. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) set__result=result)
  22. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 516, in update_one
  23. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) upsert=upsert, multi=False, write_concern=write_concern, **update)
  24. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/pulp/server/db/querysets.py", line 100, in update
  25. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) super(CriteriaQuerySet, self).update(*args, **kwargs)
  26. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 461, in update
  27. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) upsert=upsert, **write_concern)
  28. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 2232, in update
  29. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) check_keys, multi, manipulate, write_concern)
  30. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 709, in _update
  31. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) codec_options=self.codec_options).copy()
  32. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 216, in command
  33. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) self._raise_connection_failure(error)
  34. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 343, in _raise_connection_failure
  35. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) raise error
  36. Feb 13 20:50:05 foreman.domain.local pulp[4136]: gofer.rmi.async:ERROR: (4136-56288) AutoReconnect: connection closed
  37. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: Unhandled Exception
  38. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) localhost:27017: [Errno 111] Connection refused
  39. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) Traceback (most recent call last):
  40. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 112, in get_response
  41. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) response = wrapped_callback(request, *callback_args, **callback_kwargs)
  42. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 69, in view
  43. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return self.dispatch(request, *args, **kwargs)
  44. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 87, in dispatch
  45. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return handler(request, *args, **kwargs)
  46. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 241, in _auth_decorator
  47. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return _verify_auth(self, operation, super_user_only, method, *args, **kwargs)
  48. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 154, in _verify_auth
  49. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) login = authenticate_user()
  50. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 30, in check_preauthenticated
  51. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) userid = factory.authentication_manager().check_username_password(username)
  52. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/pulp/server/managers/auth/authentication.py", line 95, in check_username_password
  53. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) user = self._check_username_password_local(username, password)
  54. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/pulp/server/managers/auth/authentication.py", line 35, in _check_username_password_local
  55. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) user = model.User.objects(login=username).first()
  56. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  57. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) result = queryset[0]
  58. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  59. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return queryset._document._from_son(queryset._cursor[key],
  60. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  61. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) for doc in clone:
  62. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  63. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) if len(self.__data) or self._refresh():
  64. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  65. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) self.__read_concern))
  66. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  67. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) **kwargs)
  68. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  69. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) exhaust)
  70. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  71. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return func(*args, **kwargs)
  72. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  73. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) with self.get_socket(all_credentials, exhaust) as sock_info:
  74. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  75. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return self.gen.next()
  76. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  77. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  78. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  79. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return self.gen.next()
  80. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  81. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) sock_info = self._get_socket_no_auth()
  82. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  83. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) sock_info = self._check(sock_info)
  84. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  85. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) return self.connect()
  86. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  87. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) _raise_connection_failure(self.address, error)
  88. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  89. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) raise AutoReconnect(msg)
  90. Feb 13 20:50:05 foreman.domain.local pulp[4137]: pulp.server.webservices.middleware.exception:ERROR: (4137-47072) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  91. Feb 13 20:50:08 foreman.domain.local pulp[17644]: pulp.server.async.scheduler:ERROR: localhost:27017: [Errno 111] Connection refused
  92. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) Error in timer: AutoReconnect('localhost:27017: [Errno 111] Connection refused',)
  93. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) Traceback (most recent call last):
  94. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  95. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) entry()
  96. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  97. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return self.fun(*self.args, **self.kwargs)
  98. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  99. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return fun(*args, **kwargs)
  100. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  101. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) worker_watcher.handle_worker_heartbeat(name)
  102. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  103. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) existing_worker = Worker.objects(name=worker_name).first()
  104. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  105. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) result = queryset[0]
  106. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  107. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return queryset._document._from_son(queryset._cursor[key],
  108. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  109. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) for doc in clone:
  110. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  111. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) if len(self.__data) or self._refresh():
  112. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  113. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) self.__read_concern))
  114. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  115. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) **kwargs)
  116. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  117. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) exhaust)
  118. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  119. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return func(*args, **kwargs)
  120. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  121. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) with self.get_socket(all_credentials, exhaust) as sock_info:
  122. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  123. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return self.gen.next()
  124. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  125. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  126. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  127. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return self.gen.next()
  128. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  129. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) sock_info = self._get_socket_no_auth()
  130. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  131. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) sock_info = self._check(sock_info)
  132. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  133. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return self.connect()
  134. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  135. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) _raise_connection_failure(self.address, error)
  136. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  137. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) raise AutoReconnect(msg)
  138. Feb 13 20:50:09 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  139. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) Error in timer: AutoReconnect('localhost:27017: [Errno 111] Connection refused',)
  140. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) Traceback (most recent call last):
  141. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  142. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) entry()
  143. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  144. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return self.fun(*self.args, **self.kwargs)
  145. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  146. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return fun(*args, **kwargs)
  147. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  148. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) worker_watcher.handle_worker_heartbeat(name)
  149. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  150. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) existing_worker = Worker.objects(name=worker_name).first()
  151. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  152. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) result = queryset[0]
  153. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  154. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return queryset._document._from_son(queryset._cursor[key],
  155. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  156. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) for doc in clone:
  157. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  158. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) if len(self.__data) or self._refresh():
  159. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  160. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) self.__read_concern))
  161. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  162. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) **kwargs)
  163. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  164. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) exhaust)
  165. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  166. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return func(*args, **kwargs)
  167. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  168. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) with self.get_socket(all_credentials, exhaust) as sock_info:
  169. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  170. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return self.gen.next()
  171. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  172. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  173. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  174. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return self.gen.next()
  175. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  176. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) sock_info = self._get_socket_no_auth()
  177. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  178. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) sock_info = self._check(sock_info)
  179. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  180. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return self.connect()
  181. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  182. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) _raise_connection_failure(self.address, error)
  183. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  184. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) raise AutoReconnect(msg)
  185. Feb 13 20:50:10 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  186. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) Error in timer: AutoReconnect('localhost:27017: [Errno 111] Connection refused',)
  187. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) Traceback (most recent call last):
  188. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  189. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) entry()
  190. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  191. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return self.fun(*self.args, **self.kwargs)
  192. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  193. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return fun(*args, **kwargs)
  194. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  195. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) worker_watcher.handle_worker_heartbeat(name)
  196. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  197. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) existing_worker = Worker.objects(name=worker_name).first()
  198. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  199. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) result = queryset[0]
  200. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  201. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return queryset._document._from_son(queryset._cursor[key],
  202. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  203. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) for doc in clone:
  204. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  205. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) if len(self.__data) or self._refresh():
  206. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  207. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) self.__read_concern))
  208. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  209. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) **kwargs)
  210. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  211. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) exhaust)
  212. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  213. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return func(*args, **kwargs)
  214. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  215. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) with self.get_socket(all_credentials, exhaust) as sock_info:
  216. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  217. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return self.gen.next()
  218. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  219. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  220. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  221. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return self.gen.next()
  222. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  223. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) sock_info = self._get_socket_no_auth()
  224. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  225. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) sock_info = self._check(sock_info)
  226. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  227. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return self.connect()
  228. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  229. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) _raise_connection_failure(self.address, error)
  230. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  231. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) raise AutoReconnect(msg)
  232. Feb 13 20:50:10 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  233. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) Error in timer: AutoReconnect('localhost:27017: [Errno 111] Connection refused',)
  234. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) Traceback (most recent call last):
  235. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  236. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) entry()
  237. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  238. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return self.fun(*self.args, **self.kwargs)
  239. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  240. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return fun(*args, **kwargs)
  241. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  242. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) worker_watcher.handle_worker_heartbeat(name)
  243. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  244. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) existing_worker = Worker.objects(name=worker_name).first()
  245. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  246. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) result = queryset[0]
  247. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  248. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return queryset._document._from_son(queryset._cursor[key],
  249. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  250. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) for doc in clone:
  251. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  252. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) if len(self.__data) or self._refresh():
  253. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  254. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) self.__read_concern))
  255. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  256. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) **kwargs)
  257. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  258. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) exhaust)
  259. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  260. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return func(*args, **kwargs)
  261. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  262. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) with self.get_socket(all_credentials, exhaust) as sock_info:
  263. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  264. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return self.gen.next()
  265. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  266. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  267. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  268. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return self.gen.next()
  269. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  270. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) sock_info = self._get_socket_no_auth()
  271. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  272. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) sock_info = self._check(sock_info)
  273. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  274. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return self.connect()
  275. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  276. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) _raise_connection_failure(self.address, error)
  277. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  278. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) raise AutoReconnect(msg)
  279. Feb 13 20:50:10 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  280. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) Error in timer: AutoReconnect('localhost:27017: [Errno 111] Connection refused',)
  281. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) Traceback (most recent call last):
  282. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  283. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) entry()
  284. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  285. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return self.fun(*self.args, **self.kwargs)
  286. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  287. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return fun(*args, **kwargs)
  288. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  289. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) worker_watcher.handle_worker_heartbeat(name)
  290. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  291. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) existing_worker = Worker.objects(name=worker_name).first()
  292. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  293. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) result = queryset[0]
  294. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  295. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return queryset._document._from_son(queryset._cursor[key],
  296. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  297. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) for doc in clone:
  298. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  299. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) if len(self.__data) or self._refresh():
  300. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  301. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) self.__read_concern))
  302. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  303. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) **kwargs)
  304. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 794, in _send_message_with_response
  305. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) exhaust)
  306. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 805, in _reset_on_error
  307. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return func(*args, **kwargs)
  308. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 88, in send_message_with_response
  309. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) with self.get_socket(all_credentials, exhaust) as sock_info:
  310. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  311. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return self.gen.next()
  312. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/server.py", line 152, in get_socket
  313. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) with self.pool.get_socket(all_credentials, checkout) as sock_info:
  314. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
  315. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return self.gen.next()
  316. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 536, in get_socket
  317. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) sock_info = self._get_socket_no_auth()
  318. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 574, in _get_socket_no_auth
  319. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) sock_info = self._check(sock_info)
  320. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 624, in _check
  321. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return self.connect()
  322. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 509, in connect
  323. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) _raise_connection_failure(self.address, error)
  324. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 64, in _raise_connection_failure
  325. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) raise AutoReconnect(msg)
  326. Feb 13 20:50:10 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) AutoReconnect: localhost:27017: [Errno 111] Connection refused
  327. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: Unhandled Exception
  328. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) localhost:27017: [Errno 111] Connection refused
  329. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) Traceback (most recent call last):
  330. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 112, in get_response
  331. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) response = wrapped_callback(request, *callback_args, **callback_kwargs)
  332. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 69, in view
  333. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) return self.dispatch(request, *args, **kwargs)
  334. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 87, in dispatch
  335. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) return handler(request, *args, **kwargs)
  336. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 241, in _auth_decorator
  337. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) return _verify_auth(self, operation, super_user_only, method, *args, **kwargs)
  338. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 154, in _verify_auth
  339. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) login = authenticate_user()
  340. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/pulp/server/webservices/views/decorators.py", line 30, in check_preauthenticated
  341. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) userid = factory.authentication_manager().check_username_password(username)
  342. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/pulp/server/managers/auth/authentication.py", line 95, in check_username_password
  343. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) user = self._check_username_password_local(username, password)
  344. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/pulp/server/managers/auth/authentication.py", line 35, in _check_username_password_local
  345. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) user = model.User.objects(login=username).first()
  346. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  347. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) result = queryset[0]
  348. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  349. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) return queryset._document._from_son(queryset._cursor[key],
  350. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  351. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) for doc in clone:
  352. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  353. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) if len(self.__data) or self._refresh():
  354. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  355. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) self.__read_concern))
  356. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  357. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) **kwargs)
  358. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  359. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) server = topology.select_server(selector)
  360. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  361. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) address))
  362. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  363. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) self._error_message(selector))
  364. Feb 13 20:50:38 foreman.domain.local pulp[4136]: pulp.server.webservices.middleware.exception:ERROR: (4136-39776) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
  365. Feb 13 20:50:38 foreman.domain.local pulp[17644]: pulp.server.async.worker_watcher:INFO: Worker 'scheduler@foreman.domain.local' shutdown
  366. Feb 13 20:50:38 foreman.domain.local pulp[17644]: pulp.server.async.tasks:INFO: Cleaning up shutdown worker 'scheduler@foreman.domain.local'.
  367. Feb 13 20:50:38 foreman.domain.local pulp[17644]: py.warnings:WARNING: (17644-98048) /usr/lib/python2.7/site-packages/mongoengine/queryset/base.py:420: DeprecationWarning: remove is deprecated. Use delete_one or delete_many instead.
  368. Feb 13 20:50:38 foreman.domain.local pulp[17644]: py.warnings:WARNING: (17644-98048) result = queryset._collection.remove(queryset._query, **write_concern)
  369. Feb 13 20:50:38 foreman.domain.local pulp[17644]: py.warnings:WARNING: (17644-98048)
  370. Feb 13 20:50:43 foreman.domain.local pulp[17644]: pulp.server.async.scheduler:ERROR: localhost:27017: [Errno 111] Connection refused
  371. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) Error in timer: ServerSelectionTimeoutError('localhost:27017: [Errno 111] Connection refused',)
  372. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) Traceback (most recent call last):
  373. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  374. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) entry()
  375. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  376. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return self.fun(*self.args, **self.kwargs)
  377. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  378. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return fun(*args, **kwargs)
  379. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  380. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) worker_watcher.handle_worker_heartbeat(name)
  381. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  382. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) existing_worker = Worker.objects(name=worker_name).first()
  383. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  384. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) result = queryset[0]
  385. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  386. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) return queryset._document._from_son(queryset._cursor[key],
  387. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  388. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) for doc in clone:
  389. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  390. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) if len(self.__data) or self._refresh():
  391. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  392. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) self.__read_concern))
  393. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  394. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) **kwargs)
  395. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  396. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) server = topology.select_server(selector)
  397. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  398. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) address))
  399. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  400. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) self._error_message(selector))
  401. Feb 13 20:50:44 foreman.domain.local pulp[3998]: kombu.async.hub:ERROR: (3998-11008) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
  402. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) Error in timer: ServerSelectionTimeoutError('localhost:27017: [Errno 111] Connection refused',)
  403. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) Traceback (most recent call last):
  404. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  405. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) entry()
  406. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  407. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return self.fun(*self.args, **self.kwargs)
  408. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  409. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return fun(*args, **kwargs)
  410. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  411. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) worker_watcher.handle_worker_heartbeat(name)
  412. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  413. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) existing_worker = Worker.objects(name=worker_name).first()
  414. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  415. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) result = queryset[0]
  416. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  417. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) return queryset._document._from_son(queryset._cursor[key],
  418. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  419. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) for doc in clone:
  420. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  421. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) if len(self.__data) or self._refresh():
  422. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  423. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) self.__read_concern))
  424. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  425. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) **kwargs)
  426. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  427. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) server = topology.select_server(selector)
  428. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  429. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) address))
  430. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  431. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) self._error_message(selector))
  432. Feb 13 20:50:45 foreman.domain.local pulp[16807]: kombu.async.hub:ERROR: (16807-10976) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
  433. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) Error in timer: ServerSelectionTimeoutError('localhost:27017: [Errno 111] Connection refused',)
  434. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) Traceback (most recent call last):
  435. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  436. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) entry()
  437. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  438. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return self.fun(*self.args, **self.kwargs)
  439. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  440. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return fun(*args, **kwargs)
  441. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  442. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) worker_watcher.handle_worker_heartbeat(name)
  443. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  444. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) existing_worker = Worker.objects(name=worker_name).first()
  445. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  446. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) result = queryset[0]
  447. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  448. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) return queryset._document._from_son(queryset._cursor[key],
  449. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  450. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) for doc in clone:
  451. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  452. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) if len(self.__data) or self._refresh():
  453. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  454. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) self.__read_concern))
  455. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  456. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) Error in timer: ServerSelectionTimeoutError('localhost:27017: [Errno 111] Connection refused',)
  457. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) **kwargs)
  458. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) Traceback (most recent call last):
  459. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  460. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  461. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) entry()
  462. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) server = topology.select_server(selector)
  463. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  464. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  465. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return self.fun(*self.args, **self.kwargs)
  466. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  467. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) address))
  468. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return fun(*args, **kwargs)
  469. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  470. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  471. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) self._error_message(selector))
  472. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) worker_watcher.handle_worker_heartbeat(name)
  473. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  474. Feb 13 20:50:45 foreman.domain.local pulp[16798]: kombu.async.hub:ERROR: (16798-69632) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
  475. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) existing_worker = Worker.objects(name=worker_name).first()
  476. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  477. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) result = queryset[0]
  478. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  479. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) return queryset._document._from_son(queryset._cursor[key],
  480. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  481. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) for doc in clone:
  482. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  483. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) if len(self.__data) or self._refresh():
  484. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  485. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) self.__read_concern))
  486. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  487. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) **kwargs)
  488. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  489. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) server = topology.select_server(selector)
  490. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  491. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) address))
  492. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  493. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) self._error_message(selector))
  494. Feb 13 20:50:45 foreman.domain.local pulp[16801]: kombu.async.hub:ERROR: (16801-35104) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
  495. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) Error in timer: ServerSelectionTimeoutError('localhost:27017: [Errno 111] Connection refused',)
  496. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) Traceback (most recent call last):
  497. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/hub.py", line 140, in fire_timers
  498. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) entry()
  499. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 64, in __call__
  500. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return self.fun(*self.args, **self.kwargs)
  501. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/kombu/async/timer.py", line 132, in _reschedules
  502. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return fun(*args, **kwargs)
  503. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/pulp/server/async/app.py", line 117, in _record_heartbeat
  504. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) worker_watcher.handle_worker_heartbeat(name)
  505. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/pulp/server/async/worker_watcher.py", line 37, in handle_worker_heartbeat
  506. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) existing_worker = Worker.objects(name=worker_name).first()
  507. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 264, in first
  508. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) result = queryset[0]
  509. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib/python2.7/site-packages/mongoengine/queryset/base.py", line 161, in __getitem__
  510. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) return queryset._document._from_son(queryset._cursor[key],
  511. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 565, in __getitem__
  512. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) for doc in clone:
  513. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1097, in next
  514. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) if len(self.__data) or self._refresh():
  515. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 1019, in _refresh
  516. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) self.__read_concern))
  517. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/cursor.py", line 850, in __send_message
  518. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) **kwargs)
  519. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 777, in _send_message_with_response
  520. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) server = topology.select_server(selector)
  521. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 141, in select_server
  522. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) address))
  523. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) File "/usr/lib64/python2.7/site-packages/pymongo/topology.py", line 117, in select_servers
  524. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) self._error_message(selector))
  525. Feb 13 20:50:45 foreman.domain.local pulp[16804]: kombu.async.hub:ERROR: (16804-72576) ServerSelectionTimeoutError: localhost:27017: [Errno 111] Connection refused
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!