API tools faq
paste
Guest User

aimes_error

a guest
Feb 27th, 2015
211
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.37 KB | None | 0 0
raw download clone embed print report
  1. Enacting Execution Strategy
  2. ================================================================================
  3.  
  4. Resource overlay
  5. Execution session created : UID 54efa8f3debaf246be4711e2
  6. Credentials for target resources : ***
  7. Pilot Manager Initialized : UID 54efa8f3debaf246be4711e3
  8. Total number of cores : 21
  9. Total number of pilots : 0
  10.  
  11. Pilot descriptions
  12.  
  13. CUs descriptions for Stage_1
  14. Tasks translated into CUs : Stage_1_Stage_1_0 : Stage_1_Stage_1_1 : Stage_1_Stage_1_2 : Stage_1_Stage_1_3 : Stage_1_Stage_1_4 : Stage_1_Stage_1_5 : Stage_1_Stage_1_6 : Stage_1_Stage_1_7 : Stage_1_Stage_1_8 : Stage_1_Stage_1_9 : Stage_1_Stage_1_10 : Stage_1_Stage_1_11 : Stage_1_Stage_1_12 : Stage_1_Stage_1_13 : StException in thread OutputFileTransferWorker-1:
  15. Traceback (most recent call last):
  16. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  17. self.run()
  18. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/output_file_transfer_worker.py", line 261, in run
  19. "statehistory": {"state": DONE, "timestamp": ts}
  20. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/collection.py", line 1738, in find_and_modify
  21. **kwargs)
  22. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 439, in command
  23. uuid_subtype, compile_re, **kwargs)[0]
  24. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 338, in _command
  25. for doc in cursor:
  26. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  27. if len(self.__data) or self._refresh():
  28. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  29. self.__uuid_subtype))
  30. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  31. res = client._send_message_with_response(message, **kwargs)
  32. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1217, in _send_message_with_response
  33. raise AutoReconnect(str(e))
  34. AutoReconnect: [Errno 22] Invalid argument
  35.  
  36. Exception in thread OutputFileTransferWorker-2:
  37. Traceback (most recent call last):
  38. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  39. self.run()
  40. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/output_file_transfer_worker.py", line 96, in run
  41. limit=BULK_LIMIT
  42. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/collection.py", line 1738, in find_and_modify
  43. **kwargs)
  44. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 439, in command
  45. uuid_subtype, compile_re, **kwargs)[0]
  46. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 338, in _command
  47. for doc in cursor:
  48. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  49. if len(self.__data) or self._refresh():
  50. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  51. self.__uuid_subtype))
  52. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  53. res = client._send_message_with_response(message, **kwargs)
  54. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1217, in _send_message_with_response
  55. raise AutoReconnect(str(e))
  56. AutoReconnect: [Errno 22] Invalid argument
  57.  
  58. Exception in thread PilotLauncherWorker-1:
  59. Traceback (most recent call last):
  60. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  61. self.run()
  62. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/pilot_launcher_worker.py", line 294, in run
  63. limit=BULK_LIMIT
  64. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/collection.py", line 1738, in find_and_modify
  65. **kwargs)
  66. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 439, in command
  67. uuid_subtype, compile_re, **kwargs)[0]
  68. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/database.py", line 338, in _command
  69. for doc in cursor:
  70. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  71. if len(self.__data) or self._refresh():
  72. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  73. self.__uuid_subtype))
  74. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  75. res = client._send_message_with_response(message, **kwargs)
  76. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1217, in _send_message_with_response
  77. raise AutoReconnect(str(e))
  78. AutoReconnect: [Errno 22] Invalid argument
  79.  
  80. Exception in thread Thread-1:
  81. Traceback (most recent call last):
  82. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  83. self.run()
  84. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/pilot_manager_controller.py", line 297, in run
  85. pilot_list = self._db.get_pilots(pilot_manager_id=self._pm_id)
  86. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/db/database.py", line 418, in get_pilots
  87. for obj in cursor:
  88. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  89. if len(self.__data) or self._refresh():
  90. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  91. self.__uuid_subtype))
  92. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  93. res = client._send_message_with_response(message, **kwargs)
  94. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1217, in _send_message_with_response
  95. raise AutoReconnect(str(e))
  96. AutoReconnect: [Errno 110] Connection timed out
  97.  
  98. Exception in thread InputFileTransferWorker-1:
  99. Traceback (most recent call last):
  100. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  101. self.run()
  102. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/input_file_transfer_worker.py", line 288, in run
  103. self._session.close (cleanup=False)
  104. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/session.py", line 279, in close
  105. pmgr.close (terminate=terminate)
  106. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 168, in close
  107. self.cancel_pilots ()
  108. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 543, in cancel_pilots
  109. self._worker.register_cancel_pilots_request(pilot_ids=pilot_ids)
  110. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/pilot_manager_controller.py", line 484, in register_cancel_pilots_request
  111. for pilot in self._db.get_pilots(pilot_manager_id=self._pm_id) :
  112. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/db/database.py", line 418, in get_pilots
  113. for obj in cursor:
  114. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  115. if len(self.__data) or self._refresh():
  116. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  117. self.__uuid_subtype))
  118. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  119. res = client._send_message_with_response(message, **kwargs)
  120. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1198, in _send_message_with_response
  121. member = self.__ensure_member()
  122. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 813, in __ensure_member
  123. member, nodes = self.__find_node()
  124. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 904, in __find_node
  125. raise AutoReconnect(', '.join(errors))
  126. AutoReconnect: timed out
  127.  
  128. Exception in thread InputFileTransferWorker-2:
  129. Traceback (most recent call last):
  130. File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
  131. self.run()
  132. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/input_file_transfer_worker.py", line 288, in run
  133. self._session.close (cleanup=False)
  134. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/session.py", line 279, in close
  135. pmgr.close (terminate=terminate)
  136. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 168, in close
  137. self.cancel_pilots ()
  138. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 543, in cancel_pilots
  139. self._worker.register_cancel_pilots_request(pilot_ids=pilot_ids)
  140. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/controller/pilot_manager_controller.py", line 484, in register_cancel_pilots_request
  141. for pilot in self._db.get_pilots(pilot_manager_id=self._pm_id) :
  142. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/radical/pilot/db/database.py", line 418, in get_pilots
  143. for obj in cursor:
  144. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1076, in next
  145. if len(self.__data) or self._refresh():
  146. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 1020, in _refresh
  147. self.__uuid_subtype))
  148. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/cursor.py", line 933, in __send_message
  149. res = client._send_message_with_response(message, **kwargs)
  150. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 1198, in _send_message_with_response
  151. member = self.__ensure_member()
  152. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 798, in __ensure_member
  153. return future.result()
  154. File "/home/yadu/Virtualenvs/AIMES-DEMO-SC2014/local/lib/python2.7/site-packages/pymongo/thread_util.py", line 214, in result
  155. raise self._exception
  156. AutoReconnect: timed out
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!