API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Sep 18th, 2014
266
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 54.08 KB | None | 0 0
raw download clone embed print report
  1. Sep 16 04:04:45 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-15 22:04:45,758: WARNING/Worker-3] Destroying payrollhero-website_v14.web.2
  2. Sep 16 04:04:45 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-15 22:04:45,919: WARNING/Worker-3] Destroying payrollhero-website_v14.web.1
  3. Sep 16 04:04:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.2-announce.service
  4. Sep 16 04:04:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.1-announce.service
  5. Sep 16 04:04:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.2.service
  6. Sep 16 04:04:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.1.service
  7. Sep 16 04:04:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.2-log.service
  8. Sep 16 04:04:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed payrollhero-website_v14.web.1-log.service
  9. Sep 16 04:04:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-15 22:04:47,123: INFO/MainProcess] Task api.tasks.deploy_release[c22c058a-5f72-44e4-9675-dd30cfaafcdc] succeeded in 164.876085452s: None
  10. Sep 17 01:02:59 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:02:59 [27582] [DEBUG] GET /api/auth/login/
  11. Sep 17 01:03:00 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:03:00 [105] [DEBUG] POST /api/auth/login/
  12. Sep 17 01:11:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:11:55 [21052] [DEBUG] POST /api/auth/register
  13. Sep 17 01:11:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:11:55 [15325] [DEBUG] GET /api/auth/login/
  14. Sep 17 01:11:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:11:56 [27582] [DEBUG] POST /api/auth/login/
  15. Sep 17 01:12:22 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:12:22 [25915] [DEBUG] POST /api/keys
  16. Sep 17 01:12:52 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:12:52 [25915] [DEBUG] GET /api/auth/login/
  17. Sep 17 01:12:52 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:12:52 [13353] [DEBUG] POST /api/auth/login/
  18. Sep 17 01:13:00 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:13:00 [23520] [DEBUG] POST /api/apps/photo-verification/perms
  19. Sep 17 01:13:00 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: User nsuria was granted access to photo-verification
  20. Sep 17 01:18:12 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:18:12 [23520] [DEBUG] POST /api/hooks/push
  21. Sep 17 01:18:13 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:18:13 [23520] [DEBUG] POST /api/hooks/config
  22. Sep 17 01:20:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:20:27 [105] [DEBUG] POST /api/hooks/push
  23. Sep 17 01:20:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:20:27 [105] [DEBUG] POST /api/hooks/config
  24. Sep 17 01:22:30 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:22:30 [105] [DEBUG] POST /api/hooks/push
  25. Sep 17 01:22:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:22:31 [105] [DEBUG] POST /api/hooks/config
  26. Sep 17 01:24:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:24:47 [459] [DEBUG] GET /api/apps/photo-verification/config
  27. Sep 17 01:29:44 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:29:44 [25915] [DEBUG] POST /api/hooks/push
  28. Sep 17 01:29:45 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:29:45 [105] [DEBUG] POST /api/hooks/config
  29. Sep 17 01:30:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:30:32 [15325] [DEBUG] GET /api/apps/photo-verification/config
  30. Sep 17 01:37:40 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:37:40 [15325] [DEBUG] POST /api/hooks/push
  31. Sep 17 01:37:40 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:37:40 [21052] [DEBUG] POST /api/hooks/config
  32. Sep 17 01:40:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:40:01 [13353] [DEBUG] POST /api/hooks/build
  33. Sep 17 01:40:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-ec4edb1 created
  34. Sep 17 01:40:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v100 created
  35. Sep 17 01:40:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 19:40:01,239: INFO/MainProcess] Received task: api.tasks.deploy_release[3a294249-7d8f-4563-99ed-e3d9a3b22e5d]
  36. Sep 17 01:40:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 19:40:01,274: WARNING/Worker-7] Creating photo-verification_v100.web.1
  37. Sep 17 01:40:02 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 19:40:02,877: WARNING/Worker-7] Starting photo-verification_v100.web.1
  38. Sep 17 01:40:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v100.web.1.service start
  39. Sep 17 01:40:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v100.web.1-log.service start
  40. Sep 17 01:40:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v100.web.1-announce.service start
  41. Sep 17 01:40:37 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 19:40:37,507: WARNING/Worker-7] Destroying photo-verification_v99.web.1
  42. Sep 17 01:40:37 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v99.web.1-announce.service
  43. Sep 17 01:40:38 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v99.web.1.service
  44. Sep 17 01:40:38 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v99.web.1-log.service
  45. Sep 17 01:40:38 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 19:40:38,627: INFO/MainProcess] Task api.tasks.deploy_release[3a294249-7d8f-4563-99ed-e3d9a3b22e5d] succeeded in 37.3850602149s: None
  46. Sep 17 01:57:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:57:51 [21052] [DEBUG] POST /api/apps/photo-verification/logs
  47. Sep 17 01:58:37 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 19:58:37 [21052] [DEBUG] GET /api/apps/photo-verification/containers
  48. Sep 17 02:03:37 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:03:37 [15325] [DEBUG] POST /api/hooks/push
  49. Sep 17 02:03:38 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:03:38 [15325] [DEBUG] POST /api/hooks/config
  50. Sep 17 02:03:48 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:03:48 [15325] [DEBUG] POST /api/hooks/push
  51. Sep 17 02:03:48 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:03:48 [15325] [DEBUG] POST /api/hooks/config
  52. Sep 17 02:07:13 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:07:13 [23520] [DEBUG] POST /api/hooks/push
  53. Sep 17 02:07:13 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:07:13 [13353] [DEBUG] POST /api/hooks/config
  54. Sep 17 02:09:24 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:09:24 [21052] [DEBUG] POST /api/hooks/build
  55. Sep 17 02:09:24 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-371ec10 created
  56. Sep 17 02:09:24 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v101 created
  57. Sep 17 02:09:24 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:09:24,876: INFO/MainProcess] Received task: api.tasks.deploy_release[cf8e2e68-e4a2-4210-bd36-2cbf46d3824d]
  58. Sep 17 02:09:24 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:09:24,910: WARNING/Worker-2] Creating photo-verification_v101.web.1
  59. Sep 17 02:09:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:09:26,473: WARNING/Worker-2] Starting photo-verification_v101.web.1
  60. Sep 17 02:09:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v101.web.1.service start
  61. Sep 17 02:09:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v101.web.1-log.service start
  62. Sep 17 02:09:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v101.web.1-announce.service start
  63. Sep 17 02:11:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:11:03,355: WARNING/Worker-2] Destroying photo-verification_v100.web.1
  64. Sep 17 02:11:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v100.web.1-announce.service
  65. Sep 17 02:11:03 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v100.web.1.service
  66. Sep 17 02:11:04 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v100.web.1-log.service
  67. Sep 17 02:11:04 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:11:04,258: INFO/MainProcess] Task api.tasks.deploy_release[cf8e2e68-e4a2-4210-bd36-2cbf46d3824d] succeeded in 99.3790558131s: None
  68. Sep 17 02:13:15 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:13:15 [459] [DEBUG] POST /api/hooks/push
  69. Sep 17 02:13:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:13:16 [459] [DEBUG] POST /api/hooks/config
  70. Sep 17 02:15:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:15:27 [25915] [DEBUG] POST /api/hooks/build
  71. Sep 17 02:15:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-b2b31dd created
  72. Sep 17 02:15:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v102 created
  73. Sep 17 02:15:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:15:27,324: INFO/MainProcess] Received task: api.tasks.deploy_release[9c7041fb-1990-4ff2-a32f-d554ba14a460]
  74. Sep 17 02:15:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:15:27,357: WARNING/Worker-5] Creating photo-verification_v102.web.1
  75. Sep 17 02:15:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:15:29,107: WARNING/Worker-5] Starting photo-verification_v102.web.1
  76. Sep 17 02:15:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v102.web.1.service start
  77. Sep 17 02:15:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v102.web.1-log.service start
  78. Sep 17 02:15:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v102.web.1-announce.service start
  79. Sep 17 02:25:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:25:27 [80] [CRITICAL] WORKER TIMEOUT (pid:25915)
  80. Sep 17 02:25:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:25:27 [80] [CRITICAL] WORKER TIMEOUT (pid:25915)
  81. Sep 17 02:25:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:25:27 [15695] [INFO] Booting worker with pid: 15695
  82. Sep 17 02:29:45 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:29:45 [105] [DEBUG] POST /api/apps/photo-verification/logs
  83. Sep 17 02:30:57 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:30:57 [15695] [DEBUG] POST /api/hooks/push
  84. Sep 17 02:30:59 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:30:59 [15695] [DEBUG] POST /api/hooks/config
  85. Sep 17 02:33:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:33:16 [15695] [DEBUG] POST /api/hooks/build
  86. Sep 17 02:33:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-4873aef created
  87. Sep 17 02:33:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v103 created
  88. Sep 17 02:33:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:33:17,951: INFO/MainProcess] Received task: api.tasks.deploy_release[5d50d8d0-6fcc-4d6c-9d47-4f9bbe6b6132]
  89. Sep 17 02:33:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:33:17,990: WARNING/Worker-3] Creating photo-verification_v103.web.1
  90. Sep 17 02:33:20 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:33:20,232: WARNING/Worker-3] Starting photo-verification_v103.web.1
  91. Sep 17 02:33:20 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v103.web.1.service start
  92. Sep 17 02:33:20 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v103.web.1-log.service start
  93. Sep 17 02:33:20 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v103.web.1-announce.service start
  94. Sep 17 02:33:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:33:53,378: WARNING/Worker-3] Destroying photo-verification_v102.web.1
  95. Sep 17 02:33:54 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1-announce.service
  96. Sep 17 02:33:54 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1.service
  97. Sep 17 02:33:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1-log.service
  98. Sep 17 02:33:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:33:55,169: INFO/MainProcess] Task api.tasks.deploy_release[5d50d8d0-6fcc-4d6c-9d47-4f9bbe6b6132] succeeded in 37.216235623s: None
  99. Sep 17 02:37:42 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:37:42 [21052] [DEBUG] POST /api/hooks/push
  100. Sep 17 02:37:43 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:37:43 [23520] [DEBUG] POST /api/hooks/config
  101. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:39:34,512: WARNING/Worker-5] Exception in thread Thread-45:
  102. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: Traceback (most recent call last):
  103. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
  104. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.run()
  105. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/lib/python2.7/threading.py", line 504, in run
  106. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.__target(*self.__args, **self.__kwargs)
  107. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/api/models.py", line 49, in _inner
  108. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: func(*args, **kwargs)
  109. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/django_fsm/__init__.py", line 267, in _change_state
  110. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: return fsm_meta.field.change_state(instance, func, *args, **kwargs)
  111. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/django_fsm/__init__.py", line 161, in change_state
  112. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: result = method(instance, *args, **kwargs)
  113. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/api/models.py", line 377, in deploy
  114. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: self._scheduler.start(new_job_id, self._command_announceable())
  115. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/scheduler/coreos.py", line 129, in start
  116. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: self._wait_for_announcer(name, env)
  117. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/scheduler/coreos.py", line 159, in _wait_for_announcer
  118. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: raise RuntimeError('Container failed to start')
  119. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: RuntimeError: Container failed to start
  120. Sep 17 02:39:34 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:39:34,515: INFO/MainProcess] Task api.tasks.deploy_release[9c7041fb-1990-4ff2-a32f-d554ba14a460] succeeded in 1447.18833729s: None
  121. Sep 17 02:40:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 20:40:27 [15325] [DEBUG] POST /api/hooks/build
  122. Sep 17 02:40:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-50f23f7 created
  123. Sep 17 02:40:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v104 created
  124. Sep 17 02:40:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:40:27,961: INFO/MainProcess] Received task: api.tasks.deploy_release[f0ca0914-3c66-4b47-92a2-874f2bc2d91d]
  125. Sep 17 02:40:27 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:40:27,993: WARNING/Worker-7] Creating photo-verification_v104.web.1
  126. Sep 17 02:40:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:40:29,679: WARNING/Worker-7] Starting photo-verification_v104.web.1
  127. Sep 17 02:40:29 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v104.web.1.service start
  128. Sep 17 02:40:30 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v104.web.1-log.service start
  129. Sep 17 02:40:30 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v104.web.1-announce.service start
  130. Sep 17 02:41:04 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:41:04,627: WARNING/Worker-7] Destroying photo-verification_v102.web.1
  131. Sep 17 02:41:04 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1-announce.service
  132. Sep 17 02:41:05 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1.service
  133. Sep 17 02:41:05 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v102.web.1-log.service
  134. Sep 17 02:41:05 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 20:41:05,544: INFO/MainProcess] Task api.tasks.deploy_release[f0ca0914-3c66-4b47-92a2-874f2bc2d91d] succeeded in 37.580779604s: None
  135. Sep 17 04:01:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 22:01:19 [27582] [DEBUG] POST /api/hooks/push
  136. Sep 17 04:01:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 22:01:19 [15325] [DEBUG] POST /api/hooks/config
  137. Sep 17 04:03:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 22:03:53 [13353] [DEBUG] POST /api/hooks/build
  138. Sep 17 04:03:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-ecc9c81 created
  139. Sep 17 04:03:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v105 created
  140. Sep 17 04:03:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 22:03:53,949: INFO/MainProcess] Received task: api.tasks.deploy_release[0a065d70-6ed8-4cc6-8004-36bb6f7ee450]
  141. Sep 17 04:03:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 22:03:53,984: WARNING/Worker-2] Creating photo-verification_v105.web.1
  142. Sep 17 04:03:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 22:03:55,514: WARNING/Worker-2] Starting photo-verification_v105.web.1
  143. Sep 17 04:03:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v105.web.1.service start
  144. Sep 17 04:03:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v105.web.1-log.service start
  145. Sep 17 04:03:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v105.web.1-announce.service start
  146. Sep 17 04:05:48 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 22:05:48,552: WARNING/Worker-2] Destroying photo-verification_v104.web.1
  147. Sep 17 04:05:48 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v104.web.1-announce.service
  148. Sep 17 04:05:49 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v104.web.1.service
  149. Sep 17 04:05:49 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v104.web.1-log.service
  150. Sep 17 04:05:49 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 22:05:49,654: INFO/MainProcess] Task api.tasks.deploy_release[0a065d70-6ed8-4cc6-8004-36bb6f7ee450] succeeded in 115.703151914s: None
  151. Sep 17 04:54:39 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 22:54:39 [459] [DEBUG] GET /api/apps/photo-verification/config
  152. Sep 17 05:09:00 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:09:00 [21052] [DEBUG] POST /api/hooks/push
  153. Sep 17 05:09:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:09:01 [13353] [DEBUG] POST /api/hooks/config
  154. Sep 17 05:11:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:11:17 [15695] [DEBUG] POST /api/hooks/build
  155. Sep 17 05:11:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-2339a2f created
  156. Sep 17 05:11:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v106 created
  157. Sep 17 05:11:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:11:17,553: INFO/MainProcess] Received task: api.tasks.deploy_release[204268ba-4c11-4e7a-b657-ae857e599964]
  158. Sep 17 05:11:17 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:11:17,586: WARNING/Worker-5] Creating photo-verification_v106.web.1
  159. Sep 17 05:11:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:11:19,172: WARNING/Worker-5] Starting photo-verification_v106.web.1
  160. Sep 17 05:11:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v106.web.1.service start
  161. Sep 17 05:11:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v106.web.1-log.service start
  162. Sep 17 05:11:19 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v106.web.1-announce.service start
  163. Sep 17 05:12:20 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:12:20,750: WARNING/Worker-5] Destroying photo-verification_v105.web.1
  164. Sep 17 05:12:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v105.web.1-announce.service
  165. Sep 17 05:12:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v105.web.1.service
  166. Sep 17 05:12:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: Destroyed photo-verification_v105.web.1-log.service
  167. Sep 17 05:12:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:12:21,662: INFO/MainProcess] Task api.tasks.deploy_release[204268ba-4c11-4e7a-b657-ae857e599964] succeeded in 64.1068059839s: None
  168. Sep 17 05:14:13 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:14:13 [13353] [DEBUG] POST /api/hooks/push
  169. Sep 17 05:14:14 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:14:14 [15325] [DEBUG] POST /api/hooks/config
  170. Sep 17 05:16:58 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:16:58 [27582] [DEBUG] POST /api/hooks/build
  171. Sep 17 05:16:58 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Build photo-verification-02b3e83 created
  172. Sep 17 05:16:58 staging-instance1.c.fourth-blend-666.internal sh[8798]: INFO photo-verification: Release photo-verification-v107 created
  173. Sep 17 05:16:58 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:16:58,722: INFO/MainProcess] Received task: api.tasks.deploy_release[e65d490b-29fc-47ef-9f5b-69e916bf4d37]
  174. Sep 17 05:16:58 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:16:58,761: WARNING/Worker-3] Creating photo-verification_v107.web.1
  175. Sep 17 05:17:02 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:17:02,221: WARNING/Worker-3] Starting photo-verification_v107.web.1
  176. Sep 17 05:17:02 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v107.web.1.service start
  177. Sep 17 05:17:02 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v107.web.1-log.service start
  178. Sep 17 05:17:02 staging-instance1.c.fourth-blend-666.internal sh[8798]: Triggered job photo-verification_v107.web.1-announce.service start
  179. Sep 17 05:26:59 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:26:59 [80] [CRITICAL] WORKER TIMEOUT (pid:27582)
  180. Sep 17 05:26:59 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:26:59 [80] [CRITICAL] WORKER TIMEOUT (pid:27582)
  181. Sep 17 05:26:59 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-16 23:26:59 [21762] [INFO] Booting worker with pid: 21762
  182. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:40:32,915: WARNING/Worker-3] Exception in thread Thread-46:
  183. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: Traceback (most recent call last):
  184. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
  185. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.run()
  186. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/lib/python2.7/threading.py", line 504, in run
  187. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.__target(*self.__args, **self.__kwargs)
  188. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/api/models.py", line 49, in _inner
  189. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: func(*args, **kwargs)
  190. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/django_fsm/__init__.py", line 267, in _change_state
  191. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: return fsm_meta.field.change_state(instance, func, *args, **kwargs)
  192. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/django_fsm/__init__.py", line 161, in change_state
  193. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: result = method(instance, *args, **kwargs)
  194. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/api/models.py", line 377, in deploy
  195. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: self._scheduler.start(new_job_id, self._command_announceable())
  196. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/scheduler/coreos.py", line 129, in start
  197. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: self._wait_for_announcer(name, env)
  198. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/app/scheduler/coreos.py", line 159, in _wait_for_announcer
  199. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: raise RuntimeError('Container failed to start')
  200. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: RuntimeError: Container failed to start
  201. Sep 17 05:40:32 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-16 23:40:32,920: INFO/MainProcess] Task api.tasks.deploy_release[e65d490b-29fc-47ef-9f5b-69e916bf4d37] succeeded in 1414.19518843s: None
  202. Sep 17 08:51:55 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:51:55Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  203. Sep 17 08:52:00 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:00Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  204. Sep 17 08:52:05 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:05Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  205. Sep 17 08:52:10 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:10Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  206. Sep 17 08:52:15 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:15Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  207. Sep 17 08:52:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:21Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  208. Sep 17 08:52:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:26Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  209. Sep 17 08:52:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  210. Sep 17 08:52:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  211. Sep 17 08:52:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  212. Sep 17 08:52:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  213. Sep 17 08:52:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:51Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  214. Sep 17 08:52:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:52:56Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  215. Sep 17 08:53:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:01Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  216. Sep 17 08:53:06 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:06Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  217. Sep 17 08:53:11 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:11Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  218. Sep 17 08:53:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:16Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  219. Sep 17 08:53:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:21Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  220. Sep 17 08:53:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:26Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  221. Sep 17 08:53:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  222. Sep 17 08:53:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  223. Sep 17 08:53:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  224. Sep 17 08:53:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  225. Sep 17 08:53:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:51Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  226. Sep 17 08:53:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:53:56Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  227. Sep 17 08:54:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:01Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  228. Sep 17 08:54:06 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:06Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  229. Sep 17 08:54:11 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:11Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  230. Sep 17 08:54:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:16Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  231. Sep 17 08:54:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:21Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  232. Sep 17 08:54:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:26Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  233. Sep 17 08:54:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  234. Sep 17 08:54:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  235. Sep 17 08:54:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  236. Sep 17 08:54:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  237. Sep 17 08:54:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:51Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  238. Sep 17 08:54:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:54:56Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  239. Sep 17 08:55:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:01Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  240. Sep 17 08:55:06 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:06Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  241. Sep 17 08:55:11 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:11Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  242. Sep 17 08:55:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:16Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  243. Sep 17 08:55:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:21Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  244. Sep 17 08:55:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:26Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  245. Sep 17 08:55:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  246. Sep 17 08:55:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  247. Sep 17 08:55:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  248. Sep 17 08:55:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  249. Sep 17 08:55:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:51Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  250. Sep 17 08:55:56 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:55:56Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  251. Sep 17 08:56:01 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:01Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  252. Sep 17 08:56:06 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:06Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  253. Sep 17 08:56:11 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:11Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  254. Sep 17 08:56:16 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:16Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  255. Sep 17 08:56:21 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:21Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  256. Sep 17 08:56:26 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:26Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  257. Sep 17 08:56:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  258. Sep 17 08:56:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  259. Sep 17 08:56:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  260. Sep 17 08:56:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T08:56:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  261. Sep 17 09:35:31 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T09:35:31Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  262. Sep 17 09:35:36 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T09:35:36Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  263. Sep 17 09:35:41 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T09:35:41Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  264. Sep 17 09:35:46 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T09:35:46Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  265. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-17 03:35:46,844: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
  266. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: Traceback (most recent call last):
  267. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/celery/worker/consumer.py", line 278, in start
  268. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: blueprint.start(self)
  269. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/celery/bootsteps.py", line 123, in start
  270. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: step.start(parent)
  271. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/celery/worker/consumer.py", line 821, in start
  272. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: c.loop(*c.loop_args())
  273. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/celery/worker/loops.py", line 70, in asynloop
  274. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: next(loop)
  275. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/async/hub.py", line 274, in create_loop
  276. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: poll_timeout = fire_timers(propagate=propagate) if scheduled else 1
  277. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/async/hub.py", line 136, in fire_timers
  278. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: entry()
  279. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/async/timer.py", line 64, in __call__
  280. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: return self.fun(*self.args, **self.kwargs)
  281. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/async/timer.py", line 132, in _reschedules
  282. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: return fun(*args, **kwargs)
  283. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/transport/redis.py", line 313, in maybe_restore_messages
  284. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: num=channel.unacked_restore_limit,
  285. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/transport/redis.py", line 181, in restore_visible
  286. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.unacked_mutex_expire):
  287. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
  288. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: return self.gen.next()
  289. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/kombu/transport/redis.py", line 106, in Mutex
  290. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: i_won = client.setnx(name, lock_id)
  291. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/redis/client.py", line 922, in setnx
  292. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: return self.execute_command('SETNX', name, value)
  293. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/redis/client.py", line 464, in execute_command
  294. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: connection.send_command(*args)
  295. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/redis/connection.py", line 334, in send_command
  296. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.send_packed_command(self.pack_command(*args))
  297. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/redis/connection.py", line 316, in send_packed_command
  298. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: self.connect()
  299. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: File "/usr/local/lib/python2.7/dist-packages/redis/connection.py", line 253, in connect
  300. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: raise ConnectionError(self._error_message(e))
  301. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: ConnectionError: Error 111 connecting 10.240.145.192:6379. Connection refused.
  302. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-17 03:35:47,070: ERROR/MainProcess] consumer: Cannot connect to redis://10.240.145.192:6379/0: Error 111 connecting 10.240.145.192:6379. Connection refused..
  303. Sep 17 09:35:47 staging-instance1.c.fourth-blend-666.internal sh[8798]: Trying again in 2.00 seconds...
  304. Sep 17 09:35:49 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-17 03:35:49,076: ERROR/MainProcess] consumer: Cannot connect to redis://10.240.145.192:6379/0: Error 111 connecting 10.240.145.192:6379. Connection refused..
  305. Sep 17 09:35:49 staging-instance1.c.fourth-blend-666.internal sh[8798]: Trying again in 4.00 seconds...
  306. Sep 17 09:35:51 staging-instance1.c.fourth-blend-666.internal sh[8798]: 2014-09-17T09:35:51Z 7674f137dbca confd[78]: ERROR Config check failed: exit status 1
  307. Sep 17 09:35:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: [2014-09-17 03:35:53,083: ERROR/MainProcess] consumer: Cannot connect to redis://10.240.145.192:6379/0: Error 111 connecting 10.240.145.192:6379. Connection refused..
  308. Sep 17 09:35:53 staging-instance1.c.fourth-blend-666.internal sh[8798]: Trying again in 6.00 seconds...
  309. -- Reboot --
  310. Sep 17 09:41:26 staging-instance1.c.fourth-blend-666.internal systemd[1]: Starting deis-controller...
  311. Sep 17 09:41:26 staging-instance1.c.fourth-blend-666.internal sh[1389]: Pulling repository deis/controller
  312. Sep 17 09:46:06 staging-instance1.c.fourth-blend-666.internal systemd[1]: Started deis-controller.
  313. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Syncing...
  314. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating tables ...
  315. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table django_admin_log
  316. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_permission
  317. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_group_permissions
  318. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_group
  319. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_user_groups
  320. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_user_user_permissions
  321. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table auth_user
  322. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table django_content_type
  323. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table django_session
  324. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table django_site
  325. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table account_emailaddress
  326. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table account_emailconfirmation
  327. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Creating table south_migrationhistory
  328. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Installing custom SQL ...
  329. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Installing indexes ...
  330. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Installed 0 object(s) from 0 fixture(s)
  331. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Migrating...
  332. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Running migrations for api:
  333. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - Migrating forwards to 0015_migration_config_defaults.
  334. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > guardian:0001_initial
  335. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > guardian:0002_auto__add_field_groupobjectpermission_object_pk__add_field_userobjectp
  336. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > guardian:0003_update_objectpermission_object_pk
  337. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > guardian:0004_auto__del_field_groupobjectpermission_object_id__del_unique_groupobjec
  338. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > guardian:0005_auto__chg_field_groupobjectpermission_object_pk__chg_field_userobjectp
  339. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0001_initial
  340. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0002_drop_djcelery
  341. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0003_drop_socialaccount
  342. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0004_add_custom_perms
  343. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0005_auto__add_push__add_unique_push_app_uuid
  344. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0006_auto__add_field_release_summary
  345. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0007_auto__del_flavor__del_unique_flavor_owner_id__del_layer__del_unique_la
  346. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0008_auto__add_field_release_image
  347. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0009_auto__chg_field_container_state
  348. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0010_auto__add_field_build_sha__add_field_build_procfile__add_field_build_d
  349. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0011_auto__add_domain
  350. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0012_auto__add_limit__add_unique_limit_app_uuid__add_field_config_limit
  351. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0013_auto__del_limit__del_unique_limit_app_uuid__del_field_config_limit__ad
  352. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0014_auto__add_field_config_tags
  353. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > api:0015_migration_config_defaults
  354. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - Loading initial data for api.
  355. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Installed 0 object(s) from 0 fixture(s)
  356. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Running migrations for guardian:
  357. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - Nothing to migrate.
  358. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - Loading initial data for guardian.
  359. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Installed 0 object(s) from 0 fixture(s)
  360. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Synced:
  361. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.admin
  362. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.auth
  363. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.contenttypes
  364. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.humanize
  365. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.messages
  366. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.sessions
  367. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.sites
  368. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django.contrib.staticfiles
  369. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > allauth
  370. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > allauth.account
  371. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > django_fsm
  372. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > json_field
  373. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > rest_framework
  374. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > south
  375. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: > web
  376. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: Migrated:
  377. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - api
  378. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: - guardian
  379. Sep 17 09:46:28 staging-instance1.c.fourth-blend-666.internal sh[3730]: deis-controller running...
  380. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [88] [INFO] Starting gunicorn 18.0
  381. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [88] [DEBUG] Arbiter booted
  382. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [88] [INFO] Listening at: http://0.0.0.0:8000 (88)
  383. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [88] [INFO] Using worker: sync
  384. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [108] [INFO] Booting worker with pid: 108
  385. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [109] [INFO] Booting worker with pid: 109
  386. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [110] [INFO] Booting worker with pid: 110
  387. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [111] [INFO] Booting worker with pid: 111
  388. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [115] [INFO] Booting worker with pid: 115
  389. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [116] [INFO] Booting worker with pid: 116
  390. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [120] [INFO] Booting worker with pid: 120
  391. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17 03:46:29 [135] [INFO] Booting worker with pid: 135
  392. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: [2014-09-17 03:46:29,839: INFO/MainProcess] Connected to redis://10.240.227.129:6379/0
  393. Sep 17 09:46:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: [2014-09-17 03:46:29,860: INFO/MainProcess] mingle: searching for neighbors
  394. Sep 17 09:46:31 staging-instance1.c.fourth-blend-666.internal sh[3730]: [2014-09-17 03:46:30,876: INFO/MainProcess] mingle: all alone
  395. Sep 17 09:46:31 staging-instance1.c.fourth-blend-666.internal sh[3730]: [2014-09-17 03:46:30,903: WARNING/MainProcess] celery@935bfc42f350 ready.
  396. Sep 17 09:49:23 staging-instance1.c.fourth-blend-666.internal sh[3730]: Error:  501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]
  397. Sep 17 09:49:24 staging-instance1.c.fourth-blend-666.internal sh[3730]: Error:  501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]
  398. Sep 17 09:49:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-17T09:49:29Z 935bfc42f350 confd[85]: ERROR Config check failed: exit status 1
  399. Sep 18 06:31:29 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-18 00:31:29 [135] [DEBUG] POST /api/hooks/push
  400. Sep 18 06:55:19 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-18 00:55:19 [115] [DEBUG] POST /api/hooks/push
  401. Sep 18 07:55:21 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-18 01:55:21 [116] [DEBUG] GET /api/apps/photo-verification/config
  402. Sep 18 07:55:35 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-18 01:55:35 [116] [DEBUG] GET /api/auth/login/
  403. Sep 18 07:55:35 staging-instance1.c.fourth-blend-666.internal sh[3730]: 2014-09-18 01:55:35 [135] [DEBUG] POST /api/auth/login/
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!