Advertisement
Guest User

Untitled

a guest
Jan 10th, 2019
86
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 246.12 KB | None | 0 0
  1. 21:45:54 Started by user vnegi
  2. 21:45:54 [EnvInject] - Loading node environment variables.
  3. 21:45:54 Building remotely on worker-3 (listener worker) in workspace /var/jenkins/workspace/test-deploy-scripts-vnegi
  4. 21:45:54 > git rev-parse --is-inside-work-tree # timeout=10
  5. 21:45:54 Fetching changes from the remote Git repository
  6. 21:45:54 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/symphony.git # timeout=10
  7. 21:45:54 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/symphony.git
  8. 21:45:54 > git --version # timeout=10
  9. 21:45:54 using GIT_SSH to set credentials jenkins user ssh key
  10. 21:45:54 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/symphony.git +refs/heads/*:refs/remotes/origin/*
  11. 21:45:55 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  12. 21:45:55 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  13. 21:45:55 Checking out Revision d1ff6ff69bd697cc4103be3c910f999979d55d81 (refs/remotes/origin/master)
  14. 21:45:55 > git config core.sparsecheckout # timeout=10
  15. 21:45:55 > git checkout -f d1ff6ff69bd697cc4103be3c910f999979d55d81
  16. 21:45:55 Commit message: "Add safeguard against factory and stateless service deletion."
  17. 21:45:55 > git rev-list --no-walk d1ff6ff69bd697cc4103be3c910f999979d55d81 # timeout=10
  18. 21:45:55 > git rev-parse --is-inside-work-tree # timeout=10
  19. 21:45:55 Fetching changes from the remote Git repository
  20. 21:45:55 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/symphony-infra.git # timeout=10
  21. 21:45:55 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/symphony-infra.git
  22. 21:45:55 > git --version # timeout=10
  23. 21:45:55 using GIT_SSH to set credentials jenkins user ssh key
  24. 21:45:55 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/symphony-infra.git +refs/heads/*:refs/remotes/origin/*
  25. 21:45:59 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  26. 21:45:59 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  27. 21:45:59 Checking out Revision b37f908c5b13a4c2e03d00a1fd4d151eec566f72 (refs/remotes/origin/master)
  28. 21:45:59 > git config core.sparsecheckout # timeout=10
  29. 21:45:59 > git checkout -f b37f908c5b13a4c2e03d00a1fd4d151eec566f72
  30. 21:45:59 Commit message: "VCMDEVOPS-3633 - add jfrog username option to the cleanup_preflight_deploys.sh script"
  31. 21:45:59 > git rev-list --no-walk b37f908c5b13a4c2e03d00a1fd4d151eec566f72 # timeout=10
  32. 21:45:59 > git rev-parse --is-inside-work-tree # timeout=10
  33. 21:45:59 Fetching changes from the remote Git repository
  34. 21:45:59 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/symphony-ui.git # timeout=10
  35. 21:45:59 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/symphony-ui.git
  36. 21:45:59 > git --version # timeout=10
  37. 21:45:59 using GIT_SSH to set credentials jenkins user ssh key
  38. 21:45:59 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/symphony-ui.git +refs/heads/*:refs/remotes/origin/*
  39. 21:46:02 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  40. 21:46:02 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  41. 21:46:02 Checking out Revision a3d3cd2b1838ef89b84116f6780b197b5f3fd382 (refs/remotes/origin/master)
  42. 21:46:02 > git config core.sparsecheckout # timeout=10
  43. 21:46:02 > git checkout -f a3d3cd2b1838ef89b84116f6780b197b5f3fd382
  44. 21:46:02 Commit message: "VSYM-16999 - relative url bug fix"
  45. 21:46:02 > git rev-list --no-walk a3d3cd2b1838ef89b84116f6780b197b5f3fd382 # timeout=10
  46. 21:46:02 > git rev-parse --is-inside-work-tree # timeout=10
  47. 21:46:02 Fetching changes from the remote Git repository
  48. 21:46:02 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/heimdall.git # timeout=10
  49. 21:46:02 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/heimdall.git
  50. 21:46:02 > git --version # timeout=10
  51. 21:46:02 using GIT_SSH to set credentials jenkins user ssh key
  52. 21:46:02 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/heimdall.git +refs/heads/*:refs/remotes/origin/*
  53. 21:46:04 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  54. 21:46:04 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  55. 21:46:04 Checking out Revision c7266d48227d87d64eab8e0526e8f1c534754232 (refs/remotes/origin/master)
  56. 21:46:04 > git config core.sparsecheckout # timeout=10
  57. 21:46:04 > git checkout -f c7266d48227d87d64eab8e0526e8f1c534754232
  58. 21:46:04 Commit message: "VCMDEVOPS-2765 Remove old diploma-heimdall-service-secret"
  59. 21:46:04 > git rev-list --no-walk c7266d48227d87d64eab8e0526e8f1c534754232 # timeout=10
  60. 21:46:04 > git rev-parse --is-inside-work-tree # timeout=10
  61. 21:46:04 Fetching changes from the remote Git repository
  62. 21:46:04 > git config remote.origin.url http://cmbuosvc-gerrit.eng.vmware.com/osvc-starter # timeout=10
  63. 21:46:04 Fetching upstream changes from http://cmbuosvc-gerrit.eng.vmware.com/osvc-starter
  64. 21:46:04 > git --version # timeout=10
  65. 21:46:04 > git fetch --tags --progress http://cmbuosvc-gerrit.eng.vmware.com/osvc-starter +refs/heads/*:refs/remotes/origin/*
  66. 21:46:04 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  67. 21:46:05 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  68. 21:46:05 Checking out Revision 44d2baa64a568ea1f067f05881fab6abc7e231dd (refs/remotes/origin/master)
  69. 21:46:05 > git config core.sparsecheckout # timeout=10
  70. 21:46:05 > git checkout -f 44d2baa64a568ea1f067f05881fab6abc7e231dd
  71. 21:46:05 Commit message: "fix path of log so that it will be scanned by the li-agent"
  72. 21:46:05 > git rev-list --no-walk 44d2baa64a568ea1f067f05881fab6abc7e231dd # timeout=10
  73. 21:46:05 > git rev-parse --is-inside-work-tree # timeout=10
  74. 21:46:05 Fetching changes from the remote Git repository
  75. 21:46:05 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-commons.git # timeout=10
  76. 21:46:05 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-commons.git
  77. 21:46:05 > git --version # timeout=10
  78. 21:46:05 using GIT_SSH to set credentials jenkins user ssh key
  79. 21:46:05 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-commons.git +refs/heads/*:refs/remotes/origin/*
  80. 21:46:05 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  81. 21:46:05 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  82. 21:46:05 Checking out Revision 38d2ba3ef579f6b87aa56fd81b96965010482a50 (refs/remotes/origin/master)
  83. 21:46:05 > git config core.sparsecheckout # timeout=10
  84. 21:46:05 > git checkout -f 38d2ba3ef579f6b87aa56fd81b96965010482a50
  85. 21:46:05 Commit message: "Increasing version of provisioning processor. Had ignored failed deployments and fixed a bug"
  86. 21:46:05 > git rev-list --no-walk 38d2ba3ef579f6b87aa56fd81b96965010482a50 # timeout=10
  87. 21:46:05 > git rev-parse --is-inside-work-tree # timeout=10
  88. 21:46:05 Fetching changes from the remote Git repository
  89. 21:46:05 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-ui.git # timeout=10
  90. 21:46:05 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-ui.git
  91. 21:46:05 > git --version # timeout=10
  92. 21:46:05 using GIT_SSH to set credentials jenkins user ssh key
  93. 21:46:05 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-ui.git +refs/heads/*:refs/remotes/origin/*
  94. 21:46:07 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  95. 21:46:07 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  96. 21:46:07 Checking out Revision c48cc1581de7bd670ffef05987cb92e28437aa14 (refs/remotes/origin/master)
  97. 21:46:07 > git config core.sparsecheckout # timeout=10
  98. 21:46:07 > git checkout -f c48cc1581de7bd670ffef05987cb92e28437aa14
  99. 21:46:07 Commit message: "Changes for additional cost drivers, public cloud cost drivers"
  100. 21:46:07 > git rev-list --no-walk c48cc1581de7bd670ffef05987cb92e28437aa14 # timeout=10
  101. 21:46:07 > git rev-parse --is-inside-work-tree # timeout=10
  102. 21:46:07 Fetching changes from the remote Git repository
  103. 21:46:07 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-cost-analysis.git # timeout=10
  104. 21:46:07 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-cost-analysis.git
  105. 21:46:07 > git --version # timeout=10
  106. 21:46:07 using GIT_SSH to set credentials jenkins user ssh key
  107. 21:46:07 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-cost-analysis.git +refs/heads/*:refs/remotes/origin/*
  108. 21:46:08 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  109. 21:46:08 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  110. 21:46:08 Checking out Revision 4a52f73e53b5d23285ff04081907dbeae02e02dc (refs/remotes/origin/master)
  111. 21:46:08 > git config core.sparsecheckout # timeout=10
  112. 21:46:08 > git checkout -f 4a52f73e53b5d23285ff04081907dbeae02e02dc
  113. 21:46:08 Commit message: "Fallback vsanEnabled Request Param to false"
  114. 21:46:08 > git rev-list --no-walk 4a52f73e53b5d23285ff04081907dbeae02e02dc # timeout=10
  115. 21:46:08 > git rev-parse --is-inside-work-tree # timeout=10
  116. 21:46:08 Fetching changes from the remote Git repository
  117. 21:46:08 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-onboarding.git # timeout=10
  118. 21:46:08 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-onboarding.git
  119. 21:46:08 > git --version # timeout=10
  120. 21:46:08 using GIT_SSH to set credentials jenkins user ssh key
  121. 21:46:08 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-onboarding.git +refs/heads/*:refs/remotes/origin/*
  122. 21:46:09 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  123. 21:46:09 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  124. 21:46:09 Checking out Revision d7abb13456008be3902191b9ffcf716cfc1e41de (refs/remotes/origin/master)
  125. 21:46:09 > git config core.sparsecheckout # timeout=10
  126. 21:46:09 > git checkout -f d7abb13456008be3902191b9ffcf716cfc1e41de
  127. 21:46:09 Commit message: "VSYM-16933 : Implement liquibase migration"
  128. 21:46:09 > git rev-list --no-walk d7abb13456008be3902191b9ffcf716cfc1e41de # timeout=10
  129. 21:46:09 > git rev-parse --is-inside-work-tree # timeout=10
  130. 21:46:09 Fetching changes from the remote Git repository
  131. 21:46:09 > git config remote.origin.url http://cmbuosvc-gerrit.eng.vmware.com/osvc-bow.git # timeout=10
  132. 21:46:09 Fetching upstream changes from http://cmbuosvc-gerrit.eng.vmware.com/osvc-bow.git
  133. 21:46:09 > git --version # timeout=10
  134. 21:46:09 using GIT_SSH to set credentials jenkins user ssh key
  135. 21:46:09 > git fetch --tags --progress http://cmbuosvc-gerrit.eng.vmware.com/osvc-bow.git +refs/heads/*:refs/remotes/origin/*
  136. 21:46:09 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  137. 21:46:09 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  138. 21:46:09 Checking out Revision 0df0a681ee13c76b3f94ab1433127ed5a83052c6 (refs/remotes/origin/master)
  139. 21:46:09 > git config core.sparsecheckout # timeout=10
  140. 21:46:09 > git checkout -f 0df0a681ee13c76b3f94ab1433127ed5a83052c6
  141. 21:46:09 Commit message: "remove the vrbc-ui tag since it is no more needed"
  142. 21:46:09 > git rev-list --no-walk 0df0a681ee13c76b3f94ab1433127ed5a83052c6 # timeout=10
  143. 21:46:09 > git rev-parse --is-inside-work-tree # timeout=10
  144. 21:46:09 Fetching changes from the remote Git repository
  145. 21:46:09 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ops-mgmt-solr.git # timeout=10
  146. 21:46:09 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ops-mgmt-solr.git
  147. 21:46:09 > git --version # timeout=10
  148. 21:46:09 using GIT_SSH to set credentials jenkins user ssh key
  149. 21:46:09 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ops-mgmt-solr.git +refs/heads/*:refs/remotes/origin/*
  150. 21:46:10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  151. 21:46:10 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  152. 21:46:10 Checking out Revision e8decc16d306a981e46f7039f6b99e96fb9b9249 (refs/remotes/origin/master)
  153. 21:46:10 > git config core.sparsecheckout # timeout=10
  154. 21:46:10 > git checkout -f e8decc16d306a981e46f7039f6b99e96fb9b9249
  155. 21:46:10 Commit message: "remove vrbc-ui-tag from ops-mgmt-solr new-dev"
  156. 21:46:10 > git rev-list --no-walk e8decc16d306a981e46f7039f6b99e96fb9b9249 # timeout=10
  157. 21:46:10 > git rev-parse --is-inside-work-tree # timeout=10
  158. 21:46:10 Fetching changes from the remote Git repository
  159. 21:46:10 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ops-data-solr.git # timeout=10
  160. 21:46:10 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ops-data-solr.git
  161. 21:46:10 > git --version # timeout=10
  162. 21:46:10 using GIT_SSH to set credentials jenkins user ssh key
  163. 21:46:10 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ops-data-solr.git +refs/heads/*:refs/remotes/origin/*
  164. 21:46:13 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  165. 21:46:13 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  166. 21:46:13 Checking out Revision 6c7fb4a9caf691f3ba65009b9f8ea95d3b117f77 (refs/remotes/origin/master)
  167. 21:46:13 > git config core.sparsecheckout # timeout=10
  168. 21:46:13 > git checkout -f 6c7fb4a9caf691f3ba65009b9f8ea95d3b117f77
  169. 21:46:13 Commit message: "VSAAS-8027 Query progress cache is not bing properly cleared out."
  170. 21:46:13 > git rev-list --no-walk 6c7fb4a9caf691f3ba65009b9f8ea95d3b117f77 # timeout=10
  171. 21:46:13 > git rev-parse --is-inside-work-tree # timeout=10
  172. 21:46:13 Fetching changes from the remote Git repository
  173. 21:46:13 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/osvc-notifications.git # timeout=10
  174. 21:46:13 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/osvc-notifications.git
  175. 21:46:13 > git --version # timeout=10
  176. 21:46:13 using GIT_SSH to set credentials jenkins user ssh key
  177. 21:46:13 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/osvc-notifications.git +refs/heads/*:refs/remotes/origin/*
  178. 21:46:14 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  179. 21:46:14 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  180. 21:46:14 Checking out Revision 709ee1525f4130e7d5cc9eb2c7cdeeb812d5331f (refs/remotes/origin/master)
  181. 21:46:14 > git config core.sparsecheckout # timeout=10
  182. 21:46:14 > git checkout -f 709ee1525f4130e7d5cc9eb2c7cdeeb812d5331f
  183. 21:46:14 Commit message: "remove vrbc-ui-tag from osvc-notification new-dev"
  184. 21:46:14 > git rev-list --no-walk 709ee1525f4130e7d5cc9eb2c7cdeeb812d5331f # timeout=10
  185. 21:46:14 > git rev-parse --is-inside-work-tree # timeout=10
  186. 21:46:14 Fetching changes from the remote Git repository
  187. 21:46:14 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/osvc-xenon-starter.git # timeout=10
  188. 21:46:14 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/osvc-xenon-starter.git
  189. 21:46:14 > git --version # timeout=10
  190. 21:46:14 using GIT_SSH to set credentials jenkins user ssh key
  191. 21:46:14 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/osvc-xenon-starter.git +refs/heads/*:refs/remotes/origin/*
  192. 21:46:15 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  193. 21:46:15 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  194. 21:46:15 Checking out Revision 1f87ebbd8c4c0e67eafa12bb1fa307809ee8355e (refs/remotes/origin/master)
  195. 21:46:15 > git config core.sparsecheckout # timeout=10
  196. 21:46:15 > git checkout -f 1f87ebbd8c4c0e67eafa12bb1fa307809ee8355e
  197. 21:46:15 Commit message: "Adding additional args to xenon starter"
  198. 21:46:15 > git rev-list --no-walk 1f87ebbd8c4c0e67eafa12bb1fa307809ee8355e # timeout=10
  199. 21:46:15 > git rev-parse --is-inside-work-tree # timeout=10
  200. 21:46:15 Fetching changes from the remote Git repository
  201. 21:46:15 > git config remote.origin.url http://cmbuosvc-gerrit.eng.vmware.com/osvc-alerts.git # timeout=10
  202. 21:46:15 Fetching upstream changes from http://cmbuosvc-gerrit.eng.vmware.com/osvc-alerts.git
  203. 21:46:15 > git --version # timeout=10
  204. 21:46:15 > git fetch --tags --progress http://cmbuosvc-gerrit.eng.vmware.com/osvc-alerts.git +refs/heads/*:refs/remotes/origin/*
  205. 21:46:15 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  206. 21:46:15 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  207. 21:46:15 Checking out Revision d6159baff259180c09387d87885faa80a1da0e00 (refs/remotes/origin/master)
  208. 21:46:15 > git config core.sparsecheckout # timeout=10
  209. 21:46:15 > git checkout -f d6159baff259180c09387d87885faa80a1da0e00
  210. 21:46:15 Commit message: "ANS-231: Alert service APIs fails with 500 Internal Server Error"
  211. 21:46:15 > git rev-list --no-walk d6159baff259180c09387d87885faa80a1da0e00 # timeout=10
  212. 21:46:15 > git rev-parse --is-inside-work-tree # timeout=10
  213. 21:46:15 Fetching changes from the remote Git repository
  214. 21:46:15 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/le-mans.git # timeout=10
  215. 21:46:15 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/le-mans.git
  216. 21:46:15 > git --version # timeout=10
  217. 21:46:15 using GIT_SSH to set credentials jenkins user ssh key
  218. 21:46:15 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/le-mans.git +refs/heads/*:refs/remotes/origin/*
  219. 21:46:18 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  220. 21:46:18 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  221. 21:46:18 Checking out Revision 2c5be06d53c6c32463a63f2887943fc2cdb705dd (refs/remotes/origin/master)
  222. 21:46:18 > git config core.sparsecheckout # timeout=10
  223. 21:46:18 > git checkout -f 2c5be06d53c6c32463a63f2887943fc2cdb705dd
  224. 21:46:18 Commit message: "VRLEM-155: Use our own certificate when communicating with kafka"
  225. 21:46:18 > git rev-list --no-walk 2c5be06d53c6c32463a63f2887943fc2cdb705dd # timeout=10
  226. 21:46:18 > git rev-parse --is-inside-work-tree # timeout=10
  227. 21:46:18 Fetching changes from the remote Git repository
  228. 21:46:18 > git config remote.origin.url http://cmbuosvc-gerrit.eng.vmware.com/ops-ingest.git # timeout=10
  229. 21:46:18 Fetching upstream changes from http://cmbuosvc-gerrit.eng.vmware.com/ops-ingest.git
  230. 21:46:18 > git --version # timeout=10
  231. 21:46:18 > git fetch --tags --progress http://cmbuosvc-gerrit.eng.vmware.com/ops-ingest.git +refs/heads/*:refs/remotes/origin/*
  232. 21:46:18 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  233. 21:46:18 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  234. 21:46:18 Checking out Revision 6cd28163955aa0a393246902bdc91a100132ae60 (refs/remotes/origin/master)
  235. 21:46:18 > git config core.sparsecheckout # timeout=10
  236. 21:46:18 > git checkout -f 6cd28163955aa0a393246902bdc91a100132ae60
  237. 21:46:18 Commit message: "VSAAS-8084: Adding a implementation for the missing interface method"
  238. 21:46:18 > git rev-list --no-walk 6cd28163955aa0a393246902bdc91a100132ae60 # timeout=10
  239. 21:46:18 > git rev-parse --is-inside-work-tree # timeout=10
  240. 21:46:18 Fetching changes from the remote Git repository
  241. 21:46:18 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-benchmark.git # timeout=10
  242. 21:46:18 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-benchmark.git
  243. 21:46:18 > git --version # timeout=10
  244. 21:46:18 using GIT_SSH to set credentials jenkins user ssh key
  245. 21:46:18 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-benchmark.git +refs/heads/*:refs/remotes/origin/*
  246. 21:46:19 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  247. 21:46:19 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  248. 21:46:19 Checking out Revision 99be92d082934fcbb20c7357af8dbe78bae444d5 (refs/remotes/origin/master)
  249. 21:46:19 > git config core.sparsecheckout # timeout=10
  250. 21:46:19 > git checkout -f 99be92d082934fcbb20c7357af8dbe78bae444d5
  251. 21:46:19 Commit message: "Updated vrops-utils dependency and fixed inconsistency with Reflib-commons"
  252. 21:46:19 > git rev-list --no-walk 99be92d082934fcbb20c7357af8dbe78bae444d5 # timeout=10
  253. 21:46:19 > git rev-parse --is-inside-work-tree # timeout=10
  254. 21:46:19 Fetching changes from the remote Git repository
  255. 21:46:19 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-transformer.git # timeout=10
  256. 21:46:19 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-transformer.git
  257. 21:46:19 > git --version # timeout=10
  258. 21:46:19 using GIT_SSH to set credentials jenkins user ssh key
  259. 21:46:19 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-transformer.git +refs/heads/*:refs/remotes/origin/*
  260. 21:46:20 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  261. 21:46:20 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  262. 21:46:20 Checking out Revision 4e14c8f9a7772f6c7bb607d73399b5c056e60fad (refs/remotes/origin/master)
  263. 21:46:20 > git config core.sparsecheckout # timeout=10
  264. 21:46:20 > git checkout -f 4e14c8f9a7772f6c7bb607d73399b5c056e60fad
  265. 21:46:20 Commit message: ""VSYM-16669: Processing vm storage stats when Tango is enabled" And changed some logs to debug only."
  266. 21:46:20 > git rev-list --no-walk 4e14c8f9a7772f6c7bb607d73399b5c056e60fad # timeout=10
  267. 21:46:20 > git rev-parse --is-inside-work-tree # timeout=10
  268. 21:46:20 Fetching changes from the remote Git repository
  269. 21:46:20 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/symphony-metrics.git # timeout=10
  270. 21:46:20 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/symphony-metrics.git
  271. 21:46:20 > git --version # timeout=10
  272. 21:46:20 using GIT_SSH to set credentials jenkins user ssh key
  273. 21:46:20 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/symphony-metrics.git +refs/heads/*:refs/remotes/origin/*
  274. 21:46:21 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  275. 21:46:21 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  276. 21:46:21 Checking out Revision ebf9393e1ded240cee438c7ee12ed4f027803369 (refs/remotes/origin/master)
  277. 21:46:21 > git config core.sparsecheckout # timeout=10
  278. 21:46:21 > git checkout -f ebf9393e1ded240cee438c7ee12ed4f027803369
  279. 21:46:21 Commit message: "Fix upgrade failure"
  280. 21:46:21 > git rev-list --no-walk ebf9393e1ded240cee438c7ee12ed4f027803369 # timeout=10
  281. 21:46:21 > git rev-parse --is-inside-work-tree # timeout=10
  282. 21:46:21 Fetching changes from the remote Git repository
  283. 21:46:21 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/provisioning-ui.git # timeout=10
  284. 21:46:21 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/provisioning-ui.git
  285. 21:46:21 > git --version # timeout=10
  286. 21:46:21 using GIT_SSH to set credentials jenkins user ssh key
  287. 21:46:21 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/provisioning-ui.git +refs/heads/*:refs/remotes/origin/*
  288. 21:46:23 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  289. 21:46:23 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  290. 21:46:23 Checking out Revision 9ca4856dfe75b1410ee71becc094c0d7b13b3a59 (refs/remotes/origin/master)
  291. 21:46:23 > git config core.sparsecheckout # timeout=10
  292. 21:46:23 > git checkout -f 9ca4856dfe75b1410ee71becc094c0d7b13b3a59
  293. 21:46:23 Commit message: "Switching Provisioning feature flag to Symphony feature flag"
  294. 21:46:23 > git rev-list --no-walk 9ca4856dfe75b1410ee71becc094c0d7b13b3a59 # timeout=10
  295. 21:46:24 > git rev-parse --is-inside-work-tree # timeout=10
  296. 21:46:24 Fetching changes from the remote Git repository
  297. 21:46:24 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/provisioning-service.git # timeout=10
  298. 21:46:24 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/provisioning-service.git
  299. 21:46:24 > git --version # timeout=10
  300. 21:46:24 using GIT_SSH to set credentials jenkins user ssh key
  301. 21:46:24 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/provisioning-service.git +refs/heads/*:refs/remotes/origin/*
  302. 21:46:24 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  303. 21:46:24 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  304. 21:46:24 Checking out Revision d377cf00e8aaed4dfd812c4b9e2f238b65427cc1 (refs/remotes/origin/master)
  305. 21:46:24 > git config core.sparsecheckout # timeout=10
  306. 21:46:24 > git checkout -f d377cf00e8aaed4dfd812c4b9e2f238b65427cc1
  307. 21:46:24 Commit message: "Set server max header size to 64KB (for the Spring Boot app)"
  308. 21:46:24 > git rev-list --no-walk d377cf00e8aaed4dfd812c4b9e2f238b65427cc1 # timeout=10
  309. 21:46:25 > git rev-parse --is-inside-work-tree # timeout=10
  310. 21:46:25 Fetching changes from the remote Git repository
  311. 21:46:25 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/service-template-ui.git # timeout=10
  312. 21:46:25 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/service-template-ui.git
  313. 21:46:25 > git --version # timeout=10
  314. 21:46:25 using GIT_SSH to set credentials jenkins user ssh key
  315. 21:46:25 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/service-template-ui.git +refs/heads/*:refs/remotes/origin/*
  316. 21:46:26 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  317. 21:46:26 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  318. 21:46:26 Checking out Revision 4df6c66a3038e2aa00e382178908255dc127e51c (refs/remotes/origin/master)
  319. 21:46:26 > git config core.sparsecheckout # timeout=10
  320. 21:46:26 > git checkout -f 4df6c66a3038e2aa00e382178908255dc127e51c
  321. 21:46:26 Commit message: "VCBP-1623: Source Control Status in Blueprint List"
  322. 21:46:26 > git rev-list --no-walk 4df6c66a3038e2aa00e382178908255dc127e51c # timeout=10
  323. 21:46:26 > git rev-parse --is-inside-work-tree # timeout=10
  324. 21:46:26 Fetching changes from the remote Git repository
  325. 21:46:26 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/service-template.git # timeout=10
  326. 21:46:26 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/service-template.git
  327. 21:46:26 > git --version # timeout=10
  328. 21:46:26 using GIT_SSH to set credentials jenkins user ssh key
  329. 21:46:26 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/service-template.git +refs/heads/*:refs/remotes/origin/*
  330. 21:46:28 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  331. 21:46:28 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  332. 21:46:28 Checking out Revision 8950b742e6ddde91ad4cce54d94fd4c16ee66ded (refs/remotes/origin/master)
  333. 21:46:28 > git config core.sparsecheckout # timeout=10
  334. 21:46:28 > git checkout -f 8950b742e6ddde91ad4cce54d94fd4c16ee66ded
  335. 21:46:28 Commit message: "Update Puppet provider bundle to support Day2 actions"
  336. 21:46:28 > git rev-list --no-walk 8950b742e6ddde91ad4cce54d94fd4c16ee66ded # timeout=10
  337. 21:46:28 > git rev-parse --is-inside-work-tree # timeout=10
  338. 21:46:28 Fetching changes from the remote Git repository
  339. 21:46:28 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/automation-service.git # timeout=10
  340. 21:46:28 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/automation-service.git
  341. 21:46:28 > git --version # timeout=10
  342. 21:46:28 using GIT_SSH to set credentials jenkins user ssh key
  343. 21:46:28 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/automation-service.git +refs/heads/*:refs/remotes/origin/*
  344. 21:46:29 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  345. 21:46:29 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  346. 21:46:29 Checking out Revision 710733316e3c0966957afc134c0e4b74496691e8 (refs/remotes/origin/master)
  347. 21:46:29 > git config core.sparsecheckout # timeout=10
  348. 21:46:29 > git checkout -f 710733316e3c0966957afc134c0e4b74496691e8
  349. 21:46:29 Commit message: "Pam's Jan 9 QBls plus docs.json for the day"
  350. 21:46:29 > git rev-list --no-walk 710733316e3c0966957afc134c0e4b74496691e8 # timeout=10
  351. 21:46:29 > git rev-parse --is-inside-work-tree # timeout=10
  352. 21:46:29 Fetching changes from the remote Git repository
  353. 21:46:29 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/symphony-inventory.git # timeout=10
  354. 21:46:29 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/symphony-inventory.git
  355. 21:46:29 > git --version # timeout=10
  356. 21:46:29 using GIT_SSH to set credentials jenkins user ssh key
  357. 21:46:29 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/symphony-inventory.git +refs/heads/*:refs/remotes/origin/*
  358. 21:46:37 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  359. 21:46:37 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  360. 21:46:37 Checking out Revision d98ba942839d7136bff777b116156c6c9e7ab424 (refs/remotes/origin/master)
  361. 21:46:37 > git config core.sparsecheckout # timeout=10
  362. 21:46:37 > git checkout -f d98ba942839d7136bff777b116156c6c9e7ab424
  363. 21:46:37 Commit message: "Fixing bad escape of passwords"
  364. 21:46:37 > git rev-list --no-walk d98ba942839d7136bff777b116156c6c9e7ab424 # timeout=10
  365. 21:46:37 > git rev-parse --is-inside-work-tree # timeout=10
  366. 21:46:37 Fetching changes from the remote Git repository
  367. 21:46:37 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ccs-billing.git # timeout=10
  368. 21:46:37 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ccs-billing.git
  369. 21:46:37 > git --version # timeout=10
  370. 21:46:37 using GIT_SSH to set credentials jenkins user ssh key
  371. 21:46:37 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ccs-billing.git +refs/heads/*:refs/remotes/origin/*
  372. 21:46:38 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  373. 21:46:38 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  374. 21:46:38 Checking out Revision 90807ba3f36bb3d99b72582d90c5914da892b332 (refs/remotes/origin/master)
  375. 21:46:38 > git config core.sparsecheckout # timeout=10
  376. 21:46:38 > git checkout -f 90807ba3f36bb3d99b72582d90c5914da892b332
  377. 21:46:38 Commit message: "VCMDEVOPS-2030 : Remove LI agent from CCS services"
  378. 21:46:38 > git rev-list --no-walk 90807ba3f36bb3d99b72582d90c5914da892b332 # timeout=10
  379. 21:46:38 > git rev-parse --is-inside-work-tree # timeout=10
  380. 21:46:38 Fetching changes from the remote Git repository
  381. 21:46:38 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ccs-command-channel.git # timeout=10
  382. 21:46:38 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ccs-command-channel.git
  383. 21:46:38 > git --version # timeout=10
  384. 21:46:38 using GIT_SSH to set credentials jenkins user ssh key
  385. 21:46:38 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ccs-command-channel.git +refs/heads/*:refs/remotes/origin/*
  386. 21:46:40 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  387. 21:46:40 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  388. 21:46:40 Checking out Revision 3bf85f09ce94975eb8b81440efc5ea328691d06b (refs/remotes/origin/master)
  389. 21:46:40 > git config core.sparsecheckout # timeout=10
  390. 21:46:40 > git checkout -f 3bf85f09ce94975eb8b81440efc5ea328691d06b
  391. 21:46:40 Commit message: "VSTAR-313 : UI API for upgrading specific agent"
  392. 21:46:40 > git rev-list --no-walk 3bf85f09ce94975eb8b81440efc5ea328691d06b # timeout=10
  393. 21:46:40 > git rev-parse --is-inside-work-tree # timeout=10
  394. 21:46:40 Fetching changes from the remote Git repository
  395. 21:46:40 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/tango-commons.git # timeout=10
  396. 21:46:40 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/tango-commons.git
  397. 21:46:40 > git --version # timeout=10
  398. 21:46:40 using GIT_SSH to set credentials jenkins user ssh key
  399. 21:46:40 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/tango-commons.git +refs/heads/*:refs/remotes/origin/*
  400. 21:46:41 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  401. 21:46:41 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  402. 21:46:41 Checking out Revision 8f8ab8c0f3d100ad0a87337cfcc52e33e71e736c (refs/remotes/origin/master)
  403. 21:46:41 > git config core.sparsecheckout # timeout=10
  404. 21:46:41 > git checkout -f 8f8ab8c0f3d100ad0a87337cfcc52e33e71e736c
  405. 21:46:41 Commit message: "Fixed regression introduced by Id76544bdb956aa581c4448104c64b8298cc5a866"
  406. 21:46:41 > git rev-list --no-walk 8f8ab8c0f3d100ad0a87337cfcc52e33e71e736c # timeout=10
  407. 21:46:41 > git rev-parse --is-inside-work-tree # timeout=10
  408. 21:46:41 Fetching changes from the remote Git repository
  409. 21:46:41 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/pipeline-service.git # timeout=10
  410. 21:46:41 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/pipeline-service.git
  411. 21:46:41 > git --version # timeout=10
  412. 21:46:41 using GIT_SSH to set credentials jenkins user ssh key
  413. 21:46:41 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/pipeline-service.git +refs/heads/*:refs/remotes/origin/*
  414. 21:46:42 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  415. 21:46:42 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  416. 21:46:42 Checking out Revision 6ad308b494fa2d404b6b5b25972cc93b29db417e (refs/remotes/origin/master)
  417. 21:46:42 > git config core.sparsecheckout # timeout=10
  418. 21:46:42 > git checkout -f 6ad308b494fa2d404b6b5b25972cc93b29db417e
  419. 21:46:42 Commit message: "Increase maintenance mode wait time"
  420. 21:46:42 > git rev-list --no-walk 6ad308b494fa2d404b6b5b25972cc93b29db417e # timeout=10
  421. 21:46:42 > git rev-parse --is-inside-work-tree # timeout=10
  422. 21:46:42 Fetching changes from the remote Git repository
  423. 21:46:42 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/pipeline-service-ui.git # timeout=10
  424. 21:46:42 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/pipeline-service-ui.git
  425. 21:46:42 > git --version # timeout=10
  426. 21:46:42 using GIT_SSH to set credentials jenkins user ssh key
  427. 21:46:42 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/pipeline-service-ui.git +refs/heads/*:refs/remotes/origin/*
  428. 21:46:45 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  429. 21:46:45 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  430. 21:46:45 Checking out Revision 3af8dac6554466afa54aafc53af81518d4f85a26 (refs/remotes/origin/master)
  431. 21:46:45 > git config core.sparsecheckout # timeout=10
  432. 21:46:45 > git checkout -f 3af8dac6554466afa54aafc53af81518d4f85a26
  433. 21:46:45 Commit message: "Fix https://jira.eng.vmware.com/browse/VRCS-4092"
  434. 21:46:45 > git rev-list --no-walk 215a9e51c631480b95cdc29615d97ce7c1ad9a12 # timeout=10
  435. 21:46:45 > git rev-parse --is-inside-work-tree # timeout=10
  436. 21:46:45 Fetching changes from the remote Git repository
  437. 21:46:45 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ccs-billing.git # timeout=10
  438. 21:46:45 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ccs-billing.git
  439. 21:46:45 > git --version # timeout=10
  440. 21:46:45 using GIT_SSH to set credentials jenkins user ssh key
  441. 21:46:45 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ccs-billing.git +refs/heads/*:refs/remotes/origin/*
  442. 21:46:46 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  443. 21:46:46 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  444. 21:46:46 Checking out Revision 90807ba3f36bb3d99b72582d90c5914da892b332 (refs/remotes/origin/master)
  445. 21:46:46 > git config core.sparsecheckout # timeout=10
  446. 21:46:46 > git checkout -f 90807ba3f36bb3d99b72582d90c5914da892b332
  447. 21:46:46 Commit message: "VCMDEVOPS-2030 : Remove LI agent from CCS services"
  448. 21:46:46 > git rev-parse --is-inside-work-tree # timeout=10
  449. 21:46:46 Fetching changes from the remote Git repository
  450. 21:46:46 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ops-zk.git # timeout=10
  451. 21:46:46 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ops-zk.git
  452. 21:46:46 > git --version # timeout=10
  453. 21:46:46 using GIT_SSH to set credentials jenkins user ssh key
  454. 21:46:46 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ops-zk.git +refs/heads/*:refs/remotes/origin/*
  455. 21:46:47 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  456. 21:46:47 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  457. 21:46:47 Checking out Revision 1b8ccc039bb5b566a4b1b1807cb90533eb39972b (refs/remotes/origin/master)
  458. 21:46:47 > git config core.sparsecheckout # timeout=10
  459. 21:46:47 > git checkout -f 1b8ccc039bb5b566a4b1b1807cb90533eb39972b
  460. 21:46:47 Commit message: "fix UK staging job and extra } in prod job"
  461. 21:46:47 > git rev-list --no-walk 1b8ccc039bb5b566a4b1b1807cb90533eb39972b # timeout=10
  462. 21:46:47 > git rev-parse --is-inside-work-tree # timeout=10
  463. 21:46:47 Fetching changes from the remote Git repository
  464. 21:46:47 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/ops-kafka.git # timeout=10
  465. 21:46:47 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/ops-kafka.git
  466. 21:46:47 > git --version # timeout=10
  467. 21:46:47 using GIT_SSH to set credentials jenkins user ssh key
  468. 21:46:47 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/ops-kafka.git +refs/heads/*:refs/remotes/origin/*
  469. 21:46:48 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  470. 21:46:48 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  471. 21:46:48 Checking out Revision 6cb15ed0628f6cf4ce2c8760eb2f693a3d42b2ab (refs/remotes/origin/master)
  472. 21:46:48 > git config core.sparsecheckout # timeout=10
  473. 21:46:48 > git checkout -f 6cb15ed0628f6cf4ce2c8760eb2f693a3d42b2ab
  474. 21:46:48 Commit message: "ops-kafka: remove -uk from --app and DNS on staging UK deployment script"
  475. 21:46:48 > git rev-list --no-walk 6cb15ed0628f6cf4ce2c8760eb2f693a3d42b2ab # timeout=10
  476. 21:46:48 > git rev-parse --is-inside-work-tree # timeout=10
  477. 21:46:48 Fetching changes from the remote Git repository
  478. 21:46:48 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/cerebro.git # timeout=10
  479. 21:46:48 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/cerebro.git
  480. 21:46:48 > git --version # timeout=10
  481. 21:46:48 using GIT_SSH to set credentials jenkins user ssh key
  482. 21:46:48 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/cerebro.git +refs/heads/*:refs/remotes/origin/*
  483. 21:46:50 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  484. 21:46:50 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  485. 21:46:50 Checking out Revision 4702287c92cd2ff761dcc5248567d3232360e0ea (refs/remotes/origin/master)
  486. 21:46:50 > git config core.sparsecheckout # timeout=10
  487. 21:46:50 > git checkout -f 4702287c92cd2ff761dcc5248567d3232360e0ea
  488. 21:46:50 Commit message: "VSYM-16845: PoP handles case where tenant already exists"
  489. 21:46:50 > git rev-list --no-walk 4702287c92cd2ff761dcc5248567d3232360e0ea # timeout=10
  490. 21:46:50 > git rev-parse --is-inside-work-tree # timeout=10
  491. 21:46:50 Fetching changes from the remote Git repository
  492. 21:46:50 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/tango-vsphere.git # timeout=10
  493. 21:46:50 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/tango-vsphere.git
  494. 21:46:50 > git --version # timeout=10
  495. 21:46:50 using GIT_SSH to set credentials jenkins user ssh key
  496. 21:46:50 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/tango-vsphere.git +refs/heads/*:refs/remotes/origin/*
  497. 21:46:51 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  498. 21:46:51 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  499. 21:46:51 Checking out Revision 82fdd23985b442457212d536d25ce7d929d1c30b (refs/remotes/origin/master)
  500. 21:46:51 > git config core.sparsecheckout # timeout=10
  501. 21:46:51 > git checkout -f 82fdd23985b442457212d536d25ce7d929d1c30b
  502. 21:46:51 Commit message: "[VCOM-8415] Mask sensitive fields when logging task failure details"
  503. 21:46:51 > git rev-list --no-walk 82fdd23985b442457212d536d25ce7d929d1c30b # timeout=10
  504. 21:46:51 > git rev-parse --is-inside-work-tree # timeout=10
  505. 21:46:51 Fetching changes from the remote Git repository
  506. 21:46:51 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/tango/project-service.git # timeout=10
  507. 21:46:51 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/tango/project-service.git
  508. 21:46:51 > git --version # timeout=10
  509. 21:46:51 using GIT_SSH to set credentials jenkins user ssh key
  510. 21:46:51 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/tango/project-service.git +refs/heads/*:refs/remotes/origin/*
  511. 21:46:54 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  512. 21:46:54 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  513. 21:46:54 Checking out Revision 6f54983157dbbce3f66c29505342444543e9a98b (refs/remotes/origin/master)
  514. 21:46:54 > git config core.sparsecheckout # timeout=10
  515. 21:46:54 > git checkout -f 6f54983157dbbce3f66c29505342444543e9a98b
  516. 21:46:54 Commit message: "Do not parse empty id token"
  517. 21:46:54 > git rev-list --no-walk 6f54983157dbbce3f66c29505342444543e9a98b # timeout=10
  518. 21:46:54 > git rev-parse --is-inside-work-tree # timeout=10
  519. 21:46:54 Fetching changes from the remote Git repository
  520. 21:46:54 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/relocation-service.git # timeout=10
  521. 21:46:54 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/relocation-service.git
  522. 21:46:54 > git --version # timeout=10
  523. 21:46:54 using GIT_SSH to set credentials jenkins user ssh key
  524. 21:46:54 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/relocation-service.git +refs/heads/*:refs/remotes/origin/*
  525. 21:46:55 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  526. 21:46:55 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  527. 21:46:55 Checking out Revision afad5f4ffae32579d415830c002f59c6ab4c5ede (refs/remotes/origin/master)
  528. 21:46:55 > git config core.sparsecheckout # timeout=10
  529. 21:46:55 > git checkout -f afad5f4ffae32579d415830c002f59c6ab4c5ede
  530. 21:46:55 Commit message: "VTM-808 Customize notification email template"
  531. 21:46:55 > git rev-list --no-walk afad5f4ffae32579d415830c002f59c6ab4c5ede # timeout=10
  532. 21:46:55 > git rev-parse --is-inside-work-tree # timeout=10
  533. 21:46:55 Fetching changes from the remote Git repository
  534. 21:46:55 > git config remote.origin.url ssh://git@gitlab.eng.vmware.com/vrbc-collector.git # timeout=10
  535. 21:46:55 Fetching upstream changes from ssh://git@gitlab.eng.vmware.com/vrbc-collector.git
  536. 21:46:55 > git --version # timeout=10
  537. 21:46:55 using GIT_SSH to set credentials jenkins user ssh key
  538. 21:46:55 > git fetch --tags --progress ssh://git@gitlab.eng.vmware.com/vrbc-collector.git +refs/heads/*:refs/remotes/origin/*
  539. 21:46:56 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  540. 21:46:56 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  541. 21:46:56 Checking out Revision d54cc15f6d44e7d2259f016f7a390cf0a4242004 (refs/remotes/origin/master)
  542. 21:46:57 > git config core.sparsecheckout # timeout=10
  543. 21:46:57 > git checkout -f d54cc15f6d44e7d2259f016f7a390cf0a4242004
  544. 21:46:57 Commit message: "Remove stargate Admin path from vrbc-adapter. JIRA:VSTAR-352"
  545. 21:46:57 > git rev-list --no-walk d54cc15f6d44e7d2259f016f7a390cf0a4242004 # timeout=10
  546. 21:46:57 [test-deploy-scripts-vnegi] $ /bin/bash -ex /tmp/jenkins4283166137054034033.sh
  547. 21:46:57 + cd /var/jenkins/workspace/test-deploy-scripts-vnegi
  548. 21:46:57 + source ./symphony-infra/kubernetes-jenkins/aws/config/sym-selfserve.env
  549. 21:46:57 ++ export DEPLOYMENT_PREFIX=sym-selfserve.k8s.local
  550. 21:46:57 ++ DEPLOYMENT_PREFIX=sym-selfserve.k8s.local
  551. 21:46:57 ++ export KOPS_STATE_STORE=s3://cluster-sym-selfserve.k8s.local
  552. 21:46:57 ++ KOPS_STATE_STORE=s3://cluster-sym-selfserve.k8s.local
  553. 21:46:57 ++ export KOPS_CLOUD_LABELS=team=symphony,owner=ndalal,environment=sym-selfserve.k8s.local
  554. 21:46:57 ++ KOPS_CLOUD_LABELS=team=symphony,owner=ndalal,environment=sym-selfserve.k8s.local
  555. 21:46:57 ++ export AWS_ACCESS_KEY_ID=AKIAIS4X4HPU5G2KWEOQ
  556. 21:46:57 ++ AWS_ACCESS_KEY_ID=AKIAIS4X4HPU5G2KWEOQ
  557. 21:46:57 ++ export AWS_SECRET_ACCESS_KEY=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
  558. 21:46:57 ++ AWS_SECRET_ACCESS_KEY=q29wrHWJ1jjWMek9vZoEpcOArQzyB2v6IHMLKyCg
  559. 21:46:57 ++ export AWS_ROUTE53_ACCESS_KEY=AKIAJWWG7YI5HERIPVIA
  560. 21:46:57 ++ AWS_ROUTE53_ACCESS_KEY=AKIAJWWG7YI5HERIPVIA
  561. 21:46:57 ++ export AWS_ROUTE53_SECRET_KEY=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
  562. 21:46:57 ++ AWS_ROUTE53_SECRET_KEY=/z7F4VU0+jlBLZLsOuHKRTwlkqTNAX1/e38OkG/L
  563. 21:46:57 ++ export AWS_S3_BACKUP_ACCESS_KEY=AKIAITHUGF23UJOPYHWA
  564. 21:46:57 ++ AWS_S3_BACKUP_ACCESS_KEY=AKIAITHUGF23UJOPYHWA
  565. 21:46:57 ++ export AWS_S3_BACKUP_SECRET_KEY=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
  566. 21:46:57 ++ AWS_S3_BACKUP_SECRET_KEY=18b4cVXFwvisoGcHe88fQJnFPVGDZE4DrM3w1+o3
  567. 21:46:57 ++ export AWS_DEFAULT_REGION=us-east-1
  568. 21:46:57 ++ AWS_DEFAULT_REGION=us-east-1
  569. 21:46:57 ++ export KUBERNETES_PROVIDER=aws
  570. 21:46:57 ++ KUBERNETES_PROVIDER=aws
  571. 21:46:57 ++ export KUBERNETES_VERSION=1.9.6
  572. 21:46:57 ++ KUBERNETES_VERSION=1.9.6
  573. 21:46:57 ++ export KUBECONFIG=/var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config
  574. 21:46:57 ++ KUBECONFIG=/var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config
  575. 21:46:57 ++ export KOPS_VERSION=1.11.3
  576. 21:46:57 ++ KOPS_VERSION=1.11.3
  577. 21:46:57 + tox -c symphony-infra/tox.ini -revenv --notest
  578. 21:46:57 venv recreate: /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/.tox/venv
  579. 21:47:00 venv installdeps: -r/var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/known-good.txt
  580. 21:47:14 venv develop-inst: /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy
  581. 21:47:22 venv installed: adal==1.2.0,asn1crypto==0.24.0,atomicwrites==1.2.1,attrs==18.2.0,boto3==1.4.4,botocore==1.5.95,cachetools==3.0.0,certifi==2018.11.29,cffi==1.11.5,configparser==3.5.0,cryptography==2.1.4,datadog==0.14.0,decorator==4.0.10,docutils==0.12,Events==0.3,futures==3.0.5,google-auth==1.6.2,idna==2.8,jenkinsapi==0.3.6.dev13,jmespath==0.9.0,kubernetes==8.0.1,more-itertools==5.0.0,oauthlib==2.1.0,pluggy==0.8.1,potsdb==1.0.3,py==1.7.0,pyasn1==0.4.5,pyasn1-modules==0.2.3,pycparser==2.19,pycryptodome==3.4.11,pydash==4.2.1,PyJWT==1.7.1,pykube==0.16a1,pytest==4.1.0,python-dateutil==2.5.3,pytz==2016.7,PyYAML==3.12,requests==2.12.1,requests-oauthlib==1.1.0,rsa==4.0,Rx==1.6.0,s3transfer==0.1.13,secret==0.8,simplejson==3.10.0,six==1.10.0,tabulate==0.8.2,termcolor==1.1.0,tzlocal==1.5.1,urllib3==1.24.1,-e git+ssh://git@gitlab.eng.vmware.com/symphony-infra.git@30c2814965ea4f20188567093d7e5840ba0fc598#egg=vmware.symphony.deploy&subdirectory=src/vmware.symphony.deploy,websocket-client==0.54.0
  582. 21:47:22 ___________________________________ summary ____________________________________
  583. 21:47:22 venv: skipped tests
  584. 21:47:22 congratulations :)
  585. 21:47:22 + symphony-infra/.tox/venv/bin/python --version
  586. 21:47:22 Python 3.6.7
  587. 21:47:22 + . symphony-infra/.tox/venv/bin/activate
  588. 21:47:22 ++ deactivate nondestructive
  589. 21:47:22 ++ unset -f pydoc
  590. 21:47:22 ++ '[' -z '' ']'
  591. 21:47:22 ++ '[' -z '' ']'
  592. 21:47:22 ++ '[' -n /bin/bash ']'
  593. 21:47:22 ++ hash -r
  594. 21:47:22 ++ '[' -z '' ']'
  595. 21:47:22 ++ unset VIRTUAL_ENV
  596. 21:47:22 ++ '[' '!' nondestructive = nondestructive ']'
  597. 21:47:22 ++ VIRTUAL_ENV=/var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/.tox/venv
  598. 21:47:22 ++ export VIRTUAL_ENV
  599. 21:47:22 ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
  600. 21:47:22 ++ PATH=/var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/.tox/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
  601. 21:47:22 ++ export PATH
  602. 21:47:22 ++ '[' -z '' ']'
  603. 21:47:22 ++ '[' -z '' ']'
  604. 21:47:22 ++ _OLD_VIRTUAL_PS1=
  605. 21:47:22 ++ '[' x '!=' x ']'
  606. 21:47:22 +++ basename /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/.tox/venv
  607. 21:47:22 ++ PS1='(venv) '
  608. 21:47:22 ++ export PS1
  609. 21:47:22 ++ alias pydoc
  610. 21:47:22 ++ '[' -n /bin/bash ']'
  611. 21:47:22 ++ hash -r
  612. 21:47:22 + initialize-k8s --sym_repo_url https://symphony.jfrog.io/symphony/repo --sym_infra_repo_url https://build-artifactory.eng.vmware.com/artifactory/symphony-infra-local --sym_repo_username symphony-deployer --sym_repo_password 'Symphony1!' --kubernetes_folder kubernetes --kubernetes_version 1.9.6 --local_repo_folder /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra --log-level DEBUG
  613. 21:47:23 2019-01-09 21:47:23,103 INFO [MainThread]: Downloading k8s...
  614. 21:47:23 2019-01-09 21:47:23,123 DEBUG [MainThread]: Starting new HTTPS connection (1): storage.googleapis.com
  615. 21:47:23 2019-01-09 21:47:23,411 DEBUG [MainThread]: https://storage.googleapis.com:443 "GET /kubernetes-release/release/v1.9.6/kubernetes-client-linux-amd64.tar.gz HTTP/1.1" 200 15631905
  616. 21:47:24 2019-01-09 21:47:24,641 INFO [MainThread]: Downloaded kubectl from https://storage.googleapis.com/kubernetes-release/release/v1.9.6/kubernetes-client-linux-amd64.tar.gz and placed at /root/.local/bin/kubectl
  617. 21:47:24 2019-01-09 21:47:24,643 INFO [MainThread]: Downloading cluster configuration from https://build-artifactory.eng.vmware.com/artifactory/symphony-infra-local/kubernetes/deployments/aws/kube/sym-selfserve.k8s.local-config and storing in /var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config
  618. 21:47:24 2019-01-09 21:47:24,643 DEBUG [MainThread]: Download URL = [curl -u 'symphony-deployer:Symphony1!' --create-dirs -o /var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config https://build-artifactory.eng.vmware.com/artifactory/symphony-infra-local/kubernetes/deployments/aws/kube/sym-selfserve.k8s.local-config]
  619. 21:47:24 % Total % Received % Xferd Average Speed Time Time Time Current
  620. 21:47:24 Dload Upload Total Spent Left Speed
  621. 21:47:24
  622. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  623. 100 5763 100 5763 0 0 21611 0 --:--:-- --:--:-- --:--:-- 21665
  624. 21:47:24 2019-01-09 21:47:24,930 INFO [MainThread]: No exported AUTOMATION_CERTIFICATE_DATA/AUTOMATION_CERTIFICATE_KEY!. Continue without setting automation-user!
  625. 21:47:25 + unset SYMPHONY_DNS_NAME
  626. 21:47:25 + unset SYMPHONY_DNS_RECORDSET_NAME
  627. 21:47:25 + deployccscommandchannel
  628. 21:47:25 + cd /var/jenkins/workspace/test-deploy-scripts-vnegi/ccs-command-channel/cicd/scripts
  629. 21:47:25 + python ./deploy_ccs_command_channel_server.py --tag 1-2-vnegi-test7 --deploy-type upgrade --environment dev --log-level DEBUG --namespace vnegi-test6 --kubeconfig /var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config --replica-size 1 --csp-uri http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com --client-ids stargate-automation --lemans-server-url http://af93bf411142a11e9905212ac25d70fa-404722773.us-east-1.elb.amazonaws.com --csp-client-id stargate-automation --enable-postgres
  630. 21:47:25 2019-01-09 21:47:25,871 INFO [MainThread]: /var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config
  631. 21:47:25 2019-01-09 21:47:25,872 INFO [MainThread]: Value of csp-uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com, csp-redirect-uri= ,csp-svc-redt-uri=
  632. 21:47:25 2019-01-09 21:47:25,872 INFO [MainThread]: Value of csp-uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com, csp-redirect-uri= ,csp-svc-redt-uri=
  633. 21:47:25 2019-01-09 21:47:25,872 INFO [MainThread]: /var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config
  634. 21:47:25 2019-01-09 21:47:25,939 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  635. 21:47:26 2019-01-09 21:47:26,532 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server HTTP/1.1" 200 None
  636. 21:47:26 2019-01-09 21:47:26,537 INFO [MainThread]: Found: ['ccs-command-channel-server-deployment-1-2-vnegi-test6']
  637. 21:47:26 2019-01-09 21:47:26,646 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/extensions/v1beta1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server HTTP/1.1" 200 None
  638. 21:47:26 2019-01-09 21:47:26,752 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/extensions/v1beta1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server HTTP/1.1" 200 None
  639. 21:47:26 2019-01-09 21:47:26,755 INFO [MainThread]: Labels: {'app': 'ccs-command-channel-server', 'app-build': 'ccs-command-channel-server-1-2-vnegi-test6', 'build': '1-2-vnegi-test6', 'environment': 'dev', 'removekey': '96d4f5454d1f4002a23e7a588e0a3570', 'service-app': 'vrbc', 'service-type': 'xenon', 'tenancy': 'multiple-tenants'}
  640. 21:47:26 2019-01-09 21:47:26,859 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/extensions/v1beta1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server HTTP/1.1" 200 None
  641. 21:47:26 2019-01-09 21:47:26,864 INFO [MainThread]: Upgrade strategy is rollingUpdate: False
  642. 21:47:26 2019-01-09 21:47:26,971 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/statefulsets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 165
  643. 21:47:27 2019-01-09 21:47:27,077 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1beta1/namespaces/vnegi-test6/statefulsets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 175
  644. 21:47:27 2019-01-09 21:47:27,182 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 None
  645. 21:47:27 2019-01-09 21:47:27,187 INFO [MainThread]: [AppInfo={'svchost': {'name': 'ccs-command-channel-server-svc', 'gatewayregsvcname': 'ccs-command-channel-server-svc', 'ports': {'http': '8000'}}, 'labels': {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test6'}, 'resources': {'app_cpu_requests': '1200m', 'app_mem_requests': '7000Mi', 'app_cpu_limits': '1200m', 'app_mem_limits': '7000Mi', 'app_jvm_mem': '4500m'}, 'replicas': {'replicas': 3, 'dev_replicas': 1, 'pods': 3, 'dev_pods': 1}, 'artifactory': {'internal': 'symphony-docker-local.artifactory.eng.vmware.com', 'external': 'symphony-docker-local.jfrog.io'}, 'yamls': {'resource_yaml_deployment': 'ccs-command-channel-server.yaml', 'resource_yaml_statefulset': 'ccs-command-channel-server-statefulset.yaml', 'service_yaml': 'ccs-command-channel-server-services.yaml'}, 'application_strategy': 'xenon-stateful', 'auth_provider': 'CSP', 'operation_strategy': 'kubernetes', 'external_dependencies': OrderedDict([('CloudProvider', {'vendor': <class 'vmware_symphony_deploy.deployments.dependency.cloudprovider.aws.AWS'>, 'services': {'RDS': {'permission': 'RO'}, 'RedShift': {'permission': 'RO'}, 'Migration': {}}}), ('Persistence', {'vendor': <class 'vmware_symphony_deploy.deployments.dependency.persistence.aurora.aurora.Aurora'>, 'db-migration-strategy': 'side-by-side', 'service_parameters': {'db_name': 'ccscommandchannel'}}), ('ContainerOrchestrator', {'dependency': False, 'vendor': <class 'vmware_symphony_deploy.deployments.dependency.containerorchestration.kubernetes.Kubernetes'>}), ('PlatformServiceProvider', {'vendor': <class 'vmware_symphony_deploy.deployments.dependency.serviceprovider.csp.CSP'>, 'role': 'subscriber', 'service_parameters': {'redirect_uri': '', 'csp_client_id': 'stargate-automation', 'csp_service_auth_secret': 'K<Dj+xR9a4$`Gsx^'}}), ('Monitoring', {'vendor': <class 'vmware_symphony_deploy.deployments.dependency.metricforwarder.wavefrontreporter.WavefrontReporter'>})]), 'gateway': {'vendor': 'Heimdall', 'gateway_regs_strategy': 'deployment-scripts', 'public_service_endpoints': [{'id': 'cmd-instance-service', 'path': '/vrbc/cmd/instance'}, {'id': 'event-service', 'path': '/vrbc/cmd/event'}, {'id': 'cmd-server-health', 'path': '/vrbc/cmd/external/system-status'}, {'id': 'stargate-service', 'path': '/stargate/api'}], 'private_public_endpoints': [{'id': 'rdc-registration-service', 'public_path': '/vrb/dc/manage/register', 'private_path': '/stargate/api/v1/proxy/register'}, {'id': 'artifact', 'public_path': '/vrb/artifact-provider', 'private_path': '/stargate/api/v1/artifact-provider'}]}, 'external_dependency_list': OrderedDict([('CloudProvider', {'dependency': True, 'vendor': <vmware_symphony_deploy.deployments.dependency.cloudprovider.aws.AWS object at 0x7ff5c033add8>}), ('Persistence', {'dependency': True, 'vendor': <vmware_symphony_deploy.deployments.dependency.persistence.aurora.aurora.Aurora object at 0x7ff5c033a978>}), ('ContainerOrchestrator', {'dependency': False, 'vendor': <vmware_symphony_deploy.deployments.dependency.containerorchestration.kubernetes.Kubernetes object at 0x7ff5c033ad68>}), ('PlatformServiceProvider', {'dependency': True, 'vendor': <vmware_symphony_deploy.deployments.dependency.serviceprovider.csp.CSP object at 0x7ff5c0343710>}), ('Monitoring', {'dependency': True, 'vendor': <vmware_symphony_deploy.deployments.dependency.metricforwarder.wavefrontreporter.WavefrontReporter object at 0x7ff5c0343828>})]), 'api': <pykube.http.HTTPClient object at 0x7ff5c0333898>, 'kubeconfig': '/var/jenkins/workspace/test-deploy-scripts-vnegi/.kube/sym-selfserve.k8s.local-config', 'build': '1-2-vnegi-test6', 'type': <ControllerType.Deployment: (1,)>}]
  646. 21:47:27 2019-01-09 21:47:27,291 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /version/ HTTP/1.1" 200 263
  647. 21:47:27 2019-01-09 21:47:27,292 INFO [MainThread]: Kubernetes version: ('1', '11')
  648. 21:47:27 2019-01-09 21:47:27,294 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  649. 21:47:27 2019-01-09 21:47:27,294 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5c0211470>}: attempt [1]
  650. 21:47:27 2019-01-09 21:47:27,302 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  651. 21:47:27 2019-01-09 21:47:27,552 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  652. 21:47:27 2019-01-09 21:47:27,553 INFO [MainThread]: app_labels : {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test6'}
  653. 21:47:27 2019-01-09 21:47:27,554 INFO [MainThread]: Starting [app=ccs-command-channel-server] Healthcheck [build=1-2-vnegi-test6]
  654. 21:47:27 2019-01-09 21:47:27,663 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 None
  655. 21:47:27 2019-01-09 21:47:27,777 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 None
  656. 21:47:27 2019-01-09 21:47:27,893 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  657. 21:47:27 2019-01-09 21:47:27,899 INFO [MainThread]: [app=ccs-command-channel-server] pods. [expected=1] [actual=1]
  658. 21:47:27 2019-01-09 21:47:27,899 DEBUG [MainThread]: Default nodegroup curl = ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEwNDcsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkyNDcsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.Fme_SDe4__3J8ox6xGVwEs96V-nor1h4xQVLhendnpHVBsOWE4Qd8G6njpxeHRTDyP3Em0rZ16YhO5tgApi8RYh5ayA-GIHOwzCya2aT4S6zdowE4m9tRAZfYxIUF7ffrmdM-lhr1inFkFdQLNT5iFSxf7k7YL1wGvrmnkLYhnxvnKGono8p6eSL6TkqPhX5qAc7vhNX8wBB9E9vZrkF_-_PRTQVgFalPuoJH6BHdIj03GjKXnbkLXwGRBkFXjCPFQTPcKWOAuCoFF3nfTPP95hpkwvPQIhQNO8wFggAXoDug7cnzzi2lF0ABJUDLYtuICvAuVTdNDo_CaSFughwLQ', '', 'http://172.20.48.157:8000/core/node-groups/default']
  659. 21:47:27 2019-01-09 21:47:27,900 INFO [MainThread]: Running in cluster: curlpod-othbq0: ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEwNDcsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkyNDcsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.Fme_SDe4__3J8ox6xGVwEs96V-nor1h4xQVLhendnpHVBsOWE4Qd8G6njpxeHRTDyP3Em0rZ16YhO5tgApi8RYh5ayA-GIHOwzCya2aT4S6zdowE4m9tRAZfYxIUF7ffrmdM-lhr1inFkFdQLNT5iFSxf7k7YL1wGvrmnkLYhnxvnKGono8p6eSL6TkqPhX5qAc7vhNX8wBB9E9vZrkF_-_PRTQVgFalPuoJH6BHdIj03GjKXnbkLXwGRBkFXjCPFQTPcKWOAuCoFF3nfTPP95hpkwvPQIhQNO8wFggAXoDug7cnzzi2lF0ABJUDLYtuICvAuVTdNDo_CaSFughwLQ', '', 'http://172.20.48.157:8000/core/node-groups/default']
  660. 21:47:28 2019-01-09 21:47:28,014 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  661. 21:47:28 2019-01-09 21:47:28,016 INFO [MainThread]: Timing out at 2019-01-09 21:49:28.016914
  662. 21:47:28 2019-01-09 21:47:28,127 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-othbq0 HTTP/1.1" 200 None
  663. 21:47:28 2019-01-09 21:47:28,130 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:28.016914].
  664. 21:47:29 2019-01-09 21:47:29,242 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-othbq0 HTTP/1.1" 200 None
  665. 21:47:29 2019-01-09 21:47:29,248 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:28.016914].
  666. 21:47:30 2019-01-09 21:47:30,353 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-othbq0 HTTP/1.1" 200 None
  667. 21:47:30 2019-01-09 21:47:30,471 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-othbq0/log HTTP/1.1" 200 1109
  668. 21:47:30 2019-01-09 21:47:30,473 DEBUG [MainThread]: Command output: curlpod-othbq0(0) {"config":{"nodeRemovalDelayMicros":300000000,"stableGroupMaintenanceIntervalCount":5,"peerRequestTimeoutMicros":20000000},"nodes":{"c36a2d6f-eafc-4ba9-9cb8-30be9c153cac":{"groupReference":"http://172.20.48.157:8000/core/node-groups/default","status":"AVAILABLE","options":["PEER"],"id":"c36a2d6f-eafc-4ba9-9cb8-30be9c153cac","membershipQuorum":1,"locationQuorum":1,"documentVersion":1,"documentKind":"com:vmware:xenon:services:common:NodeState","documentSelfLink":"/core/node-groups/default/c36a2d6f-eafc-4ba9-9cb8-30be9c153cac","documentUpdateTimeMicros":1547098312653002,"documentExpirationTimeMicros":0}},"lastChanges":["PEER_STATUS_CHANGE"],"membershipUpdateTimeMicros":1547098312653002,"localMembershipUpdateTimeMicros":1547098312653002,"documentVersion":2,"documentKind":"com:vmware:xenon:services:common:NodeGroupService:NodeGroupState","documentSelfLink":"/core/node-groups/default","documentUpdateTimeMicros":1547098312655000,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"c36a2d6f-eafc-4ba9-9cb8-30be9c153cac","documentAuthPrincipalLink":"/core/authz/system-user"}
  669. 21:47:30 2019-01-09 21:47:30,583 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-othbq0 HTTP/1.1" 200 None
  670. 21:47:30 2019-01-09 21:47:30,584 INFO [MainThread]: [app=ccs-command-channel-server] node-group is healthy
  671. 21:47:30 2019-01-09 21:47:30,585 INFO [MainThread]: [deployment=upgrade] deploying service on [env=dev] to [build=1-2-vnegi-test7] using YAML templates: None and ccs-command-channel-server-services.yaml
  672. 21:47:30 2019-01-09 21:47:30,587 INFO [MainThread]: Creating secret ccs-command-channel-server-awsconfig-1-2-vnegi-test7 :
  673. 21:47:30 2019-01-09 21:47:30,587 INFO [MainThread]: Creating object: type Secret name ccs-command-channel-server-awsconfig-1-2-vnegi-test7
  674. 21:47:30 2019-01-09 21:47:30,593 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  675. 21:47:30 2019-01-09 21:47:30,992 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/secrets HTTP/1.1" 201 1245
  676. 21:47:30 2019-01-09 21:47:30,993 INFO [MainThread]: Created secret ccs-command-channel-server-awsconfig-1-2-vnegi-test7 successfully.
  677. 21:47:30 2019-01-09 21:47:30,995 INFO [MainThread]: Creating secret ccs-command-channel-server-dbconfig-1-2-vnegi-test7 :
  678. 21:47:30 2019-01-09 21:47:30,995 INFO [MainThread]: Postgres server is postgres.vnegi-test6.svc.cluster.local
  679. 21:47:30 2019-01-09 21:47:30,996 INFO [MainThread]: Creating object: type Secret name ccs-command-channel-server-dbconfig-1-2-vnegi-test7
  680. 21:47:31 2019-01-09 21:47:31,100 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/secrets HTTP/1.1" 201 698
  681. 21:47:31 2019-01-09 21:47:31,101 INFO [MainThread]: Created secret ccs-command-channel-server-dbconfig-1-2-vnegi-test7 successfully.
  682. 21:47:31 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/postgres_lib.py:81: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use api parameter instead
  683. 21:47:31 env=[{"name": "PGPASSWORD", "value": password}],
  684. 21:47:31 2019-01-09 21:47:31,115 INFO [MainThread]: Running in cluster: psqlpod-rxpkml: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT datname AS result FROM pg_database WHERE datname='ccscommandchannel-1-2-vnegi-test7'"]
  685. 21:47:31 2019-01-09 21:47:31,119 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  686. 21:47:31 2019-01-09 21:47:31,525 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1551
  687. 21:47:31 2019-01-09 21:47:31,527 INFO [MainThread]: Timing out at 2019-01-09 21:49:31.527531
  688. 21:47:31 2019-01-09 21:47:31,630 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rxpkml HTTP/1.1" 200 None
  689. 21:47:31 2019-01-09 21:47:31,633 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:31.527531].
  690. 21:47:32 2019-01-09 21:47:32,742 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rxpkml HTTP/1.1" 200 None
  691. 21:47:32 2019-01-09 21:47:32,744 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:31.527531].
  692. 21:47:33 2019-01-09 21:47:33,851 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rxpkml HTTP/1.1" 200 None
  693. 21:47:33 2019-01-09 21:47:33,965 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rxpkml/log HTTP/1.1" 200 28
  694. 21:47:33 2019-01-09 21:47:33,966 DEBUG [MainThread]: Command output: psqlpod-rxpkml(0) result
  695. 21:47:33 --------
  696. 21:47:33 (0 rows)
  697. 21:47:33
  698. 21:47:33
  699. 21:47:34 2019-01-09 21:47:34,079 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-rxpkml HTTP/1.1" 200 None
  700. 21:47:34 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/postgres_lib.py:32: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use api parameter instead
  701. 21:47:34 env=[{"name": "PGPASSWORD", "value": password}],
  702. 21:47:34 2019-01-09 21:47:34,098 INFO [MainThread]: Running in cluster: psqlpod-gr2bqd: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', 'CREATE DATABASE "ccscommandchannel-1-2-vnegi-test7"']
  703. 21:47:34 2019-01-09 21:47:34,103 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  704. 21:47:34 2019-01-09 21:47:34,500 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1513
  705. 21:47:34 2019-01-09 21:47:34,502 INFO [MainThread]: Timing out at 2019-01-09 21:49:34.502377
  706. 21:47:34 2019-01-09 21:47:34,604 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gr2bqd HTTP/1.1" 200 1675
  707. 21:47:34 2019-01-09 21:47:34,605 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:34.502377].
  708. 21:47:35 2019-01-09 21:47:35,709 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gr2bqd HTTP/1.1" 200 None
  709. 21:47:35 2019-01-09 21:47:35,710 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:34.502377].
  710. 21:47:36 2019-01-09 21:47:36,814 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gr2bqd HTTP/1.1" 200 None
  711. 21:47:36 2019-01-09 21:47:36,924 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gr2bqd/log HTTP/1.1" 200 16
  712. 21:47:36 2019-01-09 21:47:36,925 DEBUG [MainThread]: Command output: psqlpod-gr2bqd(0) CREATE DATABASE
  713. 21:47:36
  714. 21:47:37 2019-01-09 21:47:37,033 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-gr2bqd HTTP/1.1" 200 None
  715. 21:47:37 2019-01-09 21:47:37,045 INFO [MainThread]: Running in cluster: psqlpod-dgx5ex: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT datname AS result FROM pg_database WHERE datname='ccscommandchannel-1-2-vnegi-test7'"]
  716. 21:47:37 2019-01-09 21:47:37,050 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  717. 21:47:37 2019-01-09 21:47:37,440 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1551
  718. 21:47:37 2019-01-09 21:47:37,442 INFO [MainThread]: Timing out at 2019-01-09 21:49:37.442355
  719. 21:47:37 2019-01-09 21:47:37,544 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex HTTP/1.1" 200 None
  720. 21:47:37 2019-01-09 21:47:37,546 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:37.442355].
  721. 21:47:38 2019-01-09 21:47:38,648 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex HTTP/1.1" 200 None
  722. 21:47:38 2019-01-09 21:47:38,650 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:37.442355].
  723. 21:47:39 2019-01-09 21:47:39,754 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex HTTP/1.1" 200 None
  724. 21:47:39 2019-01-09 21:47:39,755 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:49:37.442355].
  725. 21:47:40 2019-01-09 21:47:40,858 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex HTTP/1.1" 200 None
  726. 21:47:40 2019-01-09 21:47:40,969 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex/log HTTP/1.1" 200 116
  727. 21:47:40 2019-01-09 21:47:40,970 DEBUG [MainThread]: Command output: psqlpod-dgx5ex(0) result
  728. 21:47:40 -----------------------------------
  729. 21:47:40 ccscommandchannel-1-2-vnegi-test7
  730. 21:47:40 (1 row)
  731. 21:47:40
  732. 21:47:40
  733. 21:47:41 2019-01-09 21:47:41,083 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-dgx5ex HTTP/1.1" 200 None
  734. 21:47:41 2019-01-09 21:47:41,084 INFO [MainThread]: Creating secret ccs-command-channel-server-cspconfig-1-2-vnegi-test7 :
  735. 21:47:41 2019-01-09 21:47:41,085 INFO [MainThread]: Creating object: type Secret name ccs-command-channel-server-cspconfig-1-2-vnegi-test7
  736. 21:47:41 2019-01-09 21:47:41,188 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/secrets HTTP/1.1" 201 889
  737. 21:47:41 2019-01-09 21:47:41,190 INFO [MainThread]: Created secret ccs-command-channel-server-cspconfig-1-2-vnegi-test7 successfully.
  738. 21:47:41 2019-01-09 21:47:41,190 INFO [MainThread]: yaml_filename: ccs-command-channel-server.yaml
  739. 21:47:41 2019-01-09 21:47:41,193 INFO [MainThread]: kind: Service
  740. 21:47:41 apiVersion: v1
  741. 21:47:41 metadata:
  742. 21:47:41 name: pccs-command-channel-server-svc-1-2-vnegi-test7
  743. 21:47:41 namespace: vnegi-test6
  744. 21:47:41 labels:
  745. 21:47:41 environment: dev
  746. 21:47:41 app: ccs-command-channel-server
  747. 21:47:41 tenancy : multiple-tenants
  748. 21:47:41 service-app: vrbc
  749. 21:47:41 service-type: xenon
  750. 21:47:41 build: "1-2-vnegi-test7"
  751. 21:47:41 spec:
  752. 21:47:41 selector:
  753. 21:47:41 app: ccs-command-channel-server
  754. 21:47:41 environment: dev
  755. 21:47:41 tenancy : multiple-tenants
  756. 21:47:41 service-app: vrbc
  757. 21:47:41 build: "1-2-vnegi-test7"
  758. 21:47:41 ports:
  759. 21:47:41 - name: ccs-command-channel-server-http
  760. 21:47:41 protocol: TCP
  761. 21:47:41 port: 8000
  762. 21:47:41 targetPort: 8000
  763. 21:47:41 ---
  764. 21:47:41 kind: Service
  765. 21:47:41 apiVersion: v1
  766. 21:47:41 metadata:
  767. 21:47:41 name: ccs-command-channel-server-svc-1-2-vnegi-test7
  768. 21:47:41 namespace: vnegi-test6
  769. 21:47:41 labels:
  770. 21:47:41 environment: dev
  771. 21:47:41 app: ccs-command-channel-server
  772. 21:47:41 tenancy : multiple-tenants
  773. 21:47:41 service-app: vrbc
  774. 21:47:41 service-type: xenon
  775. 21:47:41 build: "1-2-vnegi-test7"
  776. 21:47:41 spec:
  777. 21:47:41 clusterIP: None
  778. 21:47:41 selector:
  779. 21:47:41 app: ccs-command-channel-server
  780. 21:47:41 environment: dev
  781. 21:47:41 tenancy : multiple-tenants
  782. 21:47:41 service-app: vrbc
  783. 21:47:41 build: "1-2-vnegi-test7"
  784. 21:47:41 ports:
  785. 21:47:41 - name: ccs-command-channel-server-http
  786. 21:47:41 protocol: TCP
  787. 21:47:41 port: 8000
  788. 21:47:41 targetPort: 8000
  789. 21:47:41 ---
  790. 21:47:41 apiVersion: extensions/v1beta1
  791. 21:47:41 kind: Deployment
  792. 21:47:41 metadata:
  793. 21:47:41 name: ccs-command-channel-server-deployment-1-2-vnegi-test7
  794. 21:47:41 namespace: vnegi-test6
  795. 21:47:41 spec:
  796. 21:47:41 replicas: 1
  797. 21:47:41 template:
  798. 21:47:41 metadata:
  799. 21:47:41 annotations:
  800. 21:47:41 scheduler.alpha.kubernetes.io/affinity: >
  801. 21:47:41 {
  802. 21:47:41 "podAntiAffinity": {
  803. 21:47:41 "requiredDuringSchedulingIgnoredDuringExecution": [
  804. 21:47:41 {
  805. 21:47:41 "labelSelector": {
  806. 21:47:41 "matchExpressions": [
  807. 21:47:41 {
  808. 21:47:41 "key": "app-build",
  809. 21:47:41 "operator": "In",
  810. 21:47:41 "values": ["ccs-command-channel-server-1-2-vnegi-test7"]
  811. 21:47:41 }
  812. 21:47:41 ]
  813. 21:47:41 },
  814. 21:47:41 "namespaces": ["vnegi-test6"],
  815. 21:47:41 "topologyKey": "kubernetes.io/hostname"
  816. 21:47:41 }
  817. 21:47:41 ]
  818. 21:47:41 }
  819. 21:47:41 }
  820. 21:47:41 labels:
  821. 21:47:41 app: ccs-command-channel-server
  822. 21:47:41 app-build: ccs-command-channel-server-1-2-vnegi-test7
  823. 21:47:41 environment: dev
  824. 21:47:41 tenancy : multiple-tenants
  825. 21:47:41 service-app: vrbc
  826. 21:47:41 service-type: xenon
  827. 21:47:41 build: "1-2-vnegi-test7"
  828. 21:47:41 removekey: f6a76a32d9c0402cb25f23ac8986fb0e
  829. 21:47:41 spec:
  830. 21:47:41 nodeSelector:
  831. 21:47:41 autoscale: "False"
  832. 21:47:41 tolerations:
  833. 21:47:41 - key: "autoscale"
  834. 21:47:41 operator: "Equal"
  835. 21:47:41 value: "False"
  836. 21:47:41 effect: "NoSchedule"
  837. 21:47:41 containers:
  838. 21:47:41 - name: ccs-command-server
  839. 21:47:41 image: symphony-docker-local.jfrog.io/vrbc-services/initial/ccs-command-channel-server:1-2-vnegi-test7
  840. 21:47:41 ports:
  841. 21:47:41 - containerPort: 8000
  842. 21:47:41 name: ccs-cmd-server
  843. 21:47:41 env:
  844. 21:47:41 - name: BINDING_PORT
  845. 21:47:41 value: "8000"
  846. 21:47:41 - name: JAVA_OPTS
  847. 21:47:41 value: "-Dvrbc.adapter.svc=http://vrbc-adapter-svc.vnegi-test6.svc.cluster.local:8000
  848. 21:47:41 -Dsymphony.svc=http://symphony-service.vnegi-test6.svc.cluster.local:8283
  849. 21:47:41 -Dvrbc.peerNodesDNS=ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local
  850. 21:47:41 -Dxenon.NodeState.membershipQuorum=1
  851. 21:47:41 -DSVC_HOST_NAME=ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local
  852. 21:47:41 -Dsymphony.SymphonyGatewayRegistrationTaskService.apiGatewayHost=heimdall-service.vnegi-test6.svc.cluster.local
  853. 21:47:41 -Dlemans.resources.svc=http://lemans-resources-service.vnegi-test6.svc.cluster.local:8000
  854. 21:47:41 -Dlemans-server-url=http://af93bf411142a11e9905212ac25d70fa-404722773.us-east-1.elb.amazonaws.com
  855. 21:47:41 -Dcommand.manager.svc=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000
  856. 21:47:41 -Dlemans_uri=http://lemans-resources-service.vnegi-test6.svc.cluster.local:8000
  857. 21:47:41 -DdcArtifactUrl=https://ci-data-collector-sandbox.s3.amazonaws.com/VMware-Cloud-Services-Data-Collector.ova
  858. 21:47:41 -Dxenon.PostgresServiceHost.enablePostgres=True
  859. 21:47:41 -Dxenon.PostgresServiceDocumentDao.isDetailedLoggingEnabled=false
  860. 21:47:41 -Dxenon.PostgresHostUtils.disableSynchronizeFactories=true
  861. 21:47:41 -Dxenon.PostgresServiceHost.enableClearCacheOnNodeGroupChange=false"
  862. 21:47:41 - name: JVM_HEAP
  863. 21:47:41 value: 4500m
  864. 21:47:41 - name: POSTGRES_QUERY_THREAD_COUNT
  865. 21:47:41 value: "100"
  866. 21:47:41 - name: POSTGRES_UPDATE_THREAD_COUNT
  867. 21:47:41 value: "100"
  868. 21:47:41 - name: POSTGRES_FETCH_SIZE
  869. 21:47:41 value: "1000"
  870. 21:47:41 - name: POSTGRES_POOL_SIZE
  871. 21:47:41 value: "100"
  872. 21:47:41 - name: JVM_METASPACE
  873. 21:47:41 value: 200m
  874. 21:47:41 - name: JMX_PORT
  875. 21:47:41 value: "7199"
  876. 21:47:41 - name: WAVEFRONT_TAGS
  877. 21:47:41 value: product:stargate,app:stargate-command-channel,env:dev,namespace:vnegi-test6
  878. 21:47:41 - name: WAVEFRONT_PROXY
  879. 21:47:41 value: "wavefront-proxy.wf-monitoring.svc.cluster.local:2878"
  880. 21:47:41 - name: SYMPHONY_HOST
  881. 21:47:41 value: "symphony-service:8283"
  882. 21:47:41 - name: CSP_CONFIG_FILE
  883. 21:47:41 value: /run/csp-config/csp.properties
  884. 21:47:41 - name: BACKUP_PARAMS
  885. 21:47:41 value:
  886. 21:47:41 command:
  887. 21:47:41 - /bin/sh
  888. 21:47:41 - -c
  889. 21:47:41 - >
  890. 21:47:41 exec bin/run.sh --dbConfigFile=/run/db-config/db.properties
  891. 21:47:41 volumeMounts:
  892. 21:47:41 - mountPath: /var/log
  893. 21:47:41 name: varlogs
  894. 21:47:41 - mountPath: /run/db-config
  895. 21:47:41 name: db-secret
  896. 21:47:41 - mountPath: /opt/vrbc/sandbox
  897. 21:47:41 name: ccs-command-channel-server-volume
  898. 21:47:41 - mountPath: /run/csp-config
  899. 21:47:41 name: csp-secret
  900. 21:47:41 imagePullPolicy: IfNotPresent
  901. 21:47:41 resources:
  902. 21:47:41 requests:
  903. 21:47:41 cpu: "1200m"
  904. 21:47:41 memory: "7000Mi"
  905. 21:47:41 limits:
  906. 21:47:41 cpu: "1200m"
  907. 21:47:41 memory: "7000Mi"
  908. 21:47:41 livenessProbe:
  909. 21:47:41 httpGet:
  910. 21:47:41 path: "/stargate/api/health"
  911. 21:47:41 port: 8000
  912. 21:47:41 initialDelaySeconds: 300
  913. 21:47:41 periodSeconds: 300
  914. 21:47:41 - name: wavefront-reporter
  915. 21:47:41 image: symphony-docker-local.jfrog.io/symphony/metrics-wavefront-reporter:15
  916. 21:47:41 command:
  917. 21:47:41 - /bin/sh
  918. 21:47:41 - -c
  919. 21:47:41 - >
  920. 21:47:41 JAVA_OPTS=""
  921. 21:47:41 JAVA_OPTS="${JAVA_OPTS:-} -XX:+PrintGCDateStamps -XX:+PrintGCDetails -verbose:gc"
  922. 21:47:41 JAVA_OPTS="${JAVA_OPTS:-} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/"
  923. 21:47:41 exec bin/run.sh
  924. 21:47:41 env:
  925. 21:47:41 - name: AUTH_ENABLED
  926. 21:47:41 value: "false"
  927. 21:47:41 - name: SOURCE_HOST
  928. 21:47:41 value: "AUTO"
  929. 21:47:41 - name: SOURCE_HOST_PORT
  930. 21:47:41 value: "8000"
  931. 21:47:41 - name: UTIL_JVM_HEAP
  932. 21:47:41 value: 96m
  933. 21:47:41 - name: UTIL_JVM_METASPACE
  934. 21:47:41 value: 48m
  935. 21:47:41 - name: WAVEFRONT_TAGS
  936. 21:47:41 value: app:ccs-command-channel-server,environment:dev,namespace:vnegi-test6
  937. 21:47:41 - name: WAVEFRONT_PROXY_HOST
  938. 21:47:41 value: wavefront-proxy.wf-monitoring.svc.cluster.local
  939. 21:47:41 - name: SERVICE_SOURCE
  940. 21:47:41 value: xenon
  941. 21:47:41 imagePullPolicy: IfNotPresent
  942. 21:47:41 resources:
  943. 21:47:41 limits:
  944. 21:47:41 cpu: "50m"
  945. 21:47:41 memory: "512Mi"
  946. 21:47:41 volumeMounts:
  947. 21:47:41 - mountPath: /var/log
  948. 21:47:41 name: varlogs
  949. 21:47:41 volumes:
  950. 21:47:41 - name: ccs-command-channel-server-volume
  951. 21:47:41 emptyDir: {}
  952. 21:47:41 - name: db-secret
  953. 21:47:41 secret:
  954. 21:47:41 secretName: ccs-command-channel-server-dbconfig-1-2-vnegi-test7
  955. 21:47:41 - name: varlogs
  956. 21:47:41 emptyDir: {}
  957. 21:47:41 - name: csp-secret
  958. 21:47:41 secret:
  959. 21:47:41 secretName: ccs-command-channel-server-cspconfig-1-2-vnegi-test7
  960. 21:47:41 restartPolicy: Always
  961. 21:47:41 imagePullSecrets:
  962. 21:47:41 - name: registrysecret
  963. 21:47:41
  964. 21:47:41 2019-01-09 21:47:41,229 INFO [MainThread]: Creating object: type Service name pccs-command-channel-server-svc-1-2-vnegi-test7
  965. 21:47:41 2019-01-09 21:47:41,234 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  966. 21:47:41 2019-01-09 21:47:41,627 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/services HTTP/1.1" 201 869
  967. 21:47:41 2019-01-09 21:47:41,628 INFO [MainThread]: Successfully created Resources on k8s.
  968. 21:47:41 {'kind': 'Service', 'apiVersion': 'v1', 'metadata': {'name': 'pccs-command-channel-server-svc-1-2-vnegi-test7', 'namespace': 'vnegi-test6', 'labels': {'environment': 'dev', 'app': 'ccs-command-channel-server', 'tenancy': 'multiple-tenants', 'service-app': 'vrbc', 'service-type': 'xenon', 'build': '1-2-vnegi-test7'}}, 'spec': {'selector': {'app': 'ccs-command-channel-server', 'environment': 'dev', 'tenancy': 'multiple-tenants', 'service-app': 'vrbc', 'build': '1-2-vnegi-test7'}, 'ports': [{'name': 'ccs-command-channel-server-http', 'protocol': 'TCP', 'port': 8000, 'targetPort': 8000}]}}
  969. 21:47:41 2019-01-09 21:47:41,629 INFO [MainThread]: Creating object: type Service name ccs-command-channel-server-svc-1-2-vnegi-test7
  970. 21:47:41 2019-01-09 21:47:41,731 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/services HTTP/1.1" 201 858
  971. 21:47:41 2019-01-09 21:47:41,732 INFO [MainThread]: Successfully created Resources on k8s.
  972. 21:47:41 {'kind': 'Service', 'apiVersion': 'v1', 'metadata': {'name': 'ccs-command-channel-server-svc-1-2-vnegi-test7', 'namespace': 'vnegi-test6', 'labels': {'environment': 'dev', 'app': 'ccs-command-channel-server', 'tenancy': 'multiple-tenants', 'service-app': 'vrbc', 'service-type': 'xenon', 'build': '1-2-vnegi-test7'}}, 'spec': {'clusterIP': 'None', 'selector': {'app': 'ccs-command-channel-server', 'environment': 'dev', 'tenancy': 'multiple-tenants', 'service-app': 'vrbc', 'build': '1-2-vnegi-test7'}, 'ports': [{'name': 'ccs-command-channel-server-http', 'protocol': 'TCP', 'port': 8000, 'targetPort': 8000}]}}
  973. 21:47:41 2019-01-09 21:47:41,732 INFO [MainThread]: Creating object: type Deployment name ccs-command-channel-server-deployment-1-2-vnegi-test7
  974. 21:47:41 2019-01-09 21:47:41,836 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /apis/extensions/v1beta1/namespaces/vnegi-test6/deployments HTTP/1.1" 201 None
  975. 21:47:41 2019-01-09 21:47:41,839 INFO [MainThread]: Successfully created Resources on k8s.
  976. 21:47:41 {'apiVersion': 'extensions/v1beta1', 'kind': 'Deployment', 'metadata': {'name': 'ccs-command-channel-server-deployment-1-2-vnegi-test7', 'namespace': 'vnegi-test6'}, 'spec': {'replicas': 1, 'template': {'metadata': {'annotations': {'scheduler.alpha.kubernetes.io/affinity': '{\n "podAntiAffinity": {\n "requiredDuringSchedulingIgnoredDuringExecution": [\n {\n "labelSelector": {\n "matchExpressions": [\n {\n "key": "app-build",\n "operator": "In",\n "values": ["ccs-command-channel-server-1-2-vnegi-test7"]\n }\n ]\n },\n "namespaces": ["vnegi-test6"],\n "topologyKey": "kubernetes.io/hostname"\n }\n ]\n }\n}\n'}, 'labels': {'app': 'ccs-command-channel-server', 'app-build': 'ccs-command-channel-server-1-2-vnegi-test7', 'environment': 'dev', 'tenancy': 'multiple-tenants', 'service-app': 'vrbc', 'service-type': 'xenon', 'build': '1-2-vnegi-test7', 'removekey': 'f6a76a32d9c0402cb25f23ac8986fb0e'}}, 'spec': {'nodeSelector': {'autoscale': 'False'}, 'tolerations': [{'key': 'autoscale', 'operator': 'Equal', 'value': 'False', 'effect': 'NoSchedule'}], 'containers': [{'name': 'ccs-command-server', 'image': 'symphony-docker-local.jfrog.io/vrbc-services/initial/ccs-command-channel-server:1-2-vnegi-test7', 'ports': [{'containerPort': 8000, 'name': 'ccs-cmd-server'}], 'env': [{'name': 'BINDING_PORT', 'value': '8000'}, {'name': 'JAVA_OPTS', 'value': '-Dvrbc.adapter.svc=http://vrbc-adapter-svc.vnegi-test6.svc.cluster.local:8000 -Dsymphony.svc=http://symphony-service.vnegi-test6.svc.cluster.local:8283 -Dvrbc.peerNodesDNS=ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local -Dxenon.NodeState.membershipQuorum=1 -DSVC_HOST_NAME=ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local -Dsymphony.SymphonyGatewayRegistrationTaskService.apiGatewayHost=heimdall-service.vnegi-test6.svc.cluster.local -Dlemans.resources.svc=http://lemans-resources-service.vnegi-test6.svc.cluster.local:8000 -Dlemans-server-url=http://af93bf411142a11e9905212ac25d70fa-404722773.us-east-1.elb.amazonaws.com -Dcommand.manager.svc=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000 -Dlemans_uri=http://lemans-resources-service.vnegi-test6.svc.cluster.local:8000 -DdcArtifactUrl=https://ci-data-collector-sandbox.s3.amazonaws.com/VMware-Cloud-Services-Data-Collector.ova -Dxenon.PostgresServiceHost.enablePostgres=True -Dxenon.PostgresServiceDocumentDao.isDetailedLoggingEnabled=false -Dxenon.PostgresHostUtils.disableSynchronizeFactories=true -Dxenon.PostgresServiceHost.enableClearCacheOnNodeGroupChange=false'}, {'name': 'JVM_HEAP', 'value': '4500m'}, {'name': 'POSTGRES_QUERY_THREAD_COUNT', 'value': '100'}, {'name': 'POSTGRES_UPDATE_THREAD_COUNT', 'value': '100'}, {'name': 'POSTGRES_FETCH_SIZE', 'value': '1000'}, {'name': 'POSTGRES_POOL_SIZE', 'value': '100'}, {'name': 'JVM_METASPACE', 'value': '200m'}, {'name': 'JMX_PORT', 'value': '7199'}, {'name': 'WAVEFRONT_TAGS', 'value': 'product:stargate,app:stargate-command-channel,env:dev,namespace:vnegi-test6'}, {'name': 'WAVEFRONT_PROXY', 'value': 'wavefront-proxy.wf-monitoring.svc.cluster.local:2878'}, {'name': 'SYMPHONY_HOST', 'value': 'symphony-service:8283'}, {'name': 'CSP_CONFIG_FILE', 'value': '/run/csp-config/csp.properties'}, {'name': 'BACKUP_PARAMS', 'value': None}], 'command': ['/bin/sh', '-c', 'exec bin/run.sh --dbConfigFile=/run/db-config/db.properties\n'], 'volumeMounts': [{'mountPath': '/var/log', 'name': 'varlogs'}, {'mountPath': '/run/db-config', 'name': 'db-secret'}, {'mountPath': '/opt/vrbc/sandbox', 'name': 'ccs-command-channel-server-volume'}, {'mountPath': '/run/csp-config', 'name': 'csp-secret'}], 'imagePullPolicy': 'IfNotPresent', 'resources': {'requests': {'cpu': '1200m', 'memory': '7000Mi'}, 'limits': {'cpu': '1200m', 'memory': '7000Mi'}}, 'livenessProbe': {'httpGet': {'path': '/stargate/api/health', 'port': 8000}, 'initialDelaySeconds': 300, 'periodSeconds': 300}}, {'name': 'wavefront-reporter', 'image': 'symphony-docker-local.jfrog.io/symphony/metrics-wavefront-reporter:15', 'command': ['/bin/sh', '-c', 'JAVA_OPTS="" JAVA_OPTS="${JAVA_OPTS:-} -XX:+PrintGCDateStamps -XX:+PrintGCDetails -verbose:gc" JAVA_OPTS="${JAVA_OPTS:-} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/" exec bin/run.sh\n'], 'env': [{'name': 'AUTH_ENABLED', 'value': 'false'}, {'name': 'SOURCE_HOST', 'value': 'AUTO'}, {'name': 'SOURCE_HOST_PORT', 'value': '8000'}, {'name': 'UTIL_JVM_HEAP', 'value': '96m'}, {'name': 'UTIL_JVM_METASPACE', 'value': '48m'}, {'name': 'WAVEFRONT_TAGS', 'value': 'app:ccs-command-channel-server,environment:dev,namespace:vnegi-test6'}, {'name': 'WAVEFRONT_PROXY_HOST', 'value': 'wavefront-proxy.wf-monitoring.svc.cluster.local'}, {'name': 'SERVICE_SOURCE', 'value': 'xenon'}], 'imagePullPolicy': 'IfNotPresent', 'resources': {'limits': {'cpu': '50m', 'memory': '512Mi'}}, 'volumeMounts': [{'mountPath': '/var/log', 'name': 'varlogs'}]}], 'volumes': [{'name': 'ccs-command-channel-server-volume', 'emptyDir': {}}, {'name': 'db-secret', 'secret': {'secretName': 'ccs-command-channel-server-dbconfig-1-2-vnegi-test7'}}, {'name': 'varlogs', 'emptyDir': {}}, {'name': 'csp-secret', 'secret': {'secretName': 'ccs-command-channel-server-cspconfig-1-2-vnegi-test7'}}], 'restartPolicy': 'Always', 'imagePullSecrets': [{'name': 'registrysecret'}]}}}}
  977. 21:47:41 2019-01-09 21:47:41,840 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  978. 21:47:41 2019-01-09 21:47:41,840 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5bf974588>}: attempt [1]
  979. 21:47:41 2019-01-09 21:47:41,844 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  980. 21:47:42 2019-01-09 21:47:42,056 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  981. 21:47:42 2019-01-09 21:47:42,057 INFO [MainThread]: app_labels : {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test7'}
  982. 21:47:42 2019-01-09 21:47:42,057 INFO [MainThread]: Timing out at 2019-01-09 21:57:42.057951
  983. 21:47:42 2019-01-09 21:47:42,058 INFO [MainThread]: Starting [app=ccs-command-channel-server] Healthcheck [build=1-2-vnegi-test7]
  984. 21:47:42 2019-01-09 21:47:42,159 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  985. 21:47:42 2019-01-09 21:47:42,263 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  986. 21:47:42 2019-01-09 21:47:42,368 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 138
  987. 21:47:42 2019-01-09 21:47:42,369 INFO [MainThread]: [app=ccs-command-channel-server] pods. [expected=1] [actual=0]
  988. 21:47:42 2019-01-09 21:47:42,369 INFO [MainThread]: [app=ccs-command-channel-server] not healthy right now...
  989. 21:47:42 Traceback (most recent call last):
  990. 21:47:42 File "/var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/sym_common_lib.py", line 286, in healthcheck
  991. 21:47:42 check_pod_count(app_name, replicas, pod_ips)
  992. 21:47:42 File "/var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/sym_common_lib.py", line 120, in check_pod_count
  993. 21:47:42 app_name, str(expected_pod_count), str(len(pod_ips))
  994. 21:47:42 Exception: Incorrect number of [app=ccs-command-channel-server] pods running. [expected=1] [actual=0]
  995. 21:47:42 2019-01-09 21:47:42,370 DEBUG [MainThread]: [func=<lambda>]: [attempt=1] returned False. Retrying in 30 seconds [timeout_at=2019-01-09 21:57:42.057951].
  996. 21:48:12 2019-01-09 21:48:12,400 INFO [MainThread]: Starting [app=ccs-command-channel-server] Healthcheck [build=1-2-vnegi-test7]
  997. 21:48:12 2019-01-09 21:48:12,503 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  998. 21:48:12 2019-01-09 21:48:12,607 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  999. 21:48:12 2019-01-09 21:48:12,722 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1000. 21:48:12 2019-01-09 21:48:12,726 INFO [MainThread]: [app=ccs-command-channel-server] pods. [expected=1] [actual=1]
  1001. 21:48:12 2019-01-09 21:48:12,726 DEBUG [MainThread]: Default nodegroup curl = ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEwNjIsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkyNjIsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.iIsKUUNonqoZjkwd8RsSyy-9hd87466enESHoNseKP1p1WLPcLK2Z1aFz42TGFpySoXjwOLz3NessDhLOwOT93JdpRuxkK3cud2BAXNhtaKzwp1Dh3TCiktwkGkQiWFQHaDC8vvkAp1bxxSx7EJJv9IXKfXfVK776bLKj-BgosUmjVJf7xSkC4t9ay3kj05nlabpGr968GaT6mkIMsEmF4kdm-7oM11ob6XxC-dyPTkL-B4RGnGe1K6edG_tsl_VSiXhL_o832ZpWoRzyPTvHN2R_UZXL-ss0-Y6rdWQkN3vjzuFoBMWbeW-aMAgXRMYFMtS2Dfs-78GHvoBABDk_w', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1002. 21:48:12 2019-01-09 21:48:12,727 INFO [MainThread]: Running in cluster: curlpod-e5w27q: ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEwNjIsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkyNjIsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.iIsKUUNonqoZjkwd8RsSyy-9hd87466enESHoNseKP1p1WLPcLK2Z1aFz42TGFpySoXjwOLz3NessDhLOwOT93JdpRuxkK3cud2BAXNhtaKzwp1Dh3TCiktwkGkQiWFQHaDC8vvkAp1bxxSx7EJJv9IXKfXfVK776bLKj-BgosUmjVJf7xSkC4t9ay3kj05nlabpGr968GaT6mkIMsEmF4kdm-7oM11ob6XxC-dyPTkL-B4RGnGe1K6edG_tsl_VSiXhL_o832ZpWoRzyPTvHN2R_UZXL-ss0-Y6rdWQkN3vjzuFoBMWbeW-aMAgXRMYFMtS2Dfs-78GHvoBABDk_w', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1003. 21:48:12 2019-01-09 21:48:12,834 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1004. 21:48:12 2019-01-09 21:48:12,835 INFO [MainThread]: Timing out at 2019-01-09 21:50:12.835782
  1005. 21:48:12 2019-01-09 21:48:12,936 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q HTTP/1.1" 200 None
  1006. 21:48:12 2019-01-09 21:48:12,937 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:12.835782].
  1007. 21:48:14 2019-01-09 21:48:14,040 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q HTTP/1.1" 200 None
  1008. 21:48:14 2019-01-09 21:48:14,042 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:12.835782].
  1009. 21:48:15 2019-01-09 21:48:15,145 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q HTTP/1.1" 200 None
  1010. 21:48:15 2019-01-09 21:48:15,146 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:12.835782].
  1011. 21:48:16 2019-01-09 21:48:16,253 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q HTTP/1.1" 200 None
  1012. 21:48:16 2019-01-09 21:48:16,373 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q/log HTTP/1.1" 200 1109
  1013. 21:48:16 2019-01-09 21:48:16,374 DEBUG [MainThread]: Command output: curlpod-e5w27q(0) {"config":{"nodeRemovalDelayMicros":300000000,"stableGroupMaintenanceIntervalCount":5,"peerRequestTimeoutMicros":20000000},"nodes":{"6d6c86f5-bf21-4c53-87f9-43793697ab0b":{"groupReference":"http://172.20.42.147:8000/core/node-groups/default","status":"AVAILABLE","options":["PEER"],"id":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","membershipQuorum":1,"locationQuorum":1,"documentVersion":1,"documentKind":"com:vmware:xenon:services:common:NodeState","documentSelfLink":"/core/node-groups/default/6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentUpdateTimeMicros":1547099292351001,"documentExpirationTimeMicros":0}},"lastChanges":["PEER_STATUS_CHANGE"],"membershipUpdateTimeMicros":1547099292351001,"localMembershipUpdateTimeMicros":1547099292351001,"documentVersion":2,"documentKind":"com:vmware:xenon:services:common:NodeGroupService:NodeGroupState","documentSelfLink":"/core/node-groups/default","documentUpdateTimeMicros":1547099292355000,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentAuthPrincipalLink":"/core/authz/system-user"}
  1014. 21:48:16 2019-01-09 21:48:16,481 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-e5w27q HTTP/1.1" 200 None
  1015. 21:48:16 2019-01-09 21:48:16,482 INFO [MainThread]: [app=ccs-command-channel-server] node-group is healthy
  1016. 21:48:16 2019-01-09 21:48:16,482 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1017. 21:48:16 2019-01-09 21:48:16,482 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5c0211fd0>}: attempt [1]
  1018. 21:48:16 2019-01-09 21:48:16,486 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1019. 21:48:16 2019-01-09 21:48:16,697 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1020. 21:48:16 2019-01-09 21:48:16,698 INFO [MainThread]: ccs-command-channel-server pausing Nodes of build 1-2-vnegi-test7 with Heimdall
  1021. 21:48:16 2019-01-09 21:48:16,698 INFO [MainThread]: Running in cluster: curlpod-shq0cq: ['curl', '--max-time', '120', '--silent', '-X', 'POST', '-H', 'content-type:application/json', '-d', '{}', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local:8000/upgrade/notify/maintenance', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEwOTYsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkyOTYsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.PaG_Blwno7--0_p039GD_RBYGZja4TJjFLS9NVjMW84mOh3t0Er3PVgZG0NCmsviJaYL7jRzExW7z6rL7OIVbinP3FU3QpUJwcgqi69Duz9id48hZ9wgC91a5OQpYUudRaySSfXud0gh6uXWtZJK2LEqcVzJdjVrxHSXmxWxr8t28VdVL6tNkqdk6C1RdanqntOvVR9fkaxh0iQzLU-7ziou2sE5ChD6zhzi0raaZKDokNpnlWbzZC-_wRStpHqMLg3Tr7pO1fu2HzhI8M8FhPsXeoOUH0qKPw2r7-9D8iHMOv0hQJtvyuPG05fxyKysBvtFP0nuI3RTLnWgkxGGkQ']
  1022. 21:48:16 2019-01-09 21:48:16,800 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1023. 21:48:16 2019-01-09 21:48:16,802 INFO [MainThread]: Timing out at 2019-01-09 21:58:16.802021
  1024. 21:48:16 2019-01-09 21:48:16,902 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq HTTP/1.1" 200 None
  1025. 21:48:16 2019-01-09 21:48:16,904 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:58:16.802021].
  1026. 21:48:18 2019-01-09 21:48:18,009 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq HTTP/1.1" 200 None
  1027. 21:48:18 2019-01-09 21:48:18,010 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:58:16.802021].
  1028. 21:48:19 2019-01-09 21:48:19,113 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq HTTP/1.1" 200 None
  1029. 21:48:19 2019-01-09 21:48:19,115 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:58:16.802021].
  1030. 21:48:20 2019-01-09 21:48:20,221 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq HTTP/1.1" 200 None
  1031. 21:48:20 2019-01-09 21:48:20,330 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq/log HTTP/1.1" 200 143
  1032. 21:48:20 2019-01-09 21:48:20,331 DEBUG [MainThread]: Command output: curlpod-shq0cq(0) {"success":true,"delay":0,"message":"Disabled all features","context":{"/common/persistence/feature/SystemFeatures::dropwizardMetrics":"true"}}
  1033. 21:48:20 2019-01-09 21:48:20,439 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-shq0cq HTTP/1.1" 200 None
  1034. 21:48:20 2019-01-09 21:48:20,440 INFO [MainThread]: Got response during xenon pause of service of build 1-2-vnegi-test7 : {'success': True, 'delay': 0, 'message': 'Disabled all features', 'context': {'/common/persistence/feature/SystemFeatures::dropwizardMetrics': 'true'}}
  1035. 21:48:20 2019-01-09 21:48:20,441 DEBUG [MainThread]: Registering Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000] with Heimdall
  1036. 21:48:20 2019-01-09 21:48:20,441 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1037. 21:48:20 2019-01-09 21:48:20,442 INFO [MainThread]: Timing out at 2019-01-09 21:49:20.442540
  1038. 21:48:20 2019-01-09 21:48:20,442 INFO [MainThread]: Running in cluster: curlpod-90gio1: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/nodes']
  1039. 21:48:20 2019-01-09 21:48:20,544 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1917
  1040. 21:48:20 2019-01-09 21:48:20,545 INFO [MainThread]: Timing out at 2019-01-09 21:50:20.545678
  1041. 21:48:20 2019-01-09 21:48:20,646 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1 HTTP/1.1" 200 None
  1042. 21:48:20 2019-01-09 21:48:20,648 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:20.545678].
  1043. 21:48:21 2019-01-09 21:48:21,755 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1 HTTP/1.1" 200 None
  1044. 21:48:21 2019-01-09 21:48:21,757 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:20.545678].
  1045. 21:48:22 2019-01-09 21:48:22,862 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1 HTTP/1.1" 200 None
  1046. 21:48:22 2019-01-09 21:48:22,863 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:20.545678].
  1047. 21:48:23 2019-01-09 21:48:23,966 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1 HTTP/1.1" 200 None
  1048. 21:48:24 2019-01-09 21:48:24,075 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1/log HTTP/1.1" 200 154
  1049. 21:48:24 2019-01-09 21:48:24,076 DEBUG [MainThread]: Command output: curlpod-90gio1(0) {"cluster":"default","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1050. 21:48:24 2019-01-09 21:48:24,185 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-90gio1 HTTP/1.1" 200 None
  1051. 21:48:24 2019-01-09 21:48:24,186 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/nodes response {
  1052. 21:48:24 "cluster": "default",
  1053. 21:48:24 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1054. 21:48:24 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1055. 21:48:24 }
  1056. 21:48:24 2019-01-09 21:48:24,186 INFO [MainThread]: find_and_parse_json: input = [{
  1057. 21:48:24 "cluster": "default",
  1058. 21:48:24 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1059. 21:48:24 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1060. 21:48:24 }]
  1061. 21:48:24 2019-01-09 21:48:24,186 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000] registered with Heimdall
  1062. 21:48:24 2019-01-09 21:48:24,186 DEBUG [MainThread]: Marking Node [id=ccs-command-channel-server-1-2-vnegi-test7] inactive with Heimdall with inactive plugin
  1063. 21:48:24 2019-01-09 21:48:24,186 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1064. 21:48:24 2019-01-09 21:48:24,186 INFO [MainThread]: Timing out at 2019-01-09 21:49:24.186966
  1065. 21:48:24 2019-01-09 21:48:24,187 INFO [MainThread]: Running in cluster: curlpod-v4rbsn: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"config":[{"name":"node_id","value":"ccs-command-channel-server-1-2-vnegi-test7"}]}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/plugins/inactive/plugin-config']
  1066. 21:48:24 2019-01-09 21:48:24,290 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1896
  1067. 21:48:24 2019-01-09 21:48:24,292 INFO [MainThread]: Timing out at 2019-01-09 21:50:24.292210
  1068. 21:48:24 2019-01-09 21:48:24,393 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn HTTP/1.1" 200 None
  1069. 21:48:24 2019-01-09 21:48:24,395 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:24.292210].
  1070. 21:48:25 2019-01-09 21:48:25,497 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn HTTP/1.1" 200 None
  1071. 21:48:25 2019-01-09 21:48:25,499 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:24.292210].
  1072. 21:48:26 2019-01-09 21:48:26,602 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn HTTP/1.1" 200 None
  1073. 21:48:26 2019-01-09 21:48:26,604 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:24.292210].
  1074. 21:48:27 2019-01-09 21:48:27,711 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn HTTP/1.1" 200 None
  1075. 21:48:27 2019-01-09 21:48:27,821 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn/log HTTP/1.1" 200 161
  1076. 21:48:27 2019-01-09 21:48:27,822 DEBUG [MainThread]: Command output: curlpod-v4rbsn(0) {"config":[{"name":"node_id","value":"ccs-command-channel-server-1-2-vnegi-test7"}],"name":"inactive","id":"inactive-ccs-command-channel-server-1-2-vnegi-test7"}
  1077. 21:48:27 2019-01-09 21:48:27,929 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-v4rbsn HTTP/1.1" 200 None
  1078. 21:48:27 2019-01-09 21:48:27,930 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/plugins/inactive/plugin-config response {
  1079. 21:48:27 "config": [
  1080. 21:48:27 {
  1081. 21:48:27 "name": "node_id",
  1082. 21:48:27 "value": "ccs-command-channel-server-1-2-vnegi-test7"
  1083. 21:48:27 }
  1084. 21:48:27 ],
  1085. 21:48:27 "id": "inactive-ccs-command-channel-server-1-2-vnegi-test7",
  1086. 21:48:27 "name": "inactive"
  1087. 21:48:27 }
  1088. 21:48:27 2019-01-09 21:48:27,931 INFO [MainThread]: find_and_parse_json: input = [{
  1089. 21:48:27 "config": [
  1090. 21:48:27 {
  1091. 21:48:27 "name": "node_id",
  1092. 21:48:27 "value": "ccs-command-channel-server-1-2-vnegi-test7"
  1093. 21:48:27 }
  1094. 21:48:27 ],
  1095. 21:48:27 "id": "inactive-ccs-command-channel-server-1-2-vnegi-test7",
  1096. 21:48:27 "name": "inactive"
  1097. 21:48:27 }]
  1098. 21:48:27 2019-01-09 21:48:27,931 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7] is marked inactive with Heimdall with inactive plugin config [id=inactive-ccs-command-channel-server-1-2-vnegi-test7]
  1099. 21:48:27 2019-01-09 21:48:27,931 INFO [MainThread]: Registering Service [id=cmd-instance-service, path=/vrbc/cmd/instance] with Heimdall
  1100. 21:48:27 2019-01-09 21:48:27,931 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1101. 21:48:27 2019-01-09 21:48:27,931 INFO [MainThread]: Timing out at 2019-01-09 21:49:27.931623
  1102. 21:48:27 2019-01-09 21:48:27,931 INFO [MainThread]: Running in cluster: curlpod-c7qt01: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"cmd-instance-service","path":"/vrbc/cmd/instance"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1103. 21:48:28 2019-01-09 21:48:28,033 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1845
  1104. 21:48:28 2019-01-09 21:48:28,035 INFO [MainThread]: Timing out at 2019-01-09 21:50:28.035016
  1105. 21:48:28 2019-01-09 21:48:28,147 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-c7qt01 HTTP/1.1" 200 None
  1106. 21:48:28 2019-01-09 21:48:28,149 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:28.035016].
  1107. 21:48:29 2019-01-09 21:48:29,251 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-c7qt01 HTTP/1.1" 200 None
  1108. 21:48:29 2019-01-09 21:48:29,253 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:28.035016].
  1109. 21:48:30 2019-01-09 21:48:30,358 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-c7qt01 HTTP/1.1" 200 None
  1110. 21:48:30 2019-01-09 21:48:30,467 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-c7qt01/log HTTP/1.1" 200 60
  1111. 21:48:30 2019-01-09 21:48:30,468 DEBUG [MainThread]: Command output: curlpod-c7qt01(0) {"path":"\/vrbc\/cmd\/instance","id":"cmd-instance-service"}
  1112. 21:48:30 2019-01-09 21:48:30,576 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-c7qt01 HTTP/1.1" 200 None
  1113. 21:48:30 2019-01-09 21:48:30,577 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1114. 21:48:30 "id": "cmd-instance-service",
  1115. 21:48:30 "path": "/vrbc/cmd/instance"
  1116. 21:48:30 }
  1117. 21:48:30 2019-01-09 21:48:30,577 INFO [MainThread]: find_and_parse_json: input = [{
  1118. 21:48:30 "id": "cmd-instance-service",
  1119. 21:48:30 "path": "/vrbc/cmd/instance"
  1120. 21:48:30 }]
  1121. 21:48:30 2019-01-09 21:48:30,577 INFO [MainThread]: Service [id=cmd-instance-service, path=/vrbc/cmd/instance] is registered with Heimdall
  1122. 21:48:30 2019-01-09 21:48:30,577 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1123. 21:48:30 2019-01-09 21:48:30,578 INFO [MainThread]: Timing out at 2019-01-09 21:49:30.578064
  1124. 21:48:30 2019-01-09 21:48:30,578 INFO [MainThread]: Running in cluster: curlpod-gz6qxa: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/cmd-instance-service/nodes']
  1125. 21:48:30 2019-01-09 21:48:30,681 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1947
  1126. 21:48:30 2019-01-09 21:48:30,683 INFO [MainThread]: Timing out at 2019-01-09 21:50:30.683097
  1127. 21:48:30 2019-01-09 21:48:30,784 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa HTTP/1.1" 200 None
  1128. 21:48:30 2019-01-09 21:48:30,786 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:30.683097].
  1129. 21:48:31 2019-01-09 21:48:31,890 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa HTTP/1.1" 200 None
  1130. 21:48:31 2019-01-09 21:48:31,891 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:30.683097].
  1131. 21:48:32 2019-01-09 21:48:32,994 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa HTTP/1.1" 200 None
  1132. 21:48:32 2019-01-09 21:48:32,995 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:30.683097].
  1133. 21:48:34 2019-01-09 21:48:34,098 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa HTTP/1.1" 200 None
  1134. 21:48:34 2019-01-09 21:48:34,207 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa/log HTTP/1.1" 200 185
  1135. 21:48:34 2019-01-09 21:48:34,208 DEBUG [MainThread]: Command output: curlpod-gz6qxa(0) {"cluster":"default","path":"\/vrbc\/cmd\/instance","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1136. 21:48:34 2019-01-09 21:48:34,317 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-gz6qxa HTTP/1.1" 200 None
  1137. 21:48:34 2019-01-09 21:48:34,318 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/cmd-instance-service/nodes response {
  1138. 21:48:34 "cluster": "default",
  1139. 21:48:34 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1140. 21:48:34 "path": "/vrbc/cmd/instance",
  1141. 21:48:34 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1142. 21:48:34 }
  1143. 21:48:34 2019-01-09 21:48:34,318 INFO [MainThread]: find_and_parse_json: input = [{
  1144. 21:48:34 "cluster": "default",
  1145. 21:48:34 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1146. 21:48:34 "path": "/vrbc/cmd/instance",
  1147. 21:48:34 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1148. 21:48:34 }]
  1149. 21:48:34 2019-01-09 21:48:34,318 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=None] is registered for service [id=cmd-instance-service]
  1150. 21:48:34 2019-01-09 21:48:34,318 INFO [MainThread]: Registering Service [id=event-service, path=/vrbc/cmd/event] with Heimdall
  1151. 21:48:34 2019-01-09 21:48:34,318 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1152. 21:48:34 2019-01-09 21:48:34,319 INFO [MainThread]: Timing out at 2019-01-09 21:49:34.319032
  1153. 21:48:34 2019-01-09 21:48:34,319 INFO [MainThread]: Running in cluster: curlpod-vz6qmv: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"event-service","path":"/vrbc/cmd/event"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1154. 21:48:34 2019-01-09 21:48:34,420 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1835
  1155. 21:48:34 2019-01-09 21:48:34,422 INFO [MainThread]: Timing out at 2019-01-09 21:50:34.422238
  1156. 21:48:34 2019-01-09 21:48:34,525 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv HTTP/1.1" 200 None
  1157. 21:48:34 2019-01-09 21:48:34,526 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:34.422238].
  1158. 21:48:35 2019-01-09 21:48:35,631 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv HTTP/1.1" 200 None
  1159. 21:48:35 2019-01-09 21:48:35,633 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:34.422238].
  1160. 21:48:36 2019-01-09 21:48:36,735 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv HTTP/1.1" 200 None
  1161. 21:48:36 2019-01-09 21:48:36,737 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:34.422238].
  1162. 21:48:37 2019-01-09 21:48:37,841 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv HTTP/1.1" 200 None
  1163. 21:48:37 2019-01-09 21:48:37,956 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv/log HTTP/1.1" 200 50
  1164. 21:48:37 2019-01-09 21:48:37,957 DEBUG [MainThread]: Command output: curlpod-vz6qmv(0) {"path":"\/vrbc\/cmd\/event","id":"event-service"}
  1165. 21:48:38 2019-01-09 21:48:38,065 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-vz6qmv HTTP/1.1" 200 None
  1166. 21:48:38 2019-01-09 21:48:38,066 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1167. 21:48:38 "id": "event-service",
  1168. 21:48:38 "path": "/vrbc/cmd/event"
  1169. 21:48:38 }
  1170. 21:48:38 2019-01-09 21:48:38,067 INFO [MainThread]: find_and_parse_json: input = [{
  1171. 21:48:38 "id": "event-service",
  1172. 21:48:38 "path": "/vrbc/cmd/event"
  1173. 21:48:38 }]
  1174. 21:48:38 2019-01-09 21:48:38,067 INFO [MainThread]: Service [id=event-service, path=/vrbc/cmd/event] is registered with Heimdall
  1175. 21:48:38 2019-01-09 21:48:38,067 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1176. 21:48:38 2019-01-09 21:48:38,068 INFO [MainThread]: Timing out at 2019-01-09 21:49:38.068230
  1177. 21:48:38 2019-01-09 21:48:38,068 INFO [MainThread]: Running in cluster: curlpod-er7u5e: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/event-service/nodes']
  1178. 21:48:38 2019-01-09 21:48:38,177 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1940
  1179. 21:48:38 2019-01-09 21:48:38,178 INFO [MainThread]: Timing out at 2019-01-09 21:50:38.178568
  1180. 21:48:38 2019-01-09 21:48:38,280 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e HTTP/1.1" 200 None
  1181. 21:48:38 2019-01-09 21:48:38,281 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:38.178568].
  1182. 21:48:39 2019-01-09 21:48:39,388 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e HTTP/1.1" 200 None
  1183. 21:48:39 2019-01-09 21:48:39,391 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:38.178568].
  1184. 21:48:40 2019-01-09 21:48:40,496 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e HTTP/1.1" 200 None
  1185. 21:48:40 2019-01-09 21:48:40,499 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:38.178568].
  1186. 21:48:41 2019-01-09 21:48:41,606 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e HTTP/1.1" 200 None
  1187. 21:48:41 2019-01-09 21:48:41,718 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e/log HTTP/1.1" 200 182
  1188. 21:48:41 2019-01-09 21:48:41,719 DEBUG [MainThread]: Command output: curlpod-er7u5e(0) {"cluster":"default","path":"\/vrbc\/cmd\/event","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1189. 21:48:41 2019-01-09 21:48:41,831 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-er7u5e HTTP/1.1" 200 None
  1190. 21:48:41 2019-01-09 21:48:41,832 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/event-service/nodes response {
  1191. 21:48:41 "cluster": "default",
  1192. 21:48:41 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1193. 21:48:41 "path": "/vrbc/cmd/event",
  1194. 21:48:41 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1195. 21:48:41 }
  1196. 21:48:41 2019-01-09 21:48:41,832 INFO [MainThread]: find_and_parse_json: input = [{
  1197. 21:48:41 "cluster": "default",
  1198. 21:48:41 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1199. 21:48:41 "path": "/vrbc/cmd/event",
  1200. 21:48:41 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1201. 21:48:41 }]
  1202. 21:48:41 2019-01-09 21:48:41,832 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=None] is registered for service [id=event-service]
  1203. 21:48:41 2019-01-09 21:48:41,833 INFO [MainThread]: Registering Service [id=cmd-server-health, path=/vrbc/cmd/external/system-status] with Heimdall
  1204. 21:48:41 2019-01-09 21:48:41,833 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1205. 21:48:41 2019-01-09 21:48:41,833 INFO [MainThread]: Timing out at 2019-01-09 21:49:41.833546
  1206. 21:48:41 2019-01-09 21:48:41,834 INFO [MainThread]: Running in cluster: curlpod-6cg471: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"cmd-server-health","path":"/vrbc/cmd/external/system-status"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1207. 21:48:41 2019-01-09 21:48:41,936 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1856
  1208. 21:48:41 2019-01-09 21:48:41,938 INFO [MainThread]: Timing out at 2019-01-09 21:50:41.938640
  1209. 21:48:42 2019-01-09 21:48:42,041 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471 HTTP/1.1" 200 None
  1210. 21:48:42 2019-01-09 21:48:42,043 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:41.938640].
  1211. 21:48:43 2019-01-09 21:48:43,145 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471 HTTP/1.1" 200 None
  1212. 21:48:43 2019-01-09 21:48:43,147 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:41.938640].
  1213. 21:48:44 2019-01-09 21:48:44,249 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471 HTTP/1.1" 200 None
  1214. 21:48:44 2019-01-09 21:48:44,251 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:41.938640].
  1215. 21:48:45 2019-01-09 21:48:45,358 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471 HTTP/1.1" 200 None
  1216. 21:48:45 2019-01-09 21:48:45,468 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471/log HTTP/1.1" 200 72
  1217. 21:48:45 2019-01-09 21:48:45,468 DEBUG [MainThread]: Command output: curlpod-6cg471(0) {"path":"\/vrbc\/cmd\/external\/system-status","id":"cmd-server-health"}
  1218. 21:48:45 2019-01-09 21:48:45,576 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-6cg471 HTTP/1.1" 200 None
  1219. 21:48:45 2019-01-09 21:48:45,577 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1220. 21:48:45 "id": "cmd-server-health",
  1221. 21:48:45 "path": "/vrbc/cmd/external/system-status"
  1222. 21:48:45 }
  1223. 21:48:45 2019-01-09 21:48:45,577 INFO [MainThread]: find_and_parse_json: input = [{
  1224. 21:48:45 "id": "cmd-server-health",
  1225. 21:48:45 "path": "/vrbc/cmd/external/system-status"
  1226. 21:48:45 }]
  1227. 21:48:45 2019-01-09 21:48:45,578 INFO [MainThread]: Service [id=cmd-server-health, path=/vrbc/cmd/external/system-status] is registered with Heimdall
  1228. 21:48:45 2019-01-09 21:48:45,578 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1229. 21:48:45 2019-01-09 21:48:45,578 INFO [MainThread]: Timing out at 2019-01-09 21:49:45.578689
  1230. 21:48:45 2019-01-09 21:48:45,579 INFO [MainThread]: Running in cluster: curlpod-6bd25a: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/cmd-server-health/nodes']
  1231. 21:48:45 2019-01-09 21:48:45,690 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1944
  1232. 21:48:45 2019-01-09 21:48:45,692 INFO [MainThread]: Timing out at 2019-01-09 21:50:45.692915
  1233. 21:48:45 2019-01-09 21:48:45,797 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6bd25a HTTP/1.1" 200 None
  1234. 21:48:45 2019-01-09 21:48:45,799 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:45.692915].
  1235. 21:48:46 2019-01-09 21:48:46,902 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6bd25a HTTP/1.1" 200 None
  1236. 21:48:46 2019-01-09 21:48:46,905 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:45.692915].
  1237. 21:48:48 2019-01-09 21:48:48,008 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6bd25a HTTP/1.1" 200 None
  1238. 21:48:48 2019-01-09 21:48:48,118 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-6bd25a/log HTTP/1.1" 200 200
  1239. 21:48:48 2019-01-09 21:48:48,119 DEBUG [MainThread]: Command output: curlpod-6bd25a(0) {"cluster":"default","path":"\/vrbc\/cmd\/external\/system-status","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1240. 21:48:48 2019-01-09 21:48:48,227 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-6bd25a HTTP/1.1" 200 None
  1241. 21:48:48 2019-01-09 21:48:48,227 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/cmd-server-health/nodes response {
  1242. 21:48:48 "cluster": "default",
  1243. 21:48:48 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1244. 21:48:48 "path": "/vrbc/cmd/external/system-status",
  1245. 21:48:48 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1246. 21:48:48 }
  1247. 21:48:48 2019-01-09 21:48:48,228 INFO [MainThread]: find_and_parse_json: input = [{
  1248. 21:48:48 "cluster": "default",
  1249. 21:48:48 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1250. 21:48:48 "path": "/vrbc/cmd/external/system-status",
  1251. 21:48:48 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1252. 21:48:48 }]
  1253. 21:48:48 2019-01-09 21:48:48,228 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=None] is registered for service [id=cmd-server-health]
  1254. 21:48:48 2019-01-09 21:48:48,228 INFO [MainThread]: Registering Service [id=stargate-service, path=/stargate/api] with Heimdall
  1255. 21:48:48 2019-01-09 21:48:48,228 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1256. 21:48:48 2019-01-09 21:48:48,229 INFO [MainThread]: Timing out at 2019-01-09 21:49:48.228980
  1257. 21:48:48 2019-01-09 21:48:48,229 INFO [MainThread]: Running in cluster: curlpod-qcaqan: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"stargate-service","path":"/stargate/api"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1258. 21:48:48 2019-01-09 21:48:48,331 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1836
  1259. 21:48:48 2019-01-09 21:48:48,333 INFO [MainThread]: Timing out at 2019-01-09 21:50:48.333625
  1260. 21:48:48 2019-01-09 21:48:48,435 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan HTTP/1.1" 200 None
  1261. 21:48:48 2019-01-09 21:48:48,437 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:48.333625].
  1262. 21:48:49 2019-01-09 21:48:49,543 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan HTTP/1.1" 200 None
  1263. 21:48:49 2019-01-09 21:48:49,545 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:48.333625].
  1264. 21:48:50 2019-01-09 21:48:50,648 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan HTTP/1.1" 200 None
  1265. 21:48:50 2019-01-09 21:48:50,650 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:48.333625].
  1266. 21:48:51 2019-01-09 21:48:51,763 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan HTTP/1.1" 200 None
  1267. 21:48:51 2019-01-09 21:48:51,874 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan/log HTTP/1.1" 200 50
  1268. 21:48:51 2019-01-09 21:48:51,875 DEBUG [MainThread]: Command output: curlpod-qcaqan(0) {"path":"\/stargate\/api","id":"stargate-service"}
  1269. 21:48:51 2019-01-09 21:48:51,985 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-qcaqan HTTP/1.1" 200 None
  1270. 21:48:51 2019-01-09 21:48:51,986 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1271. 21:48:51 "id": "stargate-service",
  1272. 21:48:51 "path": "/stargate/api"
  1273. 21:48:51 }
  1274. 21:48:51 2019-01-09 21:48:51,986 INFO [MainThread]: find_and_parse_json: input = [{
  1275. 21:48:51 "id": "stargate-service",
  1276. 21:48:51 "path": "/stargate/api"
  1277. 21:48:51 }]
  1278. 21:48:51 2019-01-09 21:48:51,986 INFO [MainThread]: Service [id=stargate-service, path=/stargate/api] is registered with Heimdall
  1279. 21:48:51 2019-01-09 21:48:51,987 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1280. 21:48:51 2019-01-09 21:48:51,987 INFO [MainThread]: Timing out at 2019-01-09 21:49:51.987386
  1281. 21:48:51 2019-01-09 21:48:51,987 INFO [MainThread]: Running in cluster: curlpod-uadv3i: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/stargate-service/nodes']
  1282. 21:48:52 2019-01-09 21:48:52,091 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1943
  1283. 21:48:52 2019-01-09 21:48:52,093 INFO [MainThread]: Timing out at 2019-01-09 21:50:52.093740
  1284. 21:48:52 2019-01-09 21:48:52,195 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i HTTP/1.1" 200 None
  1285. 21:48:52 2019-01-09 21:48:52,197 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:52.093740].
  1286. 21:48:53 2019-01-09 21:48:53,308 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i HTTP/1.1" 200 None
  1287. 21:48:53 2019-01-09 21:48:53,310 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:52.093740].
  1288. 21:48:54 2019-01-09 21:48:54,416 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i HTTP/1.1" 200 None
  1289. 21:48:54 2019-01-09 21:48:54,418 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:52.093740].
  1290. 21:48:55 2019-01-09 21:48:55,525 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i HTTP/1.1" 200 None
  1291. 21:48:55 2019-01-09 21:48:55,634 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i/log HTTP/1.1" 200 179
  1292. 21:48:55 2019-01-09 21:48:55,635 DEBUG [MainThread]: Command output: curlpod-uadv3i(0) {"cluster":"default","path":"\/stargate\/api","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1293. 21:48:55 2019-01-09 21:48:55,744 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-uadv3i HTTP/1.1" 200 None
  1294. 21:48:55 2019-01-09 21:48:55,745 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/stargate-service/nodes response {
  1295. 21:48:55 "cluster": "default",
  1296. 21:48:55 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1297. 21:48:55 "path": "/stargate/api",
  1298. 21:48:55 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1299. 21:48:55 }
  1300. 21:48:55 2019-01-09 21:48:55,745 INFO [MainThread]: find_and_parse_json: input = [{
  1301. 21:48:55 "cluster": "default",
  1302. 21:48:55 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1303. 21:48:55 "path": "/stargate/api",
  1304. 21:48:55 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1305. 21:48:55 }]
  1306. 21:48:55 2019-01-09 21:48:55,746 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=None] is registered for service [id=stargate-service]
  1307. 21:48:55 2019-01-09 21:48:55,746 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1308. 21:48:55 2019-01-09 21:48:55,746 INFO [MainThread]: Timing out at 2019-01-09 21:49:55.746853
  1309. 21:48:55 2019-01-09 21:48:55,747 INFO [MainThread]: Running in cluster: curlpod-fcwu5v: ['curl', '--max-time', '60', '--silent', '-X', 'DELETE', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/plugins/inactive/plugin-config/inactive-ccs-command-channel-server-1-2-vnegi-test7']
  1310. 21:48:55 2019-01-09 21:48:55,849 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1844
  1311. 21:48:55 2019-01-09 21:48:55,851 INFO [MainThread]: Timing out at 2019-01-09 21:50:55.851236
  1312. 21:48:55 2019-01-09 21:48:55,952 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v HTTP/1.1" 200 None
  1313. 21:48:55 2019-01-09 21:48:55,954 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:55.851236].
  1314. 21:48:57 2019-01-09 21:48:57,057 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v HTTP/1.1" 200 None
  1315. 21:48:57 2019-01-09 21:48:57,059 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:55.851236].
  1316. 21:48:58 2019-01-09 21:48:58,166 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v HTTP/1.1" 200 None
  1317. 21:48:58 2019-01-09 21:48:58,168 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:55.851236].
  1318. 21:48:59 2019-01-09 21:48:59,274 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v HTTP/1.1" 200 None
  1319. 21:48:59 2019-01-09 21:48:59,386 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v/log HTTP/1.1" 200 21
  1320. 21:48:59 2019-01-09 21:48:59,387 DEBUG [MainThread]: Command output: curlpod-fcwu5v(0) {"message":"Success"}
  1321. 21:48:59 2019-01-09 21:48:59,495 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-fcwu5v HTTP/1.1" 200 None
  1322. 21:48:59 2019-01-09 21:48:59,496 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/plugins/inactive/plugin-config/inactive-ccs-command-channel-server-1-2-vnegi-test7 response {
  1323. 21:48:59 "message": "Success"
  1324. 21:48:59 }
  1325. 21:48:59 2019-01-09 21:48:59,496 INFO [MainThread]: find_and_parse_json: input = [{
  1326. 21:48:59 "message": "Success"
  1327. 21:48:59 }]
  1328. 21:48:59 2019-01-09 21:48:59,496 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7] is marked active with Heimdall with message [Success]
  1329. 21:48:59 2019-01-09 21:48:59,496 INFO [MainThread]: Registering with Heimdall is complete
  1330. 21:48:59 2019-01-09 21:48:59,497 INFO [MainThread]: Successfully registered with heimdall and the registration id is ccs-command-channel-server-1-2-vnegi-test7
  1331. 21:48:59 2019-01-09 21:48:59,497 INFO [MainThread]: Registering Service [id=rdc-registration-service, path=/vrb/dc/manage/register] with Heimdall
  1332. 21:48:59 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/heimdall_lib.py:384: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use api parameter instead
  1333. 21:48:59 pykubeapi=api,
  1334. 21:48:59 2019-01-09 21:48:59,497 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1335. 21:48:59 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/heimdall_lib.py:244: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use pykubeapi parameter instead
  1336. 21:48:59 pykubeapi=pykubeapi,
  1337. 21:48:59 2019-01-09 21:48:59,509 INFO [MainThread]: Timing out at 2019-01-09 21:49:59.509146
  1338. 21:48:59 2019-01-09 21:48:59,509 INFO [MainThread]: Running in cluster: curlpod-tks9e1: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"rdc-registration-service","path":"/vrb/dc/manage/register"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1339. 21:48:59 2019-01-09 21:48:59,514 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  1340. 21:48:59 2019-01-09 21:48:59,953 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1854
  1341. 21:48:59 2019-01-09 21:48:59,955 INFO [MainThread]: Timing out at 2019-01-09 21:50:59.955407
  1342. 21:49:00 2019-01-09 21:49:00,062 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-tks9e1 HTTP/1.1" 200 None
  1343. 21:49:00 2019-01-09 21:49:00,065 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:59.955407].
  1344. 21:49:01 2019-01-09 21:49:01,180 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-tks9e1 HTTP/1.1" 200 None
  1345. 21:49:01 2019-01-09 21:49:01,183 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:50:59.955407].
  1346. 21:49:02 2019-01-09 21:49:02,293 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-tks9e1 HTTP/1.1" 200 None
  1347. 21:49:02 2019-01-09 21:49:02,407 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-tks9e1/log HTTP/1.1" 200 70
  1348. 21:49:02 2019-01-09 21:49:02,409 DEBUG [MainThread]: Command output: curlpod-tks9e1(0) {"path":"\/vrb\/dc\/manage\/register","id":"rdc-registration-service"}
  1349. 21:49:02 2019-01-09 21:49:02,525 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-tks9e1 HTTP/1.1" 200 None
  1350. 21:49:02 2019-01-09 21:49:02,526 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1351. 21:49:02 "id": "rdc-registration-service",
  1352. 21:49:02 "path": "/vrb/dc/manage/register"
  1353. 21:49:02 }
  1354. 21:49:02 2019-01-09 21:49:02,528 INFO [MainThread]: find_and_parse_json: input = [{
  1355. 21:49:02 "id": "rdc-registration-service",
  1356. 21:49:02 "path": "/vrb/dc/manage/register"
  1357. 21:49:02 }]
  1358. 21:49:02 2019-01-09 21:49:02,528 INFO [MainThread]: Service [id=rdc-registration-service, path=/vrb/dc/manage/register] is registered with Heimdall
  1359. 21:49:02 2019-01-09 21:49:02,528 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1360. 21:49:02 2019-01-09 21:49:02,528 INFO [MainThread]: Timing out at 2019-01-09 21:50:02.528884
  1361. 21:49:02 2019-01-09 21:49:02,529 INFO [MainThread]: Running in cluster: curlpod-zarqpy: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","path":"/stargate/api/v1/proxy/register","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/rdc-registration-service/nodes']
  1362. 21:49:02 2019-01-09 21:49:02,636 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1996
  1363. 21:49:02 2019-01-09 21:49:02,639 INFO [MainThread]: Timing out at 2019-01-09 21:51:02.638888
  1364. 21:49:02 2019-01-09 21:49:02,744 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy HTTP/1.1" 200 None
  1365. 21:49:02 2019-01-09 21:49:02,748 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:02.638888].
  1366. 21:49:03 2019-01-09 21:49:03,853 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy HTTP/1.1" 200 None
  1367. 21:49:03 2019-01-09 21:49:03,856 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:02.638888].
  1368. 21:49:04 2019-01-09 21:49:04,964 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy HTTP/1.1" 200 None
  1369. 21:49:04 2019-01-09 21:49:04,967 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:02.638888].
  1370. 21:49:06 2019-01-09 21:49:06,079 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy HTTP/1.1" 200 None
  1371. 21:49:06 2019-01-09 21:49:06,195 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy/log HTTP/1.1" 200 200
  1372. 21:49:06 2019-01-09 21:49:06,197 DEBUG [MainThread]: Command output: curlpod-zarqpy(0) {"cluster":"default","path":"\/stargate\/api\/v1\/proxy\/register","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1373. 21:49:06 2019-01-09 21:49:06,316 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-zarqpy HTTP/1.1" 200 None
  1374. 21:49:06 2019-01-09 21:49:06,318 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/rdc-registration-service/nodes response {
  1375. 21:49:06 "cluster": "default",
  1376. 21:49:06 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1377. 21:49:06 "path": "/stargate/api/v1/proxy/register",
  1378. 21:49:06 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1379. 21:49:06 }
  1380. 21:49:06 2019-01-09 21:49:06,318 INFO [MainThread]: find_and_parse_json: input = [{
  1381. 21:49:06 "cluster": "default",
  1382. 21:49:06 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1383. 21:49:06 "path": "/stargate/api/v1/proxy/register",
  1384. 21:49:06 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1385. 21:49:06 }]
  1386. 21:49:06 2019-01-09 21:49:06,318 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=/stargate/api/v1/proxy/register] is registered for service [id=rdc-registration-service]
  1387. 21:49:06 2019-01-09 21:49:06,319 INFO [MainThread]: Successfully registered with heimdall and the registration id is {'path': '/vrb/dc/manage/register', 'id': 'rdc-registration-service'}
  1388. 21:49:06 2019-01-09 21:49:06,319 INFO [MainThread]: Registering Service [id=artifact, path=/vrb/artifact-provider] with Heimdall
  1389. 21:49:06 2019-01-09 21:49:06,319 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1390. 21:49:06 2019-01-09 21:49:06,343 INFO [MainThread]: Timing out at 2019-01-09 21:50:06.343060
  1391. 21:49:06 2019-01-09 21:49:06,343 INFO [MainThread]: Running in cluster: curlpod-mlll70: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"artifact","path":"/vrb/artifact-provider"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services']
  1392. 21:49:06 2019-01-09 21:49:06,353 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  1393. 21:49:06 2019-01-09 21:49:06,752 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1837
  1394. 21:49:06 2019-01-09 21:49:06,756 INFO [MainThread]: Timing out at 2019-01-09 21:51:06.756846
  1395. 21:49:06 2019-01-09 21:49:06,865 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-mlll70 HTTP/1.1" 200 None
  1396. 21:49:06 2019-01-09 21:49:06,869 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:06.756846].
  1397. 21:49:07 2019-01-09 21:49:07,978 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-mlll70 HTTP/1.1" 200 None
  1398. 21:49:07 2019-01-09 21:49:07,982 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:06.756846].
  1399. 21:49:09 2019-01-09 21:49:09,091 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-mlll70 HTTP/1.1" 200 None
  1400. 21:49:09 2019-01-09 21:49:09,210 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-mlll70/log HTTP/1.1" 200 51
  1401. 21:49:09 2019-01-09 21:49:09,212 DEBUG [MainThread]: Command output: curlpod-mlll70(0) {"path":"\/vrb\/artifact-provider","id":"artifact"}
  1402. 21:49:09 2019-01-09 21:49:09,326 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-mlll70 HTTP/1.1" 200 None
  1403. 21:49:09 2019-01-09 21:49:09,328 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services response {
  1404. 21:49:09 "id": "artifact",
  1405. 21:49:09 "path": "/vrb/artifact-provider"
  1406. 21:49:09 }
  1407. 21:49:09 2019-01-09 21:49:09,330 INFO [MainThread]: find_and_parse_json: input = [{
  1408. 21:49:09 "id": "artifact",
  1409. 21:49:09 "path": "/vrb/artifact-provider"
  1410. 21:49:09 }]
  1411. 21:49:09 2019-01-09 21:49:09,331 INFO [MainThread]: Service [id=artifact, path=/vrb/artifact-provider] is registered with Heimdall
  1412. 21:49:09 2019-01-09 21:49:09,332 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1413. 21:49:09 2019-01-09 21:49:09,332 INFO [MainThread]: Timing out at 2019-01-09 21:50:09.332605
  1414. 21:49:09 2019-01-09 21:49:09,333 INFO [MainThread]: Running in cluster: curlpod-f4vgfv: ['curl', '--max-time', '60', '--silent', '-X', 'POST', '--data', '{"id":"ccs-command-channel-server-1-2-vnegi-test7","path":"/stargate/api/v1/artifact-provider","uri":"http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"}', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/artifact/nodes']
  1415. 21:49:09 2019-01-09 21:49:09,437 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1983
  1416. 21:49:09 2019-01-09 21:49:09,440 INFO [MainThread]: Timing out at 2019-01-09 21:51:09.439911
  1417. 21:49:09 2019-01-09 21:49:09,547 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv HTTP/1.1" 200 None
  1418. 21:49:09 2019-01-09 21:49:09,550 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:09.439911].
  1419. 21:49:10 2019-01-09 21:49:10,657 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv HTTP/1.1" 200 None
  1420. 21:49:10 2019-01-09 21:49:10,659 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:09.439911].
  1421. 21:49:11 2019-01-09 21:49:11,766 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv HTTP/1.1" 200 None
  1422. 21:49:11 2019-01-09 21:49:11,768 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:09.439911].
  1423. 21:49:12 2019-01-09 21:49:12,878 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv HTTP/1.1" 200 None
  1424. 21:49:12 2019-01-09 21:49:12,992 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv/log HTTP/1.1" 200 202
  1425. 21:49:12 2019-01-09 21:49:12,993 DEBUG [MainThread]: Command output: curlpod-f4vgfv(0) {"cluster":"default","path":"\/stargate\/api\/v1\/artifact-provider","uri":"http:\/\/ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000","id":"ccs-command-channel-server-1-2-vnegi-test7"}
  1426. 21:49:13 2019-01-09 21:49:13,102 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-f4vgfv HTTP/1.1" 200 None
  1427. 21:49:13 2019-01-09 21:49:13,103 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/services/artifact/nodes response {
  1428. 21:49:13 "cluster": "default",
  1429. 21:49:13 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1430. 21:49:13 "path": "/stargate/api/v1/artifact-provider",
  1431. 21:49:13 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1432. 21:49:13 }
  1433. 21:49:13 2019-01-09 21:49:13,103 INFO [MainThread]: find_and_parse_json: input = [{
  1434. 21:49:13 "cluster": "default",
  1435. 21:49:13 "id": "ccs-command-channel-server-1-2-vnegi-test7",
  1436. 21:49:13 "path": "/stargate/api/v1/artifact-provider",
  1437. 21:49:13 "uri": "http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000"
  1438. 21:49:13 }]
  1439. 21:49:13 2019-01-09 21:49:13,104 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test7, uri=http://ccs-command-channel-server-svc.vnegi-test6.svc.cluster.local:8000, path=/stargate/api/v1/artifact-provider] is registered for service [id=artifact]
  1440. 21:49:13 2019-01-09 21:49:13,104 INFO [MainThread]: Successfully registered with heimdall and the registration id is {'path': '/vrb/artifact-provider', 'id': 'artifact'}
  1441. 21:49:13 2019-01-09 21:49:13,104 INFO [MainThread]: Successfully registered with heimdall and the registration
  1442. 21:49:13 2019-01-09 21:49:13,104 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1443. 21:49:13 2019-01-09 21:49:13,105 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5bf992dd8>}: attempt [1]
  1444. 21:49:13 2019-01-09 21:49:13,113 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1445. 21:49:13 2019-01-09 21:49:13,377 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1446. 21:49:13 2019-01-09 21:49:13,379 INFO [MainThread]: ccs-command-channel-server unpausing Nodes of build 1-2-vnegi-test7 with Heimdall
  1447. 21:49:13 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/deployments/operations/common_function.py:379: DeprecationWarning: string cmds are deprecated, please use argv lists.
  1448. 21:49:13 namespace=app_config.namespace,
  1449. 21:49:13 2019-01-09 21:49:13,379 INFO [MainThread]: Running in cluster: curlpod-5b30an: ['curl', '--max-time', '120', '--silent', '-X', 'POST', '-H', 'content-type:application/json', '-d', '{"/common/persistence/feature/SystemFeatures::dropwizardMetrics":"true"}', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local:8000/upgrade/notify/activate']
  1450. 21:49:13 2019-01-09 21:49:13,486 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1608
  1451. 21:49:13 2019-01-09 21:49:13,487 INFO [MainThread]: Timing out at 2019-01-09 21:59:13.487699
  1452. 21:49:13 2019-01-09 21:49:13,591 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-5b30an HTTP/1.1" 200 None
  1453. 21:49:13 2019-01-09 21:49:13,594 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:13.487699].
  1454. 21:49:14 2019-01-09 21:49:14,700 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-5b30an HTTP/1.1" 200 None
  1455. 21:49:14 2019-01-09 21:49:14,702 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:13.487699].
  1456. 21:49:15 2019-01-09 21:49:15,806 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-5b30an HTTP/1.1" 200 None
  1457. 21:49:15 2019-01-09 21:49:15,920 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-5b30an/log HTTP/1.1" 200 72
  1458. 21:49:15 2019-01-09 21:49:15,920 DEBUG [MainThread]: Command output: curlpod-5b30an(0) {"success":true,"delay":0,"message":"Enabled all features","context":{}}
  1459. 21:49:16 2019-01-09 21:49:16,029 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-5b30an HTTP/1.1" 200 None
  1460. 21:49:16 2019-01-09 21:49:16,030 INFO [MainThread]: Got response during xenon unpause of service of build 1-2-vnegi-test7 : {"success":true,"delay":0,"message":"Enabled all features","context":{}}
  1461. 21:49:16 2019-01-09 21:49:16,030 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1462. 21:49:16 2019-01-09 21:49:16,031 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5bf974588>}: attempt [1]
  1463. 21:49:16 2019-01-09 21:49:16,034 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1464. 21:49:16 2019-01-09 21:49:16,248 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1465. 21:49:16 2019-01-09 21:49:16,250 INFO [MainThread]: app_labels : {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test7'}
  1466. 21:49:16 2019-01-09 21:49:16,250 INFO [MainThread]: Timing out at 2019-01-09 21:59:16.250585
  1467. 21:49:16 2019-01-09 21:49:16,250 INFO [MainThread]: Starting [app=ccs-command-channel-server] Healthcheck [build=1-2-vnegi-test7]
  1468. 21:49:16 2019-01-09 21:49:16,358 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  1469. 21:49:16 2019-01-09 21:49:16,464 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  1470. 21:49:16 2019-01-09 21:49:16,574 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1471. 21:49:16 2019-01-09 21:49:16,579 INFO [MainThread]: [app=ccs-command-channel-server] pods. [expected=1] [actual=1]
  1472. 21:49:16 2019-01-09 21:49:16,580 DEBUG [MainThread]: Default nodegroup curl = ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNTYsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNTYsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.FcgVEUpkoZ0-afDQuISnkjEyDL0yYtUGCJbIL6_KcfjUVjwOCfIk-n9dF06gYC39I5nJJyvWZRq6eQRcidvWUCZrkxEG8MvhNkFz1KQJzv8BW_FY7KdXlifmYpxH30PMG9K2kej2TkWWQcJR27Z39eS06rHUHfYloX3Vzigt2ZTZg_1TlNl0erTgfw8c2fhSGTTZbXlhHRBRRqWAcIlr7vsIELpqCDawLDzVBNRmS9NGAyAgy9XwEvlc0OmgiTkEiUZSCKYyDT2DcpkJc0VKWhioATe8I8PBEqtX6U1xiz7Wuz9TzbtwheZ-wzzr0EJWJkqo4Fp8odrnBi5GUOmNlA', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1473. 21:49:16 2019-01-09 21:49:16,580 INFO [MainThread]: Running in cluster: curlpod-gajlbc: ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNTYsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNTYsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.FcgVEUpkoZ0-afDQuISnkjEyDL0yYtUGCJbIL6_KcfjUVjwOCfIk-n9dF06gYC39I5nJJyvWZRq6eQRcidvWUCZrkxEG8MvhNkFz1KQJzv8BW_FY7KdXlifmYpxH30PMG9K2kej2TkWWQcJR27Z39eS06rHUHfYloX3Vzigt2ZTZg_1TlNl0erTgfw8c2fhSGTTZbXlhHRBRRqWAcIlr7vsIELpqCDawLDzVBNRmS9NGAyAgy9XwEvlc0OmgiTkEiUZSCKYyDT2DcpkJc0VKWhioATe8I8PBEqtX6U1xiz7Wuz9TzbtwheZ-wzzr0EJWJkqo4Fp8odrnBi5GUOmNlA', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1474. 21:49:16 2019-01-09 21:49:16,693 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1475. 21:49:16 2019-01-09 21:49:16,695 INFO [MainThread]: Timing out at 2019-01-09 21:51:16.695870
  1476. 21:49:16 2019-01-09 21:49:16,801 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gajlbc HTTP/1.1" 200 None
  1477. 21:49:16 2019-01-09 21:49:16,803 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:16.695870].
  1478. 21:49:17 2019-01-09 21:49:17,907 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gajlbc HTTP/1.1" 200 None
  1479. 21:49:17 2019-01-09 21:49:17,909 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:16.695870].
  1480. 21:49:19 2019-01-09 21:49:19,016 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gajlbc HTTP/1.1" 200 None
  1481. 21:49:19 2019-01-09 21:49:19,132 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-gajlbc/log HTTP/1.1" 200 1109
  1482. 21:49:19 2019-01-09 21:49:19,133 DEBUG [MainThread]: Command output: curlpod-gajlbc(0) {"config":{"nodeRemovalDelayMicros":300000000,"stableGroupMaintenanceIntervalCount":5,"peerRequestTimeoutMicros":20000000},"nodes":{"6d6c86f5-bf21-4c53-87f9-43793697ab0b":{"groupReference":"http://172.20.42.147:8000/core/node-groups/default","status":"AVAILABLE","options":["PEER"],"id":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","membershipQuorum":1,"locationQuorum":1,"documentVersion":1,"documentKind":"com:vmware:xenon:services:common:NodeState","documentSelfLink":"/core/node-groups/default/6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentUpdateTimeMicros":1547099292351001,"documentExpirationTimeMicros":0}},"lastChanges":["PEER_STATUS_CHANGE"],"membershipUpdateTimeMicros":1547099292351001,"localMembershipUpdateTimeMicros":1547099292351001,"documentVersion":2,"documentKind":"com:vmware:xenon:services:common:NodeGroupService:NodeGroupState","documentSelfLink":"/core/node-groups/default","documentUpdateTimeMicros":1547099292355000,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentAuthPrincipalLink":"/core/authz/system-user"}
  1483. 21:49:19 2019-01-09 21:49:19,245 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-gajlbc HTTP/1.1" 200 None
  1484. 21:49:19 2019-01-09 21:49:19,246 INFO [MainThread]: [app=ccs-command-channel-server] node-group is healthy
  1485. 21:49:19 2019-01-09 21:49:19,247 INFO [MainThread]: Initiating upgrade (via API) from [old_image=1-2-vnegi-test6] to [new_image=1-2-vnegi-test7]
  1486. 21:49:19 2019-01-09 21:49:19,247 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1487. 21:49:19 2019-01-09 21:49:19,247 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5bf992d68>}: attempt [1]
  1488. 21:49:19 2019-01-09 21:49:19,255 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1489. 21:49:19 2019-01-09 21:49:19,467 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1490. 21:49:19 2019-01-09 21:49:19,468 INFO [MainThread]: ccs-command-channel-server pausing Nodes of build 1-2-vnegi-test6 with Heimdall
  1491. 21:49:19 2019-01-09 21:49:19,469 INFO [MainThread]: Running in cluster: curlpod-xlgqa2: ['curl', '--max-time', '120', '--silent', '-X', 'POST', '-H', 'content-type:application/json', '-d', '{}', 'http://ccs-command-channel-server-svc-1-2-vnegi-test6.vnegi-test6.svc.cluster.local:8000/upgrade/notify/maintenance', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNTksInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNTksImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.NlhZFELSsH2l57VNVxya7q2yLoy7N05U2lOavpaQTl3clUnXsb2ckhVeEZPXp9uSEeQ7YEMjAY9unV5eSM9xwohBlA4HlCSguieXvyu1T0PGu5usuJhDBVQSB4cEmXUPAo1-XN8SkOLuzgU2XxENxyUTHcmRoBIL5WQ_UMarw0LJeT0g1sF1E8bCZq2gBp3MYbX0wz6gDrumwySjrOreDhcQX2SfN5ZIpVu3EbRDddUMsegRKM7MFHrSgpHFLSsSY_VvXwvGI3_ITebvJuwBT3h6l0X3kEtIpIz9g_qJS3_KfMDHhBCbPk5r7fnPI-8xwI7a4xID8SNBmsWH-aeMeg']
  1492. 21:49:19 2019-01-09 21:49:19,579 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1493. 21:49:19 2019-01-09 21:49:19,581 INFO [MainThread]: Timing out at 2019-01-09 21:59:19.581264
  1494. 21:49:19 2019-01-09 21:49:19,685 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2 HTTP/1.1" 200 None
  1495. 21:49:19 2019-01-09 21:49:19,687 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:19.581264].
  1496. 21:49:20 2019-01-09 21:49:20,798 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2 HTTP/1.1" 200 None
  1497. 21:49:20 2019-01-09 21:49:20,800 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:19.581264].
  1498. 21:49:21 2019-01-09 21:49:21,909 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2 HTTP/1.1" 200 None
  1499. 21:49:21 2019-01-09 21:49:21,912 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:19.581264].
  1500. 21:49:23 2019-01-09 21:49:23,022 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2 HTTP/1.1" 200 None
  1501. 21:49:23 2019-01-09 21:49:23,142 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2/log HTTP/1.1" 200 143
  1502. 21:49:23 2019-01-09 21:49:23,143 DEBUG [MainThread]: Command output: curlpod-xlgqa2(0) {"success":true,"delay":0,"message":"Disabled all features","context":{"/common/persistence/feature/SystemFeatures::dropwizardMetrics":"true"}}
  1503. 21:49:23 2019-01-09 21:49:23,255 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-xlgqa2 HTTP/1.1" 200 None
  1504. 21:49:23 2019-01-09 21:49:23,256 INFO [MainThread]: Got response during xenon pause of service of build 1-2-vnegi-test6 : {'success': True, 'delay': 0, 'message': 'Disabled all features', 'context': {'/common/persistence/feature/SystemFeatures::dropwizardMetrics': 'true'}}
  1505. 21:49:23 2019-01-09 21:49:23,257 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1506. 21:49:23 2019-01-09 21:49:23,257 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5c0211f98>}: attempt [1]
  1507. 21:49:23 2019-01-09 21:49:23,266 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1508. 21:49:23 2019-01-09 21:49:23,478 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1509. 21:49:23 2019-01-09 21:49:23,480 INFO [MainThread]: ccs-command-channel-server pausing Nodes of build 1-2-vnegi-test7 with Heimdall
  1510. 21:49:23 2019-01-09 21:49:23,480 INFO [MainThread]: Running in cluster: curlpod-78ccmn: ['curl', '--max-time', '120', '--silent', '-X', 'POST', '-H', 'content-type:application/json', '-d', '{}', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local:8000/upgrade/notify/maintenance', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNjMsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNjMsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.G9qcFmDNgEGy6Tdat3WJjy_idec03nJ7i1yFMe6EeZGP5jBGD7r3OWAVPlxuSF1550zMKE1I8Z5jHjHMseEwE-nHTf2ZVgcdkewuKRe4gtGo9W9EmqLw2IKskuA2795Q7J7otGdlxXu6ou4bfxFUlZT5TNDXxC0OZ_jHVKK7Yn3NXsv-z-5ba3E3wySAz8vm-7jw6SIWd6Z2BUFPqjPHpRVS1Wa0RFYuqHTegaX1C5GKz592v64iJavPEMlKPy17hQESRdJe8UwYM-TMdGbyJkba6AHDIQCEMwYPHOp4e-w59AujfB4PDLMSzkbThaFp0UBJwYQVfsHCjYUrC3aCzA']
  1511. 21:49:23 2019-01-09 21:49:23,585 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1512. 21:49:23 2019-01-09 21:49:23,587 INFO [MainThread]: Timing out at 2019-01-09 21:59:23.587682
  1513. 21:49:23 2019-01-09 21:49:23,693 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-78ccmn HTTP/1.1" 200 None
  1514. 21:49:23 2019-01-09 21:49:23,694 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:23.587682].
  1515. 21:49:24 2019-01-09 21:49:24,801 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-78ccmn HTTP/1.1" 200 None
  1516. 21:49:24 2019-01-09 21:49:24,803 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:59:23.587682].
  1517. 21:49:25 2019-01-09 21:49:25,913 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-78ccmn HTTP/1.1" 200 None
  1518. 21:49:26 2019-01-09 21:49:26,030 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-78ccmn/log HTTP/1.1" 200 143
  1519. 21:49:26 2019-01-09 21:49:26,031 DEBUG [MainThread]: Command output: curlpod-78ccmn(0) {"success":true,"delay":0,"message":"Disabled all features","context":{"/common/persistence/feature/SystemFeatures::dropwizardMetrics":"true"}}
  1520. 21:49:26 2019-01-09 21:49:26,142 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-78ccmn HTTP/1.1" 200 None
  1521. 21:49:26 2019-01-09 21:49:26,143 INFO [MainThread]: Got response during xenon pause of service of build 1-2-vnegi-test7 : {'success': True, 'delay': 0, 'message': 'Disabled all features', 'context': {'/common/persistence/feature/SystemFeatures::dropwizardMetrics': 'true'}}
  1522. 21:49:26 2019-01-09 21:49:26,251 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1523. 21:49:26 2019-01-09 21:49:26,362 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1524. 21:49:26 2019-01-09 21:49:26,366 INFO [MainThread]: labels= {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test7'}
  1525. 21:49:26 2019-01-09 21:49:26,366 INFO [MainThread]: namespace = vnegi-test6
  1526. 21:49:26 2019-01-09 21:49:26,366 INFO [MainThread]: new_ips = ['172.20.42.147']
  1527. 21:49:26 2019-01-09 21:49:26,367 DEBUG [MainThread]: IPs of pods: [old_ips=['172.20.48.157']] [new_ips=['172.20.42.147']]. Using [old_ip=172.20.48.157] [new_ip=172.20.42.147]
  1528. 21:49:26 2019-01-09 21:49:26,367 INFO [MainThread]: Running in cluster: curlpod-4ge1h6: ['curl', '--max-time', '15', '--silent', '-H', 'Content-Type:application/json', 'http://172.20.42.147:8000/mgmt/upgrade-tasks', '--data', '{"sourceNodeGroupReference":"http://172.20.48.157:8000/core/node-groups/default","destinationNodeGroupReference":"http://172.20.42.147:8000/core/node-groups/default","apiGatewayUri":"https://heimdall-service.vnegi-test6.svc.cluster.local:9443"}', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNjMsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNjMsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.G9qcFmDNgEGy6Tdat3WJjy_idec03nJ7i1yFMe6EeZGP5jBGD7r3OWAVPlxuSF1550zMKE1I8Z5jHjHMseEwE-nHTf2ZVgcdkewuKRe4gtGo9W9EmqLw2IKskuA2795Q7J7otGdlxXu6ou4bfxFUlZT5TNDXxC0OZ_jHVKK7Yn3NXsv-z-5ba3E3wySAz8vm-7jw6SIWd6Z2BUFPqjPHpRVS1Wa0RFYuqHTegaX1C5GKz592v64iJavPEMlKPy17hQESRdJe8UwYM-TMdGbyJkba6AHDIQCEMwYPHOp4e-w59AujfB4PDLMSzkbThaFp0UBJwYQVfsHCjYUrC3aCzA']
  1529. 21:49:26 2019-01-09 21:49:26,473 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1530. 21:49:26 2019-01-09 21:49:26,475 INFO [MainThread]: Timing out at 2019-01-09 21:51:26.475735
  1531. 21:49:26 2019-01-09 21:49:26,579 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6 HTTP/1.1" 200 None
  1532. 21:49:26 2019-01-09 21:49:26,582 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:26.475735].
  1533. 21:49:27 2019-01-09 21:49:27,685 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6 HTTP/1.1" 200 None
  1534. 21:49:27 2019-01-09 21:49:27,687 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:26.475735].
  1535. 21:49:28 2019-01-09 21:49:28,790 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6 HTTP/1.1" 200 None
  1536. 21:49:28 2019-01-09 21:49:28,793 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:26.475735].
  1537. 21:49:29 2019-01-09 21:49:29,900 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6 HTTP/1.1" 200 None
  1538. 21:49:30 2019-01-09 21:49:30,011 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6/log HTTP/1.1" 200 1252
  1539. 21:49:30 2019-01-09 21:49:30,012 DEBUG [MainThread]: Command output: curlpod-4ge1h6(0) {"factoryLinks":[[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}]],"sourceNodeGroupReference":"http://172.20.48.157:8000/core/node-groups/default","destinationNodeGroupReference":"http://172.20.42.147:8000/core/node-groups/default","documentVersion":0,"documentEpoch":0,"documentKind":"com:vmware:vrbc:common:xenon:upgrade:services:ApplicationMigrationTaskServiceV2:State","documentSelfLink":"/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08","documentUpdateTimeMicros":1547099368342000,"documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b"}
  1540. 21:49:30 2019-01-09 21:49:30,125 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-4ge1h6 HTTP/1.1" 200 None
  1541. 21:49:30 2019-01-09 21:49:30,126 INFO [MainThread]: Successfully created upgrade task http://172.20.42.147:8000/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08 with task-id 1bf78f9a3de1787557f1424483e08
  1542. 21:49:30 2019-01-09 21:49:30,127 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1543. 21:49:30 2019-01-09 21:49:30,127 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5bf992940>}: attempt [1]
  1544. 21:49:30 2019-01-09 21:49:30,135 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1545. 21:49:30 2019-01-09 21:49:30,349 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1546. 21:49:30 2019-01-09 21:49:30,351 INFO [MainThread]: Timing out at 2019-01-09 21:59:30.350953
  1547. 21:49:30 2019-01-09 21:49:30,351 INFO [MainThread]: Checking [service=ccs-command-channel-server-svc-1-2-vnegi-test7] to check whether the upgrade has completed...
  1548. 21:49:30 2019-01-09 21:49:30,352 INFO [MainThread]: curl_cmd :
  1549. 21:49:30 ['curl', '--max-time', '30', '--silent', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7:8000/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNzAsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNzAsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.k4kjyyhDjYRJLV0spWXKWAaDcEKilcMBOkhb4Uo68rlhgAVMrR8PZQ3TOyiP_0tgUwSW78HLQfuytsqNDEA78jdSwmFj949Ip4p1oblnQ42sHaD8AnoXwJnw0pXxGLZqk5KBQu0nArxUj-GIEtLmO3KjCOzI_PlFDU950Mprotf6GbURlIeNVMOPl3ARPBPUNS6mk6EQrqzySy8aTrbNLbFGLxAgHWjwU8laItWduqlh3ebE3-sdMPiyLH3aeHk_fIP6rDbz8iqlhd1LAQXIAk5etX0nkzEUwVnXjlB74BazWXzJY6lg6Al-XSgBM8JAq2a3NbYrTYr_s6132-mlFA']
  1550. 21:49:30 2019-01-09 21:49:30,352 INFO [MainThread]: Running in cluster: curlpod-rk730w: ['curl', '--max-time', '30', '--silent', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7:8000/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNzAsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNzAsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.k4kjyyhDjYRJLV0spWXKWAaDcEKilcMBOkhb4Uo68rlhgAVMrR8PZQ3TOyiP_0tgUwSW78HLQfuytsqNDEA78jdSwmFj949Ip4p1oblnQ42sHaD8AnoXwJnw0pXxGLZqk5KBQu0nArxUj-GIEtLmO3KjCOzI_PlFDU950Mprotf6GbURlIeNVMOPl3ARPBPUNS6mk6EQrqzySy8aTrbNLbFGLxAgHWjwU8laItWduqlh3ebE3-sdMPiyLH3aeHk_fIP6rDbz8iqlhd1LAQXIAk5etX0nkzEUwVnXjlB74BazWXzJY6lg6Al-XSgBM8JAq2a3NbYrTYr_s6132-mlFA']
  1551. 21:49:30 2019-01-09 21:49:30,462 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1552. 21:49:30 2019-01-09 21:49:30,465 INFO [MainThread]: Timing out at 2019-01-09 21:51:30.465166
  1553. 21:49:30 2019-01-09 21:49:30,567 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-rk730w HTTP/1.1" 200 None
  1554. 21:49:30 2019-01-09 21:49:30,570 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:30.465166].
  1555. 21:49:31 2019-01-09 21:49:31,676 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-rk730w HTTP/1.1" 200 None
  1556. 21:49:31 2019-01-09 21:49:31,679 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:51:30.465166].
  1557. 21:49:32 2019-01-09 21:49:32,806 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-rk730w HTTP/1.1" 200 None
  1558. 21:49:32 2019-01-09 21:49:32,917 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-rk730w/log HTTP/1.1" 200 None
  1559. 21:49:32 2019-01-09 21:49:32,918 DEBUG [MainThread]: Command output: curlpod-rk730w(0) {"subStage":"MIGRATE_NEXT_BATCH","factoryLinks":[[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}]],"sourceNodeGroupReference":"http://172.20.48.157:8000/core/node-groups/default","destinationNodeGroupReference":"http://172.20.42.147:8000/core/node-groups/default","currentFactoryIndex":0,"currentFactoryBatchIndex":0,"taskInfo":{"stage":"STARTED","isDirect":false},"documentVersion":1,"documentEpoch":0,"documentKind":"com:vmware:vrbc:common:xenon:upgrade:services:ApplicationMigrationTaskServiceV2:State","documentSelfLink":"/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08","documentUpdateTimeMicros":1547099368344002,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b"}
  1560. 21:49:33 2019-01-09 21:49:33,032 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-rk730w HTTP/1.1" 200 None
  1561. 21:49:33 2019-01-09 21:49:33,034 INFO [MainThread]: Latest upgrade status: STARTED
  1562. 21:49:33 2019-01-09 21:49:33,034 DEBUG [MainThread]: [func=<lambda>]: [attempt=1] returned False. Retrying in 30 seconds [timeout_at=2019-01-09 21:59:30.350953].
  1563. 21:50:03 2019-01-09 21:50:03,065 INFO [MainThread]: Checking [service=ccs-command-channel-server-svc-1-2-vnegi-test7] to check whether the upgrade has completed...
  1564. 21:50:03 2019-01-09 21:50:03,066 INFO [MainThread]: curl_cmd :
  1565. 21:50:03 ['curl', '--max-time', '30', '--silent', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7:8000/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNzAsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNzAsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.k4kjyyhDjYRJLV0spWXKWAaDcEKilcMBOkhb4Uo68rlhgAVMrR8PZQ3TOyiP_0tgUwSW78HLQfuytsqNDEA78jdSwmFj949Ip4p1oblnQ42sHaD8AnoXwJnw0pXxGLZqk5KBQu0nArxUj-GIEtLmO3KjCOzI_PlFDU950Mprotf6GbURlIeNVMOPl3ARPBPUNS6mk6EQrqzySy8aTrbNLbFGLxAgHWjwU8laItWduqlh3ebE3-sdMPiyLH3aeHk_fIP6rDbz8iqlhd1LAQXIAk5etX0nkzEUwVnXjlB74BazWXzJY6lg6Al-XSgBM8JAq2a3NbYrTYr_s6132-mlFA']
  1566. 21:50:03 2019-01-09 21:50:03,066 INFO [MainThread]: Running in cluster: curlpod-l8anf5: ['curl', '--max-time', '30', '--silent', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7:8000/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDExNzAsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTkzNzAsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.k4kjyyhDjYRJLV0spWXKWAaDcEKilcMBOkhb4Uo68rlhgAVMrR8PZQ3TOyiP_0tgUwSW78HLQfuytsqNDEA78jdSwmFj949Ip4p1oblnQ42sHaD8AnoXwJnw0pXxGLZqk5KBQu0nArxUj-GIEtLmO3KjCOzI_PlFDU950Mprotf6GbURlIeNVMOPl3ARPBPUNS6mk6EQrqzySy8aTrbNLbFGLxAgHWjwU8laItWduqlh3ebE3-sdMPiyLH3aeHk_fIP6rDbz8iqlhd1LAQXIAk5etX0nkzEUwVnXjlB74BazWXzJY6lg6Al-XSgBM8JAq2a3NbYrTYr_s6132-mlFA']
  1567. 21:50:03 2019-01-09 21:50:03,173 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1568. 21:50:03 2019-01-09 21:50:03,175 INFO [MainThread]: Timing out at 2019-01-09 21:52:03.175315
  1569. 21:50:03 2019-01-09 21:50:03,277 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-l8anf5 HTTP/1.1" 200 None
  1570. 21:50:03 2019-01-09 21:50:03,279 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:03.175315].
  1571. 21:50:04 2019-01-09 21:50:04,382 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-l8anf5 HTTP/1.1" 200 None
  1572. 21:50:04 2019-01-09 21:50:04,385 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:03.175315].
  1573. 21:50:05 2019-01-09 21:50:05,488 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-l8anf5 HTTP/1.1" 200 None
  1574. 21:50:05 2019-01-09 21:50:05,597 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-l8anf5/log HTTP/1.1" 200 None
  1575. 21:50:05 2019-01-09 21:50:05,598 DEBUG [MainThread]: Command output: curlpod-l8anf5(0) {"subStage":"MIGRATION_TASK_COMPLETED","factoryLinks":[[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/template/persistence","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-subscription","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/dc-certificate","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/common/persistence/feature","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/resources/remote-feature-version","transformLink":"/mgmt/upgrade-transforms/basic"}],[{"factoryLink":"/vrbc/internal/cmd/persistence/definition","transformLink":"/mgmt/upgrade-transforms/basic"}]],"sourceNodeGroupReference":"http://172.20.48.157:8000/core/node-groups/default","destinationNodeGroupReference":"http://172.20.42.147:8000/core/node-groups/default","currentFactoryIndex":2,"currentFactoryBatchIndex":6,"taskInfo":{"stage":"FINISHED","isDirect":false},"documentVersion":15,"documentEpoch":0,"documentKind":"com:vmware:vrbc:common:xenon:upgrade:services:ApplicationMigrationTaskServiceV2:State","documentSelfLink":"/mgmt/upgrade-tasks/1bf78f9a3de1787557f1424483e08","documentUpdateTimeMicros":1547099372360002,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b"}
  1576. 21:50:05 2019-01-09 21:50:05,706 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-l8anf5 HTTP/1.1" 200 None
  1577. 21:50:05 2019-01-09 21:50:05,707 INFO [MainThread]: Latest upgrade status: FINISHED
  1578. 21:50:05 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/deployments/operations/register/operator/heimdall/script_registration.py:168: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use api parameter instead
  1579. 21:50:05 app_config.app_constants["application_strategy"] == "xenon-stateful"
  1580. 21:50:05 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/heimdall_lib.py:527: DeprecationWarning: use of KUBECONFIG os env variable will be deprecated, use api parameter instead
  1581. 21:50:05 pykubeapi=api,
  1582. 21:50:05 2019-01-09 21:50:05,708 DEBUG [MainThread]: Encoded Admin Credentials b'c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh'
  1583. 21:50:05 2019-01-09 21:50:05,721 INFO [MainThread]: Timing out at 2019-01-09 21:51:05.720978
  1584. 21:50:05 2019-01-09 21:50:05,721 INFO [MainThread]: Running in cluster: curlpod-urim2g: ['curl', '--max-time', '60', '--silent', '-X', 'DELETE', '-H', 'Authorization:Basic c3ltcGhvbnktYWRtaW5Adm13YXJlLmNvbTpWTXdhcmUxMjMh', 'https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/nodes/ccs-command-channel-server-1-2-vnegi-test6']
  1585. 21:50:05 2019-01-09 21:50:05,726 DEBUG [MainThread]: Starting new HTTPS connection (1): api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com
  1586. 21:50:06 2019-01-09 21:50:06,172 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1810
  1587. 21:50:06 2019-01-09 21:50:06,175 INFO [MainThread]: Timing out at 2019-01-09 21:52:06.175095
  1588. 21:50:06 2019-01-09 21:50:06,280 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g HTTP/1.1" 200 None
  1589. 21:50:06 2019-01-09 21:50:06,283 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:06.175095].
  1590. 21:50:07 2019-01-09 21:50:07,388 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g HTTP/1.1" 200 None
  1591. 21:50:07 2019-01-09 21:50:07,390 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:06.175095].
  1592. 21:50:08 2019-01-09 21:50:08,499 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g HTTP/1.1" 200 None
  1593. 21:50:08 2019-01-09 21:50:08,502 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:06.175095].
  1594. 21:50:09 2019-01-09 21:50:09,610 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g HTTP/1.1" 200 None
  1595. 21:50:09 2019-01-09 21:50:09,726 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g/log HTTP/1.1" 200 21
  1596. 21:50:09 2019-01-09 21:50:09,728 DEBUG [MainThread]: Command output: curlpod-urim2g(0) {"message":"Success"}
  1597. 21:50:09 2019-01-09 21:50:09,845 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-urim2g HTTP/1.1" 200 None
  1598. 21:50:09 2019-01-09 21:50:09,846 INFO [MainThread]: url https://heimdall-service.vnegi-test6.svc.cluster.local:9443/admin/nodes/ccs-command-channel-server-1-2-vnegi-test6 response {
  1599. 21:50:09 "message": "Success"
  1600. 21:50:09 }
  1601. 21:50:09 2019-01-09 21:50:09,847 INFO [MainThread]: find_and_parse_json: input = [{
  1602. 21:50:09 "message": "Success"
  1603. 21:50:09 }]
  1604. 21:50:09 2019-01-09 21:50:09,847 INFO [MainThread]: Node [id=ccs-command-channel-server-1-2-vnegi-test6] is deleted with Heimdall with message [Success]
  1605. 21:50:09 2019-01-09 21:50:09,853 INFO [MainThread]: Updating object: type Service name ccs-command-channel-server-svc
  1606. 21:50:09 2019-01-09 21:50:09,961 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "PATCH /api/v1/namespaces/vnegi-test6/services/ccs-command-channel-server-svc HTTP/1.1" 200 687
  1607. 21:50:09 2019-01-09 21:50:09,962 INFO [MainThread]: Successfully Deployed Service on k8s.
  1608. 21:50:09 ccs-command-channel-server-svc
  1609. 21:50:09 2019-01-09 21:50:09,962 INFO [MainThread]: ccs-command-channel-server unpausing Nodes of build 1-2-vnegi-test7 with Heimdall
  1610. 21:50:09 2019-01-09 21:50:09,963 INFO [MainThread]: Running in cluster: curlpod-p9cufl: ['curl', '--max-time', '120', '--silent', '-X', 'POST', '-H', 'content-type:application/json', '-d', '{"/common/persistence/feature/SystemFeatures::dropwizardMetrics":"true"}', 'http://ccs-command-channel-server-svc-1-2-vnegi-test7.vnegi-test6.svc.cluster.local:8000/upgrade/notify/activate']
  1611. 21:50:10 2019-01-09 21:50:10,068 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1608
  1612. 21:50:10 2019-01-09 21:50:10,070 INFO [MainThread]: Timing out at 2019-01-09 22:00:10.070813
  1613. 21:50:10 2019-01-09 21:50:10,176 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl HTTP/1.1" 200 None
  1614. 21:50:10 2019-01-09 21:50:10,178 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 22:00:10.070813].
  1615. 21:50:11 2019-01-09 21:50:11,281 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl HTTP/1.1" 200 None
  1616. 21:50:11 2019-01-09 21:50:11,283 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 22:00:10.070813].
  1617. 21:50:12 2019-01-09 21:50:12,385 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl HTTP/1.1" 200 None
  1618. 21:50:12 2019-01-09 21:50:12,387 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 22:00:10.070813].
  1619. 21:50:13 2019-01-09 21:50:13,489 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl HTTP/1.1" 200 None
  1620. 21:50:13 2019-01-09 21:50:13,597 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl/log HTTP/1.1" 200 72
  1621. 21:50:13 2019-01-09 21:50:13,598 DEBUG [MainThread]: Command output: curlpod-p9cufl(0) {"success":true,"delay":0,"message":"Enabled all features","context":{}}
  1622. 21:50:13 2019-01-09 21:50:13,705 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-p9cufl HTTP/1.1" 200 None
  1623. 21:50:13 2019-01-09 21:50:13,706 INFO [MainThread]: Got response during xenon unpause of service of build 1-2-vnegi-test7 : {"success":true,"delay":0,"message":"Enabled all features","context":{}}
  1624. 21:50:13 2019-01-09 21:50:13,706 INFO [MainThread]: Deleting K8S resources of service ccs-command-channel-server!
  1625. 21:50:13 2019-01-09 21:50:13,706 INFO [MainThread]: Deleting K8S resources of service ccs-command-channel-server!
  1626. 21:50:13 2019-01-09 21:50:13,816 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/services?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 1801
  1627. 21:50:13 2019-01-09 21:50:13,937 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/services/ccs-command-channel-server-svc-1-2-vnegi-test6 HTTP/1.1" 200 200
  1628. 21:50:14 2019-01-09 21:50:14,073 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/services/pccs-command-channel-server-svc-1-2-vnegi-test6 HTTP/1.1" 200 201
  1629. 21:50:14 2019-01-09 21:50:14,074 INFO [MainThread]: Finished deleting services
  1630. 21:50:14 2019-01-09 21:50:14,181 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 None
  1631. 21:50:14 2019-01-09 21:50:14,294 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /apis/apps/v1/namespaces/vnegi-test6/deployments/ccs-command-channel-server-deployment-1-2-vnegi-test6 HTTP/1.1" 200 225
  1632. 21:50:14 2019-01-09 21:50:14,399 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/extensions/v1beta1/namespaces/vnegi-test6/replicasets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 185
  1633. 21:50:14 2019-01-09 21:50:14,505 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/statefulsets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 165
  1634. 21:50:14 2019-01-09 21:50:14,615 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1beta1/namespaces/vnegi-test6/statefulsets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 175
  1635. 21:50:14 2019-01-09 21:50:14,722 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 None
  1636. 21:50:14 2019-01-09 21:50:14,831 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/ccs-command-channel-server-deployment-1-2-vnegi-test6-756bgs6cq HTTP/1.1" 200 None
  1637. 21:50:14 2019-01-09 21:50:14,936 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/secrets?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 144
  1638. 21:50:15 2019-01-09 21:50:15,040 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/storage.k8s.io/v1beta1/storageclasses?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 175
  1639. 21:50:15 2019-01-09 21:50:15,041 INFO [MainThread]: Deleting secret vnegi-test6.ccs-command-channel-server-awsconfig-1-2-vnegi-test6
  1640. 21:50:15 2019-01-09 21:50:15,144 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-awsconfig-1-2-vnegi-test6 HTTP/1.1" 200 1245
  1641. 21:50:15 2019-01-09 21:50:15,257 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-awsconfig-1-2-vnegi-test6 HTTP/1.1" 200 205
  1642. 21:50:15 2019-01-09 21:50:15,258 DEBUG [MainThread]: Deleted secret vnegi-test6.ccs-command-channel-server-awsconfig-1-2-vnegi-test6
  1643. 21:50:15 2019-01-09 21:50:15,258 INFO [MainThread]: Deleting secret vnegi-test6.ccs-command-channel-server-dbconfig-1-2-vnegi-test6
  1644. 21:50:15 2019-01-09 21:50:15,362 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-dbconfig-1-2-vnegi-test6 HTTP/1.1" 200 698
  1645. 21:50:15 2019-01-09 21:50:15,471 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-dbconfig-1-2-vnegi-test6 HTTP/1.1" 200 204
  1646. 21:50:15 2019-01-09 21:50:15,472 DEBUG [MainThread]: Deleted secret vnegi-test6.ccs-command-channel-server-dbconfig-1-2-vnegi-test6
  1647. 21:50:15 2019-01-09 21:50:15,472 INFO [MainThread]: Timing out at 2019-01-09 21:56:55.472289
  1648. 21:50:15 2019-01-09 21:50:15,472 INFO [MainThread]: Running in cluster: psqlpod-gghoa9: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT pid, pg_terminate_backend(pid) FROM pg_stat_activity WHERE pg_stat_activity.datname = 'ccscommandchannel-1-2-vnegi-test6';"]
  1649. 21:50:15 2019-01-09 21:50:15,579 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1589
  1650. 21:50:15 2019-01-09 21:50:15,580 INFO [MainThread]: Timing out at 2019-01-09 21:52:15.580316
  1651. 21:50:15 2019-01-09 21:50:15,683 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gghoa9 HTTP/1.1" 200 None
  1652. 21:50:15 2019-01-09 21:50:15,685 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:15.580316].
  1653. 21:50:16 2019-01-09 21:50:16,794 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gghoa9 HTTP/1.1" 200 None
  1654. 21:50:16 2019-01-09 21:50:16,795 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:15.580316].
  1655. 21:50:17 2019-01-09 21:50:17,900 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gghoa9 HTTP/1.1" 200 None
  1656. 21:50:18 2019-01-09 21:50:18,014 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-gghoa9/log HTTP/1.1" 200 1072
  1657. 21:50:18 2019-01-09 21:50:18,015 DEBUG [MainThread]: Command output: psqlpod-gghoa9(0) pid | pg_terminate_backend
  1658. 21:50:18 ------+----------------------
  1659. 21:50:18 4942 | t
  1660. 21:50:18 4943 | t
  1661. 21:50:18 4944 | t
  1662. 21:50:18 4945 | t
  1663. 21:50:18 4946 | t
  1664. 21:50:18 4947 | t
  1665. 21:50:18 4948 | t
  1666. 21:50:18 4949 | t
  1667. 21:50:18 4950 | t
  1668. 21:50:18 4951 | t
  1669. 21:50:18 4952 | t
  1670. 21:50:18 4953 | t
  1671. 21:50:18 4954 | t
  1672. 21:50:18 4955 | t
  1673. 21:50:18 4956 | t
  1674. 21:50:18 4957 | t
  1675. 21:50:18 4958 | t
  1676. 21:50:18 4959 | t
  1677. 21:50:18 4960 | t
  1678. 21:50:18 4961 | t
  1679. 21:50:18 4962 | t
  1680. 21:50:18 4963 | t
  1681. 21:50:18 4964 | t
  1682. 21:50:18 4965 | t
  1683. 21:50:18 4966 | t
  1684. 21:50:18 4967 | t
  1685. 21:50:18 4968 | t
  1686. 21:50:18 4969 | t
  1687. 21:50:18 4970 | t
  1688. 21:50:18 4971 | t
  1689. 21:50:18 4972 | t
  1690. 21:50:18 4973 | t
  1691. 21:50:18 4974 | t
  1692. 21:50:18 4975 | t
  1693. 21:50:18 4976 | t
  1694. 21:50:18 4977 | t
  1695. 21:50:18 4978 | t
  1696. 21:50:18 4979 | t
  1697. 21:50:18 4980 | t
  1698. 21:50:18 4981 | t
  1699. 21:50:18 4982 | t
  1700. 21:50:18 4983 | t
  1701. 21:50:18 4984 | t
  1702. 21:50:18 4985 | t
  1703. 21:50:18 4986 | t
  1704. 21:50:18 4987 | t
  1705. 21:50:18 4988 | t
  1706. 21:50:18 4989 | t
  1707. 21:50:18 4990 | t
  1708. 21:50:18 4991 | t
  1709. 21:50:18 4992 | t
  1710. 21:50:18 4993 | t
  1711. 21:50:18 4994 | t
  1712. 21:50:18 4995 | t
  1713. 21:50:18 4996 | t
  1714. 21:50:18 4997 | t
  1715. 21:50:18 4998 | t
  1716. 21:50:18 4999 | t
  1717. 21:50:18 5000 | t
  1718. 21:50:18 5001 | t
  1719. 21:50:18 5002 | t
  1720. 21:50:18 5003 | t
  1721. 21:50:18 5004 | t
  1722. 21:50:18 5005 | t
  1723. 21:50:18 5006 | t
  1724. 21:50:18 5007 | t
  1725. 21:50:18 5008 | t
  1726. 21:50:18 5009 | t
  1727. 21:50:18 5010 | t
  1728. 21:50:18 5011 | t
  1729. 21:50:18 5012 | t
  1730. 21:50:18 5013 | t
  1731. 21:50:18 5014 | t
  1732. 21:50:18 5015 | t
  1733. 21:50:18 5016 | t
  1734. 21:50:18 5017 | t
  1735. 21:50:18 5018 | t
  1736. 21:50:18 5019 | t
  1737. 21:50:18 5020 | t
  1738. 21:50:18 5021 | t
  1739. 21:50:18 5022 | t
  1740. 21:50:18 5023 | t
  1741. 21:50:18 5024 | t
  1742. 21:50:18 5025 | t
  1743. 21:50:18 5026 | t
  1744. 21:50:18 5027 | t
  1745. 21:50:18 5028 | t
  1746. 21:50:18 5029 | t
  1747. 21:50:18 5030 | t
  1748. 21:50:18 5031 | t
  1749. 21:50:18 5032 | t
  1750. 21:50:18 5033 | t
  1751. 21:50:18 5034 | t
  1752. 21:50:18 5035 | t
  1753. 21:50:18 5036 | t
  1754. 21:50:18 5037 | t
  1755. 21:50:18 5038 | t
  1756. 21:50:18 5039 | t
  1757. 21:50:18 5040 | t
  1758. 21:50:18 5041 | t
  1759. 21:50:18 (100 rows)
  1760. 21:50:18
  1761. 21:50:18
  1762. 21:50:18 2019-01-09 21:50:18,129 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-gghoa9 HTTP/1.1" 200 None
  1763. 21:50:18 2019-01-09 21:50:18,130 INFO [MainThread]: Running in cluster: psqlpod-rytlab: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', 'DROP DATABASE IF EXISTS "ccscommandchannel-1-2-vnegi-test6"']
  1764. 21:50:18 2019-01-09 21:50:18,237 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1521
  1765. 21:50:18 2019-01-09 21:50:18,239 INFO [MainThread]: Timing out at 2019-01-09 21:52:18.239104
  1766. 21:50:18 2019-01-09 21:50:18,342 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1767. 21:50:18 2019-01-09 21:50:18,344 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1768. 21:50:19 2019-01-09 21:50:19,450 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1769. 21:50:19 2019-01-09 21:50:19,452 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1770. 21:50:20 2019-01-09 21:50:20,560 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1771. 21:50:20 2019-01-09 21:50:20,562 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1772. 21:50:21 2019-01-09 21:50:21,667 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1773. 21:50:21 2019-01-09 21:50:21,668 DEBUG [MainThread]: [func=pod_complete]: [attempt=4] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1774. 21:50:22 2019-01-09 21:50:22,776 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1775. 21:50:22 2019-01-09 21:50:22,778 DEBUG [MainThread]: [func=pod_complete]: [attempt=5] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1776. 21:50:23 2019-01-09 21:50:23,884 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1777. 21:50:23 2019-01-09 21:50:23,886 DEBUG [MainThread]: [func=pod_complete]: [attempt=6] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1778. 21:50:24 2019-01-09 21:50:24,996 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1779. 21:50:24 2019-01-09 21:50:24,997 DEBUG [MainThread]: [func=pod_complete]: [attempt=7] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:18.239104].
  1780. 21:50:26 2019-01-09 21:50:26,103 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1781. 21:50:26 2019-01-09 21:50:26,215 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab/log HTTP/1.1" 200 144
  1782. 21:50:26 2019-01-09 21:50:26,216 ERROR [MainThread]: Failed command in cluster: psqlpod-rytlab(1), 'ERROR: database "ccscommandchannel-1-2-vnegi-test6" is being accessed by other users\nDETAIL: There are 100 other sessions using the database.\n'
  1783. 21:50:26 2019-01-09 21:50:26,328 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-rytlab HTTP/1.1" 200 None
  1784. 21:50:26 /var/jenkins/workspace/test-deploy-scripts-vnegi/symphony-infra/src/vmware.symphony.deploy/vmware_symphony_deploy/deployments/dependency/persistence/db_utils.py:43: DeprecationWarning: The 'warn' function is deprecated, use 'warning' instead
  1785. 21:50:26 logging.warn("Unable to delete database %s", target_db)
  1786. 21:50:26 2019-01-09 21:50:26,329 WARNING [MainThread]: Unable to delete database ccscommandchannel-1-2-vnegi-test6
  1787. 21:50:26 2019-01-09 21:50:26,330 DEBUG [MainThread]: [func=<lambda>]: [attempt=1] returned False. Retrying in 20 seconds [timeout_at=2019-01-09 21:56:55.472289].
  1788. 21:50:46 2019-01-09 21:50:46,350 INFO [MainThread]: Running in cluster: psqlpod-7l02pl: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT pid, pg_terminate_backend(pid) FROM pg_stat_activity WHERE pg_stat_activity.datname = 'ccscommandchannel-1-2-vnegi-test6';"]
  1789. 21:50:46 2019-01-09 21:50:46,459 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1589
  1790. 21:50:46 2019-01-09 21:50:46,460 INFO [MainThread]: Timing out at 2019-01-09 21:52:46.460607
  1791. 21:50:46 2019-01-09 21:50:46,564 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-7l02pl HTTP/1.1" 200 None
  1792. 21:50:46 2019-01-09 21:50:46,565 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:46.460607].
  1793. 21:50:47 2019-01-09 21:50:47,670 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-7l02pl HTTP/1.1" 200 None
  1794. 21:50:47 2019-01-09 21:50:47,672 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:46.460607].
  1795. 21:50:48 2019-01-09 21:50:48,778 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-7l02pl HTTP/1.1" 200 None
  1796. 21:50:48 2019-01-09 21:50:48,895 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-7l02pl/log HTTP/1.1" 200 68
  1797. 21:50:48 2019-01-09 21:50:48,895 DEBUG [MainThread]: Command output: psqlpod-7l02pl(0) pid | pg_terminate_backend
  1798. 21:50:48 -----+----------------------
  1799. 21:50:48 (0 rows)
  1800. 21:50:48
  1801. 21:50:48
  1802. 21:50:49 2019-01-09 21:50:49,007 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-7l02pl HTTP/1.1" 200 None
  1803. 21:50:49 2019-01-09 21:50:49,008 INFO [MainThread]: Running in cluster: psqlpod-uzmrmu: ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', 'DROP DATABASE IF EXISTS "ccscommandchannel-1-2-vnegi-test6"']
  1804. 21:50:49 2019-01-09 21:50:49,115 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 1521
  1805. 21:50:49 2019-01-09 21:50:49,117 INFO [MainThread]: Timing out at 2019-01-09 21:52:49.117536
  1806. 21:50:49 2019-01-09 21:50:49,226 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu HTTP/1.1" 200 None
  1807. 21:50:49 2019-01-09 21:50:49,227 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:49.117536].
  1808. 21:50:50 2019-01-09 21:50:50,334 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu HTTP/1.1" 200 None
  1809. 21:50:50 2019-01-09 21:50:50,337 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:49.117536].
  1810. 21:50:51 2019-01-09 21:50:51,442 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu HTTP/1.1" 200 None
  1811. 21:50:51 2019-01-09 21:50:51,445 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:49.117536].
  1812. 21:50:52 2019-01-09 21:50:52,549 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu HTTP/1.1" 200 None
  1813. 21:50:52 2019-01-09 21:50:52,660 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu/log HTTP/1.1" 200 14
  1814. 21:50:52 2019-01-09 21:50:52,661 DEBUG [MainThread]: Command output: psqlpod-uzmrmu(0) DROP DATABASE
  1815. 21:50:52
  1816. 21:50:52 2019-01-09 21:50:52,779 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/psqlpod-uzmrmu HTTP/1.1" 200 None
  1817. 21:50:52 2019-01-09 21:50:52,780 INFO [MainThread]: deleted database ccscommandchannel-1-2-vnegi-test6
  1818. 21:50:52 2019-01-09 21:50:52,780 INFO [MainThread]: Deleting secret vnegi-test6.ccs-command-channel-server-cspconfig-1-2-vnegi-test6
  1819. 21:50:52 2019-01-09 21:50:52,886 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-cspconfig-1-2-vnegi-test6 HTTP/1.1" 200 889
  1820. 21:50:52 2019-01-09 21:50:52,994 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/secrets/ccs-command-channel-server-cspconfig-1-2-vnegi-test6 HTTP/1.1" 200 205
  1821. 21:50:52 2019-01-09 21:50:52,994 DEBUG [MainThread]: Deleted secret vnegi-test6.ccs-command-channel-server-cspconfig-1-2-vnegi-test6
  1822. 21:50:52 2019-01-09 21:50:52,994 INFO [MainThread]: Finished deleting [image_tag=1-2-vnegi-test6] deployments.
  1823. 21:50:53 2019-01-09 21:50:53,098 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/persistentvolumeclaims?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test6 HTTP/1.1" 200 174
  1824. 21:50:53 2019-01-09 21:50:53,099 INFO [MainThread]: Authenticating with CSP [uri=http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize] as client_credentials [user=stargate-automation]
  1825. 21:50:53 2019-01-09 21:50:53,100 INFO [MainThread]: Waiting for Requesting ('http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com/csp/gateway/am/api/auth/authorize',) {'data': 'grant_type=client_credentials', 'headers': {'Content-Type': 'application/x-www-form-urlencoded'}, 'auth': <requests.auth.HTTPBasicAuth object at 0x7ff5c0211f98>}: attempt [1]
  1826. 21:50:53 2019-01-09 21:50:53,104 DEBUG [MainThread]: Starting new HTTP connection (1): a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com
  1827. 21:50:53 2019-01-09 21:50:53,351 DEBUG [MainThread]: http://a177df6e2142a11e9905212ac25d70fa-1963228917.us-east-1.elb.amazonaws.com:80 "POST /csp/gateway/am/api/auth/authorize HTTP/1.1" 200 669
  1828. 21:50:53 2019-01-09 21:50:53,353 INFO [MainThread]: app_labels : {'app': 'ccs-command-channel-server', 'build': '1-2-vnegi-test7'}
  1829. 21:50:53 2019-01-09 21:50:53,353 INFO [MainThread]: Timing out at 2019-01-09 22:00:53.353311
  1830. 21:50:53 2019-01-09 21:50:53,353 INFO [MainThread]: Starting [app=ccs-command-channel-server] Healthcheck [build=1-2-vnegi-test7]
  1831. 21:50:53 2019-01-09 21:50:53,456 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  1832. 21:50:53 2019-01-09 21:50:53,562 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /apis/apps/v1/namespaces/vnegi-test6/deployments?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7 HTTP/1.1" 200 None
  1833. 21:50:53 2019-01-09 21:50:53,668 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1834. 21:50:53 2019-01-09 21:50:53,671 INFO [MainThread]: [app=ccs-command-channel-server] pods. [expected=1] [actual=1]
  1835. 21:50:53 2019-01-09 21:50:53,671 DEBUG [MainThread]: Default nodegroup curl = ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEyNTMsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTk0NTMsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.Cqx-Vb6M1JKNbmRjTe27l6C8-MfW25IImbcn1-QRyvyuzvL3z-KcpZTnipUEW4CoR0cfxk76T2jzPaDvdQbeZ6IGukF-TMNoGR7AszVNn3AiP0XQLaEuq2G2ZXFsU8iF5jAc-kBy7UGRsVLgCTRjeDDh6hSOVF4lAVv1jUmR91CjsJDzACPHzJr3VNY8PARTjttLVG-x9p_tb4Eb0HhrUx0SmFcfCyIjtpTSvce6fj73xByCsjt_D6hyUHy_Iy7uX_0aE9M2e8_uHC2aYLhl45B0UbPbL1X9MjAoSktffmg4ofZ5Crr_tRNx01WCCOQ-7tB6t5FQYSjKrruH9el_EA', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1836. 21:50:53 2019-01-09 21:50:53,672 INFO [MainThread]: Running in cluster: curlpod-0otdrp: ['curl', '--max-time', '15', '--silent', '-H', 'Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI6c3RhcmdhdGUtYXV0b21hdGlvbiIsImF6cCI6InN0YXJnYXRlLWF1dG9tYXRpb24iLCJpc3MiOiJjc3AiLCJleHAiOjE1NDcxMDEyNTMsInBybiI6InN0YXJnYXRlLWF1dG9tYXRpb25AY3NwLWRlZmF1bHQiLCJpYXQiOjE1NDcwOTk0NTMsImNpZCI6InN0YXJnYXRlLWF1dG9tYXRpb24ifQ.Cqx-Vb6M1JKNbmRjTe27l6C8-MfW25IImbcn1-QRyvyuzvL3z-KcpZTnipUEW4CoR0cfxk76T2jzPaDvdQbeZ6IGukF-TMNoGR7AszVNn3AiP0XQLaEuq2G2ZXFsU8iF5jAc-kBy7UGRsVLgCTRjeDDh6hSOVF4lAVv1jUmR91CjsJDzACPHzJr3VNY8PARTjttLVG-x9p_tb4Eb0HhrUx0SmFcfCyIjtpTSvce6fj73xByCsjt_D6hyUHy_Iy7uX_0aE9M2e8_uHC2aYLhl45B0UbPbL1X9MjAoSktffmg4ofZ5Crr_tRNx01WCCOQ-7tB6t5FQYSjKrruH9el_EA', '', 'http://172.20.42.147:8000/core/node-groups/default']
  1837. 21:50:53 2019-01-09 21:50:53,779 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "POST /api/v1/namespaces/vnegi-test6/pods HTTP/1.1" 201 None
  1838. 21:50:53 2019-01-09 21:50:53,781 INFO [MainThread]: Timing out at 2019-01-09 21:52:53.781177
  1839. 21:50:53 2019-01-09 21:50:53,882 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp HTTP/1.1" 200 None
  1840. 21:50:53 2019-01-09 21:50:53,883 DEBUG [MainThread]: [func=pod_complete]: [attempt=1] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:53.781177].
  1841. 21:50:54 2019-01-09 21:50:54,986 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp HTTP/1.1" 200 None
  1842. 21:50:54 2019-01-09 21:50:54,987 DEBUG [MainThread]: [func=pod_complete]: [attempt=2] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:53.781177].
  1843. 21:50:56 2019-01-09 21:50:56,090 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp HTTP/1.1" 200 None
  1844. 21:50:56 2019-01-09 21:50:56,092 DEBUG [MainThread]: [func=pod_complete]: [attempt=3] returned False. Retrying in 1 seconds [timeout_at=2019-01-09 21:52:53.781177].
  1845. 21:50:57 2019-01-09 21:50:57,195 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp HTTP/1.1" 200 None
  1846. 21:50:57 2019-01-09 21:50:57,305 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp/log HTTP/1.1" 200 1109
  1847. 21:50:57 2019-01-09 21:50:57,306 DEBUG [MainThread]: Command output: curlpod-0otdrp(0) {"config":{"nodeRemovalDelayMicros":300000000,"stableGroupMaintenanceIntervalCount":5,"peerRequestTimeoutMicros":20000000},"nodes":{"6d6c86f5-bf21-4c53-87f9-43793697ab0b":{"groupReference":"http://172.20.42.147:8000/core/node-groups/default","status":"AVAILABLE","options":["PEER"],"id":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","membershipQuorum":1,"locationQuorum":1,"documentVersion":1,"documentKind":"com:vmware:xenon:services:common:NodeState","documentSelfLink":"/core/node-groups/default/6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentUpdateTimeMicros":1547099292351001,"documentExpirationTimeMicros":0}},"lastChanges":["PEER_STATUS_CHANGE"],"membershipUpdateTimeMicros":1547099292351001,"localMembershipUpdateTimeMicros":1547099292351001,"documentVersion":2,"documentKind":"com:vmware:xenon:services:common:NodeGroupService:NodeGroupState","documentSelfLink":"/core/node-groups/default","documentUpdateTimeMicros":1547099292355000,"documentUpdateAction":"PATCH","documentExpirationTimeMicros":0,"documentOwner":"6d6c86f5-bf21-4c53-87f9-43793697ab0b","documentAuthPrincipalLink":"/core/authz/system-user"}
  1848. 21:50:57 2019-01-09 21:50:57,415 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "DELETE /api/v1/namespaces/vnegi-test6/pods/curlpod-0otdrp HTTP/1.1" 200 None
  1849. 21:50:57 2019-01-09 21:50:57,416 INFO [MainThread]: [app=ccs-command-channel-server] node-group is healthy
  1850. 21:50:57 2019-01-09 21:50:57,524 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods?labelSelector=app%3Dccs-command-channel-server%2Cbuild%3D1-2-vnegi-test7&fieldSelector=status.phase%3DRunning HTTP/1.1" 200 None
  1851. 21:50:57 2019-01-09 21:50:57,637 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/ccs-command-channel-server-deployment-1-2-vnegi-test7-78f4t9v6q/log?container=ccs-command-server&timestamps=true HTTP/1.1" 200 None
  1852. 21:50:58 2019-01-09 21:50:58,025 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/ccs-command-channel-server-deployment-1-2-vnegi-test7-78f4t9v6q/log?container=wavefront-reporter&timestamps=true HTTP/1.1" 200 None
  1853. 21:50:58 2019-01-09 21:50:58,128 DEBUG [MainThread]: https://api-sym-selfserve-k8s-loc-2ck3cp-1455007622.us-east-1.elb.amazonaws.com:443 "GET /api/v1/namespaces/vnegi-test6/pods/ccs-command-channel-server-deployment-1-2-vnegi-test7-78f4t9v6q HTTP/1.1" 200 None
  1854. 21:50:58 2019-01-09 21:50:58,131 INFO [MainThread]: Collecting description of [pod=ccs-command-channel-server-deployment-1-2-vnegi-test7-78f4t9v6q] to [file=ccs-command-channel-server-deployment-1-2-vnegi-test7-78f4t9v6q.pod_desc]
  1855. 21:50:58 ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT pid, pg_terminate_backend(pid) FROM pg_stat_activity WHERE pg_stat_activity.datname = 'ccscommandchannel-1-2-vnegi-test6';"]
  1856. 21:50:58 ['psql', '-h', 'postgres.vnegi-test6.svc.cluster.local', '-U', 'postgres', '-p', '5432', '-c', "SELECT pid, pg_terminate_backend(pid) FROM pg_stat_activity WHERE pg_stat_activity.datname = 'ccscommandchannel-1-2-vnegi-test6';"]
  1857. 21:50:58 Finished: SUCCESS
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement