API tools faq
paste
Guest User

Untitled

a guest
Aug 28th, 2015
200
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.53 KB | None | 0 0
raw download clone embed print report
  1. Started by user jixu
  2. Building remotely on worker (base) in workspace /home/worker/workspace/news-recommender-deploy-prod
  3.  
  4. Deleting project workspace... done
  5.  
  6. Cloning the remote Git repository
  7. Cloning repository https://git.yidian-inc.com:8021/qa/ci.git
  8. > /usr/local/git/bin/git init /home/worker/workspace/news-recommender-deploy-prod # timeout=10
  9. Fetching upstream changes from https://git.yidian-inc.com:8021/qa/ci.git
  10. > /usr/local/git/bin/git --version # timeout=10
  11. using .gitcredentials to set credentials
  12. > /usr/local/git/bin/git config --local credential.helper store --file=/tmp/git8445591272681436484.credentials # timeout=10
  13. > /usr/local/git/bin/git -c core.askpass=true fetch --tags --progress https://git.yidian-inc.com:8021/qa/ci.git +refs/heads/*:refs/remotes/origin/*
  14. > /usr/local/git/bin/git config --local --remove-section credential # timeout=10
  15. > /usr/local/git/bin/git config remote.origin.url https://git.yidian-inc.com:8021/qa/ci.git # timeout=10
  16. > /usr/local/git/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
  17. > /usr/local/git/bin/git config remote.origin.url https://git.yidian-inc.com:8021/qa/ci.git # timeout=10
  18. Fetching upstream changes from https://git.yidian-inc.com:8021/qa/ci.git
  19. using .gitcredentials to set credentials
  20. > /usr/local/git/bin/git config --local credential.helper store --file=/tmp/git8047918048392612058.credentials # timeout=10
  21. > /usr/local/git/bin/git -c core.askpass=true fetch --tags --progress https://git.yidian-inc.com:8021/qa/ci.git +refs/heads/*:refs/remotes/origin/*
  22. > /usr/local/git/bin/git config --local --remove-section credential # timeout=10
  23. > /usr/local/git/bin/git rev-parse refs/remotes/origin/master^{commit} # timeout=10
  24. > /usr/local/git/bin/git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
  25. Checking out Revision 355a357d79377e073d10dc77ac109921db62963a (refs/remotes/origin/master)
  26. > /usr/local/git/bin/git config core.sparsecheckout # timeout=10
  27. > /usr/local/git/bin/git checkout -f 355a357d79377e073d10dc77ac109921db62963a
  28. > /usr/local/git/bin/git rev-list 355a357d79377e073d10dc77ac109921db62963a # timeout=10
  29. [news-recommender-deploy-prod] $ /bin/sh -xe /tmp/hudson4375160133093694620.sh
  30. + echo news-recommender-commit
  31. news-recommender-commit
  32. + echo 231
  33. 231
  34. + echo 10.101.1.13:8017
  35. 10.101.1.13:8017
  36. + '[' 10.101.1.13:8017X = X ']'
  37. + echo 10.101.1.13:8017
  38. 10.101.1.13:8017
  39. ++ echo 10.101.1.13:8017
  40. ++ sed 's/;/; /g'
  41. + tmp_release_machines=10.101.1.13:8017
  42. + echo '[DESC] <a href=http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231/>231</a> (10.101.1.13:8017)'
  43. [DESC] <a href=http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231/>231</a> (10.101.1.13:8017)
  44. + echo parallel=4
  45. + cp ./scripts/Makefile.common Makefile
  46. + cp ./scripts/docker_deploy_env.sh ./docker_deploy_env.sh
  47. + export env_name=prod
  48. + env_name=prod
  49. + export '[email protected] [email protected]'
  50. + receiver='[email protected] [email protected]'
  51. + make docker_deploy_prod
  52. echo $release_number
  53. 231
  54. echo $release_job
  55. news-recommender-commit
  56. + '[' 5 '!=' 4 ']'
  57. + '[' 5 '!=' 3 ']'
  58. + '[' 5 '!=' 5 ']'
  59. + release_job=news-recommender-commit
  60. + release_number=231
  61. + env_name=prod
  62. + release_machines=10.101.1.13:8017
  63. + start_cmd='sh deploy.sh nrexp'
  64. + '[' '[email protected] [email protected]' = X ']'
  65. + '[' Xnews-recommender-commit '!=' Xcrawler-pipeline-commit ']'
  66. + mail -s 'news-recommender-commit is being deployed' -c '[email protected] [email protected]' [email protected]
  67. ++ echo news-recommender-commit
  68. ++ sed -e s/-commit/-deploy-prod/g
  69. + echo 'Attention Please
  70.  
  71. http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231 is being deployed to
  72. [10.101.1.13:8017]
  73.  
  74. Click http://jenkins.yidian-inc.com:8030/job/news-recommender-deploy-prod to view progress'
  75. + '[' Xnews-recommender-commit = Xblender-commit ']'
  76. + '[' Xnews-recommender-commit = Xsearcher-commit ']'
  77. + '[' Xnews-recommender-commit = Xnews-recommender-commit ']'
  78. + component=news-recommender
  79. + src_log=/home/services/docker_home/_logs/news-recommender
  80. + dst_log=/home/services/NewsRecommender/logs
  81. + container_name=news-recommender
  82. + image_name=docker2.yidian.com:5000/publish/news-recommender-231-image-prod
  83. + '[' Xnews-recommender = Xzion-proxy ']'
  84. + '[' Xnews-recommender = Xzion-controller ']'
  85. + '[' Xnews-recommender = Xzion-ssdb-rocks ']'
  86. + mkdir -p ./news-recommender/machines
  87. + machine_file=./news-recommender/machines/prod
  88. + rm -f ./news-recommender/machines/prod
  89. + '[' X10.101.1.13:8017 '!=' X ']'
  90. + echo 10.101.1.13:8017
  91. + sed 's/;/\n/g'
  92. + '[' '!' -f ./news-recommender/machines/prod ']'
  93. + '[' -f parallel.file ']'
  94. ++ grep parallel= parallel.file
  95. ++ head -1
  96. ++ awk -F= '{print $2}'
  97. + parallel=4
  98. + checkInt 4
  99. + expr 4 + 0
  100. + '[' 0 -ne 0 ']'
  101. + return 0
  102. + checkIntRet=0
  103. + '[' 0 '!=' 0 ']'
  104. + '[' 4 -ge 8 ']'
  105. + echo 'Deploy parallel number:4'
  106. Deploy parallel number:4
  107. ++ cat ./news-recommender/machines/prod
  108. ++ grep -v '^#'
  109. ++ awk -F: '{print $1}'
  110. + hosts=10.101.1.13
  111. + protect_overflow_machines 10.101.1.13 4
  112. + declare -A local router_list
  113. + for host in '$1'
  114. ++ cat ./news-recommender/machines/prod
  115. ++ grep -v '^#'
  116. ++ grep 10.101.1.13:
  117. ++ awk -F: '{print $2}'
  118. + container_port=8017
  119. ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_router_by_innerip&innerIp=10.101.1.13:8017'
  120. ++ grep yidian/prod/serving/
  121. ++ head -1
  122. ++ awk -F yidian/prod/serving/ '{print $2}'
  123. ++ sed 's/"//g'
  124. % Total % Received % Xferd Average Speed Time Time Time Current
  125. Dload Upload Total Spent Left Speed
  126.  
  127. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  128. 112 112 112 112 0 0 5340 0 --:--:-- --:--:-- --:--:-- 5600
  129. 112 112 112 112 0 0 5324 0 --:--:-- --:--:-- --:--:-- 5600
  130. + tmp_machine_router=news-recommender
  131. + router_list[$tmp_machine_router]=1
  132. + echo 'Process router list: news-recommender'
  133. Process router list: news-recommender
  134. + for key in '${!router_list[@]}'
  135. ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_namespace_id_by_router&router=yidian/prod/serving/news-recommender'
  136. ++ grep 'namespaceId":'
  137. ++ awk -F 'namespaceId":' '{print $2}'
  138. ++ sed 's/[" ]//g'
  139. % Total % Received % Xferd Average Speed Time Time Time Current
  140. Dload Upload Total Spent Left Speed
  141.  
  142. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  143. 0 66 0 66 0 0 4228 0 --:--:-- --:--:-- --:--:-- 4714
  144. + local namespace=52
  145. ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_machines_by_namespace&namespace=52'
  146. ++ grep inner_ip -c
  147. % Total % Received % Xferd Average Speed Time Time Time Current
  148. Dload Upload Total Spent Left Speed
  149.  
  150. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  151. 100 11041 100 11041 0 0 1068k 0 --:--:-- --:--:-- --:--:-- 1347k
  152. + local t_machines_by_namespace=30
  153. ++ expr 30 / 3
  154. + least_machines_by_namespace=10
  155. + '[' 10 -lt 1 ']'
  156. + '[' 10 -lt 4 ']'
  157. + echo 'PASS! Parallel 4 is proper ( <= 1/3 total news-recommender service machines[10])'
  158. PASS! Parallel 4 is proper ( <= 1/3 total news-recommender service machines[10])
  159. + deploy_and_check 10.101.1.13 4
  160. + hosts=($1)
  161. + parallel=4
  162. + remainder=1
  163. + checkInt 1
  164. + expr 1 + 0
  165. + '[' 0 -ne 0 ']'
  166. + return 0
  167. + checkIntRet=0
  168. + '[' X0 '!=' X0 ']'
  169. + host_index=0
  170. + true
  171. + echo 'Begin to process. There is 1 machines to be deployed'
  172. Begin to process. There is 1 machines to be deployed
  173. + '[' 1 -le 0 ']'
  174. ++ expr 1 - 4
  175. + '[' -3 -lt 0 ']'
  176. + '[' 0 -lt 1 ']'
  177. + host=10.101.1.13
  178. ++ cat ./news-recommender/machines/prod
  179. ++ grep -v '^#'
  180. ++ grep 10.101.1.13:
  181. ++ awk -F: '{print $2}'
  182. + container_port=8017
  183. ++ expr 0 + 1
  184. + host_index=1
  185. + echo 'Deploy 10.101.1.13:8017'
  186. Deploy 10.101.1.13:8017
  187. + deploy_script 10.101.1.13 8017
  188. + echo Enter deploy_script
  189. Enter deploy_script
  190. + '[' Xnews-recommender-commit = Xchannel-serving-commit ']'
  191. + '[' Xnews-recommender-commit = Xblender-commit ']'
  192. + '[' Xnews-recommender-commit = Xadserver-commit ']'
  193. + '[' Xnews-recommender-commit = Xnews-recommender-commit ']'
  194. + haproxy_disable 10.101.1.13 8017
  195. + echo 'Begin disable haproxy 10.101.1.13:8017'
  196. Begin disable haproxy 10.101.1.13:8017
  197. ++ get_machine_router 10.101.1.13 8017
  198. +++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_router_by_innerip&innerIp=10.101.1.13:8017'
  199. +++ grep yidian/prod/serving/
  200. +++ head -1
  201. +++ awk -F yidian/prod/serving/ '{print $2}'
  202. +++ sed 's/"//g'
  203. % Total % Received % Xferd Average Speed Time Time Time Current
  204. Dload Upload Total Spent Left Speed
  205.  
  206. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
  207. 112 112 112 112 0 0 6041 0 --:--:-- --:--:-- --:--:-- 6588
  208. ++ tmp_machine_router=news-recommender
  209. ++ echo news-recommender
  210. + machine_router=news-recommender
  211. + '[' -z news-recommender ']'
  212. ++ get_base_haproxy_url news-recommender
  213. ++ machine_router=news-recommender
  214. ++ '[' Xnews-recommender = Xnews-recommender ']'
  215. ++ echo http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers
  216. + base_url=http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers
  217. + '[' -z http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers ']'
  218. ++ curl -l -H 'Content-type: application/json' -X POST -d '{"maint":["10.101.1.13:8017"]}' http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers/stat/set
  219. % Total % Received % Xferd Average Speed Time Time Time Current
  220. Dload Upload Total Spent Left Speed
  221.  
  222. 0 0 0 0 0 30 0 136k --:--:-- --:--:-- --:--:-- 136k
  223. 0 0 0 0 0 30 0 29 --:--:-- 0:00:01 --:--:-- 0
  224. 0 0 0 0 0 30 0 14 --:--:-- 0:00:02 --:--:-- 0
  225. 0 2 0 2 0 30 0 14 --:--:-- 0:00:02 --:--:-- 0
  226. + result=OK
  227. + '[' XOK '!=' XOK ']'
  228. + echo 'Disable api success'
  229. Disable api success
  230. + echo 'End disable haproxy 10.101.1.13:8017'
  231. End disable haproxy 10.101.1.13:8017
  232. + ssh [email protected] 'mkdir -p ~/docker_home'
  233. + scp ./scripts/restart_container.sh '[email protected]:~/docker_home'
  234. + '[' 1 -lt 1 ']'
  235. + wait
  236. + nohup ssh [email protected] 'cd ~/docker_home; sh restart_container.sh docker2.yidian.com:5000/publish/news-recommender-231-image-prod news-recommender 8017 /home/services/docker_home/_logs/news-recommender /home/services/NewsRecommender/logs "sh deploy.sh nrexp"'
  237. latest: Pulling from docker2.yidian.com:5000/publish/news-recommender-231-image-prod
  238. 63a9c680256f: Already exists
  239. 6bb749570a3e: Already exists
  240. 4300c6af5f62: Already exists
  241. 6cd11d47ee2a: Already exists
  242. 5416ccb4a816: Already exists
  243. f4dcee328fa1: Already exists
  244. 65332ef137d4: Already exists
  245. 2f83561557ea: Already exists
  246. fc3860780eef: Already exists
  247. d7f33762d9ee: Already exists
  248. fc90ee827c40: Already exists
  249. b5a4f6dcf74b: Already exists
  250. 266f28b8a27e: Already exists
  251. 97ac34fd5e3b: Already exists
  252. 2ac1f0c019db: Already exists
  253. 5d8a45290460: Already exists
  254. fc78c9cb384c: Already exists
  255. 913170bc56a8: Already exists
  256. 617722410ea0: Already exists
  257. b170b9ba1629: Already exists
  258. 3856c2300ebe: Already exists
  259. 4226729dce8c: Already exists
  260. c8ec1031aedb: Already exists
  261. 42672f6edcdf: Already exists
  262. 07f4e2b93490: Already exists
  263. bb07b0a26e31: Already exists
  264. b2690954be4d: Already exists
  265. 3547b2870c74: Already exists
  266. 3bdc2bd6c9eb: Already exists
  267. 7448e1c33c84: Already exists
  268. 5acdec41b6b2: Already exists
  269. daaa8eb0ecb6: Already exists
  270. 2e1a46a6beba: Already exists
  271. 95b241d8ceb3: Already exists
  272. 95b241d8ceb3: Already exists
  273. Digest: sha256:d2216772aa4956010ad46be0c24ee17cd9853ea9517cdddc8b03750845963e0d
  274. Status: Image is up to date for docker2.yidian.com:5000/publish/news-recommender-231-image-prod:latest
  275. news-recommender
  276. news-recommender
  277. Sleep for start up...
  278. Run container [19b5876d2113a4425aefacb4c5efcbcd561e1a5ae2722391671056c002e4eae1] -> [news-recommender]
  279. wait done...
  280. not finished yet... check /home/services/docker_home/_logs/news-recommender/warmup.done
  281. 101-1-13-lg-201-i01.yidian.com used 10 seconds...
  282. 101-1-13-lg-201-i01.yidian.com used 20 seconds...
  283. 101-1-13-lg-201-i01.yidian.com used 30 seconds...
  284. 101-1-13-lg-201-i01.yidian.com used 40 seconds...
  285. 101-1-13-lg-201-i01.yidian.com used 50 seconds...
  286. 101-1-13-lg-201-i01.yidian.com used 60 seconds...
  287. 101-1-13-lg-201-i01.yidian.com used 70 seconds...
  288. 101-1-13-lg-201-i01.yidian.com used 80 seconds...
  289. 101-1-13-lg-201-i01.yidian.com used 90 seconds...
  290. 101-1-13-lg-201-i01.yidian.com used 100 seconds...
  291. 101-1-13-lg-201-i01.yidian.com used 110 seconds...
  292. 101-1-13-lg-201-i01.yidian.com used 120 seconds...
  293. 101-1-13-lg-201-i01.yidian.com used 130 seconds...
  294. 101-1-13-lg-201-i01.yidian.com used 140 seconds...
  295. 101-1-13-lg-201-i01.yidian.com used 150 seconds...
  296. 101-1-13-lg-201-i01.yidian.com used 160 seconds...
  297. 101-1-13-lg-201-i01.yidian.com used 170 seconds...
  298. 101-1-13-lg-201-i01.yidian.com used 180 seconds...
  299. 101-1-13-lg-201-i01.yidian.com used 190 seconds...
  300. 101-1-13-lg-201-i01.yidian.com used 200 seconds...
  301. 101-1-13-lg-201-i01.yidian.com used 210 seconds...
  302. 101-1-13-lg-201-i01.yidian.com used 220 seconds...
  303. 101-1-13-lg-201-i01.yidian.com used 230 seconds...
  304. 101-1-13-lg-201-i01.yidian.com used 240 seconds...
  305. Build was aborted
  306. Aborted by jixu
  307. [description-setter] Description set:
  308. Finished: ABORTED
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!