Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Started by user jixu
- Building remotely on worker (base) in workspace /home/worker/workspace/news-recommender-deploy-prod
- Deleting project workspace... done
- Cloning the remote Git repository
- Cloning repository https://git.yidian-inc.com:8021/qa/ci.git
- > /usr/local/git/bin/git init /home/worker/workspace/news-recommender-deploy-prod # timeout=10
- Fetching upstream changes from https://git.yidian-inc.com:8021/qa/ci.git
- > /usr/local/git/bin/git --version # timeout=10
- using .gitcredentials to set credentials
- > /usr/local/git/bin/git config --local credential.helper store --file=/tmp/git8445591272681436484.credentials # timeout=10
- > /usr/local/git/bin/git -c core.askpass=true fetch --tags --progress https://git.yidian-inc.com:8021/qa/ci.git +refs/heads/*:refs/remotes/origin/*
- > /usr/local/git/bin/git config --local --remove-section credential # timeout=10
- > /usr/local/git/bin/git config remote.origin.url https://git.yidian-inc.com:8021/qa/ci.git # timeout=10
- > /usr/local/git/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
- > /usr/local/git/bin/git config remote.origin.url https://git.yidian-inc.com:8021/qa/ci.git # timeout=10
- Fetching upstream changes from https://git.yidian-inc.com:8021/qa/ci.git
- using .gitcredentials to set credentials
- > /usr/local/git/bin/git config --local credential.helper store --file=/tmp/git8047918048392612058.credentials # timeout=10
- > /usr/local/git/bin/git -c core.askpass=true fetch --tags --progress https://git.yidian-inc.com:8021/qa/ci.git +refs/heads/*:refs/remotes/origin/*
- > /usr/local/git/bin/git config --local --remove-section credential # timeout=10
- > /usr/local/git/bin/git rev-parse refs/remotes/origin/master^{commit} # timeout=10
- > /usr/local/git/bin/git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
- Checking out Revision 355a357d79377e073d10dc77ac109921db62963a (refs/remotes/origin/master)
- > /usr/local/git/bin/git config core.sparsecheckout # timeout=10
- > /usr/local/git/bin/git checkout -f 355a357d79377e073d10dc77ac109921db62963a
- > /usr/local/git/bin/git rev-list 355a357d79377e073d10dc77ac109921db62963a # timeout=10
- [news-recommender-deploy-prod] $ /bin/sh -xe /tmp/hudson4375160133093694620.sh
- + echo news-recommender-commit
- news-recommender-commit
- + echo 231
- 231
- + echo 10.101.1.13:8017
- 10.101.1.13:8017
- + '[' 10.101.1.13:8017X = X ']'
- + echo 10.101.1.13:8017
- 10.101.1.13:8017
- ++ echo 10.101.1.13:8017
- ++ sed 's/;/; /g'
- + tmp_release_machines=10.101.1.13:8017
- + echo '[DESC] <a href=http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231/>231</a> (10.101.1.13:8017)'
- [DESC] <a href=http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231/>231</a> (10.101.1.13:8017)
- + echo parallel=4
- + cp ./scripts/Makefile.common Makefile
- + cp ./scripts/docker_deploy_env.sh ./docker_deploy_env.sh
- + export env_name=prod
- + env_name=prod
- + export 'receiver=serving@yidian-inc.com wangyy@yidian-inc.com'
- + receiver='serving@yidian-inc.com wangyy@yidian-inc.com'
- + make docker_deploy_prod
- echo $release_number
- 231
- echo $release_job
- news-recommender-commit
- + '[' 5 '!=' 4 ']'
- + '[' 5 '!=' 3 ']'
- + '[' 5 '!=' 5 ']'
- + release_job=news-recommender-commit
- + release_number=231
- + env_name=prod
- + release_machines=10.101.1.13:8017
- + start_cmd='sh deploy.sh nrexp'
- + '[' 'Xserving@yidian-inc.com wangyy@yidian-inc.com' = X ']'
- + '[' Xnews-recommender-commit '!=' Xcrawler-pipeline-commit ']'
- + mail -s 'news-recommender-commit is being deployed' -c 'serving@yidian-inc.com wangyy@yidian-inc.com' qa@yidian-inc.com
- ++ echo news-recommender-commit
- ++ sed -e s/-commit/-deploy-prod/g
- + echo 'Attention Please
- http://jenkins.yidian-inc.com:8030/job/news-recommender-commit/231 is being deployed to
- [10.101.1.13:8017]
- Click http://jenkins.yidian-inc.com:8030/job/news-recommender-deploy-prod to view progress'
- + '[' Xnews-recommender-commit = Xblender-commit ']'
- + '[' Xnews-recommender-commit = Xsearcher-commit ']'
- + '[' Xnews-recommender-commit = Xnews-recommender-commit ']'
- + component=news-recommender
- + src_log=/home/services/docker_home/_logs/news-recommender
- + dst_log=/home/services/NewsRecommender/logs
- + container_name=news-recommender
- + image_name=docker2.yidian.com:5000/publish/news-recommender-231-image-prod
- + '[' Xnews-recommender = Xzion-proxy ']'
- + '[' Xnews-recommender = Xzion-controller ']'
- + '[' Xnews-recommender = Xzion-ssdb-rocks ']'
- + mkdir -p ./news-recommender/machines
- + machine_file=./news-recommender/machines/prod
- + rm -f ./news-recommender/machines/prod
- + '[' X10.101.1.13:8017 '!=' X ']'
- + echo 10.101.1.13:8017
- + sed 's/;/\n/g'
- + '[' '!' -f ./news-recommender/machines/prod ']'
- + '[' -f parallel.file ']'
- ++ grep parallel= parallel.file
- ++ head -1
- ++ awk -F= '{print $2}'
- + parallel=4
- + checkInt 4
- + expr 4 + 0
- + '[' 0 -ne 0 ']'
- + return 0
- + checkIntRet=0
- + '[' 0 '!=' 0 ']'
- + '[' 4 -ge 8 ']'
- + echo 'Deploy parallel number:4'
- Deploy parallel number:4
- ++ cat ./news-recommender/machines/prod
- ++ grep -v '^#'
- ++ awk -F: '{print $1}'
- + hosts=10.101.1.13
- + protect_overflow_machines 10.101.1.13 4
- + declare -A local router_list
- + for host in '$1'
- ++ cat ./news-recommender/machines/prod
- ++ grep -v '^#'
- ++ grep 10.101.1.13:
- ++ awk -F: '{print $2}'
- + container_port=8017
- ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_router_by_innerip&innerIp=10.101.1.13:8017'
- ++ grep yidian/prod/serving/
- ++ head -1
- ++ awk -F yidian/prod/serving/ '{print $2}'
- ++ sed 's/"//g'
- % Total % Received % Xferd Average Speed Time Time Time Current
- Dload Upload Total Spent Left Speed
- 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
- 112 112 112 112 0 0 5340 0 --:--:-- --:--:-- --:--:-- 5600
- 112 112 112 112 0 0 5324 0 --:--:-- --:--:-- --:--:-- 5600
- + tmp_machine_router=news-recommender
- + router_list[$tmp_machine_router]=1
- + echo 'Process router list: news-recommender'
- Process router list: news-recommender
- + for key in '${!router_list[@]}'
- ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_namespace_id_by_router&router=yidian/prod/serving/news-recommender'
- ++ grep 'namespaceId":'
- ++ awk -F 'namespaceId":' '{print $2}'
- ++ sed 's/[" ]//g'
- % Total % Received % Xferd Average Speed Time Time Time Current
- Dload Upload Total Spent Left Speed
- 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
- 0 66 0 66 0 0 4228 0 --:--:-- --:--:-- --:--:-- 4714
- + local namespace=52
- ++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_machines_by_namespace&namespace=52'
- ++ grep inner_ip -c
- % Total % Received % Xferd Average Speed Time Time Time Current
- Dload Upload Total Spent Left Speed
- 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
- 100 11041 100 11041 0 0 1068k 0 --:--:-- --:--:-- --:--:-- 1347k
- + local t_machines_by_namespace=30
- ++ expr 30 / 3
- + least_machines_by_namespace=10
- + '[' 10 -lt 1 ']'
- + '[' 10 -lt 4 ']'
- + echo 'PASS! Parallel 4 is proper ( <= 1/3 total news-recommender service machines[10])'
- PASS! Parallel 4 is proper ( <= 1/3 total news-recommender service machines[10])
- + deploy_and_check 10.101.1.13 4
- + hosts=($1)
- + parallel=4
- + remainder=1
- + checkInt 1
- + expr 1 + 0
- + '[' 0 -ne 0 ']'
- + return 0
- + checkIntRet=0
- + '[' X0 '!=' X0 ']'
- + host_index=0
- + true
- + echo 'Begin to process. There is 1 machines to be deployed'
- Begin to process. There is 1 machines to be deployed
- + '[' 1 -le 0 ']'
- ++ expr 1 - 4
- + '[' -3 -lt 0 ']'
- + '[' 0 -lt 1 ']'
- + host=10.101.1.13
- ++ cat ./news-recommender/machines/prod
- ++ grep -v '^#'
- ++ grep 10.101.1.13:
- ++ awk -F: '{print $2}'
- + container_port=8017
- ++ expr 0 + 1
- + host_index=1
- + echo 'Deploy 10.101.1.13:8017'
- Deploy 10.101.1.13:8017
- + deploy_script 10.101.1.13 8017
- + echo Enter deploy_script
- Enter deploy_script
- + '[' Xnews-recommender-commit = Xchannel-serving-commit ']'
- + '[' Xnews-recommender-commit = Xblender-commit ']'
- + '[' Xnews-recommender-commit = Xadserver-commit ']'
- + '[' Xnews-recommender-commit = Xnews-recommender-commit ']'
- + haproxy_disable 10.101.1.13 8017
- + echo 'Begin disable haproxy 10.101.1.13:8017'
- Begin disable haproxy 10.101.1.13:8017
- ++ get_machine_router 10.101.1.13 8017
- +++ curl 'http://feedback.yidian-inc.com/tools/machinetool?action=get_router_by_innerip&innerIp=10.101.1.13:8017'
- +++ grep yidian/prod/serving/
- +++ head -1
- +++ awk -F yidian/prod/serving/ '{print $2}'
- +++ sed 's/"//g'
- % Total % Received % Xferd Average Speed Time Time Time Current
- Dload Upload Total Spent Left Speed
- 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
- 112 112 112 112 0 0 6041 0 --:--:-- --:--:-- --:--:-- 6588
- ++ tmp_machine_router=news-recommender
- ++ echo news-recommender
- + machine_router=news-recommender
- + '[' -z news-recommender ']'
- ++ get_base_haproxy_url news-recommender
- ++ machine_router=news-recommender
- ++ '[' Xnews-recommender = Xnews-recommender ']'
- ++ echo http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers
- + base_url=http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers
- + '[' -z http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers ']'
- ++ curl -l -H 'Content-type: application/json' -X POST -d '{"maint":["10.101.1.13:8017"]}' http://10.101.1.139:10010/haproxy/news_recommender/news_recommender/servers/stat/set
- % Total % Received % Xferd Average Speed Time Time Time Current
- Dload Upload Total Spent Left Speed
- 0 0 0 0 0 30 0 136k --:--:-- --:--:-- --:--:-- 136k
- 0 0 0 0 0 30 0 29 --:--:-- 0:00:01 --:--:-- 0
- 0 0 0 0 0 30 0 14 --:--:-- 0:00:02 --:--:-- 0
- 0 2 0 2 0 30 0 14 --:--:-- 0:00:02 --:--:-- 0
- + result=OK
- + '[' XOK '!=' XOK ']'
- + echo 'Disable api success'
- Disable api success
- + echo 'End disable haproxy 10.101.1.13:8017'
- End disable haproxy 10.101.1.13:8017
- + ssh services@10.101.1.13 'mkdir -p ~/docker_home'
- + scp ./scripts/restart_container.sh 'services@10.101.1.13:~/docker_home'
- + '[' 1 -lt 1 ']'
- + wait
- + nohup ssh services@10.101.1.13 'cd ~/docker_home; sh restart_container.sh docker2.yidian.com:5000/publish/news-recommender-231-image-prod news-recommender 8017 /home/services/docker_home/_logs/news-recommender /home/services/NewsRecommender/logs "sh deploy.sh nrexp"'
- latest: Pulling from docker2.yidian.com:5000/publish/news-recommender-231-image-prod
- 63a9c680256f: Already exists
- 6bb749570a3e: Already exists
- 4300c6af5f62: Already exists
- 6cd11d47ee2a: Already exists
- 5416ccb4a816: Already exists
- f4dcee328fa1: Already exists
- 65332ef137d4: Already exists
- 2f83561557ea: Already exists
- fc3860780eef: Already exists
- d7f33762d9ee: Already exists
- fc90ee827c40: Already exists
- b5a4f6dcf74b: Already exists
- 266f28b8a27e: Already exists
- 97ac34fd5e3b: Already exists
- 2ac1f0c019db: Already exists
- 5d8a45290460: Already exists
- fc78c9cb384c: Already exists
- 913170bc56a8: Already exists
- 617722410ea0: Already exists
- b170b9ba1629: Already exists
- 3856c2300ebe: Already exists
- 4226729dce8c: Already exists
- c8ec1031aedb: Already exists
- 42672f6edcdf: Already exists
- 07f4e2b93490: Already exists
- bb07b0a26e31: Already exists
- b2690954be4d: Already exists
- 3547b2870c74: Already exists
- 3bdc2bd6c9eb: Already exists
- 7448e1c33c84: Already exists
- 5acdec41b6b2: Already exists
- daaa8eb0ecb6: Already exists
- 2e1a46a6beba: Already exists
- 95b241d8ceb3: Already exists
- 95b241d8ceb3: Already exists
- Digest: sha256:d2216772aa4956010ad46be0c24ee17cd9853ea9517cdddc8b03750845963e0d
- Status: Image is up to date for docker2.yidian.com:5000/publish/news-recommender-231-image-prod:latest
- news-recommender
- news-recommender
- Sleep for start up...
- Run container [19b5876d2113a4425aefacb4c5efcbcd561e1a5ae2722391671056c002e4eae1] -> [news-recommender]
- wait done...
- not finished yet... check /home/services/docker_home/_logs/news-recommender/warmup.done
- 101-1-13-lg-201-i01.yidian.com used 10 seconds...
- 101-1-13-lg-201-i01.yidian.com used 20 seconds...
- 101-1-13-lg-201-i01.yidian.com used 30 seconds...
- 101-1-13-lg-201-i01.yidian.com used 40 seconds...
- 101-1-13-lg-201-i01.yidian.com used 50 seconds...
- 101-1-13-lg-201-i01.yidian.com used 60 seconds...
- 101-1-13-lg-201-i01.yidian.com used 70 seconds...
- 101-1-13-lg-201-i01.yidian.com used 80 seconds...
- 101-1-13-lg-201-i01.yidian.com used 90 seconds...
- 101-1-13-lg-201-i01.yidian.com used 100 seconds...
- 101-1-13-lg-201-i01.yidian.com used 110 seconds...
- 101-1-13-lg-201-i01.yidian.com used 120 seconds...
- 101-1-13-lg-201-i01.yidian.com used 130 seconds...
- 101-1-13-lg-201-i01.yidian.com used 140 seconds...
- 101-1-13-lg-201-i01.yidian.com used 150 seconds...
- 101-1-13-lg-201-i01.yidian.com used 160 seconds...
- 101-1-13-lg-201-i01.yidian.com used 170 seconds...
- 101-1-13-lg-201-i01.yidian.com used 180 seconds...
- 101-1-13-lg-201-i01.yidian.com used 190 seconds...
- 101-1-13-lg-201-i01.yidian.com used 200 seconds...
- 101-1-13-lg-201-i01.yidian.com used 210 seconds...
- 101-1-13-lg-201-i01.yidian.com used 220 seconds...
- 101-1-13-lg-201-i01.yidian.com used 230 seconds...
- 101-1-13-lg-201-i01.yidian.com used 240 seconds...
- Build was aborted
- Aborted by jixu
- [description-setter] Description set:
- Finished: ABORTED
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement