Advertisement
Guest User

Untitled

a guest
Dec 15th, 2015
42
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Logtalk 16.31 KB | None | 0 0
  1. INFO: Deleting container rancher-agent-upgrade
  2. INFO: Starting agent for B8608F17408F10AFEB5A
  3. INFO: Access Key: B8608F17408F10AFEB5A
  4. INFO: Config URL: http://172.19.8.100:8080/v1
  5. INFO: Storage URL: http://172.19.8.100:8080/v1
  6. INFO: API URL: http://172.19.8.100:8080/v1
  7. INFO: IP: 172.19.8.100
  8. INFO: Port:
  9. INFO: Required Image: rancher/agent:v0.8.2
  10. INFO: Current Image: rancher/agent:v0.8.2
  11. INFO: Using image rancher/agent:v0.8.2
  12. INFO: Downloading agent http://172.19.8.100:8080/v1/configcontent/configscripts
  13. INFO: Updating configscripts
  14. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//configscripts current=
  15. INFO: Running /var/lib/cattle/download/configscripts/configscripts-1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319/apply.sh
  16. INFO: Sending configscripts applied 1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319
  17. INFO: Updating pyagent
  18. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//pyagent current=
  19. INFO: Running /var/lib/cattle/download/pyagent/pyagent-1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60/apply.sh
  20. INFO: Updating host-api
  21. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-api current=
  22. INFO: Running /var/lib/cattle/download/host-api/1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a/apply.sh
  23. INFO: Sending host-api applied 1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a
  24. INFO: Updating agent-binaries
  25. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//agent-binaries current=
  26. INFO: Running /var/lib/cattle/download/agent-binaries/1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae/apply.sh
  27. INFO: Sending agent-binaries applied 1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae
  28. INFO: Updating python-agent
  29. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//python-agent current=
  30. INFO: Running /var/lib/cattle/download/python-agent/1-5b049c5b47a3146529443d36bea4878b288939af2c6cb54883f86303872087b5/apply.sh
  31. INFO: Sending python-agent applied 1-5b049c5b47a3146529443d36bea4878b288939af2c6cb54883f86303872087b5
  32. INFO: Updating cadvisor
  33. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//cadvisor current=
  34. INFO: Running /var/lib/cattle/download/cadvisor/1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25/apply.sh
  35. INFO: HOME -> ./
  36. INFO: HOME -> ./bin/
  37. INFO: HOME -> ./bin/cadvisor.sh
  38. INFO: HOME -> ./bin/cadvisor
  39. INFO: Sending cadvisor applied 1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25
  40. INFO: Updating volmgr
  41. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//volmgr current=
  42. INFO: Running /var/lib/cattle/download/volmgr/1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15/apply.sh
  43. INFO: Sending volmgr applied 1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15
  44. INFO: Sending pyagent applied 1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60
  45. INFO: Starting agent /var/lib/cattle/pyagent/apply.sh
  46. INFO: Executing /var/lib/cattle/pyagent/main.py
  47. INFO: Updating host-config
  48. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-config current=
  49. INFO: Running /var/lib/cattle/download/host-config/host-config-1-c88bfe0436c41a6e8df76f0bdbc7ad8bcf0a34c454eaaeb36b8ea86fa2ba7447/apply.sh
  50. INFO: HOME -> ./
  51. INFO: HOME -> ./etc/
  52. INFO: HOME -> ./etc/cattle/
  53. INFO: HOME -> ./etc/cattle/api.crt
  54. INFO: Sending host-config applied 1-c88bfe0436c41a6e8df76f0bdbc7ad8bcf0a34c454eaaeb36b8ea86fa2ba7447
  55. time="2015-12-16T02:48:02Z" level="info" msg="Starting event router."
  56. time="2015-12-16T02:48:02Z" level="info" msg="Watching state directory: /var/lib/rancher/state/containers"
  57. time="2015-12-16T02:48:03Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"7858c522267a6069a8b806a525d699376e091194219d7f37b2183e14e98b8d24\", From:\"-simulated-\", Time:0}"
  58. time="2015-12-16T02:48:03Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"6583ac445f6d7d3ba02e799a233bf60feb3bd47547e4c147d6664035b6e0290f\", From:\"-simulated-\", Time:0}"
  59. time="2015-12-16T02:48:03Z" level="info" msg="Host not registered yet. Sleeping 1 second and trying again." Attempt=0 reportedUuid="b7df40b6-32b6-4813-a9c9-382f01de923a"
  60. I1216 02:48:03.283385 02353 storagedriver.go:132] No backend storage selected
  61. I1216 02:48:03.334946 02353 storagedriver.go:134] Caching stats in memory for 2m0s
  62. I1216 02:48:03.335111 02353 manager.go:128] cAdvisor running in container: "/docker/ebab2301fdd9267420180839096c690b16c3f1ff63badc78e369a6f314be0c70/docker/7858c522267a6069a8b806a525d699376e091194219d7f37b2183e14e98b8d24"
  63. I1216 02:48:03.341767 02353 fs.go:108] Filesystem partitions: map[/dev/sda1:{mountpoint:/ major:8 minor:1 fsType: blockSize:0}]
  64. 2015-12-16 02:48:03,445 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/machine
  65. Traceback (most recent call last):
  66.   File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
  67.     with closing(urllib2.urlopen(url, timeout=5)) as resp:
  68.   File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
  69.     return _opener.open(url, data, timeout)
  70.   File "/usr/lib/python2.7/urllib2.py", line 404, in open
  71.     response = self._open(req, data)
  72.   File "/usr/lib/python2.7/urllib2.py", line 422, in _open
  73.     '_open', req)
  74.   File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
  75.     result = func(*args)
  76.   File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
  77.     return self.do_open(httplib.HTTPConnection, req)
  78.   File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
  79.     raise URLError(err)
  80. URLError: <urlopen error [Errno 111] ECONNREFUSED>
  81. 2015-12-16 02:48:03,450 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/containers
  82. Traceback (most recent call last):
  83.   File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
  84.     with closing(urllib2.urlopen(url, timeout=5)) as resp:
  85.   File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
  86.     return _opener.open(url, data, timeout)
  87.   File "/usr/lib/python2.7/urllib2.py", line 404, in open
  88.     response = self._open(req, data)
  89.   File "/usr/lib/python2.7/urllib2.py", line 422, in _open
  90.     '_open', req)
  91.   File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
  92.     result = func(*args)
  93.   File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
  94.     return self.do_open(httplib.HTTPConnection, req)
  95.   File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
  96.     raise URLError(err)
  97. URLError: <urlopen error [Errno 111] ECONNREFUSED>
  98. 2015-12-16 02:48:03,458 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/containers
  99. Traceback (most recent call last):
  100.   File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
  101.     with closing(urllib2.urlopen(url, timeout=5)) as resp:
  102.   File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
  103.     return _opener.open(url, data, timeout)
  104.   File "/usr/lib/python2.7/urllib2.py", line 404, in open
  105.     response = self._open(req, data)
  106.   File "/usr/lib/python2.7/urllib2.py", line 422, in _open
  107.     '_open', req)
  108.   File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
  109.     result = func(*args)
  110.   File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
  111.     return self.do_open(httplib.HTTPConnection, req)
  112.   File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
  113.     raise URLError(err)
  114. URLError: <urlopen error [Errno 111] ECONNREFUSED>
  115. I1216 02:48:03.578305 02353 machine.go:48] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
  116. I1216 02:48:03.578445 02353 manager.go:163] Machine: {NumCores:1 CpuFrequency:2594088 MemoryCapacity:1044946944 MachineID: SystemUUID:2EDBB022-1CA6-4694-8689-DC6158A47D2D BootID:bf910324-4a72-4e77-b4b7-840eb414dff1 Filesystems:[{Device:/dev/sda1 Capacity:39183224832}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:41943040000 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:08:00:27:9f:1d:71 Speed:0 Mtu:1500} {Name:eth1 MacAddress:08:00:27:82:81:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:1044946944 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:6291456 Type:Unified Level:3}]}] CloudProvider:Unknown InstanceType:Unknown}
  117. I1216 02:48:03.582917 02353 manager.go:169] Version: {KernelVersion:4.2.3-rancher ContainerOsVersion:Unknown DockerVersion:1.9.1-rc1 CadvisorVersion: CadvisorRevision:}
  118. I1216 02:48:03.620631 02353 factory.go:236] Registering Docker factory
  119. I1216 02:48:03.621222 02353 factory.go:93] Registering Raw factory
  120. I1216 02:48:03.658671 02353 manager.go:1006] Started watching for new ooms in manager
  121. I1216 02:48:03.660041 02353 oomparser.go:199] OOM parser using kernel log file: "/var/log/messages"
  122. I1216 02:48:03.676045 02353 manager.go:250] Starting recovery of all containers
  123. I1216 02:48:03.738029 02353 manager.go:255] Recovery completed
  124. I1216 02:48:03.766324 02353 cadvisor.go:96] Starting cAdvisor version: - on port 9344
  125. time="2015-12-16T02:48:04Z" level="info" msg="Connecting to proxy." url="ws://172.19.8.100:8080/v1/connectbackend?token=eyJhbGciOiJSUzI1NiJ9.eyJleHAiOjE0NTAyMzQzODQsInN1YiI6ImNhdHRsZSIsImlzcyI6Imh0dHA6XC9cL2NhdHRsZS5pbyIsInJlcG9ydGVkVXVpZCI6ImI3ZGY0MGI2LTMyYjYtNDgxMy1hOWM5LTM4MmYwMWRlOTIzYSIsImlhdCI6MTQ1MDIzNDA4NCwia2lkIjoiZGVmYXVsdCJ9.HloAddowuBm7k79AzSvxxKj18vlwkk2iPUWSKhSuDAf95fFxKGkJGHoYw3B-geQKpXtoOCrcFe0Bl3whOf75NOSf0Q6eoIT11vcQw1bj7eZRkg08BVCbFjoryNA7nFsZrD25gjiH9EpTbOWGG4dNTk6xtqD7SWKL-8BZpMaRw2zYjnOqCcMF7RdaqrpeGSQEDQQ4m1wmkDedzgYgwCRcRDFzpCG1y9WDijkDWpqHCC4uRfMaIOMxQiPUsFP9OyOrsmxWnIlUSrLjHOyNM7EI-LCZU5z7d_RrsZgkv3qoxGyXvoASOCIe8TuKHXniPwQSeLQeMdghDcv89y5vrxRrww"
  126. time="2015-12-16T03:11:13Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562\", From:\"rancher/agent-instance:v0.6.0\", Time:1450235473}"
  127. time="2015-12-16T03:11:13Z" level="info" msg="Assigning IP [10.42.253.229/16], ContainerId [46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562], Pid [10592]"
  128. time="2015-12-16T03:11:13Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562\", From:\"-simulated-\", Time:0}"
  129. time="2015-12-16T03:11:13Z" level="info" msg="Container locked. Can't run StartHandler. ID: [46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562]"
  130. time="2015-12-16T03:12:17Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"rancher/logspout-logstash:v0.2.0\", Time:1450235537}"
  131. time="2015-12-16T03:12:17Z" level="info" msg="Assigning IP [10.42.138.73/16], ContainerId [1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32], Pid [12437]"
  132. time="2015-12-16T03:12:17Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"-simulated-\", Time:0}"
  133. time="2015-12-16T03:12:17Z" level="info" msg="Container locked. Can't run StartHandler. ID: [1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32]"
  134. time="2015-12-16T03:12:21Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"die\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"rancher/logspout-logstash:v0.2.0\", Time:1450235541}"
  135. 2015-12-16 03:12:39,085 ERROR cattle [140010809928272] [utils.py:284] Failed to call (['/var/lib/cattle/config.sh', u'host-iptables', u'host-routes'],) {'stderr': -2, 'cwd': '/var/lib/cattle', 'env': {'AGENT_PARENT_PID': '1906', 'CATTLE_CONFIG_URL': 'http://172.19.8.100:8080/v1', 'CATTLE_AGENT_PIDNS': 'host', 'CATTLE_URL': 'http://172.19.8.100:8080/v1', 'SHLVL': '1', 'OLDPWD': '/tmp', 'HOSTNAME': 'rancher-server', 'PWD': '/var/lib/cattle/pyagent', 'CATTLE_ACCESS_KEY': 'B8608F17408F10AFEB5A', 'CATTLE_AGENT_LOG_FILE': '/var/log/rancher/agent.log', 'CATTLE_AGENT_IP': '172.19.8.100', 'CATTLE_STATE_DIR': '/var/lib/rancher/state', 'CATTLE_SECRET_KEY': 'oxuiJA5udTtQnKxyDGxLvQpniy2Uwa9daYX4KAey', 'CATTLE_SYSTEMD': 'false', 'RANCHER_AGENT_IMAGE': 'rancher/agent:v0.8.2', 'HOME': '/root', 'CATTLE_CADVISOR_WRAPPER': 'cadvisor.sh', 'CATTLE_STORAGE_URL': 'http://172.19.8.100:8080/v1', 'CATTLE_HOME': '/var/lib/cattle', 'PATH': '/var/lib/cattle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin'}}, exit [28], output :
  136. INFO: Updating host-iptables
  137. INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-iptables current=
  138. INFO: Running /var/lib/cattle/download/host-iptables/host-iptables-1-d049e47d422e7c2556577ff35624f118e182ec70793d23712724afa2f3165683/apply.sh
  139. INFO: HOME -> ./
  140. INFO: HOME -> ./etc/
  141. INFO: HOME -> ./etc/cattle/
  142. INFO: HOME -> ./etc/cattle/host-iptables
  143. INFO: Sending host-iptables applied 1-d049e47d422e7c2556577ff35624f118e182ec70793d23712724afa2f3165683
  144.  
  145. Traceback (most recent call last):
  146.   File "/var/lib/cattle/pyagent/cattle/utils.py", line 280, in get_command_output
  147.     return check_output(*args, **kw)
  148.   File "/var/lib/cattle/pyagent/cattle/utils.py", line 337, in check_output
  149.     raise e1
  150. CalledProcessError: Command '['/var/lib/cattle/config.sh', u'host-iptables', u'host-routes']' returned non-zero exit status 28
  151. 2015-12-16 03:13:18,290 ERROR root [140010809408080] [_logging.py:54] error from callback <function on_error at 0x7f56ce60f668>: ('Received websocket error: [%s]', error(110, 'Connection timed out'))
  152.   PID  PGID S TTY          TIME COMMAND
  153.  2328  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
  154.  2333  1944 S ?        00:00:02 /bin/bash /var/lib/cattle/pyagent/cattle/plugins/conntrack/conntrack.sh
  155.  2334  1944 S ?        00:00:02 host-api -cadvisor-url http://127.0.0.1:9344 -logtostderr=true -ip 0.0.0.0 -port 9345 -auth=true -host-uuid b7df40b6-32b6-4813-a9c9-382f01de923a -public-key /var/lib/cattle/etc/cattle/api.crt -cattle-url http://172.19.8.100:8080/v1 -cattle-state-dir /var/lib/rancher/state/containers
  156.  2336  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/bin/cadvisor.sh cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
  157.  2353  1944 S ?        00:00:17 /var/log/rancher/.cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
  158. 12941  1944 S ?        00:00:00 sleep 1
  159. 12943  1944 R ?        00:00:00 ps -eO pgid
  160. 12944  1944 S ?        00:00:00 grep -E PGID| 1944
  161.   PID  PGID S TTY          TIME COMMAND
  162.  2328  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
  163.  2333  1944 S ?        00:00:02 /bin/bash /var/lib/cattle/pyagent/cattle/plugins/conntrack/conntrack.sh
  164.  2334  1944 S ?        00:00:02 host-api -cadvisor-url http://127.0.0.1:9344 -logtostderr=true -ip 0.0.0.0 -port 9345 -auth=true -host-uuid b7df40b6-32b6-4813-a9c9-382f01de923a -public-key /var/lib/cattle/etc/cattle/api.crt -cattle-url http://172.19.8.100:8080/v1 -cattle-state-dir /var/lib/rancher/state/containers
  165.  2336  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/bin/cadvisor.sh cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
  166.  2353  1944 S ?        00:00:17 /var/log/rancher/.cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
  167. 12941  1944 S ?        00:00:00 sleep 1
  168. 12950  1944 R ?        00:00:00 ps -eO pgid
  169. 12951  1944 S ?        00:00:00 grep -E PGID| 1944
  170. PID 1944 has died doing kill 2333 2334 2336 2353 12941
  171. I1216 03:13:18.559495 02353 manager.go:996] Exiting thread watching subcontainers
  172. I1216 03:13:18.564835 02353 manager.go:320] Exiting global housekeeping thread
  173. I1216 03:13:18.566877 02353 cadvisor.go:130] Exiting given signal: terminated
  174.   PID  PGID S TTY          TIME COMMAND
  175.  2328  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
  176. 12954  1944 R ?        00:00:00 ps -eO pgid
  177. 12955  1944 S ?        00:00:00 grep -E PGID| 1944
  178. Caught EXIT
  179.   PID  PGID S TTY          TIME COMMAND
  180.  2328  1944 S ?        00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
  181. 12961  1944 R ?        00:00:00 ps -eO pgid
  182. 12962  1944 S ?        00:00:00 grep -E PGID| 1944
  183. [rancher@rancher-server ~]$
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement