Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- INFO: Deleting container rancher-agent-upgrade
- INFO: Starting agent for B8608F17408F10AFEB5A
- INFO: Access Key: B8608F17408F10AFEB5A
- INFO: Config URL: http://172.19.8.100:8080/v1
- INFO: Storage URL: http://172.19.8.100:8080/v1
- INFO: API URL: http://172.19.8.100:8080/v1
- INFO: IP: 172.19.8.100
- INFO: Port:
- INFO: Required Image: rancher/agent:v0.8.2
- INFO: Current Image: rancher/agent:v0.8.2
- INFO: Using image rancher/agent:v0.8.2
- INFO: Downloading agent http://172.19.8.100:8080/v1/configcontent/configscripts
- INFO: Updating configscripts
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//configscripts current=
- INFO: Running /var/lib/cattle/download/configscripts/configscripts-1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319/apply.sh
- INFO: Sending configscripts applied 1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319
- INFO: Updating pyagent
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//pyagent current=
- INFO: Running /var/lib/cattle/download/pyagent/pyagent-1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60/apply.sh
- INFO: Updating host-api
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-api current=
- INFO: Running /var/lib/cattle/download/host-api/1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a/apply.sh
- INFO: Sending host-api applied 1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a
- INFO: Updating agent-binaries
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//agent-binaries current=
- INFO: Running /var/lib/cattle/download/agent-binaries/1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae/apply.sh
- INFO: Sending agent-binaries applied 1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae
- INFO: Updating python-agent
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//python-agent current=
- INFO: Running /var/lib/cattle/download/python-agent/1-5b049c5b47a3146529443d36bea4878b288939af2c6cb54883f86303872087b5/apply.sh
- INFO: Sending python-agent applied 1-5b049c5b47a3146529443d36bea4878b288939af2c6cb54883f86303872087b5
- INFO: Updating cadvisor
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//cadvisor current=
- INFO: Running /var/lib/cattle/download/cadvisor/1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25/apply.sh
- INFO: HOME -> ./
- INFO: HOME -> ./bin/
- INFO: HOME -> ./bin/cadvisor.sh
- INFO: HOME -> ./bin/cadvisor
- INFO: Sending cadvisor applied 1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25
- INFO: Updating volmgr
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//volmgr current=
- INFO: Running /var/lib/cattle/download/volmgr/1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15/apply.sh
- INFO: Sending volmgr applied 1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15
- INFO: Sending pyagent applied 1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60
- INFO: Starting agent /var/lib/cattle/pyagent/apply.sh
- INFO: Executing /var/lib/cattle/pyagent/main.py
- INFO: Updating host-config
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-config current=
- INFO: Running /var/lib/cattle/download/host-config/host-config-1-c88bfe0436c41a6e8df76f0bdbc7ad8bcf0a34c454eaaeb36b8ea86fa2ba7447/apply.sh
- INFO: HOME -> ./
- INFO: HOME -> ./etc/
- INFO: HOME -> ./etc/cattle/
- INFO: HOME -> ./etc/cattle/api.crt
- INFO: Sending host-config applied 1-c88bfe0436c41a6e8df76f0bdbc7ad8bcf0a34c454eaaeb36b8ea86fa2ba7447
- time="2015-12-16T02:48:02Z" level="info" msg="Starting event router."
- time="2015-12-16T02:48:02Z" level="info" msg="Watching state directory: /var/lib/rancher/state/containers"
- time="2015-12-16T02:48:03Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"7858c522267a6069a8b806a525d699376e091194219d7f37b2183e14e98b8d24\", From:\"-simulated-\", Time:0}"
- time="2015-12-16T02:48:03Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"6583ac445f6d7d3ba02e799a233bf60feb3bd47547e4c147d6664035b6e0290f\", From:\"-simulated-\", Time:0}"
- time="2015-12-16T02:48:03Z" level="info" msg="Host not registered yet. Sleeping 1 second and trying again." Attempt=0 reportedUuid="b7df40b6-32b6-4813-a9c9-382f01de923a"
- I1216 02:48:03.283385 02353 storagedriver.go:132] No backend storage selected
- I1216 02:48:03.334946 02353 storagedriver.go:134] Caching stats in memory for 2m0s
- I1216 02:48:03.335111 02353 manager.go:128] cAdvisor running in container: "/docker/ebab2301fdd9267420180839096c690b16c3f1ff63badc78e369a6f314be0c70/docker/7858c522267a6069a8b806a525d699376e091194219d7f37b2183e14e98b8d24"
- I1216 02:48:03.341767 02353 fs.go:108] Filesystem partitions: map[/dev/sda1:{mountpoint:/ major:8 minor:1 fsType: blockSize:0}]
- 2015-12-16 02:48:03,445 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/machine
- Traceback (most recent call last):
- File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
- with closing(urllib2.urlopen(url, timeout=5)) as resp:
- File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
- return _opener.open(url, data, timeout)
- File "/usr/lib/python2.7/urllib2.py", line 404, in open
- response = self._open(req, data)
- File "/usr/lib/python2.7/urllib2.py", line 422, in _open
- '_open', req)
- File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
- result = func(*args)
- File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
- return self.do_open(httplib.HTTPConnection, req)
- File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
- raise URLError(err)
- URLError: <urlopen error [Errno 111] ECONNREFUSED>
- 2015-12-16 02:48:03,450 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/containers
- Traceback (most recent call last):
- File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
- with closing(urllib2.urlopen(url, timeout=5)) as resp:
- File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
- return _opener.open(url, data, timeout)
- File "/usr/lib/python2.7/urllib2.py", line 404, in open
- response = self._open(req, data)
- File "/usr/lib/python2.7/urllib2.py", line 422, in _open
- '_open', req)
- File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
- result = func(*args)
- File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
- return self.do_open(httplib.HTTPConnection, req)
- File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
- raise URLError(err)
- URLError: <urlopen error [Errno 111] ECONNREFUSED>
- 2015-12-16 02:48:03,458 ERROR cattle [140010809928112] [utils.py:132] Could not get stats from cAdvisor at: http://127.0.0.1:9344/api/v1.2/containers
- Traceback (most recent call last):
- File "/var/lib/cattle/pyagent/cattle/utils.py", line 126, in _get
- with closing(urllib2.urlopen(url, timeout=5)) as resp:
- File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
- return _opener.open(url, data, timeout)
- File "/usr/lib/python2.7/urllib2.py", line 404, in open
- response = self._open(req, data)
- File "/usr/lib/python2.7/urllib2.py", line 422, in _open
- '_open', req)
- File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain
- result = func(*args)
- File "/usr/lib/python2.7/urllib2.py", line 1214, in http_open
- return self.do_open(httplib.HTTPConnection, req)
- File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open
- raise URLError(err)
- URLError: <urlopen error [Errno 111] ECONNREFUSED>
- I1216 02:48:03.578305 02353 machine.go:48] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
- I1216 02:48:03.578445 02353 manager.go:163] Machine: {NumCores:1 CpuFrequency:2594088 MemoryCapacity:1044946944 MachineID: SystemUUID:2EDBB022-1CA6-4694-8689-DC6158A47D2D BootID:bf910324-4a72-4e77-b4b7-840eb414dff1 Filesystems:[{Device:/dev/sda1 Capacity:39183224832}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:41943040000 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:08:00:27:9f:1d:71 Speed:0 Mtu:1500} {Name:eth1 MacAddress:08:00:27:82:81:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:1044946944 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:6291456 Type:Unified Level:3}]}] CloudProvider:Unknown InstanceType:Unknown}
- I1216 02:48:03.582917 02353 manager.go:169] Version: {KernelVersion:4.2.3-rancher ContainerOsVersion:Unknown DockerVersion:1.9.1-rc1 CadvisorVersion: CadvisorRevision:}
- I1216 02:48:03.620631 02353 factory.go:236] Registering Docker factory
- I1216 02:48:03.621222 02353 factory.go:93] Registering Raw factory
- I1216 02:48:03.658671 02353 manager.go:1006] Started watching for new ooms in manager
- I1216 02:48:03.660041 02353 oomparser.go:199] OOM parser using kernel log file: "/var/log/messages"
- I1216 02:48:03.676045 02353 manager.go:250] Starting recovery of all containers
- I1216 02:48:03.738029 02353 manager.go:255] Recovery completed
- I1216 02:48:03.766324 02353 cadvisor.go:96] Starting cAdvisor version: - on port 9344
- time="2015-12-16T02:48:04Z" level="info" msg="Connecting to proxy." url="ws://172.19.8.100:8080/v1/connectbackend?token=eyJhbGciOiJSUzI1NiJ9.eyJleHAiOjE0NTAyMzQzODQsInN1YiI6ImNhdHRsZSIsImlzcyI6Imh0dHA6XC9cL2NhdHRsZS5pbyIsInJlcG9ydGVkVXVpZCI6ImI3ZGY0MGI2LTMyYjYtNDgxMy1hOWM5LTM4MmYwMWRlOTIzYSIsImlhdCI6MTQ1MDIzNDA4NCwia2lkIjoiZGVmYXVsdCJ9.HloAddowuBm7k79AzSvxxKj18vlwkk2iPUWSKhSuDAf95fFxKGkJGHoYw3B-geQKpXtoOCrcFe0Bl3whOf75NOSf0Q6eoIT11vcQw1bj7eZRkg08BVCbFjoryNA7nFsZrD25gjiH9EpTbOWGG4dNTk6xtqD7SWKL-8BZpMaRw2zYjnOqCcMF7RdaqrpeGSQEDQQ4m1wmkDedzgYgwCRcRDFzpCG1y9WDijkDWpqHCC4uRfMaIOMxQiPUsFP9OyOrsmxWnIlUSrLjHOyNM7EI-LCZU5z7d_RrsZgkv3qoxGyXvoASOCIe8TuKHXniPwQSeLQeMdghDcv89y5vrxRrww"
- time="2015-12-16T03:11:13Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562\", From:\"rancher/agent-instance:v0.6.0\", Time:1450235473}"
- time="2015-12-16T03:11:13Z" level="info" msg="Assigning IP [10.42.253.229/16], ContainerId [46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562], Pid [10592]"
- time="2015-12-16T03:11:13Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562\", From:\"-simulated-\", Time:0}"
- time="2015-12-16T03:11:13Z" level="info" msg="Container locked. Can't run StartHandler. ID: [46b1a125a5f2c03b694f1bc0150b8168ffa948e7c34cc03050e7b88074e22562]"
- time="2015-12-16T03:12:17Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"rancher/logspout-logstash:v0.2.0\", Time:1450235537}"
- time="2015-12-16T03:12:17Z" level="info" msg="Assigning IP [10.42.138.73/16], ContainerId [1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32], Pid [12437]"
- time="2015-12-16T03:12:17Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"-simulated-\", Time:0}"
- time="2015-12-16T03:12:17Z" level="info" msg="Container locked. Can't run StartHandler. ID: [1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32]"
- time="2015-12-16T03:12:21Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"die\", ID:\"1f93cb057897ff6dd9488440cc81b92abc92d168be8cc05a83dc206e9b25dd32\", From:\"rancher/logspout-logstash:v0.2.0\", Time:1450235541}"
- 2015-12-16 03:12:39,085 ERROR cattle [140010809928272] [utils.py:284] Failed to call (['/var/lib/cattle/config.sh', u'host-iptables', u'host-routes'],) {'stderr': -2, 'cwd': '/var/lib/cattle', 'env': {'AGENT_PARENT_PID': '1906', 'CATTLE_CONFIG_URL': 'http://172.19.8.100:8080/v1', 'CATTLE_AGENT_PIDNS': 'host', 'CATTLE_URL': 'http://172.19.8.100:8080/v1', 'SHLVL': '1', 'OLDPWD': '/tmp', 'HOSTNAME': 'rancher-server', 'PWD': '/var/lib/cattle/pyagent', 'CATTLE_ACCESS_KEY': 'B8608F17408F10AFEB5A', 'CATTLE_AGENT_LOG_FILE': '/var/log/rancher/agent.log', 'CATTLE_AGENT_IP': '172.19.8.100', 'CATTLE_STATE_DIR': '/var/lib/rancher/state', 'CATTLE_SECRET_KEY': 'oxuiJA5udTtQnKxyDGxLvQpniy2Uwa9daYX4KAey', 'CATTLE_SYSTEMD': 'false', 'RANCHER_AGENT_IMAGE': 'rancher/agent:v0.8.2', 'HOME': '/root', 'CATTLE_CADVISOR_WRAPPER': 'cadvisor.sh', 'CATTLE_STORAGE_URL': 'http://172.19.8.100:8080/v1', 'CATTLE_HOME': '/var/lib/cattle', 'PATH': '/var/lib/cattle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin'}}, exit [28], output :
- INFO: Updating host-iptables
- INFO: Downloading http://172.19.8.100:8080/v1//configcontent//host-iptables current=
- INFO: Running /var/lib/cattle/download/host-iptables/host-iptables-1-d049e47d422e7c2556577ff35624f118e182ec70793d23712724afa2f3165683/apply.sh
- INFO: HOME -> ./
- INFO: HOME -> ./etc/
- INFO: HOME -> ./etc/cattle/
- INFO: HOME -> ./etc/cattle/host-iptables
- INFO: Sending host-iptables applied 1-d049e47d422e7c2556577ff35624f118e182ec70793d23712724afa2f3165683
- Traceback (most recent call last):
- File "/var/lib/cattle/pyagent/cattle/utils.py", line 280, in get_command_output
- return check_output(*args, **kw)
- File "/var/lib/cattle/pyagent/cattle/utils.py", line 337, in check_output
- raise e1
- CalledProcessError: Command '['/var/lib/cattle/config.sh', u'host-iptables', u'host-routes']' returned non-zero exit status 28
- 2015-12-16 03:13:18,290 ERROR root [140010809408080] [_logging.py:54] error from callback <function on_error at 0x7f56ce60f668>: ('Received websocket error: [%s]', error(110, 'Connection timed out'))
- PID PGID S TTY TIME COMMAND
- 2328 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
- 2333 1944 S ? 00:00:02 /bin/bash /var/lib/cattle/pyagent/cattle/plugins/conntrack/conntrack.sh
- 2334 1944 S ? 00:00:02 host-api -cadvisor-url http://127.0.0.1:9344 -logtostderr=true -ip 0.0.0.0 -port 9345 -auth=true -host-uuid b7df40b6-32b6-4813-a9c9-382f01de923a -public-key /var/lib/cattle/etc/cattle/api.crt -cattle-url http://172.19.8.100:8080/v1 -cattle-state-dir /var/lib/rancher/state/containers
- 2336 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/bin/cadvisor.sh cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
- 2353 1944 S ? 00:00:17 /var/log/rancher/.cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
- 12941 1944 S ? 00:00:00 sleep 1
- 12943 1944 R ? 00:00:00 ps -eO pgid
- 12944 1944 S ? 00:00:00 grep -E PGID| 1944
- PID PGID S TTY TIME COMMAND
- 2328 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
- 2333 1944 S ? 00:00:02 /bin/bash /var/lib/cattle/pyagent/cattle/plugins/conntrack/conntrack.sh
- 2334 1944 S ? 00:00:02 host-api -cadvisor-url http://127.0.0.1:9344 -logtostderr=true -ip 0.0.0.0 -port 9345 -auth=true -host-uuid b7df40b6-32b6-4813-a9c9-382f01de923a -public-key /var/lib/cattle/etc/cattle/api.crt -cattle-url http://172.19.8.100:8080/v1 -cattle-state-dir /var/lib/rancher/state/containers
- 2336 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/bin/cadvisor.sh cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
- 2353 1944 S ? 00:00:17 /var/log/rancher/.cadvisor -logtostderr=true -listen_ip 127.0.0.1 -port 9344 -docker_root /var/lib/docker
- 12941 1944 S ? 00:00:00 sleep 1
- 12950 1944 R ? 00:00:00 ps -eO pgid
- 12951 1944 S ? 00:00:00 grep -E PGID| 1944
- PID 1944 has died doing kill 2333 2334 2336 2353 12941
- I1216 03:13:18.559495 02353 manager.go:996] Exiting thread watching subcontainers
- I1216 03:13:18.564835 02353 manager.go:320] Exiting global housekeeping thread
- I1216 03:13:18.566877 02353 cadvisor.go:130] Exiting given signal: terminated
- PID PGID S TTY TIME COMMAND
- 2328 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
- 12954 1944 R ? 00:00:00 ps -eO pgid
- 12955 1944 S ? 00:00:00 grep -E PGID| 1944
- Caught EXIT
- PID PGID S TTY TIME COMMAND
- 2328 1944 S ? 00:00:00 /bin/bash /var/lib/cattle/pyagent/cattle/process_watcher.sh
- 12961 1944 R ? 00:00:00 ps -eO pgid
- 12962 1944 S ? 00:00:00 grep -E PGID| 1944
- [rancher@rancher-server ~]$
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement