Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2013-12-11 15:59:37.226 5191 AUDIT nova.compute.manager [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Starting instance...
- 2013-12-11 15:59:37.427 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Attempting claim: memory 2048 MB, disk 20 GB, VCPUs 1
- 2013-12-11 15:59:37.427 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Total Memory: 64377 MB, used: 10752.00 MB
- 2013-12-11 15:59:37.428 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Memory limit: 96565.50 MB, free: 85813.50 MB
- 2013-12-11 15:59:37.428 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Total Disk: 391 GB, used: 100.00 GB
- 2013-12-11 15:59:37.428 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Disk limit not specified, defaulting to unlimited
- 2013-12-11 15:59:37.429 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Total CPU: 24 VCPUs, used: 5.00 VCPUs
- 2013-12-11 15:59:37.429 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] CPU limit: 384.00 VCPUs, free: 379.00 VCPUs
- 2013-12-11 15:59:37.430 5191 AUDIT nova.compute.claims [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Claim successful
- 2013-12-11 15:59:37.816 5191 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 192.168.30.203
- 2013-12-11 15:59:38.014 5191 AUDIT nova.virt.block_device [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Booting with volume b4773199-7fa3-4815-b2fc-893211cbf97c at vda
- 2013-12-11 15:59:38.348 5191 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 192.168.30.203
- 2013-12-11 15:59:38.569 5191 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 192.168.30.203
- 2013-12-11 15:59:39.188 5191 INFO nova.virt.libvirt.driver [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Creating image
- 2013-12-11 15:59:39.341 5191 ERROR nova.compute.manager [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Instance failed to spawn
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Traceback (most recent call last):
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] block_device_info)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2067, in spawn
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] write_to_disk=True)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3040, in to_xml
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] disk_info, rescue, block_device_info)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2824, in get_guest_config
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] {'root_device_name': root_device_name})
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 372, in instance_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] **updates)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 477, in _instance_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] rt.update_usage(context, instance_ref)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return f(*args, **kwargs)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 258, in update_usage
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] self._update(context.elevated(), self.compute_node)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 428, in _update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] context, self.compute_node, values, prune_stats)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/conductor/api.py", line 263, in compute_node_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] prune_stats)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/conductor/rpcapi.py", line 386, in compute_node_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] prune_stats=prune_stats)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/rpcclient.py", line 85, in call
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return self._invoke(self.proxy.call, ctxt, method, **kwargs)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/rpcclient.py", line 63, in _invoke
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return cast_or_call(ctxt, msg, **self.kwargs)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/proxy.py", line 126, in call
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] result = rpc.call(context, real_topic, msg, timeout)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/__init__.py", line 139, in call
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return _get_impl().call(CONF, context, topic, msg, timeout)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/impl_qpid.py", line 794, in call
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] rpc_amqp.get_connection_pool(conf, Connection))
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 574, in call
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] rv = list(rv)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 539, in __iter__
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] raise result
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Traceback (most recent call last):
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] **args)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] result = getattr(proxyobj, method)(ctxt, **kwargs)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/conductor/manager.py", line 450, in compute_node_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] prune_stats)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/db/api.py", line 216, in compute_node_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return IMPL.compute_node_update(context, compute_id, values, prune_stats)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return f(*args, **kwargs)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 674, in compute_node_update
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] compute_ref.update(values)
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib64/python2.6/site-packages/SQLAlchemy-0.7.8-py2.6-linux-x86_64.egg/sqlalchemy/orm/session.py", line 405, in __exit__
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] raise
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.341 5191 TRACE nova.compute.manager [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:39.428 5191 AUDIT nova.compute.manager [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Terminating instance
- 2013-12-11 15:59:39.888 5191 ERROR nova.virt.libvirt.driver [-] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] During wait destroy, instance disappeared.
- 2013-12-11 15:59:40.055 5191 ERROR nova.virt.libvirt.vif [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Failed while unplugging vif
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Traceback (most recent call last):
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/vif.py", line 602, in unplug_ovs_hybrid
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] utils.execute('brctl', 'delif', br_name, v1_name, run_as_root=True)
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/utils.py", line 177, in execute
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] return processutils.execute(*cmd, **kwargs)
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] File "/usr/lib/python2.6/site-packages/nova/openstack/common/processutils.py", line 178, in execute
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] cmd=' '.join(cmd))
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] ProcessExecutionError: Unexpected error while running command.
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf brctl delif qbr549d73f9-e1 qvb549d73f9-e1
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Exit code: 1
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Stdout: ''
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Stderr: 'interface qvb549d73f9-e1 does not exist!\n'
- 2013-12-11 15:59:40.055 5191 TRACE nova.virt.libvirt.vif [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49]
- 2013-12-11 15:59:40.693 5191 INFO nova.virt.libvirt.driver [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Deleting instance files /var/lib/nova/instances/f3d74a86-69ec-4c1e-9a6d-99b67d875a49
- 2013-12-11 15:59:40.693 5191 INFO nova.virt.libvirt.driver [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] [instance: f3d74a86-69ec-4c1e-9a6d-99b67d875a49] Deletion of /var/lib/nova/instances/f3d74a86-69ec-4c1e-9a6d-99b67d875a49 complete
- 2013-12-11 15:59:41.310 5191 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 192.168.30.203
- 2013-12-11 15:59:41.413 5191 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 192.168.30.203
- 2013-12-11 15:59:41.803 5191 ERROR nova.openstack.common.rpc.amqp [req-ec6915fa-14a9-4da7-a44d-d1f3e3acaec0 6af81667ac8a402ebe88f8c4dd28cb77 cdb5c489c34e4beababdbadc8f1a155f] Exception during message handling
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp **args)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp payload)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in decorated_function
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp pass
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in decorated_function
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in decorated_function
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in decorated_function
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in decorated_function
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in run_instance
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp do_run_instance()
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return f(*args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in do_run_instance
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp legacy_bdm_in_spec)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in _run_instance
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp notify("error", msg=unicode(e)) # notify that build failed
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in _run_instance
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp instance, image_meta, legacy_bdm_in_spec)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in _build_instance
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp set_access_ip=set_access_ip)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in _spawn
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp LOG.exception(_('Instance failed to spawn'), instance=instance)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp block_device_info)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2067, in spawn
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp write_to_disk=True)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3040, in to_xml
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp disk_info, rescue, block_device_info)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2824, in get_guest_config
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp {'root_device_name': root_device_name})
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 372, in instance_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp **updates)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 477, in _instance_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp rt.update_usage(context, instance_ref)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return f(*args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 258, in update_usage
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp self._update(context.elevated(), self.compute_node)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 428, in _update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp context, self.compute_node, values, prune_stats)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/conductor/api.py", line 263, in compute_node_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp prune_stats)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/conductor/rpcapi.py", line 386, in compute_node_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp prune_stats=prune_stats)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpcclient.py", line 85, in call
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return self._invoke(self.proxy.call, ctxt, method, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpcclient.py", line 63, in _invoke
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return cast_or_call(ctxt, msg, **self.kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/proxy.py", line 126, in call
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp result = rpc.call(context, real_topic, msg, timeout)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/__init__.py", line 139, in call
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return _get_impl().call(CONF, context, topic, msg, timeout)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/impl_qpid.py", line 794, in call
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp rpc_amqp.get_connection_pool(conf, Connection))
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 574, in call
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp rv = list(rv)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 539, in __iter__
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp raise result
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp **args)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/conductor/manager.py", line 450, in compute_node_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp prune_stats)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/api.py", line 216, in compute_node_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return IMPL.compute_node_update(context, compute_id, values, prune_stats)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp return f(*args, **kwargs)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 674, in compute_node_update
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp compute_ref.update(values)
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp File "/usr/lib64/python2.6/site-packages/SQLAlchemy-0.7.8-py2.6-linux-x86_64.egg/sqlalchemy/orm/session.py", line 405, in __exit__
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp raise
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:41.803 5191 TRACE nova.openstack.common.rpc.amqp
- 2013-12-11 15:59:58.285 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 15:59:58.695 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 15:59:58.695 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 15:59:58.695 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 15:59:58.766 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:00:55.126 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:00:55.555 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:00:55.555 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:00:55.555 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:00:55.601 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:01:55.692 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:01:56.112 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:01:56.113 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:01:56.113 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:01:56.158 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:02:56.897 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:02:57.309 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:02:57.309 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:02:57.309 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:02:57.360 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:03:58.148 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:03:58.569 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:03:58.569 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:03:58.570 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:03:58.618 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:04:59.417 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:04:59.850 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:04:59.850 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:04:59.850 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:04:59.907 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:05:44.052 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:05:44.465 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:05:44.465 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:05:44.465 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:05:44.519 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:05:44.611 5191 WARNING nova.compute.manager [-] Found 6 in the database and 5 on the hypervisor.
- 2013-12-11 16:05:55.661 5191 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
- 2013-12-11 16:05:56.079 5191 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 51577
- 2013-12-11 16:05:56.079 5191 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 271
- 2013-12-11 16:05:56.079 5191 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 18
- 2013-12-11 16:05:56.155 5191 INFO nova.compute.resource_tracker [-] Compute_service record updated for Controller01:Controller01
- 2013-12-11 16:05:56.186 5191 INFO nova.compute.manager [-] Updating bandwidth usage cache
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement