Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2012-05-23 11:26:02 DEBUG nova.manager [req-a7a45c44-7e90-4397-8836-d1d71c73668f None None] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:26:02 DEBUG nova.manager [req-a7a45c44-7e90-4397-8836-d1d71c73668f None None] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:26:17 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'96d3881145214741b61c96470fa095e3', u'_context_quota_class': None, u'_context_request_id': u'req-e0e777dc-6fde-4750-b923-24f8f6a91377', u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:26:17.650864', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'get_floating_ips_by_project', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:17 DEBUG nova.rpc.amqp [req-e0e777dc-6fde-4750-b923-24f8f6a91377 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:26:17.650864', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-e0e777dc-6fde-4750-b923-24f8f6a91377', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:17 DEBUG nova.utils [req-e0e777dc-6fde-4750-b923-24f8f6a91377 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Reloading cached file /etc/nova/policy.json from (pid=16498) read_cached_file /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:1218
- 2012-05-23 11:26:17 DEBUG nova.rpc.amqp [req-e0e777dc-6fde-4750-b923-24f8f6a91377 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Pool creating new connection from (pid=16498) create /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/amqp.py:57
- 2012-05-23 11:26:17 INFO nova.rpc.common [req-e0e777dc-6fde-4750-b923-24f8f6a91377 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Connected to AMQP server on PUBLIC_IP:5672
- 2012-05-23 11:26:21 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'dae71e9d06914bd087b283ab5aec8ee8', u'_context_quota_class': None, u'_context_request_id': u'req-877a0f9a-caeb-4df6-8f25-5680f9d28e06', u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:26:21.504454', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'get_floating_ips_by_project', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:21 DEBUG nova.rpc.amqp [req-877a0f9a-caeb-4df6-8f25-5680f9d28e06 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:26:21.504454', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-877a0f9a-caeb-4df6-8f25-5680f9d28e06', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:30 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'7eccf0a37c2e4fbbb266476dc45c87f4', u'_context_quota_class': None, u'_context_request_id': u'req-832e0675-cdc5-4b0b-b99e-46426d577006', u'args': {u'instance_uuid': u'c6903195-454e-4782-a50b-dd9cf1e8e807', u'vpn': False, u'requested_networks': None, u'instance_id': 21, u'host': u'cloud', u'rxtx_factor': 1.0, u'project_id': u'b3421b6098894bfca08ef60c4d4abee0'}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:26:29.383208', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'allocate_for_instance', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:30 DEBUG nova.rpc.amqp [req-832e0675-cdc5-4b0b-b99e-46426d577006 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:26:29.383208', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-832e0675-cdc5-4b0b-b99e-46426d577006', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:30 DEBUG nova.network.manager [req-832e0675-cdc5-4b0b-b99e-46426d577006 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] floating IP allocation for instance |21| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:317
- 2012-05-23 11:26:30 DEBUG nova.network.manager [req-832e0675-cdc5-4b0b-b99e-46426d577006 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] network allocations for instance |21| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:921
- 2012-05-23 11:26:30 DEBUG nova.network.manager [req-832e0675-cdc5-4b0b-b99e-46426d577006 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] networks retrieved for instance |21|: |[]| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:927
- 2012-05-23 11:26:36 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'347605dec45d415c95c68e7e946e18c8', u'_context_quota_class': None, u'_context_request_id': u'req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb', u'args': {u'instance_id': 21, u'instance_uuid': u'c6903195-454e-4782-a50b-dd9cf1e8e807', u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:26:33.640182', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'get_instance_nw_info', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:36 DEBUG nova.rpc.amqp [req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:26:33.640182', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:37 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_context_request_id': u'req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb', u'_context_quota_class': None, u'args': {u'instance_id': 21, u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0'}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:26:33.640182', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'deallocate_for_instance', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:37 DEBUG nova.rpc.amqp [req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:26:33.640182', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:26:37 DEBUG nova.network.manager [req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] floating IP deallocation for instance |21| from (pid=16498) deallocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:355
- 2012-05-23 11:26:37 DEBUG nova.network.manager [req-07f33e4f-fb0d-4833-b96b-fed7c8d148eb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] network deallocation for instance |21| from (pid=16498) deallocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:955
- 2012-05-23 11:27:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:27:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:27:09 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'379000b9098d447599c777b4a5738a23', u'_context_quota_class': None, u'_context_request_id': u'req-0f75e63e-7c0e-49eb-acf5-849453c27140', u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:27:09.667671', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'get_floating_ips_by_project', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:09 DEBUG nova.rpc.amqp [req-0f75e63e-7c0e-49eb-acf5-849453c27140 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:27:09.667671', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-0f75e63e-7c0e-49eb-acf5-849453c27140', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:21 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'4a90d93856a64d1fb6be31698ae0a9a3', u'_context_quota_class': None, u'_context_request_id': u'req-929f381c-f631-468d-b471-cc65028f04cb', u'args': {u'instance_uuid': u'94a61670-06fe-4e86-b745-1a20dcb449b9', u'vpn': False, u'requested_networks': None, u'instance_id': 22, u'host': u'cloud', u'rxtx_factor': 1.0, u'project_id': u'b3421b6098894bfca08ef60c4d4abee0'}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:27:19.789283', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'allocate_for_instance', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:21 DEBUG nova.rpc.amqp [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:27:19.789283', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-929f381c-f631-468d-b471-cc65028f04cb', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:21 DEBUG nova.network.manager [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] floating IP allocation for instance |22| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:317
- 2012-05-23 11:27:21 DEBUG nova.network.manager [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] network allocations for instance |22| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:921
- 2012-05-23 11:27:21 DEBUG nova.network.manager [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] networks retrieved for instance |22|: |[<nova.db.sqlalchemy.models.Network object at 0x3efe290>]| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:927
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "ensure_bridge" for method "ensure_bridge"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "ensure_bridge" for method "ensure_bridge"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab file lock "ensure_bridge" for method "ensure_bridge"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:770
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got file lock "ensure_bridge" for method "ensure_bridge"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:777
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo ip link show dev br100 from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo brctl addif br100 eth0 from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Result was 1 from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:192
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo route -n from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo ip addr show dev eth0 scope global from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab file lock "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:770
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got file lock "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:777
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-save -t filter from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-restore from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-save -t nat from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-restore from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.network.linux_net [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] IPTablesManager.apply completed with success from (pid=16498) apply /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/linux_net.py:336
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo sysctl -w net.ipv4.ip_forward=1 from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo ip addr show dev br100 scope global from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "dnsmasq_start" for method "restart_dhcp"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "dnsmasq_start" for method "restart_dhcp"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:21 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo FLAGFILE=/etc/nova/nova.conf NETWORK_ID=3 dnsmasq --strict-order --bind-interfaces --conf-file= --domain=novalocal --pid-file=/usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/networks/nova-br100.pid --listen-address=10.0.0.3 --except-interface=lo --dhcp-range=10.0.0.2,static,120s --dhcp-lease-max=256 --dhcp-hostsfile=/usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/networks/nova-br100.conf --dhcp-script=/usr/local/bin/nova-dhcpbridge --leasefile-ro from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab file lock "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:770
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got file lock "iptables" for method "apply"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:777
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-save -t filter from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-restore from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-save -t nat from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Running cmd (subprocess): sudo iptables-restore from (pid=16498) execute /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:176
- 2012-05-23 11:27:22 DEBUG nova.network.linux_net [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] IPTablesManager.apply completed with success from (pid=16498) apply /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/linux_net.py:336
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:27:22 DEBUG nova.utils [req-929f381c-f631-468d-b471-cc65028f04cb 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:27:25 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'eb7b91a68cb64703bc9f8ab527a45cdb', u'_context_quota_class': None, u'_context_request_id': u'req-4d83bf86-6c2f-462b-b5b7-14efb85f7cb5', u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:27:25.540312', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'get_floating_ips_by_project', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:25 DEBUG nova.rpc.amqp [req-4d83bf86-6c2f-462b-b5b7-14efb85f7cb5 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:27:25.540312', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-4d83bf86-6c2f-462b-b5b7-14efb85f7cb5', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:34 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'1ef9479a0a0845c59eeb3f04cb1749dd', u'_context_quota_class': None, u'_context_request_id': u'req-032f5618-07e0-4fe0-9f12-aadef9a4744d', u'args': {u'instance_uuid': u'5a0a6558-3bd6-47d9-9b4f-2c4815234e30', u'vpn': False, u'requested_networks': None, u'instance_id': 23, u'host': u'Node1', u'rxtx_factor': 1.0, u'project_id': u'b3421b6098894bfca08ef60c4d4abee0'}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'_context_timestamp': u'2012-05-23T03:27:32.914338', u'_context_read_deleted': u'no', u'_context_user_id': u'062983f8a1fb42579316062accd599cd', u'method': u'allocate_for_instance', u'_context_remote_address': u'PUBLIC_IP'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:34 DEBUG nova.rpc.amqp [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] unpacked context: {'user_id': u'062983f8a1fb42579316062accd599cd', 'roles': [u'admin'], 'timestamp': '2012-05-23T03:27:32.914338', 'auth_token': '<SANITIZED>', 'remote_address': u'PUBLIC_IP', 'quota_class': None, 'is_admin': True, 'request_id': u'req-032f5618-07e0-4fe0-9f12-aadef9a4744d', 'project_id': u'b3421b6098894bfca08ef60c4d4abee0', 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:27:34 DEBUG nova.network.manager [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] floating IP allocation for instance |23| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:317
- 2012-05-23 11:27:34 DEBUG nova.network.manager [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] network allocations for instance |23| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:921
- 2012-05-23 11:27:34 DEBUG nova.network.manager [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] networks retrieved for instance |23|: |[<nova.db.sqlalchemy.models.Network object at 0x3d80a10>]| from (pid=16498) allocate_for_instance /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/network/manager.py:927
- 2012-05-23 11:27:34 DEBUG nova.rpc.amqp [-] Making asynchronous call on network.Node1 ... from (pid=16498) multicall /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/amqp.py:340
- 2012-05-23 11:27:34 DEBUG nova.rpc.amqp [-] MSG_ID is 1a5649e17d834a07ad30e2c575df1919 from (pid=16498) multicall /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/amqp.py:343
- 2012-05-23 11:28:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:28:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:28:18 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'06a7809380464786a22aef43eb0d374a', u'_context_quota_class': None, u'_context_request_id': u'req-15ca838c-27b9-437a-be93-14d407816f07', u'args': {u'instance_id': 23, u'instance_uuid': u'5a0a6558-3bd6-47d9-9b4f-2c4815234e30', u'host': u'Node1', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:28:14.411466', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:28:18 DEBUG nova.rpc.amqp [req-15ca838c-27b9-437a-be93-14d407816f07 None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:28:14.411466', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-15ca838c-27b9-437a-be93-14d407816f07', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:28:18 DEBUG nova.utils [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:18 DEBUG nova.utils [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:28:18 DEBUG nova.utils [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:18 DEBUG nova.utils [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:28:18 DEBUG nova.rpc.amqp [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Pool creating new connection from (pid=16498) create /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/amqp.py:57
- 2012-05-23 11:28:18 INFO nova.rpc.common [req-15ca838c-27b9-437a-be93-14d407816f07 None None] Connected to AMQP server on PUBLIC_IP:5672
- 2012-05-23 11:28:21 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'1feb05309b0c4d4e964e196ec6c01113', u'_context_quota_class': None, u'_context_request_id': u'req-937ee446-b454-41a6-a919-255b0731375d', u'args': {u'instance_id': 22, u'instance_uuid': u'94a61670-06fe-4e86-b745-1a20dcb449b9', u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:28:14.196654', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:28:21 DEBUG nova.rpc.amqp [req-937ee446-b454-41a6-a919-255b0731375d None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:28:14.196654', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-937ee446-b454-41a6-a919-255b0731375d', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:28:21 DEBUG nova.utils [req-937ee446-b454-41a6-a919-255b0731375d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:21 DEBUG nova.utils [req-937ee446-b454-41a6-a919-255b0731375d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:28:21 DEBUG nova.utils [req-937ee446-b454-41a6-a919-255b0731375d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:21 DEBUG nova.utils [req-937ee446-b454-41a6-a919-255b0731375d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:28:34 ERROR nova.rpc.common [-] Timed out waiting for RPC response: timed out
- 2012-05-23 11:28:34 TRACE nova.rpc.common Traceback (most recent call last):
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/impl_kombu.py", line 490, in ensure
- 2012-05-23 11:28:34 TRACE nova.rpc.common return method(*args, **kwargs)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/impl_kombu.py", line 567, in _consume
- 2012-05-23 11:28:34 TRACE nova.rpc.common return self.connection.drain_events(timeout=timeout)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line 110, in drain_events
- 2012-05-23 11:28:34 TRACE nova.rpc.common return self.transport.drain_events(self.connection, **kwargs)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 200, in drain_events
- 2012-05-23 11:28:34 TRACE nova.rpc.common return connection.drain_events(**kwargs)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 50, in drain_events
- 2012-05-23 11:28:34 TRACE nova.rpc.common return self.wait_multi(self.channels.values(), timeout=timeout)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 56, in wait_multi
- 2012-05-23 11:28:34 TRACE nova.rpc.common chanmap.keys(), allowed_methods, timeout=timeout)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 104, in _wait_multiple
- 2012-05-23 11:28:34 TRACE nova.rpc.common channel, method_sig, args, content = self.read_timeout(timeout)
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 86, in read_timeout
- 2012-05-23 11:28:34 TRACE nova.rpc.common return self.method_reader.read_method()
- 2012-05-23 11:28:34 TRACE nova.rpc.common File "/usr/local/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 215, in read_method
- 2012-05-23 11:28:34 TRACE nova.rpc.common raise m
- 2012-05-23 11:28:34 TRACE nova.rpc.common timeout: timed out
- 2012-05-23 11:28:34 TRACE nova.rpc.common
- 2012-05-23 11:28:34 DEBUG nova.utils [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:34 DEBUG nova.utils [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:28:34 DEBUG nova.utils [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:28:34 DEBUG nova.utils [req-032f5618-07e0-4fe0-9f12-aadef9a4744d 062983f8a1fb42579316062accd599cd b3421b6098894bfca08ef60c4d4abee0] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:29:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:29:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:29:26 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'101b4f596943439a9078b74e1c3c0ee4', u'_context_quota_class': None, u'_context_request_id': u'req-b2462789-4f57-4cd0-956b-6b11ebd5239d', u'args': {u'instance_id': 23, u'instance_uuid': u'5a0a6558-3bd6-47d9-9b4f-2c4815234e30', u'host': u'Node1', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:29:22.388485', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:29:26 DEBUG nova.rpc.amqp [req-b2462789-4f57-4cd0-956b-6b11ebd5239d None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:29:22.388485', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-b2462789-4f57-4cd0-956b-6b11ebd5239d', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:29:26 DEBUG nova.utils [req-b2462789-4f57-4cd0-956b-6b11ebd5239d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:29:26 DEBUG nova.utils [req-b2462789-4f57-4cd0-956b-6b11ebd5239d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:29:26 DEBUG nova.utils [req-b2462789-4f57-4cd0-956b-6b11ebd5239d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:29:26 DEBUG nova.utils [req-b2462789-4f57-4cd0-956b-6b11ebd5239d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:29:29 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'0f34884ff3e74090bd68b2d7fd989160', u'_context_quota_class': None, u'_context_request_id': u'req-97231de2-9a72-40ad-b0f0-d052faea2d1c', u'args': {u'instance_id': 22, u'instance_uuid': u'94a61670-06fe-4e86-b745-1a20dcb449b9', u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:29:21.957287', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:29:29 DEBUG nova.rpc.amqp [req-97231de2-9a72-40ad-b0f0-d052faea2d1c None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:29:21.957287', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-97231de2-9a72-40ad-b0f0-d052faea2d1c', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:29:29 DEBUG nova.utils [req-97231de2-9a72-40ad-b0f0-d052faea2d1c None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:29:29 DEBUG nova.utils [req-97231de2-9a72-40ad-b0f0-d052faea2d1c None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:29:29 DEBUG nova.utils [req-97231de2-9a72-40ad-b0f0-d052faea2d1c None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:29:29 DEBUG nova.utils [req-97231de2-9a72-40ad-b0f0-d052faea2d1c None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:30:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:30:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:30:30 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'19f740d23cb544a9b231a63a408ed011', u'_context_quota_class': None, u'_context_request_id': u'req-d978c653-b23b-4f7b-8237-e0ba9b1f5727', u'args': {u'instance_id': 23, u'instance_uuid': u'5a0a6558-3bd6-47d9-9b4f-2c4815234e30', u'host': u'Node1', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:30:26.571113', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:30:30 DEBUG nova.rpc.amqp [req-d978c653-b23b-4f7b-8237-e0ba9b1f5727 None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:30:26.571113', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-d978c653-b23b-4f7b-8237-e0ba9b1f5727', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:30:30 DEBUG nova.utils [req-d978c653-b23b-4f7b-8237-e0ba9b1f5727 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:30:30 DEBUG nova.utils [req-d978c653-b23b-4f7b-8237-e0ba9b1f5727 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:30:30 DEBUG nova.utils [req-d978c653-b23b-4f7b-8237-e0ba9b1f5727 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:30:30 DEBUG nova.utils [req-d978c653-b23b-4f7b-8237-e0ba9b1f5727 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:30:42 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'f30eac243aa34718b6ad7c34cb5f895c', u'_context_quota_class': None, u'_context_request_id': u'req-722cfe28-3367-4af5-b05e-adae2cf06bf1', u'args': {u'instance_id': 22, u'instance_uuid': u'94a61670-06fe-4e86-b745-1a20dcb449b9', u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:30:34.915607', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:30:42 DEBUG nova.rpc.amqp [req-722cfe28-3367-4af5-b05e-adae2cf06bf1 None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:30:34.915607', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-722cfe28-3367-4af5-b05e-adae2cf06bf1', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:30:42 DEBUG nova.utils [req-722cfe28-3367-4af5-b05e-adae2cf06bf1 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:30:42 DEBUG nova.utils [req-722cfe28-3367-4af5-b05e-adae2cf06bf1 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:30:42 DEBUG nova.utils [req-722cfe28-3367-4af5-b05e-adae2cf06bf1 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:30:42 DEBUG nova.utils [req-722cfe28-3367-4af5-b05e-adae2cf06bf1 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:31:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:31:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:31:38 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'fbbdf538699e4fcda437073802c80093', u'_context_quota_class': None, u'_context_request_id': u'req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d', u'args': {u'instance_id': 23, u'instance_uuid': u'5a0a6558-3bd6-47d9-9b4f-2c4815234e30', u'host': u'Node1', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:31:34.572825', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:31:38 DEBUG nova.rpc.amqp [req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:31:34.572825', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:31:38 DEBUG nova.utils [req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:31:38 DEBUG nova.utils [req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:31:38 DEBUG nova.utils [req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:31:38 DEBUG nova.utils [req-82ff2d30-7b37-456c-ab8f-ba3275d6b21d None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:31:50 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_msg_id': u'f5caec2b124f427e8fee75d3a89cfcac', u'_context_quota_class': None, u'_context_request_id': u'req-05754058-5c8f-4417-b9a4-e58443e81025', u'args': {u'instance_id': 22, u'instance_uuid': u'94a61670-06fe-4e86-b745-1a20dcb449b9', u'host': u'cloud', u'project_id': u'b3421b6098894bfca08ef60c4d4abee0', u'rxtx_factor': 1.0}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-05-23T03:31:42.676973', u'_context_read_deleted': u'no', u'_context_user_id': None, u'method': u'get_instance_nw_info', u'_context_remote_address': None} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:31:50 DEBUG nova.rpc.amqp [req-05754058-5c8f-4417-b9a4-e58443e81025 None None] unpacked context: {'user_id': None, 'roles': [u'admin'], 'timestamp': '2012-05-23T03:31:42.676973', 'auth_token': '<SANITIZED>', 'remote_address': None, 'quota_class': None, 'is_admin': True, 'request_id': u'req-05754058-5c8f-4417-b9a4-e58443e81025', 'project_id': None, 'read_deleted': u'no'} from (pid=16498) _safe_log /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/rpc/common.py:180
- 2012-05-23 11:31:50 DEBUG nova.utils [req-05754058-5c8f-4417-b9a4-e58443e81025 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:31:50 DEBUG nova.utils [req-05754058-5c8f-4417-b9a4-e58443e81025 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:31:50 DEBUG nova.utils [req-05754058-5c8f-4417-b9a4-e58443e81025 None None] Attempting to grab semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:762
- 2012-05-23 11:31:50 DEBUG nova.utils [req-05754058-5c8f-4417-b9a4-e58443e81025 None None] Got semaphore "get_dhcp" for method "_get_dhcp_ip"... from (pid=16498) inner /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/utils.py:766
- 2012-05-23 11:32:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._publish_service_capabilities from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
- 2012-05-23 11:32:02 DEBUG nova.manager [-] Running periodic task FlatDHCPManager._disassociate_stale_fixed_ips from (pid=16498) periodic_tasks /usr/local/lib/python2.7/dist-packages/nova-2012.2-py2.7.egg/nova/manager.py:164
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement