2019-01-03 15:21:33.532 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:33.534 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:33.534 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:33.535 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:33.538 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:33.539 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:33.539 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.553 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.565 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:33.566 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:33.774 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:33.775 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:33.776 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:33.777 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.787 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.796 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.805 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.813 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:33.822 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.046s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:33.823 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:33.831 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:33.834 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:33.843 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:33.846 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:33.854 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955490, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:33.856 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:33.870 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:33.881 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:33.891 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:33.901 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:33.915 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:33.923 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:33.923 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:33.926 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:33.933 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:33.935 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:35.416 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:35.417 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:35.418 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:35.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:35.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:35.531 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:35.532 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:35.532 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:35.533 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:35.535 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:35.536 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:35.537 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:35.540 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:35.541 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:35.541 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.555 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.572 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:35.573 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:35.776 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:35.777 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:35.778 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:35.779 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.789 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.797 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.807 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.816 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:35.824 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.047s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:35.826 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:35.834 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:35.836 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:35.846 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:35.849 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:35.856 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955482, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:35.858 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:35.871 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:35.882 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:35.895 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:35.908 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:35.921 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:35.930 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:35.931 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:35.934 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:35.940 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:35.943 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:37.416 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:37.417 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:37.418 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:37.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:37.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:37.522 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:37.523 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:37.523 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:37.524 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:37.526 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:37.527 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:37.528 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:37.531 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:37.531 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:37.532 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.545 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.557 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:37.558 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:37.747 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:37.748 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:37.749 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:37.750 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.759 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.768 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.777 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.785 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:37.794 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.046s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:37.796 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:37.803 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:37.806 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:37.815 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:37.817 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:37.825 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955474, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:37.827 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:37.839 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:37.849 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:37.861 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:37.875 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:37.887 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:37.896 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:37.897 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:37.900 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:37.908 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:37.910 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:39.416 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:39.418 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:39.418 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:39.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:39.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:39.536 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:39.537 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:39.537 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:39.538 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:39.539 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:39.539 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:39.540 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:39.542 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:39.543 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:39.543 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.556 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.568 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:39.569 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:39.773 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:39.774 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:39.775 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:39.776 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.785 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.795 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.805 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.814 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:39.822 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.047s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:39.823 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:39.831 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:39.834 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:39.843 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:39.845 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:39.855 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955466, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:39.857 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:39.870 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:39.882 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:39.894 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:39.905 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:39.917 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:39.926 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:39.927 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:39.930 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:39.937 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:39.939 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:41.416 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:41.418 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:41.419 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:41.420 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:41.421 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:41.537 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:41.537 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:41.538 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:41.538 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:41.540 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:41.540 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:41.541 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:41.543 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:41.544 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:41.544 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.556 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.565 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:41.566 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:41.928 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:41.928 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:41.929 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:41.929 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.938 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.945 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.952 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.960 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:41.968 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.040s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:41.969 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:41.975 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:41.976 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:41.982 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:41.984 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:41.989 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955458, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:41.991 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:42.003 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:42.015 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:42.025 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:42.035 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:42.048 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:42.055 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:42.055 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:42.057 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:42.062 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:42.064 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:43.417 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:43.418 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:43.418 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:43.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:43.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:43.533 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:43.534 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:43.535 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:43.535 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:43.537 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:43.538 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:43.539 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:43.542 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:43.543 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:43.543 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.557 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.570 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:43.570 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:43.797 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:43.797 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:43.798 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:43.799 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.809 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.818 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.827 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.835 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:43.843 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.045s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:43.844 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:43.851 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:43.853 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:43.862 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:43.864 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:43.871 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955450, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:43.873 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:43.884 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:43.895 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:43.905 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:43.917 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:43.928 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:43.935 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:43.936 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:43.939 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:43.946 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:43.949 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:45.417 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:45.418 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:45.419 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:45.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:45.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:45.533 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:45.533 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:45.534 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:45.535 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:45.537 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:45.537 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:45.538 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:45.541 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:45.542 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:45.543 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.556 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.569 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:45.570 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:45.770 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:45.770 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:45.771 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:45.772 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.782 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.792 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.800 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.809 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:45.817 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.046s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:45.818 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:45.826 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:45.829 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:45.837 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:45.839 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:45.846 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955442, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:45.848 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:45.860 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:45.871 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:45.882 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:45.894 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:45.906 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:45.913 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:45.914 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:45.917 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:45.922 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:45.924 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent 2019-01-03 15:21:47.417 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Linux bridge agent Agent out of sync with plugin! 2019-01-03 15:21:47.418 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Agent loop found changes! {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])} daemon_loop /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:456 2019-01-03 15:21:47.419 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device filters for 2 new devices setup_port_filters /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:249 2019-01-03 15:21:47.419 32234 INFO neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing filters for devices set(['tap35f9e0e9-f7', 'tapc26d10e0-73']) 2019-01-03 15:21:47.420 32234 DEBUG neutron.api.rpc.handlers.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Get security group information for devices via rpc ['tap35f9e0e9-f7', 'tapc26d10e0-73'] security_group_info_for_devices /usr/lib/python2.7/site-packages/neutron/api/rpc/handlers/securitygroups_rpc.py:57 2019-01-03 15:21:47.531 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information for ports [u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9'] _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:147 2019-01-03 15:21:47.532 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update security group information _update_security_group_info /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:161 2019-01-03 15:21:47.532 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update rules of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_rules /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:142 2019-01-03 15:21:47.533 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Update members of security group (2ece3762-a86a-4e21-abf8-d5753755e8be) update_security_group_members /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:146 2019-01-03 15:21:47.534 32234 DEBUG neutron.agent.securitygroups_rpc [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Prepare port filter for tap35f9e0e9-f7 _apply_port_filter /usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py:155 2019-01-03 15:21:47.535 32234 DEBUG neutron.agent.linux.iptables_firewall [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Preparing device (tap35f9e0e9-f7) filter prepare_port_filter /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_firewall.py:183 2019-01-03 15:21:47.536 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Attempted to remove chain s35f9e0e9-f which does not exist remove_chain /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:179 2019-01-03 15:21:47.538 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212 2019-01-03 15:21:47.539 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Acquired external semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:219 2019-01-03 15:21:47.540 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['iptables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.554 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ip6tables-save'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.566 32234 DEBUG neutron.agent.linux.iptables_manager [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] IPTablesManager.apply completed with success. 0 iptables commands were issued _apply_synchronized /usr/lib/python2.7/site-packages/neutron/agent/linux/iptables_manager.py:598 2019-01-03 15:21:47.567 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Releasing semaphore "iptables" lock /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228 2019-01-03 15:21:47.775 32234 DEBUG neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 added _process_device_if_exists /usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py:235 2019-01-03 15:21:47.776 32234 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Port tap35f9e0e9-f7 updated. Details: {u'profile': {}, u'network_qos_policy_id': None, u'qos_policy_id': None, u'allowed_address_pairs': [], u'admin_state_up': True, u'network_id': u'2f36fcca-b069-48cb-aee6-b1d2e96652f5', u'segmentation_id': None, u'mtu': 1500, u'device_owner': u'compute:nova', u'physical_network': u'provider', u'mac_address': u'fa:16:3e:0c:cd:a1', u'device': u'tap35f9e0e9-f7', u'port_security_enabled': True, u'port_id': u'35f9e0e9-f7b7-4b51-98c7-810c5e5d6eb9', u'fixed_ips': [{u'subnet_id': u'1ecb9bb8-7cad-485b-8816-bda6378bd112', u'ip_address': u'192.168.15.162'}], u'network_type': u'flat'} 2019-01-03 15:21:47.776 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" acquired by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: waited 0.000s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273 2019-01-03 15:21:47.777 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-L'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.787 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:0c:cd:a1', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.796 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-D', 'neutronMAC-tap35f9e0e9-f7', '-i', 'tap35f9e0e9-f7', '--among-src', 'fa:16:3e:c:cd:a1,', '-j', 'RETURN'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.805 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-F', 'neutronARP-tap35f9e0e9-f7'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.813 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command (rootwrap daemon): ['ebtables', '-t', 'nat', '--concurrent', '-A', 'neutronARP-tap35f9e0e9-f7', '-p', 'ARP', '--arp-ip-src', '192.168.15.162', '-j', 'ACCEPT'] execute_rootwrap_daemon /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:103 2019-01-03 15:21:47.822 32234 DEBUG oslo_concurrency.lockutils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Lock "ebtables" released by "neutron.plugins.ml2.drivers.linuxbridge.agent.arp_protect._setup_arp_spoofing_protection" :: held 0.045s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285 2019-01-03 15:21:47.823 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:47.828 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:47.830 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.get_link_attributes', (u'brq2f36fcca-b0', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:47.836 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, {'alias': None, 'qlen': 1000, 'qdisc': 'noqueue', 'link/ether': 'fe:16:3e:0c:cd:a1', 'allmulticast': False, 'brd': 'ff:ff:ff:ff:ff:ff', 'state': 'UP', 'mtu': 1500}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:47.838 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.set_link_attribute', (u'brq2f36fcca-b0', None), {'state': 'up'}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:47.843 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, [{'header': {'pid': 4294955434, 'length': 36, 'flags': 0, 'error': None, 'type': 2, 'sequence_number': 255}, 'event': 'NLMSG_ERROR'}]) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:47.845 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:47.857 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-4', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:47.869 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'addr', 'show', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:47.881 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', '-6', 'route', 'list', 'dev', 'eth0', 'scope', 'global'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:47.892 32234 DEBUG neutron.agent.linux.utils [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Running command: ['ip', 'addr', 'show', 'brq2f36fcca-b0', 'to', 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:87 2019-01-03 15:21:47.904 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.add_ip_address', (6, 'fd54:8eae:84fb:0:3ed9:2bff:fe05:fca4', 64, u'brq2f36fcca-b0', None, 'global', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:47.910 32338 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[139856536265264]: (13, 'Permission denied') loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:449 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 445, in loop reply = self._process_cmd(*msg) File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 428, in _process_cmd ret = func(*f_args, **f_kwargs) File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 209, in _wrap return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 202, in add_ip_address scope=_get_scope_name(scope)) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 183, in _run_iproute_addr _translate_ip_device_exception(e, device, namespace) File "/usr/lib/python2.7/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 181, in _run_iproute_addr return ip.addr(command, index=idx, **kwargs) File "/usr/lib/python2.7/site-packages/pyroute2/iproute.py", line 1419, in addr terminate=lambda x: x['header']['type'] == File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 804, in nlm_request return do_try() File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 783, in do_try callback=callback) File "/usr/lib/python2.7/site-packages/pyroute2/netlink/nlsocket.py", line 648, in get raise msg['header']['error'] NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:47.910 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (5, 'pyroute2.netlink.exceptions.NetlinkError', (13, 'Permission denied')) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:47.913 32338 DEBUG oslo.privsep.daemon [-] privsep: request[139856536265264]: (3, 'neutron.privileged.agent.linux.ip_lib.interface_exists', (u'tap35f9e0e9-f7', None), {}) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:443 2019-01-03 15:21:47.918 32338 DEBUG oslo.privsep.daemon [-] privsep: reply[139856536265264]: (4, True) loop /usr/lib/python2.7/site-packages/oslo_privsep/daemon.py:456 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [req-fe0fb414-c3df-4018-99f1-58ebfaf37a30 - - - - -] Error in agent loop. Devices info: {'current': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'timestamps': {'tap35f9e0e9-f7': 7, 'tapc26d10e0-73': 8}, 'removed': set([]), 'added': set(['tap35f9e0e9-f7', 'tapc26d10e0-73']), 'updated': set([])}: NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent Traceback (most recent call last): 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 458, in daemon_loop 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent sync = self.process_network_devices(device_info) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 209, in process_network_devices 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 159, in wrapper 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent result = f(*args, **kwargs) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 226, in treat_devices_added_updated 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self._process_device_if_exists(device_details) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/agent/_common_agent.py", line 253, in _process_device_if_exists 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, device_details['device_owner']) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in plug_interface 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent network_segment.mtu) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 519, in add_tap_interface 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return False 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.force_reraise() 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent six.reraise(self.type_, self.value, self.tb) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 511, in add_tap_interface 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent tap_device_name, device_owner, mtu) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 543, in _add_tap_interface 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent mtu): 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 495, in ensure_physical_in_bridge 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent physical_interface) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 284, in ensure_flat_bridge 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent if self.ensure_bridge(bridge_name, physical_interface): 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 453, in ensure_bridge 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent self.update_interface_ip_details(bridge_name, interface) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 415, in update_interface_ip_details 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent gateway) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 392, in _update_interface_ip_details 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent dst_device.addr.add(cidr=ip['cidr']) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 604, in add 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent add_broadcast) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 995, in add_ip_address 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent device, namespace, scope, broadcast) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/priv_context.py", line 207, in _wrap 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent return self.channel.remote_call(name, args, kwargs) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent File "/usr/lib/python2.7/site-packages/oslo_privsep/daemon.py", line 202, in remote_call 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent raise exc_type(*result[2]) 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent NetlinkError: (13, 'Permission denied') 2019-01-03 15:21:47.920 32234 ERROR neutron.plugins.ml2.drivers.agent._common_agent [root@s1e neutron]#