API tools faq
paste
vincentepic

Untitled

vincentepic
Oct 2nd, 2018
613
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 204.95 KB | None | 0 0
raw download clone embed print report
  1. MiscFileReadException: Internal file read failure: (u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata', 1, 'Read timeout')
  2. 2018-10-02 07:08:19,938-0700 INFO (check/loop) [storage.Monitor] Domain d08b4a3d-d08d-4d7f-bc8e-69e35e057797 became INVALID (monitor:469)
  3. 2018-10-02 07:08:20,156-0700 INFO (periodic/0) [vdsm.api] START getVolumeSize(sdUUID='d08b4a3d-d08d-4d7f-bc8e-69e35e057797', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='31856584-8cdb-4863-9b78-b97413c58b78', volUUID='a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', options=None) from=internal, task_id=541f9bf8-d0aa-4bc7-9914-48f00f4b35d9 (api:46)
  4. 2018-10-02 07:08:20,647-0700 WARN (qgapoller/3) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  5. 2018-10-02 07:08:22,136-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  6. 2018-10-02 07:08:22,138-0700 INFO (jsonrpc/0) [api.host] START getStats() from=::1,43336 (api:46)
  7. 2018-10-02 07:08:22,139-0700 INFO (jsonrpc/0) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=26576f17-c82a-41cf-b3f5-4493bc2e7b72 (api:46)
  8. 2018-10-02 07:08:22,139-0700 INFO (jsonrpc/0) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.3', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.2', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.5', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '2.3', 'valid': False}} from=::1,43336, task_id=26576f17-c82a-41cf-b3f5-4493bc2e7b72 (api:52)
  9. 2018-10-02 07:08:22,140-0700 INFO (jsonrpc/0) [vdsm.api] START multipath_health() from=::1,43336, task_id=e3982237-fe87-4fc6-b992-91f1fef54904 (api:46)
  10. 2018-10-02 07:08:22,140-0700 INFO (jsonrpc/0) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=e3982237-fe87-4fc6-b992-91f1fef54904 (api:52)
  11. 2018-10-02 07:08:22,148-0700 INFO (jsonrpc/0) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '25': {'cpuUser': '0.33', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.54'}, '26': {'cpuUser': '0.67', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '2.80', 'nodeIndex': 0, 'cpuSys': '0.87', 'cpuIdle': '96.33'}, '22': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.60'}, '23': {'cpuUser': '1.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '98.93'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '3.19', 'nodeIndex': 0, 'cpuSys': '1.20', 'cpuIdle': '95.61'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.87', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '98.86'}, '2': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '5': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.40'}, '4': {'cpuUser': '0.40', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.53'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.40', 'nodeIndex': 0, 'cpuSys': '0.20', 'cpuIdle': '99.40'}, '9': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '4.73', 'nodeIndex': 1, 'cpuSys': '0.87', 'cpuIdle': '94.40'}, '10': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.33'}, '13': {'cpuUser': '1.46', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '98.27'}, '12': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '99.13'}, '15': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.46'}, '14': {'cpuUser': '1.40', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '98.47'}, '17': {'cpuUser': '0.33', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.60'}, '16': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.40'}, '19': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '18': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '31': {'cpuUser': '6.59', 'nodeIndex': 1, 'cpuSys': '1.66', 'cpuIdle': '91.75'}, '30': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.14'}, '35': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '34': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.66'}, '33': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '99.13'}, '32': {'cpuUser': '0.53', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.34'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59127'}, '0': {'memPercent': 4, 'memFree': '62821'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.3', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.2', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '2.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '2.5', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0', 'tx': '11326168694', 'txDropped': '0', 'rx': '46421534207', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ovirtmgmt', 'tx': '4399971475', 'txDropped': '0', 'rx': '42570723259', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'lo', 'tx': '174280819', 'txDropped': '0', 'rx': '174280819', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18969686', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'vnet0', 'tx': '142712016', 'txDropped': '0', 'rx': '112492707', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0.200', 'tx': '6396131806', 'txDropped': '0', 'rx': '1488820539', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ens2f0', 'tx': '11326168334', 'txDropped': '0', 'rx': '46416606980', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4927227', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20636605', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38942.22', 'cpuLoad': '1.06', 'cpuSys': '0.19', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.87', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122186, 'bootTime': '1538450196', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:08:22 GMT', 'cpuUser': '0.74', 'memFree': 122571, 'cpuIdle': '99.06', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.40'}} from=::1,43336 (api:52)
  12. 2018-10-02 07:08:22,150-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.02 seconds (__init__:573)
  13. 2018-10-02 07:08:23,930-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  14. 2018-10-02 07:08:23,933-0700 INFO (jsonrpc/1) [api.host] START getCapabilities() from=::1,43336 (api:46)
  15. 2018-10-02 07:08:24,334-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  16. 2018-10-02 07:08:24,337-0700 INFO (jsonrpc/5) [api.virt] START getStats() from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:46)
  17. 2018-10-02 07:08:24,338-0700 INFO (jsonrpc/5) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'vcpuCount': '2', 'memUsage': '76', 'acpiEnable': 'true', 'displayInfo': [{'tlsPort': '-1', 'ipAddress': '172.16.100.12', 'type': 'vnc', 'port': '5900'}], 'guestFQDN': u'ovirt-engine.malonetuning.net', 'vmId': 'c3365c53-60c1-406c-8b6f-3c86c1d9de0a', 'session': 'Unknown', 'netIfaces': [{u'inet6': [u'fe80::216:3eff:fe6a:7af9'], u'hw': u'00:16:3e:6a:7a:f9', u'inet': [u'172.16.100.13'], u'name': u'eth0'}], 'timeOffset': '0', 'memoryStats': {'swap_out': '0', 'majflt': '0', 'mem_cached': '780008', 'mem_free': '207900', 'mem_buffers': '2104', 'swap_in': '0', 'pageflt': '143', 'mem_total': '3878948', 'mem_unused': '207900'}, 'balloonInfo': {'balloon_max': '4194304', 'balloon_min': '4194304', 'balloon_target': '4194304', 'balloon_cur': '4194304'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '6565134336', u'fs': u'xfs', u'used': '2742919168'}, {u'path': u'/home', u'total': '1063256064', u'fs': u'xfs', u'used': '33792000'}, {u'path': u'/tmp', u'total': '2136997888', u'fs': u'xfs', u'used': '33964032'}, {u'path': u'/var', u'total': '21464350720', u'fs': u'xfs', u'used': '973684736'}, {u'path': u'/boot', u'total': '1063256064', u'fs': u'xfs', u'used': '300433408'}, {u'path': u'/var/log', u'total': '10726932480', u'fs': u'xfs', u'used': '160481280'}, {u'path': u'/var/log/audit', u'total': '1063256064', u'fs': u'xfs', u'used': '69861376'}], 'network': {'vnet0': {'macAddr': '00:16:3e:6a:7a:f9', 'rxDropped': '0', 'tx': '112429415', 'rxErrors': '0', 'txDropped': '0', 'rx': '142658309', 'txErrors': '0', 'state': 'unknown', 'sampleTime': 4333775.27, 'speed': '1000', 'name': 'vnet0'}}, 'vmType': 'kvm', 'guestName': u'ovirt-engine.malonetuning.net', 'elapsedTime': '35337', 'vmJobs': {}, 'cpuSys': '0.47', 'appsList': (u'kernel-3.10.0-693.17.1.el7', u'cloud-init-0.7.9-24.el7.centos.1', u'kernel-3.10.0-862.9.1.el7', u'kernel-3.10.0-862.14.4.el7', u'ovirt-guest-agent-common-1.0.14-1.el7', u'kernel-3.10.0-693.11.1.el7'), 'guestOs': u'3.10.0-862.14.4.el7.x86_64', 'vmName': 'HostedEngine', 'status': 'Up', 'clientIp': '', 'hash': '-8271365721701534724', 'guestCPUCount': 2, 'cpuUsage': '309690000000', 'vcpuPeriod': 100000L, 'guestTimezone': {u'zone': u'America/Vancouver', u'offset': -480}, 'vcpuQuota': '-1', 'statusTime': '4333775270', 'kvmEnable': 'true', 'disks': {'vda': {'readLatency': '0', 'flushLatency': '1558742', 'readRate': '0.0', 'writeRate': '28652.8980684', 'writtenBytes': '1560313856', 'truesize': '53687091200', 'apparentsize': '53687091200', 'readOps': '22779', 'writeLatency': '23545915', 'imageID': '31856584-8cdb-4863-9b78-b97413c58b78', 'readBytes': '696515584', 'writeOps': '126218'}, 'hdc': {'readLatency': '0', 'flushLatency': '0', 'readRate': '0.0', 'writeRate': '0.0', 'writtenBytes': '0', 'truesize': '0', 'apparentsize': '0', 'readOps': '4', 'writeLatency': '0', 'readBytes': '152', 'writeOps': '0'}}, 'monitorResponse': '0', 'guestOsInfo': {u'kernel': u'3.10.0-862.14.4.el7.x86_64', u'arch': u'x86_64', u'version': u'7.5.1804', u'distribution': u'CentOS Linux', u'type': u'linux', u'codename': u'Core'}, 'username': u'None', 'cpuUser': '3.82', 'lastLogin': 1538454019.865233, 'guestIPs': u'172.16.100.13', 'guestContainers': []}]} from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:52)
  18. 2018-10-02 07:08:24,339-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573)
  19. 2018-10-02 07:08:25,278-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  20. 2018-10-02 07:08:25,281-0700 INFO (jsonrpc/3) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=e178406b-667d-4a1d-b6c1-3c36dae86def (api:46)
  21. 2018-10-02 07:08:25,281-0700 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '5.3', 'valid': False}} from=::1,43336, task_id=e178406b-667d-4a1d-b6c1-3c36dae86def (api:52)
  22. 2018-10-02 07:08:25,281-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  23. 2018-10-02 07:08:26,296-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  24. 2018-10-02 07:08:26,480-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  25. 2018-10-02 07:08:26,659-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  26. 2018-10-02 07:08:26,660-0700 INFO (jsonrpc/1) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'14686', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'5521', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  27. 2018-10-02 07:08:26,672-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.74 seconds (__init__:573)
  28. 2018-10-02 07:08:27,218-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  29. 2018-10-02 07:08:27,221-0700 INFO (jsonrpc/7) [api.virt] START getStats() from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:46)
  30. 2018-10-02 07:08:27,222-0700 INFO (jsonrpc/7) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'vcpuCount': '2', 'memUsage': '76', 'acpiEnable': 'true', 'displayInfo': [{'tlsPort': '-1', 'ipAddress': '172.16.100.12', 'type': 'vnc', 'port': '5900'}], 'guestFQDN': u'ovirt-engine.malonetuning.net', 'vmId': 'c3365c53-60c1-406c-8b6f-3c86c1d9de0a', 'session': 'Unknown', 'netIfaces': [{u'inet6': [u'fe80::216:3eff:fe6a:7af9'], u'hw': u'00:16:3e:6a:7a:f9', u'inet': [u'172.16.100.13'], u'name': u'eth0'}], 'timeOffset': '0', 'memoryStats': {'swap_out': '0', 'majflt': '0', 'mem_cached': '780008', 'mem_free': '207900', 'mem_buffers': '2104', 'swap_in': '0', 'pageflt': '143', 'mem_total': '3878948', 'mem_unused': '207900'}, 'balloonInfo': {'balloon_max': '4194304', 'balloon_min': '4194304', 'balloon_target': '4194304', 'balloon_cur': '4194304'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '6565134336', u'fs': u'xfs', u'used': '2742919168'}, {u'path': u'/home', u'total': '1063256064', u'fs': u'xfs', u'used': '33792000'}, {u'path': u'/tmp', u'total': '2136997888', u'fs': u'xfs', u'used': '33964032'}, {u'path': u'/var', u'total': '21464350720', u'fs': u'xfs', u'used': '973684736'}, {u'path': u'/boot', u'total': '1063256064', u'fs': u'xfs', u'used': '300433408'}, {u'path': u'/var/log', u'total': '10726932480', u'fs': u'xfs', u'used': '160481280'}, {u'path': u'/var/log/audit', u'total': '1063256064', u'fs': u'xfs', u'used': '69861376'}], 'network': {'vnet0': {'macAddr': '00:16:3e:6a:7a:f9', 'rxDropped': '0', 'tx': '112429415', 'rxErrors': '0', 'txDropped': '0', 'rx': '142658309', 'txErrors': '0', 'state': 'unknown', 'sampleTime': 4333778.16, 'speed': '1000', 'name': 'vnet0'}}, 'vmType': 'kvm', 'guestName': u'ovirt-engine.malonetuning.net', 'elapsedTime': '35340', 'vmJobs': {}, 'cpuSys': '0.47', 'appsList': (u'kernel-3.10.0-693.17.1.el7', u'cloud-init-0.7.9-24.el7.centos.1', u'kernel-3.10.0-862.9.1.el7', u'kernel-3.10.0-862.14.4.el7', u'ovirt-guest-agent-common-1.0.14-1.el7', u'kernel-3.10.0-693.11.1.el7'), 'guestOs': u'3.10.0-862.14.4.el7.x86_64', 'vmName': 'HostedEngine', 'status': 'Up', 'clientIp': '', 'hash': '-8271365721701534724', 'guestCPUCount': 2, 'cpuUsage': '309690000000', 'vcpuPeriod': 100000L, 'guestTimezone': {u'zone': u'America/Vancouver', u'offset': -480}, 'vcpuQuota': '-1', 'statusTime': '4333778160', 'kvmEnable': 'true', 'disks': {'vda': {'readLatency': '0', 'flushLatency': '1558742', 'readRate': '0.0', 'writeRate': '28652.8980684', 'writtenBytes': '1560313856', 'truesize': '53687091200', 'apparentsize': '53687091200', 'readOps': '22779', 'writeLatency': '23545915', 'imageID': '31856584-8cdb-4863-9b78-b97413c58b78', 'readBytes': '696515584', 'writeOps': '126218'}, 'hdc': {'readLatency': '0', 'flushLatency': '0', 'readRate': '0.0', 'writeRate': '0.0', 'writtenBytes': '0', 'truesize': '0', 'apparentsize': '0', 'readOps': '4', 'writeLatency': '0', 'readBytes': '152', 'writeOps': '0'}}, 'monitorResponse': '0', 'guestOsInfo': {u'kernel': u'3.10.0-862.14.4.el7.x86_64', u'arch': u'x86_64', u'version': u'7.5.1804', u'distribution': u'CentOS Linux', u'type': u'linux', u'codename': u'Core'}, 'username': u'None', 'cpuUser': '3.82', 'lastLogin': 1538454019.865233, 'guestIPs': u'172.16.100.13', 'guestContainers': []}]} from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:52)
  31. 2018-10-02 07:08:27,223-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573)
  32. 2018-10-02 07:08:28,009-0700 WARN (vdsm.Scheduler) [Executor] executor state: count=5 workers=set([<Worker name=periodic/4 waiting task#=0 at 0x7fc69819d850>, <Worker name=periodic/0 running <Task discardable <UpdateVolumes vm=c3365c53-60c1-406c-8b6f-3c86c1d9de0a at 0x7fc6981f8150> timeout=30.0, duration=7 at 0x7fc6983c9050> task#=8212 at 0x7fc69819d310>, <Worker name=periodic/3 waiting task#=8126 at 0x7fc69819dad0>, <Worker name=periodic/1 running <Task discardable <Operation action=<vdsm.virt.sampling.VMBulkstatsMonitor object at 0x7fc69810d790> at 0x7fc69810d9d0> timeout=7.5, duration=7 at 0x7fc678518150> discarded task#=8238 at 0x7fc69819d550>, <Worker name=periodic/2 waiting task#=8176 at 0x7fc69819d810>]) (executor:213)
  33. 2018-10-02 07:08:28,010-0700 INFO (vdsm.Scheduler) [Executor] Worker discarded: <Worker name=periodic/1 running <Task discardable <Operation action=<vdsm.virt.sampling.VMBulkstatsMonitor object at 0x7fc69810d790> at 0x7fc69810d9d0> timeout=7.5, duration=7 at 0x7fc678518150> discarded task#=8238 at 0x7fc69819d550> (executor:355)
  34. 2018-10-02 07:08:29,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 20.00 seconds (check:282)
  35. 2018-10-02 07:08:29,837-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 20.00 seconds (check:282)
  36. 2018-10-02 07:08:29,877-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 20.00 seconds (check:282)
  37. 2018-10-02 07:08:29,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 20.00 seconds (check:282)
  38. 2018-10-02 07:08:30,642-0700 WARN (qgapoller/0) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  39. 2018-10-02 07:08:31,474-0700 INFO (jsonrpc/4) [api.host] START getAllVmStats() from=::1,43342 (api:46)
  40. 2018-10-02 07:08:31,475-0700 INFO (jsonrpc/4) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,43342 (api:52)
  41. 2018-10-02 07:08:31,476-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:573)
  42. 2018-10-02 07:08:31,481-0700 INFO (jsonrpc/5) [api.host] START getAllVmIoTunePolicies() from=::1,43342 (api:46)
  43. 2018-10-02 07:08:31,481-0700 INFO (jsonrpc/5) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'c3365c53-60c1-406c-8b6f-3c86c1d9de0a': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': u'/var/run/vdsm/storage/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/31856584-8cdb-4863-9b78-b97413c58b78/a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', 'name': 'vda'}]}}} from=::1,43342 (api:52)
  44. 2018-10-02 07:08:31,482-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:573)
  45. 2018-10-02 07:08:32,156-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  46. 2018-10-02 07:08:32,159-0700 INFO (jsonrpc/3) [api.host] START getStats() from=::1,43336 (api:46)
  47. 2018-10-02 07:08:32,160-0700 INFO (jsonrpc/3) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=8d93c059-7cf6-404b-80db-baf26019bae2 (api:46)
  48. 2018-10-02 07:08:32,160-0700 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '12.3', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '12.2', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '8.9', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '12.3', 'valid': False}} from=::1,43336, task_id=8d93c059-7cf6-404b-80db-baf26019bae2 (api:52)
  49. 2018-10-02 07:08:32,160-0700 INFO (jsonrpc/3) [vdsm.api] START multipath_health() from=::1,43336, task_id=42bd5fd5-6464-410a-9ecb-69abc3c65f1f (api:46)
  50. 2018-10-02 07:08:32,160-0700 INFO (jsonrpc/3) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=42bd5fd5-6464-410a-9ecb-69abc3c65f1f (api:52)
  51. 2018-10-02 07:08:32,170-0700 INFO (jsonrpc/3) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '25': {'cpuUser': '0.33', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.54'}, '26': {'cpuUser': '0.67', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '2.80', 'nodeIndex': 0, 'cpuSys': '0.87', 'cpuIdle': '96.33'}, '22': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.60'}, '23': {'cpuUser': '1.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '98.93'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '3.19', 'nodeIndex': 0, 'cpuSys': '1.20', 'cpuIdle': '95.61'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.87', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '98.86'}, '2': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '5': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.40'}, '4': {'cpuUser': '0.40', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.53'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.40', 'nodeIndex': 0, 'cpuSys': '0.20', 'cpuIdle': '99.40'}, '9': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '4.73', 'nodeIndex': 1, 'cpuSys': '0.87', 'cpuIdle': '94.40'}, '10': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.33'}, '13': {'cpuUser': '1.46', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '98.27'}, '12': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '99.13'}, '15': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.46'}, '14': {'cpuUser': '1.40', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '98.47'}, '17': {'cpuUser': '0.33', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.60'}, '16': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.40'}, '19': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '18': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '31': {'cpuUser': '6.59', 'nodeIndex': 1, 'cpuSys': '1.66', 'cpuIdle': '91.75'}, '30': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.14'}, '35': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '34': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.66'}, '33': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '99.13'}, '32': {'cpuUser': '0.53', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.34'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59127'}, '0': {'memPercent': 4, 'memFree': '62821'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '12.3', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '12.2', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '12.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '8.9', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0', 'tx': '11326168694', 'txDropped': '0', 'rx': '46421534207', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ovirtmgmt', 'tx': '4399971475', 'txDropped': '0', 'rx': '42570723259', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'lo', 'tx': '174280819', 'txDropped': '0', 'rx': '174280819', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18969686', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'vnet0', 'tx': '142712016', 'txDropped': '0', 'rx': '112492707', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0.200', 'tx': '6396131806', 'txDropped': '0', 'rx': '1488820539', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ens2f0', 'tx': '11326168334', 'txDropped': '0', 'rx': '46416606980', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4927227', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489298.585429, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20636605', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489298.585429, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38952.24', 'cpuLoad': '1.06', 'cpuSys': '0.19', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.87', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122177, 'bootTime': '1538450196', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:08:32 GMT', 'cpuUser': '0.74', 'memFree': 122561, 'cpuIdle': '99.06', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.40'}} from=::1,43336 (api:52)
  52. 2018-10-02 07:08:32,171-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.02 seconds (__init__:573)
  53. 2018-10-02 07:08:33,621-0700 INFO (periodic/3) [vdsm.api] START repoStats(domains=()) from=internal, task_id=71d337ca-ca00-4481-b7cf-a934def6c41f (api:46)
  54. 2018-10-02 07:08:33,621-0700 INFO (periodic/3) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '13.8', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '13.7', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '0.4', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '13.7', 'valid': False}} from=internal, task_id=71d337ca-ca00-4481-b7cf-a934def6c41f (api:52)
  55. 2018-10-02 07:08:33,621-0700 INFO (periodic/3) [vdsm.api] START multipath_health() from=internal, task_id=fc332010-a360-4bd7-a4c4-f8e3ab973f99 (api:46)
  56. 2018-10-02 07:08:33,622-0700 INFO (periodic/3) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=fc332010-a360-4bd7-a4c4-f8e3ab973f99 (api:52)
  57. 2018-10-02 07:08:34,708-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  58. 2018-10-02 07:08:34,711-0700 INFO (jsonrpc/0) [api.host] START getCapabilities() from=::1,43336 (api:46)
  59. 2018-10-02 07:08:35,295-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  60. 2018-10-02 07:08:35,298-0700 INFO (jsonrpc/4) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=46037a93-ec73-4f18-908c-a0791e745fce (api:46)
  61. 2018-10-02 07:08:35,298-0700 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '15.4', 'valid': False}} from=::1,43336, task_id=46037a93-ec73-4f18-908c-a0791e745fce (api:52)
  62. 2018-10-02 07:08:35,298-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  63. 2018-10-02 07:08:37,043-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  64. 2018-10-02 07:08:37,068-0700 INFO (jsonrpc/0) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  65. 2018-10-02 07:08:37,223-0700 INFO (jsonrpc/0) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  66. 2018-10-02 07:08:37,391-0700 INFO (jsonrpc/0) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  67. 2018-10-02 07:08:37,392-0700 INFO (jsonrpc/0) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'13609', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'4444', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  68. 2018-10-02 07:08:37,401-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.69 seconds (__init__:573)
  69. 2018-10-02 07:08:39,638-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 29.99 seconds (check:282)
  70. 2018-10-02 07:08:39,838-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 30.00 seconds (check:282)
  71. 2018-10-02 07:08:39,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 30.00 seconds (check:282)
  72. 2018-10-02 07:08:39,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 30.00 seconds (check:282)
  73. 2018-10-02 07:08:40,646-0700 WARN (qgapoller/1) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  74. 2018-10-02 07:08:42,186-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  75. 2018-10-02 07:08:42,189-0700 INFO (jsonrpc/3) [api.host] START getStats() from=::1,43336 (api:46)
  76. 2018-10-02 07:08:42,190-0700 INFO (jsonrpc/3) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=29688f24-9657-4946-b9ed-0050c8ef5e36 (api:46)
  77. 2018-10-02 07:08:42,190-0700 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '22.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '22.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '8.9', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '22.3', 'valid': False}} from=::1,43336, task_id=29688f24-9657-4946-b9ed-0050c8ef5e36 (api:52)
  78. 2018-10-02 07:08:42,190-0700 INFO (jsonrpc/3) [vdsm.api] START multipath_health() from=::1,43336, task_id=970d4a47-5a55-4b84-92cd-a762b1bb84c6 (api:46)
  79. 2018-10-02 07:08:42,190-0700 INFO (jsonrpc/3) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=970d4a47-5a55-4b84-92cd-a762b1bb84c6 (api:52)
  80. 2018-10-02 07:08:42,199-0700 INFO (jsonrpc/3) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '1.00', 'nodeIndex': 0, 'cpuSys': '0.20', 'cpuIdle': '98.80'}, '25': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '26': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '3.13', 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': '96.27'}, '22': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '23': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '4.13', 'nodeIndex': 0, 'cpuSys': '0.93', 'cpuIdle': '94.94'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '3': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '98.94'}, '2': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '5': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '99.53'}, '4': {'cpuUser': '1.00', 'nodeIndex': 0, 'cpuSys': '0.20', 'cpuIdle': '98.80'}, '7': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '6': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '9': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '38': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '11': {'cpuUser': '3.73', 'nodeIndex': 1, 'cpuSys': '0.67', 'cpuIdle': '95.60'}, '10': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.27'}, '13': {'cpuUser': '1.00', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '98.80'}, '12': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '99.07'}, '15': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '99.67'}, '14': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '17': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.80'}, '16': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '99.67'}, '19': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.73'}, '18': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '31': {'cpuUser': '6.13', 'nodeIndex': 1, 'cpuSys': '1.33', 'cpuIdle': '92.54'}, '30': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '34': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '33': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '32': {'cpuUser': '0.60', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.33'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59116'}, '0': {'memPercent': 4, 'memFree': '62821'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '22.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '22.3', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '22.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '8.9', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'bond0', 'tx': '11326265756', 'txDropped': '0', 'rx': '46422108866', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489313.6035, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'ovirtmgmt', 'tx': '4400049842', 'txDropped': '0', 'rx': '42570737054', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'lo', 'tx': '174333213', 'txDropped': '0', 'rx': '174333213', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18970204', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489313.6035, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'vnet0', 'tx': '142720939', 'txDropped': '0', 'rx': '112509462', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489313.6035, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489313.6035, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'bond0.200', 'tx': '6396135988', 'txDropped': '0', 'rx': '1489349661', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'ens2f0', 'tx': '11326265396', 'txDropped': '0', 'rx': '46417180751', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4928115', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489313.6035, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20637123', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489313.6035, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38962.27', 'cpuLoad': '2.24', 'cpuSys': '0.15', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.60', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122169, 'bootTime': '1538450196', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:08:42 GMT', 'cpuUser': '0.64', 'memFree': 122553, 'cpuIdle': '99.20', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.27'}} from=::1,43336 (api:52)
  81. 2018-10-02 07:08:42,201-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.02 seconds (__init__:573)
  82. 2018-10-02 07:08:44,437-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  83. 2018-10-02 07:08:44,439-0700 INFO (jsonrpc/7) [api.host] START getCapabilities() from=::1,43336 (api:46)
  84. 2018-10-02 07:08:44,479-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  85. 2018-10-02 07:08:44,507-0700 INFO (jsonrpc/5) [api.virt] START getStats() from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:46)
  86. 2018-10-02 07:08:44,508-0700 INFO (jsonrpc/5) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '172.16.100.12', 'type': 'vnc', 'port': '5900'}], 'memUsage': '76', 'acpiEnable': 'true', 'guestFQDN': u'ovirt-engine.malonetuning.net', 'vmId': 'c3365c53-60c1-406c-8b6f-3c86c1d9de0a', 'session': 'Unknown', 'netIfaces': [{u'inet6': [u'fe80::216:3eff:fe6a:7af9'], u'hw': u'00:16:3e:6a:7a:f9', u'inet': [u'172.16.100.13'], u'name': u'eth0'}], 'timeOffset': '0', 'memoryStats': {'swap_out': '0', 'majflt': '0', 'mem_cached': '780008', 'mem_free': '207900', 'mem_buffers': '2104', 'swap_in': '0', 'pageflt': '143', 'mem_total': '3878948', 'mem_unused': '207900'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '6565134336', u'fs': u'xfs', u'used': '2742919168'}, {u'path': u'/home', u'total': '1063256064', u'fs': u'xfs', u'used': '33792000'}, {u'path': u'/tmp', u'total': '2136997888', u'fs': u'xfs', u'used': '33964032'}, {u'path': u'/var', u'total': '21464350720', u'fs': u'xfs', u'used': '973684736'}, {u'path': u'/boot', u'total': '1063256064', u'fs': u'xfs', u'used': '300433408'}, {u'path': u'/var/log', u'total': '10726932480', u'fs': u'xfs', u'used': '160481280'}, {u'path': u'/var/log/audit', u'total': '1063256064', u'fs': u'xfs', u'used': '69861376'}], 'vmType': 'kvm', 'guestName': u'ovirt-engine.malonetuning.net', 'elapsedTime': '35357', 'vmJobs': {}, 'cpuSys': '0.00', 'appsList': (u'kernel-3.10.0-693.17.1.el7', u'cloud-init-0.7.9-24.el7.centos.1', u'kernel-3.10.0-862.9.1.el7', u'kernel-3.10.0-862.14.4.el7', u'ovirt-guest-agent-common-1.0.14-1.el7', u'kernel-3.10.0-693.11.1.el7'), 'guestOs': u'3.10.0-862.14.4.el7.x86_64', 'vmName': 'HostedEngine', 'status': 'Up', 'clientIp': '', 'hash': '-8271365721701534724', 'guestCPUCount': 2, 'cpuUsage': '0.00', 'vcpuPeriod': 100000L, 'guestTimezone': {u'zone': u'America/Vancouver', u'offset': -480}, 'vcpuQuota': '-1', 'statusTime': '4333795440', 'kvmEnable': 'true', 'monitorResponse': '0', 'guestOsInfo': {u'kernel': u'3.10.0-862.14.4.el7.x86_64', u'arch': u'x86_64', u'version': u'7.5.1804', u'distribution': u'CentOS Linux', u'type': u'linux', u'codename': u'Core'}, 'username': u'None', 'cpuUser': '0.00', 'lastLogin': 1538454019.865233, 'guestIPs': u'172.16.100.13', 'guestContainers': []}]} from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:52)
  87. 2018-10-02 07:08:44,509-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573)
  88. 2018-10-02 07:08:45,312-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  89. 2018-10-02 07:08:45,315-0700 INFO (jsonrpc/2) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=9d22253a-3ea0-4db9-8d8e-9a80b1cd7b24 (api:46)
  90. 2018-10-02 07:08:45,315-0700 INFO (jsonrpc/2) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '25.4', 'valid': False}} from=::1,43336, task_id=9d22253a-3ea0-4db9-8d8e-9a80b1cd7b24 (api:52)
  91. 2018-10-02 07:08:45,315-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  92. 2018-10-02 07:08:46,497-0700 INFO (jsonrpc/3) [api.host] START getAllVmStats() from=::1,43342 (api:46)
  93. 2018-10-02 07:08:46,498-0700 INFO (jsonrpc/3) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,43342 (api:52)
  94. 2018-10-02 07:08:46,498-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:573)
  95. 2018-10-02 07:08:46,502-0700 INFO (jsonrpc/1) [api.host] START getAllVmIoTunePolicies() from=::1,43342 (api:46)
  96. 2018-10-02 07:08:46,502-0700 INFO (jsonrpc/1) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'c3365c53-60c1-406c-8b6f-3c86c1d9de0a': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': u'/var/run/vdsm/storage/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/31856584-8cdb-4863-9b78-b97413c58b78/a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', 'name': 'vda'}]}}} from=::1,43342 (api:52)
  97. 2018-10-02 07:08:46,502-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:573)
  98. 2018-10-02 07:08:46,802-0700 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  99. 2018-10-02 07:08:46,979-0700 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  100. 2018-10-02 07:08:47,163-0700 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  101. 2018-10-02 07:08:47,164-0700 INFO (jsonrpc/7) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'12636', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'3471', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  102. 2018-10-02 07:08:47,176-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.74 seconds (__init__:573)
  103. 2018-10-02 07:08:48,645-0700 INFO (periodic/4) [vdsm.api] START repoStats(domains=()) from=internal, task_id=799c9a26-1bdd-4817-be0a-945d9ae08a21 (api:46)
  104. 2018-10-02 07:08:48,645-0700 INFO (periodic/4) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '28.8', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '28.7', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '5.4', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '28.8', 'valid': False}} from=internal, task_id=799c9a26-1bdd-4817-be0a-945d9ae08a21 (api:52)
  105. 2018-10-02 07:08:48,646-0700 INFO (periodic/4) [vdsm.api] START multipath_health() from=internal, task_id=21cd597d-8b66-4eee-a840-36977f395897 (api:46)
  106. 2018-10-02 07:08:48,646-0700 INFO (periodic/4) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=21cd597d-8b66-4eee-a840-36977f395897 (api:52)
  107. 2018-10-02 07:08:49,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 40.00 seconds (check:282)
  108. 2018-10-02 07:08:49,838-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 40.00 seconds (check:282)
  109. 2018-10-02 07:08:49,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 40.00 seconds (check:282)
  110. 2018-10-02 07:08:49,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 40.00 seconds (check:282)
  111. 2018-10-02 07:08:50,160-0700 WARN (vdsm.Scheduler) [Executor] executor state: count=6 workers=set([<Worker name=periodic/2 waiting task#=8183 at 0x7fc69819d810>, <Worker name=periodic/4 waiting task#=5 at 0x7fc69819d850>, <Worker name=periodic/3 waiting task#=8131 at 0x7fc69819dad0>, <Worker name=periodic/0 running <Task discardable <UpdateVolumes vm=c3365c53-60c1-406c-8b6f-3c86c1d9de0a at 0x7fc6981f8150> timeout=30.0, duration=30 at 0x7fc6983c9050> discarded task#=8212 at 0x7fc69819d310>, <Worker name=periodic/1 running <Task discardable <Operation action=<vdsm.virt.sampling.VMBulkstatsMonitor object at 0x7fc69810d790> at 0x7fc69810d9d0> timeout=7.5, duration=29 at 0x7fc678518150> discarded task#=8238 at 0x7fc69819d550>, <Worker name=periodic/5 waiting task#=0 at 0x7fc69af91f90>]) (executor:213)
  112. 2018-10-02 07:08:50,161-0700 INFO (vdsm.Scheduler) [Executor] Worker discarded: <Worker name=periodic/0 running <Task discardable <UpdateVolumes vm=c3365c53-60c1-406c-8b6f-3c86c1d9de0a at 0x7fc6981f8150> timeout=30.0, duration=30 at 0x7fc6983c9050> discarded task#=8212 at 0x7fc69819d310> (executor:355)
  113. 2018-10-02 07:08:50,642-0700 WARN (qgapoller/2) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  114. 2018-10-02 07:08:52,215-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  115. 2018-10-02 07:08:52,218-0700 INFO (jsonrpc/5) [api.host] START getStats() from=::1,43336 (api:46)
  116. 2018-10-02 07:08:52,219-0700 INFO (jsonrpc/5) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=9c24df64-1cd7-45a0-b667-44af88abd9ad (api:46)
  117. 2018-10-02 07:08:52,219-0700 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '32.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '32.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '32.3', 'valid': False}} from=::1,43336, task_id=9c24df64-1cd7-45a0-b667-44af88abd9ad (api:52)
  118. 2018-10-02 07:08:52,219-0700 INFO (jsonrpc/5) [vdsm.api] START multipath_health() from=::1,43336, task_id=d24f4931-12ee-4052-abe1-b934c7170925 (api:46)
  119. 2018-10-02 07:08:52,219-0700 INFO (jsonrpc/5) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=d24f4931-12ee-4052-abe1-b934c7170925 (api:52)
  120. 2018-10-02 07:08:52,227-0700 INFO (jsonrpc/5) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '0.60', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.27'}, '25': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '26': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '1.33', 'nodeIndex': 0, 'cpuSys': '0.40', 'cpuIdle': '98.27'}, '22': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.40', 'cpuIdle': '99.13'}, '23': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '2.00', 'nodeIndex': 0, 'cpuSys': '0.67', 'cpuIdle': '97.33'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.67', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '99.06'}, '2': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.46'}, '5': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.87'}, '4': {'cpuUser': '0.33', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.60'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '9': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '6.92', 'nodeIndex': 1, 'cpuSys': '1.13', 'cpuIdle': '91.95'}, '10': {'cpuUser': '0.87', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.00'}, '13': {'cpuUser': '1.40', 'nodeIndex': 1, 'cpuSys': '0.33', 'cpuIdle': '98.27'}, '12': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '15': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '14': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '17': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '99.33'}, '16': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '19': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '18': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '31': {'cpuUser': '7.92', 'nodeIndex': 1, 'cpuSys': '1.60', 'cpuIdle': '90.48'}, '30': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.66'}, '37': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.20'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '34': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.20'}, '33': {'cpuUser': '1.06', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '98.74'}, '32': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.74'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59115'}, '0': {'memPercent': 4, 'memFree': '62813'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '32.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '32.3', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '32.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0', 'tx': '11326339258', 'txDropped': '0', 'rx': '46422699376', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ovirtmgmt', 'tx': '4400122054', 'txDropped': '0', 'rx': '42570760297', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'lo', 'tx': '174388214', 'txDropped': '0', 'rx': '174388214', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18980878', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'vnet0', 'tx': '142739662', 'txDropped': '0', 'rx': '112512376', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0.200', 'tx': '6396139990', 'txDropped': '0', 'rx': '1489878444', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ens2f0', 'tx': '11326338898', 'txDropped': '0', 'rx': '46417770428', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4928948', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20647797', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38972.30', 'cpuLoad': '3.40', 'cpuSys': '0.17', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.73', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122161, 'bootTime': '1538450196', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:08:52 GMT', 'cpuUser': '0.70', 'memFree': 122546, 'cpuIdle': '99.13', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.27'}} from=::1,43336 (api:52)
  121. 2018-10-02 07:08:52,229-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:573)
  122. 2018-10-02 07:08:54,214-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  123. 2018-10-02 07:08:54,217-0700 INFO (jsonrpc/2) [api.host] START getCapabilities() from=::1,43336 (api:46)
  124. 2018-10-02 07:08:55,329-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  125. 2018-10-02 07:08:55,332-0700 INFO (jsonrpc/1) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=5ac2c5d2-5b65-47a8-8d45-7b96d17475dd (api:46)
  126. 2018-10-02 07:08:55,332-0700 INFO (jsonrpc/1) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '35.4', 'valid': False}} from=::1,43336, task_id=5ac2c5d2-5b65-47a8-8d45-7b96d17475dd (api:52)
  127. 2018-10-02 07:08:55,332-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  128. 2018-10-02 07:08:56,570-0700 INFO (jsonrpc/2) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  129. 2018-10-02 07:08:56,740-0700 INFO (jsonrpc/2) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  130. 2018-10-02 07:08:56,917-0700 INFO (jsonrpc/2) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  131. 2018-10-02 07:08:56,918-0700 INFO (jsonrpc/2) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'11658', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'2494', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  132. 2018-10-02 07:08:56,930-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.71 seconds (__init__:573)
  133. 2018-10-02 07:08:59,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 50.00 seconds (check:282)
  134. 2018-10-02 07:08:59,838-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 50.00 seconds (check:282)
  135. 2018-10-02 07:08:59,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 50.00 seconds (check:282)
  136. 2018-10-02 07:08:59,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 50.00 seconds (check:282)
  137. 2018-10-02 07:09:00,646-0700 WARN (qgapoller/3) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  138. 2018-10-02 07:09:01,517-0700 INFO (jsonrpc/7) [api.host] START getAllVmStats() from=::1,43342 (api:46)
  139. 2018-10-02 07:09:01,518-0700 INFO (jsonrpc/7) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,43342 (api:52)
  140. 2018-10-02 07:09:01,519-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:573)
  141. 2018-10-02 07:09:01,525-0700 INFO (jsonrpc/4) [api.host] START getAllVmIoTunePolicies() from=::1,43342 (api:46)
  142. 2018-10-02 07:09:01,525-0700 INFO (jsonrpc/4) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'c3365c53-60c1-406c-8b6f-3c86c1d9de0a': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': u'/var/run/vdsm/storage/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/31856584-8cdb-4863-9b78-b97413c58b78/a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', 'name': 'vda'}]}}} from=::1,43342 (api:52)
  143. 2018-10-02 07:09:01,525-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:573)
  144. 2018-10-02 07:09:02,244-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  145. 2018-10-02 07:09:02,248-0700 INFO (jsonrpc/0) [api.host] START getStats() from=::1,43336 (api:46)
  146. 2018-10-02 07:09:02,248-0700 INFO (jsonrpc/0) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=9c87ac7f-5d5f-4e19-b939-c037ed0c7508 (api:46)
  147. 2018-10-02 07:09:02,249-0700 INFO (jsonrpc/0) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '42.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '42.3', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '42.4', 'valid': False}} from=::1,43336, task_id=9c87ac7f-5d5f-4e19-b939-c037ed0c7508 (api:52)
  148. 2018-10-02 07:09:02,249-0700 INFO (jsonrpc/0) [vdsm.api] START multipath_health() from=::1,43336, task_id=802ac27a-560f-4079-a038-98afe98c6751 (api:46)
  149. 2018-10-02 07:09:02,249-0700 INFO (jsonrpc/0) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=802ac27a-560f-4079-a038-98afe98c6751 (api:52)
  150. 2018-10-02 07:09:02,258-0700 INFO (jsonrpc/0) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '0.60', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.27'}, '25': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '26': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '1.33', 'nodeIndex': 0, 'cpuSys': '0.40', 'cpuIdle': '98.27'}, '22': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.40', 'cpuIdle': '99.13'}, '23': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '2.00', 'nodeIndex': 0, 'cpuSys': '0.67', 'cpuIdle': '97.33'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.67', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '99.06'}, '2': {'cpuUser': '0.47', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.46'}, '5': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.87'}, '4': {'cpuUser': '0.33', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.60'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '9': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '6.92', 'nodeIndex': 1, 'cpuSys': '1.13', 'cpuIdle': '91.95'}, '10': {'cpuUser': '0.87', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.00'}, '13': {'cpuUser': '1.40', 'nodeIndex': 1, 'cpuSys': '0.33', 'cpuIdle': '98.27'}, '12': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.67'}, '15': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '14': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '17': {'cpuUser': '0.47', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '99.33'}, '16': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '19': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '18': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '31': {'cpuUser': '7.92', 'nodeIndex': 1, 'cpuSys': '1.60', 'cpuIdle': '90.48'}, '30': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.66'}, '37': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.20'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '34': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.20'}, '33': {'cpuUser': '1.06', 'nodeIndex': 1, 'cpuSys': '0.20', 'cpuIdle': '98.74'}, '32': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.74'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59115'}, '0': {'memPercent': 4, 'memFree': '62813'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '42.4', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '42.3', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '42.4', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0', 'tx': '11326339258', 'txDropped': '0', 'rx': '46422699376', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ovirtmgmt', 'tx': '4400122054', 'txDropped': '0', 'rx': '42570760297', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'lo', 'tx': '174388214', 'txDropped': '0', 'rx': '174388214', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18980878', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'vnet0', 'tx': '142739662', 'txDropped': '0', 'rx': '112512376', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0.200', 'tx': '6396139990', 'txDropped': '0', 'rx': '1489878444', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ens2f0', 'tx': '11326338898', 'txDropped': '0', 'rx': '46417770428', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4928948', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489328.629733, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20647797', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489328.629733, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38982.33', 'cpuLoad': '3.40', 'cpuSys': '0.17', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.73', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122157, 'bootTime': '1538450196', 'haStats': {'active': False, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:09:02 GMT', 'cpuUser': '0.70', 'memFree': 122541, 'cpuIdle': '99.13', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.27'}} from=::1,43336 (api:52)
  151. 2018-10-02 07:09:02,260-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:573)
  152. 2018-10-02 07:09:03,675-0700 INFO (periodic/4) [vdsm.api] START repoStats(domains=()) from=internal, task_id=38f6ba99-289f-40e5-a435-f0064dc12de6 (api:46)
  153. 2018-10-02 07:09:03,675-0700 INFO (periodic/4) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '43.8', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '43.7', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '0.4', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0', 'lastCheck': '43.8', 'valid': False}} from=internal, task_id=38f6ba99-289f-40e5-a435-f0064dc12de6 (api:52)
  154. 2018-10-02 07:09:03,675-0700 INFO (periodic/4) [vdsm.api] START multipath_health() from=internal, task_id=2c48ee46-8a01-4e52-bcb4-ece82a5b0a2a (api:46)
  155. 2018-10-02 07:09:03,675-0700 INFO (periodic/4) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=2c48ee46-8a01-4e52-bcb4-ece82a5b0a2a (api:52)
  156. 2018-10-02 07:09:03,942-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  157. 2018-10-02 07:09:03,945-0700 INFO (jsonrpc/1) [api.host] START getCapabilities() from=::1,43336 (api:46)
  158. 2018-10-02 07:09:04,594-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  159. 2018-10-02 07:09:04,596-0700 INFO (jsonrpc/7) [api.virt] START getStats() from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:46)
  160. 2018-10-02 07:09:04,597-0700 INFO (jsonrpc/7) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '172.16.100.12', 'type': 'vnc', 'port': '5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': u'ovirt-engine.malonetuning.net', 'vmId': 'c3365c53-60c1-406c-8b6f-3c86c1d9de0a', 'session': 'Unknown', 'netIfaces': [{u'inet6': [u'fe80::216:3eff:fe6a:7af9'], u'hw': u'00:16:3e:6a:7a:f9', u'inet': [u'172.16.100.13'], u'name': u'eth0'}], 'timeOffset': '0', 'memoryStats': {'swap_out': '0', 'majflt': '0', 'mem_cached': '780008', 'mem_free': '207900', 'mem_buffers': '2104', 'swap_in': '0', 'pageflt': '143', 'mem_total': '3878948', 'mem_unused': '207900'}, 'pauseCode': 'NOERR', 'disksUsage': [{u'path': u'/', u'total': '6565134336', u'fs': u'xfs', u'used': '2742919168'}, {u'path': u'/home', u'total': '1063256064', u'fs': u'xfs', u'used': '33792000'}, {u'path': u'/tmp', u'total': '2136997888', u'fs': u'xfs', u'used': '33964032'}, {u'path': u'/var', u'total': '21464350720', u'fs': u'xfs', u'used': '973684736'}, {u'path': u'/boot', u'total': '1063256064', u'fs': u'xfs', u'used': '300433408'}, {u'path': u'/var/log', u'total': '10726932480', u'fs': u'xfs', u'used': '160481280'}, {u'path': u'/var/log/audit', u'total': '1063256064', u'fs': u'xfs', u'used': '69861376'}], 'vmType': 'kvm', 'guestName': u'ovirt-engine.malonetuning.net', 'elapsedTime': '35377', 'vmJobs': {}, 'cpuSys': '0.00', 'appsList': (u'kernel-3.10.0-693.17.1.el7', u'cloud-init-0.7.9-24.el7.centos.1', u'kernel-3.10.0-862.9.1.el7', u'kernel-3.10.0-862.14.4.el7', u'ovirt-guest-agent-common-1.0.14-1.el7', u'kernel-3.10.0-693.11.1.el7'), 'guestOs': u'3.10.0-862.14.4.el7.x86_64', 'vmName': 'HostedEngine', 'status': 'Up', 'clientIp': '', 'hash': '-8271365721701534724', 'guestCPUCount': 2, 'cpuUsage': '0.00', 'vcpuPeriod': 100000L, 'guestTimezone': {u'zone': u'America/Vancouver', u'offset': -480}, 'vcpuQuota': '-1', 'statusTime': '4333815530', 'kvmEnable': 'true', 'monitorResponse': '0', 'guestOsInfo': {u'kernel': u'3.10.0-862.14.4.el7.x86_64', u'arch': u'x86_64', u'version': u'7.5.1804', u'distribution': u'CentOS Linux', u'type': u'linux', u'codename': u'Core'}, 'username': u'None', 'cpuUser': '0.00', 'lastLogin': 1538454019.865233, 'guestIPs': u'172.16.100.13', 'guestContainers': []}]} from=::1,43336, vmId=c3365c53-60c1-406c-8b6f-3c86c1d9de0a (api:52)
  161. 2018-10-02 07:09:04,598-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573)
  162. 2018-10-02 07:09:05,338-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  163. 2018-10-02 07:09:05,342-0700 INFO (jsonrpc/5) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=23021d4c-5c03-42c1-ac82-9c5ea3ec68ce (api:46)
  164. 2018-10-02 07:09:05,342-0700 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '45.4', 'valid': False}} from=::1,43336, task_id=23021d4c-5c03-42c1-ac82-9c5ea3ec68ce (api:52)
  165. 2018-10-02 07:09:05,342-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  166. 2018-10-02 07:09:06,115-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  167. 2018-10-02 07:09:06,296-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  168. 2018-10-02 07:09:06,474-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  169. 2018-10-02 07:09:06,623-0700 WARN (vdsm.Scheduler) [Executor] Worker blocked: <Worker name=jsonrpc/6 running <Task <JsonRpcTask {'params': {u'storagepoolID': u'5a77bed1-0238-030c-0122-0000000003b3'}, 'jsonrpc': '2.0', 'method': u'StoragePool.getSpmStatus', 'id': u'38a50f30-87c8-4f4b-ac21-3b74f539ba51'} at 0x7fc6786ecb10> timeout=60, duration=60 at 0x7fc6786ecd10> task#=8003 at 0x7fc6bc056e50>, traceback:
  170. File: "/usr/lib64/python2.7/threading.py", line 785, in __bootstrap
  171. self.__bootstrap_inner()
  172. File: "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner
  173. self.run()
  174. File: "/usr/lib64/python2.7/threading.py", line 765, in run
  175. self.__target(*self.__args, **self.__kwargs)
  176. File: "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 194, in run
  177. ret = func(*args, **kwargs)
  178. File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 301, in _run
  179. self._execute_task()
  180. File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 315, in _execute_task
  181. task()
  182. File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 391, in __call__
  183. self._callable()
  184. File: "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 523, in __call__
  185. self._handler(self._ctx, self._req)
  186. File: "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 566, in _serveRequest
  187. response = self._handle_request(req, ctx)
  188. File: "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in _handle_request
  189. res = method(**params)
  190. File: "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in _dynamicMethod
  191. result = fn(*methodArgs)
  192. File: "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1107, in getSpmStatus
  193. return self._irs.getSpmStatus(self._UUID)
  194. File: "/usr/lib/python2.7/site-packages/vdsm/storage/dispatcher.py", line 73, in wrapper
  195. result = ctask.prepare(func, *args, **kwargs)
  196. File: "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 108, in wrapper
  197. return m(self, *a, **kw)
  198. File: "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 1179, in prepare
  199. result = self._run(func, *args, **kwargs)
  200. File: "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run
  201. return fn(*args, **kargs)
  202. File: "<string>", line 2, in getSpmStatus
  203. File: "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
  204. ret = func(*args, **kwargs)
  205. File: "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 636, in getSpmStatus
  206. status = self._getSpmStatusInfo(pool)
  207. File: "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 630, in _getSpmStatusInfo
  208. (pool.spmRole,) + pool.getSpmStatus()))
  209. File: "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 141, in getSpmStatus
  210. return self._backend.getSpmStatus()
  211. File: "/usr/lib/python2.7/site-packages/vdsm/storage/spbackends.py", line 435, in getSpmStatus
  212. lVer, spmId = self.masterDomain.inquireClusterLock()
  213. File: "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 853, in inquireClusterLock
  214. return self._manifest.inquireDomainLock()
  215. File: "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 524, in inquireDomainLock
  216. return self._domainLock.inquire(self.getDomainLease())
  217. File: "/usr/lib/python2.7/site-packages/vdsm/storage/clusterlock.py", line 427, in inquire
  218. resource = sanlock.read_resource(lease.path, lease.offset) (executor:363)
  219. 2018-10-02 07:09:06,659-0700 INFO (jsonrpc/1) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  220. 2018-10-02 07:09:06,660-0700 INFO (jsonrpc/1) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'10685', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'1520', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  221. 2018-10-02 07:09:06,670-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.72 seconds (__init__:573)
  222. 2018-10-02 07:09:09,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 60.00 seconds (check:282)
  223. 2018-10-02 07:09:09,838-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 60.00 seconds (check:282)
  224. 2018-10-02 07:09:09,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 60.00 seconds (check:282)
  225. 2018-10-02 07:09:09,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 60.00 seconds (check:282)
  226. 2018-10-02 07:09:10,644-0700 WARN (qgapoller/0) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  227. 2018-10-02 07:09:10,810-0700 ERROR (monitor/d08b4a3) [storage.Monitor] Error checking domain d08b4a3d-d08d-4d7f-bc8e-69e35e057797 (monitor:424)
  228. Traceback (most recent call last):
  229. File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 405, in _checkDomainStatus
  230. self.domain.selftest()
  231. File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 711, in selftest
  232. self.oop.os.statvfs(self.domaindir)
  233. File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", line 244, in statvfs
  234. return self._iop.statvfs(path)
  235. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 479, in statvfs
  236. resdict = self._sendCommand("statvfs", {"path": path}, self.timeout)
  237. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 442, in _sendCommand
  238. raise Timeout(os.strerror(errno.ETIMEDOUT))
  239. Timeout: Connection timed out
  240. 2018-10-02 07:09:10,824-0700 ERROR (monitor/7000be7) [storage.Monitor] Error checking domain 7000be72-ddb7-48d8-82d2-095a026425ff (monitor:424)
  241. Traceback (most recent call last):
  242. File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 405, in _checkDomainStatus
  243. self.domain.selftest()
  244. File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 711, in selftest
  245. self.oop.os.statvfs(self.domaindir)
  246. File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", line 244, in statvfs
  247. return self._iop.statvfs(path)
  248. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 479, in statvfs
  249. resdict = self._sendCommand("statvfs", {"path": path}, self.timeout)
  250. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 442, in _sendCommand
  251. raise Timeout(os.strerror(errno.ETIMEDOUT))
  252. Timeout: Connection timed out
  253. 2018-10-02 07:09:11,551-0700 ERROR (monitor/d316575) [storage.Monitor] Error checking domain d3165759-07c2-46ae-b7b8-b6226a929d68 (monitor:424)
  254. Traceback (most recent call last):
  255. File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 405, in _checkDomainStatus
  256. self.domain.selftest()
  257. File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 711, in selftest
  258. self.oop.os.statvfs(self.domaindir)
  259. File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", line 244, in statvfs
  260. return self._iop.statvfs(path)
  261. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 479, in statvfs
  262. resdict = self._sendCommand("statvfs", {"path": path}, self.timeout)
  263. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 442, in _sendCommand
  264. raise Timeout(os.strerror(errno.ETIMEDOUT))
  265. Timeout: Connection timed out
  266. 2018-10-02 07:09:12,274-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  267. 2018-10-02 07:09:12,277-0700 INFO (jsonrpc/2) [api.host] START getStats() from=::1,43336 (api:46)
  268. 2018-10-02 07:09:12,278-0700 INFO (jsonrpc/2) [vdsm.api] START repoStats(domains=()) from=::1,43336, task_id=1a82df7c-b083-460c-ab04-d4f961c1b303 (api:46)
  269. 2018-10-02 07:09:12,278-0700 INFO (jsonrpc/2) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.7', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.5', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.5', 'valid': False}} from=::1,43336, task_id=1a82df7c-b083-460c-ab04-d4f961c1b303 (api:52)
  270. 2018-10-02 07:09:12,279-0700 INFO (jsonrpc/2) [vdsm.api] START multipath_health() from=::1,43336, task_id=5644fe0f-a6c7-4854-8b01-83bb528da62b (api:46)
  271. 2018-10-02 07:09:12,279-0700 INFO (jsonrpc/2) [vdsm.api] FINISH multipath_health return={} from=::1,43336, task_id=5644fe0f-a6c7-4854-8b01-83bb528da62b (api:52)
  272. 2018-10-02 07:09:12,290-0700 INFO (jsonrpc/2) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'24': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '25': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '26': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '0.73', 'nodeIndex': 0, 'cpuSys': '0.27', 'cpuIdle': '99.00'}, '22': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.66'}, '23': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '28': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '0.53', 'nodeIndex': 0, 'cpuSys': '0.33', 'cpuIdle': '99.14'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '2': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '5': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '4': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '9': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '38': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '11': {'cpuUser': '6.85', 'nodeIndex': 1, 'cpuSys': '1.33', 'cpuIdle': '91.82'}, '10': {'cpuUser': '0.73', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.14'}, '13': {'cpuUser': '1.13', 'nodeIndex': 1, 'cpuSys': '0.27', 'cpuIdle': '98.60'}, '12': {'cpuUser': '0.20', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.73'}, '15': {'cpuUser': '0.67', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.26'}, '14': {'cpuUser': '0.33', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.60'}, '17': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.33', 'cpuIdle': '99.40'}, '16': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.74'}, '19': {'cpuUser': '0.27', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.60'}, '18': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.13', 'cpuIdle': '99.80'}, '31': {'cpuUser': '10.05', 'nodeIndex': 1, 'cpuSys': '2.00', 'cpuIdle': '87.95'}, '30': {'cpuUser': '0.07', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '34': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '33': {'cpuUser': '2.46', 'nodeIndex': 1, 'cpuSys': '0.33', 'cpuIdle': '97.21'}, '32': {'cpuUser': '0.13', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '99.87'}}, 'numaNodeMemFree': {'1': {'memPercent': 10, 'memFree': '59112'}, '0': {'memPercent': 4, 'memFree': '62817'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.7', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.5', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.5', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0', 'lastCheck': '9.0', 'valid': False}}, 'incomingVmMigrations': 0, 'network': {'bond0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'bond0', 'tx': '11326466785', 'txDropped': '0', 'rx': '46422728487', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'eno1': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489343.65704, 'name': 'eno1', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'ovirtmgmt', 'tx': '4400247851', 'txDropped': '0', 'rx': '42570775643', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'lo', 'tx': '174430251', 'txDropped': '0', 'rx': '174430251', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'VM-Network': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'VM-Network', 'tx': '7032', 'txDropped': '0', 'rx': '18981764', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489343.65704, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'vnet0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'vnet0', 'tx': '142748595', 'txDropped': '0', 'rx': '112514816', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489343.65704, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489343.65704, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.200': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'bond0.200', 'tx': '6396140530', 'txDropped': '0', 'rx': '1489880087', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '11', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ens2f0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'ens2f0', 'tx': '11326466425', 'txDropped': '0', 'rx': '46417798171', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '1'}, 'ens2f1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'ens2f1', 'tx': '360', 'txDropped': '0', 'rx': '4930316', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'bond0.30': {'txErrors': '0', 'state': 'up', 'sampleTime': 1538489343.65704, 'name': 'bond0.30', 'tx': '7680', 'txDropped': '0', 'rx': '20648683', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1538489343.65704, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '4344', 'ksmPages': 100, 'elapsedTime': '38992.36', 'cpuLoad': '4.51', 'cpuSys': '0.16', 'diskStats': {'/var/log': {'free': '7212'}, '/var/run/vdsm/': {'free': '64223'}, '/tmp': {'free': '905'}}, 'cpuUserVdsmd': '0.47', 'netConfigDirty': 'False', 'memCommitted': 4161, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 122159, 'bootTime': '1538450196', 'haStats': {'active': False, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '2', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2018-10-02T14:09:12 GMT', 'cpuUser': '0.64', 'memFree': 122543, 'cpuIdle': '99.20', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.20'}} from=::1,43336 (api:52)
  273. 2018-10-02 07:09:12,294-0700 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.02 seconds (__init__:573)
  274. 2018-10-02 07:09:13,270-0700 WARN (monitor/f59322b) [storage.Monitor] Host id for domain f59322ba-a312-4279-88b1-e7b66250f2a6 was released (id: 1) (monitor:444)
  275. 2018-10-02 07:09:14,721-0700 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  276. 2018-10-02 07:09:14,724-0700 INFO (jsonrpc/4) [api.host] START getCapabilities() from=::1,43336 (api:46)
  277. 2018-10-02 07:09:15,349-0700 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573)
  278. 2018-10-02 07:09:15,353-0700 INFO (jsonrpc/0) [vdsm.api] START repoStats(domains=[u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797']) from=::1,43336, task_id=1a4ee986-a250-4cd1-87ab-53835423bdff (api:46)
  279. 2018-10-02 07:09:15,353-0700 INFO (jsonrpc/0) [vdsm.api] FINISH repoStats return={u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '4.5', 'valid': False}} from=::1,43336, task_id=1a4ee986-a250-4cd1-87ab-53835423bdff (api:52)
  280. 2018-10-02 07:09:15,353-0700 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573)
  281. 2018-10-02 07:09:16,533-0700 INFO (jsonrpc/1) [api.host] START getAllVmStats() from=::1,43342 (api:46)
  282. 2018-10-02 07:09:16,534-0700 WARN (jsonrpc/1) [virt.vm] (vmId='c3365c53-60c1-406c-8b6f-3c86c1d9de0a') monitor became unresponsive (command timeout, age=71.0299999993) (vm:6215)
  283. 2018-10-02 07:09:16,534-0700 INFO (jsonrpc/1) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,43342 (api:52)
  284. 2018-10-02 07:09:16,535-0700 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:573)
  285. 2018-10-02 07:09:16,543-0700 INFO (jsonrpc/3) [api.host] START getAllVmIoTunePolicies() from=::1,43342 (api:46)
  286. 2018-10-02 07:09:16,543-0700 INFO (jsonrpc/3) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'c3365c53-60c1-406c-8b6f-3c86c1d9de0a': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': u'/var/run/vdsm/storage/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/31856584-8cdb-4863-9b78-b97413c58b78/a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', 'name': 'vda'}]}}} from=::1,43342 (api:52)
  287. 2018-10-02 07:09:16,544-0700 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:573)
  288. 2018-10-02 07:09:17,076-0700 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
  289. 2018-10-02 07:09:17,253-0700 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110)
  290. 2018-10-02 07:09:17,435-0700 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110)
  291. 2018-10-02 07:09:17,436-0700 INFO (jsonrpc/4) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.11.6.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.14'}, u'spice-server': {u'release': u'2.el7_5.4', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.39.1'}, u'qemu-kvm': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.7', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.16'}, u'qemu-img': {u'release': u'21.el7_5.4.1', u'version': u'2.10.0'}, u'mom': {u'release': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.14'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.14'}}, u'numaNodeDistance': {u'1': [21, 10], u'0': [10, 21]}, u'cpuModel': u'Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'6092f45748b23644101c04ba025ddec5'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'ada7e4e757fd0241b682b5cc6a545fc8'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'cb68e366da312b942a9a8518f3174df9'}, u'50_vhostmd': {u'md5': u'd70f7ee0453f632e87c09a157ff8ff66'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'40', u'kdumpStatus': 1, u'networks': {u'ovirtmgmt': {u'iface': u'ovirtmgmt', u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'ports': [u'bond0', u'vnet0']}, u'VM-Network': {u'iface': u'VM-Network', u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': True, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'ports': [u'bond0.30']}, u'Storage': {u'iface': u'bond0.200', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'switch': u'legacy', u'bridged': False, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'interface': u'bond0.200', u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.6.1-0.20180913.0+1/vmlinuz-3.10.0-862.11.6.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.6.1-0.20180913.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.6.1-0.20180913.0+1', u'bridges': {u'VM-Network': {u'ipv6autoconf': False, u'addr': u'172.16.30.117', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'off', u'ipv4addrs': [u'172.16.30.117/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.30.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'9609', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0.30']}, u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'172.16.100.12', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'172.16.100.12/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.100.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.b49691093aaa', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'444', u'root_id': u'8000.b49691093aaa', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'bond0', u'vnet0']}}, u'uuid': u'B0D6DE1C-B809-E711-9067-7CD30AC076FC', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,20,21,22,23,24,25,26,27,28,29,10,11,12,13,14,15,16,17,18,19,30,31,32,33,34,35,36,37,38,39', u'nameservers': [u'172.16.100.18'], u'nics': {u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fc', u'ipv6gateway': u'::', u'gateway': u''}, u'eno2': {u'ipv6autoconf': True, u'addr': u'', u'speed': 0, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'7c:d3:0a:c0:76:fd', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f0': {u'permhwaddr': u'b4:96:91:09:3a:aa', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}, u'ens2f1': {u'permhwaddr': u'b4:96:91:09:3a:ab', u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb,cat_l3,cdp_l3,intel_ppin,intel_pt,ssbd,ibrs,ibpb,stibp,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,cqm,rdt_a,rdseed,adx,smap,xsaveopt,cqm_llc,cqm_occup_llc,cqm_mbm_total,cqm_mbm_local,dtherm,ida,arat,pln,pts,spec_ctrl,intel_stibp,flush_l1d,model_n270,model_Broadwell-IBRS,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_SandyBridge,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Haswell-IBRS,model_Broadwell-noTSX-IBRS,model_Haswell,model_Conroe,model_Broadwell', u'kernelFeatures': {u'RETP': 1, u'IBRS': 0, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:17cbd22135bb', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 1, u'reservedMem': u'321', u'containers': False, u'bondings': {u'bond0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'netmask': u'', u'active_slave': u'ens2f0', u'mtu': u'1500', u'dhcpv4': False, u'switch': u'legacy', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'b4:96:91:09:3a:aa', u'slaves': [u'ens2f0', u'ens2f1'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'miimon': u'100', u'mode': u'1'}}}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'2773.974', u'numaNodes': {u'1': {u'totalMemory': u'65536', u'cpus': [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39]}, u'0': {u'totalMemory': u'65247', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}}, u'cpuSockets': u'2', u'vlans': {u'bond0.30': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 30, u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'ipv6gateway': u'::', u'gateway': u''}, u'bond0.200': {u'iface': u'bond0', u'ipv6autoconf': False, u'addr': u'172.16.200.102', u'dhcpv6': False, u'ipv6addrs': [], u'vlanid': 200, u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'ipv4addrs': [u'172.16.200.102/24'], u'ipv6gateway': u'::', u'gateway': u'172.16.200.1'}}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'20', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'2be0f62b-b67d-4244-b195-5de08a1b7750'}, u'kvmEnabled': u'true', u'memSize': u'128483', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.4.el7.centos', u'pretty_name': u'oVirt Node 4.2.6.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,43336 (api:52)
  292. 2018-10-02 07:09:17,444-0700 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 2.72 seconds (__init__:573)
  293. 2018-10-02 07:09:18,703-0700 INFO (periodic/4) [vdsm.api] START repoStats(domains=()) from=internal, task_id=aea949ab-1d77-4b5d-93f4-011c57730f4e (api:46)
  294. 2018-10-02 07:09:18,703-0700 INFO (periodic/4) [vdsm.api] FINISH repoStats return={u'd3165759-07c2-46ae-b7b8-b6226a929d68': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.2', 'valid': False}, u'd08b4a3d-d08d-4d7f-bc8e-69e35e057797': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.9', 'valid': False}, u'f59322ba-a312-4279-88b1-e7b66250f2a6': {'code': 2001, 'actual': True, 'version': 4, 'acquired': False, 'delay': '0', 'lastCheck': '5.4', 'valid': False}, u'7000be72-ddb7-48d8-82d2-095a026425ff': {'code': 2001, 'actual': True, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.9', 'valid': False}} from=internal, task_id=aea949ab-1d77-4b5d-93f4-011c57730f4e (api:52)
  295. 2018-10-02 07:09:18,703-0700 INFO (periodic/4) [vdsm.api] START multipath_health() from=internal, task_id=38010b3c-f6ab-4688-bba4-910396dc8839 (api:46)
  296. 2018-10-02 07:09:18,703-0700 INFO (periodic/4) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=38010b3c-f6ab-4688-bba4-910396dc8839 (api:52)
  297. 2018-10-02 07:09:19,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 70.00 seconds (check:282)
  298. 2018-10-02 07:09:19,828-0700 WARN (qgapoller/1) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b31b8> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  299. 2018-10-02 07:09:19,838-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 70.00 seconds (check:282)
  300. 2018-10-02 07:09:19,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 70.00 seconds (check:282)
  301. 2018-10-02 07:09:19,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 70.00 seconds (check:282)
  302. 2018-10-02 07:09:19,938-0700 WARN (qgapoller/3) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b32a8> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  303. 2018-10-02 07:09:19,938-0700 WARN (qgapoller/2) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3398> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  304. 2018-10-02 07:09:20,157-0700 INFO (periodic/0) [vdsm.api] FINISH getVolumeSize error=Connection timed out from=internal, task_id=541f9bf8-d0aa-4bc7-9914-48f00f4b35d9 (api:50)
  305. 2018-10-02 07:09:20,157-0700 ERROR (periodic/0) [storage.TaskManager.Task] (Task='541f9bf8-d0aa-4bc7-9914-48f00f4b35d9') Unexpected error (task:875)
  306. Traceback (most recent call last):
  307. File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run
  308. return fn(*args, **kargs)
  309. File "<string>", line 2, in getVolumeSize
  310. File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
  311. ret = func(*args, **kwargs)
  312. File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 3054, in getVolumeSize
  313. apparentsize = str(dom.getVSize(imgUUID, volUUID))
  314. File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 699, in getVSize
  315. return self._manifest.getVSize(imgUUID, volUUID)
  316. File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 196, in getVSize
  317. return self.oop.os.stat(volPath).st_size
  318. File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", line 241, in stat
  319. return self._iop.stat(path)
  320. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 471, in stat
  321. resdict = self._sendCommand("stat", {"path": path}, self.timeout)
  322. File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 442, in _sendCommand
  323. raise Timeout(os.strerror(errno.ETIMEDOUT))
  324. Timeout: Connection timed out
  325. 2018-10-02 07:09:20,157-0700 INFO (periodic/0) [storage.TaskManager.Task] (Task='541f9bf8-d0aa-4bc7-9914-48f00f4b35d9') aborting: Task is aborted: u'Connection timed out' - code 100 (task:1181)
  326. 2018-10-02 07:09:20,157-0700 ERROR (periodic/0) [storage.Dispatcher] FINISH getVolumeSize error=Connection timed out (dispatcher:86)
  327. Traceback (most recent call last):
  328. File "/usr/lib/python2.7/site-packages/vdsm/storage/dispatcher.py", line 73, in wrapper
  329. result = ctask.prepare(func, *args, **kwargs)
  330. File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 108, in wrapper
  331. return m(self, *a, **kw)
  332. File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 1189, in prepare
  333. raise self.error
  334. Timeout: Connection timed out
  335. 2018-10-02 07:09:20,157-0700 ERROR (periodic/0) [Executor] Unhandled exception in <Task discardable <UpdateVolumes vm=c3365c53-60c1-406c-8b6f-3c86c1d9de0a at 0x7fc6981f8150> timeout=30.0, duration=60 at 0x7fc6983c9050> (executor:317)
  336. Traceback (most recent call last):
  337. File "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 315, in _execute_task
  338. task()
  339. File "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 391, in __call__
  340. self._callable()
  341. File "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 349, in __call__
  342. self._execute()
  343. File "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 391, in _execute
  344. self._vm.updateDriveVolume(drive)
  345. File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 4326, in updateDriveVolume
  346. vmDrive.volumeID)
  347. File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 6255, in _getVolumeSize
  348. (domainID, volumeID))
  349. StorageUnavailableError: Unable to get volume size for domain d08b4a3d-d08d-4d7f-bc8e-69e35e057797 volume a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a
  350. 2018-10-02 07:09:20,158-0700 INFO (periodic/0) [Executor] Worker was discarded (executor:305)
  351. 2018-10-02 07:09:20,159-0700 WARN (periodic/5) [virt.periodic.VmDispatcher] could not run <class 'vdsm.virt.periodic.UpdateVolumes'> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  352. 2018-10-02 07:09:20,552-0700 INFO (MainThread) [vds] Received signal 15, shutting down (vdsmd:68)
  353. 2018-10-02 07:09:20,559-0700 INFO (MainThread) [jsonrpc.JsonRpcServer] Stopping JsonRPC Server (__init__:703)
  354. 2018-10-02 07:09:20,649-0700 WARN (qgapoller/0) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  355. 2018-10-02 07:09:29,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 80.00 seconds (check:282)
  356. 2018-10-02 07:09:29,837-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 80.00 seconds (check:282)
  357. 2018-10-02 07:09:29,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 80.00 seconds (check:282)
  358. 2018-10-02 07:09:29,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 80.00 seconds (check:282)
  359. 2018-10-02 07:09:30,641-0700 WARN (qgapoller/1) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  360. 2018-10-02 07:09:39,648-0700 WARN (check/loop) [storage.check] Checker '/dev/f59322ba-a312-4279-88b1-e7b66250f2a6/metadata' is blocked for 90.00 seconds (check:282)
  361. 2018-10-02 07:09:39,837-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC.malonetuning.net:_VMS/d3165759-07c2-46ae-b7b8-b6226a929d68/dom_md/metadata' is blocked for 90.00 seconds (check:282)
  362. 2018-10-02 07:09:39,878-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/dominic.malonetuning.net:_ISOS/7000be72-ddb7-48d8-82d2-095a026425ff/dom_md/metadata' is blocked for 90.00 seconds (check:282)
  363. 2018-10-02 07:09:39,938-0700 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/DOMINIC:_OVIRT/d08b4a3d-d08d-4d7f-bc8e-69e35e057797/dom_md/metadata' is blocked for 90.00 seconds (check:282)
  364. 2018-10-02 07:09:40,643-0700 WARN (qgapoller/3) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fc6cc0b3488> on ['c3365c53-60c1-406c-8b6f-3c86c1d9de0a'] (periodic:323)
  365. 2018-10-02 07:15:23,715-0700 INFO (MainThread) [vds] (PID: 3794) I am the actual vdsm 4.20.39.1-1.el7 letty.malonetuning.net (3.10.0-862.11.6.el7.x86_64) (vdsmd:149)
  366. 2018-10-02 07:15:23,716-0700 INFO (MainThread) [vds] VDSM will run with cpu affinity: frozenset([1]) (vdsmd:262)
  367. 2018-10-02 07:15:23,722-0700 INFO (MainThread) [storage.HSM] START HSM init (hsm:366)
  368. 2018-10-02 07:15:23,725-0700 INFO (MainThread) [storage.HSM] Creating data-center mount directory '/rhev/data-center/mnt' (hsm:373)
  369. 2018-10-02 07:15:23,725-0700 INFO (MainThread) [storage.fileUtils] Creating directory: /rhev/data-center/mnt mode: None (fileUtils:197)
  370. 2018-10-02 07:15:23,834-0700 INFO (MainThread) [storage.HSM] Unlinking file '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3/d3165759-07c2-46ae-b7b8-b6226a929d68' (hsm:523)
  371. 2018-10-02 07:15:23,835-0700 INFO (MainThread) [storage.HSM] Unlinking file '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3/mastersd' (hsm:523)
  372. 2018-10-02 07:15:23,835-0700 INFO (MainThread) [storage.HSM] Unlinking file '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3/7000be72-ddb7-48d8-82d2-095a026425ff' (hsm:523)
  373. 2018-10-02 07:15:23,835-0700 INFO (MainThread) [storage.HSM] Unlinking file '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3/d08b4a3d-d08d-4d7f-bc8e-69e35e057797' (hsm:523)
  374. 2018-10-02 07:15:23,836-0700 INFO (MainThread) [storage.HSM] Unlinking file '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3/f59322ba-a312-4279-88b1-e7b66250f2a6' (hsm:523)
  375. 2018-10-02 07:15:23,836-0700 INFO (MainThread) [storage.HSM] Removing directory '/rhev/data-center/5a77bed1-0238-030c-0122-0000000003b3' (hsm:537)
  376. 2018-10-02 07:15:23,836-0700 INFO (MainThread) [storage.udev] Registering multipath event monitor <vdsm.storage.mpathhealth.Monitor object at 0x7f4c6dfbd5d0> (udev:182)
  377. 2018-10-02 07:15:23,836-0700 INFO (MainThread) [storage.udev] Starting multipath event listener (udev:116)
  378. 2018-10-02 07:15:23,856-0700 INFO (MainThread) [storage.check] Starting check service (check:91)
  379. 2018-10-02 07:15:23,860-0700 INFO (MainThread) [storage.Dispatcher] Starting StorageDispatcher... (dispatcher:48)
  380. 2018-10-02 07:15:23,861-0700 INFO (check/loop) [storage.asyncevent] Starting <EventLoop running=True closed=False at 0x139966214005456> (asyncevent:125)
  381. 2018-10-02 07:15:23,923-0700 INFO (MainThread) [vdsm.api] START registerDomainStateChangeCallback(callbackFunc=<functools.partial object at 0x7f4c6c79b838>) from=internal, task_id=4ba24f7d-3e54-47ff-9af2-1a9d3ec246f3 (api:46)
  382. 2018-10-02 07:15:23,923-0700 INFO (MainThread) [vdsm.api] FINISH registerDomainStateChangeCallback return=None from=internal, task_id=4ba24f7d-3e54-47ff-9af2-1a9d3ec246f3 (api:52)
  383. 2018-10-02 07:15:23,923-0700 INFO (MainThread) [MOM] Preparing MOM interface (momIF:53)
  384. 2018-10-02 07:15:23,924-0700 INFO (MainThread) [MOM] Using named unix socket /var/run/vdsm/mom-vdsm.sock (momIF:62)
  385. 2018-10-02 07:15:23,924-0700 INFO (MainThread) [root] Unregistering all secrets (secret:91)
  386. 2018-10-02 07:15:23,940-0700 INFO (MainThread) [vds] Setting channels' timeout to 30 seconds. (vmchannels:222)
  387. 2018-10-02 07:15:23,941-0700 INFO (MainThread) [vds] Starting QEMU-GA poller (qemuguestagent:140)
  388. 2018-10-02 07:15:23,943-0700 INFO (MainThread) [vds.MultiProtocolAcceptor] Listening at :::54321 (protocoldetector:183)
  389. 2018-10-02 07:15:24,082-0700 INFO (http) [vds] Server running (http:58)
  390. 2018-10-02 07:15:24,104-0700 INFO (vmrecovery) [vds] VM recovered: c3365c53-60c1-406c-8b6f-3c86c1d9de0a (recovery:106)
  391. 2018-10-02 07:15:24,105-0700 INFO (vmrecovery) [vds] recovery [1:1/2]: recovered domain c3365c53-60c1-406c-8b6f-3c86c1d9de0a (recovery:232)
  392. 2018-10-02 07:15:24,113-0700 INFO (vm/c3365c53) [virt.vm] (vmId='c3365c53-60c1-406c-8b6f-3c86c1d9de0a') VM wrapper has started (vm:2784)
  393. 2018-10-02 07:15:24,115-0700 INFO (vm/c3365c53) [vdsm.api] START getVolumeSize(sdUUID='d08b4a3d-d08d-4d7f-bc8e-69e35e057797', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='31856584-8cdb-4863-9b78-b97413c58b78', volUUID='a0690f90-3ac9-4f03-a0f2-cd4ed3c4fa7a', options=None) from=internal, task_id=7d4d6b00-fc32-48ee-b9a2-193ccf748822 (api:46)
  394. 2018-10-02 07:15:24,121-0700 INFO (vmrecovery) [vds] VM recovered: 956f36e3-7002-4034-a041-dc87eb5db251 (recovery:106)
  395. 2018-10-02 07:15:24,122-0700 INFO (vmrecovery) [vds] recovery [1:2/2]: recovered domain 956f36e3-7002-4034-a041-dc87eb5db251 (recovery:232)
  396. 2018-10-02 07:15:24,122-0700 INFO (vmrecovery) [vds] recovery: waiting for 2 domains to go up (clientIF:701)
  397. 2018-10-02 07:15:24,126-0700 INFO (vm/956f36e3) [virt.vm] (vmId='956f36e3-7002-4034-a041-dc87eb5db251') VM wrapper has started (vm:2784)
  398. 2018-10-02 07:15:24,128-0700 INFO (vm/956f36e3) [vdsm.api] START getVolumeSize(sdUUID='d3165759-07c2-46ae-b7b8-b6226a929d68', spUUID='5a77bed1-0238-030c-0122-0000000003b3', imgUUID='672eec22-6384-41c4-8f17-379e0495ea99', volUUID='9af052e6-5305-49b2-ab89-a2f46488072f', options=None) from=internal, task_id=f9e9e071-dda1-417b-bee1-66dc073094e3 (api:46)
  399. 2018-10-02 07:15:24,132-0700 WARN (dhclient-monitor) [vds] Not ready yet, ignoring event '|net|host_conn|no_id' args={} (clientIF:209)
  400. 2018-10-02 07:15:24,133-0700 WARN (dhclient-monitor) [root] File: /var/run/vdsm/trackedInterfaces/bond0.200 already removed (fileutils:51)
  401. 2018-10-02 07:15:24,145-0700 WARN (dhclient-monitor) [vds] Not ready yet, ignoring event '|net|host_conn|no_id' args={} (clientIF:209)
  402. 2018-10-02 07:15:24,145-0700 WARN (dhclient-monitor) [root] File: /var/run/vdsm/trackedInterfaces/VM-Network already removed (fileutils:51)
  403. 2018-10-02 07:15:24,158-0700 WARN (dhclient-monitor) [vds] Not ready yet, ignoring event '|net|host_conn|no_id' args={} (clientIF:209)
  404. 2018-10-02 07:15:24,159-0700 WARN (dhclient-monitor) [root] File: /var/run/vdsm/trackedInterfaces/ovirtmgmt already removed (fileutils:51)
  405. 2018-10-02 07:15:24,250-0700 INFO (itmap/0) [IOProcessClient] (/DOMINIC.malonetuning.net:_VMS) Starting client (__init__:308)
  406. 2018-10-02 07:15:24,278-0700 INFO (ioprocess/3932) [IOProcess] (/DOMINIC.malonetuning.net:_VMS) Starting ioprocess (__init__:434)
  407. 2018-10-02 07:15:24,280-0700 INFO (itmap/1) [IOProcessClient] (/dominic.malonetuning.net:_ISOS) Starting client (__init__:308)
  408. 2018-10-02 07:15:24,315-0700 INFO (itmap/2) [IOProcessClient] (/DOMINIC:_OVIRT) Starting client (__init__:308)
  409. 2018-10-02 07:15:24,318-0700 INFO (ioprocess/3943) [IOProcess] (/dominic.malonetuning.net:_ISOS) Starting ioprocess (__init__:434)
  410. 2018-10-02 07:15:24,330-0700 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:58346 (protocoldetector:61)
  411. 2018-10-02 07:15:24,337-0700 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:58346 (protocoldetector:125)
  412. 2018-10-02 07:15:24,338-0700 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:103)
  413. 2018-10-02 07:15:24,338-0700 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:132)
  414. 2018-10-02 07:15:24,358-0700 INFO (hsm/init) [storage.LVM] Deactivating lvs: vg=onn lvs=['root', 'ovirt-node-ng-4.2.5.1-0.20180731.0+1'] (lvm:684)
  415. 2018-10-02 07:15:24,364-0700 INFO (ioprocess/3949) [IOProcess] (/DOMINIC:_OVIRT) Starting ioprocess (__init__:434)
  416. 2018-10-02 07:15:24,366-0700 INFO (vm/c3365c53) [vdsm.api] FINISH getVolumeSize error=Storage domain does not exist: ('d08b4a3d-d08d-4d7f-bc8e-69e35e057797',) from=internal, task_id=7d4d6b00-fc32-48ee-b9a2-193ccf748822 (api:50)
  417. 2018-10-02 07:15:24,366-0700 ERROR (vm/c3365c53) [storage.TaskManager.Task] (Task='7d4d6b00-fc32-48ee-b9a2-193ccf748822') Unexpected error (task:875)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!