Hi Edward, you're hitting [1] - it will be included in the next appliance
The hosted engine is created in two steps, first as a 192.168.x.x address as a local VM on the host, then it gets copied over to shared storage and gets the real ip address you assigned in the setup wizard.. So that part is normal behavior.I had a recent hosted engine installation failure with oVirt node 4.3.4, where the local VM was stuck trying to yum install yum-utils, but couldn't because it is behind a firewall, so I ssh'd into the local VM, added a proxy line to /etc/yum.conf, kill -HUP'd the bad process and manually re-ran the yum install command and it was able to complete the hosted engine installation.If that's not the issue, maybe your node's network config is not something the installer expects like preconfigured bridge when it wants to do the bridge configuration for itself, or a bond type not supported...On Sun, Jun 16, 2019 at 12:12 PM <me@brendanh.com> wrote:Hi,
I've been failing to install hosted-engine on oVirt Node for a long time. I'm now trying on a Coffee Lake Xeon-based system, having previously tried on Broadwell-E.
Trying using the webui or hosted-engine --deploy has similar result. Error in the title occurs when using the webui. Using hosted-engine --deploy gets shows:
[ INFO ] TASK [ovirt.hosted_engine_setup : Wait for the host to be up]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.hosted_engine_setup : Check host status]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, please check engine logs, fix accordingly and re-deploy.\n"}
Despite the failure, the oVirt webui is can be browsed on https://<host>:6900, but the host has status "unassigned". The Node webui (https://<host>:9090) has the engine VM running, but when I login to its console, I see its IP is 192.168.122.123, not the DHCP-reserved IP address (on our 10.0.8.x network), which doesn't seem right. I suspect some problem with DHCP, but I don't know how to fix. Any ideas?
vdsm.log shows:
2019-06-16 15:06:39,117+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:06:44,122+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=7f984b0d-9765-457e- ac8e-c5cd0bdf73d2 (api:48)
2019-06-16 15:06:44,122+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=7f984b0d-9765-457e-ac8e-c5cd0bdf73d2 (api:54)
2019-06-16 15:06:44,122+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:06:48,258+0000 INFO (periodic/1) [vdsm.api] START repoStats(domains=()) from=internal, task_id=0526307b-bb37-4eff-94d6-910ac0d64933 (api:48)
2019-06-16 15:06:48,258+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={} from=internal, task_id=0526307b-bb37-4eff-94d6-910ac0d64933 (api:54)
2019-06-16 15:06:49,126+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=0d5b359e-1a4c-4cc0- 87a1-4a41e91ba356 (api:48)
2019-06-16 15:06:49,126+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=0d5b359e-1a4c-4cc0-87a1-4a41e91ba356 (api:54)
2019-06-16 15:06:49,126+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:06:53,040+0000 INFO (jsonrpc/5) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:06:53,041+0000 INFO (jsonrpc/5) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:06:53,041+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:312)
2019-06-16 15:06:54,132+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=99c33317-7753-4d24- a10b-b716adcdaf76 (api:48)
2019-06-16 15:06:54,132+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=99c33317-7753-4d24-a10b-b716adcdaf76 (api:54)
2019-06-16 15:06:54,132+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:06:59,134+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=8f5679a1-8734-491d- b925-7387effe4726 (api:48)
2019-06-16 15:06:59,134+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=8f5679a1-8734-491d-b925-7387effe4726 (api:54)
2019-06-16 15:06:59,134+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:03,280+0000 INFO (periodic/3) [vdsm.api] START repoStats(domains=()) from=internal, task_id=a6b63d3e-3557-4a94-bc45-7f5936d5681a (api:48)
2019-06-16 15:07:03,280+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats return={} from=internal, task_id=a6b63d3e-3557-4a94-bc45-7f5936d5681a (api:54)
2019-06-16 15:07:04,139+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=f22eae3b-ccba-493f- 8da7-5e46f52ba97c (api:48)
2019-06-16 15:07:04,140+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=f22eae3b-ccba-493f-8da7-5e46f52ba97c (api:54)
2019-06-16 15:07:04,140+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:08,053+0000 INFO (jsonrpc/6) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:07:08,053+0000 INFO (jsonrpc/6) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:07:08,054+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:08,059+0000 INFO (jsonrpc/7) [api.host] START getAllVmIoTunePolicies() from=::1,50104 (api:48)
2019-06-16 15:07:08,059+0000 INFO (jsonrpc/7) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'56371630-7d71-4a9a-b84a-61f38f9d7c4d': {'policy': [], 'current_values': []}}} from=::1,50104 (api:54)
2019-06-16 15:07:08,059+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:09,140+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=5c2d5726-5de9-4dec- b809-168708be0373 (api:48)
2019-06-16 15:07:09,140+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=5c2d5726-5de9-4dec-b809-168708be0373 (api:54)
2019-06-16 15:07:09,140+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:14,141+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=942e4aa2-e592-4447- bf47-717b6b220d63 (api:48)
2019-06-16 15:07:14,141+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=942e4aa2-e592-4447-bf47-717b6b220d63 (api:54)
2019-06-16 15:07:14,141+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:18,303+0000 INFO (periodic/1) [vdsm.api] START repoStats(domains=()) from=internal, task_id=dcc3066f-a08a-43a1-ae22-3d99d9f1e0ed (api:48)
2019-06-16 15:07:18,303+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={} from=internal, task_id=dcc3066f-a08a-43a1-ae22-3d99d9f1e0ed (api:54)
2019-06-16 15:07:19,144+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=18f9bf90-bfb9-477c- 945f-376bd4cfe8d5 (api:48)
2019-06-16 15:07:19,144+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=18f9bf90-bfb9-477c-945f-376bd4cfe8d5 (api:54)
2019-06-16 15:07:19,144+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:23,075+0000 INFO (jsonrpc/0) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:07:23,075+0000 INFO (jsonrpc/0) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:07:23,076+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:23,077+0000 INFO (jsonrpc/1) [api.host] START getAllVmIoTunePolicies() from=::1,50104 (api:48)
2019-06-16 15:07:23,077+0000 INFO (jsonrpc/1) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'56371630-7d71-4a9a-b84a-61f38f9d7c4d': {'policy': [], 'current_values': []}}} from=::1,50104 (api:54)
2019-06-16 15:07:23,078+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:24,149+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=cfb1c9aa-7e92-46f6- 9faf-93caeee448c3 (api:48)
2019-06-16 15:07:24,149+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=cfb1c9aa-7e92-46f6-9faf-93caeee448c3 (api:54)
2019-06-16 15:07:24,149+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:29,154+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=f7196920-b1a5-4bc9- b36d-76bf0540f567 (api:48)
2019-06-16 15:07:29,154+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=f7196920-b1a5-4bc9-b36d-76bf0540f567 (api:54)
2019-06-16 15:07:29,154+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:33,318+0000 INFO (periodic/1) [vdsm.api] START repoStats(domains=()) from=internal, task_id=4c42bce2-75aa-423f-bb28-e06aeda7e349 (api:48)
2019-06-16 15:07:33,318+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={} from=internal, task_id=4c42bce2-75aa-423f-bb28-e06aeda7e349 (api:54)
2019-06-16 15:07:34,155+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=dc936add-86ee-4cb3- 9efe-3e5c370822d7 (api:48)
2019-06-16 15:07:34,155+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=dc936add-86ee-4cb3-9efe-3e5c370822d7 (api:54)
2019-06-16 15:07:34,155+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:38,079+0000 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:07:38,079+0000 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:07:38,080+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:38,094+0000 INFO (jsonrpc/3) [api.host] START getAllVmIoTunePolicies() from=::1,50104 (api:48)
2019-06-16 15:07:38,094+0000 INFO (jsonrpc/3) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'56371630-7d71-4a9a-b84a-61f38f9d7c4d': {'policy': [], 'current_values': []}}} from=::1,50104 (api:54)
2019-06-16 15:07:38,094+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:39,161+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=3ead3df6-b5f8-412d- 9395-a85b50e35cd3 (api:48)
2019-06-16 15:07:39,161+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=3ead3df6-b5f8-412d-9395-a85b50e35cd3 (api:54)
2019-06-16 15:07:39,161+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:44,166+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=0dffde8f-4d3f-4f21- ac3b-87e915f3a1b3 (api:48)
2019-06-16 15:07:44,166+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=0dffde8f-4d3f-4f21-ac3b-87e915f3a1b3 (api:54)
2019-06-16 15:07:44,166+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:48,336+0000 INFO (periodic/2) [vdsm.api] START repoStats(domains=()) from=internal, task_id=f7da324c-ab2b-4d61-813e-e28c22148da8 (api:48)
2019-06-16 15:07:48,336+0000 INFO (periodic/2) [vdsm.api] FINISH repoStats return={} from=internal, task_id=f7da324c-ab2b-4d61-813e-e28c22148da8 (api:54)
2019-06-16 15:07:49,172+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=2da4fdc5-5b17-4a72- 810c-ebaa05bfd51d (api:48)
2019-06-16 15:07:49,172+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=2da4fdc5-5b17-4a72-810c-ebaa05bfd51d (api:54)
2019-06-16 15:07:49,172+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:53,098+0000 INFO (jsonrpc/4) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:07:53,098+0000 INFO (jsonrpc/4) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:07:53,098+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:53,112+0000 INFO (jsonrpc/5) [api.host] START getAllVmIoTunePolicies() from=::1,50104 (api:48)
2019-06-16 15:07:53,112+0000 INFO (jsonrpc/5) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'56371630-7d71-4a9a-b84a-61f38f9d7c4d': {'policy': [], 'current_values': []}}} from=::1,50104 (api:54)
2019-06-16 15:07:53,112+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:53,656+0000 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::ffff:192.168.122.123:36798 (protocoldetector:61)
2019-06-16 15:07:53,717+0000 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::ffff:192.168.122.123:36798 (protocoldetector:125)
2019-06-16 15:07:53,717+0000 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompserver:95)
2019-06-16 15:07:53,718+0000 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompserver:124)
2019-06-16 15:07:53,718+0000 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompserver:124)
2019-06-16 15:07:53,758+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:07:53,776+0000 INFO (jsonrpc/7) [api.host] START getCapabilities() from=::ffff:192.168.122.123,36798, flow_id=129ab006 (api:48)
2019-06-16 15:07:53,882+0000 INFO (jsonrpc/7) [root] managedvolume not supported: Managed Volume Not Supported. Missing package os-brick.: ('Cannot import os_brick',) (caps:150)
2019-06-16 15:07:54,139+0000 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:114)
2019-06-16 15:07:54,173+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=73e7508c-26de-4f2d- 8e3f-575a96e33a1e (api:48)
2019-06-16 15:07:54,173+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=73e7508c-26de-4f2d-8e3f-575a96e33a1e (api:54)
2019-06-16 15:07:54,173+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:07:54,262+0000 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils. py: rc=0 err= (hooks:114)
2019-06-16 15:07:54,401+0000 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_ hook: rc=0 err= (hooks:114)
2019-06-16 15:07:54,402+0000 INFO (jsonrpc/7) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:ce1834079cf1'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'957.10.1.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'5.5'}, u'spice-server': {u'release': u'6.el7_6.1', u'version': u'0.14.0'}, u'librbd1': {u'release': u'4.el7', u'version': u'10.2.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.30.13'}, u'qemu-kvm': {u'release': u'18.el7_6.3.1', u'version': u'2.12.0'}, u'openvswitch': {u'release': u'3.el7', u'version': u'2.10.1'}, u'libvirt': {u'release': u'10.el7_6.6', u'version': u'4.5.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.3.1'}, u'qemu-img': {u'release': u'18.el7_6.3.1', u'version': u'2.12.0'}, u'mom': {u'release': u'1.e
l7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'5.5'}}, u'numaNodeDistance': {u'0': [10]}, u'cpuModel': u'Intel(R) Xeon(R) E-2146G CPU @ 3.50GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' ea0a5a715da8c1badbcda28e8b8fa0 0e'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u' ce1fbad7aa0389e3b06231219140bf 0d'}}, u'before_vm_start': {u'50_hostedengine': {u'md5': u' 95c810cdcfe4195302a59574a51482 89'}, u'50_vhostmd': {u'md5': u' 9206bc390bcbf208b06a8e899581be 2d'}}, u'after_device_migrate_ destination': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md
5': u'6226fbc4d1602994828a3904fc1b87 5d'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u' 28c352339c8beef1e1b05c67d106d0 62'}}, u'before_device_create': {u'50_vmfex': {u'md5': u' 49caba1a5faadd8efacef966f79bc3 0a'}, u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' ec8d5d7ba063a109f749cd63c7a2b5 8d'}, u'20_ovirt_provider_ovn_ vhostuser_hook': {u'md5': u' a8af653b7386c138b2e6e9738bd6b6 2c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u' 73822988042847bab1ea832a6b9fa8 37'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' 6226fbc4d1602994828a3904fc1b87 5d'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' 6226fbc4d1602994828a3904fc1b87 5d'}}, u'before_vm_migrate_ destination': {u'50_vhostmd': {u'md5': u' 9206bc390bcbf208b06a8e899581be 2d'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md
5': u'9206bc390bcbf208b06a8e899581be 2d'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u' 49caba1a5faadd8efacef966f79bc3 0a'}, u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' ec8d5d7ba063a109f749cd63c7a2b5 8d'}, u'20_ovirt_provider_ovn_ vhostuser_hook': {u'md5': u' a8af653b7386c138b2e6e9738bd6b6 2c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u' 73822988042847bab1ea832a6b9fa8 37'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' 5c3a9ab6e06e039bdd220c0216e458 09'}, u'ovirt_provider_ovn_hook': {u'md5': u' 4c4b1d2d5460e6a65114ae36cb775d f6'}}, u'before_device_migrate_ destination': {u'50_vmfex': {u'md5': u' 49caba1a5faadd8efacef966f79bc3 0a'}}, u'after_vm_destroy': {u'delete_vhostuserclient_ hook': {u'md5': u' c2f279cc9483a3f842f6c29df13994 c1'}, u'50_vhostmd': {u'md5': u' bdf4802c0521cf1bae08f2b90a9559 cf'}}}, u'supportsIPv6': True, u'realtimeKernel': False, u'vmTypes': [
u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'12', u'kdumpStatus': 0, u'deferred_preallocation': True, u'networks': {}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.3.3.1-0.20190417.0+1/vmlinuz- 3.10.0-957.10.1.el7.x86_64 root=/dev/onn_host/ovirt-node- ng-4.3.3.1-0.20190417.0+1 ro crashkernel=auto rd.lvm.lv=onn_host/swap rd.lvm.lv=onn_host/ovirt-node- ng-4.3.3.1-0.20190417.0+1 rhgb quiet LANG=en_GB.UTF-8 img.bootid=ovirt-node-ng-4.3. 3.1-0.20190417.0+1', u'domain_versions': [0, 2, 3, 4, 5], u'bridges': {u'virbr0': {u'ipv6autoconf': False, u'addr': u'192.168.122.1', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'255.255.255.0', u'ipv4defaultroute': False, u'stp': u'on', u'ipv4addrs': [u'192.168.122.1/24'], u'ipv6gateway': u'::', u'gateway': u'', u'opts': {u'multicast_last_member_ count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_ interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'
1', u'multicast_startup_query_interval': u'3125', u'hello_timer': u'99', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'1', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_ interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_ count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.5254006a0284', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'17825', u'root_id': u'8000.5254006a0284', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_ interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u
'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'200'}, u'ports': [u'vnet0', u'virbr0-nic']}}, u'uuid': u'03d502e0-045e-05e4-b806-190700080009', u'onlineCpus': u'0,1,2,3,4,5,6,7,8,9,10,11', u'nameservers': [u'10.0.8.1', u'8.8.8.8', u'8.8.4.4'], u'nics': {u'enp2s0': {u'ipv6autoconf': True, u'addr': u'10.0.8.152', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': True, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'ipv4addrs': [u'10.0.8.152/24'], u'hwaddr': u'00:e0:4c:68:75:29', u'ipv6gateway': u'::', u'gateway': u'10.0.8.1'}, u'eno1': {u'ipv6autoconf': True, u'addr': u'', u'speed': 10, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'e0:d5:5e:e4:b8:19', u'ipv6gateway': u'::', u'gateway': u''}, u'enp9s0': {u'ipv6autoconf': True, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': Fal
se, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'e0:d5:5e:e4:b8:1a', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'4.1', u'4.2', u'4.3'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca, cmov,pat,pse36,clflush,dts, acpi,mmx,fxsr,sse,sse2,ss,ht, tm,pbe,syscall,nx,pdpe1gb, rdtscp,lm,constant_tsc,art, arch_perfmon,pebs,bts,rep_ good,nopl,xtopology,nonstop_ tsc,aperfmperf,eagerfpu,pni, pclmulqdq,dtes64,monitor,ds_ cpl,vmx,smx,est,tm2,ssse3, sdbg,fma,cx16,xtpr,pdcm,pcid, sse4_1,sse4_2,x2apic,movbe, popcnt,tsc_deadline_timer,aes, xsave,avx,f16c,rdrand,lahf_lm, abm,3dnowprefetch,intel_pt, ssbd,ibrs,ibpb,stibp,tpr_ shadow,vnmi,flexpriority,ept, vpid,fsgsbase,tsc_adjust,bmi1, hle,avx2,smep,bmi2,erms, invpcid,rtm,mpx,rdseed,adx, smap,clflushopt,xsaveopt, xsavec,xgetbv1,dtherm,ida, arat,pln,pts,hwp,hwp_notify, hwp_act_window,hwp_epp,spec_ ctrl,intel_stibp,flush_l1d, model_Opteron_G2,mode
l_kvm32,model_SandyBridge-IBRS,model_Haswell-noTSX, model_Opteron_G1,model_ core2duo,model_pentium,model_ Haswell,model_Westmere-IBRS, model_Haswell-IBRS,model_ Broadwell-noTSX,model_qemu64, model_Broadwell-noTSX-IBRS, model_kvm64,model_Skylake- Client,model_Broadwell-IBRS, model_coreduo,model_Nehalem, model_Skylake-Client-IBRS, model_Nehalem-IBRS,model_ IvyBridge,model_Westmere, model_SandyBridge,model_ IvyBridge-IBRS,model_n270, model_Haswell-noTSX-IBRS, model_qemu32,model_Penryn, model_pentium2,model_pentium3, model_Conroe,model_Broadwell, model_486', u'kernelFeatures': {u'IBRS': 1, u'RETP': 0, u'SSBD': 3, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat: ce1834079cf1', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 0, u'reservedMem': u'321', u'bondings': {}, u'software_version': u'4.30.13', u'supportedENGINEs': [u'4.1', u'4.2', u'4.3'], u'vncEncrypted': False, u'backupEnabled': False, u'cpuSpeed': u'4298.095', u'numaNodes': {u'0': {u'totalMemory': u'12860
2', u'cpus': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11]}}, u'cpuSockets': u'1', u'vlans': {}, u'version_name': u'Snow Man', 'lastClientIface': 'enp2s0', u'cpuCores': u'6', u'hostedEngineDeployed': False, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OPENSTACK_OVN': u'host.example.com', u'OPEN_VSWITCH': u'host.example.com', u'OVIRT_PROVIDER_OVN': u'ed84f8bd-6024-41dc-baff-29ddcf8c9fc1'}, u'kvmEnabled': u'true', u'memSize': u'128602', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-q35-rhel7.6.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'pc-i440fx-rhel7.6.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngS
ources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'6.1810.2.el7.centos', u'pretty_name': u'oVirt Node 4.3.3.1', u'version': u'7', u'name': u'RHEL'}}} from=::ffff:192.168.122.123,36798, flow_id=129ab006 (api:54)
2019-06-16 15:07:54,406+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.63 seconds (__init__:312)
2019-06-16 15:07:54,530+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.01 seconds (__init__:312)
2019-06-16 15:07:54,538+0000 INFO (jsonrpc/1) [api.network] START setupNetworks(networks={u'ovirtmgmt': {u'ipv6autoconf': True, u'nic': u'enp2s0', u'mtu': 1500, u'switch': u'legacy', u'dhcpv6': False, u'STP': u'no', u'bridged': u'true', u'defaultRoute': True, u'bootproto': u'dhcp'}}, bondings={}, options={u'connectivityCheck': u'true', u'connectivityTimeout': 120, u'commitOnSuccess': False}) from=::ffff:192.168.122.123, 36798, flow_id=c0327 (api:48)
2019-06-16 15:07:59,178+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=a60cfd9c-3ea6-49a7- 8563-a6c0a1ad7943 (api:48)
2019-06-16 15:07:59,178+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=a60cfd9c-3ea6-49a7-8563-a6c0a1ad7943 (api:54)
2019-06-16 15:07:59,179+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:08:03,352+0000 INFO (periodic/3) [vdsm.api] START repoStats(domains=()) from=internal, task_id=bd363115-1711-41a7-89bf-9309b8c8b9ba (api:48)
2019-06-16 15:08:03,352+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats return={} from=internal, task_id=bd363115-1711-41a7-89bf-9309b8c8b9ba (api:54)
2019-06-16 15:08:04,184+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=f227c8ad-b3aa-400e- af89-06f34db9fbbd (api:48)
2019-06-16 15:08:04,184+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=f227c8ad-b3aa-400e-af89-06f34db9fbbd (api:54)
2019-06-16 15:08:04,184+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:08:08,006+0000 INFO (dhclient-monitor) [root] Received DHCP response: {'action': 'configure', 'ip': '10.0.8.152', 'route': '10.0.8.1', 'iface': 'ovirtmgmt', 'mask': '255.255.255.0'} (dhclient_monitor:127)
2019-06-16 15:08:08,105+0000 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::1,50104 (api:48)
2019-06-16 15:08:08,105+0000 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,50104 (api:54)
2019-06-16 15:08:08,106+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,129+0000 INFO (jsonrpc/3) [api.host] START getAllVmIoTunePolicies() from=::1,50104 (api:48)
2019-06-16 15:08:08,129+0000 INFO (jsonrpc/3) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'56371630-7d71-4a9a-b84a-61f38f9d7c4d': {'policy': [], 'current_values': []}}} from=::1,50104 (api:54)
2019-06-16 15:08:08,129+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,761+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,762+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,762+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,762+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,762+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:08,762+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:09,189+0000 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=22403389-1c68-4e12- 81e5-dc61df9d2b17 (api:48)
2019-06-16 15:08:09,189+0000 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=22403389-1c68-4e12-81e5-dc61df9d2b17 (api:54)
2019-06-16 15:08:09,189+0000 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709)
2019-06-16 15:08:09,521+0000 INFO (jsonrpc/1) [api.network] FINISH setupNetworks return={'status': {'message': 'Done', 'code': 0}} from=::ffff:192.168.122.123,36798, flow_id=c0327 (api:54)
2019-06-16 15:08:09,522+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks succeeded in 14.99 seconds (__init__:312)
2019-06-16 15:08:10,055+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:12,558+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.confirmConnectivity succeeded in 0.00 seconds (__init__:312)
2019-06-16 15:08:12,561+0000 INFO (jsonrpc/5) [api.host] START getCapabilities() from=::ffff:192.168.122.123,36798, flow_id=c0327 (api:48)
2019-06-16 15:08:12,611+0000 INFO (jsonrpc/5) [root] managedvolume not supported: Managed Volume Not Supported. Missing package os-brick.: ('Cannot import os_brick',) (caps:150)
2019-06-16 15:08:12,862+0000 INFO (jsonrpc/5) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:114)
2019-06-16 15:08:12,984+0000 INFO (jsonrpc/5) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils. py: rc=0 err= (hooks:114)
2019-06-16 15:08:13,127+0000 INFO (jsonrpc/5) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_ hook: rc=0 err= (hooks:114)
2019-06-16 15:08:13,127+0000 INFO (jsonrpc/5) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:ce1834079cf1'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'957.10.1.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'5.5'}, u'spice-server': {u'release': u'6.el7_6.1', u'version': u'0.14.0'}, u'librbd1': {u'release': u'4.el7', u'version': u'10.2.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.30.13'}, u'qemu-kvm': {u'release': u'18.el7_6.3.1', u'version': u'2.12.0'}, u'openvswitch': {u'release': u'3.el7', u'version': u'2.10.1'}, u'libvirt': {u'release': u'10.el7_6.6', u'version': u'4.5.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.3.1'}, u'qemu-img': {u'release': u'18.el7_6.3.1', u'version': u'2.12.0'}, u'mom': {u'release': u'1.e
l7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'5.5'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'5.5'}}, u'numaNodeDistance': {u'0': [10]}, u'cpuModel': u'Intel(R) Xeon(R) E-2146G CPU @ 3.50GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' ea0a5a715da8c1badbcda28e8b8fa0 0e'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u' ce1fbad7aa0389e3b06231219140bf 0d'}}, u'before_vm_start': {u'50_hostedengine': {u'md5': u' 95c810cdcfe4195302a59574a51482 89'}, u'50_vhostmd': {u'md5': u' 9206bc390bcbf208b06a8e899581be 2d'}}, u'after_device_migrate_ destination': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md
5': u'6226fbc4d1602994828a3904fc1b87 5d'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u' 28c352339c8beef1e1b05c67d106d0 62'}}, u'before_device_create': {u'50_vmfex': {u'md5': u' 49caba1a5faadd8efacef966f79bc3 0a'}, u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' ec8d5d7ba063a109f749cd63c7a2b5 8d'}, u'20_ovirt_provider_ovn_ vhostuser_hook': {u'md5': u' a8af653b7386c138b2e6e9738bd6b6 2c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u' 73822988042847bab1ea832a6b9fa8 37'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u' 6226fbc4d1602994828a3904fc1b87 5d'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u' 1ed38ddf30f8a9c7574589e77e2c0b 1f'}, u'50_openstacknet': {u'md5': u'