1:03 a.m.
Hi,
I've been attempting to install hosted engine intermittently for months without
success. I have raised and had one bug fixed
(https://bugzilla.redhat.com/show_bug.cgi?id=1622240) and am hitting various other
problems. I've freshly installed oVirt Node v4.2.7 (Second Release Candidate). I
have launched the webui and configured an XOR bond. Then using the following answer file,
I attempt to install hosted engine using command:
hosted-engine --deploy
--config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers.conf
Where answers contains:
[environment:default]
OVEHOSTED_CORE/deployProceed=bool:True
OVEHOSTED_CORE/rollbackProceed=none:None
OVEHOSTED_CORE/screenProceed=bool:True
OVEHOSTED_CORE/upgradeProceed=none:None
OVEHOSTED_ENGINE/clusterName=str:Default
OVEHOSTED_ENGINE/enableHcGlusterService=none:None
OVEHOSTED_ENGINE/insecureSSL=none:None
OVEHOSTED_NETWORK/bridgeName=str:ovirtmgmt
OVEHOSTED_NETWORK/fqdn=str:ovirt-engine.example.com
OVEHOSTED_NETWORK/gateway=str:10.0.0.1
OVEHOSTED_NOTIF/destEmail=str:me@example.com
OVEHOSTED_NOTIF/smtpPort=str:25
OVEHOSTED_NOTIF/smtpServer=str:smtp.emailprovider.com
OVEHOSTED_NOTIF/sourceEmail=str:admin@example.com
OVEHOSTED_STORAGE/LunID=none:None
OVEHOSTED_STORAGE/discardSupport=bool:False
OVEHOSTED_STORAGE/domainType=str:nfs
OVEHOSTED_STORAGE/iSCSIDiscoverUser=none:None
OVEHOSTED_STORAGE/iSCSIPortal=none:None
OVEHOSTED_STORAGE/iSCSIPortalIPAddress=none:None
OVEHOSTED_STORAGE/iSCSIPortalPort=none:None
OVEHOSTED_STORAGE/iSCSIPortalUser=none:None
OVEHOSTED_STORAGE/iSCSITargetName=none:None
OVEHOSTED_STORAGE/imgSizeGB=str:50
OVEHOSTED_STORAGE/imgUUID=str:4ff5a24d-7993-4be3-9301-e829030f9dc1
OVEHOSTED_STORAGE/lockspaceImageUUID=none:None
OVEHOSTED_STORAGE/lockspaceVolumeUUID=none:None
OVEHOSTED_STORAGE/metadataImageUUID=none:None
OVEHOSTED_STORAGE/metadataVolumeUUID=none:None
OVEHOSTED_STORAGE/mntOptions=str:
OVEHOSTED_STORAGE/nfsVersion=str:auto
OVEHOSTED_STORAGE/storageDomainConnection=str:nas.example.com:/export/ovirt_share
OVEHOSTED_STORAGE/storageDomainName=str:hosted_storage
OVEHOSTED_STORAGE/volUUID=str:b8e5d967-4ffc-452d-8001-fa9369a6a11b
OVEHOSTED_VM/automateVMShutdown=bool:True
OVEHOSTED_VM/cdromUUID=str:c4b91916-c96b-47cd-a945-5d662ea8fc5d
OVEHOSTED_VM/cloudInitISO=str:generate
OVEHOSTED_VM/cloudinitExecuteEngineSetup=bool:True
OVEHOSTED_VM/cloudinitInstanceDomainName=str:example.com
OVEHOSTED_VM/cloudinitInstanceHostName=str:ovirt-engine.example.com
OVEHOSTED_VM/cloudinitVMDNS=bool:False
OVEHOSTED_VM/cloudinitVMETCHOSTS=bool:False
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:False
OVEHOSTED_VM/cloudinitVMTZ=str:Europe/London
OVEHOSTED_VM/consoleUUID=str:24d13b14-cc56-420a-966c-f0d7341cb19b
OVEHOSTED_VM/emulatedMachine=str:pc
OVEHOSTED_VM/nicUUID=str:77aa84f1-744b-45cc-a298-3905acda6944
OVEHOSTED_VM/ovfArchive=str:
OVEHOSTED_VM/rootSshAccess=str:yes
OVEHOSTED_VM/rootSshPubkey=str:<public_key>
OVEHOSTED_VM/vmCDRom=none:None
OVEHOSTED_VM/vmMACAddr=str:00:18:3d:5b:11:5c
OVEHOSTED_VM/vmMemSizeMB=int:16384
OVEHOSTED_VM/vmVCpus=str:4
After prompting for a couple of passwords it proceeds as far as Task: "Clean
/etc/hosts on the host". Then errors:
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
Here is the hosted-engine-setup log:
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
2018-10-07 20:47:52,180+0100 INFO otopi.context context.runSequence:741 Stage:
Initializing
2018-10-07 20:47:52,215+0100 INFO otopi.context context.runSequence:741 Stage: Environment
setup
2018-10-07 20:47:52,449+0100 INFO otopi.context context.runSequence:741 Stage: Environment
packages setup
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
2018-10-07 20:47:52,636+0100 INFO otopi.context context.runSequence:741 Stage: Programs
detection
LANG=en_GB.UTF-8
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
LANG=en_GB.UTF-8
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
2018-10-07 20:47:52,778+0100 INFO otopi.context context.runSequence:741 Stage: Environment
setup
2018-10-07 20:47:52,787+0100 INFO otopi.context context.runSequence:741 Stage: Environment
customization
LoadState=loaded
PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.
64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.283 ms
--- 10.0.0.1 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms
2018-10-07 20:47:54,133+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:47:55,336+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:47:55,738+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Detecting interface on existing management
bridge]
2018-10-07 20:47:56,239+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:47:57,544+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get all active network interfaces]
2018-10-07 20:48:00,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Filter bonds with bad naming]
2018-10-07 20:48:01,855+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Generate output list]
2018-10-07 20:48:02,256+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0
valid_lft forever preferred_lft forever
inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute
valid_lft forever preferred_lft forever
21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0
valid_lft forever preferred_lft forever
inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute
valid_lft forever preferred_lft forever
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default
qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master
bond0 state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0
state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN
group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0
valid_lft forever preferred_lft forever
20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master
virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0
valid_lft forever preferred_lft forever
inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute
valid_lft forever preferred_lft forever
2018-10-07 20:48:21,545+0100 INFO otopi.context context.runSequence:741 Stage: Setup
validation
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default
qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master
bond0 state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0
state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN
group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0
valid_lft forever preferred_lft forever
20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master
virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0
valid_lft forever preferred_lft forever
inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute
valid_lft forever preferred_lft forever
2018-10-07 20:48:21,610+0100 WARNING otopi.plugins.gr_he_common.network.bridge
hostname._validateFQDN:387 Host name host has no domain suffix
host. 0 IN A 10.0.0.171
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default
qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master
bond0 state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0
state UP group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN
group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0
valid_lft forever preferred_lft forever
20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master
virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff
21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default qlen 1000
link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0
valid_lft forever preferred_lft forever
inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute
valid_lft forever preferred_lft forever
2018-10-07 20:48:21,693+0100 INFO otopi.context context.runSequence:741 Stage: Transaction
setup
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
2018-10-07 20:48:21,785+0100 INFO otopi.context context.runSequence:741 Stage: Misc
configuration
2018-10-07 20:48:21,787+0100 INFO otopi.context context.runSequence:741 Stage: Package
installation
2018-10-07 20:48:21,823+0100 INFO otopi.context context.runSequence:741 Stage: Misc
configuration
2018-10-07 20:48:21,839+0100 INFO otopi.context context.runSequence:741 Stage: Transaction
commit
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
2018-10-07 20:48:21,885+0100 INFO otopi.context context.runSequence:741 Stage: Closing up
2018-10-07 20:48:21,886+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc
misc.initial_clean_up:229 Cleaning previous attempts
2018-10-07 20:48:22,895+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:48:23,998+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:24,500+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check firewalld status]
2018-10-07 20:48:25,402+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:25,904+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Enforce firewalld status]
2018-10-07 20:48:26,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:48:26,707+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Stop libvirt service]
2018-10-07 20:48:27,610+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:28,112+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Drop vdsm config statements]
2018-10-07 20:48:30,216+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Restore initial abrt config files]
2018-10-07 20:48:33,823+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Restart abrtd service]
2018-10-07 20:48:34,725+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:35,127+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Drop libvirt sasl2 configuration by vdsm]
2018-10-07 20:48:35,829+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:36,230+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Stop and disable services]
2018-10-07 20:48:38,334+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Start libvirt]
2018-10-07 20:48:39,337+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:39,739+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check for leftover local Hosted Engine VM]
2018-10-07 20:48:40,541+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:40,943+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Destroy leftover local Hosted Engine VM]
2018-10-07 20:48:41,344+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:48:41,746+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check for leftover defined local Hosted Engine
VM]
2018-10-07 20:48:42,448+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:42,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Undefine leftover local engine VM]
2018-10-07 20:48:43,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:48:43,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check for leftover defined Hosted Engine VM]
2018-10-07 20:48:44,454+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:44,856+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Undefine leftover engine VM]
2018-10-07 20:48:45,157+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:48:45,558+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Remove eventually entries for the local VM from
known_hosts file]
2018-10-07 20:48:46,360+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:46,663+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc
misc._closeup:195 Starting local VM
2018-10-07 20:48:47,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:48:48,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:49,277+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Start libvirt]
2018-10-07 20:48:50,180+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:50,681+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Activate default libvirt network]
2018-10-07 20:48:51,484+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:52,687+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get libvirt interfaces]
2018-10-07 20:48:53,390+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:53,691+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get routing rules]
2018-10-07 20:48:54,493+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:55,797+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Save bridge name]
2018-10-07 20:48:56,098+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:56,500+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for the bridge to appear on the host]
2018-10-07 20:48:57,102+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:48:57,503+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Refresh network facts]
2018-10-07 20:48:57,905+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:48:58,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Prepare CIDR for virbr0]
2018-10-07 20:48:58,708+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:48:59,209+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add outbound route rules]
2018-10-07 20:48:59,911+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:01,115+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add inbound route rules]
2018-10-07 20:49:01,817+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:03,122+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:49:05,427+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:05,929+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 20:49:06,330+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:06,731+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Avoid localhost]
2018-10-07 20:49:07,133+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:07,434+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get host address resolution]
2018-10-07 20:49:08,237+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:09,440+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check address resolution]
2018-10-07 20:49:09,842+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:10,243+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse host address resolution]
2018-10-07 20:49:10,645+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:11,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Ensure host address resolves locally]
2018-10-07 20:49:12,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:12,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get target address from selected interface]
2018-10-07 20:49:13,153+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:14,458+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check the resolved address resolves on the
selected interface]
2018-10-07 20:49:14,859+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:15,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check for alias]
2018-10-07 20:49:15,963+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:17,166+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Ensure the resolved address resolves only on the
selected interface]
2018-10-07 20:49:17,568+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:18,069+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Avoid localhost]
2018-10-07 20:49:18,471+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:18,872+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get engine FQDN resolution]
2018-10-07 20:49:19,474+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:20,678+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check engine FQDN resolution]
2018-10-07 20:49:21,080+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:21,481+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse engine FQDN resolution]
2018-10-07 20:49:21,983+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:23,187+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Ensure engine FQDN doesn't resolve locally]
2018-10-07 20:49:23,588+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:49:23,890+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check http/https proxy]
2018-10-07 20:49:24,792+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Register the engine FQDN as a host]
2018-10-07 20:49:25,093+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:25,495+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create directory for local VM]
2018-10-07 20:49:26,397+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:26,799+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set local vm dir path]
2018-10-07 20:49:27,200+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:27,602+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fix local VM directory permission]
2018-10-07 20:49:28,504+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:49:29,005+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 20:49:29,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:49:29,808+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Install ovirt-engine-appliance rpm]
2018-10-07 20:53:29,731+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:53:30,234+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse appliance configuration for path]
2018-10-07 20:53:30,936+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:53:32,140+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse appliance configuration for sha1sum]
2018-10-07 20:53:32,842+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:53:34,045+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get OVA path]
2018-10-07 20:53:34,447+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:53:35,651+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Compute sha1sum]
2018-10-07 20:53:37,655+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:53:38,959+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Compare sha1sum]
2018-10-07 20:53:39,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:53:39,662+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Register appliance PATH]
2018-10-07 20:53:40,063+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:53:41,267+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Extract appliance to local VM directory]
2018-10-07 20:54:37,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:54:38,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 20:54:38,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:54:50,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Find the local appliance image]
2018-10-07 20:54:51,577+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:54:52,781+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set local_vm_disk_path]
2018-10-07 20:54:53,182+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:54:53,584+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get appliance disk size]
2018-10-07 20:54:54,386+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:54:55,590+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse qemu-img output]
2018-10-07 20:54:55,992+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:54:57,196+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create cloud init user-data and meta-data files]
2018-10-07 20:54:59,200+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create ISO disk]
2018-10-07 20:54:59,902+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:55:00,403+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create local VM]
2018-10-07 20:55:02,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:55:03,611+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get local VM IP]
2018-10-07 20:55:25,649+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:55:26,953+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Remove eventually entries for the local VM from
/etc/hosts]
2018-10-07 20:55:27,755+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:55:28,256+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create an entry in /etc/hosts for the local VM]
2018-10-07 20:55:28,958+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:55:29,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for SSH to restart on the local VM]
2018-10-07 20:56:00,316+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost -> localhost]
2018-10-07 20:56:00,818+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:56:03,123+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [ovirt-engine.example.com]
2018-10-07 20:56:03,624+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for the local VM]
2018-10-07 20:56:10,337+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [ovirt-engine.example.com]
2018-10-07 20:56:10,939+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add an entry for this host on /etc/hosts on the
local VM]
2018-10-07 20:56:12,443+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:56:12,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set FQDN]
2018-10-07 20:56:14,548+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:56:15,050+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Force the local VM FQDN to temporary resolve on
the natted network address]
2018-10-07 20:56:16,654+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:56:17,155+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Restore sshd reverse DNS lookups]
2018-10-07 20:56:18,659+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:56:19,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Generate an answer file for engine-setup]
2018-10-07 20:56:21,665+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:56:22,167+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Include before engine-setup custom tasks files for
the engine VM]
2018-10-07 20:56:23,972+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Execute engine-setup]
2018-10-07 20:57:52,926+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:57:54,430+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Include after engine-setup custom tasks files for
the engine VM]
2018-10-07 20:57:56,234+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Configure LibgfApi support]
2018-10-07 20:57:56,735+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [ovirt-engine.example.com]
2018-10-07 20:57:58,139+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Restart ovirt-engine service for LibgfApi
support]
2018-10-07 20:57:58,540+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [ovirt-engine.example.com]
2018-10-07 20:57:59,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Mask cloud-init services to speed up future boot]
2018-10-07 20:58:02,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Clean up bootstrap answer file]
2018-10-07 20:58:04,252+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 20:58:04,854+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 20:58:06,157+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:58:06,759+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for ovirt-engine service to start]
2018-10-07 20:58:07,962+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:58:09,767+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Detect VLAN ID]
2018-10-07 20:58:10,569+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:58:12,174+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set Engine public key as authorized key without
validating the TLS/SSL certificates]
2018-10-07 20:58:13,276+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:58:13,878+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 20:58:14,380+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:58:14,982+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Obtain SSO token using username/password
credentials]
2018-10-07 20:58:16,285+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 20:58:16,987+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Enable GlusterFS at cluster level]
2018-10-07 20:58:17,489+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:58:17,990+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set VLAN ID at datacenter level]
2018-10-07 20:58:18,492+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 20:58:19,094+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Force host-deploy in offline mode]
2018-10-07 20:58:20,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:58:20,598+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add host]
2018-10-07 20:58:22,401+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 20:58:23,004+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for the host to be up]
2018-10-07 22:00:02,131+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:03,835+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check host status]
2018-10-07 22:00:04,336+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:04,937+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Remove host-deploy configuration file]
2018-10-07 22:00:05,639+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:00:06,051+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.storage_domain
storage_domain._closeup:751 Creating Storage Domain
2018-10-07 22:00:06,856+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 22:00:07,658+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:08,159+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check local VM dir stat]
2018-10-07 22:00:08,860+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:09,361+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Enforce local VM dir existence]
2018-10-07 22:00:09,863+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:10,364+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 22:00:10,865+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:11,366+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Obtain SSO token using username/password
credentials]
2018-10-07 22:00:12,268+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:12,769+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch host facts]
2018-10-07 22:00:13,671+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:15,274+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch cluster ID]
2018-10-07 22:00:15,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:16,276+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch cluster facts]
2018-10-07 22:00:17,178+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:18,781+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter facts]
2018-10-07 22:00:19,683+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:21,286+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter ID]
2018-10-07 22:00:21,787+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:22,389+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter name]
2018-10-07 22:00:22,790+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:23,391+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add NFS storage domain]
2018-10-07 22:00:24,994+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:00:25,595+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add glusterfs storage domain]
2018-10-07 22:00:26,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:26,698+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add iSCSI storage domain]
2018-10-07 22:00:27,199+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:27,700+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add Fibre Channel storage domain]
2018-10-07 22:00:28,201+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:28,802+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get storage domain details]
2018-10-07 22:00:29,704+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:31,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Find the appliance OVF]
2018-10-07 22:00:32,109+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:33,812+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse OVF]
2018-10-07 22:00:34,614+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:35,115+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get required size]
2018-10-07 22:00:35,716+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:00:37,320+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Remove unsuitable storage domain]
2018-10-07 22:00:37,821+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:39,424+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check storage domain free space]
2018-10-07 22:00:39,925+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:00:40,526+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Activate storage domain]
2018-10-07 22:04:13,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:04:15,258+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.target_vm
target_vm._closeup:213 Creating Target VM
2018-10-07 22:04:16,064+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 22:04:16,965+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:17,467+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Register the engine FQDN as a host]
2018-10-07 22:04:17,968+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:04:18,469+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 22:04:18,870+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:19,472+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Obtain SSO token using username/password
credentials]
2018-10-07 22:04:20,373+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:20,874+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get local VM IP]
2018-10-07 22:04:21,676+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:04:23,179+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch host facts]
2018-10-07 22:04:24,080+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:25,683+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Cluster ID]
2018-10-07 22:04:26,184+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:26,786+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Cluster facts]
2018-10-07 22:04:27,687+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:29,290+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter facts]
2018-10-07 22:04:30,192+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:31,795+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Cluster name]
2018-10-07 22:04:32,296+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:32,898+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter ID]
2018-10-07 22:04:33,399+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:34,000+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Datacenter name]
2018-10-07 22:04:34,501+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:35,103+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get Cluster CPU model]
2018-10-07 22:04:35,604+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:37,207+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Get storage domain details]
2018-10-07 22:04:38,209+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:04:39,812+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add HE disks]
2018-10-07 22:06:32,186+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Register disk details]
2018-10-07 22:06:32,788+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:06:34,491+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Add VM]
2018-10-07 22:06:36,595+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:06:38,198+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Register external local VM uuid]
2018-10-07 22:06:39,000+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:06:40,703+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 22:06:41,905+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [ovirt-engine.example.com]
2018-10-07 22:06:42,406+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Find configuration file for SCL PostgreSQL]
2018-10-07 22:06:43,509+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 22:06:45,012+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check SCL PostgreSQL value]
2018-10-07 22:06:46,114+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 22:06:47,717+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Update target VM details at DB level]
2018-10-07 22:06:50,523+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Insert Hosted Engine configuration disk uuid into
Engine database]
2018-10-07 22:06:51,625+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 22:06:53,228+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Disable IPv6]
2018-10-07 22:06:54,330+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 22:06:54,931+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Reload sysctl]
2018-10-07 22:06:55,933+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [ovirt-engine.example.com]
2018-10-07 22:06:56,535+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 22:06:57,837+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:06:58,538+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Enable again the serial console device]
2018-10-07 22:06:59,741+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:00,442+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Trigger hosted engine OVF update]
2018-10-07 22:07:01,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:07:02,646+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait until OVF update finishes]
2018-10-07 22:07:03,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:04,449+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse OVF_STORE disk list]
2018-10-07 22:07:05,151+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:07,255+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check OVF_STORE volume status (ansible 2.5)]
2018-10-07 22:07:08,657+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Check OVF_STORE volume status (ansible 2.6)]
2018-10-07 22:07:11,362+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Prepare images]
2018-10-07 22:07:15,970+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Hosted Engine configuration disk path]
2018-10-07 22:07:16,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:17,373+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Hosted Engine virtio disk path]
2018-10-07 22:07:18,075+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:18,776+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch Hosted Engine virtio metadata path]
2018-10-07 22:07:19,377+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:07:24,286+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Shutdown local VM]
2018-10-07 22:07:25,288+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:07:26,090+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Wait for local VM shutdown]
2018-10-07 22:09:01,140+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:03,144+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Undefine local VM]
2018-10-07 22:09:04,046+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:04,747+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Detect spmId]
2018-10-07 22:09:05,749+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:07,853+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Parse spmId]
2018-10-07 22:09:08,555+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:10,558+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Detect ovirt-hosted-engine-ha version]
2018-10-07 22:09:11,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:12,162+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set ha_version]
2018-10-07 22:09:12,763+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:14,867+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create configuration templates]
2018-10-07 22:09:18,172+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create configuration archive]
2018-10-07 22:09:18,974+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:19,676+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create ovirt-hosted-engine-ha run directory]
2018-10-07 22:09:20,577+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:21,379+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy configuration files to the right location on
host]
2018-10-07 22:09:23,483+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy configuration archive to storage]
2018-10-07 22:09:24,685+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:25,387+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Initialize metadata volume]
2018-10-07 22:09:36,903+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:37,604+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 22:09:38,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:39,107+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Find the local appliance image]
2018-10-07 22:09:40,009+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:42,113+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set local_vm_disk_path]
2018-10-07 22:09:42,714+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:09:43,415+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Generate DHCP network configuration for the engine
VM]
2018-10-07 22:09:44,417+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:09:45,119+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Generate static network configuration for the
engine VM]
2018-10-07 22:09:45,720+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 skipping: [localhost]
2018-10-07 22:09:46,422+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Inject network configuration with guestfish]
2018-10-07 22:10:01,444+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:02,146+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Extract /etc/hosts from the Hosted Engine VM]
2018-10-07 22:10:05,151+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:05,953+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Clean /etc/hosts for the Hosted Engine VM for
Engine VM FQDN]
2018-10-07 22:10:06,754+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:07,455+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Clean /etc/hosts for the Hosted Engine VM for host
address]
2018-10-07 22:10:08,357+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:09,059+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy /etc/hosts back to the Hosted Engine VM]
2018-10-07 22:10:12,364+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:13,065+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy local VM disk to shared storage]
2018-10-07 22:10:43,511+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:44,212+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Clean /etc/hosts on the host]
2018-10-07 22:10:44,814+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 {u'msg': u"The task includes an option with
an undefined variable. The error was: list object has no element 0\n\nThe error appears to
have been in '/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml':
line 396, column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\n changed_when: True\n - name: Clean
/etc/hosts on the host\n ^ here\n", u'_ansible_no_log': False}
2018-10-07 22:10:44,914+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"msg":
"The task includes an option with an undefined variable. The error was: list object
has no element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:180 ansible-playbook rc: 2
2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 70 changed: 24 unreachable:
0 skipped: 3 failed: 1
2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com] : ok: 11 changed: 6
unreachable: 0 skipped: 0 failed: 0
2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:187 ansible-playbook stdout:
2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:189 to retry, use: --limit
@/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.retry
2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:190 ansible-playbook stderr:
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
line 214, in _closeup
r = ah.run()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
line 194, in run
raise RuntimeError(_('Failed executing ansible-playbook'))
RuntimeError: Failed executing ansible-playbook
2018-10-07 22:10:45,418+0100 ERROR otopi.context context._executeMethod:152 Failed to
execute stage 'Closing up': Failed executing ansible-playbook
2018-10-07 22:10:45,419+0100 INFO otopi.context context.runSequence:741 Stage: Clean up
2018-10-07 22:10:45,420+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc
misc._cleanup:246 Cleaning temporary resources
2018-10-07 22:10:46,225+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Gathering Facts]
2018-10-07 22:10:46,927+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:47,528+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fetch logs from the engine VM]
2018-10-07 22:10:47,929+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:48,430+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set destination directory path]
2018-10-07 22:10:48,931+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:49,332+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Create destination directory]
2018-10-07 22:10:50,134+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:10:50,535+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 22:10:51,036+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:51,537+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Find the local appliance image]
2018-10-07 22:10:52,239+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:53,641+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Set local_vm_disk_path]
2018-10-07 22:10:54,042+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:10:54,544+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Give the vm time to flush dirty buffers]
2018-10-07 22:11:04,959+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:11:05,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy engine logs]
2018-10-07 22:11:11,269+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [include_tasks]
2018-10-07 22:11:11,670+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-07 22:11:12,171+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Remove local vm dir]
2018-10-07 22:11:13,173+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-07 22:11:14,403+0100 INFO otopi.context context.runSequence:741 Stage:
Termination
2018-10-07 22:11:14,404+0100 ERROR otopi.plugins.gr_he_common.core.misc
misc._terminate:240 Hosted Engine deployment failed: please check the logs for the issue,
fix accordingly or re-deploy from scratch.
For brevity, I've trimmed the debug lines from the above except those around the error
"task includes an option with an undefined variable". Any ideas? I have
assigned engine a DHCP address and can resolve its name to a natted IP: 192.168.124.51.
I run the same command again in case this is an anomaly:
hosted-engine --deploy
--config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers.conf
This time, it doesn't get that far, proceeds as far as:
[ INFO ] TASK [Activate storage domain]
[ ERROR ] Error: Fault reason is "Operation Failed". Fault detail is
"[]". HTTP response code is 400.
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"Fault reason is \"Operation Failed\". Fault detail is \"[]\".
HTTP response code is 400."}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook
The hosted-engine log this time shows:
2018-10-07 22:54:43,619+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Activate storage domain]
2018-10-07 22:54:45,022+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:98 Error: Fault reason is "Operation Failed".
Fault detail is "[]". HTTP response code is 400.
2018-10-07 22:54:45,122+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"changed":
false, "msg": "Fault reason is \"Operation Failed\". Fault detail
is \"[]\". HTTP response code is 400."}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/storage_domain.py",
line 756, in _closeup
raise e
RuntimeError: Failed executing ansible-playbook
I've had other errors too, but my own investigations haven't solved. Any ideas
much appreciated.
Many thanks.
2:39 a.m.
Okay, the above failure at "TASK [Clean /etc/hosts on the host]" seems to have
been due to the fact I hadn't emptied the shared NFS storage after the last attempt.
After fresh-installing node and emptying (rm -rf *), it proceeded a few steps further to:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Add an entry in /etc/hosts for the target VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [Start ovirt-ha-broker service on the host]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Initialize lockspace volume]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Start ovirt-ha-agent service on the host]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Check engine VM health]
Then hung. Eventually I killed it by pressing ctrl-C. Ran the usual install again
(hosted-engine --deploy
--config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers.conf) in case of
anomaly. This time only got as far as:
[ INFO ] TASK [Create local VM]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd":
["virt-install", "-n", "HostedEngineLocal",
"--os-variant", "rhel7", "--virt-type", "kvm",
"--memory", "16384", "--vcpus", "4",
"--network", "network=default,mac=00:16:3e:0a:91:2c,model=virtio",
"--disk",
"/var/tmp/localvmhRtN_6/images/65f7f081-4d9e-43ae-926f-25807f075f1d/a0a00e73-d3ea-4b9b-bd26-06fe189931f2",
"--import", "--disk",
"path=/var/tmp/localvmhRtN_6/seed.iso,device=cdrom",
"--noautoconsole", "--rng", "/dev/random",
"--graphics", "vnc", "--video", "vga",
"--sound", "none", "--controller",
"usb,model=none", "--memballoon", "none",
"--boot", "hd,menu=off", "--clock",
"kvmclock_present=yes"], "delta": "0:00:00.512265",
"end": "2018-10-08 00:33:59.632317", "msg": "non-zero
return code", "rc": 1, "start": "2018-10-08
00:33:59.120052", "stderr": "ERROR The MAC address
'00:16:3e:0a:91:2c' is in use by another virtual machine.\nDomain installation
does not appear to have been successful.\nIf it was, you can restar
t your domain by running:\n virsh --connect qemu:///system start
HostedEngineLocal\notherwise, please restart your installation.",
"stderr_lines": ["ERROR The MAC address '00:16:3e:0a:91:2c' is
in use by another virtual machine.", "Domain installation does not appear to
have been successful.", "If it was, you can restart your domain by
running:", " virsh --connect qemu:///system start HostedEngineLocal",
"otherwise, please restart your installation."], "stdout":
"\nStarting install...", "stdout_lines": ["", "Starting
install..."]}
12:29 p.m.
Fresh installed again. After boot, did not configure bond this time. Attempted install.
Chose the first NIC, got as far as:
[ INFO ] TASK [Check the resolved address resolves on the selected interface]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"The resolved address doesn't resolve on the selected interface\n"}
So ran again, this time choosing the second of the two NICs, got further. Failed at:
[ INFO ] TASK [Install ovirt-engine-appliance rpm]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180903.1.el7.noarch.rpm:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 millisecond
s')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')\nTryi
ng other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-en...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt
.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180903.1.el7.noarch.rpm:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\n\n\nError downloading packages:\n
ovirt-engine-appliance-4.2-20180903.1.el7.noarch: [Errno 256] No more mirrors to
try.\n\nCannot upload enabled repos report, is this client registered?\n",
"rc": 1, "results": ["Loaded plugins: enabled_repos_upload,
fastestmirror, imgbased-persist,\n : package_upload, product-id,
search-disabled-repos, subscription-\n : manager, vdsmupgrade\nThis system is
not registered with an entitlement server. You can use subscription-manager to
register.\nLoading mirror speeds from cached hostfile\n * ovirt-4.2-epel:
mirror.vorboss.net\nResolving Dependencies\n--> Running transaction check\n--->
Package ovirt-engine-appliance.noarch 0:4.2-201
80903.1.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies
Resolved\n\n================================================================================\n
Package Arch Version Repository
Size\n================================================================================\nInstalling:\n
ovirt-engine-appliance noarch 4.2-20180903.1.el7 ovirt-4.2 992
M\n\nTransaction
Summary\n================================================================================\nInstall
1 Package\n\nTotal download size: 992 M\nInstalled size: 992 M\nDownloading
packages:\nUploading Enabled Repositories Report\nLoaded plugins: fastestmirror,
product-id, subscription-manager\nThis system is not registered with an entitlement
server. You can use subscription-manager to register.\n"]}
Possibly a temporary internet problem. Tried again. Same error. Internet is working
fine from host.
1:07 p.m.
You can try manually installing ovirt-engine-appliance via yum
On Mon, Oct 8, 2018 at 11:33 AM <me(a)brendanh.com> wrote:
Fresh installed again. After boot, did not configure bond this
time.
Attempted install. Chose the first NIC, got as far as:
[ INFO ] TASK [Check the resolved address resolves on the selected
interface]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"The
resolved address doesn't resolve on the selected interface\n"}
So ran again, this time choosing the second of the two NICs, got further.
Failed at:
[ INFO ] TASK [Install ovirt-engine-appliance rpm]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 millisecond
s')\nTrying other mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')\nTryi
ng other mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://
resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\nhttp://resources.ovirt
.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180903.1.el7.noarch.rpm:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')\nTrying other
mirror.\n\n\nError downloading packages:\n
ovirt-engine-appliance-4.2-20180903.1.el7.noarch: [Errno 256] No more
mirrors to try.\n\nCannot upload enabled repos report, is this client
registered?\n", "rc": 1, "results": ["Loaded plugins:
enabled_repos_upload,
fastestmirror, imgbased-persist,\n : package_upload,
product-id, search-disabled-repos, subscription-\n : manager,
vdsmupgrade\nThis system is not registered with an entitlement server. You
can use subscription-manager to register.\nLoading mirror speeds from
cached hostfile\n * ovirt-4.2-epel: mirror.vorboss.net\nResolving
Dependencies\n--> Running transaction check\n---> Package
ovirt-engine-appliance.noarch 0:4.2-201
80903.1.el7 will be installed\n--> Finished Dependency
Resolution\n\nDependencies
Resolved\n\n================================================================================\n
Package Arch Version Repository
Size\n================================================================================\nInstalling:\n
ovirt-engine-appliance noarch 4.2-20180903.1.el7 ovirt-4.2
992 M\n\nTransaction
Summary\n================================================================================\nInstall
1 Package\n\nTotal download size: 992 M\nInstalled size: 992 M\nDownloading
packages:\nUploading Enabled Repositories Report\nLoaded plugins:
fastestmirror, product-id, subscription-manager\nThis system is not
registered with an entitlement server. You can use subscription-manager to
register.\n"]}
Possibly a temporary internet problem. Tried again. Same error.
Internet is working fine from host.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/PXZNA5DE5FX...
5:58 p.m.
Thanks for the suggestion Simone. Tried sudo yum install ovirt-engine-appliance, no joy:
"
=================================================================================================================================
Package Arch Version
Repository Size
=================================================================================================================================
Installing:
ovirt-engine-appliance noarch 4.2-20180903.1.el7
ovirt-4.2 992 M
Transaction Summary
=================================================================================================================================
Install 1 Package
Total download size: 992 M
Installed size: 992 M
Is this ok [y/d/N]: y
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
] 1.8 kB/s | 124 MB 134:10:07 ETA
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30000 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30000 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
Error downloading packages:
ovirt-engine-appliance-4.2-20180903.1.el7.noarch: [Errno 256] No more mirrors to try.
Uploading Enabled Repositories Report
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager
to register.
Cannot upload enabled repos report, is this client registered?
"
Tried a couple of times, same result.
6:02 p.m.
On Mon, Oct 8, 2018 at 5:00 PM <me(a)brendanh.com> wrote:
Thanks for the suggestion Simone. Tried sudo yum install
ovirt-engine-appliance, no joy:
Can you please run a "yum clean all" and retry?
"
=================================================================================================================================
Package Arch Version
Repository Size
=================================================================================================================================
Installing:
ovirt-engine-appliance noarch
4.2-20180903.1.el7 ovirt-4.2 992 M
Transaction Summary
=================================================================================================================================
Install 1 Package
Total download size: 992 M
Installed size: 992 M
Is this ok [y/d/N]: y
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
] 1.8 kB/s | 124 MB 134:10:07 ETA
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30000 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30000 milliseconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
seconds')
Trying other mirror.
ovirt-engine-appliance-4.2-201 FAILED
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
[Errno 12] Timeout on
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
(28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
Error downloading packages:
ovirt-engine-appliance-4.2-20180903.1.el7.noarch: [Errno 256] No more
mirrors to try.
Uploading Enabled Repositories Report
Loaded plugins: fastestmirror, product-id, subscription-manager
This system is not registered with an entitlement server. You can use
subscription-manager to register.
Cannot upload enabled repos report, is this client registered?
"
Tried a couple of times, same result.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/A5GX3NQRGRJ...
6:10 p.m.
For debugging purposes try to download directly with curl/wget and if that
works, I would try to increase the timeout in yum.conf
On Mon, Oct 8, 2018 at 6:05 PM Simone Tiraboschi <stirabos(a)redhat.com>
wrote:
On Mon, Oct 8, 2018 at 5:00 PM <me(a)brendanh.com> wrote:
> Thanks for the suggestion Simone. Tried sudo yum install
> ovirt-engine-appliance, no joy:
>
Can you please run a "yum clean all" and retry?
> "
>
>
=================================================================================================================================
> Package Arch Version
> Repository Size
>
>
=================================================================================================================================
> Installing:
> ovirt-engine-appliance noarch
> 4.2-20180903.1.el7 ovirt-4.2 992 M
>
> Transaction Summary
>
>
=================================================================================================================================
> Install 1 Package
>
> Total download size: 992 M
> Installed size: 992 M
> Is this ok [y/d/N]: y
> Downloading packages:
> Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
> seconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30001 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30001 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30001 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
> ] 1.8 kB/s | 124 MB 134:10:07 ETA
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
> seconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30001 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30000 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30000 milliseconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30
> seconds')
> Trying other mirror.
> ovirt-engine-appliance-4.2-201 FAILED
>
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> [Errno 12] Timeout on
>
http://resources.ovirt.org/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appl...:
> (28, 'Connection timed out after 30001 milliseconds')
> Trying other mirror.
>
> Error downloading packages:
> ovirt-engine-appliance-4.2-20180903.1.el7.noarch: [Errno 256] No more
> mirrors to try.
> Uploading Enabled Repositories Report
> Loaded plugins: fastestmirror, product-id, subscription-manager
> This system is not registered with an entitlement server. You can use
> subscription-manager to register.
> Cannot upload enabled repos report, is this client registered?
> "
>
>
> Tried a couple of times, same result.
> _______________________________________________
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/A5GX3NQRGRJ...
>
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/MKNPAM6WEWE...
2:19 a.m.
Okay, I went back to using a bond (instead of an individual NIC). Above network problem
is fixed and now proceeds as far as ever. Hangs for around 10 minutes at:
[ INFO ] TASK [Check engine VM health]
The hosted-engine-setup-ansible-create_target_vm log has:
2018-10-08 23:42:01,664+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Check engine VM health', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
Then repeats the following line for around 10 minutes:
2018-10-08 23:42:01,866+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cd338d0> kwargs
Before eventually, the console outputs the following error:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed": true, "cmd": ["hosted-engine",
"--vm-status", "--json"], "delta":
"0:00:00.167677", "end": "2018-10-08 23:53:11.112436",
"rc": 0, "start": "2018-10-08 23:53:10.944759",
"stderr": "", "stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}", "stdout_lines":
["{\"1\": {\"c
onf_on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}"]}
[ INFO ] TASK [Check VM status at virt level]
The hosted-engine-setup-ansible-create_target_vm log shows the following when this error
occurs:
2018-10-08 23:53:11,812+0100 DEBUG var changed: host "localhost" var
"ansible_failed_result" type "<type 'dict'>" value:
"{
"_ansible_no_log": false,
"_ansible_parsed": true,
"attempts": 120,
"changed": true,
"cmd": [
"hosted-engine",
"--vm-status",
"--json"
],
"delta": "0:00:00.167677",
"end": "2018-10-08 23:53:11.112436",
"failed": true,
"invocation": {
"module_args": {
"_raw_params": "hosted-engine --vm-status --json",
"_uses_shell": false,
"argv": null,
"chdir": null,
"creates": null,
"executable": null,
"removes": null,
"stdin": null,
"warn": true
}
},
"rc": 0,
"start": "2018-10-08 23:53:10.944759",
"stderr": "",
"stderr_lines": [],
"stdout": "{\"1\": {\"conf_on_shared_storage\":
true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}",
"stdout_lines": [
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}"
]
}"
2018-10-08 23:53:11,813+0100 DEBUG var changed: host "localhost" var
"ansible_failed_task" type "<type 'dict'>" value:
"{
"action": "command",
"any_errors_fatal": false,
"args": {
"_ansible_check_mode": false,
"_ansible_debug": false,
"_ansible_diff": false,
"_ansible_keep_remote_files": false,
"_ansible_module_name": "command",
"_ansible_no_log": false,
"_ansible_remote_tmp": "~/.ansible/tmp",
"_ansible_selinux_special_fs": [
"fuse",
"nfs",
"vboxsf",
"ramfs",
"9p"
],
"_ansible_shell_executable": "/bin/sh",
"_ansible_socket": null,
"_ansible_syslog_facility": "LOG_USER",
"_ansible_tmpdir":
"/root/.ansible/tmp/ansible-tmp-1539039190.78-59276929025529/",
"_ansible_verbosity": 0,
"_ansible_version": "2.6.5",
"_raw_params": "hosted-engine --vm-status --json",
"warn": true
},
"async": 0,
"async_val": 0,
"become": null,
"become_flags": null,
"become_method": null,
"become_user": null,
"changed_when": [
true
],
"check_mode": null,
"connection": "local",
"debugger": null,
"delay": 5,
"delegate_facts": false,
"delegate_to": null,
"diff": null,
"environment": [
{
"LANG": "en_US.UTF-8",
"LC_ALL": "en_US.UTF-8",
"LC_MESSAGES": "en_US.UTF-8"
}
],
"failed_when": [],
"finalized": false,
"ignore_errors": null,
"loop": null,
"loop_control": null,
"loop_with": null,
"module_defaults": [],
"name": "Check engine VM health",
"no_log": null,
"notify": null,
"parent": {
"any_errors_fatal": null,
"become": null,
"become_flags": null,
"become_method": null,
"become_user": null,
"check_mode": null,
"connection": "local",
"debugger": null,
"delegate_facts": false,
"delegate_to": null,
"dep_chain": null,
"diff": null,
"environment": null,
"eor": false,
"ignore_errors": null,
"module_defaults": null,
"name": "Wait for the engine to come up on the target VM",
"no_log": null,
"port": null,
"remote_user": null,
"run_once": null,
"tags": [],
"vars": {},
"when": []
},
"parent_type": "Block",
"poll": 10,
"port": null,
"register": "health_result",
"remote_user": null,
"retries": 120,
"run_once": null,
"squashed": false,
"tags": [],
"until": [
"health_result.rc == 0 and 'health' in health_result.stdout and
health_result.stdout|from_json|json_query('*.\"engine-status\".\"health\"')|first==\"good\""
],
"uuid": "525400d0-30bf-04f1-b63b-00000000006b",
"vars": {},
"when": []
}"
2018-10-08 23:53:11,813+0100 DEBUG var changed: host "localhost" var
"health_result" type "<type 'dict'>" value: "{
"attempts": 120,
"changed": true,
"cmd": [
"hosted-engine",
"--vm-status",
"--json"
],
"delta": "0:00:00.167677",
"end": "2018-10-08 23:53:11.112436",
"failed": true,
"rc": 0,
"start": "2018-10-08 23:53:10.944759",
"stderr": "",
"stderr_lines": [],
"stdout": "{\"1\": {\"conf_on_shared_storage\":
true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}",
"stdout_lines": [
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491 (Mon Oct 8
23:53:03 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8 23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"75452be7\",
\"local_conf_timestamp\": 49491, \"host-ts\": 49491},
\"global_maintenance\": false}"
]
}"
2018-10-08 23:53:11,813+0100 ERROR ansible failed {'status': 'FAILED',
'ansible_type': 'task', 'ansible_task': u'Check engine VM
health', 'ansible_result': u'type: <type \'dict\'>\nstr:
{\'_ansible_parsed\': True, \'stderr_lines\': [], u\'changed\':
True, u\'end\': u\'2018-10-08 23:53:11.112436\',
\'_ansible_no_log\': False, u\'stdout\': u\'{"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\\\nmetadata_feature_version=1\\\\ntimestamp=49491 (Mon Oct
8 23:53:', 'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml'}
2018-10-08 23:53:11,813+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cd338d0> kwargs
ignore_errors:None
2018-10-08 23:53:12,517+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Check VM status at virt level',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:12,517+0100 DEBUG ansible on_any args TASK: Check VM status at virt level
kwargs is_conditional:False
2018-10-08 23:53:13,433+0100 DEBUG var changed: host "localhost" var
"vm_status_virsh" type "<type 'dict'>" value: "{
"changed": true,
"cmd": "virsh -r list | grep HostedEngine | grep running",
"delta": "0:00:00.053603",
"end": "2018-10-08 23:53:12.741182",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:12.687579",
"stderr": "",
"stderr_lines": [],
"stdout": " 2 HostedEngine running",
"stdout_lines": [
" 2 HostedEngine running"
]
}"
2018-10-08 23:53:13,434+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Check VM status at virt level', 'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:13,434+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caedc10> kwargs
2018-10-08 23:53:14,159+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'debug', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:14,159+0100 DEBUG ansible on_any args TASK: debug kwargs
is_conditional:False
2018-10-08 23:53:14,861+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'', 'ansible_host': u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:14,861+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313c161ad0> kwargs
2018-10-08 23:53:15,575+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Fail if engine VM is not running',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:15,576+0100 DEBUG ansible on_any args TASK: Fail if engine VM is not
running kwargs is_conditional:False
2018-10-08 23:53:16,261+0100 INFO ansible skipped {'status': 'SKIPPED',
'ansible_task': u'Fail if engine VM is not running',
'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:16,261+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313ccec510> kwargs
2018-10-08 23:53:16,967+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:16,968+0100 DEBUG ansible on_any args TASK: Get target engine VM IPv4
address kwargs is_conditional:False
2018-10-08 23:53:17,819+0100 DEBUG var changed: host "localhost" var
"engine_vm_ipv4" type "<type 'dict'>" value: "{
"changed": true,
"cmd": "getent ahostsv4 ovirt-engine.example.com | cut -d' '
-f1 | uniq",
"delta": "0:00:00.004903",
"end": "2018-10-08 23:53:17.143283",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:17.138380",
"stderr": "",
"stderr_lines": [],
"stdout": "10.0.0.109",
"stdout_lines": [
"10.0.0.109"
]
}"
2018-10-08 23:53:17,819+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address',
'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:17,819+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caedc10> kwargs
2018-10-08 23:53:18,531+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u"Get VDSM's target engine VM stats",
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:18,531+0100 DEBUG ansible on_any args TASK: Get VDSM's target engine
VM stats kwargs is_conditional:False
2018-10-08 23:53:19,620+0100 DEBUG var changed: host "localhost" var
"engine_vdsm_stats" type "<type 'dict'>" value: "{
"changed": true,
"cmd": [
"vdsm-client",
"VM",
"getStats",
"vmID=e1af6b26-9e48-251-940c-7bfadf920f3f"
],
"delta": "0:00:00.257926",
"end": "2018-10-08 23:53:18.961394",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:18.703468",
"stderr": "",
"stderr_lines": [],
"stdout": "[\n {\n \"displayInfo\": [\n
{\n \"tlsPort\": \"5901\", \n
\"ipAddress\": \"10.0.0.171\", \n \"port\":
\"5900\", \n \"type\": \"spice\"\n
}, \n {\n \"tlsPort\": \"-1\", \n
\"ipAddress\": \"10.0.0.171\", \n
\"port\": \"5902\", \n \"type\":
\"vnc\"\n }\n ], \n \"memUsage\":
\"18\", \n \"acpiEnable\": \"true\", \n
\"guestFQDN\": \"ovirt-engine.example.com\", \n
\"vmId\": \"e1af6b26-9e48-251-940c-7bfadf920f3f\", \n
\"session\": \"Unknown\", \n \"netIfaces\": [\n
{\n \"name\": \"eth0\", \n
\"inet6\": [], \n \"inet\": [], \n
\"hw\": \"00:18:3d:5b:11:5c\"\n }\n ], \n
\"timeOffset\": \"0\", \n \"memoryStats\": {\n
\"swap_out\": 0, \n \
"majflt\": 0, \n \"minflt\": 198, \n
\"mem_cached\": \"447696\", \n \"mem_free\":
\"13259132\", \n \"mem_buffers\": \"2104\", \n
\"swap_in\": 0, \n \"pageflt\": 198, \n
\"mem_total\": \"16258492\", \n \"mem_unused\":
\"13259132\"\n }, \n \"balloonInfo\": {\n
\"balloon_max\": \"16777216\", \n
\"balloon_cur\": \"16777216\", \n
\"balloon_target\": \"16777216\", \n
\"balloon_min\": \"1048576\"\n }, \n
\"pauseCode\": \"NOERR\", \n \"disksUsage\": [\n
{\n \"path\": \"/\", \n
\"total\": \"6565134336\", \n \"used\":
\"206525344\", \n \"fs\": \"xfs\"\n
}, \n {\n \"path\": \"/boot\", \n
\"total\": \"1063256064\", \n \"used\":
\"169177088\", \n \"fs\": \"xfs\"\n
}, \n
{\n \"path\": \"/tmp\", \n
\"total\": \"2136997888\", \n \"used\":
\"33935360\", \n \"fs\": \"xfs\"\n
}, \n {\n \"path\": \"/home\", \n
\"total\": \"1063256064\", \n \"used\":
\"33796096\", \n \"fs\": \"xfs\"\n
}, \n {\n \"path\": \"/var\", \n
\"total\": \"21464350720\", \n \"used\":
\"456179712\", \n \"fs\": \"xfs\"\n
}, \n {\n \"path\": \"/var/log\", \n
\"total\": \"10726932480\", \n
\"used\": \"43315200\", \n \"fs\":
\"xfs\"\n }, \n {\n \"path\":
\"/var/log/audit\", \n \"total\":
\"1063256064\", \n \"used\": \"3252160\", \n
\"fs\": \"xfs\"\n }\n ], \n
\"network\":
{\n \"vnet0\": {\n \"macAddr\":
\"00:18:3d:5b:11:5c\", \n \"rxDropped\":
\"0\", \n \"tx\": \"1710\", \n
\"txDropped\": \"0\", \n \"rxErrors\":
\"0\", \n \"rx\": \"349635\", \n
\"txErrors\": \"0\", \n \"state\":
\"unknown\", \n \"sampleTime\": 4344173.61, \n
\"speed\": \"1000\", \n \"name\":
\"vnet0\"\n }\n }, \n \"vmType\":
\"kvm\", \n \"cpuUser\": \"3.00\", \n
\"elapsedTime\": \"585\", \n \"vmJobs\": {}, \n
\"cpuSys\": \"1.27\", \n \"appsList\": [\n
\"kernel-3.10.0-862.11.6.el7\", \n
\"cloud-init-0.7.9-24.el7.centos.1\", \n
\"ovirt-guest-agent-common-1.0.14-1.el7\"\n ], \n
\"guestOs\": \"3.10.0-862.11.6.el7.x86_64\", \n
\"vmName\": \"HostedEngine\", \n \"vcpuCount\":
\"4\", \n \"has
h\": \"3205592835746233126\", \n \"lastLogin\":
1539038623.192216, \n \"cpuUsage\": \"11670000000\", \n
\"vcpuPeriod\": 100000, \n \"guestIPs\": \"\", \n
\"guestTimezone\": {\n \"zone\":
\"Europe/London\", \n \"offset\": 0\n }, \n
\"vcpuQuota\": \"-1\", \n \"guestContainers\": [], \n
\"kvmEnable\": \"true\", \n \"disks\": {\n
\"vda\": {\n \"readLatency\": \"0\",
\n \"writtenBytes\": \"44758528\", \n
\"writeOps\": \"1063\", \n \"apparentsize\":
\"53687091200\", \n \"readOps\": \"16151\",
\n \"writeLatency\": \"631097\", \n
\"imageID\": \"758f667c-6e9b-43eb-b09b-c983d78a6374\", \n
\"readBytes\": \"475618816\", \n
\"flushLatency\": \"30762\", \n \"readRate\":
\"0.0\", \n \"truesize\": \"2670891008\", \n
\"wr
iteRate\": \"3276.8\"\n }, \n \"hdc\": {\n
\"readLatency\": \"0\", \n
\"writtenBytes\": \"0\", \n \"writeOps\":
\"0\", \n \"apparentsize\": \"0\", \n
\"readOps\": \"4\", \n
\"writeLatency\": \"0\", \n \"readBytes\":
\"152\", \n \"flushLatency\": \"0\", \n
\"readRate\": \"0.0\", \n
\"truesize\": \"0\", \n \"writeRate\":
\"0.0\"\n }\n }, \n \"monitorResponse\":
\"0\", \n \"guestOsInfo\": {\n \"kernel\":
\"3.10.0-862.11.6.el7.x86_64\", \n \"type\":
\"linux\", \n \"version\": \"7.5.1804\", \n
\"distribution\": \"CentOS Linux\", \n
\"arch\": \"x86_64\", \n \"codename\":
\"Core\"\n }, \n \"username\": \"None\", \n
\"guestName\": \"ovirt-engine.example.com\", \n
\"status\": \"Up\",
\n \"guestCPUCount\": 4, \n \"clientIp\":
\"\", \n \"statusTime\": \"4344173610\"\n
}\n]",
"stdout_lines": [
"[",
" {",
" \"displayInfo\": [",
" {",
" \"tlsPort\": \"5901\", ",
" \"ipAddress\": \"10.0.0.171\", ",
" \"port\": \"5900\", ",
" \"type\": \"spice\"",
" }, ",
" {",
" \"tlsPort\": \"-1\", ",
" \"ipAddress\": \"10.0.0.171\", ",
" \"port\": \"5902\", ",
" \"type\": \"vnc\"",
" }",
" ], ",
" \"memUsage\": \"18\", ",
" \"acpiEnable\": \"true\", ",
" \"guestFQDN\": \"ovirt-engine.example.com\",
",
" \"vmId\":
\"e1af6b26-9e48-251-940c-7bfadf920f3f\", ",
" \"session\": \"Unknown\", ",
" \"netIfaces\": [",
" {",
" \"name\": \"eth0\", ",
" \"inet6\": [], ",
" \"inet\": [], ",
" \"hw\": \"00:18:3d:5b:11:5c\"",
" }",
" ], ",
" \"timeOffset\": \"0\", ",
" \"memoryStats\": {",
" \"swap_out\": 0, ",
" \"majflt\": 0, ",
" \"minflt\": 198, ",
" \"mem_cached\": \"447696\", ",
" \"mem_free\": \"13259132\", ",
" \"mem_buffers\": \"2104\", ",
" \"swap_in\": 0, ",
" \"pageflt\": 198, ",
" \"mem_total\": \"16258492\", ",
" \"mem_unused\": \"13259132\"",
" }, ",
" \"balloonInfo\": {",
" \"balloon_max\": \"16777216\", ",
" \"balloon_cur\": \"16777216\", ",
" \"balloon_target\": \"16777216\", ",
" \"balloon_min\": \"1048576\"",
" }, ",
" \"pauseCode\": \"NOERR\", ",
" \"disksUsage\": [",
" {",
" \"path\": \"/\", ",
" \"total\": \"6565134336\", ",
" \"used\": \"206525344\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/boot\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"169177088\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/tmp\", ",
" \"total\": \"2136997888\", ",
" \"used\": \"33935360\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/home\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"33796096\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var\", ",
" \"total\": \"21464350720\", ",
" \"used\": \"456179712\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var/log\", ",
" \"total\": \"10726932480\", ",
" \"used\": \"43315200\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var/log/audit\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"3252160\", ",
" \"fs\": \"xfs\"",
" }",
" ], ",
" \"network\": {",
" \"vnet0\": {",
" \"macAddr\": \"00:18:3d:5b:11:5c\",
",
" \"rxDropped\": \"0\", ",
" \"tx\": \"1710\", ",
" \"txDropped\": \"0\", ",
" \"rxErrors\": \"0\", ",
" \"rx\": \"349635\", ",
" \"txErrors\": \"0\", ",
" \"state\": \"unknown\", ",
" \"sampleTime\": 4344173.61, ",
" \"speed\": \"1000\", ",
" \"name\": \"vnet0\"",
" }",
" }, ",
" \"vmType\": \"kvm\", ",
" \"cpuUser\": \"3.00\", ",
" \"elapsedTime\": \"585\", ",
" \"vmJobs\": {}, ",
" \"cpuSys\": \"1.27\", ",
" \"appsList\": [",
" \"kernel-3.10.0-862.11.6.el7\", ",
" \"cloud-init-0.7.9-24.el7.centos.1\", ",
" \"ovirt-guest-agent-common-1.0.14-1.el7\"",
" ], ",
" \"guestOs\": \"3.10.0-862.11.6.el7.x86_64\",
",
" \"vmName\": \"HostedEngine\", ",
" \"vcpuCount\": \"4\", ",
" \"hash\": \"3205592835746233126\", ",
" \"lastLogin\": 1539038623.192216, ",
" \"cpuUsage\": \"11670000000\", ",
" \"vcpuPeriod\": 100000, ",
" \"guestIPs\": \"\", ",
" \"guestTimezone\": {",
" \"zone\": \"Europe/London\", ",
" \"offset\": 0",
" }, ",
" \"vcpuQuota\": \"-1\", ",
" \"guestContainers\": [], ",
" \"kvmEnable\": \"true\", ",
" \"disks\": {",
" \"vda\": {",
" \"readLatency\": \"0\", ",
" \"writtenBytes\": \"44758528\", ",
" \"writeOps\": \"1063\", ",
" \"apparentsize\": \"53687091200\",
",
" \"readOps\": \"16151\", ",
" \"writeLatency\": \"631097\", ",
" \"imageID\":
\"758f667c-6e9b-43eb-b09b-c983d78a6374\", ",
" \"readBytes\": \"475618816\", ",
" \"flushLatency\": \"30762\", ",
" \"readRate\": \"0.0\", ",
" \"truesize\": \"2670891008\", ",
" \"writeRate\": \"3276.8\"",
" }, ",
" \"hdc\": {",
" \"readLatency\": \"0\", ",
" \"writtenBytes\": \"0\", ",
" \"writeOps\": \"0\", ",
" \"apparentsize\": \"0\", ",
" \"readOps\": \"4\", ",
" \"writeLatency\": \"0\", ",
" \"readBytes\": \"152\", ",
" \"flushLatency\": \"0\", ",
" \"readRate\": \"0.0\", ",
" \"truesize\": \"0\", ",
" \"writeRate\": \"0.0\"",
" }",
" }, ",
" \"monitorResponse\": \"0\", ",
" \"guestOsInfo\": {",
" \"kernel\": \"3.10.0-862.11.6.el7.x86_64\",
",
" \"type\": \"linux\", ",
" \"version\": \"7.5.1804\", ",
" \"distribution\": \"CentOS Linux\", ",
" \"arch\": \"x86_64\", ",
" \"codename\": \"Core\"",
" }, ",
" \"username\": \"None\", ",
" \"guestName\": \"ovirt-engine.example.com\",
",
" \"status\": \"Up\", ",
" \"guestCPUCount\": 4, ",
" \"clientIp\": \"\", ",
" \"statusTime\": \"4344173610\"",
" }",
"]"
]
}"
2018-10-08 23:53:19,620+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u"Get VDSM's target engine VM stats",
'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:19,620+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cc17e10> kwargs
2018-10-08 23:53:20,321+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Convert stats to JSON format',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:20,322+0100 DEBUG ansible on_any args TASK: Convert stats to JSON format
kwargs is_conditional:False
2018-10-08 23:53:21,008+0100 DEBUG var changed: host "localhost" var
"json_stats" type "<type 'list'>" value: "[
{
"acpiEnable": "true",
"appsList": [
"kernel-3.10.0-862.11.6.el7",
"cloud-init-0.7.9-24.el7.centos.1",
"ovirt-guest-agent-common-1.0.14-1.el7"
],
"balloonInfo": {
"balloon_cur": "16777216",
"balloon_max": "16777216",
"balloon_min": "1048576",
"balloon_target": "16777216"
},
"clientIp": "",
"cpuSys": "1.27",
"cpuUsage": "11670000000",
"cpuUser": "3.00",
"disks": {
"hdc": {
"apparentsize": "0",
"flushLatency": "0",
"readBytes": "152",
"readLatency": "0",
"readOps": "4",
"readRate": "0.0",
"truesize": "0",
"writeLatency": "0",
"writeOps": "0",
"writeRate": "0.0",
"writtenBytes": "0"
},
"vda": {
"apparentsize": "53687091200",
"flushLatency": "30762",
"imageID": "758f667c-6e9b-43eb-b09b-c983d78a6374",
"readBytes": "475618816",
"readLatency": "0",
"readOps": "16151",
"readRate": "0.0",
"truesize": "2670891008",
"writeLatency": "631097",
"writeOps": "1063",
"writeRate": "3276.8",
"writtenBytes": "44758528"
}
},
"disksUsage": [
{
"fs": "xfs",
"path": "/",
"total": "6565134336",
"used": "206525344"
},
{
"fs": "xfs",
"path": "/boot",
"total": "1063256064",
"used": "169177088"
},
{
"fs": "xfs",
"path": "/tmp",
"total": "2136997888",
"used": "33935360"
},
{
"fs": "xfs",
"path": "/home",
"total": "1063256064",
"used": "33796096"
},
{
"fs": "xfs",
"path": "/var",
"total": "21464350720",
"used": "456179712"
},
{
"fs": "xfs",
"path": "/var/log",
"total": "10726932480",
"used": "43315200"
},
{
"fs": "xfs",
"path": "/var/log/audit",
"total": "1063256064",
"used": "3252160"
}
],
"displayInfo": [
{
"ipAddress": "10.0.0.171",
"port": "5900",
"tlsPort": "5901",
"type": "spice"
},
{
"ipAddress": "10.0.0.171",
"port": "5902",
"tlsPort": "-1",
"type": "vnc"
}
],
"elapsedTime": "585",
"guestCPUCount": 4,
"guestContainers": [],
"guestFQDN": "ovirt-engine.example.com",
"guestIPs": "",
"guestName": "ovirt-engine.example.com",
"guestOs": "3.10.0-862.11.6.el7.x86_64",
"guestOsInfo": {
"arch": "x86_64",
"codename": "Core",
"distribution": "CentOS Linux",
"kernel": "3.10.0-862.11.6.el7.x86_64",
"type": "linux",
"version": "7.5.1804"
},
"guestTimezone": {
"offset": 0,
"zone": "Europe/London"
},
"hash": "3205592835746233126",
"kvmEnable": "true",
"lastLogin": 1539038623.192216,
"memUsage": "18",
"memoryStats": {
"majflt": 0,
"mem_buffers": "2104",
"mem_cached": "447696",
"mem_free": "13259132",
"mem_total": "16258492",
"mem_unused": "13259132",
"minflt": 198,
"pageflt": 198,
"swap_in": 0,
"swap_out": 0
},
"monitorResponse": "0",
"netIfaces": [
{
"hw": "00:18:3d:5b:11:5c",
"inet": [],
"inet6": [],
"name": "eth0"
}
],
"network": {
"vnet0": {
"macAddr": "00:18:3d:5b:11:5c",
"name": "vnet0",
"rx": "349635",
"rxDropped": "0",
"rxErrors": "0",
"sampleTime": 4344173.61,
"speed": "1000",
"state": "unknown",
"tx": "1710",
"txDropped": "0",
"txErrors": "0"
}
},
"pauseCode": "NOERR",
"session": "Unknown",
"status": "Up",
"statusTime": "4344173610",
"timeOffset": "0",
"username": "None",
"vcpuCount": "4",
"vcpuPeriod": 100000,
"vcpuQuota": "-1",
"vmId": "e1af6b26-9e48-251-940c-7bfadf920f3f",
"vmJobs": {},
"vmName": "HostedEngine",
"vmType": "kvm"
}
]"
2018-10-08 23:53:21,009+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Convert stats to JSON format', 'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:21,009+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313db268d0> kwargs
2018-10-08 23:53:21,720+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address from VDSM stats',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:21,720+0100 DEBUG ansible on_any args TASK: Get target engine VM IPv4
address from VDSM stats kwargs is_conditional:False
2018-10-08 23:53:22,397+0100 DEBUG var changed: host "localhost" var
"engine_vm_ip_vdsm" type "<class
'ansible.utils.unsafe_proxy.AnsibleUnsafeText'>" value:
""""
2018-10-08 23:53:22,398+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address from VDSM stats',
'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:22,398+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caed510> kwargs
2018-10-08 23:53:23,124+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'debug', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:23,124+0100 DEBUG ansible on_any args TASK: debug kwargs
is_conditional:False
2018-10-08 23:53:23,807+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'', 'ansible_host': u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:23,807+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313ca343d0> kwargs
2018-10-08 23:53:24,511+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Fail if the Engine has no IP address',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:24,511+0100 DEBUG ansible on_any args TASK: Fail if the Engine has no IP
address kwargs is_conditional:False
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"ansible_play_hosts" type "<type 'list'>" value:
"[]"
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"play_hosts" type "<type 'list'>" value: "[]"
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"ansible_play_batch" type "<type 'list'>" value:
"[]"
2018-10-08 23:53:25,153+0100 ERROR ansible failed {'status': 'FAILED',
'ansible_type': 'task', 'ansible_task': u'Fail if the Engine
has no IP address', 'ansible_result': u"type: <type
'dict'>\nstr: {'msg': u'Engine VM has no IP address. Please check
your network configuration', 'changed': False, '_ansible_no_log':
False}", 'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml'}
2018-10-08 23:53:25,153+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caed6d0> kwargs
ignore_errors:None
2018-10-08 23:53:25,154+0100 INFO ansible stats {'status': 'FAILED',
'ansible_playbook_duration': 1064.367312, 'ansible_result': u"type:
<type 'dict'>\nstr: {u'ovirt-engine.example.com':
{'unreachable': 0, 'skipped': 0, 'ok': 11, 'changed': 6,
'failures': 0}, u'localhost': {'unreachable': 0,
'skipped': 5, 'ok': 82, 'changed': 30, 'failures':
2}}", 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'finish'}
2018-10-08 23:53:25,154+0100 DEBUG ansible on_any args
<ansible.executor.stats.AggregateStats object at 0x7f313ef6c290> kwargs
I run it again (I clear the shared NFS storage each attempt), then get the following
output to console:
[ INFO ] TASK [Undefine leftover engine VM]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd":
["virsh", "undefine", "--managed-save",
"HostedEngine"], "delta": "0:00:00.050407", "end":
"2018-10-09 00:16:58.085198", "msg": "non-zero return code",
"rc": 1, "start": "2018-10-09 00:16:58.034791",
"stderr": "error: Failed to undefine domain HostedEngine\nerror: Requested
operation is not valid: cannot undefine transient domain", "stderr_lines":
["error: Failed to undefine domain HostedEngine", "error: Requested
operation is not valid: cannot undefine transient domain"], "stdout":
"", "stdout_lines": []}
2:22 a.m.
I should qualify "I went back to using a bond (instead of an individual NIC). Above
network problem
is fixed and now proceeds as far as ever."
After running yum install ovirt-engine-appliance I ran the usual hosted-engine -deploy
command again per the advice here:
https://ovirt.org/documentation/how-to/hosted-engine/
I trust this is correct.
10:47 a.m.
On Tue, Oct 9, 2018 at 1:21 AM <me(a)brendanh.com> wrote:
Okay, I went back to using a bond (instead of an individual NIC).
Above
network problem is fixed and now proceeds as far as ever. Hangs for around
10 minutes at:
[ INFO ] TASK [Check engine VM health]
The hosted-engine-setup-ansible-create_target_vm log has:
2018-10-08 23:42:01,664+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Check engine VM health', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
Then repeats the following line for around 10 minutes:
2018-10-08 23:42:01,866+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cd338d0> kwargs
Before eventually, the console outputs the following error:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed":
true, "cmd": ["hosted-engine", "--vm-status",
"--json"], "delta":
"0:00:00.167677", "end": "2018-10-08 23:53:11.112436",
"rc": 0, "start":
"2018-10-08 23:53:10.944759", "stderr": "",
"stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}",
"stdout_lines":
["{\"1\": {\"c
onf_on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}"]}
[ INFO ] TASK [Check VM status at virt level]
The hosted-engine-setup-ansible-create_target_vm log shows the following
when this error occurs:
2018-10-08 23:53:11,812+0100 DEBUG var changed: host "localhost" var
"ansible_failed_result" type "<type 'dict'>" value:
"{
"_ansible_no_log": false,
"_ansible_parsed": true,
"attempts": 120,
"changed": true,
"cmd": [
"hosted-engine",
"--vm-status",
"--json"
],
"delta": "0:00:00.167677",
"end": "2018-10-08 23:53:11.112436",
"failed": true,
"invocation": {
"module_args": {
"_raw_params": "hosted-engine --vm-status --json",
"_uses_shell": false,
"argv": null,
"chdir": null,
"creates": null,
"executable": null,
"removes": null,
"stdin": null,
"warn": true
}
},
"rc": 0,
"start": "2018-10-08 23:53:10.944759",
"stderr": "",
"stderr_lines": [],
"stdout": "{\"1\": {\"conf_on_shared_storage\":
true, \"live-data\":
true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}",
This is usually a name resolution issue:
"vm": "up" - this is checked at virt level
"reason": "failed liveliness check", "health":
"bad" - this is checked
from the host over http
I'd suggest to double check that the host can correctly resolve the name of
the engine VM and that the engine VM correctly got the address where its
FQDN resolves to.
Do you have a properly working DHCP with a DHCP reservation for the engine
VM? did you set a static IP on the engine VM?
"stdout_lines": [
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true,
\"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}"
]
}"
2018-10-08 23:53:11,813+0100 DEBUG var changed: host "localhost" var
"ansible_failed_task" type "<type 'dict'>" value:
"{
"action": "command",
"any_errors_fatal": false,
"args": {
"_ansible_check_mode": false,
"_ansible_debug": false,
"_ansible_diff": false,
"_ansible_keep_remote_files": false,
"_ansible_module_name": "command",
"_ansible_no_log": false,
"_ansible_remote_tmp": "~/.ansible/tmp",
"_ansible_selinux_special_fs": [
"fuse",
"nfs",
"vboxsf",
"ramfs",
"9p"
],
"_ansible_shell_executable": "/bin/sh",
"_ansible_socket": null,
"_ansible_syslog_facility": "LOG_USER",
"_ansible_tmpdir":
"/root/.ansible/tmp/ansible-tmp-1539039190.78-59276929025529/",
"_ansible_verbosity": 0,
"_ansible_version": "2.6.5",
"_raw_params": "hosted-engine --vm-status --json",
"warn": true
},
"async": 0,
"async_val": 0,
"become": null,
"become_flags": null,
"become_method": null,
"become_user": null,
"changed_when": [
true
],
"check_mode": null,
"connection": "local",
"debugger": null,
"delay": 5,
"delegate_facts": false,
"delegate_to": null,
"diff": null,
"environment": [
{
"LANG": "en_US.UTF-8",
"LC_ALL": "en_US.UTF-8",
"LC_MESSAGES": "en_US.UTF-8"
}
],
"failed_when": [],
"finalized": false,
"ignore_errors": null,
"loop": null,
"loop_control": null,
"loop_with": null,
"module_defaults": [],
"name": "Check engine VM health",
"no_log": null,
"notify": null,
"parent": {
"any_errors_fatal": null,
"become": null,
"become_flags": null,
"become_method": null,
"become_user": null,
"check_mode": null,
"connection": "local",
"debugger": null,
"delegate_facts": false,
"delegate_to": null,
"dep_chain": null,
"diff": null,
"environment": null,
"eor": false,
"ignore_errors": null,
"module_defaults": null,
"name": "Wait for the engine to come up on the target VM",
"no_log": null,
"port": null,
"remote_user": null,
"run_once": null,
"tags": [],
"vars": {},
"when": []
},
"parent_type": "Block",
"poll": 10,
"port": null,
"register": "health_result",
"remote_user": null,
"retries": 120,
"run_once": null,
"squashed": false,
"tags": [],
"until": [
"health_result.rc == 0 and 'health' in health_result.stdout and
health_result.stdout|from_json|json_query('*.\"engine-status\".\"health\"')|first==\"good\""
],
"uuid": "525400d0-30bf-04f1-b63b-00000000006b",
"vars": {},
"when": []
}"
2018-10-08 23:53:11,813+0100 DEBUG var changed: host "localhost" var
"health_result" type "<type 'dict'>" value: "{
"attempts": 120,
"changed": true,
"cmd": [
"hosted-engine",
"--vm-status",
"--json"
],
"delta": "0:00:00.167677",
"end": "2018-10-08 23:53:11.112436",
"failed": true,
"rc": 0,
"start": "2018-10-08 23:53:10.944759",
"stderr": "",
"stderr_lines": [],
"stdout": "{\"1\": {\"conf_on_shared_storage\":
true, \"live-data\":
true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}",
"stdout_lines": [
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true,
\"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=49491
(Mon Oct 8 23:53:03
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=49491 (Mon Oct 8
23:53:03
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"75452be7\", \"local_conf_timestamp\":
49491,
\"host-ts\": 49491}, \"global_maintenance\": false}"
]
}"
2018-10-08 23:53:11,813+0100 ERROR ansible failed {'status': 'FAILED',
'ansible_type': 'task', 'ansible_task': u'Check engine VM
health',
'ansible_result': u'type: <type \'dict\'>\nstr:
{\'_ansible_parsed\': True,
\'stderr_lines\': [], u\'changed\': True, u\'end\':
u\'2018-10-08
23:53:11.112436\', \'_ansible_no_log\': False, u\'stdout\':
u\'{"1":
{"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\\\nmetadata_feature_version=1\\\\ntimestamp=49491
(Mon Oct 8 23:53:', 'ansible_host': u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml'}
2018-10-08 23:53:11,813+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cd338d0> kwargs
ignore_errors:None
2018-10-08 23:53:12,517+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Check VM status at virt level',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:12,517+0100 DEBUG ansible on_any args TASK: Check VM
status at virt level kwargs is_conditional:False
2018-10-08 23:53:13,433+0100 DEBUG var changed: host "localhost" var
"vm_status_virsh" type "<type 'dict'>" value: "{
"changed": true,
"cmd": "virsh -r list | grep HostedEngine | grep running",
"delta": "0:00:00.053603",
"end": "2018-10-08 23:53:12.741182",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:12.687579",
"stderr": "",
"stderr_lines": [],
"stdout": " 2 HostedEngine running",
"stdout_lines": [
" 2 HostedEngine running"
]
}"
2018-10-08 23:53:13,434+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Check VM status at virt level',
'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:13,434+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caedc10> kwargs
2018-10-08 23:53:14,159+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'debug', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:14,159+0100 DEBUG ansible on_any args TASK: debug kwargs
is_conditional:False
2018-10-08 23:53:14,861+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'', 'ansible_host': u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:14,861+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313c161ad0> kwargs
2018-10-08 23:53:15,575+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Fail if engine VM is not running',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:15,576+0100 DEBUG ansible on_any args TASK: Fail if
engine VM is not running kwargs is_conditional:False
2018-10-08 23:53:16,261+0100 INFO ansible skipped {'status': 'SKIPPED',
'ansible_task': u'Fail if engine VM is not running',
'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:16,261+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313ccec510> kwargs
2018-10-08 23:53:16,967+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:16,968+0100 DEBUG ansible on_any args TASK: Get target
engine VM IPv4 address kwargs is_conditional:False
2018-10-08 23:53:17,819+0100 DEBUG var changed: host "localhost" var
"engine_vm_ipv4" type "<type 'dict'>" value: "{
"changed": true,
"cmd": "getent ahostsv4 ovirt-engine.example.com | cut -d' '
-f1 |
uniq",
"delta": "0:00:00.004903",
"end": "2018-10-08 23:53:17.143283",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:17.138380",
"stderr": "",
"stderr_lines": [],
"stdout": "10.0.0.109",
"stdout_lines": [
"10.0.0.109"
]
}"
2018-10-08 23:53:17,819+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address',
'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:17,819+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caedc10> kwargs
2018-10-08 23:53:18,531+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u"Get VDSM's target engine VM stats",
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:18,531+0100 DEBUG ansible on_any args TASK: Get VDSM's
target engine VM stats kwargs is_conditional:False
2018-10-08 23:53:19,620+0100 DEBUG var changed: host "localhost" var
"engine_vdsm_stats" type "<type 'dict'>" value:
"{
"changed": true,
"cmd": [
"vdsm-client",
"VM",
"getStats",
"vmID=e1af6b26-9e48-251-940c-7bfadf920f3f"
],
"delta": "0:00:00.257926",
"end": "2018-10-08 23:53:18.961394",
"failed": false,
"rc": 0,
"start": "2018-10-08 23:53:18.703468",
"stderr": "",
"stderr_lines": [],
"stdout": "[\n {\n \"displayInfo\": [\n
{\n
\"tlsPort\": \"5901\", \n
\"ipAddress\":
\"10.0.0.171\", \n \"port\": \"5900\", \n
\"type\": \"spice\"\n }, \n {\n
\"tlsPort\": \"-1\", \n \"ipAddress\":
\"10.0.0.171\", \n
\"port\": \"5902\", \n \"type\":
\"vnc\"\n
}\n ], \n \"memUsage\": \"18\", \n
\"acpiEnable\": \"true\", \n \"guestFQDN\": \"
ovirt-engine.example.com\", \n \"vmId\":
\"e1af6b26-9e48-251-940c-7bfadf920f3f\", \n \"session\":
\"Unknown\", \n \"netIfaces\": [\n {\n
\"name\": \"eth0\", \n \"inet6\": [], \n
\"inet\": [], \n \"hw\":
\"00:18:3d:5b:11:5c\"\n
}\n ], \n \"timeOffset\": \"0\", \n
\"memoryStats\":
{\n \"swap_out\": 0, \n \
"majflt\": 0, \n \"minflt\": 198, \n
\"mem_cached\": \"447696\", \n \"mem_free\":
\"13259132\", \n
\"mem_buffers\": \"2104\", \n
\"swap_in\": 0, \n
\"pageflt\": 198, \n \"mem_total\":
\"16258492\", \n
\"mem_unused\": \"13259132\"\n }, \n
\"balloonInfo\":
{\n \"balloon_max\": \"16777216\", \n
\"balloon_cur\": \"16777216\", \n
\"balloon_target\":
\"16777216\", \n \"balloon_min\": \"1048576\"\n
}, \n
\"pauseCode\": \"NOERR\", \n \"disksUsage\": [\n
{\n
\"path\": \"/\", \n \"total\":
\"6565134336\",
\n \"used\": \"206525344\", \n
\"fs\":
\"xfs\"\n }, \n {\n \"path\":
\"/boot\", \n \"total\": \"1063256064\", \n
\"used\": \"169177088\", \n \"fs\":
\"xfs\"\n },
\n
{\n \"path\": \"/tmp\", \n
\"total\": \"2136997888\", \n \"used\":
\"33935360\", \n
\"fs\": \"xfs\"\n }, \n {\n
\"path\": \"/home\", \n \"total\":
\"1063256064\", \n
\"used\": \"33796096\", \n \"fs\":
\"xfs\"\n
}, \n {\n \"path\": \"/var\", \n
\"total\": \"21464350720\", \n \"used\":
\"456179712\",
\n \"fs\": \"xfs\"\n }, \n {\n
\"path\": \"/var/log\", \n
\"total\":
\"10726932480\", \n \"used\": \"43315200\",
\n
\"fs\": \"xfs\"\n }, \n {\n
\"path\": \"/var/log/audit\", \n \"total\":
\"1063256064\",
\n \"used\": \"3252160\", \n
\"fs\":
\"xfs\"\n }\n ], \n \"network\":
{\n \"vnet0\": {\n \"macAddr\":
\"00:18:3d:5b:11:5c\", \n \"rxDropped\":
\"0\", \n
\"tx\": \"1710\", \n \"txDropped\":
\"0\", \n
\"rxErrors\": \"0\", \n \"rx\":
\"349635\", \n
\"txErrors\": \"0\", \n \"state\":
\"unknown\", \n
\"sampleTime\": 4344173.61, \n
\"speed\":
\"1000\", \n \"name\": \"vnet0\"\n
}\n },
\n \"vmType\": \"kvm\", \n \"cpuUser\":
\"3.00\", \n
\"elapsedTime\": \"585\", \n \"vmJobs\": {}, \n
\"cpuSys\":
\"1.27\", \n \"appsList\": [\n
\"kernel-3.10.0-862.11.6.el7\", \n
\"cloud-init-0.7.9-24.el7.centos.1\", \n
\"ovirt-guest-agent-common-1.0.14-1.el7\"\n ], \n
\"guestOs\": \"3.10.0-862.11.6.el7.x86_64\", \n
\"vmName\":
\"HostedEngine\", \n \"vcpuCount\": \"4\", \n
\"has
h\": \"3205592835746233126\", \n \"lastLogin\":
1539038623.192216,
\n \"cpuUsage\": \"11670000000\", \n
\"vcpuPeriod\": 100000,
\n \"guestIPs\": \"\", \n \"guestTimezone\":
{\n
\"zone\": \"Europe/London\", \n \"offset\": 0\n
}, \n
\"vcpuQuota\": \"-1\", \n \"guestContainers\":
[], \n
\"kvmEnable\": \"true\", \n \"disks\": {\n
\"vda\": {\n
\"readLatency\": \"0\", \n
\"writtenBytes\":
\"44758528\", \n \"writeOps\": \"1063\", \n
\"apparentsize\": \"53687091200\", \n
\"readOps\":
\"16151\", \n \"writeLatency\": \"631097\",
\n
\"imageID\": \"758f667c-6e9b-43eb-b09b-c983d78a6374\", \n
\"readBytes\": \"475618816\", \n
\"flushLatency\":
\"30762\", \n \"readRate\": \"0.0\", \n
\"truesize\": \"2670891008\", \n \"wr
iteRate\": \"3276.8\"\n }, \n \"hdc\":
{\n
\"readLatency\": \"0\", \n
\"writtenBytes\": \"0\",
\n \"writeOps\": \"0\", \n
\"apparentsize\":
\"0\", \n \"readOps\": \"4\", \n
\"writeLatency\": \"0\", \n \"readBytes\":
\"152\", \n
\"flushLatency\": \"0\", \n
\"readRate\": \"0.0\",
\n \"truesize\": \"0\", \n
\"writeRate\":
\"0.0\"\n }\n }, \n \"monitorResponse\":
\"0\",
\n \"guestOsInfo\": {\n \"kernel\":
\"3.10.0-862.11.6.el7.x86_64\", \n \"type\":
\"linux\", \n
\"version\": \"7.5.1804\", \n
\"distribution\": \"CentOS
Linux\", \n \"arch\": \"x86_64\", \n
\"codename\":
\"Core\"\n }, \n \"username\": \"None\", \n
\"guestName\": \"ovirt-engine.example.com\", \n
\"status\":
\"Up\",
\n \"guestCPUCount\": 4, \n \"clientIp\":
\"\", \n
\"statusTime\": \"4344173610\"\n }\n]",
"stdout_lines": [
"[",
" {",
" \"displayInfo\": [",
" {",
" \"tlsPort\": \"5901\", ",
" \"ipAddress\": \"10.0.0.171\", ",
" \"port\": \"5900\", ",
" \"type\": \"spice\"",
" }, ",
" {",
" \"tlsPort\": \"-1\", ",
" \"ipAddress\": \"10.0.0.171\", ",
" \"port\": \"5902\", ",
" \"type\": \"vnc\"",
" }",
" ], ",
" \"memUsage\": \"18\", ",
" \"acpiEnable\": \"true\", ",
" \"guestFQDN\": \"ovirt-engine.example.com\",
",
" \"vmId\":
\"e1af6b26-9e48-251-940c-7bfadf920f3f\", ",
" \"session\": \"Unknown\", ",
" \"netIfaces\": [",
" {",
" \"name\": \"eth0\", ",
" \"inet6\": [], ",
" \"inet\": [], ",
" \"hw\": \"00:18:3d:5b:11:5c\"",
" }",
" ], ",
" \"timeOffset\": \"0\", ",
" \"memoryStats\": {",
" \"swap_out\": 0, ",
" \"majflt\": 0, ",
" \"minflt\": 198, ",
" \"mem_cached\": \"447696\", ",
" \"mem_free\": \"13259132\", ",
" \"mem_buffers\": \"2104\", ",
" \"swap_in\": 0, ",
" \"pageflt\": 198, ",
" \"mem_total\": \"16258492\", ",
" \"mem_unused\": \"13259132\"",
" }, ",
" \"balloonInfo\": {",
" \"balloon_max\": \"16777216\", ",
" \"balloon_cur\": \"16777216\", ",
" \"balloon_target\": \"16777216\", ",
" \"balloon_min\": \"1048576\"",
" }, ",
" \"pauseCode\": \"NOERR\", ",
" \"disksUsage\": [",
" {",
" \"path\": \"/\", ",
" \"total\": \"6565134336\", ",
" \"used\": \"206525344\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/boot\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"169177088\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/tmp\", ",
" \"total\": \"2136997888\", ",
" \"used\": \"33935360\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/home\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"33796096\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var\", ",
" \"total\": \"21464350720\", ",
" \"used\": \"456179712\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var/log\", ",
" \"total\": \"10726932480\", ",
" \"used\": \"43315200\", ",
" \"fs\": \"xfs\"",
" }, ",
" {",
" \"path\": \"/var/log/audit\", ",
" \"total\": \"1063256064\", ",
" \"used\": \"3252160\", ",
" \"fs\": \"xfs\"",
" }",
" ], ",
" \"network\": {",
" \"vnet0\": {",
" \"macAddr\": \"00:18:3d:5b:11:5c\",
",
" \"rxDropped\": \"0\", ",
" \"tx\": \"1710\", ",
" \"txDropped\": \"0\", ",
" \"rxErrors\": \"0\", ",
" \"rx\": \"349635\", ",
" \"txErrors\": \"0\", ",
" \"state\": \"unknown\", ",
" \"sampleTime\": 4344173.61, ",
" \"speed\": \"1000\", ",
" \"name\": \"vnet0\"",
" }",
" }, ",
" \"vmType\": \"kvm\", ",
" \"cpuUser\": \"3.00\", ",
" \"elapsedTime\": \"585\", ",
" \"vmJobs\": {}, ",
" \"cpuSys\": \"1.27\", ",
" \"appsList\": [",
" \"kernel-3.10.0-862.11.6.el7\", ",
" \"cloud-init-0.7.9-24.el7.centos.1\", ",
" \"ovirt-guest-agent-common-1.0.14-1.el7\"",
" ], ",
" \"guestOs\": \"3.10.0-862.11.6.el7.x86_64\",
",
" \"vmName\": \"HostedEngine\", ",
" \"vcpuCount\": \"4\", ",
" \"hash\": \"3205592835746233126\", ",
" \"lastLogin\": 1539038623.192216, ",
" \"cpuUsage\": \"11670000000\", ",
" \"vcpuPeriod\": 100000, ",
" \"guestIPs\": \"\", ",
" \"guestTimezone\": {",
" \"zone\": \"Europe/London\", ",
" \"offset\": 0",
" }, ",
" \"vcpuQuota\": \"-1\", ",
" \"guestContainers\": [], ",
" \"kvmEnable\": \"true\", ",
" \"disks\": {",
" \"vda\": {",
" \"readLatency\": \"0\", ",
" \"writtenBytes\": \"44758528\",
",
" \"writeOps\": \"1063\", ",
" \"apparentsize\": \"53687091200\",
",
" \"readOps\": \"16151\", ",
" \"writeLatency\": \"631097\", ",
" \"imageID\":
\"758f667c-6e9b-43eb-b09b-c983d78a6374\", ",
" \"readBytes\": \"475618816\", ",
" \"flushLatency\": \"30762\", ",
" \"readRate\": \"0.0\", ",
" \"truesize\": \"2670891008\", ",
" \"writeRate\": \"3276.8\"",
" }, ",
" \"hdc\": {",
" \"readLatency\": \"0\", ",
" \"writtenBytes\": \"0\", ",
" \"writeOps\": \"0\", ",
" \"apparentsize\": \"0\", ",
" \"readOps\": \"4\", ",
" \"writeLatency\": \"0\", ",
" \"readBytes\": \"152\", ",
" \"flushLatency\": \"0\", ",
" \"readRate\": \"0.0\", ",
" \"truesize\": \"0\", ",
" \"writeRate\": \"0.0\"",
" }",
" }, ",
" \"monitorResponse\": \"0\", ",
" \"guestOsInfo\": {",
" \"kernel\": \"3.10.0-862.11.6.el7.x86_64\",
",
" \"type\": \"linux\", ",
" \"version\": \"7.5.1804\", ",
" \"distribution\": \"CentOS Linux\",
",
" \"arch\": \"x86_64\", ",
" \"codename\": \"Core\"",
" }, ",
" \"username\": \"None\", ",
" \"guestName\": \"ovirt-engine.example.com\",
",
" \"status\": \"Up\", ",
" \"guestCPUCount\": 4, ",
" \"clientIp\": \"\", ",
" \"statusTime\": \"4344173610\"",
" }",
"]"
]
}"
2018-10-08 23:53:19,620+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u"Get VDSM's target engine VM stats",
'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:19,620+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313cc17e10> kwargs
2018-10-08 23:53:20,321+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Convert stats to JSON format',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:20,322+0100 DEBUG ansible on_any args TASK: Convert stats
to JSON format kwargs is_conditional:False
2018-10-08 23:53:21,008+0100 DEBUG var changed: host "localhost" var
"json_stats" type "<type 'list'>" value: "[
{
"acpiEnable": "true",
"appsList": [
"kernel-3.10.0-862.11.6.el7",
"cloud-init-0.7.9-24.el7.centos.1",
"ovirt-guest-agent-common-1.0.14-1.el7"
],
"balloonInfo": {
"balloon_cur": "16777216",
"balloon_max": "16777216",
"balloon_min": "1048576",
"balloon_target": "16777216"
},
"clientIp": "",
"cpuSys": "1.27",
"cpuUsage": "11670000000",
"cpuUser": "3.00",
"disks": {
"hdc": {
"apparentsize": "0",
"flushLatency": "0",
"readBytes": "152",
"readLatency": "0",
"readOps": "4",
"readRate": "0.0",
"truesize": "0",
"writeLatency": "0",
"writeOps": "0",
"writeRate": "0.0",
"writtenBytes": "0"
},
"vda": {
"apparentsize": "53687091200",
"flushLatency": "30762",
"imageID": "758f667c-6e9b-43eb-b09b-c983d78a6374",
"readBytes": "475618816",
"readLatency": "0",
"readOps": "16151",
"readRate": "0.0",
"truesize": "2670891008",
"writeLatency": "631097",
"writeOps": "1063",
"writeRate": "3276.8",
"writtenBytes": "44758528"
}
},
"disksUsage": [
{
"fs": "xfs",
"path": "/",
"total": "6565134336",
"used": "206525344"
},
{
"fs": "xfs",
"path": "/boot",
"total": "1063256064",
"used": "169177088"
},
{
"fs": "xfs",
"path": "/tmp",
"total": "2136997888",
"used": "33935360"
},
{
"fs": "xfs",
"path": "/home",
"total": "1063256064",
"used": "33796096"
},
{
"fs": "xfs",
"path": "/var",
"total": "21464350720",
"used": "456179712"
},
{
"fs": "xfs",
"path": "/var/log",
"total": "10726932480",
"used": "43315200"
},
{
"fs": "xfs",
"path": "/var/log/audit",
"total": "1063256064",
"used": "3252160"
}
],
"displayInfo": [
{
"ipAddress": "10.0.0.171",
"port": "5900",
"tlsPort": "5901",
"type": "spice"
},
{
"ipAddress": "10.0.0.171",
"port": "5902",
"tlsPort": "-1",
"type": "vnc"
}
],
"elapsedTime": "585",
"guestCPUCount": 4,
"guestContainers": [],
"guestFQDN": "ovirt-engine.example.com",
"guestIPs": "",
"guestName": "ovirt-engine.example.com",
"guestOs": "3.10.0-862.11.6.el7.x86_64",
"guestOsInfo": {
"arch": "x86_64",
"codename": "Core",
"distribution": "CentOS Linux",
"kernel": "3.10.0-862.11.6.el7.x86_64",
"type": "linux",
"version": "7.5.1804"
},
"guestTimezone": {
"offset": 0,
"zone": "Europe/London"
},
"hash": "3205592835746233126",
"kvmEnable": "true",
"lastLogin": 1539038623.192216,
"memUsage": "18",
"memoryStats": {
"majflt": 0,
"mem_buffers": "2104",
"mem_cached": "447696",
"mem_free": "13259132",
"mem_total": "16258492",
"mem_unused": "13259132",
"minflt": 198,
"pageflt": 198,
"swap_in": 0,
"swap_out": 0
},
"monitorResponse": "0",
"netIfaces": [
{
"hw": "00:18:3d:5b:11:5c",
"inet": [],
"inet6": [],
"name": "eth0"
}
],
"network": {
"vnet0": {
"macAddr": "00:18:3d:5b:11:5c",
"name": "vnet0",
"rx": "349635",
"rxDropped": "0",
"rxErrors": "0",
"sampleTime": 4344173.61,
"speed": "1000",
"state": "unknown",
"tx": "1710",
"txDropped": "0",
"txErrors": "0"
}
},
"pauseCode": "NOERR",
"session": "Unknown",
"status": "Up",
"statusTime": "4344173610",
"timeOffset": "0",
"username": "None",
"vcpuCount": "4",
"vcpuPeriod": 100000,
"vcpuQuota": "-1",
"vmId": "e1af6b26-9e48-251-940c-7bfadf920f3f",
"vmJobs": {},
"vmName": "HostedEngine",
"vmType": "kvm"
}
]"
2018-10-08 23:53:21,009+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Convert stats to JSON format', 'ansible_host':
u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:21,009+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313db268d0> kwargs
2018-10-08 23:53:21,720+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address from VDSM stats',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:21,720+0100 DEBUG ansible on_any args TASK: Get target
engine VM IPv4 address from VDSM stats kwargs is_conditional:False
2018-10-08 23:53:22,397+0100 DEBUG var changed: host "localhost" var
"engine_vm_ip_vdsm" type "<class
'ansible.utils.unsafe_proxy.AnsibleUnsafeText'>" value:
""""
2018-10-08 23:53:22,398+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'Get target engine VM IPv4 address from VDSM stats',
'ansible_host': u'localhost', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:22,398+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caed510> kwargs
2018-10-08 23:53:23,124+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'debug', 'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:23,124+0100 DEBUG ansible on_any args TASK: debug kwargs
is_conditional:False
2018-10-08 23:53:23,807+0100 INFO ansible ok {'status': 'OK',
'ansible_task': u'', 'ansible_host': u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:23,807+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313ca343d0> kwargs
2018-10-08 23:53:24,511+0100 INFO ansible task start {'status': 'OK',
'ansible_task': u'Fail if the Engine has no IP address',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'task'}
2018-10-08 23:53:24,511+0100 DEBUG ansible on_any args TASK: Fail if the
Engine has no IP address kwargs is_conditional:False
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"ansible_play_hosts" type "<type 'list'>" value:
"[]"
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"play_hosts" type "<type 'list'>" value:
"[]"
2018-10-08 23:53:25,152+0100 DEBUG var changed: host "localhost" var
"ansible_play_batch" type "<type 'list'>" value:
"[]"
2018-10-08 23:53:25,153+0100 ERROR ansible failed {'status': 'FAILED',
'ansible_type': 'task', 'ansible_task': u'Fail if the Engine
has no IP
address', 'ansible_result': u"type: <type 'dict'>\nstr:
{'msg': u'Engine VM
has no IP address. Please check your network configuration', 'changed':
False, '_ansible_no_log': False}", 'ansible_host':
u'localhost',
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml'}
2018-10-08 23:53:25,153+0100 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f313caed6d0> kwargs
ignore_errors:None
2018-10-08 23:53:25,154+0100 INFO ansible stats {'status': 'FAILED',
'ansible_playbook_duration': 1064.367312, 'ansible_result': u"type:
<type
'dict'>\nstr: {u'ovirt-engine.example.com': {'unreachable': 0,
'skipped':
0, 'ok': 11, 'changed': 6, 'failures': 0}, u'localhost':
{'unreachable': 0,
'skipped': 5, 'ok': 82, 'changed': 30, 'failures':
2}}",
'ansible_playbook':
u'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml',
'ansible_type': 'finish'}
2018-10-08 23:53:25,154+0100 DEBUG ansible on_any args
<ansible.executor.stats.AggregateStats object at 0x7f313ef6c290> kwargs
I run it again (I clear the shared NFS storage each attempt), then get the
following output to console:
[ INFO ] TASK [Undefine leftover engine VM]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd":
["virsh", "undefine", "--managed-save",
"HostedEngine"], "delta":
"0:00:00.050407", "end": "2018-10-09 00:16:58.085198",
"msg": "non-zero
return code", "rc": 1, "start": "2018-10-09
00:16:58.034791", "stderr":
"error: Failed to undefine domain HostedEngine\nerror: Requested operation
is not valid: cannot undefine transient domain", "stderr_lines":
["error:
Failed to undefine domain HostedEngine", "error: Requested operation is not
valid: cannot undefine transient domain"], "stdout": "",
"stdout_lines": []}
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/FLSQBNEQSC6...
5:52 p.m.
I'ved added a record to the DNS server here:
ovirt-engine.example.com 10.0.0.109
This IP address is on the physical network that the host is on (host is on 10.0.0.171). I
trust this is correct and I should not resolve to a natted IP instead. I notice that
regardless of this record, the name ovirt-engine.example.com resolves to a natted IP:
192.168.124.51 because the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com
While the script is running, if I I can successfully ping ovirt-engine.example.com, it
responds on 192.168.124.51. So as you say: "host can correctly resolve the name of
the engine VM", but it's not the DNS record's IP. If I remove the DNS record
and run hosted-engine --deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com did not resolve into an IP
address
Anyway, I added back the DNS record and ran hosted-engine --deploy command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran the usual
deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [ INFO ] TASK [Check
engine VM health] same as before. I catted /etc/hosts while it was hanging and it
contains:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
The ovirt-engine.example.com has been deleted! I pinged ovirt-engine.example.com and it
now resolves to its IP on the physical network: 10.0.0.109. So I added back this
/etc/hosts entry:
192.168.124.51 ovirt-engine.example.com
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed": true, "cmd": ["hosted-engine",
"--vm-status", "--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start": "2018-10-09 15:43:41.779715",
"stderr": "", "stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}", "stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution is correct?
6:51 p.m.
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com> wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you
are using on the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on
10.0.0.171). I trust this is correct and I should not resolve to a natted
IP instead. I notice that regardless of this record, the name
ovirt-engine.example.com resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com
While the script is running, if I I can successfully ping
ovirt-engine.example.com, it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the
DNS record's IP. If I remove the DNS record and run hosted-engine
--deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com did not
resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy
command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran
the usual deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to
etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [
INFO ] TASK [Check engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once
ready it will be shutdown and moved to the shared storage. At that point it
will be restarted on your management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
The ovirt-engine.example.com has been deleted! I pinged
ovirt-engine.example.com and it now resolves to its IP on the physical
network: 10.0.0.109. So I added back this /etc/hosts entry:
192.168.124.51 ovirt-engine.example.com
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed":
true, "cmd": ["hosted-engine", "--vm-status",
"--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start":
"2018-10-09 15:43:41.779715", "stderr": "",
"stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}",
"stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36
2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution
is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
12:49 a.m.
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be assigned.
However perhaps DHCP is not working. I have just changed to a static IP instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite possible
engine’s DHCP has been failing too. Each time the host boots, I must type dhclient in
order to receive an IP address. Anyway, after changing this and re-running hosted-engine
–deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 400,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n debug: var=FQDN\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I have just tried deploying using the webui, same error. I suspect the “undefined
variable” is local_vm_ip.std_out_lines[0]. My new debug task that tries to output this
is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest the value of this
is localhost. Localhost is just the machine this task ran on. I don’t think list
local_vm_ip.std_out_lines is defined. Any more ideas?
Many thanks
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 09 October 2018 16:51
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com <mailto:me@brendanh.com> >
wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com <http://ovirt-engine.example.com> 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you are using on
the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on 10.0.0.171). I
trust this is correct and I should not resolve to a natted IP instead. I notice that
regardless of this record, the name ovirt-engine.example.com
<http://ovirt-engine.example.com> resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
While the script is running, if I I can successfully ping ovirt-engine.example.com
<http://ovirt-engine.example.com> , it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the DNS
record's IP. If I remove the DNS record and run hosted-engine --deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com
<http://ovirt-engine.example.com> did not resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran the usual
deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [ INFO ] TASK [Check
engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once ready it will
be shutdown and moved to the shared storage. At that point it will be restarted on your
management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
The ovirt-engine.example.com <http://ovirt-engine.example.com> has been deleted! I
pinged ovirt-engine.example.com <http://ovirt-engine.example.com> and it now
resolves to its IP on the physical network: 10.0.0.109. So I added back this /etc/hosts
entry:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed": true, "cmd": ["hosted-engine",
"--vm-status", "--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start": "2018-10-09 15:43:41.779715",
"stderr": "", "stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}", "stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org>
To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org>
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
2:05 p.m.
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109
should be assigned.
However perhaps DHCP is not working. I have just changed to a static IP
instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is
quite possible engine’s DHCP has been failing too. Each time the host
boots, I must type dhclient in order to receive an IP address. Anyway,
after changing this and re-running hosted-engine –deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to
etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
400, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n debug:
var=FQDN\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I have just tried deploying using the webui, same error. I suspect the
“undefined variable” is local_vm_ip.std_out_lines[0]. My new debug task
that tries to output this is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc
hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest
the value of this is localhost. Localhost is just the machine this task
ran on. I don’t think list local_vm_ip.std_out_lines is defined. Any more
ideas?
The issue is on a task that isn't part of the code we are shipping.
I can just suggest to simply reinstall the rpm to get rid of any
modification and restart from scratch deploying with a static IP if your
DHCP server is not properly working.
Many thanks
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 09 October 2018 16:51
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com> wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you
are using on the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on
10.0.0.171). I trust this is correct and I should not resolve to a natted
IP instead. I notice that regardless of this record, the name
ovirt-engine.example.com resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com
While the script is running, if I I can successfully ping
ovirt-engine.example.com, it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the
DNS record's IP. If I remove the DNS record and run hosted-engine
--deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com did not
resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy
command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran
the usual deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to
etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [
INFO ] TASK [Check engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once
ready it will be shutdown and moved to the shared storage. At that point it
will be restarted on your management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
The ovirt-engine.example.com has been deleted! I pinged
ovirt-engine.example.com and it now resolves to its IP on the physical
network: 10.0.0.109. So I added back this /etc/hosts entry:
192.168.124.51 ovirt-engine.example.com
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed":
true, "cmd": ["hosted-engine", "--vm-status",
"--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start":
"2018-10-09 15:43:41.779715", "stderr": "",
"stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36 2018)
\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37 2018)
\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}",
"stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36 2018)
\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37 2018)
\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution
is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
1:08 a.m.
Hi Simone,
“restart from scratch deploying with a static IP”. Okay, I have reinstalled the host
using oVirt Node from scratch. I am assigning a static IP using the attached answers.conf
which contains:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
create_target_vm.yml and all other RedHat code is as-shipped. I’m getting the same
error:
[ INFO ] TASK [Copy /etc/hosts back to the Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
Any ideas? How can I debug this failure to assign an IP (undefined variable)?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 10 October 2018 12:06
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be assigned.
However perhaps DHCP is not working. I have just changed to a static IP instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite possible
engine’s DHCP has been failing too. Each time the host boots, I must type dhclient in
order to receive an IP address. Anyway, after changing this and re-running hosted-engine
–deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 400,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n debug: var=FQDN\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I have just tried deploying using the webui, same error. I suspect the “undefined
variable” is local_vm_ip.std_out_lines[0]. My new debug task that tries to output this
is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest the value of this
is localhost. Localhost is just the machine this task ran on. I don’t think list
local_vm_ip.std_out_lines is defined. Any more ideas?
The issue is on a task that isn't part of the code we are shipping.
I can just suggest to simply reinstall the rpm to get rid of any modification and restart
from scratch deploying with a static IP if your DHCP server is not properly working.
Many thanks
From: Simone Tiraboschi < <mailto:stirabos@redhat.com> stirabos(a)redhat.com>
Sent: 09 October 2018 16:51
To: B Holmes < <mailto:me@brendanh.com> me(a)brendanh.com>
Cc: users < <mailto:users@ovirt.org> users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com <mailto:me@brendanh.com> >
wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com <http://ovirt-engine.example.com> 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you are using on
the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on 10.0.0.171). I
trust this is correct and I should not resolve to a natted IP instead. I notice that
regardless of this record, the name ovirt-engine.example.com
<http://ovirt-engine.example.com> resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
While the script is running, if I I can successfully ping ovirt-engine.example.com
<http://ovirt-engine.example.com> , it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the DNS
record's IP. If I remove the DNS record and run hosted-engine --deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com
<http://ovirt-engine.example.com> did not resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran the usual
deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [ INFO ] TASK [Check
engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once ready it will
be shutdown and moved to the shared storage. At that point it will be restarted on your
management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
The ovirt-engine.example.com <http://ovirt-engine.example.com> has been deleted! I
pinged ovirt-engine.example.com <http://ovirt-engine.example.com> and it now
resolves to its IP on the physical network: 10.0.0.109. So I added back this /etc/hosts
entry:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed": true, "cmd": ["hosted-engine",
"--vm-status", "--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start": "2018-10-09 15:43:41.779715",
"stderr": "", "stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}", "stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org>
To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org>
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
6:49 a.m.
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
“restart from scratch deploying with a static IP”. Okay, I have
reinstalled the host using oVirt Node from scratch. I am assigning a
static IP using the attached answers.conf which contains:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
create_target_vm.yml and all other RedHat code is as-shipped. I’m getting
the same error:
[ INFO ] TASK [Copy /etc/hosts back to the Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to
something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
Any ideas? How can I debug this failure to assign an IP (undefined
variable)?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 10 October 2018 12:06
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109
should be assigned.
However perhaps DHCP is not working. I have just changed to a static IP
instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is
quite possible engine’s DHCP has been failing too. Each time the host
boots, I must type dhclient in order to receive an IP address. Anyway,
after changing this and re-running hosted-engine –deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to
etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
400, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n debug:
var=FQDN\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I have just tried deploying using the webui, same error. I suspect the
“undefined variable” is local_vm_ip.std_out_lines[0]. My new debug task
that tries to output this is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc
hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest
the value of this is localhost. Localhost is just the machine this task
ran on. I don’t think list local_vm_ip.std_out_lines is defined. Any more
ideas?
The issue is on a task that isn't part of the code we are shipping.
I can just suggest to simply reinstall the rpm to get rid of any
modification and restart from scratch deploying with a static IP if your
DHCP server is not properly working.
Many thanks
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 09 October 2018 16:51
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com> wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you
are using on the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on
10.0.0.171). I trust this is correct and I should not resolve to a natted
IP instead. I notice that regardless of this record, the name
ovirt-engine.example.com resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com
While the script is running, if I I can successfully ping
ovirt-engine.example.com, it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the
DNS record's IP. If I remove the DNS record and run hosted-engine
--deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com did not
resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy
command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran
the usual deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to
etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [
INFO ] TASK [Check engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once
ready it will be shutdown and moved to the shared storage. At that point it
will be restarted on your management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
The ovirt-engine.example.com has been deleted! I pinged
ovirt-engine.example.com and it now resolves to its IP on the physical
network: 10.0.0.109. So I added back this /etc/hosts entry:
192.168.124.51 ovirt-engine.example.com
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed":
true, "cmd": ["hosted-engine", "--vm-status",
"--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start":
"2018-10-09 15:43:41.779715", "stderr": "",
"stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36 2018)
\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37 2018)
\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}",
"stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810
(Tue Oct 9 15:43:36 2018)
\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810 (Tue Oct 9
15:43:37 2018)
\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\",
\"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\":
\"failed liveliness check\", \"health\": \"bad\",
\"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400,
\"stopped\": false, \"maintenance\":
false, \"crc32\": \"c5d76f8b\", \"local_conf_timestamp\":
6810,
\"host-ts\": 6810}, \"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution
is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
12:50 a.m.
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
3:33 p.m.
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is
not being populated.
Hi,
according to your log file the deployment was successful:
2018-10-14 13:06:36,316+0100 INFO otopi.plugins.gr_he_common.core.misc
misc._terminate:250 Hosted Engine successfully deployed
But from the logs I see that you introduced custom ansible tasks and you
also removed relevant code parts:
2018-10-14 13:04:31,778+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy local VM disk to shared
storage]
2018-10-14 13:04:59,019+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-14 13:04:59,721+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [pause]
2018-10-14 13:05:00,422+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:01,124+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 TASK [debug]
2018-10-14 13:05:01,725+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-14 12:58:22.193727',
u'stdout': u'',
u'cmd': u"virsh -r net-dhcp-leases default | grep -i 00:16:3e:31:d3:9e |
awk '{ print $5 }' | cut -f1 -d'/'", 'failed': False,
u'delta':
u'0:00:00.069294', u'stderr': u'', u'rc': 0,
'stdout_lines': [], u'start':
u'2018-10-14 12:58:22.124433'}
2018-10-14 13:05:02,426+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 TASK [debug]
2018-10-14 13:05:03,127+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip.stdout_lines[0]: VARIABLE IS
NOT DEFINED!
2018-10-14 13:05:03,828+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of
local_vm_ip.stdout_lines[0]]
2018-10-14 13:05:04,530+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:05,231+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of FQDN]
2018-10-14 13:05:05,832+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:180
ansible-playbook rc: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 89 changed:
24 unreachable: 0 skipped: 3 failed: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com] :
ok: 11 changed: 6 unreachable: 0 skipped: 0 failed: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:187
ansible-playbook stdout:
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 [pause]
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 Pausing
because next block will fail miserably:
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190
ansible-playbook stderr:
2018-10-14 13:05:06,435+0100 ERROR
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:192
[WARNING]: Not waiting for response to prompt as stdin is not interactive
at this point I can only suggest again to simply run the vanilla code
without any custom patch.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due
to something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
4:19 p.m.
Hi Simone,
I had exactly the same error in the run prior, which is why I added simple
non-function-changing debug code. I’ll send you the log from a run without this. It
won’t be any different except won’t contain some extra info.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
2018-10-14 13:06:36,316+0100 INFO otopi.plugins.gr_he_common.core.misc
misc._terminate:250 Hosted Engine successfully deployed
But from the logs I see that you introduced custom ansible tasks and you also removed
relevant code parts:
2018-10-14 13:04:31,778+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy local VM disk to shared storage]
2018-10-14 13:04:59,019+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-14 13:04:59,721+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [pause]
2018-10-14 13:05:00,422+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:01,124+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 TASK [debug]
2018-10-14 13:05:01,725+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-14 12:58:22.193727',
u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut -f1 -d'/'",
'failed': False, u'delta': u'0:00:00.069294', u'stderr':
u'', u'rc': 0, 'stdout_lines': [], u'start':
u'2018-10-14 12:58:22.124433'}
2018-10-14 13:05:02,426+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 TASK [debug]
2018-10-14 13:05:03,127+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip.stdout_lines[0]: VARIABLE IS NOT DEFINED!
2018-10-14 13:05:03,828+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of local_vm_ip.stdout_lines[0]]
2018-10-14 13:05:04,530+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:05,231+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of FQDN]
2018-10-14 13:05:05,832+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:180 ansible-playbook rc: 0
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 89 changed: 24 unreachable:
0 skipped: 3 failed: 0
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com
<http://ovirt-engine.example.com> ] : ok: 11 changed: 6 unreachable: 0 skipped: 0
failed: 0
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:187 ansible-playbook stdout:
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:189 [pause]
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:189 Pausing because next block will fail miserably:
2018-10-14 13:05:06,434+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:190 ansible-playbook stderr:
2018-10-14 13:05:06,435+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:192 [WARNING]: Not waiting for response to prompt as stdin is not
interactive
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
11:37 p.m.
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
11:08 a.m.
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
2018-10-22 21:22:23,360+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 engine_vm_ip_vdsm:
2018-10-22 21:22:24,062+0100 INFO
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fail if the Engine has no IP
address]
2018-10-22 21:22:24,763+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 {u'msg': u'Engine VM has no IP address.
Please check your network configuration', u'changed': False,
u'_ansible_no_log': False}
2018-10-22 21:22:24,863+0100 ERROR
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"changed":
false, "msg": "Engine VM has no IP address. Please check your network
configuration"}
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:180
ansible-playbook rc: 2
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 82 changed:
31 unreachable: 0 skipped: 5 failed: 2
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com] :
ok: 11 changed: 6 unreachable: 0 skipped: 0 failed: 0
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:187
ansible-playbook stdout:
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 to
retry, use: --limit
@/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.retry
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190
ansible-playbook stderr:
2018-10-22 21:22:25,366+0100 DEBUG otopi.context context._executeMethod:143
method exception
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
line 214, in _closeup
r = ah.run()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
line 194, in run
raise RuntimeError(_('Failed executing ansible-playbook'))
RuntimeError: Failed executing ansible-playbook
2018-10-22 21:22:25,367+0100 ERROR otopi.context context._executeMethod:152
Failed to execute stage 'Closing up': Failed executing ansible-playbook
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 22 October 2018 13:33
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is
not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code
without any custom patch.
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due
to something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
4:42 p.m.
Hi Simone,
I accidentally ran this using DHCP, which I know is problematic on my network. I had
previously run it using answer file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:<static_IP_address>
The same error occurred last time, but I’ll do so again and resend the full log.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
2018-10-22 21:22:23,360+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 engine_vm_ip_vdsm:
2018-10-22 21:22:24,062+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fail if the Engine has no IP address]
2018-10-22 21:22:24,763+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 {u'msg': u'Engine VM has no IP address.
Please check your network configuration', u'changed': False,
u'_ansible_no_log': False}
2018-10-22 21:22:24,863+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"changed":
false, "msg": "Engine VM has no IP address. Please check your network
configuration"}
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:180 ansible-playbook rc: 2
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 82 changed: 31 unreachable:
0 skipped: 5 failed: 2
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com
<http://ovirt-engine.example.com> ] : ok: 11 changed: 6 unreachable: 0 skipped: 0
failed: 0
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:187 ansible-playbook stdout:
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:189 to retry, use: --limit
@/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.retry
2018-10-22 21:22:25,365+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils.run:190 ansible-playbook stderr:
2018-10-22 21:22:25,366+0100 DEBUG otopi.context context._executeMethod:143 method
exception
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
line 214, in _closeup
r = ah.run()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
line 194, in run
raise RuntimeError(_('Failed executing ansible-playbook'))
RuntimeError: Failed executing ansible-playbook
2018-10-22 21:22:25,367+0100 ERROR otopi.context context._executeMethod:152 Failed to
execute stage 'Closing up': Failed executing ansible-playbook
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
12:19 a.m.
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt using
answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the engine VM or to
variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t work.
Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is networked. Which
port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
10:44 a.m.
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an
attempt using answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the
engine VM or to variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” –
Doesn’t work. Port querying 10.0.0.109 on 5800\5900 fails, so I don’t
think the VM is networked. Which port does engine VNC use?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 23 October 2018 09:09
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4
address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 22 October 2018 13:33
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is
not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code
without any custom patch.
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due
to something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
5:56 p.m.
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from install of
ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file from package
ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean using
command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP option) and the
usual error occurs. I attach the log from this attempt.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 24 October 2018 08:44
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt using
answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the engine VM or to
variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t work.
Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is networked. Which
port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
6:10 p.m.
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc
from install of ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts
with file from package ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you
mean using command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP
option) and the usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from
libvirt default network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 15:36:13.196641',
u'stdout': u'',
u'cmd': u"virsh -r net-dhcp-leases default | grep -i 00:16:3e:3d:13:d8 |
awk '{ print $5 }' | cut -f1 -d'/'", 'failed': False,
u'delta':
u'0:00:00.054641', u'stderr': u'', u'rc': 0,
'stdout_lines': [], u'start':
u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 24 October 2018 08:44
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an
attempt using answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the
engine VM or to variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” –
Doesn’t work. Port querying 10.0.0.109 on 5800\5900 fails, so I don’t
think the VM is networked. Which port does engine VNC use?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 23 October 2018 09:09
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4
address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 22 October 2018 13:33
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is
not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code
without any custom patch.
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due
to something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
6:48 p.m.
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC address Protocol IP address Hostname
Client ID or DUID
-------------------------------------------------------------------------------------------------------------------
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 24 October 2018 16:11
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from install of
ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file from package
ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean using
command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP option) and the
usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt default
network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 15:36:13.196641',
u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'",
'failed': False, u'delta': u'0:00:00.054641', u'stderr':
u'', u'rc': 0, 'stdout_lines': [], u'start':
u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 24 October 2018 08:44
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt using
answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the engine VM or to
variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t work.
Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is networked. Which
port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
5:28 p.m.
“The issue here is that it seams that your VM never got an address from libvirt default
network DHCP” – but aren’t I obviating DHCP by using parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
? VM should receive a static IP instead.
Perhaps there is a bug in hosted-engine setup that forces it to require DHCP. If you have
no more suggestions, I will buy a new router with different DHCP server.
Many thanks,
Brendan
From: Brendan Holmes <me(a)brendanh.com>
Sent: 24 October 2018 16:48
To: 'Simone Tiraboschi' <stirabos(a)redhat.com>
Cc: 'users' <users(a)ovirt.org>
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC address Protocol IP address Hostname
Client ID or DUID
-------------------------------------------------------------------------------------------------------------------
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 24 October 2018 16:11
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from install of
ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file from package
ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean using
command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP option) and the
usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt default
network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 15:36:13.196641',
u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'",
'failed': False, u'delta': u'0:00:00.054641', u'stderr':
u'', u'rc': 0, 'stdout_lines': [], u'start':
u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 24 October 2018 08:44
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt using
answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the engine VM or to
variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t work.
Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is networked. Which
port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
10:39 a.m.
On Thu, Oct 25, 2018 at 4:29 PM Brendan Holmes <me(a)brendanh.com> wrote:
“The issue here is that it seams that your VM never got an address
from
libvirt default network DHCP” – but aren’t I obviating DHCP by using
parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
? VM should receive a static IP instead.
Perhaps there is a bug in hosted-engine setup that forces it to require
DHCP.
No, this is expected.
The deploy process will launch a bootstrap local VM that will get a
temporary address via DHCP over libvirt default natted network.
The engine running on that VM will be used to configure the environment and
create a VM on the shared storage.
Only at the end, the local VM will be shutdown and its disk moved over the
disk of the VM created by the engine on the shared storage.
In your case it seams that the bootstrap VMs for some reasons fails to get
an address from DHCP over libvirt default natted network.
I'd suggest to try connecting to that VM via VNC to see what's going on
there.
If you have no more suggestions, I will buy a new router with different
DHCP server.
Many thanks,
Brendan
*From:* Brendan Holmes <me(a)brendanh.com>
*Sent:* 24 October 2018 16:48
*To:* 'Simone Tiraboschi' <stirabos(a)redhat.com>
*Cc:* 'users' <users(a)ovirt.org>
*Subject:* RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC address Protocol IP
address Hostname Client ID or DUID
-------------------------------------------------------------------------------------------------------------------
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a
bootable USB.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 24 October 2018 16:11
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc
from install of ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts
with file from package ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you
mean using command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP
option) and the usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from
libvirt default network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 15:36:13.196641',
u'stdout': u'',
u'cmd': u"virsh -r net-dhcp-leases default | grep -i 00:16:3e:3d:13:d8 |
awk '{ print $5 }' | cut -f1 -d'/'", 'failed': False,
u'delta':
u'0:00:00.054641', u'stderr': u'', u'rc': 0,
'stdout_lines': [], u'start':
u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 24 October 2018 08:44
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an
attempt using answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the
engine VM or to variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” –
Doesn’t work. Port querying 10.0.0.109 on 5800\5900 fails, so I don’t
think the VM is networked. Which port does engine VNC use?
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 23 October 2018 09:09
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4
address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 22 October 2018 13:33
*To:* B Holmes <me(a)brendanh.com>
*Cc:* users <users(a)ovirt.org>
*Subject:* Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is
not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code
without any custom patch.
*From:* Simone Tiraboschi <stirabos(a)redhat.com>
*Sent:* 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com> wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no
element 0\n\nThe error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line
396, column 5, but may\nbe elsewhere in the file depending on the exact
syntax problem.\n\nThe offending line appears to be:\n\n changed_when:
True\n - name: Clean /etc/hosts on the host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due
to something bad before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
10:32 p.m.
Hi Simone,
“bootstrap VMs for some reasons fails to get an address from DHCP over libvirt default
natted network”.
I respectfully disagree. Line 1784 of the most recent log I sent you is:
2018-10-24 14:12:26,524+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 14:12:25.437958',
u'stdout': u'192.168.124.175', u'cmd': u"virsh -r
net-dhcp-leases default | grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1
-d'/'", 'failed': False, 'attempts': 2, u'stderr':
u'', u'rc': 0, u'delta': u'0:00:00.070076',
'stdout_lines': [u'192.168.124.175'], u'start': u'2018-10-24
14:12:25.367882'}
I am able to ping the natted IP.
Also I wrote after an earlier attempt: “ovirt-engine.example.com resolves to a natted IP:
192.168.124.51”. (https://www.mail-archive.com/users@ovirt.org/msg51515.html).
The process fails as the bootstrap VM is moved to the final engine VM on the shared
storage. I still think if I solve the DHCP problem on my network, the engine VM will be
successfully created. Are you able to confirm the Node VM (https://www.ovirt.org/node/)
has DHCP enabled? If so, then since this has the same DHCP problem as the engine VM (I
have to type “dhclient” each boot to get an IP), I can use Node to troubleshoot.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com>
Sent: 26 October 2018 08:39
To: B Holmes <me(a)brendanh.com>
Cc: users <users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Thu, Oct 25, 2018 at 4:29 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
“The issue here is that it seams that your VM never got an address from libvirt default
network DHCP” – but aren’t I obviating DHCP by using parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
? VM should receive a static IP instead.
Perhaps there is a bug in hosted-engine setup that forces it to require DHCP.
No, this is expected.
The deploy process will launch a bootstrap local VM that will get a temporary address via
DHCP over libvirt default natted network.
The engine running on that VM will be used to configure the environment and create a VM on
the shared storage.
Only at the end, the local VM will be shutdown and its disk moved over the disk of the VM
created by the engine on the shared storage.
In your case it seams that the bootstrap VMs for some reasons fails to get an address from
DHCP over libvirt default natted network.
I'd suggest to try connecting to that VM via VNC to see what's going on there.
If you have no more suggestions, I will buy a new router with different DHCP server.
Many thanks,
Brendan
From: Brendan Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Sent: 24 October 2018 16:48
To: 'Simone Tiraboschi' <stirabos(a)redhat.com <mailto:stirabos@redhat.com>
>
Cc: 'users' <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC address Protocol IP address Hostname
Client ID or DUID
-------------------------------------------------------------------------------------------------------------------
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 24 October 2018 16:11
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from install of
ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file from package
ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean using
command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP option) and the
usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt default
network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-24 15:36:13.196641',
u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'",
'failed': False, u'delta': u'0:00:00.054641', u'stderr':
u'', u'rc': 0, 'stdout_lines': [], u'start':
u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 24 October 2018 08:44
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifac...
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt using
answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heappli...
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the engine VM or to
variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t work.
Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is networked. Which
port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you requested. I
hope it reveals why variable “local_vm_ip.stdout_lines” is not being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without any custom
patch.
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I think that this is just an error in the clean up on failures phase due to something bad
before.
Can you please attach the whole deployment log from
/var/log/ovirt-hosted-engine/hosted-engine.log ?
7:28 p.m.
Hi Simone,
Here is the value of local_vm_ip during the bootstrap VM phase:
TASK [Create local VM]
TASK [Get local VM IP]:
2018-10-14 11:50:40,831+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-14 11:50:39.860036',
u'stdout': u'192.168.124.16', u'cmd': u"virsh -r
net-dhcp-leases default | grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut -f1
-d'/'", 'failed': False, 'attempts': 2, u'stderr':
u'', u'rc': 0, u'delta': u'0:00:00.058237',
'stdout_lines': [u'192.168.124.16'], u'start': u'2018-10-14
11:50:39.801799'}
And this is its value at the moment the setup crashes (at the usual place – “Clean
/etc/hosts on the host”):
2018-10-14 12:58:23,373+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:94 local_vm_ip: {'stderr_lines': [],
u'changed': True, u'end': u'2018-10-14 12:58:22.193727',
u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut -f1 -d'/'",
'failed': False, u'delta': u'0:00:00.069294', u'stderr':
u'', u'rc': 0, 'stdout_lines': [], u'start':
u'2018-10-14 12:58:22.124433'}
stdout_lines has disappeared.
After the error, I ran command:
[root@host04 ansible]# virsh -r net-dhcp-leases default
Expiry Time MAC address Protocol IP address Hostname
Client ID or DUID
-------------------------------------------------------------------------------------------------------------------
[root@host04 ansible]#
Is the problem that I have assigned a static IP (using cloudinitVMStaticCIDR), yet the
command ansible is running to obtain the IP address (virsh -r net-dhcp-leases) is only
getting IPs obtained by DHCP, not static? Perhaps the bootstrap VM always obtains an DHCP
IP on the natted network, so this command works at that earlier stage. Your documentation
doesn’t mention a net-xxx command to obtain a list of static IPs.
Not sure if its helpful but here’s the output of a net-dumpxml command:
[root@host04 ansible]# virsh -r net-dumpxml default
<network>
<name>default</name>
<uuid>91fe2eee-c36e-4d08-9928-bff2d036aca5</uuid>
<forward mode='nat'>
<nat>
<port start='1024' end='65535'/>
</nat>
</forward>
<bridge name='virbr0' stp='on' delay='0'/>
<mac address='52:54:00:22:1b:4b'/>
<ip address='192.168.124.1' netmask='255.255.255.0'>
<dhcp>
<range start='192.168.124.2' end='192.168.124.254'/>
</dhcp>
</ip>
</network>
[root@host04 ansible]#
Many thanks,
Brendan
From: Brendan Holmes <me(a)brendanh.com>
Sent: 13 October 2018 23:09
To: 'Simone Tiraboschi' <stirabos(a)redhat.com>
Cc: 'users' <users(a)ovirt.org>
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
“restart from scratch deploying with a static IP”. Okay, I have reinstalled the host
using oVirt Node from scratch. I am assigning a static IP using the attached answers.conf
which contains:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
create_target_vm.yml and all other RedHat code is as-shipped. I’m getting the same
error:
[ INFO ] TASK [Copy /etc/hosts back to the Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
Any ideas? How can I debug this failure to assign an IP (undefined variable)?
Many thanks,
Brendan
From: Simone Tiraboschi <stirabos(a)redhat.com <mailto:stirabos@redhat.com> >
Sent: 10 October 2018 12:06
To: B Holmes <me(a)brendanh.com <mailto:me@brendanh.com> >
Cc: users <users(a)ovirt.org <mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes <me(a)brendanh.com
<mailto:me@brendanh.com> > wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be assigned.
However perhaps DHCP is not working. I have just changed to a static IP instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite possible
engine’s DHCP has been failing too. Each time the host boots, I must type dhclient in
order to receive an IP address. Anyway, after changing this and re-running hosted-engine
–deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 400,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n debug: var=FQDN\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
I have just tried deploying using the webui, same error. I suspect the “undefined
variable” is local_vm_ip.std_out_lines[0]. My new debug task that tries to output this
is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest the value of this
is localhost. Localhost is just the machine this task ran on. I don’t think list
local_vm_ip.std_out_lines is defined. Any more ideas?
The issue is on a task that isn't part of the code we are shipping.
I can just suggest to simply reinstall the rpm to get rid of any modification and restart
from scratch deploying with a static IP if your DHCP server is not properly working.
Many thanks
From: Simone Tiraboschi < <mailto:stirabos@redhat.com> stirabos(a)redhat.com>
Sent: 09 October 2018 16:51
To: B Holmes < <mailto:me@brendanh.com> me(a)brendanh.com>
Cc: users < <mailto:users@ovirt.org> users(a)ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM <me(a)brendanh.com <mailto:me@brendanh.com> >
wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com <http://ovirt-engine.example.com> 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you are using on
the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on 10.0.0.171). I
trust this is correct and I should not resolve to a natted IP instead. I notice that
regardless of this record, the name ovirt-engine.example.com
<http://ovirt-engine.example.com> resolves to a natted IP: 192.168.124.51 because
the ansible script adds an entry to /etc/hosts:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
While the script is running, if I I can successfully ping ovirt-engine.example.com
<http://ovirt-engine.example.com> , it responds on 192.168.124.51. So as you say:
"host can correctly resolve the name of the engine VM", but it's not the DNS
record's IP. If I remove the DNS record and run hosted-engine --deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com
<http://ovirt-engine.example.com> did not resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy command, it failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an
option with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe
offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the
host\n ^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran the usual
deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [ INFO ] TASK [Check
engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once ready it will
be shutdown and moved to the shared storage. At that point it will be restarted on your
management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
The ovirt-engine.example.com <http://ovirt-engine.example.com> has been deleted! I
pinged ovirt-engine.example.com <http://ovirt-engine.example.com> and it now
resolves to its IP on the physical network: 10.0.0.109. So I added back this /etc/hosts
entry:
192.168.124.51 ovirt-engine.example.com <http://ovirt-engine.example.com>
Please avoid this.
It subsequently errored:
[ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120,
"changed": true, "cmd": ["hosted-engine",
"--vm-status", "--json"], "delta":
"0:00:00.167559", "end": "2018-10-09 15:43:41.947274",
"rc": 0, "start": "2018-10-09 15:43:41.779715",
"stderr": "", "stderr_lines": [], "stdout":
"{\"1\": {\"conf_on_shared_storage\": true,
\"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}", "stdout_lines":
["{\"1\": {\"conf_
on_shared_storage\": true, \"live-data\": true, \"extra\":
\"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=6810 (Tue Oct 9
15:43:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=6810
<file://nhost-id=1/nscore=3400/nvm_conf_refresh_time=6810> (Tue Oct 9 15:43:37
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\
<file://nconf_on_shared_storage=True/nmaintenance=False/nstate=EngineStarting/nstopped=False/n/>
", \"hostname\": \"host\", \"host-id\": 1,
\"engine-status\": {\"reason\": \"failed liveliness check\",
\"health\": \"bad\", \"vm\": \"up\",
\"detail\": \"Up\"}, \"score\": 3400, \"stopped\":
false, \"maintenance\": false, \"crc32\": \"c5d76f8b\",
\"local_conf_timestamp\": 6810, \"host-ts\": 6810},
\"global_maintenance\": false}"]}
How can I check the hosted-engine's IP address to ensure name resolution is correct?
You can connect to that VM with VNC and check the IP there.
_______________________________________________
Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org>
To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org>
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/SVBXIBLS5TS...
2214
days inactive
2234
days old
30 comments
4 participants
participants (4)
-
Brendan Holmes -
me＠brendanh.com
-
Simone Tiraboschi -
Yuval Turgeman