- Users - oVirt List Archives

Diary of hosted engine install woes
by me＠brendanh.com 27 Oct '18

27 Oct '18

Hi, I've been attempting to install hosted engine intermittently for months without success. I have raised and had one bug fixed (https://bugzilla.redhat.com/show_bug.cgi?id=1622240) and am hitting various other problems. I've freshly installed oVirt Node v4.2.7 (Second Release Candidate). I have launched the webui and configured an XOR bond. Then using the following answer file, I attempt to install hosted engine using command: hosted-engine --deploy --config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers.conf Where answers contains: [environment:default] OVEHOSTED_CORE/deployProceed=bool:True OVEHOSTED_CORE/rollbackProceed=none:None OVEHOSTED_CORE/screenProceed=bool:True OVEHOSTED_CORE/upgradeProceed=none:None OVEHOSTED_ENGINE/clusterName=str:Default OVEHOSTED_ENGINE/enableHcGlusterService=none:None OVEHOSTED_ENGINE/insecureSSL=none:None OVEHOSTED_NETWORK/bridgeName=str:ovirtmgmt OVEHOSTED_NETWORK/fqdn=str:ovirt-engine.example.com OVEHOSTED_NETWORK/gateway=str:10.0.0.1 OVEHOSTED_NOTIF/destEmail=str:me@example.com OVEHOSTED_NOTIF/smtpPort=str:25 OVEHOSTED_NOTIF/smtpServer=str:smtp.emailprovider.com OVEHOSTED_NOTIF/sourceEmail=str:admin@example.com OVEHOSTED_STORAGE/LunID=none:None OVEHOSTED_STORAGE/discardSupport=bool:False OVEHOSTED_STORAGE/domainType=str:nfs OVEHOSTED_STORAGE/iSCSIDiscoverUser=none:None OVEHOSTED_STORAGE/iSCSIPortal=none:None OVEHOSTED_STORAGE/iSCSIPortalIPAddress=none:None OVEHOSTED_STORAGE/iSCSIPortalPort=none:None OVEHOSTED_STORAGE/iSCSIPortalUser=none:None OVEHOSTED_STORAGE/iSCSITargetName=none:None OVEHOSTED_STORAGE/imgSizeGB=str:50 OVEHOSTED_STORAGE/imgUUID=str:4ff5a24d-7993-4be3-9301-e829030f9dc1 OVEHOSTED_STORAGE/lockspaceImageUUID=none:None OVEHOSTED_STORAGE/lockspaceVolumeUUID=none:None OVEHOSTED_STORAGE/metadataImageUUID=none:None OVEHOSTED_STORAGE/metadataVolumeUUID=none:None OVEHOSTED_STORAGE/mntOptions=str: OVEHOSTED_STORAGE/nfsVersion=str:auto OVEHOSTED_STORAGE/storageDomainConnection=str:nas.example.com:/export/ovirt_share OVEHOSTED_STORAGE/storageDomainName=str:hosted_storage OVEHOSTED_STORAGE/volUUID=str:b8e5d967-4ffc-452d-8001-fa9369a6a11b OVEHOSTED_VM/automateVMShutdown=bool:True OVEHOSTED_VM/cdromUUID=str:c4b91916-c96b-47cd-a945-5d662ea8fc5d OVEHOSTED_VM/cloudInitISO=str:generate OVEHOSTED_VM/cloudinitExecuteEngineSetup=bool:True OVEHOSTED_VM/cloudinitInstanceDomainName=str:example.com OVEHOSTED_VM/cloudinitInstanceHostName=str:ovirt-engine.example.com OVEHOSTED_VM/cloudinitVMDNS=bool:False OVEHOSTED_VM/cloudinitVMETCHOSTS=bool:False OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:False OVEHOSTED_VM/cloudinitVMTZ=str:Europe/London OVEHOSTED_VM/consoleUUID=str:24d13b14-cc56-420a-966c-f0d7341cb19b OVEHOSTED_VM/emulatedMachine=str:pc OVEHOSTED_VM/nicUUID=str:77aa84f1-744b-45cc-a298-3905acda6944 OVEHOSTED_VM/ovfArchive=str: OVEHOSTED_VM/rootSshAccess=str:yes OVEHOSTED_VM/rootSshPubkey=str:<public_key> OVEHOSTED_VM/vmCDRom=none:None OVEHOSTED_VM/vmMACAddr=str:00:18:3d:5b:11:5c OVEHOSTED_VM/vmMemSizeMB=int:16384 OVEHOSTED_VM/vmVCpus=str:4 After prompting for a couple of passwords it proceeds as far as Task: "Clean /etc/hosts on the host". Then errors: [ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: list object has no element 0\n\nThe error appears to have been in '/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the host\n ^ here\n"} Here is the hosted-engine-setup log: Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. 2018-10-07 20:47:52,180+0100 INFO otopi.context context.runSequence:741 Stage: Initializing 2018-10-07 20:47:52,215+0100 INFO otopi.context context.runSequence:741 Stage: Environment setup 2018-10-07 20:47:52,449+0100 INFO otopi.context context.runSequence:741 Stage: Environment packages setup Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. 2018-10-07 20:47:52,636+0100 INFO otopi.context context.runSequence:741 Stage: Programs detection LANG=en_GB.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin LANG=en_GB.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2018-10-07 20:47:52,778+0100 INFO otopi.context context.runSequence:741 Stage: Environment setup 2018-10-07 20:47:52,787+0100 INFO otopi.context context.runSequence:741 Stage: Environment customization LoadState=loaded PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.283 ms --- 10.0.0.1 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 2018-10-07 20:47:54,133+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:47:55,336+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:47:55,738+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Detecting interface on existing management bridge] 2018-10-07 20:47:56,239+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:47:57,544+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get all active network interfaces] 2018-10-07 20:48:00,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Filter bonds with bad naming] 2018-10-07 20:48:01,855+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Generate output list] 2018-10-07 20:48:02,256+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0 valid_lft forever preferred_lft forever inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute valid_lft forever preferred_lft forever 21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0 valid_lft forever preferred_lft forever inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute valid_lft forever preferred_lft forever 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0 valid_lft forever preferred_lft forever 20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff 21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0 valid_lft forever preferred_lft forever inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute valid_lft forever preferred_lft forever 2018-10-07 20:48:21,545+0100 INFO otopi.context context.runSequence:741 Stage: Setup validation 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0 valid_lft forever preferred_lft forever 20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff 21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0 valid_lft forever preferred_lft forever inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute valid_lft forever preferred_lft forever 2018-10-07 20:48:21,610+0100 WARNING otopi.plugins.gr_he_common.network.bridge hostname._validateFQDN:387 Host name host has no domain suffix host. 0 IN A 10.0.0.171 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens6: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 3: enp6s0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff 19: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff inet 192.168.124.1/24 brd 192.168.124.255 scope global virbr0 valid_lft forever preferred_lft forever 20: virbr0-nic: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000 link/ether 52:54:00:7d:cb:57 brd ff:ff:ff:ff:ff:ff 21: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d8:cb:8c:4e:cd:12 brd ff:ff:ff:ff:ff:ff inet 10.0.0.171/24 brd 10.0.0.255 scope global noprefixroute bond0 valid_lft forever preferred_lft forever inet6 fe80::d233:e638:11a5:1fc0/64 scope link noprefixroute valid_lft forever preferred_lft forever 2018-10-07 20:48:21,693+0100 INFO otopi.context context.runSequence:741 Stage: Transaction setup Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. 2018-10-07 20:48:21,785+0100 INFO otopi.context context.runSequence:741 Stage: Misc configuration 2018-10-07 20:48:21,787+0100 INFO otopi.context context.runSequence:741 Stage: Package installation 2018-10-07 20:48:21,823+0100 INFO otopi.context context.runSequence:741 Stage: Misc configuration 2018-10-07 20:48:21,839+0100 INFO otopi.context context.runSequence:741 Stage: Transaction commit Loaded plugins: fastestmirror, product-id, subscription-manager This system is not registered with an entitlement server. You can use subscription-manager to register. 2018-10-07 20:48:21,885+0100 INFO otopi.context context.runSequence:741 Stage: Closing up 2018-10-07 20:48:21,886+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc misc.initial_clean_up:229 Cleaning previous attempts 2018-10-07 20:48:22,895+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:48:23,998+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:24,500+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check firewalld status] 2018-10-07 20:48:25,402+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:25,904+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Enforce firewalld status] 2018-10-07 20:48:26,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:48:26,707+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Stop libvirt service] 2018-10-07 20:48:27,610+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:28,112+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Drop vdsm config statements] 2018-10-07 20:48:30,216+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Restore initial abrt config files] 2018-10-07 20:48:33,823+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Restart abrtd service] 2018-10-07 20:48:34,725+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:35,127+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Drop libvirt sasl2 configuration by vdsm] 2018-10-07 20:48:35,829+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:36,230+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Stop and disable services] 2018-10-07 20:48:38,334+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Start libvirt] 2018-10-07 20:48:39,337+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:39,739+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check for leftover local Hosted Engine VM] 2018-10-07 20:48:40,541+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:40,943+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Destroy leftover local Hosted Engine VM] 2018-10-07 20:48:41,344+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:48:41,746+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check for leftover defined local Hosted Engine VM] 2018-10-07 20:48:42,448+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:42,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Undefine leftover local engine VM] 2018-10-07 20:48:43,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:48:43,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check for leftover defined Hosted Engine VM] 2018-10-07 20:48:44,454+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:44,856+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Undefine leftover engine VM] 2018-10-07 20:48:45,157+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:48:45,558+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Remove eventually entries for the local VM from known_hosts file] 2018-10-07 20:48:46,360+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:46,663+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc misc._closeup:195 Starting local VM 2018-10-07 20:48:47,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:48:48,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:49,277+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Start libvirt] 2018-10-07 20:48:50,180+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:50,681+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Activate default libvirt network] 2018-10-07 20:48:51,484+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:52,687+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get libvirt interfaces] 2018-10-07 20:48:53,390+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:53,691+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get routing rules] 2018-10-07 20:48:54,493+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:55,797+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Save bridge name] 2018-10-07 20:48:56,098+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:56,500+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for the bridge to appear on the host] 2018-10-07 20:48:57,102+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:48:57,503+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Refresh network facts] 2018-10-07 20:48:57,905+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:48:58,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Prepare CIDR for virbr0] 2018-10-07 20:48:58,708+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:48:59,209+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add outbound route rules] 2018-10-07 20:48:59,911+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:01,115+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add inbound route rules] 2018-10-07 20:49:01,817+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:03,122+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:49:05,427+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:05,929+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 20:49:06,330+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:06,731+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Avoid localhost] 2018-10-07 20:49:07,133+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:07,434+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get host address resolution] 2018-10-07 20:49:08,237+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:09,440+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check address resolution] 2018-10-07 20:49:09,842+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:10,243+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse host address resolution] 2018-10-07 20:49:10,645+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:11,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Ensure host address resolves locally] 2018-10-07 20:49:12,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:12,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get target address from selected interface] 2018-10-07 20:49:13,153+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:14,458+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check the resolved address resolves on the selected interface] 2018-10-07 20:49:14,859+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:15,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check for alias] 2018-10-07 20:49:15,963+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:17,166+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Ensure the resolved address resolves only on the selected interface] 2018-10-07 20:49:17,568+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:18,069+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Avoid localhost] 2018-10-07 20:49:18,471+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:18,872+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get engine FQDN resolution] 2018-10-07 20:49:19,474+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:20,678+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check engine FQDN resolution] 2018-10-07 20:49:21,080+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:21,481+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse engine FQDN resolution] 2018-10-07 20:49:21,983+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:23,187+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Ensure engine FQDN doesn't resolve locally] 2018-10-07 20:49:23,588+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:49:23,890+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check http/https proxy] 2018-10-07 20:49:24,792+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Register the engine FQDN as a host] 2018-10-07 20:49:25,093+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:25,495+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create directory for local VM] 2018-10-07 20:49:26,397+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:26,799+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set local vm dir path] 2018-10-07 20:49:27,200+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:27,602+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fix local VM directory permission] 2018-10-07 20:49:28,504+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:49:29,005+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 20:49:29,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:49:29,808+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Install ovirt-engine-appliance rpm] 2018-10-07 20:53:29,731+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:53:30,234+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse appliance configuration for path] 2018-10-07 20:53:30,936+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:53:32,140+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse appliance configuration for sha1sum] 2018-10-07 20:53:32,842+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:53:34,045+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get OVA path] 2018-10-07 20:53:34,447+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:53:35,651+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Compute sha1sum] 2018-10-07 20:53:37,655+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:53:38,959+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Compare sha1sum] 2018-10-07 20:53:39,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:53:39,662+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Register appliance PATH] 2018-10-07 20:53:40,063+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:53:41,267+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Extract appliance to local VM directory] 2018-10-07 20:54:37,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:54:38,250+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 20:54:38,652+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:54:50,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Find the local appliance image] 2018-10-07 20:54:51,577+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:54:52,781+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set local_vm_disk_path] 2018-10-07 20:54:53,182+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:54:53,584+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get appliance disk size] 2018-10-07 20:54:54,386+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:54:55,590+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse qemu-img output] 2018-10-07 20:54:55,992+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:54:57,196+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create cloud init user-data and meta-data files] 2018-10-07 20:54:59,200+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create ISO disk] 2018-10-07 20:54:59,902+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:55:00,403+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create local VM] 2018-10-07 20:55:02,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:55:03,611+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get local VM IP] 2018-10-07 20:55:25,649+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:55:26,953+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Remove eventually entries for the local VM from /etc/hosts] 2018-10-07 20:55:27,755+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:55:28,256+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create an entry in /etc/hosts for the local VM] 2018-10-07 20:55:28,958+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:55:29,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for SSH to restart on the local VM] 2018-10-07 20:56:00,316+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost -> localhost] 2018-10-07 20:56:00,818+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:56:03,123+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [ovirt-engine.example.com] 2018-10-07 20:56:03,624+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for the local VM] 2018-10-07 20:56:10,337+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [ovirt-engine.example.com] 2018-10-07 20:56:10,939+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add an entry for this host on /etc/hosts on the local VM] 2018-10-07 20:56:12,443+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:56:12,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set FQDN] 2018-10-07 20:56:14,548+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:56:15,050+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Force the local VM FQDN to temporary resolve on the natted network address] 2018-10-07 20:56:16,654+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:56:17,155+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Restore sshd reverse DNS lookups] 2018-10-07 20:56:18,659+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:56:19,261+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Generate an answer file for engine-setup] 2018-10-07 20:56:21,665+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:56:22,167+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Include before engine-setup custom tasks files for the engine VM] 2018-10-07 20:56:23,972+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Execute engine-setup] 2018-10-07 20:57:52,926+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:57:54,430+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Include after engine-setup custom tasks files for the engine VM] 2018-10-07 20:57:56,234+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Configure LibgfApi support] 2018-10-07 20:57:56,735+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [ovirt-engine.example.com] 2018-10-07 20:57:58,139+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Restart ovirt-engine service for LibgfApi support] 2018-10-07 20:57:58,540+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [ovirt-engine.example.com] 2018-10-07 20:57:59,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Mask cloud-init services to speed up future boot] 2018-10-07 20:58:02,849+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Clean up bootstrap answer file] 2018-10-07 20:58:04,252+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 20:58:04,854+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 20:58:06,157+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:58:06,759+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for ovirt-engine service to start] 2018-10-07 20:58:07,962+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:58:09,767+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Detect VLAN ID] 2018-10-07 20:58:10,569+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:58:12,174+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set Engine public key as authorized key without validating the TLS/SSL certificates] 2018-10-07 20:58:13,276+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:58:13,878+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 20:58:14,380+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:58:14,982+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Obtain SSO token using username/password credentials] 2018-10-07 20:58:16,285+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 20:58:16,987+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Enable GlusterFS at cluster level] 2018-10-07 20:58:17,489+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:58:17,990+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set VLAN ID at datacenter level] 2018-10-07 20:58:18,492+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 20:58:19,094+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Force host-deploy in offline mode] 2018-10-07 20:58:20,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:58:20,598+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add host] 2018-10-07 20:58:22,401+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 20:58:23,004+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for the host to be up] 2018-10-07 22:00:02,131+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:03,835+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check host status] 2018-10-07 22:00:04,336+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:04,937+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Remove host-deploy configuration file] 2018-10-07 22:00:05,639+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:00:06,051+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.storage_domain storage_domain._closeup:751 Creating Storage Domain 2018-10-07 22:00:06,856+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 22:00:07,658+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:08,159+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check local VM dir stat] 2018-10-07 22:00:08,860+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:09,361+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Enforce local VM dir existence] 2018-10-07 22:00:09,863+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:10,364+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 22:00:10,865+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:11,366+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Obtain SSO token using username/password credentials] 2018-10-07 22:00:12,268+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:12,769+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch host facts] 2018-10-07 22:00:13,671+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:15,274+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch cluster ID] 2018-10-07 22:00:15,775+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:16,276+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch cluster facts] 2018-10-07 22:00:17,178+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:18,781+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter facts] 2018-10-07 22:00:19,683+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:21,286+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter ID] 2018-10-07 22:00:21,787+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:22,389+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter name] 2018-10-07 22:00:22,790+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:23,391+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add NFS storage domain] 2018-10-07 22:00:24,994+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:00:25,595+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add glusterfs storage domain] 2018-10-07 22:00:26,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:26,698+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add iSCSI storage domain] 2018-10-07 22:00:27,199+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:27,700+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add Fibre Channel storage domain] 2018-10-07 22:00:28,201+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:28,802+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get storage domain details] 2018-10-07 22:00:29,704+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:31,307+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Find the appliance OVF] 2018-10-07 22:00:32,109+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:33,812+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse OVF] 2018-10-07 22:00:34,614+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:35,115+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get required size] 2018-10-07 22:00:35,716+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:00:37,320+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Remove unsuitable storage domain] 2018-10-07 22:00:37,821+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:39,424+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check storage domain free space] 2018-10-07 22:00:39,925+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:00:40,526+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Activate storage domain] 2018-10-07 22:04:13,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:04:15,258+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.target_vm target_vm._closeup:213 Creating Target VM 2018-10-07 22:04:16,064+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 22:04:16,965+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:17,467+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Register the engine FQDN as a host] 2018-10-07 22:04:17,968+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:04:18,469+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 22:04:18,870+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:19,472+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Obtain SSO token using username/password credentials] 2018-10-07 22:04:20,373+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:20,874+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get local VM IP] 2018-10-07 22:04:21,676+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:04:23,179+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch host facts] 2018-10-07 22:04:24,080+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:25,683+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Cluster ID] 2018-10-07 22:04:26,184+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:26,786+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Cluster facts] 2018-10-07 22:04:27,687+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:29,290+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter facts] 2018-10-07 22:04:30,192+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:31,795+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Cluster name] 2018-10-07 22:04:32,296+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:32,898+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter ID] 2018-10-07 22:04:33,399+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:34,000+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Datacenter name] 2018-10-07 22:04:34,501+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:35,103+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get Cluster CPU model] 2018-10-07 22:04:35,604+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:37,207+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Get storage domain details] 2018-10-07 22:04:38,209+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:04:39,812+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add HE disks] 2018-10-07 22:06:32,186+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Register disk details] 2018-10-07 22:06:32,788+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:06:34,491+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Add VM] 2018-10-07 22:06:36,595+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:06:38,198+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Register external local VM uuid] 2018-10-07 22:06:39,000+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:06:40,703+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 22:06:41,905+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [ovirt-engine.example.com] 2018-10-07 22:06:42,406+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Find configuration file for SCL PostgreSQL] 2018-10-07 22:06:43,509+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 22:06:45,012+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check SCL PostgreSQL value] 2018-10-07 22:06:46,114+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 22:06:47,717+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Update target VM details at DB level] 2018-10-07 22:06:50,523+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Insert Hosted Engine configuration disk uuid into Engine database] 2018-10-07 22:06:51,625+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 22:06:53,228+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Disable IPv6] 2018-10-07 22:06:54,330+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 22:06:54,931+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Reload sysctl] 2018-10-07 22:06:55,933+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [ovirt-engine.example.com] 2018-10-07 22:06:56,535+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 22:06:57,837+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:06:58,538+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Enable again the serial console device] 2018-10-07 22:06:59,741+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:00,442+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Trigger hosted engine OVF update] 2018-10-07 22:07:01,944+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:07:02,646+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait until OVF update finishes] 2018-10-07 22:07:03,748+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:04,449+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse OVF_STORE disk list] 2018-10-07 22:07:05,151+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:07,255+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check OVF_STORE volume status (ansible 2.5)] 2018-10-07 22:07:08,657+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Check OVF_STORE volume status (ansible 2.6)] 2018-10-07 22:07:11,362+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Prepare images] 2018-10-07 22:07:15,970+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Hosted Engine configuration disk path] 2018-10-07 22:07:16,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:17,373+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Hosted Engine virtio disk path] 2018-10-07 22:07:18,075+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:18,776+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch Hosted Engine virtio metadata path] 2018-10-07 22:07:19,377+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:07:24,286+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Shutdown local VM] 2018-10-07 22:07:25,288+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:07:26,090+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for local VM shutdown] 2018-10-07 22:09:01,140+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:03,144+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Undefine local VM] 2018-10-07 22:09:04,046+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:04,747+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Detect spmId] 2018-10-07 22:09:05,749+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:07,853+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Parse spmId] 2018-10-07 22:09:08,555+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:10,558+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Detect ovirt-hosted-engine-ha version] 2018-10-07 22:09:11,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:12,162+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set ha_version] 2018-10-07 22:09:12,763+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:14,867+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create configuration templates] 2018-10-07 22:09:18,172+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create configuration archive] 2018-10-07 22:09:18,974+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:19,676+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create ovirt-hosted-engine-ha run directory] 2018-10-07 22:09:20,577+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:21,379+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Copy configuration files to the right location on host] 2018-10-07 22:09:23,483+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Copy configuration archive to storage] 2018-10-07 22:09:24,685+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:25,387+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Initialize metadata volume] 2018-10-07 22:09:36,903+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:37,604+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 22:09:38,306+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:39,107+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Find the local appliance image] 2018-10-07 22:09:40,009+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:42,113+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set local_vm_disk_path] 2018-10-07 22:09:42,714+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:09:43,415+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Generate DHCP network configuration for the engine VM] 2018-10-07 22:09:44,417+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:09:45,119+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Generate static network configuration for the engine VM] 2018-10-07 22:09:45,720+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 skipping: [localhost] 2018-10-07 22:09:46,422+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Inject network configuration with guestfish] 2018-10-07 22:10:01,444+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:02,146+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Extract /etc/hosts from the Hosted Engine VM] 2018-10-07 22:10:05,151+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:05,953+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Clean /etc/hosts for the Hosted Engine VM for Engine VM FQDN] 2018-10-07 22:10:06,754+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:07,455+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Clean /etc/hosts for the Hosted Engine VM for host address] 2018-10-07 22:10:08,357+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:09,059+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Copy /etc/hosts back to the Hosted Engine VM] 2018-10-07 22:10:12,364+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:13,065+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Copy local VM disk to shared storage] 2018-10-07 22:10:43,511+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:44,212+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Clean /etc/hosts on the host] 2018-10-07 22:10:44,814+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94 {u'msg': u"The task includes an option with an undefined variable. The error was: list object has no element 0\n\nThe error appears to have been in '/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the host\n ^ here\n", u'_ansible_no_log': False} 2018-10-07 22:10:44,914+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: list object has no element 0\n\nThe error appears to have been in '/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n changed_when: True\n - name: Clean /etc/hosts on the host\n ^ here\n"} 2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:180 ansible-playbook rc: 2 2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94 PLAY RECAP [localhost] : ok: 70 changed: 24 unreachable: 0 skipped: 3 failed: 1 2018-10-07 22:10:45,415+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94 PLAY RECAP [ovirt-engine.example.com] : ok: 11 changed: 6 unreachable: 0 skipped: 0 failed: 0 2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:187 ansible-playbook stdout: 2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 to retry, use: --limit @/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.retry 2018-10-07 22:10:45,416+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190 ansible-playbook stderr: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py", line 214, in _closeup r = ah.run() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 194, in run raise RuntimeError(_('Failed executing ansible-playbook')) RuntimeError: Failed executing ansible-playbook 2018-10-07 22:10:45,418+0100 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Closing up': Failed executing ansible-playbook 2018-10-07 22:10:45,419+0100 INFO otopi.context context.runSequence:741 Stage: Clean up 2018-10-07 22:10:45,420+0100 INFO otopi.plugins.gr_he_ansiblesetup.core.misc misc._cleanup:246 Cleaning temporary resources 2018-10-07 22:10:46,225+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Gathering Facts] 2018-10-07 22:10:46,927+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:47,528+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Fetch logs from the engine VM] 2018-10-07 22:10:47,929+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:48,430+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set destination directory path] 2018-10-07 22:10:48,931+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:49,332+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Create destination directory] 2018-10-07 22:10:50,134+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:10:50,535+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 22:10:51,036+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:51,537+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Find the local appliance image] 2018-10-07 22:10:52,239+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:53,641+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Set local_vm_disk_path] 2018-10-07 22:10:54,042+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:10:54,544+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Give the vm time to flush dirty buffers] 2018-10-07 22:11:04,959+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:11:05,460+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Copy engine logs] 2018-10-07 22:11:11,269+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [include_tasks] 2018-10-07 22:11:11,670+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 ok: [localhost] 2018-10-07 22:11:12,171+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Remove local vm dir] 2018-10-07 22:11:13,173+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 changed: [localhost] 2018-10-07 22:11:14,403+0100 INFO otopi.context context.runSequence:741 Stage: Termination 2018-10-07 22:11:14,404+0100 ERROR otopi.plugins.gr_he_common.core.misc misc._terminate:240 Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. For brevity, I've trimmed the debug lines from the above except those around the error "task includes an option with an undefined variable". Any ideas? I have assigned engine a DHCP address and can resolve its name to a natted IP: 192.168.124.51. I run the same command again in case this is an anomaly: hosted-engine --deploy --config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers.conf This time, it doesn't get that far, proceeds as far as: [ INFO ] TASK [Activate storage domain] [ ERROR ] Error: Fault reason is "Operation Failed". Fault detail is "[]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[]\". HTTP response code is 400."} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook The hosted-engine log this time shows: 2018-10-07 22:54:43,619+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Activate storage domain] 2018-10-07 22:54:45,022+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:98 Error: Fault reason is "Operation Failed". Fault detail is "[]". HTTP response code is 400. 2018-10-07 22:54:45,122+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[]\". HTTP response code is 400."} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/storage_domain.py", line 756, in _closeup raise e RuntimeError: Failed executing ansible-playbook I've had other errors too, but my own investigations haven't solved. Any ideas much appreciated. Many thanks.

4 30

Unable to export vm as ova
by sangeetha.rathinavel＠oracle.com 26 Oct '18

26 Oct '18

When I try to export a vm to ova, get this below error in engine log 2018-10-26 12:11:36,657-04 ERROR [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-37) [484d3716] EngineException: ENGINE (Failed with error ENGINE and code 5001): org.ovirt.engine.core.common.errors.EngineException: EngineException: ENGINE (Failed with error ENGINE and code 5001) at org.ovirt.engine.core.bll.exportimport.ExportOvaCommand.createOva(ExportOvaCommand.java:301) [bll.jar:] at org.ovirt.engine.core.bll.exportimport.ExportOvaCommand.executeNextOperation(ExportOvaCommand.java:285) [bll.jar:] at org.ovirt.engine.core.bll.exportimport.ExportOvaCommand.performNextOperation(ExportOvaCommand.java:277) [bll.jar:] at org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback.childCommandsExecutionEnded(SerialChildCommandsExecutionCallback.java:32) [bll.jar:] at org.ovirt.engine.core.bll.ChildCommandsCallbackBase.doPolling(ChildCommandsCallbackBase.java:68) [bll.jar:] at org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethodsImpl(CommandCallbacksPoller.java:146) [bll.jar:] at org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethods(CommandCallbacksPoller.java:107) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_181] In Ansible log writing disk: path=/rhev/data-center/mnt/ca-ovmstor101:_export_sanrathi_brml11g04-oVirt-nfs-01/aec73d1f-ea3d-4228-a151-a41b20b6b67b/images/e1186fdb-3fc3-46ae-945c-dd19bb6d434c/d95c52e3-35d1-493e-ab2d-42577bdb0391 size=196848 Traceback (most recent call last): File "/root/.ansible/tmp/ansible-tmp-1540570288.02-200413742597669/pack_ova.py", line 96, in <module> write_disks(ova_path, disks_info.split('+')) File "/root/.ansible/tmp/ansible-tmp-1540570288.02-200413742597669/pack_ova.py", line 79, in write_disks write_disk(ova_path, disk_path, disk_size) File "/root/.ansible/tmp/ansible-tmp-1540570288.02-200413742597669/pack_ova.py", line 59, in write_disk fd = os.open(disk_path, os.O_RDONLY | os.O_DIRECT) OSError: [Errno 13] Permission denied: '/rhev/data-center/mnt/ca-ovmstor101:_export_sanrathi_brml11g04-oVirt-nfs-01/aec73d1f-ea3d-4228-a151-a41b20b6b67b/images/e1186fdb-3fc3-46ae-945c-dd19bb6d434c/d95c52e3-35d1-493e-ab2d-42577bdb0391' I have my storage in NFS . Note: Export to Domain works fine. Thanks in advance .

1 0

No network adapter in fresh pool
by Roman Last 26 Oct '18

26 Oct '18

Hi there! I noticed, that at creating vm pool there is no section about vNIC on new vms, So all new fresh vms create without network intefaces, Is it normal behavior? Cheers!

3 4

[ANN] oVirt 4.2.7 Fifth Release Candidate is now available
by Sandro Bonazzola 26 Oct '18

26 Oct '18

The oVirt Project is pleased to announce the availability of the oVirt 4.2.7 Fifth Release Candidate, as of October 26th, 2018. This update is a release candidate of the seventh in a series of stabilization updates to the 4.2 series. This is pre-release software. This pre-release should not to be used in production. This release is available now for: * Red Hat Enterprise Linux 7.5 or later * CentOS Linux (or similar) 7.5 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.5 or later * CentOS Linux (or similar) 7.5 or later See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is available - oVirt Node is available [2] - oVirt Tools Setup ISO is available[2] Additional Resources: * Read more about the oVirt 4.2.7 release highlights: http://www.ovirt.org/release/4.2.7/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.2.7/ [2] http://resources.ovirt.org/pub/ovirt-4.2-pre/iso/ -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=701f…>

1 0

oVirt Conference 2018 in Milan
by Gianluca Cecchi 25 Oct '18

25 Oct '18

Hi, it's almost time for the annual oVirt Conference in Italy! We will be in Milan on 16th of November. If you are searching an excuse to come to Italy this is a good one; if you are already here you cannot miss it. Moreover, yesterday we had almost 30 degrees in Milan: I don't guarantee for mid November, but with weather and computer science the rule is "Never say Never!"... ;-) More detailed information here: http://www.ovirt-italia.it/2018/10/ovirt-conference-2018.html See (plenty of) you soon! Cheers, Gianluca

1 0

Network interfaces refresh bug.
by Jacob Green 25 Oct '18

25 Oct '18

So we saw a potential bug with the user interface in oVirt 4.2 with the Network Interfaces screen. Screenshot attached. Basically this morning we had a problem with out bond, we replaced the cable and the bond came back up. However the screen in ovirt that shows you this information was reporting that half the bond was down all day, even though at the OS level it was definitely up. It did not come back up until we refreshed the host capabilities. We are currently running oVirt Open Virtualization Manager Software Version 4.2.6.4-1.el7 Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection x 2 on the host. /Note: To be clear, the screenshot I attached is after we refreshed host capabilities so it showing the bond is up 20Gbit/. Thank you. -- Jacob Green Systems Admin American Alloy Steel 713-300-5690

3 4

REST API on Engine
by Vrgotic, Marko 25 Oct '18

25 Oct '18

Dear oVirt team, My project with the company for Operations is a success and department is successfully using oVirt 4.2.6 (started with 4.2.0 this January) platform with SHE and 12 Hypervisors, hooked to GlusterFS distributed-replicated, managed outside of oVirt. It is used for Support of Customers, Projects and Trainings. Thank you oVirt community for such a great platform. In fact, if it going so well that now I have the task to build new platform for Development/Engineering. Since the users foot print is going to grow from 10 to 80 or 120, plus all the automated testing, I am wondering is there a way to make REST API of the Engine in HA/LB mode. For the other services, that is purpose of SHE and DB can always be in clustered mode, but I currently need information if there is something I can do in this direction for REST API. Kindly awaiting your reply. — — — Met vriendelijke groet / Kind regards, Marko Vrgotic Sr. System Engineer m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> tel. +31 (0)35 677 4131 ActiveVideo BV Mediacentrum 3741 Joop van den Endeplein 1 1217 WJ Hilversum

2 2

oVirt hyperconverged via cockpit error
by Jarosław Prokopowski 25 Oct '18

25 Oct '18

Hi, Please help! :-) I couldn't find any solution via google. I followed this document to create oVirt hyperconverged on 3 hosts using cockpit wizard: https://ovirt.org/blog/2018/02/up-and-running-with-ovirt-4-2-and-gluster-st… System: CentOS Linux release 7.5.1804 All hosts can resolve each other names via DNS, ssh keys are exchanged and working. I added firewall rules based on oVirt installation guide. SSH is possible between all hosts using keys. I cannot create the configuration and the error I get in the last step is: ------------------------------------------------------------------------------------------------------ PLAY [gluster_servers] ********************************************************* TASK [Run a shell script] ****************************************************** failed: [bq817storage.example.com] (item=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h bq817storage.example.com, bq735storage.example.com, bq813storage.example.com) => {"item": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h bq817storage.example.com, bq735storage.example.com, bq813storage.example.com", "msg": "Failed to connect to the host via ssh: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).\r\n", "unreachable": true} fatal: [bq817storage.example.com] UNREACHABLE! => {"changed": false, "msg": "All items completed", "results": [{"_ansible_ignore_errors": null, "_ansible_item_label": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h bq817storage.example.com, bq735storage.example.com, bq813storage.example.com", "_ansible_item_result": true, "item": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h bq817storage.example.com, bq735storage.example.com, bq813storage.example.com", "msg": "Failed to connect to the host via ssh: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).\r\n", "unreachable": true}]} to retry, use: --limit @/tmp/tmpYLHDCP/run-script.retry PLAY RECAP ********************************************************************* bq817storage.example.com : ok=0 changed=0 unreachable=1 failed=0 Firewall rules: oVirt engine host: #firewall-cmd --list-all public (active) target: default icmp-block-inversion: no interfaces: enp134s0f0 enp134s0f1 sources: services: ssh dhcpv6-client cockpit glusterfs http https dns ports: 2222/tcp 6100/tcp 7410/udp 54323/tcp 2223/tcp 161/udp 111/tcp 5900-6923/tcp 5989/tcp 9090/tcp 16514/tcp 49152-49216/tcp 54321/tcp 54322/tcp 6081/udp protocols: masquerade: no forward-ports: source-ports: icmp-blocks: rich rules: oVirt nodes: #firewall-cmd --list-all public (active) target: default icmp-block-inversion: no interfaces: enp134s0f0 enp134s0f1 sources: services: ssh dhcpv6-client cockpit glusterfs dns ports: 2223/tcp 161/udp 111/tcp 5900-6923/tcp 5989/tcp 9090/tcp 16514/tcp 49152-49216/tcp 54321/tcp 54322/tcp 6081/udp protocols: masquerade: no forward-ports: source-ports: icmp-blocks: --------------------------------------------------------------------------------- Thanks in advance Jarson

2 8

lvcache on partitioned ssd or only on full device?
by guillaume.pavese＠interact-iv.com 25 Oct '18

25 Oct '18

Hi, If possible, I would like to configure a hyperconverged cluster with hosts' system partitions and the gluster's lvcache on partitions of SSDs in RAID1. Is it possible to define the lvcache on a partitioned device like /dev/sdaX ; or is it only supported to pass a whole device like /dev/sdb ? Thanks for your help

2 2

Question on HA failure scenario
by Alan G 25 Oct '18

25 Oct '18

Hi, I have 4.1 cluster with FC block storage and hosted engine. Last night a host went unreachable due to a driver/firmware issue with the NIC card. The Engine spotted this, the host was fenced and everything behaved as expected. However, it got me thinking - if the affected host had been the one running the Engine, what would have happened? I'm assuming the Engine would have failed liveness check on the other hosted engine hosts and they would attempt to start the Engine. But as the "failed" host still had access to the storage (I believe the HBA was still working) then they would not be able to get a lock on the storage. In which case I'm in a catch-22, the Engine cannot fence the failed host because its network is isolated, but the Engine cannot be restarted else where until the failed host is fenced. At this point it requires human intervention to fence the failed host. Is my understanding correct on this? If so is there any way to mitigate this risk? Thanks, Alan

2 2