[ovirt-users] hosted-engine --deploy --restore-from-file fails on oVirt node 4.5.1.3

I'm running three oVirt 4.5.1.3 nodes with a hosted engine v4.5.1.3. I've installed ovirt node using the iso downloaded from; https://resources.ovirt.org/pub/ovirt-4.5/iso/ovirt-node-ng-installer/4.5... I recently attempted to reinstall the environment using a freshly taken engine backup. After installing a fresh oVirt node, and copying the backup to the node, I ran the command; hosted-engine --deploy --restore-from-file=backup-20220723-2 The problem appears to occur after the engine_setup ansible task starts. Where the error can be seen; [ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret' Since I was unable to get the restore-from-file method to work, I was forced to recreate the environment from scratch. However, I'm concerned that this may continue to be an unaddressed problem going forward. It is quite tedious to recreate all of the cluster resources from scratch. Has anyone attempted a --restore-from-file on oVirt node 4.5.1.3? Have you seen this problem? Were you able to overcome the error? If so, how? Or, did it work for you? Below are the complete log messages from the attempt. ----------- snip ----------- [root@ovirt-node03 ~]# hosted-engine --deploy --restore-from-file=backup-20220723-2 [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup During customization use CTRL-D to abort. Continuing will configure this host for serving as hypervisor and will create a local VM with a running engine. The provided engine backup file will be restored there, it's strongly recommended to run this tool on an host that wasn't part of the environment going to be restored. If a reference to this host is already contained in the backup file, it will be filtered out at restore time. The locally running engine will be used to configure a new storage domain and create a VM there. At the end the disk of the local VM will be moved to the shared storage. The old hosted-engine storage domain will be renamed, after checking that everything is correctly working you can manually remove it. Other hosted-engine hosts have to be reinstalled from the engine to update their hosted-engine configuration. Are you sure you want to continue? (Yes, No)[Yes]: It has been detected that this program is executed through an SSH connection without using tmux. Continuing with the installation may lead to broken installation if the network connection fails. It is highly recommended to abort the installation and run it inside a tmux session using command "tmux". Do you want to continue anyway? (Yes, No)[No]: Yes Configuration files: Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log Version: otopi-1.10.0 (otopi-1.10.0-1.el8) [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== STORAGE CONFIGURATION ==-- --== HOST NETWORK CONFIGURATION ==-- [ INFO ] Bridge ovirtmgmt already created Please indicate the gateway IP address [192.168.1.1]: [ INFO ] Checking available network interfaces: [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] Please indicate a nic to set ovirtmgmt bridge on (enp1s0f0) [enp1s0f0]: Please specify which way the network connectivity should be checked (ping, dns, tcp, none) [dns]: --== VM CONFIGURATION ==-- Please enter the name of the data center where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing data center of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target data center you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Data center: Default Please enter the name of the cluster where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing cluster of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target cluster you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Cluster: Default Renew engine CA on restore if needed? Please notice that if you choose Yes, all hosts will have to be later manually reinstalled from the engine. Renew CA if needed? (Yes, No)[No]: Pause the execution after adding this host to the engine? You will be able to connect to the restored engine in order to manually review and remediate its configuration. This is normally not required when restoring an up to date and coherent backup. Pause after adding the host? (Yes, No)[No]: Configure Keycloak integration on the engine(Yes, No) [Yes]: If you want to deploy with a custom engine appliance image, please specify the path to the OVA archive you would like to use. Entering no value will use the image from the ovirt-engine-appliance rpm, installing it if needed. Appliance image path []: Please specify the number of virtual CPUs for the VM. The default is the appliance OVF value [4]: Please specify the memory size of the VM in MB. The default is the appliance OVF value [16384]: [ INFO ] Detecting host timezone. [ INFO ] Using Engine VM FQDN ovirt-engine.internal.net from backup file. [ INFO ] Using domain name from backup file. Enter root password that will be used for the engine appliance: Confirm appliance root password: You may provide an SSH public key, that will be added by the deployment script to the authorized_keys file of the root user in the engine appliance. This should allow you passwordless login to the engine machine after deployment. If you provide no key, authorized_keys will not be touched. SSH public key []: [WARNING] Skipping appliance root ssh public key Do you want to enable ssh access for the root user? (yes, no, without-password) [yes]: Do you want to apply an OpenSCAP security profile? (Yes, No) [No]: Do you want to enable FIPS? (Yes, No) [No]: Please specify a unicast MAC address for the VM, or accept a randomly generated default [00:16:3e:5c:f2:f7]: How should the engine VM network be configured? (DHCP, Static)[DHCP]: Static Please enter the IP address to be used for the engine VM []: 192.168.1.38 [ INFO ] The engine VM will be configured to use 192.168.1.38/24 Please provide a comma-separated list (max 3) of IP addresses of domain name servers for the engine VM Engine VM DNS (leave it empty to skip) [192.168.1.101]: Add lines for the appliance itself and for this host to /etc/hosts on the engine VM? Note: ensuring that this host could resolve the engine VM hostname is still up to you. Add lines to /etc/hosts? (Yes, No)[Yes]: --== HOSTED ENGINE CONFIGURATION ==-- Please provide the name of the SMTP server through which we will send notifications [localhost]: Please provide the TCP port number of the SMTP server [25]: Please provide the email address from which notifications will be sent [root@localhost]: Please provide a comma-separated list of email addresses which will get notifications [root@localhost]: Enter engine admin password: Confirm engine admin password: [ INFO ] Stage: Setup validation Please provide the hostname of this host on the management network [ovirt-node03.internal.net]: [ INFO ] Stage: Transaction setup [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up [ INFO ] Cleaning previous attempts [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] Starting local VM [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check IPv6] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv4 route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv6 route] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse libvirt default network configuration] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set network_dict from default_net_xml] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create he-network-config.xml from network-config.j2 template] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, destroy] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, undefine] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, define] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv6] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save bridge name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the bridge to appear on the host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Accept IPv6 Router Advertisements for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Refresh network facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv4 CIDR for virbr0] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv6 CIDR for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 outbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 inbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 outbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 inbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host unique id] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create directory for local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local vm dir path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install ovirt-engine-appliance rpm] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for path] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for sha1sum] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get OVA path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compute sha1sum] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compare sha1sum] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register appliance PATH] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check available space on local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check appliance size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure we have enough space to extract the appliance] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance disk size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse qemu-img output] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Hash the appliance root password] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create cloud init user-data and meta-data files] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create ISO disk] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fix local VM directory permission] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get local VM IP] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove leftover entries in /etc/hosts for the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create an entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for SSH to restart on the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the local VM] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add an entry for this host on /etc/hosts on the local VM] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set FQDN] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force the local VM FQDN to temporary resolve on the natted network address] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reconfigure IPv6 default gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore sshd reverse DNS lookups] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add keycloak line to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance distribution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set appliance distribution variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Initialize OpenSCAP variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP datastream path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify OpenSCAP datastream] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Apply OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reset PermitRootLogin for sshd] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enable FIPS on the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reboot the engine VM to apply security rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if FIPS mode is enabled] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce FIPS mode] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include before engine-setup custom tasks files for the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy the backup file to the engine VM for restore] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Run engine-backup] [ INFO ] engine-backup --mode=restore failed: FATAL: Backup was created by version '4.5.1.3' and can not be restored using the installed version 4.5.0.8 You can now connect from this host to the bootstrap engine VM using ssh as root and the temporary IP address - 192.168.2.138 - and fix this issue. Please continue only after the backup is restored. To retry the command that failed, you can run, on the bootstrap engine VM: engine-backup --mode=restore --file=/root/engine_backup --provision-all-databases --restore-permissions [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create temporary lock file] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Pause execution until /tmp/ansible.b87cf_ef_he_setup_lock is removed, delete it once ready to proceed] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove backup file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove previous hosted-engine VM] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs on the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs migrating to the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Rename previous HE storage domain to avoid name conflicts] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save original DisableFenceAtStartupInSec] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update DisableFenceAtStartupInSec to prevent host fencing during the recovery] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to engine-setup answerfile for PKI renewal] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : remove version lock from the engine] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : recreate versionlock empty file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Perform pre-install checks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Gather facts on installed packages] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Fail when firewall manager is not installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install required packages for oVirt Engine deployment] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install oVirt Engine package] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Check if rhevm package is installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install RHV package] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install rest of the packages required for oVirt Engine deployment] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine setup] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set answer file path] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use the default answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy custom answer file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use remote's answer file] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update setup packages] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy yum configuration file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set 'best' to false] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update all packages] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Remove temporary yum configuration file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set offline parameter if variable is set] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Restore engine from file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine-setup with answerfile] [ ERROR ] fatal: [localhost -> 192.168.2.138]: FAILED! => {"changed": true, "cmd": ["engine-setup", "--accept-defaults", "--config-append=/root/ovirt-engine-answers"], "delta": "0:00:22.689366", "end": "2022-07-23 23:02:44.093812", "msg": "non-zero return code", "rc": 1, "start": "2022-07-23 23:02:21.404446", "stderr": "", "stderr_lines": [], "stdout": "[ INFO ] Stage: Initializing\n[ INFO ] Stage: Environment setup\n Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers\n Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n Version: otopi-1.10.0 (otopi-1.10.0-1.el8)\n[ INFO ] Stage: Environment packages setup\n[ INFO ] Stage: Programs detection\n[ INFO ] Stage: Environment setup (late)\n[ INFO ] Stage: Environment customization\n \n --== PRODUCT OP TIONS ==--\n \n[ INFO ] ovirt-provider-ovn already installed, skipping.\n \n --== PACKAGES ==--\n \n[ INFO ] Checking for product updates...\n[ INFO ] No product updates found\n \n --== NETWORK CONFIGURATION ==--\n \n[ INFO ] firewalld will be configured as firewall manager.\n \n --== DATABASE CONFIGURATION ==--\n \n Where is the Keycloak database located? (Local, Remote) [Local]: \n \n Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.\n Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: \n The detected DWH database size is 188.18833827972412 MB.\n Setup can backup the existing database. The time and space required for the database backup depend on its size. This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.\n If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.\n Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: \n Perform full vacuum on the oVirt engine history\n database ovirt_engine_history@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process.\n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n \n --== OVIRT ENGINE CONFIGURATION ==--\n \n Perform full vacuum on the engine database engine@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process. \n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: \n \n --== STORAGE CONFIGURATION ==--\n \n \n --== PKI CONFIGURATION ==--\n \n \n --== APACHE CONFIGURATION ==--\n \n \n --== SYSTEM CONFIGURATION ==--\n \n \n --== MISC CONFIGURATION ==--\n \n \n --== END OF CONFIGURATION ==--\n \n[ INFO ] Stage: Setup validation\n During execution engine service will be stopped (OK, Cancel) [OK]: \n[ INFO ] Cleaning stale zombie tasks and commands\n \n --== CONFIGURATION PREVIEW ==--\n \n Application mode : both\n Default SAN wipe after delete : False\n Host FQDN : ovirt-engine.internal.net\n Firewall manager : firewalld\n Update Firewall : True\n Set up Cinderlib integration : False\n Configure local Engine database : True\n Set application as default page : True\n Configure Apache SSL : True\n Keycloak installation : True\n Engine database host : localhost\n Engine database port : 5432\n Engine database secured connection : False\n Engine database host name validation : False\n Engine database name : engine\n Engine database user name : engine\n Engine installation : True\n PKI organization : internal.net\n Renew PKI : Fa lse\n Set up ovirt-provider-ovn : True\n Grafana integration : True\n Grafana database user name : ovirt_engine_history_grafana\n Keycloak database host : localhost\n Keycloak database port : 5432\n Configure local Keycloak database : True\n Configure VMConsole Proxy : True\n Configure WebSocket Proxy : True\n DWH installation : True\n DWH database host : localhost\n DWH database port : 5432\n DWH database secured connection : False\n DWH database host name validation : False\n DWH database name : ovirt_engine_history\n DWH database user name : ovirt_engine_history\n Backup DWH database : Tr ue\n Configure local DWH database : True\n[ INFO ] Cleaning async tasks and compensations\n[ INFO ] Unlocking existing entities\n[ INFO ] Checking the Engine database consistency\n[ INFO ] Stage: Transaction setup\n[ INFO ] Stopping engine service\n[ INFO ] Stopping ovirt-fence-kdump-listener service\n[ INFO ] Stopping dwh service\n[ INFO ] Stopping vmconsole-proxy service\n[ INFO ] Stopping websocket-proxy service\n[ INFO ] Stopping service: grafana-server\n[ INFO ] Stage: Misc configuration (early)\n[ INFO ] Stage: Package installation\n[ INFO ] Stage: Misc configuration\n[ INFO ] Upgrading CA\n[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database\n[ INFO ] Configuring PostgreSQL\n[ INFO ] Creating a user for Grafana\n[ INFO ] Updating OVN SSL configuration\n[ INFO ] Updating OVN timeout configuration\n[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'\n[ INFO ] DNF Performing DNF transactio n rollback\n[ INFO ] Stage: Clean up\n Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'\n[ INFO ] Stage: Pre-termination\n[ INFO ] Stage: Termination\n[ ERROR ] Execution of setup failed", "stdout_lines": ["[ INFO ] Stage: Initializing", "[ INFO ] Stage: Environment setup", " Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers", " Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", " Version: otopi-1.10.0 (otopi-1.10.0-1.el8)", "[ INFO ] Stage: Environment packages setup", "[ INFO ] Stage: Programs detection", "[ INFO ] Stage: Environment setup (late)", "[ INFO ] Stage: Environment customization", " ", " --== PRODUCT OPTIONS ==--", " ", "[ INFO ] ovirt-provider-ovn already installed, skipping.", " ", " --== PACKAGES ==--", " ", "[ INFO ] Checking for product updates...", "[ INFO ] No product updates found", " ", " --== NETWORK CONFIGURATION ==--", " ", "[ INFO ] firewalld will be configured as firewall manager.", " ", " --== DATABASE CONFIGURATION ==--", " ", " Where is the Keycloak database located? (Local, Remote) [Local]: ", " ", " Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.", " Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: ", " The detected DWH database size is 188.18833827972412 MB.", " Setup can backup the existing database. The time and space required for the database backup depend on its size. This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.", " If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.", " Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: ", " Perform full vacuum on the oVirt engine history", " database ovirt_engine_history@localhost?", " This operation may take a while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html";, " (Yes, No) [No]: ", " ", " --== OVIRT ENGINE CONFIGURATION ==--", " ", " Perform full vacuum on the engine database engine@localhost?", " This operation may take a while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html";, " (Yes, No) [No]: ", " Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: ", " ", " --== STORAGE CONFIGURATION ==--", " ", " ", " --== PKI CONFIGURATION ==--", " ", " ", " --== APACHE CONFIGURATION ==--", " ", " ", " --== SYSTEM CONFIGURATION ==--", " ", " ", " --== MISC CONFIGURATION ==--", " ", " ", " --== END OF CONFIGURATION ==--", " ", "[ INFO ] Stage: Setup validation", " During execution engine service will be stopped (OK, Cancel) [OK]: ", "[ INFO ] Cleaning stale zombie tasks and commands", " ", " --== CONFIGURATION PREVIEW ==--", " ", " Application mode : both", " Default SAN wipe after delete : False", " Host FQDN : ovirt-engine.internal.net", " Firewall manager : firewalld", " Update Firewall : True", " Set up Cinderlib integration : False", " Configure local Engine database : True", " Set application as default page : True", " Configure Apache SSL : True", " Keycloak installation : True", " Engine database host : localhost", " Engine database port : 5432", " Engine database secured connection : False", " Engine database host name validation : False", " Engine database name : engine", " Engine database user name : eng ine", " Engine installation : True", " PKI organization : internal.net", " Renew PKI : False", " Set up ovirt-provider-ovn : True", " Grafana integration : True", " Grafana database user name : ovirt_engine_history_grafana", " Keycloak database host : localhost", " Keycloak database port : 5432", " Configure local Keycloak database : True", " Configure VMConsole Proxy : True", " Configure WebSocket Proxy : True", " DWH installation : True", " DWH database host : localhost", " DWH database port : 5432", " DWH database secured connection : False", " DWH database host name validation : False", " DWH database name : ovirt_engine_history", " DWH database user name : ovirt_engine_history", " Backup DWH database : True", " Configure local DWH database : True", "[ INFO ] Cleaning async tasks and compensations", "[ INFO ] Unlocking existing entities", "[ INFO ] Checking the Engine database consistency", "[ INFO ] Stage: Transaction setup", "[ INFO ] Stopping engine service", "[ INFO ] Stopping ovirt-fence-kdump-listener service", "[ INFO ] Stopping dwh service", "[ INFO ] Stopping vmconsole-proxy service", "[ INFO ] Stopping websocket-proxy service", "[ INFO ] Stopping service: grafana-server", "[ INFO ] Stage: Misc configuration (early)", "[ INFO ] Stage: Package installation", "[ INFO ] Stage: Misc configuration", "[ INFO ] Upgrading CA", "[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database", "[ INFO ] Configuring PostgreSQL", "[ IN FO ] Creating a user for Grafana", "[ INFO ] Updating OVN SSL configuration", "[ INFO ] Updating OVN timeout configuration", "[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'", "[ INFO ] DNF Performing DNF transaction rollback", "[ INFO ] Stage: Clean up", " Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", "[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'", "[ INFO ] Stage: Pre-termination", "[ INFO ] Stage: Termination", "[ ERROR ] Execution of setup failed"]} [ INFO ] TASK [ovirt.ovirt.engine_setup : Clean temporary files] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Notify the user about a failure] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "There was a failure deploying the engine on the local engine VM. The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Clean local storage pools] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool localvmnyhvqs4j] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool localvmnyhvqs4j] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1] [ INFO ] changed: [localhost] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20220723230336.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log