[ovirt-users] Re: hosted-engine --deploy --restore-from-file fails on oVirt node 4.5.1.3

I'm unable to recreate the original problem. The good news is, the process moves past the engine_setup now. The ovirt-engine server actually starts, and is exposed on https://<ovirthost>:6900/ovirt-engine The bad news is, when I try to access the engine Web UI at that URL, I get a '500 Internal Server Error'. I don't see any obvious errors in the log files in /var/log/ovirt-engine I'm able to access the URL https://<ovirthost>:6900/ovirt-engine However, as soon as I click the "Administration Portal" link on the main page, I see the '500 Internal Server Error' I do notice the following error in /var/log/httpd/ssl_error_log; [Sat Aug 06 18:45:32.106641 2022] [auth_openidc:error] [pid 1648:tid 139896547178240] [client 192.168.222.3:58098] oidc_authenticate_user: the URL hostname (ovirt-engine.internal.net) of the configured OIDCRedirectURI does not match the URL hostname of the URL being accessed (ovirt-node04.internal.net): the "state" and "session" cookies will not be shared between the two!, referer: https://ovirt-node04.internal.net:6900/ovirt-engine/ The error above would suggest that it will not be possible to access the engine Web UI which is temporarily exposed on port 6900. How has this ever been possible in the past? What do I need to do in order to access the engine Web UI, since I need to configure the hosts's network to include several VLANs necessary to complete the restore of the engine DB? Prior to the above... I took a fresh backup of the ovirt engine. Set up a fresh/new ovirt node. Copied the backup to the new node. I ran the 'hosted-engine --deploy --restore-from-file=<filename>' command. Below are the complete messages of that attempt, up to the point I get the '500 Internal Server' error in the browser. ----------- snip ----------- [root@ovirt-node04 ~]# hosted-engine --deploy --restore-from-file=20220806-all [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup During customization use CTRL-D to abort. Continuing will configure this host for serving as hypervisor and will create a local VM with a running engine. The provided engine backup file will be restored there, it's strongly recommended to run this tool on an host that wasn't part of the environment going to be restored. If a reference to this host is already contained in the backup file, it will be filtered out at restore time. The locally running engine will be used to configure a new storage domain and create a VM there. At the end the disk of the local VM will be moved to the shared storage. The old hosted-engine storage domain will be renamed, after checking that everything is correctly working you can manually remove it. Other hosted-engine hosts have to be reinstalled from the engine to update their hosted-engine configuration. Are you sure you want to continue? (Yes, No)[Yes]: It has been detected that this program is executed through an SSH connection without using tmux. Continuing with the installation may lead to broken installation if the network connection fails. It is highly recommended to abort the installation and run it inside a tmux session using command "tmux". Do you want to continue anyway? (Yes, No)[No]: Yes Configuration files: Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220806160814-wehm0s.log Version: otopi-1.10.0 (otopi-1.10.0-1.el8) [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== STORAGE CONFIGURATION ==-- --== HOST NETWORK CONFIGURATION ==-- [ INFO ] Bridge ovirtmgmt already created Please indicate the gateway IP address [192.168.1.1]: [ INFO ] Checking available network interfaces: [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] Please indicate a nic to set ovirtmgmt bridge on (enp2s0f0) [enp2s0f0]: Please specify which way the network connectivity should be checked (ping, dns, tcp, none) [dns]: --== VM CONFIGURATION ==-- Please enter the name of the data center where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing data center of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target data center you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Data center: Default Please enter the name of the cluster where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing cluster of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target cluster you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Cluster: Default Renew engine CA on restore if needed? Please notice that if you choose Yes, all hosts will have to be later manually reinstalled from the engine. Renew CA if needed? (Yes, No)[No]: Pause the execution after adding this host to the engine? You will be able to connect to the restored engine in order to manually review and remediate its configuration. This is normally not required when restoring an up to date and coherent backup. Pause after adding the host? (Yes, No)[No]: Yes Configure Keycloak integration on the engine(Yes, No) [Yes]: Yes If you want to deploy with a custom engine appliance image, please specify the path to the OVA archive you would like to use. Entering no value will use the image from the ovirt-engine-appliance rpm, installing it if needed. Appliance image path []: Please specify the number of virtual CPUs for the VM. The default is the appliance OVF value [4]: Please specify the memory size of the VM in MB. The default is the appliance OVF value [16384]: [ INFO ] Detecting host timezone. [ INFO ] Using Engine VM FQDN ovirt-engine.internal.net from backup file. [ INFO ] Using domain name from backup file. Enter root password that will be used for the engine appliance: Confirm appliance root password: You may provide an SSH public key, that will be added by the deployment script to the authorized_keys file of the root user in the engine appliance. This should allow you passwordless login to the engine machine after deployment. If you provide no key, authorized_keys will not be touched. SSH public key []: [WARNING] Skipping appliance root ssh public key Do you want to enable ssh access for the root user? (yes, no, without-password) [yes]: Do you want to apply an OpenSCAP security profile? (Yes, No) [No]: Do you want to enable FIPS? (Yes, No) [No]: Please specify a unicast MAC address for the VM, or accept a randomly generated default [00:16:3e:55:27:66]: How should the engine VM network be configured? (DHCP, Static)[DHCP]: Static Please enter the IP address to be used for the engine VM []: 192.168.1.38 [ INFO ] The engine VM will be configured to use 192.168.1.38/24 Please provide a comma-separated list (max 3) of IP addresses of domain name servers for the engine VM Engine VM DNS (leave it empty to skip) [192.168.1.101]: Add lines for the appliance itself and for this host to /etc/hosts on the engine VM? Note: ensuring that this host could resolve the engine VM hostname is still up to you. Add lines to /etc/hosts? (Yes, No)[Yes]: --== HOSTED ENGINE CONFIGURATION ==-- Please provide the name of the SMTP server through which we will send notifications [localhost]: Please provide the TCP port number of the SMTP server [25]: Please provide the email address from which notifications will be sent [root@localhost]: Please provide a comma-separated list of email addresses which will get notifications [root@localhost]: Enter engine admin password: Confirm engine admin password: [ INFO ] Stage: Setup validation Please provide the hostname of this host on the management network [ovirt-node04.internal.net]: [ INFO ] Stage: Transaction setup [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up [ INFO ] Cleaning previous attempts [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] Starting local VM [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check IPv6] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv4 route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv6 route] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse libvirt default network configuration] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set network_dict from default_net_xml] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create he-network-config.xml from network-config.j2 template] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, destroy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, undefine] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, define] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv6] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save bridge name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the bridge to appear on the host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Accept IPv6 Router Advertisements for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Refresh network facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv4 CIDR for virbr0] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv6 CIDR for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 outbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 inbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 outbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 inbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host unique id] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create directory for local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local vm dir path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install ovirt-engine-appliance rpm] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for path] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for sha1sum] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get OVA path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compute sha1sum] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compare sha1sum] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register appliance PATH] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check available space on local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check appliance size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure we have enough space to extract the appliance] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance disk size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse qemu-img output] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Hash the appliance root password] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create cloud init user-data and meta-data files] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create ISO disk] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fix local VM directory permission] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get local VM IP] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove leftover entries in /etc/hosts for the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create an entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for SSH to restart on the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the local VM] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add an entry for this host on /etc/hosts on the local VM] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set FQDN] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force the local VM FQDN to temporary resolve on the natted network address] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reconfigure IPv6 default gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore sshd reverse DNS lookups] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add keycloak line to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance distribution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set appliance distribution variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Initialize OpenSCAP variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP datastream path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify OpenSCAP datastream] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Apply OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reset PermitRootLogin for sshd] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enable FIPS on the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reboot the engine VM to apply security rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if FIPS mode is enabled] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce FIPS mode] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include before engine-setup custom tasks files for the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy the backup file to the engine VM for restore] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Run engine-backup] [ INFO ] engine-backup --mode=restore failed: FATAL: Backup was created by version '4.5.1.3' and can not be restored using the installed version 4.5.0.8 You can now connect from this host to the bootstrap engine VM using ssh as root and the temporary IP address - 192.168.222.3 - and fix this issue. Please continue only after the backup is restored. To retry the command that failed, you can run, on the bootstrap engine VM: engine-backup --mode=restore --file=/root/engine_backup --provision-all-databases --restore-permissions [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create temporary lock file] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Pause execution until /tmp/ansible.a97mneg1_he_setup_lock is removed, delete it once ready to proceed] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove backup file] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove previous hosted-engine VM] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs on the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs migrating to the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove host used to redeploy] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Rename previous HE storage domain to avoid name conflicts] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save original DisableFenceAtStartupInSec] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update DisableFenceAtStartupInSec to prevent host fencing during the recovery] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to engine-setup answerfile for PKI renewal] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : remove version lock from the engine] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : recreate versionlock empty file] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Perform pre-install checks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Gather facts on installed packages] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Fail when firewall manager is not installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install required packages for oVirt Engine deployment] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install oVirt Engine package] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Check if rhevm package is installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install RHV package] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install rest of the packages required for oVirt Engine deployment] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine setup] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set answer file path] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use the default answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy custom answer file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use remote's answer file] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update setup packages] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy yum configuration file] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set 'best' to false] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update all packages] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Remove temporary yum configuration file] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set offline parameter if variable is set] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Restore engine from file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine-setup with answerfile] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Make sure `ovirt-engine` service is running] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine-config] [ INFO ] TASK [ovirt.ovirt.engine_setup : Restart engine after engine-config] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Check if Engine health page is up] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.engine_setup : Clean temporary files] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include after engine-setup custom tasks files for the engine VM] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the engine to reach a stable condition] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Configure LibgfApi support] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save original OvfUpdateIntervalInMinutes] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OVF update interval to 1 minute] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Saving original value] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Adding new SSO_ALTERNATE_ENGINE_FQDNS line] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart ovirt-engine service for changed OVF Update configuration and LibgfApi support] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Mask cloud-init services to speed up future boot] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if keycloak is configured] [ INFO ] changed: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set admin username] [ INFO ] ok: [localhost -> 192.168.222.3] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for ovirt-engine service to start] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Open a port on firewalld] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Expose engine VM webui over a local port via ssh port forwarding] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Evaluate temporary bootstrap engine VM URL] [ INFO ] ok: [localhost] [ INFO ] The bootstrap engine is temporarily accessible via https://ovirt-node04.internal.net:6900/ovirt-engine/ [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detect VLAN ID] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Engine public key as authorized key without validating the TLS/SSL certificates] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure that the target datacenter is present] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure that the target cluster is present in the target datacenter] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check actual cluster location] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enable GlusterFS at cluster level] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set VLAN ID at datacenter level] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get active list of active firewalld zones] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Configure libvirt firewalld zone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reload firewall-cmd] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include after_add_host tasks files] [ INFO ] You can now connect to https://ovirt-node04.internal.net:6900/ovirt-engine/ and check the status of this host and eventually remediate it, please continue only when the host is listed as 'up' [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create temporary lock file] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Pause execution until /tmp/ansible.fziqboj0_he_setup_lock is removed, delete it once ready to proceed] taking a new backup, and setting up a new ovirt host