- Users - oVirt List Archives

Certificates Expiration Problem - Urgent Help Needed
by Andrei Verovski 09 Aug '22

09 Aug '22

Hi ! Today my hosts (engine + all nodes) certificates expired and I re-run engine-setup to renew certificates. Then I did for each node host: Edit host -> Advanced parameters -> Fetch SSH public key (PEM) in order to update certificates on nodes, everything was finished just fine. Unfortunately, one of the most crucial nodes (node14) still shows this error: VDSM node14 command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed Restarted vdsms and vdsm-network, still same, node is marked as non-responsive, and all VM with "?" sign (unknown status). However, node14 pings without any problem, its storage domain shown in green (OK), and all VMs are running fine. Service vdsm-network status is OK, vdsmd is NOT: Aug 08 22:07:27 node14.***.lv vdsm[1264164]: ERROR ssl handshake: socket error, address: ::ffff:192.168.0.4 This node is running our accounting and stock control system, its storage domain holds VM disk of that software. If its nonoperational after restart, its a BIG trouble, I will not be able to migrate VM disk anywhere. Restoring accounting DB from daily backup is a lengthy process for 2 - 3 hours. Please advice what to do next. Thanks in advance.

2 4

Q: How to fix ghost "locked" status of VM
by Andrei Verovski 08 Aug '22

08 Aug '22

Hi, Creating snapshot of one of the VM vailed, and zombie tasks was killed with: su postgres psql -d engine -U postgres select * from job order by start_time desc; select DeleteJob('UUID_FROZEN_TASK_ID’); However, VM remains in locked state (with lock sign left-below red “DOWN” arrow in status column of web interface. I run: /usr/share/ovirt-engine/setup/dbutils/unlock_entity.sh -t all then rebooted engine VM, still no luck. Can’t do anything with that VM. Please advise how to fix. Thanks in advance.

3 14

Re: Q: How to fix ghost "locked" status of VM
by Andrei Verovski 08 Aug '22

08 Aug '22

> On 8 Aug 2022, at 09:52, Jirka Simon <jirka(a)vesim.cz> wrote: > > Hi Benny, Andrei. > > do you have any news? I deleted frozen task and locked snapshot and disk on Friday and during the weekend everything worked fine. (there were 3 snapshots and backups from Friday to now.) Deleting zombie task from Postgresql didn’t help. > > Thank you > > Jirka > > On 8/5/22 11:53, Benny Zlotnik wrote: >> Jirka, I suppose your issue is different than Anderi's no? >> >> In your log I see the command has failed: >> 2022-08-05 10:26:57,741+02 INFO >> [org.ovirt.engine.core.bll.VirtJobCallback] >> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) >> [8ff04bca-b5a2-4ba3-892 >> 5-1037c5a2850e] Command CreateLiveSnapshotForVm id: >> '2f94c337-487e-40f7-b8f8-df69225d5c79': execution was completed, the >> command status is 'FAILED' >> 2022-08-05 10:26:58,742+02 ERROR >> [org.ovirt.engine.core.bll.snapshots.CreateLiveSnapshotForVmCommand] >> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35 >> ) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command >> 'org.ovirt.engine.core.bll.snapshots.CreateLiveSnapshotForVmCommand' >> with failure. >> 2022-08-05 10:26:59,796+02 INFO >> [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] >> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-31) >> [8 >> ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command 'CreateSnapshotForVm' id: >> '93f98c9c-2936-4615-b12e-c295b90eace0' child commands >> '[2f94c337-487e-40f7-b8f8-df69225d5c79, 1b3abc1e >> -f0c1-40f7-b52e-f7df52c52601]' executions were completed, status 'FAILED' >> 2022-08-05 10:27:00,826+02 ERROR >> [org.ovirt.engine.core.bll.snapshots.CreateSnapshotForVmCommand] >> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-4) >> [8f >> f04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command >> 'org.ovirt.engine.core.bll.snapshots.CreateSnapshotForVmCommand' with >> failure. >> 2022-08-05 10:27:00,829+02 ERROR >> [org.ovirt.engine.core.bll.snapshots.CreateSnapshotDiskCommand] >> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-4) >> [8ff >> 04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command >> 'org.ovirt.engine.core.bll.snapshots.CreateSnapshotDiskCommand' with >> failure. >> >> Generally, live snapshot has a default 30 minute timeout to complete >> and it looks like it was reached in your case, I don't see a command >> that's still running >> >> On Fri, Aug 5, 2022 at 12:36 PM Jirka Simon <jirka(a)vesim.cz> wrote: >>> Hi Benny , Andrei, >>> >>> >>> here are my logs >>> >>> >>> affected job was " waiting for job '6e73cda8-85d0-471c-b090-4c89719a97f4' on host 'ovirt3.corp.sldev.cz' " >>> >>> thank you >>> >>> >>> Jirka >>> >>> On 8/5/22 11:00, Andrei Verovski wrote: >>> >>> Hi, >>> >>> I have e-mailed vdsm log to Benny. >>> Unfortunately, yesterday I deleted engine.log before restarting engine to have more shorter log. >>> >>> Jirka, can you e-mail engine.log and vdsm logs (SPM at the time and the host >>> running the VM) to Benny? >>> >>> >>> On 5 Aug 2022, at 11:42, Jirka Simon <jirka(a)vesim.cz> wrote: >>> >>> Hi Benny, so we have the same problem last 2 days. >>> >>> there are two affected VMs (furtunately not more) and we cant start any snapshot for these VMS. >>> >>> it looks that the snapshot haven't start yet , then to unlock objects (snapshot and disk) shouldn't damage disk (i tried it on both VMS), then i restarted them and VMS run again. I made clone from one of them ant the clone works properly. >>> >>> >>> Jirka >>> >>> On 8/5/22 10:34, Benny Zlotnik wrote: >>> >>> So based on your logs the lock you are seeing is a memory lock, >>> unlock_entity.sh can't really help with these. >>> Also, the job table is used mainly for presentation so removing an >>> entry from will not help. >>> >>> Do you have the logs from when this snapshot operation started, you >>> can use the correlation id (28353fa0-5e36-4fe8-8609-e74cd1da6d36) to >>> search? Also, do you have the vdsm logs (SPM at the time and the host >>> running the VM), same correlation id can be used for this as well >>> >>> The table that's used to coordinate this is command_entities, so in >>> theory removing the entries with this correlation id can help, but I'd >>> like to see what led to this first >>> >>> On Fri, Aug 5, 2022 at 8:37 AM Andrei Verovski <andreil1(a)starlett.lv> wrote: >>> >>> Hi, Benny, >>> >>> I have sent log on your mailbox, its too big to post here on mailing list. >>> >>> Looks like ghost task is still running, anything else need to be removed from Postgres DB? >>> >>> BTW, frozen dead snapshot is in invalid state, is there any way to get rid of it? I think it's actually exists, but due to invalid state its not possible to do anything with it. >>> >>> >>> —— >>> >>> Log file still shows zombie task: >>> >>> 2022-08-04 20:57:30,145+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-24) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete >>> 2022-08-04 20:57:40,176+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-85) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete >>> 2022-08-04 20:57:50,252+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-66) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete >>> >>> >>> On 4 Aug 2022, at 19:06, Benny Zlotnik <bzlotnik(a)redhat.com> wrote: >>> >>> can you share the logs after restarting ovirt-engine? >>> >>> On Thu, Aug 4, 2022 at 4:58 PM Andrei Verovski <andreil1(a)starlett.lv> wrote: >>> >>> Hi, >>> >>> >>> Creating snapshot of one of the VM vailed, and zombie tasks was killed with: >>> >>> su postgres >>> psql -d engine -U postgres >>> select * from job order by start_time desc; >>> >>> select DeleteJob('UUID_FROZEN_TASK_ID’); >>> >>> >>> However, VM remains in locked state (with lock sign left-below red “DOWN” arrow in status column of web interface. >>> >>> I run: >>> /usr/share/ovirt-engine/setup/dbutils/unlock_entity.sh -t all >>> >>> then rebooted engine VM, still no luck. Can’t do anything with that VM. >>> >>> Please advise how to fix. >>> Thanks in advance. >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/privacy-policy.html >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/P2TVMLHC53JWC… >>> >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/privacy-policy.html >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ILYSLIM7UNRU3…

1 0

hosted-engine --deploy --restore-from-file fails on oVirt node 4.5.1.3
by P F 08 Aug '22

08 Aug '22

I'm running three oVirt 4.5.1.3 nodes with a hosted engine v4.5.1.3. I've installed ovirt node using the iso downloaded from; https://resources.ovirt.org/pub/ovirt-4.5/iso/ovirt-node-ng-installer/4.5.1… I recently attempted to reinstall the environment using a freshly taken engine backup. After installing a fresh oVirt node, and copying the backup to the node, I ran the command; hosted-engine --deploy --restore-from-file=backup-20220723-2 The problem appears to occur after the engine_setup ansible task starts. Where the error can be seen; [ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret' Since I was unable to get the restore-from-file method to work, I was forced to recreate the environment from scratch. However, I'm concerned that this may continue to be an unaddressed problem going forward. It is quite tedious to recreate all of the cluster resources from scratch. Has anyone attempted a --restore-from-file on oVirt node 4.5.1.3? Have you seen this problem? Were you able to overcome the error? If so, how? Or, did it work for you? Below are the complete log messages from the attempt. ----------- snip ----------- [root@ovirt-node03 ~]# hosted-engine --deploy --restore-from-file=backup-20220723-2 [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup During customization use CTRL-D to abort. Continuing will configure this host for serving as hypervisor and will create a local VM with a running engine. The provided engine backup file will be restored there, it's strongly recommended to run this tool on an host that wasn't part of the environment going to be restored. If a reference to this host is already contained in the backup file, it will be filtered out at restore time. The locally running engine will be used to configure a new storage domain and create a VM there. At the end the disk of the local VM will be moved to the shared storage. The old hosted-engine storage domain will be renamed, after checking that everything is correctly working you can manually remove it. Other hosted-engine hosts have to be reinstalled from the engine to update their hosted-engine configuration. Are you sure you want to continue? (Yes, No)[Yes]: It has been detected that this program is executed through an SSH connection without using tmux. Continuing with the installation may lead to broken installation if the network connection fails. It is highly recommended to abort the installation and run it inside a tmux session using command "tmux". Do you want to continue anyway? (Yes, No)[No]: Yes Configuration files: Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log Version: otopi-1.10.0 (otopi-1.10.0-1.el8) [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== STORAGE CONFIGURATION ==-- --== HOST NETWORK CONFIGURATION ==-- [ INFO ] Bridge ovirtmgmt already created Please indicate the gateway IP address [192.168.1.1]: [ INFO ] Checking available network interfaces: [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] Please indicate a nic to set ovirtmgmt bridge on (enp1s0f0) [enp1s0f0]: Please specify which way the network connectivity should be checked (ping, dns, tcp, none) [dns]: --== VM CONFIGURATION ==-- Please enter the name of the data center where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing data center of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target data center you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Data center: Default Please enter the name of the cluster where you want to deploy this hosted-engine host. Please note: If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing cluster of HostedEngine. If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. If you are migrating from a standalone engine to a hosted-engine, this value should be the target cluster you wish to add the HostedEngine VM and this host to. The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct. Cluster: Default Renew engine CA on restore if needed? Please notice that if you choose Yes, all hosts will have to be later manually reinstalled from the engine. Renew CA if needed? (Yes, No)[No]: Pause the execution after adding this host to the engine? You will be able to connect to the restored engine in order to manually review and remediate its configuration. This is normally not required when restoring an up to date and coherent backup. Pause after adding the host? (Yes, No)[No]: Configure Keycloak integration on the engine(Yes, No) [Yes]: If you want to deploy with a custom engine appliance image, please specify the path to the OVA archive you would like to use. Entering no value will use the image from the ovirt-engine-appliance rpm, installing it if needed. Appliance image path []: Please specify the number of virtual CPUs for the VM. The default is the appliance OVF value [4]: Please specify the memory size of the VM in MB. The default is the appliance OVF value [16384]: [ INFO ] Detecting host timezone. [ INFO ] Using Engine VM FQDN ovirt-engine.internal.net from backup file. [ INFO ] Using domain name from backup file. Enter root password that will be used for the engine appliance: Confirm appliance root password: You may provide an SSH public key, that will be added by the deployment script to the authorized_keys file of the root user in the engine appliance. This should allow you passwordless login to the engine machine after deployment. If you provide no key, authorized_keys will not be touched. SSH public key []: [WARNING] Skipping appliance root ssh public key Do you want to enable ssh access for the root user? (yes, no, without-password) [yes]: Do you want to apply an OpenSCAP security profile? (Yes, No) [No]: Do you want to enable FIPS? (Yes, No) [No]: Please specify a unicast MAC address for the VM, or accept a randomly generated default [00:16:3e:5c:f2:f7]: How should the engine VM network be configured? (DHCP, Static)[DHCP]: Static Please enter the IP address to be used for the engine VM []: 192.168.1.38 [ INFO ] The engine VM will be configured to use 192.168.1.38/24 Please provide a comma-separated list (max 3) of IP addresses of domain name servers for the engine VM Engine VM DNS (leave it empty to skip) [192.168.1.101]: Add lines for the appliance itself and for this host to /etc/hosts on the engine VM? Note: ensuring that this host could resolve the engine VM hostname is still up to you. Add lines to /etc/hosts? (Yes, No)[Yes]: --== HOSTED ENGINE CONFIGURATION ==-- Please provide the name of the SMTP server through which we will send notifications [localhost]: Please provide the TCP port number of the SMTP server [25]: Please provide the email address from which notifications will be sent [root@localhost]: Please provide a comma-separated list of email addresses which will get notifications [root@localhost]: Enter engine admin password: Confirm engine admin password: [ INFO ] Stage: Setup validation Please provide the hostname of this host on the management network [ovirt-node03.internal.net] [ INFO ] Stage: Transaction setup [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up [ INFO ] Cleaning previous attempts [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] Starting local VM [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check IPv6] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv4 route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv6 route] [ INFO ] skipping: [localhost] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse libvirt default network configuration] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set network_dict from default_net_xml] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create he-network-config.xml from network-config.j2 template] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, destroy] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, undefine] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, define] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv4] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv6] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save bridge name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the bridge to appear on the host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Accept IPv6 Router Advertisements for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Refresh network facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv4 CIDR for virbr0] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv6 CIDR for virbr0] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 outbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 inbound route rules] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 outbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 inbound route rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host unique id] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create directory for local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local vm dir path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install ovirt-engine-appliance rpm] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for path] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for sha1sum] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get OVA path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compute sha1sum] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compare sha1sum] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register appliance PATH] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check available space on local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check appliance size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure we have enough space to extract the appliance] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to local VM directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance disk size] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse qemu-img output] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Hash the appliance root password] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create cloud init user-data and meta-data files] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create ISO disk] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fix local VM directory permission] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get local VM IP] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove leftover entries in /etc/hosts for the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create an entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for SSH to restart on the local VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the local VM] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add an entry for this host on /etc/hosts on the local VM] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set FQDN] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force the local VM FQDN to temporary resolve on the natted network address] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reconfigure IPv6 default gateway] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore sshd reverse DNS lookups] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add keycloak line to answerfile] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance distribution] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set appliance distribution variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Initialize OpenSCAP variables] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP datastream path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify OpenSCAP datastream] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Apply OpenSCAP profile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reset PermitRootLogin for sshd] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enable FIPS on the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reboot the engine VM to apply security rules] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if FIPS mode is enabled] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce FIPS mode] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include before engine-setup custom tasks files for the engine VM] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy the backup file to the engine VM for restore] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Run engine-backup] [ INFO ] engine-backup --mode=restore failed: FATAL: Backup was created by version '4.5.1.3' and can not be restored using the installed version 4.5.0.8 You can now connect from this host to the bootstrap engine VM using ssh as root and the temporary IP address - 192.168.2.138 - and fix this issue. Please continue only after the backup is restored. To retry the command that failed, you can run, on the bootstrap engine VM: engine-backup --mode=restore --file=/root/engine_backup --provision-all-databases --restore-permissions [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create temporary lock file] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Pause execution until /tmp/ansible.b87cf_ef_he_setup_lock is removed, delete it once ready to proceed] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove backup file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove previous hosted-engine VM] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs on the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs migrating to the host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove host used to redeploy] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Rename previous HE storage domain to avoid name conflicts] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save original DisableFenceAtStartupInSec] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update DisableFenceAtStartupInSec to prevent host fencing during the recovery] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to engine-setup answerfile for PKI renewal] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : remove version lock from the engine] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : recreate versionlock empty file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Perform pre-install checks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Gather facts on installed packages] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Fail when firewall manager is not installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install required packages for oVirt Engine deployment] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install oVirt Engine package] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Check if rhevm package is installed] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install RHV package] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Install rest of the packages required for oVirt Engine deployment] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine setup] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set answer file path] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use the default answerfile] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy custom answer file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Use remote's answer file] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update setup packages] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy yum configuration file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set 'best' to false] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update all packages] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Remove temporary yum configuration file] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set offline parameter if variable is set] [ INFO ] ok: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.engine_setup : Restore engine from file] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine-setup with answerfile] [ ERROR ] fatal: [localhost -> 192.168.2.138]: FAILED! => {"changed": true, "cmd": ["engine-setup", "--accept-defaults", "--config-append=/root/ovirt-engine-answers"], "delta": "0:00:22.689366", "end": "2022-07-23 23:02:44.093812", "msg": "non-zero return code", "rc": 1, "start": "2022-07-23 23:02:21.404446", "stderr": "", "stderr_lines": [], "stdout": "[ INFO ] Stage: Initializing\n[ INFO ] Stage: Environment setup\n Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers\n Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n Version: otopi-1.10.0 (otopi-1.10.0-1.el8)\n[ INFO ] Stage: Environment packages setup\n[ INFO ] Stage: Programs detection\n[ INFO ] Stage: Environment setup (late)\n[ INFO ] Stage: Environment customization\n \n --== PRODUCT OP TIONS ==--\n \n[ INFO ] ovirt-provider-ovn already installed, skipping.\n \n --== PACKAGES ==--\n \n[ INFO ] Checking for product updates...\n[ INFO ] No product updates found\n \n --== NETWORK CONFIGURATION ==--\n \n[ INFO ] firewalld will be configured as firewall manager.\n \n --== DATABASE CONFIGURATION ==--\n \n Where is the Keycloak database located? (Local, Remote) [Local]: \n \n Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.\n Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: \n The detected DWH database size is 188.18833827972412 MB.\n Setup can backup the existing database. The time and space required for the database backup depend on its size. This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.\n If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.\n Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: \n Perform full vacuum on the oVirt engine history\n database ovirt_engine_history@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process.\n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n \n --== OVIRT ENGINE CONFIGURATION ==--\n \n Perform full vacuum on the engine database engine@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process. \n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: \n \n --== STORAGE CONFIGURATION ==--\n \n \n --== PKI CONFIGURATION ==--\n \n \n --== APACHE CONFIGURATION ==--\n \n \n --== SYSTEM CONFIGURATION ==--\n \n \n --== MISC CONFIGURATION ==--\n \n \n --== END OF CONFIGURATION ==--\n \n[ INFO ] Stage: Setup validation\n During execution engine service will be stopped (OK, Cancel) [OK]: \n[ INFO ] Cleaning stale zombie tasks and commands\n \n --== CONFIGURATION PREVIEW ==--\n \n Application mode : both\n Default SAN wipe after delete : False\n Host FQDN : ovirt-engine.internal.net\n Firewall manager : firewalld\n Update Firewall : True\n Set up Cinderlib integration : False\n Configure local Engine database : True\n Set application as default page : True\n Configure Apache SSL : True\n Keycloak installation : True\n Engine database host : localhost\n Engine database port : 5432\n Engine database secured connection : False\n Engine database host name validation : False\n Engine database name : engine\n Engine database user name : engine\n Engine installation : True\n PKI organization : internal.net\n Renew PKI : Fa lse\n Set up ovirt-provider-ovn : True\n Grafana integration : True\n Grafana database user name : ovirt_engine_history_grafana\n Keycloak database host : localhost\n Keycloak database port : 5432\n Configure local Keycloak database : True\n Configure VMConsole Proxy : True\n Configure WebSocket Proxy : True\n DWH installation : True\n DWH database host : localhost\n DWH database port : 5432\n DWH database secured connection : False\n DWH database host name validation : False\n DWH database name : ovirt_engine_history\n DWH database user name : ovirt_engine_history\n Backup DWH database : Tr ue\n Configure local DWH database : True\n[ INFO ] Cleaning async tasks and compensations\n[ INFO ] Unlocking existing entities\n[ INFO ] Checking the Engine database consistency\n[ INFO ] Stage: Transaction setup\n[ INFO ] Stopping engine service\n[ INFO ] Stopping ovirt-fence-kdump-listener service\n[ INFO ] Stopping dwh service\n[ INFO ] Stopping vmconsole-proxy service\n[ INFO ] Stopping websocket-proxy service\n[ INFO ] Stopping service: grafana-server\n[ INFO ] Stage: Misc configuration (early)\n[ INFO ] Stage: Package installation\n[ INFO ] Stage: Misc configuration\n[ INFO ] Upgrading CA\n[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database\n[ INFO ] Configuring PostgreSQL\n[ INFO ] Creating a user for Grafana\n[ INFO ] Updating OVN SSL configuration\n[ INFO ] Updating OVN timeout configuration\n[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'\n[ INFO ] DNF Performing DNF transactio n rollback\n[ INFO ] Stage: Clean up\n Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'\n[ INFO ] Stage: Pre-termination\n[ INFO ] Stage: Termination\n[ ERROR ] Execution of setup failed", "stdout_lines": ["[ INFO ] Stage: Initializing", "[ INFO ] Stage: Environment setup", " Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers", " Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", " Version: otopi-1.10.0 (otopi-1.10.0-1.el8)", "[ INFO ] Stage: Environment packages setup", "[ INFO ] Stage: Programs detection", "[ INFO ] Stage: Environment setup (late)", "[ INFO ] Stage: Environment customization", " ", " --== PRODUCT OPTIONS ==--", " ", "[ INFO ] ovirt-provider-ovn already installed, skipping.", " ", " --== PACKAGES ==--", " ", "[ INFO ] Checking for product updates...", "[ INFO ] No product updates found", " ", " --== NETWORK CONFIGURATION ==--", " ", "[ INFO ] firewalld will be configured as firewall manager.", " ", " --== DATABASE CONFIGURATION ==--", " ", " Where is the Keycloak database located? (Local, Remote) [Local]: ", " ", " Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.", " Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: ", " The detected DWH database size is 188.18833827972412 MB.", " Setup can backup the existing database. The time and space required for the database backup depend on its size. This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.", " If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.", " Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: ", " Perform full vacuum on the oVirt engine history", " database ovirt_engine_history@localhost?", " This operation may take a while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html", " (Yes, No) [No]: ", " ", " --== OVIRT ENGINE CONFIGURATION ==--", " ", " Perform full vacuum on the engine database engine@localhost?", " This operation may take a while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html", " (Yes, No) [No]: ", " Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: ", " ", " --== STORAGE CONFIGURATION ==--", " ", " ", " --== PKI CONFIGURATION ==--", " ", " ", " --== APACHE CONFIGURATION ==--", " ", " ", " --== SYSTEM CONFIGURATION ==--", " ", " ", " --== MISC CONFIGURATION ==--", " ", " ", " --== END OF CONFIGURATION ==--", " ", "[ INFO ] Stage: Setup validation", " During execution engine service will be stopped (OK, Cancel) [OK]: ", "[ INFO ] Cleaning stale zombie tasks and commands", " ", " --== CONFIGURATION PREVIEW ==--", " ", " Application mode : both", " Default SAN wipe after delete : False", " Host FQDN : ovirt-engine.internal.net", " Firewall manager : firewalld", " Update Firewall : True", " Set up Cinderlib integration : False", " Configure local Engine database : True", " Set application as default page : True", " Configure Apache SSL : True", " Keycloak installation : True", " Engine database host : localhost", " Engine database port : 5432", " Engine database secured connection : False", " Engine database host name validation : False", " Engine database name : engine", " Engine database user name : eng ine", " Engine installation : True", " PKI organization : internal.net", " Renew PKI : False", " Set up ovirt-provider-ovn : True", " Grafana integration : True", " Grafana database user name : ovirt_engine_history_grafana", " Keycloak database host : localhost", " Keycloak database port : 5432", " Configure local Keycloak database : True", " Configure VMConsole Proxy : True", " Configure WebSocket Proxy : True", " DWH installation : True", " DWH database host : localhost", " DWH database port : 5432", " DWH database secured connection : False", " DWH database host name validation : False", " DWH database name : ovirt_engine_history", " DWH database user name : ovirt_engine_history", " Backup DWH database : True", " Configure local DWH database : True", "[ INFO ] Cleaning async tasks and compensations", "[ INFO ] Unlocking existing entities", "[ INFO ] Checking the Engine database consistency", "[ INFO ] Stage: Transaction setup", "[ INFO ] Stopping engine service", "[ INFO ] Stopping ovirt-fence-kdump-listener service", "[ INFO ] Stopping dwh service", "[ INFO ] Stopping vmconsole-proxy service", "[ INFO ] Stopping websocket-proxy service", "[ INFO ] Stopping service: grafana-server", "[ INFO ] Stage: Misc configuration (early)", "[ INFO ] Stage: Package installation", "[ INFO ] Stage: Misc configuration", "[ INFO ] Upgrading CA", "[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database", "[ INFO ] Configuring PostgreSQL", "[ IN FO ] Creating a user for Grafana", "[ INFO ] Updating OVN SSL configuration", "[ INFO ] Updating OVN timeout configuration", "[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'", "[ INFO ] DNF Performing DNF transaction rollback", "[ INFO ] Stage: Clean up", " Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", "[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'", "[ INFO ] Stage: Pre-termination", "[ INFO ] Stage: Termination", "[ ERROR ] Execution of setup failed"]} [ INFO ] TASK [ovirt.ovirt.engine_setup : Clean temporary files] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] [ INFO ] changed: [localhost -> 192.168.2.138] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs] [ INFO ] changed: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Notify the user about a failure] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "There was a failure deploying the engine on the local engine VM. The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost -> localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Clean local storage pools] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool localvmnyhvqs4j] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool localvmnyhvqs4j] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1] [ INFO ] changed: [localhost] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20220723230336.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log

2 4

Gluster network - associate brick
by r greg 06 Aug '22

06 Aug '22

hi all, *** new to oVirt and still learning *** Sorry for the long thread... I have a 3x node hyperconverged setup on v4.5.1. 4x 1G NICS NIC0 > ovirtmgmt (Hosted-Engine VM) > vmnetwork vlan102 (all VMs are placed on this network) NIC1 > migration NIC2 - NIC3 > bond0 > storage Logical Networks: ovirtmgmt - role: VM network | management | display | default route vmnetwork - role: VM network migrate - role: migration network storage - role: gluster network During deployment, I overlooked a setting and on node2 the host was deployed with Name: node2.mydomain.lab --- Hostname/IP: 172.16.20.X/24 (WebUI > Compute > Hosts) I suspect because of this I see the following entries on /var/log/ovirt-engine/engine.log (only for node2) 2022-08-04 12:00:15,460Z WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-16) [] Could not associate brick 'node2.mydomain.lab:/gluster_bricks/vmstore/vmstore' of volume '1ca6a01a-9230-4bb1-844e-8064f3eadb53' with correct network as no gluster network found in cluster '1770ade4-0f6f-11ed-b8f6-00163e6faae8' Is this something I need to be worried about or correct somehow? From node1 gluster> peer status Number of Peers: 2 Hostname: node2.mydomain.lab Uuid: a4468bb0-a3b3-42bc-9070-769da5a13427 State: Peer in Cluster (Connected) Other names: 172.16.20.X Hostname: node3.mydomain.lab Uuid: 2b1273a4-667e-4925-af5e-00904988595a State: Peer in Cluster (Connected) Other names: 172.16.20.Z volume status (same output Online Y --- for volumes vmstore and engine ) Status of volume: data Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Brick node1.mydomain.lab:/gluster_brick s/data/data 58734 0 Y 31586 Brick node2.mydomain.lab:/gluster_brick s/data/data 55148 0 Y 4317 Brick node3.mydomain.lab:/gluster_brick s/data/data 57021 0 Y 5242 Self-heal Daemon on localhost N/A N/A Y 63170 Self-heal Daemon on node2.mydomain.lab N/A N/A Y 4365 Self-heal Daemon on node3.mydomain.lab N/A N/A Y 5385

2 1

VM snapshot stuck
by Jirka Simon 05 Aug '22

05 Aug '22

Hello Ovirt folks, last two days we have troubles with stuck snapshot task on some vms. and VM is frozen and unresponsible. task progress is still null I can unlock it with command unlock_entity.sh but VM stays frozen. and VM has to be force powered down and started again in engine log i can see only that master job is waiting for an other job. oVirt Version 4.4.10.7-1.el8 OS Rocky Linux 8.6 last full update was last week on Thurstday Log: 2022-08-05 09:10:05,461+02 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command 'CreateSnapshotForVm' (id: '93f98c9c-2936-4615-b12e-c295b90eace0') waiting on child command id: '2f94c337-487e-40f7-b8f8-df69225d5c79' type:'CreateLiveSnapshotForVm' to complete 2022-08-05 09:10:05,462+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] START, GetHostJobsVDSCommand(HostName = ovirt3.corp.sldev.cz, GetHostJobsVDSCommandParameters:{hostId='15d9a919-63d5-4673-95d2-e84662ef0852', type='virt', jobIds='[6e73cda8-85d0-471c-b090-4c89719a97f4]'}), log id: 515c7e0d 2022-08-05 09:10:05,466+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] FINISH, GetHostJobsVDSCommand, return: {6e73cda8-85d0-471c-b090-4c89719a97f4=HostJobInfo:{id='6e73cda8-85d0-471c-b090-4c89719a97f4', type='virt', description='snapshot_vm', status='running', progress='null', error='null'}}, log id: 515c7e0d 2022-08-05 09:10:05,466+02 INFO [org.ovirt.engine.core.bll.VirtJobCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command CreateLiveSnapshotForVm id: '2f94c337-487e-40f7-b8f8-df69225d5c79': waiting for job '6e73cda8-85d0-471c-b090-4c89719a97f4' on host 'ovirt3.corp.sldev.cz' (id: '15d9a919-63d5-4673-95d2-e84662ef0852') to complete any idea what should I check ? thank you for any help. Jirka

2 2

Cannot Enable incremental backup
by Jonas 05 Aug '22

05 Aug '22

Hello all I'm trying to create incremental backups for my VMs on a testing cluster and am using the functions from https://gitlab.com/nirs/ovirt-stress/-/blob/master/backup/backup.py. So far it works well, but on some disks it is not possible to enable incremental backups even when the VM is powered off (see screenshot below). Does anyone know why this might be the case and how to activate it? I think I already checked the docs and didn't find anything but feel free to nudge me in the right direction. By the way, is there a backup solution that is somewhat endorsed by the community here? Thank you and kind regards, Jonas Screenshot of oVirt Disk

3 2

Adding a GlusterFS Storage Domain
by simon＠justconnect.ie 04 Aug '22

04 Aug '22

This may seem like a simple question but clarification from the experts would be good. When adding a GlusterFS Storage Domain via the engine, do I use the Gluster Storage FQDNs for the Path and backup-volfile-servers mount options Or Do I use the ovirt management network FQDNs. Kind Regards Simon...

2 1

Single Peer in Gluster Cluster Failure caused Storage Domain outage
by simon＠justconnect.ie 04 Aug '22

04 Aug '22

Hi All, We have a 3 node HCI cluster with Gluster 2+1 volumes. The first node had a hardware memory failure which caused file corruption to the engine lv and the server would only boot into maintenance mode. For some reason glusterd wouldn't start and one of the volumes became inaccessible with the Storage domain going offline. This caused multiple VMs to go into a paused or shutdown state. Putting the host into maintenance mode and then shutting it down was done in an attempt to allow gluster to continue across 2 nodes (one being the arbiter). Unfortunately this didn't work. The solution was to do the following: 1. Remove the contents of /var/lib/glusterd except for glusterd.info 2. Start glusterd 3. Peer probe one of the other 2 peers 4. Restart glusterd 5. Cross fingers and toes Although this was a successful outcome I would like to know why losing 1 gluster peer caused the outage of a single storage domain and therefore outages of VMs with disks on that storage domain. Kind Regards Simon...

2 2

Problem with engine deployment
by varekoarfa＠gmail.com 04 Aug '22

04 Aug '22

HI everyone, hope all is good. OS: Centos Stream ovirt 4.5 I'm having problems deploying the hosted engine both through cockpit and cli. I have 3 servers, where through cockpit, I have managed to configure and deploy glusterfs without problems. but when I want to deploy the hosted engine it tells me "No valid network interface has been found". the 3 servers have 2 nic each one, I have created a bond in each one with cockpit and with the name bond0 and in XOR mode. if someone can help me, please. ansible packages installed: [root@vs05 pre_checks]# rpq -qa | ansi -bash: ansi: no se encontró la orden -bash: rpq: no se encontró la orden [root@vs05 pre_checks]# rpq -qa |grep ansi -bash: rpq: no se encontró la orden [root@vs05 pre_checks]# rpm -qa |grep ansi ansible-collection-ansible-posix-1.3.0-1.2.el8.noarch ansible-collection-ansible-netcommon-2.2.0-3.2.el8.noarch ansible-collection-ansible-utils-2.3.0-2.2.el8.noarch gluster-ansible-maintenance-1.0.1-12.el8.noarch gluster-ansible-features-1.0.5-15.el8.noarch ovirt-ansible-collection-2.1.0-1.el8.noarch gluster-ansible-cluster-1.0-5.el8.noarch gluster-ansible-repositories-1.0.1-5.el8.noarch ansible-core-2.12.7-1.el8.x86_64 gluster-ansible-roles-1.0.5-28.el8.noarch gluster-ansible-infra-1.0.4-22.el8.noarch

4 7