Re: Q: How to fix ghost "locked" status of VM
by Andrei Verovski
> On 8 Aug 2022, at 09:52, Jirka Simon <jirka(a)vesim.cz> wrote:
>
> Hi Benny, Andrei.
>
> do you have any news? I deleted frozen task and locked snapshot and disk on Friday and during the weekend everything worked fine. (there were 3 snapshots and backups from Friday to now.)
Deleting zombie task from Postgresql didn’t help.
>
> Thank you
>
> Jirka
>
> On 8/5/22 11:53, Benny Zlotnik wrote:
>> Jirka, I suppose your issue is different than Anderi's no?
>>
>> In your log I see the command has failed:
>> 2022-08-05 10:26:57,741+02 INFO
>> [org.ovirt.engine.core.bll.VirtJobCallback]
>> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92)
>> [8ff04bca-b5a2-4ba3-892
>> 5-1037c5a2850e] Command CreateLiveSnapshotForVm id:
>> '2f94c337-487e-40f7-b8f8-df69225d5c79': execution was completed, the
>> command status is 'FAILED'
>> 2022-08-05 10:26:58,742+02 ERROR
>> [org.ovirt.engine.core.bll.snapshots.CreateLiveSnapshotForVmCommand]
>> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35
>> ) [8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command
>> 'org.ovirt.engine.core.bll.snapshots.CreateLiveSnapshotForVmCommand'
>> with failure.
>> 2022-08-05 10:26:59,796+02 INFO
>> [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
>> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-31)
>> [8
>> ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command 'CreateSnapshotForVm' id:
>> '93f98c9c-2936-4615-b12e-c295b90eace0' child commands
>> '[2f94c337-487e-40f7-b8f8-df69225d5c79, 1b3abc1e
>> -f0c1-40f7-b52e-f7df52c52601]' executions were completed, status 'FAILED'
>> 2022-08-05 10:27:00,826+02 ERROR
>> [org.ovirt.engine.core.bll.snapshots.CreateSnapshotForVmCommand]
>> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-4)
>> [8f
>> f04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command
>> 'org.ovirt.engine.core.bll.snapshots.CreateSnapshotForVmCommand' with
>> failure.
>> 2022-08-05 10:27:00,829+02 ERROR
>> [org.ovirt.engine.core.bll.snapshots.CreateSnapshotDiskCommand]
>> (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-4)
>> [8ff
>> 04bca-b5a2-4ba3-8925-1037c5a2850e] Ending command
>> 'org.ovirt.engine.core.bll.snapshots.CreateSnapshotDiskCommand' with
>> failure.
>>
>> Generally, live snapshot has a default 30 minute timeout to complete
>> and it looks like it was reached in your case, I don't see a command
>> that's still running
>>
>> On Fri, Aug 5, 2022 at 12:36 PM Jirka Simon <jirka(a)vesim.cz> wrote:
>>> Hi Benny , Andrei,
>>>
>>>
>>> here are my logs
>>>
>>>
>>> affected job was " waiting for job '6e73cda8-85d0-471c-b090-4c89719a97f4' on host 'ovirt3.corp.sldev.cz' "
>>>
>>> thank you
>>>
>>>
>>> Jirka
>>>
>>> On 8/5/22 11:00, Andrei Verovski wrote:
>>>
>>> Hi,
>>>
>>> I have e-mailed vdsm log to Benny.
>>> Unfortunately, yesterday I deleted engine.log before restarting engine to have more shorter log.
>>>
>>> Jirka, can you e-mail engine.log and vdsm logs (SPM at the time and the host
>>> running the VM) to Benny?
>>>
>>>
>>> On 5 Aug 2022, at 11:42, Jirka Simon <jirka(a)vesim.cz> wrote:
>>>
>>> Hi Benny, so we have the same problem last 2 days.
>>>
>>> there are two affected VMs (furtunately not more) and we cant start any snapshot for these VMS.
>>>
>>> it looks that the snapshot haven't start yet , then to unlock objects (snapshot and disk) shouldn't damage disk (i tried it on both VMS), then i restarted them and VMS run again. I made clone from one of them ant the clone works properly.
>>>
>>>
>>> Jirka
>>>
>>> On 8/5/22 10:34, Benny Zlotnik wrote:
>>>
>>> So based on your logs the lock you are seeing is a memory lock,
>>> unlock_entity.sh can't really help with these.
>>> Also, the job table is used mainly for presentation so removing an
>>> entry from will not help.
>>>
>>> Do you have the logs from when this snapshot operation started, you
>>> can use the correlation id (28353fa0-5e36-4fe8-8609-e74cd1da6d36) to
>>> search? Also, do you have the vdsm logs (SPM at the time and the host
>>> running the VM), same correlation id can be used for this as well
>>>
>>> The table that's used to coordinate this is command_entities, so in
>>> theory removing the entries with this correlation id can help, but I'd
>>> like to see what led to this first
>>>
>>> On Fri, Aug 5, 2022 at 8:37 AM Andrei Verovski <andreil1(a)starlett.lv> wrote:
>>>
>>> Hi, Benny,
>>>
>>> I have sent log on your mailbox, its too big to post here on mailing list.
>>>
>>> Looks like ghost task is still running, anything else need to be removed from Postgres DB?
>>>
>>> BTW, frozen dead snapshot is in invalid state, is there any way to get rid of it? I think it's actually exists, but due to invalid state its not possible to do anything with it.
>>>
>>>
>>> ——
>>>
>>> Log file still shows zombie task:
>>>
>>> 2022-08-04 20:57:30,145+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-24) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete
>>> 2022-08-04 20:57:40,176+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-85) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete
>>> 2022-08-04 20:57:50,252+03 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-66) [28353fa0-5e36-4fe8-8609-e74cd1da6d36] Command 'CreateSnapshotForVm' (id: '2f8b32d8-fd3c-46c9-90e9-4863d63c0530') waiting on child command id: 'ed816f9d-e25c-4b58-8c8f-fd0393abda2f' type:'CreateLiveSnapshotForVm' to complete
>>>
>>>
>>> On 4 Aug 2022, at 19:06, Benny Zlotnik <bzlotnik(a)redhat.com> wrote:
>>>
>>> can you share the logs after restarting ovirt-engine?
>>>
>>> On Thu, Aug 4, 2022 at 4:58 PM Andrei Verovski <andreil1(a)starlett.lv> wrote:
>>>
>>> Hi,
>>>
>>>
>>> Creating snapshot of one of the VM vailed, and zombie tasks was killed with:
>>>
>>> su postgres
>>> psql -d engine -U postgres
>>> select * from job order by start_time desc;
>>>
>>> select DeleteJob('UUID_FROZEN_TASK_ID’);
>>>
>>>
>>> However, VM remains in locked state (with lock sign left-below red “DOWN” arrow in status column of web interface.
>>>
>>> I run:
>>> /usr/share/ovirt-engine/setup/dbutils/unlock_entity.sh -t all
>>>
>>> then rebooted engine VM, still no luck. Can’t do anything with that VM.
>>>
>>> Please advise how to fix.
>>> Thanks in advance.
>>> _______________________________________________
>>> Users mailing list -- users(a)ovirt.org
>>> To unsubscribe send an email to users-leave(a)ovirt.org
>>> Privacy Statement: https://www.ovirt.org/privacy-policy.html
>>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
>>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/P2TVMLHC53J...
>>>
>>> _______________________________________________
>>> Users mailing list -- users(a)ovirt.org
>>> To unsubscribe send an email to users-leave(a)ovirt.org
>>> Privacy Statement: https://www.ovirt.org/privacy-policy.html
>>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
>>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ILYSLIM7UNR...
2 years, 10 months
hosted-engine --deploy --restore-from-file fails on oVirt node 4.5.1.3
by P F
I'm running three oVirt 4.5.1.3 nodes with a hosted engine v4.5.1.3.
I've installed ovirt node using the iso downloaded from;
https://resources.ovirt.org/pub/ovirt-4.5/iso/ovirt-node-ng-installer/4.5...
I recently attempted to reinstall the environment using a freshly taken engine backup.
After installing a fresh oVirt node, and copying the backup to the node, I ran the command;
hosted-engine --deploy --restore-from-file=backup-20220723-2
The problem appears to occur after the engine_setup ansible task starts.
Where the error can be seen;
[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'
Since I was unable to get the restore-from-file method to work, I was forced to recreate the environment from scratch.
However, I'm concerned that this may continue to be an unaddressed problem going forward. It is quite tedious to recreate all of the cluster resources from scratch.
Has anyone attempted a --restore-from-file on oVirt node 4.5.1.3?
Have you seen this problem? Were you able to overcome the error? If so, how?
Or, did it work for you?
Below are the complete log messages from the attempt.
----------- snip -----------
[root@ovirt-node03 ~]# hosted-engine --deploy --restore-from-file=backup-20220723-2
[ INFO ] Stage: Initializing
[ INFO ] Stage: Environment setup
During customization use CTRL-D to abort.
Continuing will configure this host for serving as hypervisor and will create a local VM with a running engine.
The provided engine backup file will be restored there,
it's strongly recommended to run this tool on an host that wasn't part of the environment going to be restored.
If a reference to this host is already contained in the backup file, it will be filtered out at restore time.
The locally running engine will be used to configure a new storage domain and create a VM there.
At the end the disk of the local VM will be moved to the shared storage.
The old hosted-engine storage domain will be renamed, after checking that everything is correctly working you can manually remove it.
Other hosted-engine hosts have to be reinstalled from the engine to update their hosted-engine configuration.
Are you sure you want to continue? (Yes, No)[Yes]:
It has been detected that this program is executed through an SSH connection without using tmux.
Continuing with the installation may lead to broken installation if the network connection fails.
It is highly recommended to abort the installation and run it inside a tmux session using command "tmux".
Do you want to continue anyway? (Yes, No)[No]: Yes
Configuration files:
Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log
Version: otopi-1.10.0 (otopi-1.10.0-1.el8)
[ INFO ] Stage: Environment packages setup
[ INFO ] Stage: Programs detection
[ INFO ] Stage: Environment setup (late)
[ INFO ] Stage: Environment customization
--== STORAGE CONFIGURATION ==--
--== HOST NETWORK CONFIGURATION ==--
[ INFO ] Bridge ovirtmgmt already created
Please indicate the gateway IP address [192.168.1.1]:
[ INFO ] Checking available network interfaces:
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist]
[ INFO ] skipping: [localhost]
Please indicate a nic to set ovirtmgmt bridge on (enp1s0f0) [enp1s0f0]:
Please specify which way the network connectivity should be checked (ping, dns, tcp, none) [dns]:
--== VM CONFIGURATION ==--
Please enter the name of the data center where you want to deploy this hosted-engine host.
Please note:
If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing data center of HostedEngine.
If you are restoring a backup of a hosted-engine, this value should be the data center of the HostedEngine VM and hosts.
If you are migrating from a standalone engine to a hosted-engine, this value should be the target data center you wish to add the HostedEngine VM and this host to.
The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct.
Data center: Default
Please enter the name of the cluster where you want to deploy this hosted-engine host.
Please note:
If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts. This can be useful for moving an existing hosted-engine setup to new storage which will be attached to the existing cluster of HostedEngine.
If you are restoring a backup of a hosted-engine, this value should be the cluster of the HostedEngine VM and hosts.
If you are migrating from a standalone engine to a hosted-engine, this value should be the target cluster you wish to add the HostedEngine VM and this host to.
The default, for new deployments, is "Default", but is not supplied here, because you are restoring from a backup - please make sure that the value you supply is correct.
Cluster: Default
Renew engine CA on restore if needed?
Please notice that if you choose Yes, all hosts will have to be later manually reinstalled from the engine.
Renew CA if needed? (Yes, No)[No]:
Pause the execution after adding this host to the engine?
You will be able to connect to the restored engine in order to manually review and remediate its configuration.
This is normally not required when restoring an up to date and coherent backup.
Pause after adding the host? (Yes, No)[No]:
Configure Keycloak integration on the engine(Yes, No) [Yes]:
If you want to deploy with a custom engine appliance image, please specify the path to the OVA archive you would like to use.
Entering no value will use the image from the ovirt-engine-appliance rpm, installing it if needed.
Appliance image path []:
Please specify the number of virtual CPUs for the VM. The default is the appliance OVF value [4]:
Please specify the memory size of the VM in MB. The default is the appliance OVF value [16384]:
[ INFO ] Detecting host timezone.
[ INFO ] Using Engine VM FQDN ovirt-engine.internal.net from backup file.
[ INFO ] Using domain name from backup file.
Enter root password that will be used for the engine appliance:
Confirm appliance root password:
You may provide an SSH public key, that will be added by the deployment script to the authorized_keys file of the root user in the engine appliance.
This should allow you passwordless login to the engine machine after deployment.
If you provide no key, authorized_keys will not be touched.
SSH public key []:
[WARNING] Skipping appliance root ssh public key
Do you want to enable ssh access for the root user? (yes, no, without-password) [yes]:
Do you want to apply an OpenSCAP security profile? (Yes, No) [No]:
Do you want to enable FIPS? (Yes, No) [No]:
Please specify a unicast MAC address for the VM, or accept a randomly generated default [00:16:3e:5c:f2:f7]:
How should the engine VM network be configured? (DHCP, Static)[DHCP]: Static
Please enter the IP address to be used for the engine VM []: 192.168.1.38
[ INFO ] The engine VM will be configured to use 192.168.1.38/24
Please provide a comma-separated list (max 3) of IP addresses of domain name servers for the engine VM
Engine VM DNS (leave it empty to skip) [192.168.1.101]:
Add lines for the appliance itself and for this host to /etc/hosts on the engine VM?
Note: ensuring that this host could resolve the engine VM hostname is still up to you.
Add lines to /etc/hosts? (Yes, No)[Yes]:
--== HOSTED ENGINE CONFIGURATION ==--
Please provide the name of the SMTP server through which we will send notifications [localhost]:
Please provide the TCP port number of the SMTP server [25]:
Please provide the email address from which notifications will be sent [root@localhost]:
Please provide a comma-separated list of email addresses which will get notifications [root@localhost]:
Enter engine admin password:
Confirm engine admin password:
[ INFO ] Stage: Setup validation
Please provide the hostname of this host on the management network [ovirt-node03.internal.net]:
[ INFO ] Stage: Transaction setup
[ INFO ] Stage: Misc configuration (early)
[ INFO ] Stage: Package installation
[ INFO ] Stage: Misc configuration
[ INFO ] Stage: Transaction commit
[ INFO ] Stage: Closing up
[ INFO ] Cleaning previous attempts
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid]
[ INFO ] skipping: [localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined]
[ INFO ] skipping: [localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] Starting local VM
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install oVirt Hosted Engine packages]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : System configuration validations]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Detecting interface on existing management bridge]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set variable for supported bond modes]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get all active network interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter bonds with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate output list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect interface types]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for Team devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get list of Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect Team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter team devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only team devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate invalid VLANs list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create list of unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices naming convention pattern]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad naming]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid naming convention]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with invalid naming convention are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for base interface of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get base interface types of VLAN devices]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for bond as base type of VLAN device]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if bond base interface of VLAN device is in supported mode]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check VLAN devices with bad bond mode base interfaces]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Collect unsupported VLAN bonds]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter VLAN devices with invalid bond mode base interface]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if only VLAN devices with bad bond mode are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported VLAN devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate list of all unsupported network devices]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter unsupported interface types]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Failed if only unsupported devices are available]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate selected bridge interface if management bridge does not exist]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get full hostname]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set hostname variable if not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define host address variable if not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Prepare getent key]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host address resolution]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check address resolution]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse host address resolution]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if host's ip is empty]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure host address resolves locally]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv4)]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get target address from selected interface (IPv6)]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for alias]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Filter resolved address list]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure the resolved address resolves only on the selected interface]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Avoid localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get engine FQDN resolution]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check engine he_fqdn resolution]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse engine he_fqdn resolution]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure engine he_fqdn doesn't resolve locally]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check http/https proxy]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get domain name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cloud_init_domain_name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define he_cloud_init_host_name]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_nic_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get uuid]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_cdrom_uuid]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get timezone]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_time_zone]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if Data Center name format is incorrect]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Validate Cluster name]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check firewalld status]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce firewalld status]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv4]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get default gateway IPv6]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_gateway]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if there is no gateway]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Generate unicast MAC address]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vm_mac_addr]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if MAC address structure is incorrect]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get free memory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get cached memory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set Max memory]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : set he_mem_size_MB to max available if not defined]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if available memory is less then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose less memory then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_disk_size_GB is smaller then the minimal requirement]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_network_test is not valid]
[ INFO ] skipping: [localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_address is not defined]
[ INFO ] skipping: [localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is not defined]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if he_tcp_t_port is no integer]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Populate service facts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if the service is masked or not running]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : get max cpus]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_maxvcpus]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set he_vcpus to maximum amount if not defined]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check number of chosen CPUs]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop libvirt service]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop vdsm config statements]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop VNC encryption config statements]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify abrt-action-save-package-data file]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial abrt config files]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restart abrtd service]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Stop and disable services]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore initial libvirt default network configuration]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover local Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy leftover local Hosted Engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined local Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover local engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check for leftover defined Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine leftover engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove eventually entries for the local VM from known_hosts file]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check IPv6]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv4 route]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv4 subnet prefix]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Define 3rd chunk]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set 3rd chunk]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get ip route]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fail if can't find an available subnet]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set new IPv6 subnet prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Search again with another prefix]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get IPv6 route]
[ INFO ] skipping: [localhost]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if route exists]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse libvirt default network configuration]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set network_dict from default_net_xml]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create he-network-config.xml from network-config.j2 template]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, destroy]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, undefine]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update libvirt default network configuration, define]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Start libvirt]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Activate default libvirt network]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv4]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get routing rules, IPv6]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save bridge name]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the bridge to appear on the host]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Accept IPv6 Router Advertisements for virbr0]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Refresh network facts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv4 CIDR for virbr0]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch IPv6 CIDR for virbr0]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 outbound route rules]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv4 inbound route rules]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 outbound route rules]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add IPv6 inbound route rules]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get host unique id]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create directory for local VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local vm dir path]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Install ovirt-engine-appliance rpm]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for path]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse appliance configuration for sha1sum]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get OVA path]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compute sha1sum]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Compare sha1sum]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register appliance PATH]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check available space on local VM directory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check appliance size]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Ensure we have enough space to extract the appliance]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Extract appliance to local VM directory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance disk size]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Parse qemu-img output]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Hash the appliance root password]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create cloud init user-data and meta-data files]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create ISO disk]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fix local VM directory permission]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create local VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get local VM IP]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove leftover entries in /etc/hosts for the local VM]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create an entry in /etc/hosts for the local VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for SSH to restart on the local VM]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the local VM]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add an entry for this host on /etc/hosts on the local VM]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set FQDN]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force the local VM FQDN to temporary resolve on the natted network address]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reconfigure IPv6 default gateway]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Restore sshd reverse DNS lookups]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to answerfile]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add keycloak line to answerfile]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get appliance distribution]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set appliance distribution variables]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Initialize OpenSCAP variables]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP datastream path]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Verify OpenSCAP datastream]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set OpenSCAP profile]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Apply OpenSCAP profile]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reset PermitRootLogin for sshd]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enable FIPS on the engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Reboot the engine VM to apply security rules]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check if FIPS mode is enabled]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce FIPS mode]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Include before engine-setup custom tasks files for the engine VM]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy the backup file to the engine VM for restore]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Run engine-backup]
[ INFO ] engine-backup --mode=restore failed:
FATAL: Backup was created by version '4.5.1.3' and can not be restored using the installed version 4.5.0.8
You can now connect from this host to the bootstrap engine VM using ssh as root and the temporary IP address - 192.168.2.138 - and fix this issue. Please continue only after the backup is restored.
To retry the command that failed, you can run, on the bootstrap engine VM:
engine-backup --mode=restore --file=/root/engine_backup --provision-all-databases --restore-permissions
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create temporary lock file]
[ INFO ] changed: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Pause execution until /tmp/ansible.b87cf_ef_he_setup_lock is removed, delete it once ready to proceed]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove backup file]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove previous hosted-engine VM]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs on the host used to redeploy]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update dynamic data for VMs migrating to the host used to redeploy]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove host used to redeploy]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Rename previous HE storage domain to avoid name conflicts]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Save original DisableFenceAtStartupInSec]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Update DisableFenceAtStartupInSec to prevent host fencing during the recovery]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add lines to engine-setup answerfile for PKI renewal]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : remove version lock from the engine]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : recreate versionlock empty file]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Perform pre-install checks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Gather facts on installed packages]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Fail when firewall manager is not installed]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Install required packages for oVirt Engine deployment]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Install oVirt Engine package]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Check if rhevm package is installed]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Install RHV package]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Install rest of the packages required for oVirt Engine deployment]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine setup]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Set answer file path]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Use the default answerfile]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Copy custom answer file]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Use remote's answer file]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Update setup packages]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Copy yum configuration file]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Set 'best' to false]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Update all packages]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Remove temporary yum configuration file]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Set offline parameter if variable is set]
[ INFO ] ok: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Restore engine from file]
[ INFO ] skipping: [localhost]
[ INFO ] TASK [ovirt.ovirt.engine_setup : Run engine-setup with answerfile]
[ ERROR ] fatal: [localhost -> 192.168.2.138]: FAILED! => {"changed": true, "cmd": ["engine-setup", "--accept-defaults", "--config-append=/root/ovirt-engine-answers"], "delta": "0:00:22.689366", "end": "2022-07-23 23:02:44.093812", "msg": "non-zero return code", "rc": 1, "start": "2022-07-23 23:02:21.404446", "stderr": "", "stderr_lines": [], "stdout": "[ INFO ] Stage: Initializing\n[ INFO ] Stage: Environment setup\n Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers\n Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n Version: otopi-1.10.0 (otopi-1.10.0-1.el8)\n[ INFO ] Stage: Environment packages setup\n[ INFO ] Stage: Programs detection\n[ INFO ] Stage: Environment setup (late)\n[ INFO ] Stage: Environment customization\n \n --== PRODUCT OP
TIONS ==--\n \n[ INFO ] ovirt-provider-ovn already installed, skipping.\n \n --== PACKAGES ==--\n \n[ INFO ] Checking for product updates...\n[ INFO ] No product updates found\n \n --== NETWORK CONFIGURATION ==--\n \n[ INFO ] firewalld will be configured as firewall manager.\n \n --== DATABASE CONFIGURATION ==--\n \n Where is the Keycloak database located? (Local, Remote) [Local]: \n \n Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.\n Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: \n The detected DWH database size is 188.18833827972412 MB.\n Setup can backup the existing database. The time and space required for the database backup depend on its size.
This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.\n If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.\n Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: \n Perform full vacuum on the oVirt engine history\n database ovirt_engine_history@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process.\n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n \n --== OVIRT ENGINE CONFIGURATION ==--\n \n Perform full vacuum on the engine database engine@localhost?\n This operation may take a while depending on this setup health and the\n configuration of the db vacuum process.
\n See https://www.postgresql.org/docs/12/sql-vacuum.html\n (Yes, No) [No]: \n Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: \n \n --== STORAGE CONFIGURATION ==--\n \n \n --== PKI CONFIGURATION ==--\n \n \n --== APACHE CONFIGURATION ==--\n \n \n --== SYSTEM CONFIGURATION ==--\n \n \n --== MISC CONFIGURATION ==--\n \n \n --== END OF CONFIGURATION ==--\n \n[ INFO ] Stage: Setup validation\n During execution engine service will be stopped (OK, Cancel) [OK]: \n[ INFO ] Cleaning stale zombie tasks and commands\n \n --== CONFIGURATION PREVIEW ==--\n \n Application mode : both\n Default SAN wipe after delete : False\n Host FQDN
: ovirt-engine.internal.net\n Firewall manager : firewalld\n Update Firewall : True\n Set up Cinderlib integration : False\n Configure local Engine database : True\n Set application as default page : True\n Configure Apache SSL : True\n Keycloak installation : True\n Engine database host : localhost\n Engine database port : 5432\n Engine database secured connection : False\n Engine database host name validation : False\n Engine database name : engine\n Engine database user name : engine\n Engine installation : True\n PKI organization : internal.net\n Renew PKI : Fa
lse\n Set up ovirt-provider-ovn : True\n Grafana integration : True\n Grafana database user name : ovirt_engine_history_grafana\n Keycloak database host : localhost\n Keycloak database port : 5432\n Configure local Keycloak database : True\n Configure VMConsole Proxy : True\n Configure WebSocket Proxy : True\n DWH installation : True\n DWH database host : localhost\n DWH database port : 5432\n DWH database secured connection : False\n DWH database host name validation : False\n DWH database name : ovirt_engine_history\n DWH database user name : ovirt_engine_history\n Backup DWH database : Tr
ue\n Configure local DWH database : True\n[ INFO ] Cleaning async tasks and compensations\n[ INFO ] Unlocking existing entities\n[ INFO ] Checking the Engine database consistency\n[ INFO ] Stage: Transaction setup\n[ INFO ] Stopping engine service\n[ INFO ] Stopping ovirt-fence-kdump-listener service\n[ INFO ] Stopping dwh service\n[ INFO ] Stopping vmconsole-proxy service\n[ INFO ] Stopping websocket-proxy service\n[ INFO ] Stopping service: grafana-server\n[ INFO ] Stage: Misc configuration (early)\n[ INFO ] Stage: Package installation\n[ INFO ] Stage: Misc configuration\n[ INFO ] Upgrading CA\n[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database\n[ INFO ] Configuring PostgreSQL\n[ INFO ] Creating a user for Grafana\n[ INFO ] Updating OVN SSL configuration\n[ INFO ] Updating OVN timeout configuration\n[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'\n[ INFO ] DNF Performing DNF transactio
n rollback\n[ INFO ] Stage: Clean up\n Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log\n[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'\n[ INFO ] Stage: Pre-termination\n[ INFO ] Stage: Termination\n[ ERROR ] Execution of setup failed", "stdout_lines": ["[ INFO ] Stage: Initializing", "[ INFO ] Stage: Environment setup", " Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers", " Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", " Version: otopi-1.10.0 (otopi-1.10.0-1.el8)", "[ INFO ] Stage: Environment packages setup", "[ INFO ] Stage: Programs detection", "[ INFO ] Stage: Environment setup (late)", "[ INFO ] Stage: Environment customization", "
", " --== PRODUCT OPTIONS ==--", " ", "[ INFO ] ovirt-provider-ovn already installed, skipping.", " ", " --== PACKAGES ==--", " ", "[ INFO ] Checking for product updates...", "[ INFO ] No product updates found", " ", " --== NETWORK CONFIGURATION ==--", " ", "[ INFO ] firewalld will be configured as firewall manager.", " ", " --== DATABASE CONFIGURATION ==--", " ", " Where is the Keycloak database located? (Local, Remote) [Local]: ", " ", " Setup can configure the local postgresql server automatically for the Keycloak to run. This may conflict with existing applications.", " Would you like Setup to automatically configure postgresql and create Keycloak database, or prefer to perform that manually? (Automatic, Manual) [Automatic]: ", " The detected DWH database size is 188.18833827972412 MB.", " Setup can backup the existing database. The
time and space required for the database backup depend on its size. This process takes time, and in some cases (for instance, when the size is few GBs) may take several hours to complete.", " If you choose to not back up the database, and Setup later fails for some reason, it will not be able to restore the database and all DWH data will be lost.", " Would you like to backup the existing database before upgrading it? (Yes, No) [Yes]: ", " Perform full vacuum on the oVirt engine history", " database ovirt_engine_history@localhost?", " This operation may take a while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html", " (Yes, No) [No]: ", " ", " --== OVIRT ENGINE CONFIGURATION ==--", " ", " Perform full vacuum on the engine database engine@localhost?", " This operation may take a
while depending on this setup health and the", " configuration of the db vacuum process.", " See https://www.postgresql.org/docs/12/sql-vacuum.html", " (Yes, No) [No]: ", " Use Engine admin password as initial keycloak admin [admin] and [admin@ovirt] administration panel user password (Yes, No) [Yes]: ", " ", " --== STORAGE CONFIGURATION ==--", " ", " ", " --== PKI CONFIGURATION ==--", " ", " ", " --== APACHE CONFIGURATION ==--", " ", " ", " --== SYSTEM CONFIGURATION ==--", " ", " ", " --== MISC CONFIGURATION ==--", " ", " ", " --== END OF CONFIGURATION ==--", " ", "[ INFO ] Stage: Setup validation", " During execution engine service will be stopped (OK, Cancel) [OK]: ", "[ INFO ] Cleaning stale zombie tasks and commands", " ", " --== CONFIGURATION PREVIEW ==--", "
", " Application mode : both", " Default SAN wipe after delete : False", " Host FQDN : ovirt-engine.internal.net", " Firewall manager : firewalld", " Update Firewall : True", " Set up Cinderlib integration : False", " Configure local Engine database : True", " Set application as default page : True", " Configure Apache SSL : True", " Keycloak installation : True", " Engine database host : localhost", " Engine database port : 5432", " Engine database secured connection : False", " Engine database host name validation : False", " Engine database name : engine", " Engine database user name : eng
ine", " Engine installation : True", " PKI organization : internal.net", " Renew PKI : False", " Set up ovirt-provider-ovn : True", " Grafana integration : True", " Grafana database user name : ovirt_engine_history_grafana", " Keycloak database host : localhost", " Keycloak database port : 5432", " Configure local Keycloak database : True", " Configure VMConsole Proxy : True", " Configure WebSocket Proxy : True", " DWH installation : True", " DWH database host : localhost", " DWH database port : 5432", " DWH database secured connection : False", " DWH database host name validation
: False", " DWH database name : ovirt_engine_history", " DWH database user name : ovirt_engine_history", " Backup DWH database : True", " Configure local DWH database : True", "[ INFO ] Cleaning async tasks and compensations", "[ INFO ] Unlocking existing entities", "[ INFO ] Checking the Engine database consistency", "[ INFO ] Stage: Transaction setup", "[ INFO ] Stopping engine service", "[ INFO ] Stopping ovirt-fence-kdump-listener service", "[ INFO ] Stopping dwh service", "[ INFO ] Stopping vmconsole-proxy service", "[ INFO ] Stopping websocket-proxy service", "[ INFO ] Stopping service: grafana-server", "[ INFO ] Stage: Misc configuration (early)", "[ INFO ] Stage: Package installation", "[ INFO ] Stage: Misc configuration", "[ INFO ] Upgrading CA", "[ INFO ] Creating PostgreSQL 'ovirt_engine_keycloak' database", "[ INFO ] Configuring PostgreSQL", "[ IN
FO ] Creating a user for Grafana", "[ INFO ] Updating OVN SSL configuration", "[ INFO ] Updating OVN timeout configuration", "[ ERROR ] Failed to execute stage 'Misc configuration': 'OVESETUP_OVN/ovirtProviderOvnSecret'", "[ INFO ] DNF Performing DNF transaction rollback", "[ INFO ] Stage: Clean up", " Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220723230221-070rb2.log", "[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220723230243-setup.conf'", "[ INFO ] Stage: Pre-termination", "[ INFO ] Stage: Termination", "[ ERROR ] Execution of setup failed"]}
[ INFO ] TASK [ovirt.ovirt.engine_setup : Clean temporary files]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine]
[ INFO ] changed: [localhost -> 192.168.2.138]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory]
[ INFO ] changed: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs]
[ INFO ] changed: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Notify the user about a failure]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "There was a failure deploying the engine on the local engine VM. The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook
[ INFO ] Stage: Clean up
[ INFO ] Cleaning temporary resources
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set the name for add_host]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch the value of HOST_KEY_CHECKING]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Get the username running the deploy]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Register the engine FQDN as a host]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch logs from the engine VM]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set destination directory path]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Create destination directory]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Find the local appliance image]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Set local_vm_disk_path]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers]
[ INFO ] ok: [localhost -> localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Copy engine logs]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Change ownership of copied engine logs]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove local vm dir]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Clean local storage pools]
[ INFO ] ok: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool localvmnyhvqs4j]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool localvmnyhvqs4j]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Destroy local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1]
[ INFO ] changed: [localhost]
[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Undefine local storage-pool 5d0c9ad9-db74-46d8-a705-9092d5b874e1]
[ INFO ] changed: [localhost]
[ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20220723230336.conf'
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
[ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch.
Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20220723215602-h3k4pg.log
2 years, 10 months
Gluster network - associate brick
by r greg
hi all,
*** new to oVirt and still learning ***
Sorry for the long thread...
I have a 3x node hyperconverged setup on v4.5.1.
4x 1G NICS
NIC0
> ovirtmgmt (Hosted-Engine VM)
> vmnetwork vlan102 (all VMs are placed on this network)
NIC1
> migration
NIC2 - NIC3 > bond0
> storage
Logical Networks:
ovirtmgmt - role: VM network | management | display | default route
vmnetwork - role: VM network
migrate - role: migration network
storage - role: gluster network
During deployment, I overlooked a setting and on node2 the host was deployed with Name: node2.mydomain.lab --- Hostname/IP: 172.16.20.X/24 (WebUI > Compute > Hosts)
I suspect because of this I see the following entries on /var/log/ovirt-engine/engine.log (only for node2)
2022-08-04 12:00:15,460Z WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-16) [] Could not associate brick 'node2.mydomain.lab:/gluster_bricks/vmstore/vmstore' of volume '1ca6a01a-9230-4bb1-844e-8064f3eadb53' with correct network as no gluster network found in cluster '1770ade4-0f6f-11ed-b8f6-00163e6faae8'
Is this something I need to be worried about or correct somehow?
From node1
gluster> peer status
Number of Peers: 2
Hostname: node2.mydomain.lab
Uuid: a4468bb0-a3b3-42bc-9070-769da5a13427
State: Peer in Cluster (Connected)
Other names:
172.16.20.X
Hostname: node3.mydomain.lab
Uuid: 2b1273a4-667e-4925-af5e-00904988595a
State: Peer in Cluster (Connected)
Other names:
172.16.20.Z
volume status (same output Online Y --- for volumes vmstore and engine )
Status of volume: data
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick node1.mydomain.lab:/gluster_brick
s/data/data 58734 0 Y 31586
Brick node2.mydomain.lab:/gluster_brick
s/data/data 55148 0 Y 4317
Brick node3.mydomain.lab:/gluster_brick
s/data/data 57021 0 Y 5242
Self-heal Daemon on localhost N/A N/A Y 63170
Self-heal Daemon on node2.mydomain.lab N/A N/A Y 4365
Self-heal Daemon on node3.mydomain.lab N/A N/A Y 5385
2 years, 10 months
VM snapshot stuck
by Jirka Simon
Hello Ovirt folks,
last two days we have troubles with stuck snapshot task on some vms. and
VM is frozen and unresponsible.
task progress is still null
I can unlock it with command unlock_entity.sh but VM stays frozen. and
VM has to be force powered down and started again
in engine log i can see only that master job is waiting for an other job.
oVirt Version 4.4.10.7-1.el8
OS Rocky Linux 8.6
last full update was last week on Thurstday
Log:
2022-08-05 09:10:05,461+02 INFO
[org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35)
[8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command 'CreateSnapshotForVm'
(id: '93f98c9c-2936-4615-b12e-c295b90eace0') waiting on child command
id: '2f94c337-487e-40f7-b8f8-df69225d5c79'
type:'CreateLiveSnapshotForVm' to complete
2022-08-05 09:10:05,462+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35)
[8ff04bca-b5a2-4ba3-8925-1037c5a2850e] START,
GetHostJobsVDSCommand(HostName = ovirt3.corp.sldev.cz,
GetHostJobsVDSCommandParameters:{hostId='15d9a919-63d5-4673-95d2-e84662ef0852',
type='virt', jobIds='[6e73cda8-85d0-471c-b090-4c89719a97f4]'}), log id:
515c7e0d
2022-08-05 09:10:05,466+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35)
[8ff04bca-b5a2-4ba3-8925-1037c5a2850e] FINISH, GetHostJobsVDSCommand,
return:
{6e73cda8-85d0-471c-b090-4c89719a97f4=HostJobInfo:{id='6e73cda8-85d0-471c-b090-4c89719a97f4',
type='virt', description='snapshot_vm', status='running',
progress='null', error='null'}}, log id: 515c7e0d
2022-08-05 09:10:05,466+02 INFO
[org.ovirt.engine.core.bll.VirtJobCallback]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35)
[8ff04bca-b5a2-4ba3-8925-1037c5a2850e] Command CreateLiveSnapshotForVm
id: '2f94c337-487e-40f7-b8f8-df69225d5c79': waiting for job
'6e73cda8-85d0-471c-b090-4c89719a97f4' on host 'ovirt3.corp.sldev.cz'
(id: '15d9a919-63d5-4673-95d2-e84662ef0852') to complete
any idea what should I check ?
thank you for any help.
Jirka
2 years, 10 months
Cannot Enable incremental backup
by Jonas
Hello all
I'm trying to create incremental backups for my VMs on a testing cluster
and am using the functions from
https://gitlab.com/nirs/ovirt-stress/-/blob/master/backup/backup.py. So
far it works well, but on some disks it is not possible to enable
incremental backups even when the VM is powered off (see screenshot
below). Does anyone know why this might be the case and how to activate
it? I think I already checked the docs and didn't find anything but feel
free to nudge me in the right direction.
By the way, is there a backup solution that is somewhat endorsed by the
community here?
Thank you and kind regards,
Jonas
Screenshot of oVirt Disk
2 years, 10 months
Adding a GlusterFS Storage Domain
by simon＠justconnect.ie
This may seem like a simple question but clarification from the experts would be good.
When adding a GlusterFS Storage Domain via the engine, do I use the Gluster Storage FQDNs for the Path and backup-volfile-servers mount options
Or
Do I use the ovirt management network FQDNs.
Kind Regards
Simon...
2 years, 10 months
Single Peer in Gluster Cluster Failure caused Storage Domain outage
by simon＠justconnect.ie
Hi All,
We have a 3 node HCI cluster with Gluster 2+1 volumes.
The first node had a hardware memory failure which caused file corruption to the engine lv and the server would only boot into maintenance mode.
For some reason glusterd wouldn't start and one of the volumes became inaccessible with the Storage domain going offline. This caused multiple VMs to go into a paused or shutdown state.
Putting the host into maintenance mode and then shutting it down was done in an attempt to allow gluster to continue across 2 nodes (one being the arbiter). Unfortunately this didn't work.
The solution was to do the following:
1. Remove the contents of /var/lib/glusterd except for glusterd.info
2. Start glusterd
3. Peer probe one of the other 2 peers
4. Restart glusterd
5. Cross fingers and toes
Although this was a successful outcome I would like to know why losing 1 gluster peer caused the outage of a single storage domain and therefore outages of VMs with disks on that storage domain.
Kind Regards
Simon...
2 years, 10 months
Problem with engine deployment
by varekoarfa＠gmail.com
HI everyone, hope all is good.
OS: Centos Stream
ovirt 4.5
I'm having problems deploying the hosted engine both through cockpit and cli.
I have 3 servers, where through cockpit, I have managed to configure and deploy glusterfs without problems. but when I want to deploy the hosted engine it tells me "No valid network interface has been found".
the 3 servers have 2 nic each one, I have created a bond in each one with cockpit and with the name bond0 and in XOR mode.
if someone can help me, please.
ansible packages installed:
[root@vs05 pre_checks]# rpq -qa | ansi
-bash: ansi: no se encontró la orden
-bash: rpq: no se encontró la orden
[root@vs05 pre_checks]# rpq -qa |grep ansi
-bash: rpq: no se encontró la orden
[root@vs05 pre_checks]# rpm -qa |grep ansi
ansible-collection-ansible-posix-1.3.0-1.2.el8.noarch
ansible-collection-ansible-netcommon-2.2.0-3.2.el8.noarch
ansible-collection-ansible-utils-2.3.0-2.2.el8.noarch
gluster-ansible-maintenance-1.0.1-12.el8.noarch
gluster-ansible-features-1.0.5-15.el8.noarch
ovirt-ansible-collection-2.1.0-1.el8.noarch
gluster-ansible-cluster-1.0-5.el8.noarch
gluster-ansible-repositories-1.0.1-5.el8.noarch
ansible-core-2.12.7-1.el8.x86_64
gluster-ansible-roles-1.0.5-28.el8.noarch
gluster-ansible-infra-1.0.4-22.el8.noarch
2 years, 10 months
Q: "vdsm-client Host getAllTasksInfo" Fails (Removing frozen task)
by Andrei Verovski
Hi,
I have frozen task (creating snapshot) on one of my oVirt nodes, and trying to kill it.
However,
# sudo vdsm-client Host getAllTasksInfo
vdsm-client: Command Host.getAllTasksInfo with args {} failed:
However, sudo "vdsm-client Host getVMList” and "sudo vdsm-client Host getVMFullList" working fine.
# /usr/share/ovirt-engine/setup/dbutils/taskcleaner.sh -v -Z
select exists (select * from information_schema.tables where table_schema = 'public' and table_name = 'command_entities');
t
SELECT command_id,command_type,root_command_id,command_parameters,command_params_class,created_at,status,return_value,return_value_class,executed FROM GetAllCommandsWithZombieTasks();
So only letter “t” is printed and it is not clear what does it mean.
I can run "/usr/share/ovirt-engine/setup/dbutils/taskcleaner.sh -vR” but not sure its not too destructive.
What is the problem with "vdsm-client Host getAllTasksInfo” ?
Thanks in advance.
Andrei
2 years, 10 months
Host certificate expired
by Rob B
Hi,
We have a ovirt host in a 'Unassigned' state because its certificate has expired.
The ovirt events show...
VDSM host1 command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed
This is the only host in the cluster, and has local storage so I don't have any options to start the single VM elsewhere.
Is there a way to renew the certificate on this host? I have no option to put the host in maintenance mode and 'Enroll Certificate' as its in the unassigned state.
The oVirt manager is running version: 4.4.10.7-1.el8
The oVirt host in the bad state is running: ovirt-host-4.4.9-2, vdsm-4.40.100.2-1.
Please let me know if you need any more info, and thanks in advance.
Rob
2 years, 10 months
HostedEngine Restore woes
by simon＠justconnect.ie
Hi All,
I've been asked to test the HE restore process but after taking a look at the documentation I'm afraid I'm none the wiser.
I thought there would be a simple 'restore in situ' option but it appears not.
My environments were build using ansible with a hostedengine .json answer file.
From what I've read so far it appears that a new HE VM needs to be built with new engine storage etc
2 years, 10 months
Re: Six node HCI
by Strahil Nikolov
It would make more sense to odentify the root cause.Can you check if all oVirt nodes are in the TSP:gluster pool listAlso, check that the Engine's volume is available from all nodes -> should be mounted and listable:ls -l /rhev/data-center/mnt/glusterSD/<host>:_<volume name>
Best Regards,Strahil Nikolov
On Tue, Aug 2, 2022 at 8:45, Gaurang Patel<gaurang.patel(a)allotgroup.com> wrote: <!--#yiv2856725588 _filtered {} _filtered {} _filtered {}#yiv2856725588 #yiv2856725588 p.yiv2856725588MsoNormal, #yiv2856725588 li.yiv2856725588MsoNormal, #yiv2856725588 div.yiv2856725588MsoNormal {margin:0cm;font-size:11.0pt;font-family:"Calibri", sans-serif;}#yiv2856725588 span.yiv2856725588EmailStyle17 {font-family:"Calibri", sans-serif;color:windowtext;}#yiv2856725588 .yiv2856725588MsoChpDefault {font-family:"Calibri", sans-serif;} _filtered {}#yiv2856725588 div.yiv2856725588WordSection1 {}-->
Hi,
I am very new to Ovirt 6 Node Gluster.
We can create three node cluster successfully with the 4.5.1 version but after expanding the gluster cluster with additional 3 nodes, Ovirt-engine is going to not responding mode.
If you can help me with step by step document would be very greatful to us.
Thank in advance.
Gaurang Patel
DISCLAIMER : The content of this email is confidential and intended for the recipient specified in message only. It is strictly forbidden to share any part of this message with any third party, without a written consent of the sender. If you received this message by mistake, please reply to this message and follow with its deletion, so that we can ensure such a mistake does not occur in the future._______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/S7KBUPG2KPX...
2 years, 10 months
Moving raw/sparse disk from NFS to iSCSI fails on oVirt 4.5.1
by Guillaume Pavese
On a 4.5.1 DC, I have imported a vm and its disk from an old 4.3 DC
(through an export domain if that's relevant)
The DC/Cluster compat level is 4.7 and the vm was upgraded to it.
"Original custom compatibility version 4.3 of imported VM xxx is not
supported. Changing it to the lowest supported version: 4.7."
The disk is raw and sparse :
<format>raw</format>
<sparse>true</sparse>
I initially put the VM's disks on an NFS storage domain, but I want to move
the disks to an iSCSI one
However, after copying data for a while the task fails "User has failed to
move disk VM-TEMPLATE-COS7_Disk1 to domain iSCSI-STO-FR-301"
in engine.log :
qemu-img: error while writing at byte xxx: No space left on device
2022-07-21 08:58:23,240+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-48)
[65fed1dc-e33b-471e-bc49-8b9662400e5f] FINISH, GetHostJobsVDSCommand,
return:
{0aa2d519-8130-4e2f-bc4f-892e5f7b5206=HostJobInfo:{id='0aa2d519-8130-4e2f-bc4f-892e5f7b5206',
type='storage', description='copy_data', status='failed', progress='79',
error='VDSError:{code='GeneralException', message='General Exception:
("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T',
'none', '-f', 'raw', '-O', 'qcow2', '-o', 'compat=1.1',
'/rhev/data-center/mnt/svc-int-prd-sto-fr-301.hostics.fr:_volume1_ovirt-int-2_data/1ce95c4a-2ec5-47b7-bd24-e540165c6718/images/d3c33cc7-f2c3-4613-84d0-d3c9fa3d5ebd/2c4a0041-b18b-408f-9c0d-971c19a552ea',
'/rhev/data-center/mnt/blockSD/b5dc9c01-3749-4326-99c5-f84f683190bd/images/d3c33cc7-f2c3-4613-84d0-d3c9fa3d5ebd/2c4a0041-b18b-408f-9c0d-971c19a552ea']
failed with rc=1 out=b'' err=bytearray(b'qemu-img: error while writing at
byte 13639873536: No space left on device\\n')",)'}'}}, log id: 73f77495
2022-07-21 08:58:23,241+02 INFO
[org.ovirt.engine.core.bll.StorageJobCallback]
(EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-48)
[65fed1dc-e33b-471e-bc49-8b9662400e5f] Command CopyData id:
'521bdf57-8379-40ce-a682-af859fb0cad7': job
'0aa2d519-8130-4e2f-bc4f-892e5f7b5206' execution was completed with VDSM
job status 'failed'
I do want the conversion from raw/sparse to qcow2/sparse to happen, as I
want to activate incremental backups.
I think that it may fail because the virtual size is bigger than the
initial size, as I think someone as explained on this list earlier? Can
anybody confirm?
It seems to be a pretty common use case to support though?
Guillaume Pavese
Ingénieur Système et Réseau
Interactiv-Group
--
Ce message et toutes les pièces jointes (ci-après le “message”) sont
établis à l’intention exclusive de ses destinataires et sont confidentiels.
Si vous recevez ce message par erreur, merci de le détruire et d’en avertir
immédiatement l’expéditeur. Toute utilisation de ce message non conforme a
sa destination, toute diffusion ou toute publication, totale ou partielle,
est interdite, sauf autorisation expresse. L’internet ne permettant pas
d’assurer l’intégrité de ce message . Interactiv-group (et ses filiales)
décline(nt) toute responsabilité au titre de ce message, dans l’hypothèse
ou il aurait été modifié. IT, ES, UK.
<https://interactiv-group.com/disclaimer.html>
2 years, 10 months
The node host enters emergency mode
by BJ一哥
ovirt 4.5.1
After the kernel SR-IOV is started and the host is restarted, the host will
enter emergency mode. When journalctl -xb is used, the engine mount fails
mount:/gluster_bricks/engine:mount(2)system call failed:structure needs
cleaning
You need to manually annotate /etc/fstab to mount the engine volume to
enter the system normally.
https://s1.328888.xyz/2022/08/03/OomMy.png
2 years, 10 months
User login issues - version 4.5.1
by itforums51＠gmail.com
hi all,
new fresh installation version 4.5.1
I've created a dummy user, using ovirt-aaa-jdbc-tool. Reset the password and added it to a role from within the hosted-engine.
when I attempt to logon to the portal using: user1@ovirt I get the following message in /var/log/ovirt-engine/keycloak.log:
It must be something stupid I am missing, but I just cannot figure out what is wrong.
Suggestions/recommendations are greatly appreciated.
2022-08-01 13:04:46,133Z WARN [org.keycloak.events] (default task-70) [] type=LOGIN_ERROR, realmId=bb5ae6fa-bc18-470c-bfde-1af5fa7c1e28, clientId=ovirt-engine-internal, userId=null, ipAddress=X.X.X.X, error=user_not_found, auth_method=openid-connect, auth_type=code, redirect_uri=https://ovirt-engine1.ukteam.lab/ovirt-engine/callback, code_id=5f0eb48d-46d8-4bed-97fe-2649916ff0f9, username=user1@localhost, authSessionParentId=5f0eb48d-46d8-4bed-97fe-2649916ff0f9, authSessionTabId=dl7mnpAO5KY
# ovirt-aaa-jdbc-tool user show user1
Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false
-- User user1(a3579138-7c51-4573-a09e-18b0a42812b6) --
Namespace: *
Name: user1
ID: a3579138-7c51-4573-a09e-18b0a42812b6
Display Name:
Email: user1@localhost
First Name: user
Last Name: dummy
Department:
Title:
Description:
Account Disabled: false
Account Locked: false
Account Unlocked At: 1970-01-01 00:00:00Z
Account Valid From: 2022-08-01 12:59:33Z
Account Valid To: 2222-08-01 12:59:33Z
Account Without Password: false
Last successful Login At: 1970-01-01 00:00:00Z
Last unsuccessful Login At: 1970-01-01 00:00:00Z
Password Valid To: 2222-06-11 18:50:23Z
2 years, 10 months
login error via active directory
by adam_xu＠adagene.com.cn
Hi Ovirt list,
I have a fresh installed ovirt cluster. Version 4.5.1.3
And I ran " ovirt-engine-extension-aaa-ldap-setup” to attach an AD successfully.
First question is:
When I click “Administration Portal”, the login page jumped to https://engine.example.com/ovirt-engine-auth/realms/ovirt-internal/protoc... <https://engine.example.com/ovirt-engine-auth/realms/ovirt-internal/protoc...> &scope=openid&client_id=ovirt-engine-internal&state=pWm6gymCKh9eW-pq1P5PSdvSeUY&redirect_uri=https%3A%2F%2Fengine.adagene.cn%2Fovirt-engine%2Fcallback&nonce=Rnx6mYrKjBLP0bEnPEUKAjE0jQ96IaJIz6IY7j8a4b0
Not the https://engine.example.com/ovirt-engine/sso/login.html page.
I removed the httpd conf file /etc/httpd/conf.d/internalsso-openidc.conf and restart httpd. This time, it jumped to https://engine.example.com/ovirt-engine/sso/login.html
�
The second question:
When I try to login via Active Directory accounts, it said：
server_error: Missing parameter: 'params'
�
here’s some logs in engine.log
2022-08-02 13:43:54,686+08 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-8) [38f1f346] Lock freed to object 'EngineLock:{exclusiveLocks='[7ae0fbd3-c2fb-4a82-8d36-6c88c5bce900=PROVIDER]', sharedLocks=''}'
2022-08-02 13:46:47,451+08 ERROR [org.ovirt.engine.core.sso.servlets.InteractiveAuthServlet] (default task-3) [] Internal Server Error: Missing parameter: 'params'
2022-08-02 13:46:47,451+08 ERROR [org.ovirt.engine.core.sso.service.SsoService] (default task-3) [] Missing parameter: 'params'
2022-08-02 13:46:47,632+08 ERROR [org.ovirt.engine.core.aaa.servlet.SsoPostLoginServlet] (default task-3) [] server_error: Missing parameter: 'params'
2022-08-02 13:47:18,747+08 ERROR [org.ovirt.engine.core.sso.servlets.InteractiveAuthServlet] (default task-3) [] Internal Server Error: Missing parameter: 'params'
2022-08-02 13:47:18,747+08 ERROR [org.ovirt.engine.core.sso.service.SsoService] (default task-3) [] Missing parameter: 'params'
2022-08-02 13:47:46,550+08 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedScheduledExecutorService-engineThreadMonitoringThreadPool-Thread-1) [] Thread pool 'default' is using 0 threads out of 1, 5 threads waiting for tasks.
�
I need your help.
2 years, 10 months
disk pending in "finalizing" state
by Diego Ercolani
ovirt-engine-4.5.1.3-1.el8.noarch
Hello I have a situation where a disk is stuck in finalizing state derived by trying to backup via veeam.
backup process is interrupted and I have cleared the job states with the dbutils scripts (/usr/share/ovirt-engine/setup/dbutils/task_cleaner.sh) even if the script didn't advice about any pending job...
I tryied to unlock_entity of the disk but for the script there is no disk locked.
In the ovirt-engine gui, the disk is "finalizing"
And I'm stuck here
Can someone address me somewhere?
2 years, 10 months
Authentication with Active Directory
by Alireza Eskandari
Hi all,
I'm trying to connect an active directory to my ovirt for authentication.
But the base DN of my active directory is not the default one so I need to
specify it in ovirt configuration to find users.
How can I configure it?
In my current configuration when I try to login, I get this message:
server_error: Cannot resolve principal 'xxxx(a)yy.zz'
Regards,
Alireza
2 years, 10 months
ovirt-engine manager, certificate issue
by david
hello
I have a problem to log in to ovirt-engine manager in my browser
the warning message in the browser display me this text:
PKIX path validation failed: java.security.cert.CertPathValidatorException:
validity check failed
to solve this problem I am offered to run engine-setup
and here is a question: the engine-setup will have no impact to the
hosts(hypervisors) working?
ovirt version 4.4.4.7-1.el8
thanks
2 years, 10 months
Make QXL the default
by Colin Coe
Hey all
We've just updated to RHV4.4SP1 (aka 4.5) from v4.4 and now our ansible
workflows are failing with:
cannot run VM. Selected display type is not supported by the operating
system
The OS are RHEL6 and RHEL7 (no, I can't change this as the software stack
only works with these)
I couldn't find anything in the ansible ovirt collection to change from VGA
to QXL.
Any ideas on how I can make QXL the default instead of VGA? Maybe a DB
change?
Thanks
2 years, 10 months
Issue with oVirt 4.5 and Data Warehouse installed on a Separate Machine
by Igor Davidoff
Hello,
i have an issue with 'engine-seup' step on DWH (separate server) aufter upgrade from 4.4.10 to 4.5.
It looks like the ovirt-engine-setup are looking for rpm-package 'ovirt-engine' instead of 'ovirt-engine-dwh'.
the reporting error is:
"
--== END OF CONFIGURATION ==--
[ INFO ] Stage: Setup validation
[ ERROR ] Failed to execute stage 'Setup validation': Command '/usr/bin/rpm' failed to execute
[ INFO ] Stage: Clean up
Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20220502100751-fqwb07.log
[WARNING] Remote engine was not configured to be able to access DWH, please check the logs.
[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20220502101130-setup.conf'
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
[ ERROR ] Execution of setup failed
"
in Setup log i found:
"
2022-05-02 10:11:30,000+0000 DEBUG otopi.context context._executeMethod:127 Stage validation METHOD otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages.Plugin._validation
2022-05-02 10:11:30,001+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.executeRaw:813 execute: ('/usr/bin/rpm', '-q', '--queryformat=%{version}-%{release}', 'ovirt-engine'), executable='None', cwd='None', env=None
2022-05-02 10:11:30,013+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.executeRaw:863 execute-result: ('/usr/bin/rpm', '-q', '--queryformat=%{version}-%{release}', 'ovirt-engine'), rc=1
2022-05-02 10:11:30,013+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.execute:921 execute-output: ('/usr/bin/rpm', '-q', '--queryformat=%{version}-%{release}', 'ovirt-engine') stdout:
package ovirt-engine is not installed
2022-05-02 10:11:30,013+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.execute:926 execute-output: ('/usr/bin/rpm', '-q', '--queryformat=%{version}-%{release}', 'ovirt-engine') stderr:
2022-05-02 10:11:30,013+0000 DEBUG otopi.context context._executeMethod:145 method exception
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod
method['method']()
File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine-common/distro-rpm/packages.py", line 463, in _validation
oenginecons.Const.ENGINE_PACKAGE_NAME,
File "/usr/lib/python3.6/site-packages/otopi/plugin.py", line 931, in execute
command=args[0],
RuntimeError: Command '/usr/bin/rpm' failed to execute
2022-05-02 10:11:30,015+0000 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Setup validation': Command '/usr/bin/rpm' failed to execute
"
usually the upgrade of minor versions in 4.4 was just:
# yum update ovirt\*setup\*
# engine-setup
# yum update
as it did not work, i tried the fresh installation of centos8 stream and recovery of DWH Database and configuration:
# engine-backup --mode=restore --file=backup.bck --provision-all-databases
-> no luck
the last idea was fresh installation centos8 stream + fresh installation of ovirt-engine-dwh 4.5 (without recovery)
-> the same error.
the engine side works fine.
i compared the current setup logs with the installation and all the minor upgrades of ovirt-engine-dwh before 4.5
and only found the rpm-validation for the package 'ovirt-engine-dwh':
"
2022-02-08 16:11:29,846+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.executeRaw:813 execute: ('/usr/bin/rpm', '-q', 'ovirt-engine-dwh'), executable='None', cwd='None', env=None
2022-02-08 16:11:29,877+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.executeRaw:863 execute-result: ('/usr/bin/rpm', '-q', 'ovirt-engine-dwh'), rc=0
2022-02-08 16:11:29,878+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.execute:921 execute-output: ('/usr/bin/rpm', '-q', 'ovirt-engine-dwh') stdout:
ovirt-engine-dwh-4.4.10-1.el8.noarch
2022-02-08 16:11:29,878+0000 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine_common.distro-rpm.packages plugin.execute:926 execute-output: ('/usr/bin/rpm', '-q', 'ovirt-engine-dwh') stderr:
2022-02-08 16:11:29,878+0000 DEBUG otopi.transaction transaction.commit:152 committing 'DWH Engine database Transaction'
"
It looks like engine-setup knows it is the DWH-Server, but is trying to validate the wrong rpm package.
Any Ideas, how to work around this.
Thank you!
2 years, 10 months
Obsoleting Packages in 'dnf check-update' on RHEL 8.6 hosts
by Scott Worthington
Hello,
My 4.5.1.3-1.el8 oVirt homelab cluster is running on RHEL 8.6 hosts and a
RHEL 8.6 stand-alone engine.
During the installation, I followed the instructions for RHEL 8.6:
https://ovirt.org/download/install_on_rhel.html
After the installation is complete, all packages are up-to-date, and
everything is running, I run a 'dnf check-upgrade' and I find there are
two packages that are listed under "Obsoleting Packages":
"""
Last metadata expiration check: 0:43:06 ago on Mon 01 Aug 2022 08:08:50 AM
EDT.
Obsoleting Packages
centos-stream-release.noarch 8.6-1.el8
@@System
centos-stream-release.noarch 8.6-1.el8
@@System
centos-stream-release.noarch 8.6-1.el8
@@System
redhat-release.x86_64 8.6-0.1.el8
@rhel-8-for-x86_64-baseos-rpms
"""
For the hosts, it makes it appear that the hosts always have an upgrade
pending in the oVirt Engine UI.
"centos-strea-release.noarch" appears to contain similar files to the
original RHEL 8.6 package "redhat-release-8.6.0.1.el8" except for the
addition of "centos*" named files.
Any thoughts on how to change this behavior so that it doesn't appear to
have packages to upgrade because a 'dnf update' does nothing to these
"Obsoleting Packages"?
Thanks in advance.
2 years, 10 months
Dark Mode
by Dean L
Is there a way to place oVirt in Dark Mode? It's one of those things I really like about moVirt. :)
Thanks!
2 years, 10 months
Gluster volume "deleted" by accident --- Is it possible to recover?
by itforums51＠gmail.com
hi everyone,
I have a 3x node ovirt 4.4.6 cluster in HC setup.
Today I was intending to extend the data and vmstore volume adding another brick each; then by accident I pressed the "cleanup" button. Basically it looks that the volume were deleted.
I am wondering whether there is a process of trying to recover these volumes and therefore all VMs (including the Hosted-Engine).
```
lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
gluster_lv_data gluster_vg_sda4 Vwi---t--- 500.00g gluster_thinpool_gluster_vg_sda4
gluster_lv_data-brick1 gluster_vg_sda4 Vwi-aot--- 500.00g gluster_thinpool_gluster_vg_sda4 0.45
gluster_lv_engine gluster_vg_sda4 -wi-a----- 100.00g
gluster_lv_vmstore gluster_vg_sda4 Vwi---t--- 500.00g gluster_thinpool_gluster_vg_sda4
gluster_lv_vmstore-brick1 gluster_vg_sda4 Vwi-aot--- 500.00g gluster_thinpool_gluster_vg_sda4 0.33
gluster_thinpool_gluster_vg_sda4 gluster_vg_sda4 twi-aot--- <7.07t 11.46 0.89
```
I would appreciate any advice.
TIA
2 years, 10 months
