April 2023 - Users - oVirt List Archives

Installing oVirt on RHEL vs CentOS Stream, Alma or Rocky Linux
by Richard W.M. Jones 06 Oct '25

06 Oct '25

I'm still struggling to get oVirt installed. It absolutely will not install on RHEL 8, the documentation here is flat out wrong: https://www.ovirt.org/documentation/installing_ovirt_as_a_standalone_manage… javapackages-tools is not a module that exists in RHEL 8. Apparently it's a CentOS PowerTools module. Since original CentOS no longer really exists either, does anyone have any opinions or experience with installing oVirt on any of: - CentOS Stream 8 - Alma Linux 8.5 - Rocky Linux Alma in particular looks like a straight replacement for old CentOS. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-top is 'top' for virtual machines. Tiny program with many powerful monitoring features, net stats, disk stats, logging, etc. http://people.redhat.com/~rjones/virt-top

8 10

Error when deploy Ovirt4.4 Hosted Engine
by staybox＠gmail.com 17 Feb '25

17 Feb '25

Hello, I get error, need help. [ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The conditional check 'not ipv6_deployment|bool and route_rules_ipv4.stdout | from_json | selectattr('priority', 'equalto', 100) | selectattr('dst', 'equalto', virbr_cidr_ipv4 | ipaddr('address') ) | list | length == 0' failed. The error was: error while evaluating conditional (not ipv6_deployment|bool and route_rules_ipv4.stdout | from_json | selectattr('priority', 'equalto', 100) | selectattr('dst', 'equalto', virbr_cidr_ipv4 | ipaddr('address') ) | list | length == 0): 'dict object' has no attribute 'dst'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/bootstrap_local_vm/01_prepare_routing_rules.yml': line 81, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n changed_when: true\n - name: Add IPv4 inbound route rules\n ^ here\n"}

4 4

How to list all snapshots?
by jorgevisentini＠gmail.com 14 Feb '25

14 Feb '25

Hello everyone! First, I would like to thank everyone involved in this wonderful project. I leave here my sincere thanks! Does anyone know if it is possible to list all snapshots automatically? It can be by ansible, python, shell... any way that helps to list them all without having to enter Domain by Domain. Thank you all!

4 3

snapshot solution: Existing snapshots that were taken after this one will be erased.
by dhanaraj.ramesh＠yahoo.com 29 Jan '25

29 Jan '25

Hi Team, when I want to commit the older snapshots I'm getting warning stating " Existing snapshots that were taken after this one will be erased.". is there any way we can retain the latest snapshots as is in the chain? I knew cloning and template export options are there to secure that latest snapshot data but these are will consume additional space in storage and take time.

4 3

Restart oVirt-Engine
by Jeremey Wise 09 Jan '25

09 Jan '25

How ,without reboot of hosting system, do I restart the oVirt engine? # I tried below but do not seem to effect the virtual machine [root@thor iso]# systemctl restart ov ovirt-ha-agent.service ovirt-imageio.service ovn-controller.service ovs-delete-transient-ports.service ovirt-ha-broker.service ovirt-vmconsole-host-sshd.service ovsdb-server.service ovs-vswitchd.service [root@thor iso]# # You cannot restart the VM " HostedEngine " as it responses: Error while executing action: HostedEngine: - Cannot restart VM. This VM is not managed by the engine. Reason is I had to do some work on a node. Reboot it.. it is back up.. network is all fine.. Cockpit working fine... and gluster fine.. But oVirt-Engine refuses to accept the node is up. -- p <jeremey.wise(a)gmail.com>enguinpages

4 4

Unable to access ovirt Admin Screen from ovirt Host
by louisb＠ameritech.net 07 Dec '24

07 Dec '24

I've reinstalled ovirt 4.4 on my server remotely via cockpit terminal. I'm able to access the ovirt admin screen remotely from the laptop that I used for the install. However, using the same URL I'm unable to gain access to the admin screen. Following the instruction in the documentation I've modified the file: /etc/ovirt-engine/engine.conf.d/99-custom-sso-setup.conf, to reflect the DNS name and I enter in the IP address. But I'm still unable to access the screen from the server console. What else needs to change in order to gain access from the server console? Thanks

5 8

SPM and Task error ...
by Enrico 22 Nov '24

22 Nov '24

Hi all, my ovirt cluster has got 3 Hypervisors runnig Centos 7.5.1804 vdsm is 4.20.39.1-1.el7, ovirt engine is 4.2.4.5-1.el7, the storage systems are HP MSA P2000 and 2050 (fibre channel). I need to stop one of the hypervisors for maintenance but this system is the storage pool manager. For this reason I decided to manually activate SPM in one of the other nodes but this operation is not successful. In the ovirt engine (engine.log) the error is this: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. while in the hypervisor (SPM) vdsm.log: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 *ERROR* [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::logEndTaskFailure: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended with failure: 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,751+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 34ae2b2f 2019-07-25 12:39:18,752+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 34ae2b2f 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::onTaskEndSuccess: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended successfully. 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 42de0c2b 2019-07-25 12:39:18,759+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 42de0c2b 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Fri May 03 14:48:50 CEST 2019' 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,765+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: da77af2 2019-07-25 12:39:18,766+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: da77af2 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned there is some relation between this error and a task that has remained hanging, from SPM server: # vdsm-client Task getInfo taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "verb": "prepareMerge", "id": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e" } # vdsm-client Task getStatus taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "message": "running job 1 of 1", "code": 0, "taskID": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e", "taskResult": "", "taskState": "running" } How can I solve this problem ? Thanks a lot for your help !! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it _______________________________________________________________________

5 15

oVirt networks
by Enrico Becchetti 28 Aug '24

28 Aug '24

Dear all, Ineed your help to understand how to configure the network of a new oVirt cluster. Mynew system will have a 4.3 engine thatruns in a virtual machine, andsome Dell R7525 AMD EPYC hypervisors, eachholding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3. As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center. This is a simplified scheme: My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput. This cluster will have two virtual networks, one forovirt management and one for the traffic of individual virtual machines. With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet. With the ovirt web interface I can createan active-passive "Mode 1" bond, but this won'tallow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies. This is an example with active passive configuration: Can you tell me if ovirt can generate//nested bonds? Or do you have other solutions ? Thanks a lot ! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________

5 6

boot from cdrom & error code 0005
by edp＠maddalena.it 21 Aug '24

21 Aug '24

Hi. I have created a new storage domain (data domain, storage type nfs) to use it to upload iso images. I have so uploaded a new iso and then attach the iso to a new vm. But when I try to boot the vm I obtain this error: booting from dvd/cd... boot failed: could not read from cdrom (code 0005) no bootable device The iso file has been uploaded with success in the data storage domain and so the vm lets my attach the iso to the vm in the boot settings. Can you help me? Thank you

4 6

VM Migration Failed
by KSNull Zero 10 Jul '24

10 Jul '24

Running oVirt 4.4.5 VM cannot migrate between hosts. vdsm.log contains the following error: libvirt.libvirtError: operation failed: Failed to connect to remote libvirt URI qemu+tls://ovhost01.local/system: authentication failed: Failed to verify peer's certificate Certificates on hosts was renewed some time ago. How this issue can be fixed ? Thank you.

4 6

How to re-enroll (or renew) host certificates for a single-host hosted-engine deployment?
by Derek Atkins 28 Jun '24

28 Jun '24

Hi, I've got a single-host hosted-engine deployment that I originally installed with 4.0 and have upgraded over the years to 4.3.10. I and some of my users have upgraded remote-viewer and now I get an error when I try to view the console of my VMs: (remote-viewer:8252): Spice-WARNING **: 11:30:41.806: ../subprojects/spice-common/common/ssl_verify.c:477:openssl_verify: Error in server certificate verification: CA signature digest algorithm too weak (num=68:depth0:/O=<My Org Name>/CN=<Host's Name>) I am 99.99% sure this is because the old certs use SHA1. I reran engine-setup on the engine and it asked me if I wanted to renew the PKI, and I answered yes. This replaced many[1] of the certificates in /etc/pki/ovirt-engine/certs on the engine, but it did not update the Host's certificate. All the documentation I've seen says that to refresh this certificate I need to put the host into maintenance mode and then re-enroll.. However I cannot do that, because this is a single-host system so I cannot put the host in local mode -- there is no place to migrate the VMs (let alone the Engine VM). So.... Is there a command-line way to re-enroll manually and update the host certs? Or some other way to get all the leftover certs renewed? Thanks, -derek [1] Not only did it not update the Host's cert, it did not update any of the vmconsole-proxy certs, nor the certs in /etc/pki/ovirt-vmconsole/, and obviously nothing in /etc/pki/ on the host itself. -- Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant

8 16

4.5.4 with Ceph only storage
by Maurice Burrows 25 Jun '24

25 Jun '24

Hey ... A long story short ... I have an existing Red Hat Virt / Gluster hyperconverged solution that I am moving away from. I have an existing Ceph cluster that I primarily use for OpenStack and a small requirement for S3 via RGW. I'm planning to build a new oVirt 4.5.4 cluster on RHEL9 using Ceph for all storage requirements. I've read many online articles on oVirt and Ceph, and they all seem to use the Ceph iSCSI gateway, which is now in maintenance, so I'm not real keen to commit to iSCSI. So my question is, IS there any reason I cannot use CephFS for both hosted-engine and as a data storage domain? I'm currently running Ceph Pacific FWIW. Cheers

5 10

Changing disk QoS causes segfault with IO-Threads enabled (oVirt 4.3.0.4-1.el7)
by jloh＠squiz.net 23 Apr '24

23 Apr '24

We recently upgraded to 4.3.0 and have found that when changing disk QoS settings on VMs whilst IO-Threads is enabled causes them to segfault and the VM to reboot. We've been able to replicate this across several VMs. VMs with IO-Threads disabled/turned off do not segfault when changing the QoS. Mar 1 11:49:06 srvXX kernel: IO iothread1[30468]: segfault at fffffffffffffff8 ip 0000557649f2bd24 sp 00007f80de832f60 error 5 in qemu-kvm[5576498dd000+a03000] Mar 1 11:49:06 srvXX abrt-hook-ccpp: invalid number 'iothread1' Mar 1 11:49:11 srvXX libvirtd: 2019-03-01 00:49:11.116+0000: 13365: error : qemuMonitorIORead:609 : Unable to read from monitor: Connection reset by peer Happy to supply some more logs to someone if they'll help but just wondering whether anyone else has experienced this or knows of a current fix other than turning io-threads off. Cheers.

4 3

Deploy oVirt Engine fail behind proxy
by Matteo Bonardi 21 Mar '24

21 Mar '24

Hi, I am trying to deploy the ovirt engine following self-hosted engine installation procedure on documentation. Deployment servers are behind a proxy and I have set it in environment and in yum.conf before run deploy. Deploy fails because ovirt engine vm cannot resolve AppStream repository url: [ INFO ] TASK [ovirt.engine-setup : Install oVirt Engine package] [ ERROR ] fatal: [localhost -> ovirt-manager.mydomain]: FAILED! => {"changed": false, "msg": "Failed to download metadata for repo 'AppStream': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=AppStream&infra=st… [Could not resolve host: mirrorlist.centos.org]", "rc": 1, "results": []} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Clean local storage pools] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20201109165237.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20201109164244-b3e8sd.log How I can set proxy for the engine vm? Ovirt version: [root@myhost ~]# rpm -qa | grep ovirt-engine-appliance ovirt-engine-appliance-4.4-20200916125954.1.el8.x86_64 [root@myhost ~]# rpm -qa | grep ovirt-hosted-engine-setup ovirt-hosted-engine-setup-2.4.6-1.el8.noarch OS version: [root@myhost ~]# cat /etc/centos-release CentOS Linux release 8.2.2004 (Core) [root@myhost ~]# uname -a Linux myhost.mydomain 4.18.0-193.28.1.el8_2.x86_64 #1 SMP Thu Oct 22 00:20:22 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux Thanks for the help. Regards, Matteo

7 20

The oVirt Counter
by Sandro Bonazzola 21 Feb '24

21 Feb '24

Hi, for those who remember the Linux Counter project, if you'd like other to know you're using oVirt and know some details about your deployment, here's a way to count you in: https://ovirt.org/community/ovirt-counter.html Enjoy! -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D PERFORMANCE & SCALE Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 1

Cannot restart ovirt after massive failure.
by Gilboa Davara 18 Jan '24

18 Jan '24

Hello all, During the night, one of my (smaller) setups, a single node self hosted engine (localhost NFS) crashed due to what-looks-like a massive disk failure (Software RAID6, with 10 drives + spare). After a reboot, I let the RAID resync with a fresh drive) and went on to start oVirt. However, no such luck. Two issues: 1. ovirt-ha-broker fails due to broken hosted engine state (log attached). 2. ovirt-ha-agent fails due to network test (tcp) even though both remote-host and DNS servers are active. (log attached). Two questions: 1. Can I somehow force the agent to disable the network liveliness test? 2. Can I somehow force the broker to rebuild / fix the hosted engine state? - Gilboa

4 17

Please, Please Help - New oVirt Install/Deployment Failing - "Host is not up..."
by Matthew J Black 18 Jan '24

18 Jan '24

Hi Everyone, Could someone please help me - I've been trying to do an install of oVirt for *weeks* (including false starts and self-inflicted wounds/errors) and it is still not working. My setup: - oVirt v4.5.3 - A brand new fresh vanilla install of RockyLinux 8.6 - all working AOK - 2*NICs in a bond (802.3ad) with a couple of sub-Interfaces/VLANs - all working AOK - All relevant IPv4 Address in DNS with Reverse Lookups - all working AOK - All relevant IPv4 Address in "/etc/hosts" file - all working AOK - IPv6 (using "method=auto" in the interface config file) enabled on the relevant sub-Interface/VLAN - I'm not using IPv6 on the network, only IPv4, but I'm trying to cover all the bases. - All relevant Ports (as per the oVirt documentation) set up on the firewall - ie firewall-cmd --add-service={{ libvirt-tls | ovirt-imageio | ovirt-vmconsole | vdsm }} - All the relevant Repositories installed (ie RockyLinux BaseOS, AppStream, & PowerTools, and the EPEL, plus the ones from the oVirt documentation) I have followed the oVirt documentation (including the special RHEL-instructions and RockyLinux-instructions) to the letter - no deviations, no special settings, exactly as they are written. All the dnf installs, etc, went off without a hitch, including the "dnf install centos-release-ovirt45", "dnf install ovirt-engine-appliance", and "dnf install ovirt-hosted-engine-setup" - no errors anywhere. Here is the results of a "dnf repolist": - appstream Rocky Linux 8 - AppStream - baseos Rocky Linux 8 - BaseOS - centos-ceph-pacific CentOS-8-stream - Ceph Pacific - centos-gluster10 CentOS-8-stream - Gluster 10 - centos-nfv-openvswitch CentOS-8 - NFV OpenvSwitch - centos-opstools CentOS-OpsTools - collectd - centos-ovirt45 CentOS Stream 8 - oVirt 4.5 - cs8-extras CentOS Stream 8 - Extras - cs8-extras-common CentOS Stream 8 - Extras common packages - epel Extra Packages for Enterprise Linux 8 - x86_64 - epel-modular Extra Packages for Enterprise Linux Modular 8 - x86_64 - ovirt-45-centos-stream-openstack-yoga CentOS Stream 8 - oVirt 4.5 - OpenStack Yoga Repository - ovirt-45-upstream oVirt upstream for CentOS Stream 8 - oVirt 4.5 - powertools Rocky Linux 8 - PowerTools So I kicked-off the oVirt deployment with: "hosted-engine --deploy --4 --ansible-extra-vars=he_offline_deployment=true". I used "--ansible-extra-vars=he_offline_deployment=true" because without that flag I was getting "DNF timout" issues (see my previous post `Local (Deployment) VM Can't Reach "centos-ceph-pacific" Repo`). I answer the defaults to all of questions the script asked, or entered the deployment-relevant answers where appropriate. In doing this I double-checked every answer before hitting <Enter>. Everything progressed smoothly until the deployment reached the "Wait for the host to be up" task... which then hung for more than 30 minutes before failing. From the ovirt-hosted-engine-setup... log file: - 2022-10-20 17:54:26,285+1100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:113 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} I checked the following log files and found all of the relevant ERROR lines, then checked several 10s of proceeding and succeeding lines trying to determine what was going wrong, but I could not determine anything. - ovirt-hosted-engine-setup... - ovirt-hosted-engine-setup-ansible-bootstrap_local_vm... - ovirt-hosted-engine-setup-ansible-final_clean... - not really relevant, I believe I can include the log files (or the relevant parts of the log files) if people want - but that are very large: several 100 kilobytes each. I also googled "oVirt Host is not up" and found several entries, but after reading them all the most relevant seems to be a thread from these mailing list: `Install of RHV 4.4 failing - "Host is not up, please check logs, perhaps also on the engine machine"` - but this seems to be talking about an upgrade and I didn't gleam anything useful from it - I could, of course, be wrong about that. So my questions are: - Where else should I be looking (ie other log files, etc, and possible where to find them)? - Does anyone have any idea why this isn't working? - Does anyone have a work-around (including a completely manual process to get things working - I don't mind working in the CLI with virsh, etc)? - What am I doing wrong? Please, I'm really stumped with this, and I really do need help. Cheers Dulux-Oz

8 22

how to renew expired ovirt node vdsm cert manually ?
by dhanaraj.ramesh＠yahoo.com 11 Jan '24

11 Jan '24

below are the steps to renew the expired vdsm cert of ovirt node # To check CERT expired # openssl x509 -in /etc/pki/vdsm/certs/vdsmcert.pem -noout -dates 1. Backup vdsm folder # cd /etc/pki # mv vdsm vdsm.orig # mkdir vdsm ; chown vdsm:kvm vdsm # cd vdsm # mkdir libvirt-vnc certs keys libvirt-spice libvirt-migrate # chown vdsm:kvm libvirt-vnc certs keys libvirt-spice libvirt-migrate 2. Regenerate cert & keys # vdsm-tool configure --module certificates 3. Copy the cert to destination location chmod 440 /etc/pki/vdsm/keys/vdsmkey.pem chown root /etc/pki/vdsmcerts/*pem chmod 644 /etc/pki/vdsmcerts/*pem cp /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-spice/ca-cert.pem cp /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-spice/server-key.pem cp /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-spice/server-cert.pem cp /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-vnc/ca-cert.pem cp /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-vnc/server-key.pem cp /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-vnc/server-cert.pem cp -p /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-migrate/ca-cert.pem cp -p /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-migrate/server-key.pem cp -p /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-migrate/server-cert.pem chown root:qemu /etc/pki/vdsm/libvirt-migrate/server-key.pem cp -p /etc/pki/vdsm.orig/keys/libvirt_password /etc/pki/vdsm/keys/ mv /etc/pki/libvirt/clientcert.pem /etc/pki/libvirt/clientcert.pem.orig mv /etc/pki/libvirt/private/clientkey.pem /etc/pki/libvirt/private/clientkey.pem.orig mv /etc/pki/CA/cacert.pem /etc/pki/CA/cacert.pem.orig cp -p /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/libvirt/clientcert.pem cp -p /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/libvirt/private/clientkey.pem cp -p /etc/pki/vdsm/certs/cacert.pem /etc/pki/CA/cacert.pem 3. cross check the backup folder /etc/pki/vdsm.orig vs /etc/pki/vdsm # refer to /etc/pki/vdsm.orig/*/ and set the correct owner & group permission in /etc/pki/vdsm/*/ 4. restart services # Make sure both services are up systemctl restart vdsmd libvirtd

5 4

Unable to install oVirt on RHEL7.5
by SS00514758＠techmahindra.com 05 Jan '24

05 Jan '24

Hi All, I am unable to install oVirt on RHEL7.5, to install it I am taking reference of below link, https://www.ovirt.org/documentation/install-guide/chap-Installing_oVirt.html But though it is not working for me, couple of dependencies is not getting installed, and because of this I am not able to run the ovirt-engine, below are the depencies packages that unable to install, Error: Package: collectd-write_http-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) Requires: collectd(x86-64) = 5.8.0-6.1.el7 Removing: collectd-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-6.1.el7 Updated By: collectd-5.8.1-1.el7.x86_64 (epel) collectd(x86-64) = 5.8.1-1.el7 Available: collectd-5.7.2-1.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-1.el7 Available: collectd-5.7.2-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-3.el7 Available: collectd-5.8.0-2.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-2.el7 Available: collectd-5.8.0-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-3.el7 Available: collectd-5.8.0-5.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-5.el7 Help me to install this. Looking forward to resolve this issue. Regards Sumit Sahay

6 8

Grafana - Origin Not Allowed
by Maton, Brett 14 Dec '23

14 Dec '23

oVirt 4.5.0.8-1.el8 I tried to connect to grafana via the monitoring portal link from the dash and all panels are failing to display any data with varying error messages, but all include 'Origin Not Allowed' I navigated to Data Sources and ran a test on the PostgreSQL connection (localhost) which threw the same Origin Not Allowed error message. Any suggestions?

6 8

Multiple hosts stuck in Connecting state waiting for storage pool to go up.
by ivan.lezhnjov.iv＠gmail.com 06 Nov '23

06 Nov '23

Hi! We have a problem with multiple hosts stuck in Connecting state, which I hoped somebody here could help us wrap our heads around. All hosts, except one, seem to have very similar symptoms but I'll focus on one host that represents the rest. So, the host is stuck in Connecting state and this what we see in oVirt log files. /var/log/ovirt-engine/engine.log: 2023-04-20 09:51:53,021+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-37) [] Command 'GetCapabilitiesAsyncVDSCommand(HostName = ABC010-176-XYZ, VdsIdAndVdsVDSCommandParametersBase:{hostId='2c458562-3d4d-4408-afc9-9a9484984a91', vds='Host[ABC010-176-XYZ,2c458562-3d4d-4408-afc9-9a9484984a91]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: SSL session is invalid 2023-04-20 09:55:16,556+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-67) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM ABC010-176-XYZ command Get Host Capabilities failed: Message timeout which can be caused by communication issues /var/log/vdsm/vdsm.log: 2023-04-20 17:48:51,977+0300 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=ebce7c8c-6ded-454e-9aee-86edf72764ef (api:31) 2023-04-20 17:48:51,977+0300 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=ebce7c8c-6ded-454e-9aee-86edf72764ef (api:37) 2023-04-20 17:48:51,978+0300 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:723) Both engine.log and vdsm.log are flooded with these messages. They are repeated at regular intervals ad infinitum. This is one common symptom shared by multiple hosts in our deployment. They all have these message loops in engine.log and vdsm.log files. On all Running vdsm-client Host getConnectedStoragePools also returns an empty list represented by [] on all hosts (but interestingly there is one that showed Storage Pool UUID and yet it was still stuck in Connecting state). This particular host (ABC010-176-XYZ) is connected to 3 CEPH iSCSI Storage Domains and lsblk shows 3 block devices with matching UUIDs in their device components. So, the storage seems to be connected but the Storage Pool is not? How is that even possible? Now, what's even more weird is that we tried rebooting the host (via Administrator Portal) and it didn't help. We even tried removing and re-adding the host in Administrator Portal but to no avail. Additionally, the host refused to go into Maintenance mode so we had to enforce it by manually updating Engine DB. We also tried reinstalling the host via Administrator Portal and ran into another weird problem, which I'm not sure if it's a related one or a problem that deserves a dedicated discussion thread but, basically, the underlying Ansible playbook exited with the following error message: "stdout" : "fatal: [10.10.10.176]: UNREACHABLE! => {\"changed\": false, \"msg\": \"Data could not be sent to remote host \\\"10.10.10.176\\\". Make sure this host can be reached over ssh: \", \"unreachable\": true}", Counterintuitively, just before running Reinstall via Administrator Portal we had been able to reboot the same host (which as you know oVirt does via Ansible as well). So, no changes on the host in between just different Ansible playbooks. To confirm that we actually had access to the host over ssh we successfully ran ssh -p $PORT root(a)10.10.10.176 -i /etc/pki/ovirt-engine/keys/engine_id_rsa and it worked. That made us scratch our heads for a while but what seems to had fixed Ansible's ssh access problems was manual full stop of all VDSM-related systemd services on the host. It was just a wild guess but as soon as we stopped all VDSM services Ansible stopped complaining about not being able to reach the target host and successfully did its job. I'm sure you'd like to see more logs but I'm not certain what exactly is relevant. There are a ton of logs as this deployment is comprised of nearly 80 hosts. So, I guess it's best if you just request to see specific logs, messages or configuration details and I'll cherry-pick what's relevant. We don't really understand what's going on and would appreciate any help. We tried just about anything we could think of to resolve this issue and are running out of ideas what to do next. If you have any questions just ask and I'll do my best to answer them.

2 4

Re: Failed to synchronize networks of Provider ovirt-provider-ovn
by Mail SET Inc. Group 27 Oct '23

27 Oct '23

Yes, i use same manual to change WebUI SSL. ovirt-ca-file= is a same SSL file which use WebUI. Yes, i restart ovirt-provider-ovn, i restart engine, i restart all what i can restart. Nothing... > 12 сент. 2018 г., в 16:11, Dominik Holler <dholler(a)redhat.com> написал(а): > > On Wed, 12 Sep 2018 14:23:54 +0300 > "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: > >> Ok! > > Not exactly, please use users(a)ovirt.org for such questions. > Other should benefit from this questions, too. > Please write the next mail to users(a)ovirt.org and keep me in CC. > >> What i did: >> >> 1) install oVirt «from box» (4.2.5.2-1.el7); >> 2) generate own ssl for my engine using my FreeIPA CA, Install it and > > What means "Install it"? You can use the doc from the following link > https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… > > Ensure that ovirt-ca-file= in > /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf > points to the correct file and ovirt-provider-ovn is restarted. > >> get tis issue; >> >> >> [root@engine ~]# tail -n 50 /var/log/ovirt-provider-ovn.log >> 2018-09-12 14:10:23,828 root [SSL: CERTIFICATE_VERIFY_FAILED] >> certificate verify failed (_ssl.c:579) Traceback (most recent call >> last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", >> line 133, in _handle_request method, path_parts, content >> File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", >> line 175, in handle_request return >> self.call_response_handler(handler, content, parameters) File >> "/usr/share/ovirt-provider-ovn/handlers/keystone.py", line 33, in >> call_response_handler return response_handler(content, parameters) >> File "/usr/share/ovirt-provider-ovn/handlers/keystone_responses.py", >> line 62, in post_tokens user_password=user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 26, in >> create_token return auth.core.plugin.create_token(user_at_domain, >> user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/plugin.py", line >> 48, in create_token timeout=self._timeout()) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 75, >> in create_token username, password, engine_url, ca_file, timeout) >> File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line >> 91, in _get_sso_token timeout=timeout File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, >> in wrapper response = func(*args, **kwargs) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, >> in wrapper raise BadGateway(e) BadGateway: [SSL: >> CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) >> >> >> [root@engine ~]# tail -n 20 /var/log/ovirt-engine/engine.log >> 2018-09-12 14:10:23,773+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:10:23,778+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:10:23,836+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:10:23,837+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:14:12,477+03 INFO >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default >> task-6) [] User admin@internal successfully logged in with scopes: >> ovirt-app-admin ovirt-app-api ovirt-app-portal >> ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all >> ovirt-ext=token-info:authz-search >> ovirt-ext=token-info:public-authz-search >> ovirt-ext=token-info:validate ovirt-ext=token:password-access >> 2018-09-12 14:14:12,587+03 INFO >> [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default >> task-6) [1bf1b763] Running command: CreateUserSessionCommand >> internal: false. 2018-09-12 14:14:12,628+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [1bf1b763] EVENT_ID: USER_VDC_LOGIN(30), User >> admin@internal-authz connecting from '10.0.3.61' using session >> 's8jAm7BUJGlicthm6yZBA3CUM8QpRdtwFaK3M/IppfhB3fHFB9gmNf0cAlbl1xIhcJ2WX+ww7e71Ri+MxJSsIg==' >> logged in. 2018-09-12 14:14:30,972+03 INFO >> [org.ovirt.engine.core.bll.provider.ImportProviderCertificateCommand] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] Running >> command: ImportProviderCertificateCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:30,982+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] EVENT_ID: >> PROVIDER_CERTIFICATE_IMPORTED(213), Certificate for provider >> ovirt-provider-ovn was imported. (User: admin@internal-authz) >> 2018-09-12 14:14:31,006+03 INFO >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Running >> command: TestProviderConnectivityCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:31,058+03 ERROR >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Command >> 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'default' is using 0 threads out of 1, 5 threads waiting for >> tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engine' is using 0 threads out of 500, 16 threads waiting for >> tasks and 0 tasks in queue. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineScheduled' is using 0 threads out of 100, 100 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads >> waiting for tasks. 2018-09-12 14:15:23,843+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:15:23,849+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:15:23,900+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:23,901+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' >> >> >> [root@engine ~]# >> cat /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf # >> This file is automatically generated by engine-setup. Please do not >> edit manually [OVN REMOTE] ovn-remote=ssl:127.0.0.1:6641 >> [SSL] >> https-enabled=true >> ssl-cacert-file=/etc/pki/ovirt-engine/ca.pem >> ssl-cert-file=/etc/pki/ovirt-engine/certs/ovirt-provider-ovn.cer >> ssl-key-file=/etc/pki/ovirt-engine/keys/ovirt-provider-ovn.key.nopass >> [OVIRT] >> ovirt-sso-client-secret=Ms7Gw9qNT6IkXu7oA54tDmxaZDIukABV >> ovirt-host=https://engine.set.local:443 >> ovirt-sso-client-id=ovirt-provider-ovn >> ovirt-ca-file=/etc/pki/ovirt-engine/apache-ca.pem >> [PROVIDER] >> provider-host=engine.set.local >> >> >>> 12 сент. 2018 г., в 13:59, Dominik Holler <dholler(a)redhat.com> >>> написал(а): >>> >>> On Wed, 12 Sep 2018 13:04:53 +0300 >>> "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: >>> >>>> Hello Dominik! >>>> I have a same issue with OVN provider and SSL >>>> https://www.mail-archive.com/users@ovirt.org/msg47020.html >>>> <https://www.mail-archive.com/users@ovirt.org/msg47020.html> But >>>> certificate changes not helps to resolve it. Maybe you can help me >>>> with this? >>> >>> Sure. Can you please share the relevant lines of >>> ovirt-provider-ovn.log and engine.log, and the information if you >>> are using the certificates generated by engine-setup with >>> users(a)ovirt.org ? Thanks, >>> Dominik >>> >> > >

5 13

engine-config -s UserSessionTimeOutInterval=X problem
by marek 28 Aug '23

28 Aug '23

ovirt 4.5.4, standalone engine, centos 8 stream [root@ovirt ~]# engine-config -g UserSessionTimeOutInterval Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false UserSessionTimeOutInterval: 30 version: general [root@ovirt ~]# engine-config -s UserSessionTimeOutInterval=60 Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value 60 to key UserSessionTimeOutInterval. any ideas where is the problem? Marek

5 6

Unable to upload or download iso via admin portal
by Igor Filipovic 23 Aug '23

23 Aug '23

Hi, I'm having a trouble on fresh 4.4.10.7 installation (on oracle linux), I'm not able to upload or download any file using storage domain upload image function. I've imported CA certificate and have tried on several browsers (firefow, chrome,edge), on different computers (and browsers are green - claiming that I'm securely connected), but I'm always getting error regarding CA certificate when I test connection, or when I try to upload ISO image. I've tried to upload ISO image via cli commands (upload_disk.py), and that scenario was successful, however this method It is not very convenient for my co-workers. I have 5 physical hosts, one is dedicated to run ovirt-engine, and other 4 are kvm hypervisors. When I try to upload ISO this is what engine.log logs: 2023-04-08 11:00:28,339+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Running command: TransferImageStatusCommand internal: false. Entities affected : ID: 1eb97088-b805-4616-af55-0ac9d1d7dfbe Type: SystemAction group CREATE_DISK with role type USER 2023-04-08 11:00:28,340+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Updating image transfer a78b18c5-e395-4c29-aa5c-15ffff8a1cb6 (image 4f758325-ac11-4071-a9fa-d180425e8604) phase to Paused by System (message: 'Sent 0MB') 2023-04-08 11:00:28,363+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] EVENT_ID: UPLOAD_IMAGE_NETWORK_ERROR(1,062), Unable to upload image to disk 4f758325-ac11-4071-a9fa-d180425e8604 due to a network error. Ensure ovirt-engine's CA certificate is registered as a trusted CA in the browser. The certificate can be fetched from https://engine-dr.somedomain/ovirt-engine/services/pki-resource?resource=ca… 2023-04-08 11:00:28,363+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Running command: TransferImageStatusCommand internal: false. Entities affected : ID: 1eb97088-b805-4616-af55-0ac9d1d7dfbe Type: SystemAction group CREATE_DISK with role type USER Can you please point me in some direction to try to fix this? Thanks, and best regards Igor

4 4

ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials
by cmicarelli＠fdmservices.it 22 Aug '23

22 Aug '23

Hi Guys, I'm tried to install ovirt 4.5 on centos 8 stream and everytime file with this error ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials Someone could help me? Regrards

2 2

engine-setup failing on 4.3.2 -> 4.3.3 fails during Engine schema refresh fail
by Edward Berger 18 Jul '23

18 Jul '23

I was trying to upgrade a hyperconverged oVirt hosted engine and failed in the engine-setup command with these error and warnings. ... [ INFO ] Creating/refreshing Engine database schema [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0830_add_foreign_key_to_image_transfers.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed ... [ INFO ] Yum Verify: 16/16: ovirt-engine-tools.noarch 0:4.3.3.5-1.el7 - e [WARNING] Rollback of DWH database postponed to Stage "Clean up" [ INFO ] Rolling back database schema ... [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Attaching engine-setup logfile.

4 6

Suggestion to switch to nightly
by Sandro Bonazzola 07 Jul '23

07 Jul '23

Hi, As you probably noticed there were no regular releases after oVirt 4.5.4 <https://ovirt.org/release/4.5.4/> in December 2022. Despite the calls to action to the community and to the companies involved with oVirt, there have been no uptake of the leading of the oVirt project yet. The developers at Red Hat still dedicating time to the project are now facing the fact they lack the time to do formal releases despite they keep fixing platform regressions like the recent ones due to the new ansible changes. That makes a nightly snapshot setup a more stable environment than oVirt 4.5.4. For this reason, we would like to suggest the user community to enable nightly repositories for oVirt by following the procedure at: https://www.ovirt.org/develop/dev-process/install-nightly-snapshot.html This will ensure that the latest fixes for the platform regressions will be promptly available. Regards, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

5 9

Bcp vm
by Ali Gusainov 27 Jun '23

27 Jun '23

Hello experts. Environment: 2 identical servers running CentOS Linux release 7.7.1908 oVirt Version:4.3.7.2-1.el7 No clusters configured. NFS share for backups on third server. Have some questions. 1. Need to create backups of virtual machines to NFS without downtime. Can an 'OVA export' be a complete policy for backups? 2. Is there a way to export vm to OVA via command line?

2 5

novnc console error: promise.js missing?
by karl.morgan＠gmail.com 02 Jun '23

02 Jun '23

Seeing the following on the engine when attempting to start a novnc console 2023-03-31 11:57:34,988-07 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-29) [307c22a9] START, SetVmTicketVDSCommand(HostName = ov2node02-mn, SetVmTicketVDSCommandParameters:{hostId='19a92de3-c6e4-4f4e-be31-1d5533a2b6b6', vmId='4481b0e9-a96c-4ee7-8bd2-572558eb9fda', protocol='VNC', ticket='LMl903dd', validTime='120', userName='admin@ovirt', userId='9e88a363-34cb-466a-8ba9-25e46819423b', disconnectAction='LOCK_SCREEN', consoleDisconnectActionDelay='0'}), log id: 1d6520d5 2023-03-31 11:57:35,031-07 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-29) [307c22a9] FINISH, SetVmTicketVDSCommand, return: , log id: 1d6520d5 2023-03-31 11:57:35,044-07 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-29) [307c22a9] EVENT_ID: VM_SET_TICKET(164), User admin@ovirt@internalkeycloak-authz initiated console session for VM first 2023-03-31 11:57:35,158-07 INFO [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-29) [] Can't read file '/usr/share/ovirt-engine/files/novnc/vendor/promise.js' for request '/ovirt-engine/services/files/novnc/vendor/promise.js' -- 404 Curious if this is obvious to anyone? How to resolve? ovirt-engine-webadmin-portal-4.5.4-1.el9.noarch ovirt-engine-4.5.4-1.el9.noarch

2 1

Ovirt 4.5.0 Support (End of Life Date)
by masood.ahmed＠digital.mod.uk 23 May '23

23 May '23

Hi, I am working on a project and we would like to utilise (oVirt 4.5.) as the platform for our enterprise infrastructure. We have arrived at this juncture because of a range of considerations related to hardware and software availability and compatibility. My question is if there is on-going vendor \ professional support for oVirt moving forward, as one of my colleagues spoke with Red Hat, who stated they are going to end their support for the product. we will not gain security accreditation for our project unless we have professional support available, community support only is not sufficient, Any ideas of firms available for a support contract for oVirt 4.5.0? thanks

2 1

Ovirt node disk broken
by marcel d'heureuse 09 May '23

09 May '23

Hi all, On a single Server the node disk is broken and I have to replace it. The glusterfs configuration is also gone but the glusterfs directorys are existing on a separate available disk. Did I have a Chance to install the ovirt Node on a New disk and make the old glusterfs running and also the 7 vms included the hosted engine? I can also deploy a New hosted engine but can I than import the existing gluster disk from the old Installation? I have installed the node and also mount the gluster_bricks but to make the volumes available I have not found any command. It is an ovirt 4.3.10 Installation. Is there any chance to save some time. The data inside the vms are good to have. Br Marcel

2 1

Unable to change the admin passsword on oVirt 4.5.2.5
by Ayansh Rocks 08 May '23

08 May '23

Hi All, Any idea hot to change password of admin user on oVirt 4.5.2.5 ? Below is not working - [root@ovirt]# ovirt-aaa-jdbc-tool user password-reset admin Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Password: Reenter password: updating user admin... user updated successfully [root@delhi-test-ovirtm-02 ~]# Above shows successful but password not changed. Thanks

5 7

VDSM certs expired, manual renewal not working
by cen 02 May '23

02 May '23

Hi Our VDSM certs have expired, both hosts are unassigned and can't be put into maintenance from UI. vdsm-client is not working, times out even with --insecure flag. Does host and port need to be specified when run locally or should defaults work? Error in console events is: Get Host Capabilities Failed: PKIX path validation failed... I followed a RHV guide for this exact situation and generated new vdsm certificate using the ovirt-engine CA. The new cert seems identical to the old one, everything matches (algos, extensions, CA, CN, SAN etc) just new date. After restarting libvirtd and vdsmd on the host with new cert in place the host is still not reachable. However, error message is now slightly different: get Host Capabilities failed: Received fatal error: certificate_expired Cert was replaced in the following locations: /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-spice/server-cert.pem /etc/pki/libvirt/clientcert.pem Is there another location missing? What else can I try? All help appreciated in advance

3 6

ovirt 4.5.4 install failure
by Selçuk N 02 May '23

02 May '23

Hello all, I tried to install ovirt 4.5.4 on ovirt node install. *hosted-engine --deploy* After this step installation is stuck. *[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the host to be up]* I checked the log file and details below. Apr 20 22:10:18 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85405) Apr 20 22:10:19 ovirt3 python3[51367]: ansible-ovirt_host_info Invoked with pattern=name=ovirt3.44c.net auth={'token': 'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJOTXdyenhDY284eERxZVlLaFRhWG5xblVpV0lFNDVBM2VmRzhXdndTaDVBIn0.eyJleHAiOjE2ODIwMzQzNzgsImlhdCI6MTY4MjAxNzA5OCwianRpIjoiODdjNDAwZTItNDZiMS00NmY1LTk2MWMtMWJhMDA3MDAxOGQxIiwiaXNzIjoiaHR0cHM6Ly9lbmcuNDRjLm5ldC9vdmlydC1lbmdpbmUtYXV0aC9yZWFsbXMvb3ZpcnQtaW50ZXJuYWwiLCJhdWQiOiJhY2NvdW50Iiwic3ViIjoiZmFiMDNmM2UtODVmZS00YjQ5LWE5ZWItZTExODRjOTYzYzdjIiwidHlwIjoiQmVhcmVyIiwiYXpwIjoib3ZpcnQtZW5naW5lLWludGVybmFsIiwic2Vzc2lvbl9zdGF0ZSI6IjYwOWJiMmMxLTJkNTItNDc4Zi1hYzg2LWMyMjVlNTVmYTMwNyIsImFjciI6IjEiLCJhbGxvd2VkLW9yaWdpbnMiOlsiaHR0cHM6Ly9lbmcuNDRjLm5ldCJdLCJyZWFsbV9hY2Nlc3MiOnsicm9sZXMiOlsiZGVmYXVsdC1yb2xlcy1vdmlydC1pbnRlcm5hbCIsIm9mZmxpbmVfYWNjZXNzIiwidW1hX2F1dGhvcml6YXRpb24iXX0sInJlc291cmNlX2FjY2VzcyI6eyJhY2NvdW50Ijp7InJvbGVzIjpbIm1hbmFnZS1hY2NvdW50IiwibWFuYWdlLWFjY291bnQtbGlua3MiLCJ2aWV3LXByb2ZpbGUiXX19LCJzY29wZSI6Im92aXJ0LWFwcC1hcGkgZW1haWwgb3ZpcnQtZXh0PXRva2VuLWluZm86YXV0aHotc2VhcmNoIG92aXJ0LWV4dD10b2tlbi1pbmZvOnZhbGlkYXRlIG92aXJ0LWV4dD10b2tlbi1pbmZvOnB1YmxpYy1hdXRoei1zZWFyY2ggcHJvZmlsZSBvdmlydC1leHQ9dG9rZW46cGFzc3dvcmQtYWNjZXNzIiwic2lkIjoiNjA5YmIyYzEtMmQ1Mi00NzhmLWFjODYtYzIyNWU1NWZhMzA3IiwiZW1haWxfdmVyaWZpZWQiOmZhbHNlLCJncm91cHMiOlsiL292aXJ0LWFkbWluaXN0cmF0b3IiXSwicHJlZmVycmVkX3VzZXJuYW1lIjoiYWRtaW5Ab3ZpcnQiLCJlbWFpbCI6ImFkbWluQGxvY2FsaG9zdCJ9.e47PgAtt_Sj-_4IQ8OIQynAV_AvrOfzalhwi1VJapCQB_sdQqxd0jIH7JGVM1a4TGEJb6E5ffTXBocqQabe5pBPIv4kqsgU1iadyTjjDjZ1elECnahPf6lrze-8hEO92GKFOepGLQ-iu7gRilAknvaXhoc309G1hyQvnP4Q-syffw6Eoo4RmgnLnztnPzsxBtGgkZrzAwFfTNDtdS2uj5lvzzAEIfvDPRFTjJhYwKXSx2hC1lnhXnmv1XEtCfXZZ3qqarXw8GAvOQbe10xklm5UAtu--C8NX32DE6659QtEqk-5g52SdFWIic_OlZ5-obHn3jOllo8qnsb-6mfEn_w', 'url': 'https://eng.44c.net/ovirt-engine/api', 'ca_file': None, 'insecure': True, 'timeout': 0, 'compress': True, 'kerberos': False, 'headers': None, 'hostname': None, 'username': None, 'password': None} fetch_nested=False nested_attributes=[] follow=[] all_content=False cluster_version=None *Apr 20 22:10:22 ovirt3 journal[47971]: Invalid value '-1' for 'cpu.max': Invalid argument* Apr 20 22:10:23 ovirt3 sssd_kcm[50811]: Shutting down (status = 0) Apr 20 22:10:23 ovirt3 systemd[1]: sssd-kcm.service: Deactivated successfully. Apr 20 22:10:23 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85400) Apr 20 22:10:28 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85395) What did I did wrong? Thanks.

2 1

checking engine vm status during global maintenance
by Alexey Valkov 02 May '23

02 May '23

Hi all, I tried to check engine status (via hosted-engine --vm-status) during global maintenance in oVirt 4.5.1 and discovered that it showed me status as it was just before entering global maintenance. Is it by design? And HA agent doesn't monitor and therefore doesn't update Engine VM status? If I remember right in oVirt 4.2 hosted-engine --vm-status showed correct status of Engine VM regardless of Global maintenance. I shutted down the engine but the output of hosted-engine --vm-status was Engine status : {"vm": "up", "health": "good", "detail": "Up"} Notice !! Cluster is in GLOBAL MAINTENANCE mode !! existed in the output. Host timestamp and extra metadata was up to date. All rest info looked good. Thi is my second attempt to ask the question (first was at 24/04 and still is being moderated). -- Best regards Alexei

2 1

richiesta accesso Zanata
by Rosario Grasso 02 May '23

02 May '23

Buongiorno, la presente per richiedere l'accesso a Zanata in lingua inglese e se possibile anche in italiano. Saluti, RG

2 2

Serial console VMs (vmconsole) only listed when admin user is logged into Manager WebUI?
by aleblanc＠lbl.gov 28 Apr '23

28 Apr '23

I am running a test\POC oVirt configuration with the following... oVirt engine: ovirt-engine-4.5.4-1.el8 engine OS: Rocky Linux release 8.7 (Green Obsidian) install type: stand-alone engine install I am able to access the serial console of VMs successfully, using the proper SSH command directly on the engine or remotely. Problem is, the VMs only show up in the list IF the 'admin' or 'admin@ovirt' user is presently logged into the manager UI. If I log out of the manager UI, the serial console returns 'no VMs'. Is there a setting or something that I am missing? ==== logged out of manager UI: [ovirt-vmconsole-proxy-helper]# /usr/libexec/ovirt-vmconsole-proxy-helper/ovirt-vmconsole-list.py --version "1" consoles --entityid "d55e4ab6-0318-46b0-95bc-12b21144eb88" {"consoles": [], "version": 1, "content": "console_list"} ==== logged into manager UI: [ovirt-vmconsole-proxy-helper]# /usr/libexec/ovirt-vmconsole-proxy-helper/ovirt-vmconsole-list.py --version "1" consoles --entityid "d55e4ab6-0318-46b0-95bc-12b21144eb88" {"consoles": [{"console": "3ecd0eda-130d-434b-9ece-32bbcc3b3e5a.sock", "vmid": "3ecd0eda-130d-434b-9ece-32bbcc3b3e5a", "host": "dldvovirt01", "vmname": "mytestvm_2", "vm": "mytestvm_2"}, {"console": "4e6abfbe-ede3-4e87-8d07-4ed1d6cb715c.sock", "vmid": "4e6abfbe-ede3-4e87-8d07-4ed1d6cb715c", "host": "dldvovirt02", "vmname": "testvm_4", "vm": "testvm_4"}, {"console": "dc4d017b-4f68-4eee-b80e-e49122345139.sock", "vmid": "dc4d017b-4f68-4eee-b80e-e49122345139", "host": "dldvovirt01", "vmname": "mytestvm_3", "vm": "mytestvm_3"}], "version": 1, "content": "console_list"} Any help would be appreciated.

1 0

Getting to the consoles of the Virtual machines
by destfinal＠googlemail.com 28 Apr '23

28 Apr '23

Hi, I have just deployed a functional oVirt cluster. I have created a few virtual machines and am able to ssh into them. However, I could not connect to the consoles of any of the running virtual machines. If I click on the console, from the management portal, it offers me to download a console.vv file. If I download it and double click on it, the file (console.vv itself) simply disappears. I connected to the kvm of the the node where the vm is running, from a VMM (from my local machine which is a Ubuntu 22.04) and when I tried to open the the console from there I get a "Viewer was disconnected" message in the machine Window. In the oVirt cluster, the VM console settings are: Video Type: VGA # Another available option is QXL Graphics protocol: VNC # Which is the only option available Could not find any useful information from the engin.log (all it say is that "Initiated console session for VM XXXXXX). What setting should I enable/change to get into the cnsole of my VM's? Please let me know if you need more information in this regard. Thanks

1 0

oVirt Self-hosted Engine Deployment fails
by destfinal＠googlemail.com 28 Apr '23

28 Apr '23

Hi, I am struggling to get an oVirt cluster setup (for a PoC with some workstations) for the past more than one week and am getting nowhere. Following is my environment: Machine: Dell Workstation with i7, 16G RAM, 256G (I have got couple of more of this machine but could not getr beyond the first one) OS: oVirt minimal (https://resources.ovirt.org/pub/ovirt-4.5/iso/ovirt-node-ng-installer/4.5.4…) Documentation followed: https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engin… Cluster name chosen: my.cluster First node host name: node1-ovirt.my.cluster Engine VM name: ovirt-engine.my.cluster The documentation states that there should be resolvable DNS entries for both the oVirt hosts *as well as* for the oVirt engine VM. I am a bit confused on this as the VM will get a DHCP address only after running the 'hosted-engine' script. What ip address should I have for the engine VM (say if I have my engine host name as ovirt-engine.my.cluster)? If I have no entry for the engine in the DNS I get the following error: [ ERROR ] Host name is not valid: ovirt-engine.my.cluster did not resolve into an IP address Please provide the FQDN you would like to use for the engine. Note: This will be the FQDN of the engine VM you are now going to launch, it should not point to the base host or to any other existing machine. Engine VM FQDN: So I simply added an entry for 'ovirt-engine.my.cluster' with a dummy value 192.168.0.222 (this is an ip address on the host subnet; but the engine gets a DHCP address from a different subnet from a virtual network from the host; I dont understand this) which moves away from the above problem and goes all the way (after providing the values for a few other questions) to hang at 'Wait for the host to be up' for a while and eventually fail with an error message: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} At this point a vm is running in the host. I logged on to the VM and searched the logs and found the following line in the /var/log/ovirt-engine/engine.log: ERROR [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-1) [728b2edd-d13a-48c3-a2c1-42a66a5334c5] Exception: Task Install ovs failed to execute. Please check logs for more details: /var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20230425210047-node1-ovirt.my.cluster-728b2edd-d13a-48c3-a2c1-42a66a5334c5.log and in the file /var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20230425210047-node1-ovirt.my.cluster-728b2edd-d13a-48c3-a2c1-42a66a5334c5.log I found the following error: "msg" : "The conditional check 'cluster_switch == \"ovs\" or (ovn_central is defined and ovn_central | ipaddr)' failed. The error was: The ipaddr filter requires python's netaddr be installed on the ansible controller\n\nThe error appears to be in '/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml': line 3, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n- block:\n - name: Install ovs\n ^ here\n" On the host (node1-ovirt.my.cluster) =========================== the result of 'rpm -qa | grep netaddr' is 'python3-netaddr-0.8.0-5.el9.noarch' the ansible version is: ansible [core 2.14.0] config file = /etc/ansible/ansible.cfg configured module search path = ['/root/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] ansible python module location = /usr/lib/python3.9/site-packages/ansible ansible collection location = /root/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible python version = 3.9.14 (main, Sep 21 2022, 00:00:00) [GCC 11.3.1 20220421 (Red Hat 11.3.1-2)] (/usr/bin/python3.9) jinja version = 3.1.2 libyaml = True # rpm -qi ovirt-engine-appliance Name : ovirt-engine-appliance Version : 4.5 Release : 20221206125848.1.el9 On the vm (ovirt-engine.my.cluster) =========================== the result of 'rpm -qa | grep netaddr' is: python3-netaddr-0.7.19-8.1.2.el8.noarch python39-netaddr-0.7.19-8.1.2.el8.noarch ansible version is: ansible [core 2.14.2] config file = /etc/ansible/ansible.cfg configured module search path = ['/root/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] ansible python module location = /usr/lib/python3.11/site-packages/ansible ansible collection location = /root/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible python version = 3.11.2 (main, Feb 28 2023, 23:00:48) [GCC 8.5.0 20210514 (Red Hat 8.5.0-18)] (/usr/bin/python3.11) jinja version = 3.1.2 libyaml = True At the moment I ran out of ideas. Am I not following something in the document correctly? Please let me know if you need more information in this regard Thanks

5 12

Problem when re-attaching domain - some vms disapered
by Ricardo Alonso 26 Apr '23

26 Apr '23

Hello all, Due to a maintenance in our glusterfs infrastructure, I moved the domain data to a different location (but before I took care of shutdown all machines and detach it from the manager). After the upgrade, I created a new glusterfs volume to hold the vms and attached the old one, using NFS, in order to move the vms to this new storage location. Out of 38 machines, 2 of them didn't appear in the list to be imported back. Analysing the storage I managed to find they volumes but Ovirt insists in not import them. I found an old thread that talks about a similar problem: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/MF5IUXURKIQZNN… but their solution didn't help. Those VMs were imported from Virtualbox in the past. This is the meta file: cat 80f95e3e-f92b-497a-aec5-440ba5282682.meta CAP=53687091200 CTIME=1665328113 DESCRIPTION=generated by virt-v2v 1.42.0rhel_8,release_19.module+el8.6.0+998+252a5635 DISKTYPE=2 DOMAIN=1102600c-eee7-40cc-86b2-ee90b3c4df6b FORMAT=RAW GEN=0 IMAGE=00e13c7f-d0e9-4d5b-8862-a28f0b91acfe LEGALITY=LEGAL PUUID=00000000-0000-0000-0000-000000000000 TYPE=SPARSE VOLTYPE=INTERNAL EOF I could get the disk manually and import, but it has 2 snapshots (two other volumes in the same directory) which I don't know how to "merge" them into the original disk (if it's possible). tree 00e13c7f-d0e9-4d5b-8862-a28f0b91acfe 00e13c7f-d0e9-4d5b-8862-a28f0b91acfe ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c.lease ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c.meta ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7 ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7.lease ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7.meta ├── 80f95e3e-f92b-497a-aec5-440ba5282682 ├── 80f95e3e-f92b-497a-aec5-440ba5282682.lease └── 80f95e3e-f92b-497a-aec5-440ba5282682.meta The Ovirt is 4.5.4 and the host Rocky 8, all updated to the latest version. On the vdsm.log, this is the only 2 lines related to this disk I could find. 2023-04-24 13:39:25,812-0300 INFO (jsonrpc/3) [vdsm.api] FINISH getImagesList return={'imageslist': ['d03f371f-0b86-4a06-b8e3-bbd602a81442', 'f1425fd4-fb4f-48ae-8df1-1bd44b026848', '9d52bfa9-d2dd-49c3-8a98-66cf950a7bcb', 'f7c69f63-c3a8-447c-baf2-751021fb7c26', 'bc76e648-e09d-448e-86f1-b3ae47509837', '00e13c7f-d0e9-4d5b-8862-a28f0b91acfe', '88b53eb4-9ca9-4162-9e91-f00b4f41f278', '0bd13065-cb21-4db3-9eb0-7582c65c4ca9', '06444eb3-52bf-48af-84fe-36baf1531853', '7ea966f8-72ed-421b-be71-e20b3dcc4e5a', '2e9dee7c-131b-427b-9e7a-33a49af7c6f0', 'e58171dc-5135-4462-b1f3-49d98785907e', 'f5d2e866-1d53-4243-8a6e-f5031c4be33d', 'ad5fe94a-4880-4dcf-af36-4a36ede9a6ab', '72a047f4-6546-4750-845f-ceb74c6503c8', '36d0ec3d-482b-4c90-a169-8b2b9abee158', '6e5afad2-5de0-463f-b04b-34b4828b7aa3', '565c2418-d43f-4138-8d31-50e8bd9c5c4e', '0d128f2c-3962-4f91-8231-a5772132d241', '0b9cbbc5-316c-453a-aab0-a3e6805796e9', 'b43bc279-000b-40dc-8c00-cc22b8caab5d', '6a401413-d2ae-4c14-b028-a7fc953d08f2', 'aa3b6e24-1b74-4890-897a-13f858844b3a', '20ae1e1f-fccd-40e8-a1b4-90339e6c7ca1', '8e9050ad-82a1-4a23-a461-5d1eca7c9d80', 'fc2e4d0b-c092-4e74-b69e-da5020ac396e', '4c5c3c74-307f-49a9-ae66-60dddfc1db67', 'd8463e92-5495-4e59-8d2f-bcfcdfa59987', '0342e096-cf34-4a8c-a9f6-36b13c3e39c3', 'f6714bec-37df-4aad-8b21-2ae146b0fa19', 'd4c77a6b-dfcf-424c-9025-cbc8795b2f46', 'f42cb81b-058b-4bd6-b55e-5b3ae3601ade', 'fe052d41-8e94-4145-8c8b-7fdf8d8adc37', '1fc4c7b8-d7c8-4c32-88ce-6cf5c9e65aa0', '3aef6a30-8757-4f65-b989-c1b40236f4cb', '2e9fc88d-e5c0-4a97-b590-481a1508c155', 'dcedf2e9-5e92-44bc-9113-5263dd0dda96', '393e02b4-5765-4ea5-8008-e7d3a3995794', 'b895f40b-17a2-4f08-9126-c25d8858601f', '1c9a3ff9-7434-4867-8880-7d11548aca53', 'fa64e6eb-7aad-4548-b944-1bc04b719256', 'f912af5e-9c51-45a6-8b01-6d9224c48893', '6611aba7-e201-4702-842a-4089deeb306d', '00098322-3ba9-4af9-9e6d-54cb07ec3d77', '666fd481-07e5-45ed-be2e-bd3cd78df7dc', '13eb4b21-2134-48ae-84b6-164d6a8141cc', '50c3d0b9-a850-487a-a213-fd9b87db91b3', '3573b171-2980-47a2-96c2-55d39fddda55', '9b3a156f-3cb4-485a-b357-f5c7ed1bb890']} from=::ffff:192.168.5.52,52296, flow_id=a2fe8beb-4f0a-4d71-bf08-3a0d0c3b6403, task_id=39d06e06-2b25-4a94-b3f7-15dc60a44164 (api:37) 2023-04-24 13:39:26,220-0300 INFO (jsonrpc/4) [vdsm.api] START getVolumesList(sdUUID='1102600c-eee7-40cc-86b2-ee90b3c4df6b', spUUID='f04dd188-b214-11ea-845b-00163e4ad29b', imgUUID='00e13c7f-d0e9-4d5b-8862-a28f0b91acfe') from=::ffff:192.168.5.52,52296, flow_id=a2fe8beb-4f0a-4d71-bf08-3a0d0c3b6403, task_id=387e8181-764b-47d7-aa4d-13abf66fd94b (api:31) Does anyone have an idea?? Thank you Best regards Ricardo

2 2

New hosted engine setup mailed : maybe local_vm_ip undefined?
by Fedele Stabile 25 Apr '23

25 Apr '23

Good morning, I have a fresh installed host node ovirt v.4.5 and i'm installing engine using the command hosted-engine --deploy host node has a ip on 160.97.xx and i want the engine on the same network (160.97.xx) The installation seems to be good but at the end it exit leaving the host-engine running on 192.168.222.x (i can connect) Reading the logs in the ovirt-host i found they are relatedated to the file: sync_on_engine_machine.yml and are an undefined local_vm_ip variable and dict object has no attribute engine Seems that the error is here: 2023-04-25 06:28:18,953+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'local_vm_ip' is undefined\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Set the name for add_host\n ^ here\n"} .... .... 2023-04-25 06:28:19,757+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"} 2023-04-25 06:28:19,857+0200 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] 2023-04-25 06:28:19,958+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n", '_ansible_no_log': None} 2023-04-25 06:28:20,058+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n"} Help me, please

1 0

Hosted engine setup Failed
by Fedele Stabile 25 Apr '23

25 Apr '23

Good morning, I have a fresh installed host node ovirt v.4.5 and i would install engine using terminal, using the commanda hosted-engine --deploy host node has a ip on 160.97.xx and i want the engine on the same network (160.97.xx) The installation seems to be good but at the end exit leaving the host-engine running on 192.168.222.x Seems that the error is here: 2023-04-25 06:28:18,953+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'local_vm_ip' is undefined\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Set the name for add_host\n ^ here\n"} .... .... 2023-04-25 06:28:19,757+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"} 2023-04-25 06:28:19,857+0200 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] 2023-04-25 06:28:19,958+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n", '_ansible_no_log': None} 2023-04-25 06:28:20,058+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n"} Help me, please

1 0

New host deployment failed: Task Configure OVN for oVirt failed to execute.
by Xavier Lauzon 24 Apr '23

24 Apr '23

Hi there, I have been trying to deploy a new host to my cluster and have been having some difficulties with one part of the installation. I've tried to add this host a few different times, and each time I get the same error. Current troubleshooting steps tried: Used three different distros: CentOS 9, oVirt Node 4.5.5, Rocky Linux 9,1 Used two separate machines with different network card configurations. Used both the stable and nightly branches. Workaround tried: Manually configuring the host networks through the "Network Interfaces" tab. Manually activated the host after the install failed - host is set to active state. This workaround seems to work; however, whenever any VMs are migrated to the host, they fail with the error 'Fatal exception'. Here is the error log: 2023-04-24 15:21:11 UTC - TASK [ovirt-provider-ovn-driver : Configure OVN for oVirt] ********************* 2023-04-24 15:21:14 UTC - { "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38", "counter" : 423, "stdout" : "fatal: [node.example.org] FAILED! => {\"changed\": true, \"cmd\": [\"vdsm-tool\", \"ovn-config\", \"10.0.0.2\", \"node.example.org\"], \"delta\": \"0:00:02.351900\", \"end\": \"2023-04-24 11:21:11.968404\", \"msg\": \"non-zero return code\", \"rc\": 1, \"start\": \"2023-04-24 11:21:09.616504\", \"stderr\": \"Traceback (most recent call last):\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\\n return networks[net_name]\\nKeyError: 'node.example.org'\\n\\nDuring handling of the above exception, another exception occurred:\\n\\nTraceback (most recent call last):\\n File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\\n return tool_command[cmd][\\\"command\\\"](*args)\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\\n raise NetworkNotFoundError(net_name)\\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\", \"stderr_lines\": [\"Traceback (most recent call last):\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\", \" return networks[net_name]\", \"KeyError: 'node.example.org'\", \"\", \"During handling of the above exception, another exception occurred:\", \"\", \"Traceback (most recent call last):\", \" File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\", \" return tool_command[cmd][\\\"command\\\"](*args)\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\", \" ip_address = get_ip_addr(get_network(network_caps(), net_name))\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\", \" raise NetworkNotFoundError(net_name)\", \"vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\"], \"stdout\": \"\", \"stdout_lines\": []}", "start_line" : 416, "end_line" : 417, "runner_ident" : "a36144c0-97bc-4170-8f9e-1c2fbc10b7c3", "event" : "runner_on_failed", "pid" : 91786, "created" : "2023-04-24T15:21:11.993278", "parent_uuid" : "00163e19-a0e7-c330-a021-000000000041", "event_data" : { "playbook" : "ovirt-host-deploy.yml", "playbook_uuid" : "86e8189d-85f0-4040-9615-8eb13e614105", "play" : "all", "play_uuid" : "00163e19-a0e7-c330-a021-000000000002", "play_pattern" : "all", "task" : "Configure OVN for oVirt", "task_uuid" : "00163e19-a0e7-c330-a021-000000000041", "task_action" : "ansible.builtin.command", "task_args" : "", "task_path" : "/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml:43", "role" : "ovirt-provider-ovn-driver", "host" : "node.example.org", "remote_addr" : "node.example.org", "res" : { "changed" : true, "stdout" : "", "stderr" : "Traceback (most recent call last):\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network\n return networks[net_name]\nKeyError: 'node.example.org'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/bin/vdsm-tool\", line 195, in main\n return tool_command[cmd][\"command\"](*args)\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network\n raise NetworkNotFoundError(net_name)\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org", "rc" : 1, "cmd" : [ "vdsm-tool", "ovn-config", "10.0.0.2", "node.example.org" ], "start" : "2023-04-24 11:21:09.616504", "end" : "2023-04-24 11:21:11.968404", "delta" : "0:00:02.351900", "msg" : "non-zero return code", "invocation" : { "module_args" : { "_raw_params" : "vdsm-tool ovn-config 10.0.0.2 node.example.org\n", "_uses_shell" : false, "stdin_add_newline" : true, "strip_empty_ends" : true, "argv" : null, "chdir" : null, "executable" : null, "creates" : null, "removes" : null, "stdin" : null } }, "stdout_lines" : [ ], "stderr_lines" : [ "Traceback (most recent call last):", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network", " return networks[net_name]", "KeyError: 'node.example.org'", "", "During handling of the above exception, another exception occurred:", "", "Traceback (most recent call last):", " File \"/usr/bin/vdsm-tool\", line 195, in main", " return tool_command[cmd][\"command\"](*args)", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config", " ip_address = get_ip_addr(get_network(network_caps(), net_name))", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network", " raise NetworkNotFoundError(net_name)", "vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org" ], "_ansible_no_log" : null }, "start" : "2023-04-24T15:21:09.330408", "end" : "2023-04-24T15:21:11.993114", "duration" : 2.662706, "ignore_errors" : null, "event_loop" : null, "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38" } } Has anyone been experiencing the same issues? Cheers, Xavier Lauzon

1 0

A disk cannot be created because of the size and cannot delete it now
by cagdasbs＠gmail.com 24 Apr '23

24 Apr '23

Hi everyone, A colleague of mine tried to create a 1T preallocated disk on a 1T datastore. Ovirt failed to allocate enough space for the disk and throw an error. Now there is a 1T locked disk in the disks list and I cannot delete it, because it's locked. I tried unlock_entity.sh but it doesn't list anything when I run `unlock_entity.sh -t all -q` . Any suggestions on how do I delete this disk?

1 0

hosted-engine to standalone
by carl langlois 21 Apr '23

21 Apr '23

Hi, I plan to transform my hosted_engine setup to a standalone engine. Currently I have 3 hosts that can run the engine. The engine domain is located on a glusterfs. I want to simplify this setup by taking 1 of the 3 hosts and setting it as a standalone engine and re-installing the other host as a standard hypervisor. Also i want to remove the glusterfs. I am on 4.3 for now but the plan is to upgrade after this simplification. The step i plan to do is: 1. global maintenance 2. stop engine 3. backup engine 4. shutdown engine 5. install fresh standalone engine and restore from the backup 6. boot the standalone engine. 7. after not sure what the step to clean the old engine domain.. Any suggestion? Regards, Carl

2 3

Installing Server 2022 VM
by Devin A. Bougie 20 Apr '23

20 Apr '23

We've been struggling to install Windows Server 2022 on oVirt. We recently upgraded to the latest oVirt 4.5 on EL9 hosts, but it didn't help. In the past, we could boot a VM from the install CD, add the mass storage drivers from the virt-io CD, and proceed from there. However, oVirt 4.3 didn't have a Server 2022 selection. After upgrading to oVirt 4.5, we couldn't get it to boot from the CD. It just gave me Windows boot errors if I do q35 EFI. If I switch back to i440fx I get the same behavior as in oVirt 4.3 - it'll boot the DVD but doesn't find a disk with the virtio-scsi drivers. We'd greatly appreciate if anyone has successfully installed Server 2022 in oVirt. Many thanks, Devin

1 1

Not able to create a storage domain of
by kushagra.gupta＠hsc.com 20 Apr '23

20 Apr '23

Hi team, We have installed ovirt 4.4. We have a self hosted Engine setup in the environment which has 1 hosted engine on top of 1 deployment-host. Goal: We want to create a storage domain of POSIX compliant type for mounting a ceph based infrastructure. We have done SRV based resolution in our DNS server but we are unable to create a storage domain. Issue: We are passing the following information: path: :/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 vfs-type: ceph mounting option:rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA= We get the following errors: ====================vdsm.log================================== 2023-04-20 11:26:30,318+0530 INFO (jsonrpc/7) [storage.Mount] mounting :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 at /rhev/data-center/mnt/ :_volumes_xyz_conf_2ee9c2d0-873b-4d04-8c46-4c0da02787b8 (mount:207) 2023-04-20 11:26:30,384+0530 ERROR (jsonrpc/7) [storage.HSM] Could not connect to storageServer (hsm:2374) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 2371, in connectStorageServer conObj.connect() File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 180, in connect six.reraise(t, v, tb) File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise raise value File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 171, in connect self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 210, in mount cgroup=cgroup) File "/usr/lib/python3.6/site-packages/vdsm/common/supervdsm.py", line 56, in __call__ return callMethod() File "/usr/lib/python3.6/site-packages/vdsm/common/supervdsm.py", line 54, in <lambda> **kwargs) File "<string>", line 2, in mount File "/usr/lib64/python3.6/multiprocessing/managers.py", line 772, in _callmethod raise convert_to_error(kind, result) vdsm.storage.mount.MountError: Command ['/usr/bin/mount', '-t', 'ceph', '-o', 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', ' :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', '/rhev/data-center/mnt/ :_volumes_xyz_conf_2ee9c2d0-873b-4d04-8c46-4c0da02787b8'] failed with rc=32 out=b'' err=b'mount error 3 = No such process\n' 2023-04-20 11:31:05,715+0530 ERROR (jsonrpc/3) [storage.Dispatcher] FINISH connectStorageServer error=:/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 is not a valid hosttail address: (dispatcher:87) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/common/network/address.py", line 42, in hosttail_split raise ValueError ValueError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/dispatcher.py", line 74, in wrapper result = ctask.prepare(func, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 110, in wrapper return m(self, *a, **kw) File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 1190, in prepare raise self.error File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 884, in _run return fn(*args, **kargs) File "<decorator-gen-117>", line 2, in connectStorageServer File "/usr/lib/python3.6/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 2368, in connectStorageServer conObj = storageServer.ConnectionFactory.createConnection(conInfo) File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 741, in createConnection return ctor(**params) File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 154, in __init__ self._remotePath = fileUtils.normalize_path(spec) File "/usr/lib/python3.6/site-packages/vdsm/storage/fileUtils.py", line 98, in normalize_path host, tail = address.hosttail_split(path) File "/usr/lib/python3.6/site-packages/vdsm/common/network/address.py", line 45, in hosttail_split raise HosttailError('%s is not a valid hosttail address:' % hosttail) vdsm.common.network.address.HosttailError: :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 is not a valid hosttail address: 2023-04-20 11:31:05,715+0530 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer failed (error 451) in 0.00 seconds (__init__:312) ====================engine.log================================ 2023-04-20 11:31:03,818+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] HostName = deployment-host 2023-04-20 11:31:03,818+05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Command 'ConnectStorageServerVDSCommand(HostName = deployment-host, StorageServerConnectionManagementVDSParameters:{hostId='745b7584-0a43-47d9-985f-af0a0155e787', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='POSIXFS', connectionList='[StorageServerConnections:{id='null', connection=':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', iqn='null', vfsType='ceph', mountOptions='rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'})' execution failed: VDSGenericException: VDSErrorException: Failed to ConnectStorageServerVDS, error = Error storage server connection: ("domType=6, spUUID=00000000-0000-0000-0000-000000000000, conList=[{'password': '********', 'vfs_type' : 'ceph', 'port': '', 'mnt_options': 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', 'iqn': '', 'connection': ':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', 'ipv6_enabled': 'false', 'id': '00000000-0000-0000-0000-000000000000', 'user': '', 'tpgt': '1'}]",), code = 451 2023-04-20 11:31:03,818+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] FINISH, ConnectStorageServerVDSCommand, return: , log id: 19c06f3f 2023-04-20 11:31:03,819+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to ConnectStorageServerVDS, error = Error storage server connection: ("domType=6, spUUID=00000000-0000-0000-0000-000000000000, conList=[{'password': '********', 'vfs_type': 'ceph', 'port': '', 'mnt_options': 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', 'iqn': '', 'connection': ':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', 'ipv6_enabled': 'false', 'id': '00000000-0000-0000-0000-000000000000', 'user': '', 'tpgt': '1'}]",), code = 451 (Failed with error StorageServerConnectionError and code 451) 2023-04-20 11:31:03,824+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand'. 2023-04-20 11:31:03,847+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Lock freed to object 'EngineLock:{exclusiveLocks='[:/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8=STORAGE_CONNECTION]', sharedLocks=''}' 2023-04-20 11:34:27,788+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-28) [63fbb9de] Lock Acquired to object 'EngineLock:{exclusiveLocks='[c6e0aa38-20ff-4be3-9b34-81a7b0fabb6a=PROVIDER]', sharedLocks=''}' 2023-04-20 11:34:27,809+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-28) [63fbb9de] Running command: SyncNetworkProviderCommand internal: true. 2023-04-20 11:34:28,017+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-29) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access =============================================================================== We tried creating a NFS type storage domain using the hostname of the nfs server. This hostname is resolved using the dns server. We are able to create this storage domain. We also tried creating the POSIX compliant domain using the hostname of the ceph-mon node but it is failing. We are passing the following information: path: ceph-node2:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 vfs-type: ceph mounting option:rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA= In this scenario though the mounting is happening but the storage domain is not created correctly. we are getting the following errors: ====================vdsm.log================================== 2023-04-20 12:23:54,759+0530 INFO (jsonrpc/0) [api.virt] FINISH getStats return={'status': {'code': 0, 'message': 'Done'}, 'statsList': [{'statusTime': '3009297867', 'status': 'Up', 'vmId': '9ea50595-33cc-4fde-9cd2-ac35c4e97a2c', 'vmName': 'HostedEngine', 'vmType': 'kvm', 'kvmEnable': 'true', 'acpiEnable': 'true', 'elapsedTime': '71325', 'monitorResponse': '0', 'clientIp': '', 'timeOffset': '0', 'pauseCode': 'NOERR', 'cpuUser': '7.12', 'cpuSys': '1.80', 'cpuUsage': '1264730000000', 'network': {'vnet1': {'macAddr': '00:16:3e:54:7f:23', 'name': 'vnet1', 'speed': '1000', 'state': 'unknown', 'rxErrors': '0', 'rxDropped': '0', 'txErrors': '0', 'txDropped': '0', 'rx': '94068359', 'tx': '107873946', 'sampleTime': 861814.22111595}}, 'disks': {'sdc': {'truesize': '0', 'apparentsize': '0', 'readLatency': '0', 'writeLatency': '0', 'flushLatency': '0', 'writtenBytes': '0', 'writeOps': '0', 'readOps': '22', 'readBytes': '406', 'readRate': '0.0', 'writeRate': '0.0'}, 'vda': {'truesize': '76436357 12', 'apparentsize': '53689188352', 'readLatency': '0', 'writeLatency': '18963692.40625', 'flushLatency': '132326.26666666666', 'writtenBytes': '1946506752', 'writeOps': '165176', 'readOps': '31194', 'readBytes': '859866624', 'readRate': '0.0', 'writeRate': '14743.1258832571', 'imageID': 'bcd042b1-0978-43bd-bf24-eb1f554cd520'}}, 'balloonInfo': {'balloon_max': '13489152', 'balloon_min': '13489152', 'balloon_cur': '13489152', 'balloon_target': '13489152', 'ballooning_enabled': True}, 'vcpuCount': '4', 'memoryStats': {'mem_total': '12887304', 'mem_unused': '7100564', 'mem_free': '7994896', 'swap_in': 0, 'swap_out': 0, 'majflt': 0, 'minflt': 196, 'pageflt': 196}, 'displayInfo': [{'type': 'vnc', 'port': '5900', 'tlsPort': '', 'ipAddress': '10.0.1.47'}, {'type': 'spice', 'port': '5901', 'tlsPort': '5902', 'ipAddress': '10.0.1.47'}], 'hash': '-7465763413854713032', 'vmJobs': {}, 'vcpuQuota': '-1', 'vcpuPeriod': 100000, 'username': 'root', 'session': 'Unknown', 'memUsage': '40', 'guestCPUCo unt': -1, 'appsList': ('kernel-4.18.0-486.el8.x86_64', 'qemu-guest-agent-6.2.0'), 'guestIPs': '', 'guestFQDN': 'manager-hosted-engine.com', 'netIfaces': [{'hw': '00:00:00:00:00:00', 'inet': ['127.0.0.1'], 'inet6': ['::1'], 'name': 'lo'}, {'hw': '00:16:3e:54:7f:23', 'inet': ['10.0.1.48'], 'inet6': ['fe80::216:3eff:fe54:7f23'], 'name': 'eth0'}], 'disksUsage': [{'path': '/', 'total': '7505707008', 'used': '4872785920', 'fs': 'xfs'}, {'path': '/var', 'total': '21464350720', 'used': '1688195072', 'fs': 'xfs'}, {'path': '/home', 'total': '1063256064', 'used': '41271296', 'fs': 'xfs'}, {'path': '/tmp', 'total': '2136997888', 'used': '48943104', 'fs': 'xfs'}, {'path': '/var/log', 'total': '10726932480', 'used': '132661248', 'fs': 'xfs'}, {'path': '/var/log/audit', 'total': '1063256064', 'used': '42233856', 'fs': 'xfs'}, {'path': '/boot', 'total': '1063256064', 'used': '352448512', 'fs': 'xfs'}], 'guestName': 'manager-hosted-engine.com', 'guestOs': '4.18.0-486.el8.x86_64', 'guestOsInfo': {'t ype': 'linux', 'arch': 'x86_64', 'kernel': '4.18.0-486.el8.x86_64', 'distribution': 'CentOS Stream', 'version': '8', 'codename': ''}, 'guestTimezone': {'offset': 330, 'zone': 'IST'}}]} from=::1,57200, vmId=9ea50595-33cc-4fde-9cd2-ac35c4e97a2c (api:54) 2023-04-20 12:23:55,230+0530 INFO (jsonrpc/3) [vdsm.api] START repoStats(domains=['963b7fd2-c32f-400d-9abf-ade3d702cb4b']) from=::1,57200, task_id=0279b915-ac22-46d2-afbc-8466144d22d8 (api:48) 2023-04-20 12:23:55,231+0530 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={'963b7fd2-c32f-400d-9abf-ade3d702cb4b': {'code': 0, 'lastCheck': '5.1', 'delay': '0.000864457', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}} from=::1,57200, task_id=0279b915-ac22-46d2-afbc-8466144d22d8 (api:54) 2023-04-20 12:23:55,735+0530 ERROR (monitor/6ac48b4) [storage.Monitor] Error checking domain 6ac48b40-a9dc-4475-b17e-247b6018abc1 (monitor:453) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 434, in _checkDomainStatus self.domain.selftest() File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 48, in __getattr__ return getattr(self.getRealDomain(), attrName) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 51, in getRealDomain return self._cache._realProduce(self._sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 139, in _realProduce domain = self._findDomain(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 156, in _findDomain return findMethod(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/nfsSD.py", line 146, in findDomain return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID)) File "/usr/lib/python3.6/site-packages/vdsm/storage/nfsSD.py", line 136, in findDomainPath raise se.StorageDomainDoesNotExist(sdUUID) vdsm.storage.exception.StorageDomainDoesNotExist: Storage domain does not exist: ('6ac48b40-a9dc-4475-b17e-247b6018abc1',) 2023-04-20 12:23:56,307+0530 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/[abcd:abcd:abcd::51]:6789:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9/6ac48b40-a9dc-4475-b17e-247b6018abc1/dom_md/metadata (monitor:511) ====================engine.log================================ 2023-04-20 12:23:55,064+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Lock Acquired to object 'EngineLock:{exclusiveLocks='[ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9=STORAGE_CONNECTION]', sharedLocks=''}' 2023-04-20 12:23:55,118+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2023-04-20 12:23:55,119+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] START, ConnectStorageServerVDSCommand(HostName = deployment-host, StorageServerConnectionManagementVDSParameters:{hostId='745b7584-0a43-47d9-985f-af0a0155e787', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='POSIXFS', connectionList='[StorageServerConnections:{id='null', connection='ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9', iqn='null', vfsType='ceph', mountOptions='rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 7e34045e 2023-04-20 12:23:55,223+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=100}, log id: 7e34045e 2023-04-20 12:23:55,248+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] EVENT_ID: STORAGE_DOMAIN_ERROR(996), The error message for connection ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 returned by VDSM was: General Exception 2023-04-20 12:23:55,248+05 ERROR [org.ovirt.engine.core.bll.storage.connection.FileStorageHelper] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] The connection with details 'ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9' failed because of error code '100' and error message is: general exception 2023-04-20 12:23:55,249+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand' failed: EngineException: GeneralException (Failed with error GeneralException and code 100) 2023-04-20 12:23:55,255+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand'. 2023-04-20 12:23:55,278+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Lock freed to object 'EngineLock:{exclusiveLocks='[ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9=STORAGE_CONNECTION]', sharedLocks=''}' This also doesn't work. We tried mounting the ceph-mon nodes cluster manually on the deployment host CLI , we were able to mount the same. sudo mount -t ceph :/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 /rhev/data-center/mnt/:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9 -o rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA== [root@deployment-host mnt]# df -kh df: /run/user/0/gvfs: Transport endpoint is not connected Filesystem Size Used Avail Use% Mounted on [abcd:abcd:abcd::51]:6789,[abcd:abcd:abcd::52]:6789,[abcd:abcd:abcd::53]:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 19G 0 19G 0% /rhev/data-center/mnt/:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9 Queries: 1. Could you help us in creating a storage domain for the same from UI. 2. Do we have any process of doing the same using the CLI. Thanks and Regards Kushagra Gupta

1 0

Ovirt installation, deployment failed..
by John Bnet 20 Apr '23

20 Apr '23

Hi, I'm new to ovirt. I'm trying to get it up and running but I stuck at the deployement point. Can someone have any idea of what is going on? this is what i did to install on cent0s8 --> hostnamectl set-hostname node1.local.net vi /etc/hosts dnf install -y centos-release-ovirt45 dnf module enable -y javapackages-tools pki-deps postgresql:12 389-ds mod_auth_openidc dnf update dnf install ovirt-engine engine-setup dnf install cockpit-ovirt-dashboard vdsm-gluster ovirt-host systemctl enable cockpit.socket systemctl start cockpit.socket firewall-cmd --list-services firewall-cmd --permanent --add-service=cockpit hosted-engine --deploy an here is a part of the log output: 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/internalPackageTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/mainTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.packagers.yumpackager.Plugin._setup 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.packagers.yumpackager.Plugin._setup condition False 2023-04-19 09:32:36,630-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.engine.fqdn.Plugin._setup 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=NoneType:'None' 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=NoneType:'None' 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,632-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._setup 2023-04-19 09:32:36,633-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.gateway.Plugin._setup 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.network_check.Plugin._setup 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=NoneType:'None' 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=NoneType:'None' 2023-04-19 09:32:36,635-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,635-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.vm.cloud_init.Plugin._setup 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=NoneType:'None' 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.network.firewalld.Plugin._setup 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=NoneType:'None' 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=NoneType:'None' 2023-04-19 09:32:36,638-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,638-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.network.hostname.Plugin._setup 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.openrc.Plugin._setup 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc=NoneType:'None' 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc-update=NoneType:'None' 2023-04-19 09:32:36,640-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,640-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.rhel.Plugin._setup 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/initctl=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=NoneType:'None' 2023-04-19 09:32:36,642-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,642-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.systemd.Plugin._setup 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.system.clock.Plugin._setup 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=NoneType:'None' 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ntpq=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.system.reboot.Plugin._setup 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=NoneType:'None' 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,646-0400 INFO otopi.context context.runSequence:616 Stage: Environment packages setup 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context.runSequence:620 STAGE internal_packages 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.core.transaction.Plugin._pre_prepare 2023-04-19 09:32:36,647-0400 DEBUG otopi.transaction transaction._prepare:61 preparing 'DNF Transaction' 2023-04-19 09:32:36,647-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Creating transaction 2023-04-19 09:32:38,583-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.gr_he_common.vm.boot_disk.Plugin._internal_packages 2023-04-19 09:32:38,584-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.vm.boot_disk.Plugin._internal_packages condition False 2023-04-19 09:32:38,585-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.packagers.dnfpackager.Plugin._internal_packages_end 2023-04-19 09:32:38,585-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Building transaction 2023-04-19 09:32:38,870-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Transaction built 2023-04-19 09:32:38,871-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Empty transaction 2023-04-19 09:32:38,872-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.packagers.yumpackager.Plugin._internal_packages_end 2023-04-19 09:32:38,872-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.packagers.yumpackager.Plugin._internal_packages_end condition False 2023-04-19 09:32:38,873-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.core.transaction.Plugin._pre_end 2023-04-19 09:32:38,873-0400 DEBUG otopi.transaction transaction.commit:152 committing 'DNF Transaction' 2023-04-19 09:32:38,873-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Closing transaction with commit 2023-04-19 09:32:38,873-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Calling _plugins._unload 2023-04-19 09:32:38,927-0400 INFO otopi.context context.runSequence:616 Stage: Programs detection 2023-04-19 09:32:38,927-0400 DEBUG otopi.context context.runSequence:620 STAGE programs 2023-04-19 09:32:38,927-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._check_NM 2023-04-19 09:32:38,928-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.network.bridge.Plugin._check_NM condition False 2023-04-19 09:32:38,929-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.system.command.Plugin._programs 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=str:'/usr/sbin/chkconfig' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=str:'/usr/bin/chronyc' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=str:'/usr/bin/date' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=str:'/usr/bin/dig' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=str:'/usr/bin/firewall-cmd' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=str:'/usr/sbin/hwclock' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=str:'/usr/sbin/ip' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=str:'/usr/bin/nc' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=str:'/usr/sbin/ping' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=str:'/usr/bin/python3' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=str:'/usr/sbin/reboot' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=str:'/usr/sbin/service' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=str:'/usr/bin/ssh-keygen' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=str:'/usr/bin/systemctl' 2023-04-19 09:32:38,932-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:38,932-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.openrc.Plugin._programs 2023-04-19 09:32:38,933-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.rhel.Plugin._programs 2023-04-19 09:32:38,934-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show-environment'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,943-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show-environment'), rc=0 2023-04-19 09:32:38,944-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show-environment') stdout: LANG=en_US.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2023-04-19 09:32:38,944-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show-environment') stderr: 2023-04-19 09:32:38,945-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.systemd.Plugin._programs 2023-04-19 09:32:38,945-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show-environment'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show-environment'), rc=0 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show-environment') stdout: LANG=en_US.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show-environment') stderr: 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd systemd._programs:49 registering systemd provider 2023-04-19 09:32:38,955-0400 INFO otopi.context context.runSequence:616 Stage: Environment setup (late) 2023-04-19 09:32:38,955-0400 DEBUG otopi.context context.runSequence:620 STAGE late_setup 2023-04-19 09:32:38,956-0400 DEBUG otopi.context context._executeMethod:127 Stage late_setup METHOD otopi.plugins.gr_he_common.vm.boot_disk.Plugin._late_setup 2023-04-19 09:32:38,956-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.vm.boot_disk.Plugin._late_setup condition False 2023-04-19 09:32:38,957-0400 INFO otopi.context context.runSequence:616 Stage: Environment customization 2023-04-19 09:32:38,957-0400 DEBUG otopi.context context.runSequence:620 STAGE customization 2023-04-19 09:32:38,958-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.network.firewalld.Plugin._customization 2023-04-19 09:32:38,958-0400 DEBUG otopi.plugins.otopi.services.systemd systemd.exists:85 check if service firewalld exists 2023-04-19 09:32:38,958-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service'), rc=0 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service') stdout: LoadState=loaded 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service') stderr: 2023-04-19 09:32:38,969-0400 DEBUG otopi.plugins.otopi.network.firewalld firewalld._get_firewalld_cmd_version:116 firewalld version: 0.9.3 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldAvailable=bool:'True' 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:38,971-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.core.config.Plugin._customize1 2023-04-19 09:32:38,972-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._storage_start 2023-04-19 09:32:38,972-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,973-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND --== STORAGE CONFIGURATION ==-- 2023-04-19 09:32:38,973-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,974-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.dialog.cli.Plugin._customize 2023-04-19 09:32:38,974-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.cli.Plugin._customize condition False 2023-04-19 09:32:38,975-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._storage_end 2023-04-19 09:32:38,976-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._network_start 2023-04-19 09:32:38,976-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,976-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND --== HOST NETWORK CONFIGURATION ==-- 2023-04-19 09:32:38,977-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,978-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._detect_bridges 2023-04-19 09:32:38,979-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.gateway.Plugin._customization 2023-04-19 09:32:38,979-0400 DEBUG otopi.plugins.otopi.dialog.human human.queryString:174 query OVEHOSTED_GATEWAY 2023-04-19 09:32:38,979-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Please indicate the gateway IP address [10.3.3.1]: 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/gateway=str:'10.3.3.1' 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/OVEHOSTED_GATEWAY=str:'10.3.3.1' 2023-04-19 09:32:40,456-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:40,456-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._customization 2023-04-19 09:32:40,456-0400 INFO otopi.plugins.gr_he_common.network.bridge bridge._customization:143 Checking available network interfaces: 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:198 ansible-playbook: cmd: ['/bin/ansible-playbook', '--module-path=/usr/share/ovirt-hosted-engine-setup/he_ansible', '--inventory=localhost,', '--extra-vars=@/tmp/tmppje659zg', '--tags=get_network_interfaces', '--skip-tags=always', '/usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml'] 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:199 ansible-playbook: out_path: /tmp/tmp4gk4pm6s 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:200 ansible-playbook: vars_path: /tmp/tmppje659zg 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:201 ansible-playbook: env: {'LS_COLORS': 'rs=0:di=38;5;33:ln=38;5;51:mh=00:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=01;05;37;41:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;40:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.zst=38;5;9:*.tzst=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.wim=38;5;9:*.swm=38;5;9:*.dwm=38;5;9:*.esd=38; 5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.mjpg=38;5;13:*.mjpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.m4a=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.oga=38;5;45:*.opus=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'SSH_CONNECTION': '10.3.3.95 33474 10.3.3.55 22', 'LANG': 'en_CA.UTF-8', 'HISTCONTROL': 'ignoredups', 'GUESTFISH_RESTORE': '\\e[0m', 'HOSTNAME': 'node1.local.net', 'GUESTFISH_INIT': '\\e[1;34m', 'S_COLORS': 'auto', 'which_declare': 'declare -f', 'XDG_SESSION_ID': '4', 'USER': 'root', 'GUESTFISH_PS1': '\\[\\e[1;32m\\]><fs>\\[\\e[0;31m\\] ', 'SELINUX_ROLE_REQUESTED': '', 'PWD': '/root', 'SSH_ASKPASS': '/usr/libexec/openssh/gnome-ssh-askpass', 'HOME': '/root', 'SSH_CLIENT': '10.3.3.95 33474 22', 'SELINUX_LEVEL_REQUESTED': '', 'XDG_DATA_DIRS': '/root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share', 'SSH_TTY': '/dev/pts/0', 'MAIL': '/var/spool/mail/root', 'SHELL': '/bin/bash', 'TERM': 'xterm-256color', 'SELINUX_USE_CURRENT_RANGE': '', 'SHLVL': '1', 'PYTHONPATH': '/usr/share/ovirt-hosted-engine-setup/scripts/..:', 'LOGNAME': 'root', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/0/bus', 'XDG_RUNTIME_DIR': '/run/user/0', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin', 'GUESTFISH_OUTPUT': ' \\e[0m', 'DEBUGINFOD_URLS': 'https://debuginfod.centos.org/ ', 'HISTSIZE': '1000', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'BASH_FUNC_which%%': '() { ( alias;\n eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@\n}', 'OTOPI_EXECDIR': '/root', 'OTOPI_LOGFILE': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log', 'OTOPI_CALLBACK_OF': '/tmp/tmp4gk4pm6s', 'ANSIBLE_CALLBACKS_ENABLED': '1_otopi_json,2_ovirt_logger', 'ANSIBLE_STDOUT_CALLBACK': '1_otopi_json', 'HE_ANSIBLE_LOG_PATH': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-ansible-get_network_interfaces-20230419093240-wm9s2d.log'} 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:226 ansible-playbook rc: 250 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:233 ansible-playbook stdout: 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:235 b'to see the full traceback, use -vvv\n' 2023-04-19 09:32:41,364-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:236 ansible-playbook stderr: 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"import name 'Callable' from 'collections'\n" 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'(/usr/lib64/python3.11/collections/__init__.py)\n' 2023-04-19 09:32:41,365-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" 2023-04-19 09:32:41,365-0400 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-common/network/bridge.py", line 152, in _customization r = ah.run() File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 240, in run raise RuntimeError(_('Failed executing ansible-playbook')) RuntimeError: Failed executing ansible-playbook 2023-04-19 09:32:41,367-0400 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Environment customization': Failed executing ansible-playbook 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/error=bool:'True' 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>)]' 2023-04-19 09:32:41,368-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:41,368-0400 INFO otopi.context context.runSequence:616 Stage: Clean up 2023-04-19 09:32:41,368-0400 DEBUG otopi.context context.runSequence:620 STAGE cleanup 2023-04-19 09:32:41,369-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.gr_he_ansiblesetup.core.misc.Plugin._cleanup 2023-04-19 09:32:41,369-0400 INFO otopi.plugins.gr_he_ansiblesetup.core.misc misc._cleanup:546 Cleaning temporary resources 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:198 ansible-playbook: cmd: ['/bin/ansible-playbook', '--module-path=/usr/share/ovirt-hosted-engine-setup/he_ansible', '--inventory=localhost,', '--extra-vars=@/tmp/tmptom_o0os', '--tags=final_clean', '--skip-tags=always', '/usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml'] 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:199 ansible-playbook: out_path: /tmp/tmpjo8dbijt 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:200 ansible-playbook: vars_path: /tmp/tmptom_o0os 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:201 ansible-playbook: env: {'LS_COLORS': 'rs=0:di=38;5;33:ln=38;5;51:mh=00:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=01;05;37;41:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;40:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.zst=38;5;9:*.tzst=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.wim=38;5;9:*.swm=38;5;9:*.dwm=38;5;9:*.esd=38; 5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.mjpg=38;5;13:*.mjpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.m4a=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.oga=38;5;45:*.opus=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'SSH_CONNECTION': '10.3.3.95 33474 10.3.3.55 22', 'LANG': 'en_CA.UTF-8', 'HISTCONTROL': 'ignoredups', 'GUESTFISH_RESTORE': '\\e[0m', 'HOSTNAME': 'node1.local.net', 'GUESTFISH_INIT': '\\e[1;34m', 'S_COLORS': 'auto', 'which_declare': 'declare -f', 'XDG_SESSION_ID': '4', 'USER': 'root', 'GUESTFISH_PS1': '\\[\\e[1;32m\\]><fs>\\[\\e[0;31m\\] ', 'SELINUX_ROLE_REQUESTED': '', 'PWD': '/root', 'SSH_ASKPASS': '/usr/libexec/openssh/gnome-ssh-askpass', 'HOME': '/root', 'SSH_CLIENT': '10.3.3.95 33474 22', 'SELINUX_LEVEL_REQUESTED': '', 'XDG_DATA_DIRS': '/root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share', 'SSH_TTY': '/dev/pts/0', 'MAIL': '/var/spool/mail/root', 'SHELL': '/bin/bash', 'TERM': 'xterm-256color', 'SELINUX_USE_CURRENT_RANGE': '', 'SHLVL': '1', 'PYTHONPATH': '/usr/share/ovirt-hosted-engine-setup/scripts/..:', 'LOGNAME': 'root', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/0/bus', 'XDG_RUNTIME_DIR': '/run/user/0', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin', 'GUESTFISH_OUTPUT': ' \\e[0m', 'DEBUGINFOD_URLS': 'https://debuginfod.centos.org/ ', 'HISTSIZE': '1000', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'BASH_FUNC_which%%': '() { ( alias;\n eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@\n}', 'OTOPI_EXECDIR': '/root', 'OTOPI_LOGFILE': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log', 'OTOPI_CALLBACK_OF': '/tmp/tmpjo8dbijt', 'ANSIBLE_CALLBACKS_ENABLED': '1_otopi_json,2_ovirt_logger', 'ANSIBLE_STDOUT_CALLBACK': '1_otopi_json', 'HE_ANSIBLE_LOG_PATH': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-ansible-final_clean-20230419093241-7kk3yj.log'} 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:226 ansible-playbook rc: 250 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:233 ansible-playbook stdout: 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:235 b'to see the full traceback, use -vvv\n' 2023-04-19 09:32:42,277-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:236 ansible-playbook stderr: 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"import name 'Callable' from 'collections'\n" 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'(/usr/lib64/python3.11/collections/__init__.py)\n' 2023-04-19 09:32:42,278-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" 2023-04-19 09:32:42,278-0400 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/misc.py", line 547, in _cleanup r = ah.run() File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 240, in run raise RuntimeError(_('Failed executing ansible-playbook')) RuntimeError: Failed executing ansible-playbook 2023-04-19 09:32:42,279-0400 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Clean up': Failed executing ansible-playbook 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>), (<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef3bc4988>)]' 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,281-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.otopi.dialog.answer_file.Plugin._generate_answer_file 2023-04-19 09:32:42,281-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFileContent=str:'# OTOPI answer file, generated by human dialog [environment:default] QUESTION/1/DEPLOY_PROCEED=str:yes QUESTION/1/FORCE_IP_PROCEED=str:yes QUESTION/1/OVEHOSTED_GATEWAY=str:10.3.3.1 QUESTION/1/TMUX_PROCEED=str:yes ' 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.gr_he_common.core.answerfile.Plugin._save_answers_at_cleanup 2023-04-19 09:32:42,283-0400 INFO otopi.plugins.gr_he_common.core.answerfile answerfile._save_answers:74 Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20230419093242.conf' 2023-04-19 09:32:42,284-0400 INFO otopi.context context.runSequence:616 Stage: Pre-termination 2023-04-19 09:32:42,284-0400 DEBUG otopi.context context.runSequence:620 STAGE pre-terminate 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context._executeMethod:127 Stage pre-terminate METHOD otopi.plugins.otopi.core.misc.Plugin._preTerminate 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/aborted=bool:'False' 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/debug=int:'0' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/error=bool:'True' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>), (<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef3bc4988>)]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/executionDirectory=str:'/root' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exitCode=list:'[{'priority': 90001, 'code': 0}]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/log=bool:'True' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/pluginGroups=str:'otopi:gr-he-common:gr-he-ansiblesetup' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/pluginPath=str:'/usr/share/otopi/plugins:/usr/share/ovirt-hosted-engine-setup/scripts/../plugins' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/suppressEnvironmentKeys=list:'[]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=str:'/usr/sbin/chkconfig' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=str:'/usr/bin/chronyc' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=str:'/usr/bin/date' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=str:'/usr/bin/dig' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=str:'/usr/bin/firewall-cmd' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=str:'/usr/sbin/hwclock' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/initctl=NoneType:'None' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=str:'/usr/sbin/ip' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=str:'/usr/bin/nc' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ntpq=NoneType:'None' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=str:'/usr/sbin/ping' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=str:'/usr/bin/python3' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc-update=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=str:'/usr/sbin/reboot' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=str:'/usr/sbin/service' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=str:'/usr/bin/ssh-keygen' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=str:'/usr/bin/systemctl' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/configFileAppend=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/configFileName=str:'/etc/ovirt-hosted-engine-setup.conf' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/failOnPrioOverride=bool:'True' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/ignoreMissingBeforeAfter=bool:'True' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/internalPackageTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logDir=str:'/var/log/ovirt-hosted-engine-setup' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileHandle=TextIOWrapper:'<_io.TextIOWrapper name='/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log' mode='a' encoding='UTF-8'>' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileName=str:'/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileNamePrefix=str:'ovirt-hosted-engine-setup' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilter=_MyLoggerFilter:'filter' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterKeys=list:'['OVEHOSTED_ENGINE/adminPassword', 'OVEHOSTED_VM/cloudinitRootPwd']' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterQuestions=list:'[]' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterQuestionsKeys=set:'set()' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterRe=list:'[re.compile('\n BEGIN\\ PRIVATE\\ KEY\n (?P<filter>.*)\n END\\ PRIVATE\\ KEY\n ', re.DOTALL|re.VERBOSE)]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logRemoveAtExit=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/mainTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/modifiedFiles=list:'[]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/randomizeEvents=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFile=NoneType:'None' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFileContent=str:'# OTOPI answer file, generated by human dialog [environment:default] QUESTION/1/DEPLOY_PROCEED=str:yes QUESTION/1/FORCE_IP_PROCEED=str:yes QUESTION/1/OVEHOSTED_GATEWAY=str:10.3.3.1 QUESTION/1/TMUX_PROCEED=str:yes ' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/autoAcceptDefault=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/boundary=str:'--=451b80dc-996f-432e-9e4f-2b29ef6d1141=--' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/cliVersion=int:'1' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/customization=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/dialect=str:'human' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV INFO/PACKAGE_NAME=str:'otopi' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV INFO/PACKAGE_VERSION=str:'1.10.3' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldAvailable=bool:'True' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldDisableServices=list:'[]' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/iptablesEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/iptablesRules=NoneType:'None' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshKey=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshUser=str:'' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/checkRequirements=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/deployProceed=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/enableKeycloak=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/etcAnswerFile=str:'/etc/ovirt-hosted-engine/answers.conf' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/forceIpProceed=str:'yes' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/localVMDir=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/memCheckRequirements=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/miscReached=bool:'False' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/nodeSetup=bool:'False' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/pauseonRestore=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/renewPKIonRestore=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/restoreFromFile=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/screenProceed=bool:'True' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/skipTTYCheck=bool:'False' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/tempDir=str:'/var/tmp' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/userAnswerFile=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/adminPassword=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/adminUsername=str:'admin@internal' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/appHostName=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/clusterName=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/datacenterName=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/enableHcGlusterService=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/enableLibgfapi=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/engineSetupTimeout=int:'1800' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/insecureSSL=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/interactiveAdminPassword=bool:'True' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/temporaryCertificate=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_FIRST_HOST/deployWithHE35Hosts=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_FIRST_HOST/skipSharedStorageAF=bool:'False' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/allowInvalidBondModes=bool:'False' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/bridgeIf=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/bridgeName=str:'ovirtmgmt' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/forceIPv4=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/forceIPv6=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/fqdn=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/fqdnReverseValidation=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/gateway=str:'10.3.3.1' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/host_name=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test_tcp_address=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test_tcp_port=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/refuseDeployingWithNM=bool:'False' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/destEmail=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/smtpPort=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/smtpServer=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/sourceEmail=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_SANLOCK/lockspaceName=str:'hosted-engine' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_SANLOCK/serviceName=str:'sanlock' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/LunID=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/blockDeviceSizeGB=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/discardSupport=bool:'False' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/domainType=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIDiscoverPassword=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIDiscoverUser=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortal=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalIPAddress=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalPassword=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalPort=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalUser=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSITargetName=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgDesc=str:'Hosted Engine Image' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgSizeGB=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgUUID=str:'6259993f-beb7-4c29-91a9-9570dd12ac8a' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/lockspaceImageUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/lockspaceVolumeUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/metadataImageUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/metadataVolumeUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/mntOptions=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/nfsVersion=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/ovfSizeGB=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/storageDomainConnection=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/storageDomainName=str:'hosted_storage' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/volUUID=str:'1c68fc63-4512-418e-9949-075cd297f40e' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/kvmGid=int:'36' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/serviceName=str:'vdsmd' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/useSSL=bool:'True' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/vdscli=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/vdsmUid=int:'36' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/OpenScapProfileName=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/acceptDownloadEApplianceRPM=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceMem=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceVCpus=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceVersion=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applyOpenScapProfile=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/automateVMShutdown=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cdromUUID=str:'b941c4c0-7966-400c-a9fd-b2a85c9a4c33' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudInitISO=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitExecuteEngineSetup=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitInstanceDomainName=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitInstanceHostName=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitRootPwd=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMDNS=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMETCHOSTS=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMStaticCIDR=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMTZ=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/consoleUUID=str:'4b2ee9e8-a64e-4288-8672-95d080193230' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/emulatedMachine=str:'pc' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/enableFips=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/localVmUUID=str:'a729bb55-b00c-4d2f-a6b1-d7a3008539ee' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/maxVCpus=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/nicUUID=str:'1a061d6c-8a0d-4a80-ab69-cf67d9558586' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/ovfArchive=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/rootSshAccess=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/rootSshPubkey=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmCDRom=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmMACAddr=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmMemSizeMB=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmVCpus=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfDisabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfExpireCache=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfRollback=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfpackagerEnabled=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/keepAliveInterval=int:'30' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumDisabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumEnabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumExpireCache=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumRollback=bool:'True' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumpackagerEnabled=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/DEPLOY_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/FORCE_IP_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/OVEHOSTED_GATEWAY=str:'10.3.3.1' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/TMUX_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/clockMaxGap=int:'5' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/clockSet=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/commandPath=str:'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/reboot=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/rebootAllow=bool:'True' 2023-04-19 09:32:42,304-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/rebootDeferTime=int:'10' 2023-04-19 09:32:42,304-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,305-0400 DEBUG otopi.context context._executeMethod:127 Stage pre-terminate METHOD otopi.plugins.otopi.dialog.cli.Plugin._pre_terminate 2023-04-19 09:32:42,305-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.cli.Plugin._pre_terminate condition False 2023-04-19 09:32:42,305-0400 INFO otopi.context context.runSequence:616 Stage: Termination 2023-04-19 09:32:42,306-0400 DEBUG otopi.context context.runSequence:620 STAGE terminate 2023-04-19 09:32:42,306-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.gr_he_common.core.misc.Plugin._terminate 2023-04-19 09:32:42,306-0400 ERROR otopi.plugins.gr_he_common.core.misc misc._terminate:167 Hosted Engine deployment failed 2023-04-19 09:32:42,307-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Log file is located at 2023-04-19 09:32:42,307-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log 2023-04-19 09:32:42,308-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.dialog.human.Plugin._terminate 2023-04-19 09:32:42,313-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.dialog.machine.Plugin._terminate 2023-04-19 09:32:42,313-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.machine.Plugin._terminate condition False 2023-04-19 09:32:42,314-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.core.log.Plugin._terminate

2 1

Administration portal doesn't load.
by kushagra.gupta＠hsc.com 19 Apr '23

19 Apr '23

I have an odd situation: When I go to https://ovengine/manager-engine.com/webadmin/?locale=en_US after authentication passes... it shows the top banner of oVirt OPEN VIRTUALIZATION MANAGER and the Loading ... in the center. but never gets past that. I also followed the thread and tried opening the admin portal in the private/incognito mode but I still face the issue. I rebooted the hosted engine as well but I am still facing the same issue. When I trigger the above url, in the engine.log, following logs are created: 2023-04-19 12:09:37,535+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-14) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2023-04-19 12:09:37,581+05 INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-14) [4593247b] Running command: CreateUserSessionCommand internal: false. 2023-04-19 12:09:37,655+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [4593247b] EVENT_ID: USER_VDC_LOGIN(30), User admin@internal-authz connecting from '10.0.1.2' using session 'tmdEg3zM+kPrJudpmQr+ITRboP8CWKVDlKP4XmYiB2GDqgWfSRj2H/kpNd96JfEXOuB+CjBNz72FkLx5//77kg==' logged in. 2023-04-19 12:11:01,457+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Lock Acquired to object 'EngineLock:{exclusiveLocks='[7a49bb81-3c73-4119-8cb0-f3f6d88fafb9=PROVIDER]', sharedLocks=''}' 2023-04-19 12:11:01,463+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Running command: SyncNetworkProviderCommand internal: true. 2023-04-19 12:11:01,564+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-6) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2023-04-19 12:11:01,647+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Lock freed to object 'EngineLock:{exclusiveLocks='[7a49bb81-3c73-4119-8cb0-f3f6d88fafb9=PROVIDER]', sharedLocks=''}' As you can see there are no error logs. But at the same time I am able to see some prior errors in the engine.log file: ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-96) [] Command 'HSMGetAllTasksStatusesVDSCommand(HostName = ovirt-host, VdsIdVDSCommandParametersBase:{hostId='b2137069-b4e7-4c16-91e1-7f889c62ab88'})' execution failed: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () ERROR [org.ovirt.engine.core.bll.pm.FenceProxyLocator] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-47) [1e63b6f1] Can not run fence action on host 'ovirt-host', no suitable proxy host was found. WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineSch eduledThreadPool-Thread-14) [14a0ecc4] EVENT_ID: SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_WITH_ERROR(987), Invalid status on Data Center Default . Setting Data Center status to Non Responsive (On host ovirt-host, Error: Network error during communication with the Host.). 2023-04-18 19:15:13,838+05 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connection timeout for host 'ovirt-hos t', last response arrived 22501 ms ago. ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedScheduledExecutorService-engineScheduledThrea dPool-Thread-45) [] Unable to GetStats: VDSNetworkException: VDSGenericException: VDSNetworkException: Broken pipe Also I can see that there is a connection between the ovirt-host and the hosted-engine: ==========================Hosted Engine===================================================== [root@manager-engine ovirt-engine]# netstat -anlp | grep 54321 tcp6 0 0 10.0.1.103:39944 10.0.1.101:54321 ESTABLISHED 2971/ovirt-engine tcp6 0 0 10.0.1.103:44234 10.0.1.101:54321 ESTABLISHED 2971/ovirt-engine [root@manager-engine ovirt-engine]# ===========================Ovirt-host======================================================== [root@ovirt-host ~]# netstat -anlp | grep 54321 tcp6 0 0 :::54321 :::* LISTEN 114608/python3 tcp6 0 0 ::1:54321 ::1:37428 ESTABLISHED 114608/python3 tcp6 0 0 ::1:54321 ::1:37414 ESTABLISHED 114608/python3 tcp6 0 0 10.0.1.101:54321 10.0.1.103:44234 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37428 ::1:54321 ESTABLISHED 105702/platform-pyt tcp6 0 0 ::1:54321 ::1:37416 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37416 ::1:54321 ESTABLISHED 114861/platform-pyt tcp6 0 0 10.0.1.101:54321 10.0.1.103:39944 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37414 ::1:54321 ESTABLISHED 105491/platform-pyt [root@ovirt-host ~]# netstat -anlp | grep vdsm unix 2 [ ACC ] STREAM LISTENING 770058 96907/python3 /run/vdsm/svdsm.sock unix 2 [ ACC ] STREAM LISTENING 1223139 114861/platform-pyt /run/vdsm/mom-vdsm.sock unix 3 [ ] STREAM CONNECTED 1226522 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6903654 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1230271 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1230065 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6823534 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6838191 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1224904 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1225672 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1214103 96907/python3 /run/vdsm/svdsm.sock [root@ovirt-host ~]# [root@ovirt-host ~]# systemctl status vdsmd.service ? vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: disabled) Active: active (running) since Tue 2023-04-18 19:15:08 IST; 16h ago Process: 114535 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 114608 (vdsmd) Tasks: 63 (limit: 48695) Memory: 122.2M CGroup: /system.slice/vdsmd.service tq114608 /usr/bin/python3 /usr/share/vdsm/vdsmd mq114826 /usr/libexec/ioprocess --read-pipe-fd 50 --write-pipe-fd 49 --max-threads 10 --max-queued-requests 10 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing network: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing network: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:13:34 ovirt-host vdsm[114608]: WARN Attempting to add an existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 11:18:27 ovirt-host vdsm[114608]: ERROR ssl handshake: socket error, address: ::ffff:10.0.1.103 Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable. [root@ovirt-host ~]# Current netwoking: [root@ovirt-host ~]# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp2s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 48:4d:7e:a8:d8:73 brd ff:ff:ff:ff:ff:ff 3: enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff 4: enp0s20f0u6.408@enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovirtmgmt state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff 5: enp0s20f0u6.400@enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff inet6 abcd:abcd:abcd::17/64 scope global noprefixroute valid_lft forever preferred_lft forever inet6 fe80::1a7:ccb1:ae9b:9b8f/64 scope link noprefixroute valid_lft forever preferred_lft forever 38: ;vdsmdummy;: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether de:b4:76:ba:04:82 brd ff:ff:ff:ff:ff:ff 39: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 6e:94:55:f5:51:12 brd ff:ff:ff:ff:ff:ff 40: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether b6:96:23:82:d2:48 brd ff:ff:ff:ff:ff:ff 73: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff inet 10.0.1.101/24 brd 10.0.1.255 scope global noprefixroute ovirtmgmt valid_lft forever preferred_lft forever 90: vnet2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovirtmgmt state UNKNOWN group default qlen 1000 link/ether fe:16:3e:0d:0f:b9 brd ff:ff:ff:ff:ff:ff inet6 fe80::fc16:3eff:fe0d:fb9/64 scope link valid_lft forever preferred_lft forever [root@ovirt-host ~]# Could anyone please help me with this? I have tried re-installation as well but still no luck. Thanks and Regards Kushagra Gupta

2 1

vm has very slow write speed on posix compliant fs disk.
by arc＠b4restore.com 19 Apr '23

19 Apr '23

Hi, we have noticed that we get around 30MB/s of write speed per vm in oVirt on our datastore that is a GPFS filesystem mounted as posix compliant fs. Read speeds are around 1.5-3.3GB/s. We tested directly on the mount from the host cli with some benchmarking tools and from the host directly into the gpfs filesystem we get line speeds but from vms we dont.. does anybody have some clues to what is going on and what to try? Br Andi

1 0

ovirt-engine - developer mode installation
by yongshengmaa＠126.com 19 Apr '23

19 Apr '23

Hello , I'm doing a developer mode installation for ovirt-engine. I'd like to install it based on CentOS 8 Stream, but no matched version of postgresql packages are provided. Which CentOS version should I start this work? Sincerely, Yongsheng

2 9

Hosted deployment difficulties, am I missing anything?
by Xavier Lauzon 17 Apr '23

17 Apr '23

Hi everyone, Last week I had a server go down, which was the only node in my deployment handling the hosted engine (ironically, this happened right when we were planning to move the he to HA). As a result, we have been trying to redeploy the engine but have had no success. We have tried installing on every ovirt node ng stable version from 4.4.10-4.5.4.el8 and .el9. Unfortunately, each time we try to deploy the engine from scratch, we receive either of two errors depending on the version. Some versions fail to create the default network, which can be manually fixed but leads to the following error. The deployment goes until the "Waiting for host to be up" stage; however, it fails without any information as to why. I've sifted through virtually all the logs but can't find the root cause. I am aware of an ongoing issue in the ansible collection (https://github.com/oVirt/ovirt-ansible-collection/issues/695) however, even the fix outlined there does not seem to solve this issue. Additionally, I have headed the recent advice from Sandro to switch to the nightly version. Unfortunately, this has also not been working on either ovirt node or CentOS 9/8, and today has resulted in the following error: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "cmd": ["virsh", "net-dumpxml", "default"], "delta": "0:00:00.077767", "end": "2023-04-17 17:00:05.980049", "msg": "non-zero return code", "rc": 1, "start": "2023-04-17 17:00:05.902282", "stderr": "error: failed to get network 'default'\nerror: Network not found: no network with matching name 'default'", "stderr_lines": ["error: failed to get network 'default'", "error: Network not found: no network with matching name 'default'"], "stdout": "", "stdout_lines": []} [ ERROR ] Failed to execute stage 'Closing up': Failed getting local_vm_dir Please let me know what additional information needs to be provided; I am more than happy to do so. Is there something I'm missing here? Is there a version that is confirmed to be working at the moment? I am grateful for anyone who takes the time to look into my issue, Xavier Lauzon

1 0

oVirt Installation script
by destfinal＠googlemail.com 17 Apr '23

17 Apr '23

Hi, I am trying to install a self-hosted oVirt cluster using this page - https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engin…. Right from the beginning the documentation states "Self-hosted engine installation is automated using Ansible" and "installation script" all over. But I could not find any link in this regard in this page or elsewhere. Am I missing to see it in the doc? Can somebody please help? Thanks

2 4

How to build network load graphs
by Артур Кириллов 17 Apr '23

17 Apr '23

After updating Overt to 4.5.4, the network load graphs disappeared. Q: How is charting organized? What certificates are involved in data exchange?

1 0

/tmp/lvm.log keeps growing in Host
by kanehisa＠ktcsp.net 16 Apr '23

16 Apr '23

I don't understand why lvm.log is placed in /tmp directory without rotation. I noticed this fact when I got the following event notification every 2 hours. EventID ：24 Message ：Critical, Low disk space. Host ovirt01 has less than 500 MB of free space left on: /tmp. Low disk space might cause an issue upgrading this host. As a workaround, I added a log rotation setting to /tmp/lvm.log, but is this the correct way? I should have understood the contents of the Python program below before asking the question, but please forgive me because I am not very knowledgeable about Python. # cat /usr/lib/python3.6/site-packages/blivet/devicelibs/lvm.py | grep lvm.log config_string += "log {level=7 file=/tmp/lvm.log syslog=0}" Thanks in advance!! Further information is below [root@ovirt01 ~]# cat /etc/os-release NAME="CentOS Stream" VERSION="8" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="8.7.2206.0" VARIANT="oVirt Node 4.5.4" VARIANT_ID="ovirt-node" PRETTY_NAME="oVirt Node 4.5.4" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:8" HOME_URL="https://www.ovirt.org/" BUG_REPORT_URL="https://bugzilla.redhat.com/" PLATFORM_ID="platform:el8" [root@ovirt01 ~]# uname -a Linux ovirt01 4.18.0-408.el8.x86_64 #1 SMP Mon Jul 18 17:42:52 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux [root@ovirt01 ~]# df -h | grep -E " /tmp|Filesystem" Filesystem Size Used Avail Use% Mounted on /dev/mapper/onn_ovirt01-tmp 1014M 515M 499M 51% /tmp [root@ovirt01 ~]# stat /tmp/lvm.log File: /tmp/lvm.log Size: 463915707 Blocks: 906088 IO Block: 4096 regular file Device: fd0eh/64782d Inode: 137 Links: 1 Access: (0600/-rw-------) Uid: ( 0/ root) Gid: ( 0/ root) Context: system_u:object_r:lvm_tmp_t:s0 Access: 2023-02-03 10:30:06.605936740 +0900 Modify: 2023-02-03 09:52:19.712301285 +0900 Change: 2023-02-03 09:52:19.712301285 +0900 Birth: 2023-01-16 01:06:02.768495837 +0900

2 1

Upgrade failing
by notify.sina＠gmail.com 16 Apr '23

16 Apr '23

Hi all Attempting an upgrade in an attempt to fix/paper over expired certificate issues, but ran into this on my ovirt-engine [root@ovirt ~]# dnf upgrade --nobest -y Ceph packages for x86_64 5.1 MB/s | 478 kB 00:00 CentOS Stream 8 - AppStream 73 MB/s | 29 MB 00:00 CentOS Stream 8 - BaseOS 52 MB/s | 30 MB 00:00 CentOS Stream 8 - Extras 130 kB/s | 18 kB 00:00 CentOS Stream 8 - PowerTools 19 MB/s | 5.8 MB 00:00 Extra Packages for Enterprise Linux 8 - x86_64 21 MB/s | 14 MB 00:00 Extra Packages for Enterprise Linux Modular 8 - x86_64 1.0 MB/s | 733 kB 00:00 Extra Packages for Enterprise Linux 8 - Next - x86_64 549 kB/s | 407 kB 00:00 Latest oVirt 4.4 Release 575 kB/s | 2.7 MB 00:04 Extra Packages for Enterprise Linux 8 - x86_64 21 MB/s | 14 MB 00:00 CentOS-8 - Gluster 8 192 B/s | 38 B 00:00 Error: Failed to download metadata for repo 'ovirt-4.4-centos-gluster8': Cannot prepare internal mirrorlist: No URLs in mirrorlist And there are others when I try to disable specific repos. How do I fix this?

1 0

4.5.2 hosted-engine deployment failed
by j9678＠hotmail.com 15 Apr '23

15 Apr '23

The engine deployment failed with message "Host is not up, please check logs, perhaps also on the engine machine" after "Wait for the host to be up". I couldn't find any particular error in setup log, it just failed without pointing out any reason. I've tried on ovirt node (el9 and el8) and RHEL 8.7.

2 1

Ovirt FQDN is not routing correctly and problems with CentOS 9
by aleksiallula＠gmail.com 15 Apr '23

15 Apr '23

I tried to configure ovirt for FQDN with local server but can not get it to work. This is what I added to /etc/hosts: 10.0.0.50 server.ovirt.com 10.0.0.51 server.ovirt2.com My hostname is server.ovirt.com and my IP address is 10.0.0.50. 10.0.0.51 is the hosted engine IP. I have added server.ovirt.com to "DNS search domains" of network card. I ask at the same time: is the difference between hosted engine and hyperconverged that with hyperconverged I could add the host to existing hosted engine ? First I tried to install OVirt to CentOS 9, but there is no "virtualization" menu at the OVirt main menu. So, I can not add the hosted engine setup. Now I try to setup the OVirt for CentOS 8 with this manual: https://anthonyspiteri.net/ovirt-kvm-homelab-1 and https://anthonyspiteri.net/ovirt-kvm-homelab-2. Any ideas how can I setup the FQDN and OVirt to work with CentOS 8 or 9 ? Is there some working repository where I can download the hosted engine version OVirt for CentOS 9 ?

1 0

How can i power on virtual machine automatically
by pivu＠mail.ru 13 Apr '23

13 Apr '23

Tell me please. How can i power on virtual machine automatically when Host power on? I do not see any settings for it. oVirt 4.2

2 1

Re: unable to connect to the graphic server with VNC graphics protocol
by Devin A. Bougie 12 Apr '23

12 Apr '23

Hi Murilo, Yes, when trying with noVNC we get: Something went wrong, connection is closed This is getting pretty urgent for us, so any help connecting to the console of VMs running on EL9 hosts would be greatly appreciated. Thanks for following up, Devin > On Apr 8, 2023, at 4:17 AM, Murilo Morais <murilo(a)evocorp.com.br> wrote: > > Devin, good morning! All good? I hope so. > > Have you tried accessing VNC through noVNC? > > Em sex., 7 de abr. de 2023 às 16:22, Devin A. Bougie <devin.bougie(a)cornell.edu> escreveu: > Hello, > > After upgrading our cluster to oVirt 4.5 on EL9 hosts, we had to switch from QXL and SPICE to VGA and VNC as EL9 dropped support for SPICE. However, we are now unable to view the console using Windows, Linux, or MacOS. > > For example, after downloading and opening console.vv file with Remote Viewer (virt-viewer) on Linux, we see: > Unable to connect to the graphic server. > > Any help connecting to a VM using a VGA/VNC console from Windows, Mac, or Linux would be greatly appreciated. > > Many thanks, > Devin > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XWSCMSYHKEQVP…

2 2

I want to configure DHCP on my host. How do I do that?
by leezzzb12＠gmail.com 12 Apr '23

12 Apr '23

oVirt Version: 4.5 oVirt Engine : 1 unit oVirt Host : 3 units Virtual network configured ovirtmgmt, dhcp. dhcp gave vlan tagging as 50 and checked virtual machine network. Each host is configured to have two networks, ovirtmgmt and dhcp. I also set ipv4 to use DHCP, ipv6 also to use DHCP in the dhcp network. But no matter how long I wait on the host, I can't get the ipv4 and ipv6 IPs. 1. What did I do wrong? I've seen that using ovirt_provider_ovn you can configure DHCP. But I don't know how to configure it. 2. Is there a guide on how to configure it? 3. /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf is configured as follows: The [DHCP] section is missing, is this required? 4. If you use ovirtmgmt (default network, static IP) when creating a virtual machine, is it correct that you cannot receive an IP? Please help me.

1 0

virt-viewer - working alternative
by lars.stolpe＠bvg.de 11 Apr '23

11 Apr '23

Hi all, i tryed to use virt-viewer 11 (Windows) with oVirt 4.4 . I also tryed virt-viewer 10, 9, 8, and 7. The older versions can't handle ISO residing in data domains, the latest version is crashing if try the media button. Almost all links on the website are dead, no user guide, no prerequisites list... Since virt-viewer is not working properly and seems to be abandoned, i'm looking for a working alternative. Is there a working way to get a console of the virtual machines running in oVirt 4.4?

3 4

label settings
by ziyi Liu 11 Apr '23

11 Apr '23

I have many users and each user manages different devices, I made a label for the corresponding device and distributed the label to the corresponding user. The user needs to manually activate the label every time he logs in. How to activate the label by default?

1 0

4.4.9 -> 4.4.10 Cannot start or migrate any VM (hotpluggable cpus requested exceeds the maximum cpus supported by KVM)
by Jillian Morgan 10 Apr '23

10 Apr '23

After upgrading the engine from 4.4.9 to 4.4.10, and then upgrading one host, any attempt to migrate a VM to that host or start a VM on that host results in the following error: Number of hotpluggable cpus requested (16) exceeds the maximum cpus supported by KVM (8) While the version of qemu is the same across hosts, ( qemu-kvm-6.0.0-33.el8s.x86_64), I traced the difference to the upgraded kernel on the new host. I have always run elrepo's kernel-ml on these hosts to support bcache which RHEL's kernel doesn't support. The working hosts still run kernel-ml-5.15.12. The upgraded host ran kernel-ml-5.17.0. In case anyone else runs kernel-ml, have you run into this issue? Does anyone know why KVM's KVM_CAP_MAX_VCPUS value is lowered on the new kernel? Does anyone know how to query the KVM capabilities from userspace without writing a program leveraging kvm_ioctl()'s? Related to this, it seems that ovirt and/or libvirtd always runs qmu-kvm with an -smp argument of "maxcpus=16". This causes qemu's built-in check to fail on the new kernel which is supporting max_vpus of 8. Why does ovirt always request maxcpus=16? And yes, before you say it, I know you're going to say that running kernel-ml isn't supported. -- Jillian Morgan (she/her) 🏳️‍⚧️ Systems & Networking Specialist Primordial Software Group & I.T. Consultancy https://www.primordial.ca

2 1

unable to connect to the graphic server with VNC graphics protocol
by Devin A. Bougie 07 Apr '23

07 Apr '23

Hello, After upgrading our cluster to oVirt 4.5 on EL9 hosts, we had to switch from QXL and SPICE to VGA and VNC as EL9 dropped support for SPICE. However, we are now unable to view the console using Windows, Linux, or MacOS. For example, after downloading and opening console.vv file with Remote Viewer (virt-viewer) on Linux, we see: Unable to connect to the graphic server. Any help connecting to a VM using a VGA/VNC console from Windows, Mac, or Linux would be greatly appreciated. Many thanks, Devin

1 0

Ovirt CSI driver and volume snapshot
by Nathanaël Blanchet 07 Apr '23

07 Apr '23

Hello, Given that currently ovirt CSI driver doesn't support volume snapshot and consequently openshift virtualization doesn't support live snaphost, is there a chance that openshift virtualization supports volume snapshot with a ovirt CSI storage backend in the future?

1 0

Future of ovirt - end-of-life RHV
by Margit Meyer 06 Apr '23

06 Apr '23

What about the future of ovirt when RHV comes to end-of-life? Is there a chance for further usage? RedHat OpenShift will not be an option for us.... Margit

3 3

Renewing certificates - How it affects running vms?
by markeczzz＠gmail.com 06 Apr '23

06 Apr '23

Hi! Simple question - does procedure to renew certificates affects running virtual machines? I have a question regarding renewing certificates that are about to expire. I have a cluster with 5 hosts and a self-hosted engine. I have already updated the host certificates by logging in to each host, migrating virtual machines from that host to another, putting it into maintenance mode, and enrolling certificates via the web interface. Now, I have a question regarding renewing Engine certificates (self signed). I know the procedure is to log in to the host where the hosted engine is running (Host1 in my case), put it into global maintenance mode via the command "hosted-engine --set-maintenance --mode=global," and then log in to the Engine and run the command "engine-setup --offline" to renew it. My question is, will these two commands affect the running virtual machines on Host1 (where the hosted-engine is also hosted) and virtual machines on other hosts? Will they be shut down? Should I migrate virtual machines first from Host1 to some other host and then run the commands? I have a lot of virtual machines that i can't shut down or restart, any way to do it without that? Regards,

2 1

Failure to deploy oVirt node with security profile (PCIDSS)
by Guillaume Pavese 06 Apr '23

06 Apr '23

Hi oVirt community I tried with el8 & el9 oVirt Node 4.5.4 isos, But in both cases, the installation failed when selecting the PCI-DSS security profile. Please see screenshots attached According to 4.5.0 release note this is a supported feature : *BZ 2030226 [RFE] oVirt hypervisors should support running on hosts with the PCI-DSS security profile applied* *The oVirt Hypervisor is now capable of running on machine with PCI-DSS security profile.* https://bugzilla.redhat.com/show_bug.cgi?id=2030226 As the RFE says that deployment works, I guess this is a regression somewhere between 4.5.0 & 4.5.4 Is there a chance that this bug gets fixed? Is it up to the community? In the meantime, what can we do to deploy hosts with a PCI-DSS profile? Best regards, Guillaume Pavese Ingénieur Système et Réseau Interactiv-Group -- Ce message et toutes les pièces jointes (ci-après le “message”) sont établis à l’intention exclusive de ses destinataires et sont confidentiels. Si vous recevez ce message par erreur, merci de le détruire et d’en avertir immédiatement l’expéditeur. Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse. L’internet ne permettant pas d’assurer l’intégrité de ce message . Interactiv-group (et ses filiales) décline(nt) toute responsabilité au titre de ce message, dans l’hypothèse ou il aurait été modifié. IT, ES, UK. <https://interactiv-group.com/disclaimer.html>

2 1

Issue with hyper-converged node and rhel9
by Robert Pouliot 04 Apr '23

04 Apr '23

Hi, I have a 3 node cluster with gluster (2 rhel 8.7 and one rhel 9.1). I updated one of my nodes to rhel9 and I'm unable to start any VM that's running on gluster volumes on the rhel9 node or move a running VM on the rhel9 node. However, I'm able to start a node stored on a NFS node on the rhel9 node. According to gluster (10.3) all 3 nodes are working fine. I don't want to render my setup useless, that's why I didn't move the 2 other nodes. wells = rhel9 node. In the event log I'm getting the following error: Failed to sync storage devices from host wells VDSM wells command GetStorageDeviceListVDS failed: Internal JSON-RPC error Here is a part of the vdsm.log: 2023-04-03 23:25:01,242-0400 INFO (vm/69f6480f) [vds] prepared volume path: (clientIF:506) 2023-04-03 23:25:01,243-0400 INFO (vm/69f6480f) [vdsm.api] START prepareImage(sdUUID='a874a247-d8de-4951-86e8-99aaeda1a510', spUUID='595abf38-2c6d-11eb-9ba9-3ca82afed888', imgUUID='69de5e2b-dfb7-4e47-93d0-65ed4f978017', leafUUID='e66df35e-1254-48ef-bb83-ae8957fe8651', allowIllegal=False) from=internal, task_id=bf3e89e0-5d4e-47a1-8d86-3933c5004d25 (api:31) 2023-04-03 23:25:01,243-0400 INFO (vm/69f6480f) [vdsm.api] FINISH prepareImage error=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) from=internal, task_id=bf3e89e0-5d4e-47a1-8d86-3933c5004d25 (api:35) 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [storage.taskmanager.task] (Task='bf3e89e0-5d4e-47a1-8d86-3933c5004d25') aborting: Task is aborted: "value=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) abortedcode=309" (task:1165) 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [storage.dispatcher] FINISH prepareImage error=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) (dispatcher:64) 2023-04-03 23:25:01,244-0400 ERROR (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') The vm start process failed (vm:1001) Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 928, in _startUnderlyingVm self._run() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2769, in _run self._devices = self._make_devices() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2649, in _make_devices disk_objs = self._perform_host_local_adjustment() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2687, in _perform_host_local_adjustment self._preparePathsForDrives(disk_params) File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 1109, in _preparePathsForDrives drive['path'] = self.cif.prepareVolumePath( File "/usr/lib/python3.9/site-packages/vdsm/clientIF.py", line 418, in prepareVolumePath raise vm.VolumeError(drive) vdsm.virt.vm.VolumeError: Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'file', 'specParams': {}, 'alias': 'ua-69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'address': {'bus': '0', 'controller': '0', 'target': '0', 'type': 'drive', 'unit': '0'}, 'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'guestName': '/dev/sdb', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'poolID': '595abf38-2c6d-11eb-9ba9-3ca82afed888', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651', 'managed': False, 'volumeChain': [{'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'leaseOffset': 0, 'leasePath': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651.lease', 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651'}], 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'discard': False, 'format': 'raw', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'scsi', 'name': 'sda', 'bootOrder': '1', 'serial': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'index': 0, 'reqsize': '0', 'truesize': '5331688448', 'apparentsize': '42949672960'} 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Changed state to Down: Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'file', 'specParams': {}, 'alias': 'ua-69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'address': {'bus': '0', 'controller': '0', 'target': '0', 'type': 'drive', 'unit': '0'}, 'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'guestName': '/dev/sdb', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'poolID': '595abf38-2c6d-11eb-9ba9-3ca82afed888', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651', 'managed': False, 'volumeChain': [{'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'leaseOffset': 0, 'leasePath': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651.lease', 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651'}], 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'discard': False, 'format': 'raw', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'scsi', 'name': 'sda', 'bootOrder': '1', 'serial': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'index': 0, 'reqsize': '0', 'truesize': '5331688448', 'apparentsize': '42949672960'} (code=1) (vm:1743) 2023-04-03 23:25:01,245-0400 INFO (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Stopping connection (guestagent:421) 2023-04-03 23:25:01,252-0400 INFO (jsonrpc/7) [api.virt] START destroy(gracefulAttempts=1) from=::ffff:192.168.2.24,56838, vmId=69f6480f-5ee0-4210-84b9-58b4dbb4e423 (api:31) 2023-04-03 23:25:01,252-0400 INFO (jsonrpc/7) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Release VM resources (vm:5324)

1 0

ovirt 4.6 compatibility with el8
by Nathanaël Blanchet 01 Apr '23

01 Apr '23

Hello community! I noticed that rhel9 doesn't not support anymore ISP2532-based 8Gb Fibre Channel HBA. Given that all of my ovirt hosts are ISP2532-based, I d'like to know if ovirt 4.6 will be still compatible with el8 or will only support el9. -- Nathanaël Blanchet Administrateur Systèmes et Réseaux Service Informatique et REseau (SIRE) Département des systèmes d'information 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

oVirt hosted-engine deployment times out while "Wait for the host to be up"
by brwsergmslst＠gmail.com 01 Apr '23

01 Apr '23

Hi all, I am currently trying to deploy the hosted-engine without success. Unfortunately I cannot see what I am missing here. It'd be nice if you could put an eye on it and help me out. Below is an excerpt of the logfile generated. ``` 2023-03-22 20:34:10,417+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Get active list of active firewalld zones] 2023-03-22 20:34:12,222+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:13,527+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Configure libvirt firewalld zone] 2023-03-22 20:34:20,246+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:21,550+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Reload firewall-cmd] 2023-03-22 20:34:23,957+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:25,462+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Add host] 2023-03-22 20:34:27,469+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:28,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Include after_add_host tasks files] 2023-03-22 20:34:30,678+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 TASK [ovirt.ovirt.hosted_engine_setup : Let the user connect to the bootstrap engine VM to manually fix host configuration] 2023-03-22 20:34:31,882+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 skipping: [localhost] 2023-03-22 20:34:32,987+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:33,890+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 skipping: [localhost] 2023-03-22 20:34:34,893+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:36,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:37,100+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Always revoke the SSO token] 2023-03-22 20:34:38,705+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:40,111+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:41,015+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:42,020+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] 2023-03-22 20:34:44,028+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:45,032+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Wait for the host to be up] 2023-03-22 20:56:33,746+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'changed': False, 'ovirt_hosts': [{'href': '/ovirt-engine/api/hosts/17ad8088-c9e9-433f-90b9-ce8023a625e6', 'comment': '', ' id': '17ad8088-c9e9-433f-90b9-ce8023a625e6', 'name': 'vhost-tmp01.example.com', 'address': 'vhost-tmp01.example.com', 'affinity_labels': [], 'auto_numa_status': 'unknown', 'certificate': {'organization': 'example.com', 'subject': 'O=example.com,CN=vhost-tmp01.example.com'}, 'cluster': {'href': '/ovirt-engine/api/clusters/4effacb7-e5dd-4e52-86c9-90ebd2aafa0d', 'id': '4effacb7-e5dd-4e52-86c9-90ebd2aafa0d'}, 'cpu ': {'speed': 0.0, 'topology': {}}, 'cpu_units': [], 'device_passthrough': {'enabled': False}, 'devices': [], 'external_network_provider_configurations': [], 'external_status': 'ok', 'hardware_information': {'supported_rng_sources': []}, 'h ooks': [], 'katello_errata': [], 'kdump_status': 'unknown', 'ksm': {'enabled': False}, 'max_scheduling_memory': 0, 'memory': 0, 'network_attachments': [], 'nics': [], 'numa_nodes': [], 'numa_supported': False, 'os': {'custom_kernel_cmdline ': ''}, 'ovn_configured': False, 'permissions': [], 'port': 54321, 'power_management': {'automatic_pm_enabled': True, 'enabled': False, 'kdump_detection': True, 'pm_proxies': []}, 'protocol': 'stomp', 'reinstallation_required': False, 'se_linux': {}, 'spm': {'priority': 5, 'status': 'none'}, 'ssh': {'fingerprint': 'SHA256:IDhzMTO49OoNIHmLGnOIGwTn8LQB/lYrJdUnak144Q4', 'port': 22, 'public_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWbUlwbIiSliqc6OCFwG4w6/OaJb63JijJ1okaj6Y3gqNPO2XZWDTfwraIqm0S0SGlVk/g0oYcYIQ/0hU5Q+bE='}, 'statistics': [], 'status': 'install_failed', 'storage_connection_extensions': [], 'summary': {'total': 0}, 'tags': [], 'transparent_huge_pages': {'enabled': False}, 'type': 'rhel', 'unmanaged_networks': [], 'update_available': False, 'vgpu_placement': 'consolidated'}], 'invocation': {'module_args': {'pattern': 'name=vhost-tmp01.example.com', 'fetch_nested': False, 'nested_attributes': [], 'follow': [], 'all_content': False, 'cluster _version': None}}, '_ansible_no_log': None, 'attempts': 120} 2023-03-22 20:56:33,847+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"attempts": 120, "changed": false, "ovirt_hosts": [{"address": "vhost-tmp01.example.com", "affinity_labels": [], "auto_numa_status": "unknown", "certificate": {"organization": "example.com", "subject": "O=example.com,CN=vhost-tmp01.example.com"}, "cluster": {"href": "/ovirt-engine/api/clusters/4effacb7-e5dd-4e52-86c9-90ebd2aafa0d", "id": "4effacb7-e5dd-4e52-86c9-90ebd2aafa0d"}, "comment": "", "cpu": {"speed": 0.0, "topology": {}}, "cpu_units": [], "device_passthrough": {"enabled": false}, "devices": [], "external_network_provider_configurations": [], "external_status": "ok", "hardware_information": {"supported_rng_sources": []}, "hooks": [], "href": "/ovirt-engine/api/hosts/17ad8088-c9e9-433f-90b9-ce8023a625e6", "id": "17ad8088-c9e9-433f-90b9-ce8023a625e6", "katello_errata": [], "kdump_status": "unknown", "ksm": {"enabled": false}, "max_ scheduling_memory": 0, "memory": 0, "name": "vhost-tmp01.example.com", "network_attachments": [], "nics": [], "numa_nodes": [], "numa_supported": false, "os": {"custom_kernel_cmdline": ""}, "ovn_configured": false, "permissions": [], "port": 54321, "power_management": {"automatic_pm_enabled": true, "enabled": false, "kdump_detection": true, "pm_proxies": []}, "protocol": "stomp", "reinstallation_required": false, "se_linux": {}, "spm": {"priority": 5, "status": "none"}, "ssh": {"fingerprint": "SHA256:IDhzMTO49OoNIHmLGnOIGwTn8LQB/lYrJdUnak144Q4", "port": 22, "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWbUlwbIiSliqc6OCFwG4w6/OaJb63JijJ1okaj6Y3gqNPO2XZWDTfwraIqm0S0SGlVk/g0oYcYIQ/0hU5Q+bE="}, "statistics": [], "status": "install_failed", "storage_connection_extensions": [], "summary": {"total": 0}, "tags": [], "transparent_huge_pages": {"enabled": false}, "type": "rhel", "unmanaged_networks": [], "update_available": false, "vgpu_placement": " consolidated"}]} 2023-03-22 20:56:34,750+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Notify the user about a failure] 2023-03-22 20:56:35,655+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': 'Host is not up, please check logs, perhaps also on the engine machine', '_ansible_no_log': None, 'changed': False} 2023-03-22 20:56:35,755+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:113 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} ``` Thank you in advance. Best regards

1 1