April 2023 - Users - oVirt List Archives

Installing oVirt on RHEL vs CentOS Stream, Alma or Rocky Linux
by Richard W.M. Jones 06 Oct '25

06 Oct '25

I'm still struggling to get oVirt installed. It absolutely will not install on RHEL 8, the documentation here is flat out wrong: https://www.ovirt.org/documentation/installing_ovirt_as_a_standalone_manage… javapackages-tools is not a module that exists in RHEL 8. Apparently it's a CentOS PowerTools module. Since original CentOS no longer really exists either, does anyone have any opinions or experience with installing oVirt on any of: - CentOS Stream 8 - Alma Linux 8.5 - Rocky Linux Alma in particular looks like a straight replacement for old CentOS. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-top is 'top' for virtual machines. Tiny program with many powerful monitoring features, net stats, disk stats, logging, etc. http://people.redhat.com/~rjones/virt-top

8 10

Error when deploy Ovirt4.4 Hosted Engine
by staybox＠gmail.com 17 Feb '25

17 Feb '25

Hello, I get error, need help. [ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The conditional check 'not ipv6_deployment|bool and route_rules_ipv4.stdout | from_json | selectattr('priority', 'equalto', 100) | selectattr('dst', 'equalto', virbr_cidr_ipv4 | ipaddr('address') ) | list | length == 0' failed. The error was: error while evaluating conditional (not ipv6_deployment|bool and route_rules_ipv4.stdout | from_json | selectattr('priority', 'equalto', 100) | selectattr('dst', 'equalto', virbr_cidr_ipv4 | ipaddr('address') ) | list | length == 0): 'dict object' has no attribute 'dst'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/bootstrap_local_vm/01_prepare_routing_rules.yml': line 81, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n changed_when: true\n - name: Add IPv4 inbound route rules\n ^ here\n"}

4 4

How to list all snapshots?
by jorgevisentini＠gmail.com 14 Feb '25

14 Feb '25

Hello everyone! First, I would like to thank everyone involved in this wonderful project. I leave here my sincere thanks! Does anyone know if it is possible to list all snapshots automatically? It can be by ansible, python, shell... any way that helps to list them all without having to enter Domain by Domain. Thank you all!

4 3

snapshot solution: Existing snapshots that were taken after this one will be erased.
by dhanaraj.ramesh＠yahoo.com 29 Jan '25

29 Jan '25

Hi Team, when I want to commit the older snapshots I'm getting warning stating " Existing snapshots that were taken after this one will be erased.". is there any way we can retain the latest snapshots as is in the chain? I knew cloning and template export options are there to secure that latest snapshot data but these are will consume additional space in storage and take time.

4 3

Restart oVirt-Engine
by Jeremey Wise 09 Jan '25

09 Jan '25

How ,without reboot of hosting system, do I restart the oVirt engine? # I tried below but do not seem to effect the virtual machine [root@thor iso]# systemctl restart ov ovirt-ha-agent.service ovirt-imageio.service ovn-controller.service ovs-delete-transient-ports.service ovirt-ha-broker.service ovirt-vmconsole-host-sshd.service ovsdb-server.service ovs-vswitchd.service [root@thor iso]# # You cannot restart the VM " HostedEngine " as it responses: Error while executing action: HostedEngine: - Cannot restart VM. This VM is not managed by the engine. Reason is I had to do some work on a node. Reboot it.. it is back up.. network is all fine.. Cockpit working fine... and gluster fine.. But oVirt-Engine refuses to accept the node is up. -- p <jeremey.wise(a)gmail.com>enguinpages

4 4

Unable to access ovirt Admin Screen from ovirt Host
by louisb＠ameritech.net 07 Dec '24

07 Dec '24

I've reinstalled ovirt 4.4 on my server remotely via cockpit terminal. I'm able to access the ovirt admin screen remotely from the laptop that I used for the install. However, using the same URL I'm unable to gain access to the admin screen. Following the instruction in the documentation I've modified the file: /etc/ovirt-engine/engine.conf.d/99-custom-sso-setup.conf, to reflect the DNS name and I enter in the IP address. But I'm still unable to access the screen from the server console. What else needs to change in order to gain access from the server console? Thanks

5 8

SPM and Task error ...
by Enrico 22 Nov '24

22 Nov '24

Hi all, my ovirt cluster has got 3 Hypervisors runnig Centos 7.5.1804 vdsm is 4.20.39.1-1.el7, ovirt engine is 4.2.4.5-1.el7, the storage systems are HP MSA P2000 and 2050 (fibre channel). I need to stop one of the hypervisors for maintenance but this system is the storage pool manager. For this reason I decided to manually activate SPM in one of the other nodes but this operation is not successful. In the ovirt engine (engine.log) the error is this: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. while in the hypervisor (SPM) vdsm.log: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 *ERROR* [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::logEndTaskFailure: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended with failure: 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,751+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 34ae2b2f 2019-07-25 12:39:18,752+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 34ae2b2f 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::onTaskEndSuccess: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended successfully. 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 42de0c2b 2019-07-25 12:39:18,759+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 42de0c2b 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Fri May 03 14:48:50 CEST 2019' 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,765+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: da77af2 2019-07-25 12:39:18,766+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: da77af2 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned there is some relation between this error and a task that has remained hanging, from SPM server: # vdsm-client Task getInfo taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "verb": "prepareMerge", "id": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e" } # vdsm-client Task getStatus taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "message": "running job 1 of 1", "code": 0, "taskID": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e", "taskResult": "", "taskState": "running" } How can I solve this problem ? Thanks a lot for your help !! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it _______________________________________________________________________

5 15

oVirt networks
by Enrico Becchetti 28 Aug '24

28 Aug '24

Dear all, Ineed your help to understand how to configure the network of a new oVirt cluster. Mynew system will have a 4.3 engine thatruns in a virtual machine, andsome Dell R7525 AMD EPYC hypervisors, eachholding two 4-port PCI network cards. These servers will have node-ovirt image again in version 4.3. As for the network, there are two HPE Aruba 2540G, non-stackable, with 24 1Gbs ports and 2 10Gbs uplinks to the star center. This is a simplified scheme: My goal is to make the most of the server's 8 ethernet interfaces to have both reliability and maximum possible throughput. This cluster will have two virtual networks, one forovirt management and one for the traffic of individual virtual machines. With that said here's what my idea is. I would like to have two links aggregated by 4Gbs, one for ovrtmgt and the other for vmnet. With the ovirt web interface I can createan active-passive "Mode 1" bond, but this won'tallow me to go beyond 1Gbs. Alternatively I could create a "Mode 4" bond 802.3ad but unfortunately the switches are not stacked and therefore not even this solution applies. This is an example with active passive configuration: Can you tell me if ovirt can generate//nested bonds? Or do you have other solutions ? Thanks a lot ! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it Pagina web personale: https://www.pg.infn.it/home/enrico-becchetti/ ______________________________________________________________________

5 6

boot from cdrom & error code 0005
by edp＠maddalena.it 21 Aug '24

21 Aug '24

Hi. I have created a new storage domain (data domain, storage type nfs) to use it to upload iso images. I have so uploaded a new iso and then attach the iso to a new vm. But when I try to boot the vm I obtain this error: booting from dvd/cd... boot failed: could not read from cdrom (code 0005) no bootable device The iso file has been uploaded with success in the data storage domain and so the vm lets my attach the iso to the vm in the boot settings. Can you help me? Thank you

4 6

VM Migration Failed
by KSNull Zero 10 Jul '24

10 Jul '24

Running oVirt 4.4.5 VM cannot migrate between hosts. vdsm.log contains the following error: libvirt.libvirtError: operation failed: Failed to connect to remote libvirt URI qemu+tls://ovhost01.local/system: authentication failed: Failed to verify peer's certificate Certificates on hosts was renewed some time ago. How this issue can be fixed ? Thank you.

4 6

How to re-enroll (or renew) host certificates for a single-host hosted-engine deployment?
by Derek Atkins 28 Jun '24

28 Jun '24

Hi, I've got a single-host hosted-engine deployment that I originally installed with 4.0 and have upgraded over the years to 4.3.10. I and some of my users have upgraded remote-viewer and now I get an error when I try to view the console of my VMs: (remote-viewer:8252): Spice-WARNING **: 11:30:41.806: ../subprojects/spice-common/common/ssl_verify.c:477:openssl_verify: Error in server certificate verification: CA signature digest algorithm too weak (num=68:depth0:/O=<My Org Name>/CN=<Host's Name>) I am 99.99% sure this is because the old certs use SHA1. I reran engine-setup on the engine and it asked me if I wanted to renew the PKI, and I answered yes. This replaced many[1] of the certificates in /etc/pki/ovirt-engine/certs on the engine, but it did not update the Host's certificate. All the documentation I've seen says that to refresh this certificate I need to put the host into maintenance mode and then re-enroll.. However I cannot do that, because this is a single-host system so I cannot put the host in local mode -- there is no place to migrate the VMs (let alone the Engine VM). So.... Is there a command-line way to re-enroll manually and update the host certs? Or some other way to get all the leftover certs renewed? Thanks, -derek [1] Not only did it not update the Host's cert, it did not update any of the vmconsole-proxy certs, nor the certs in /etc/pki/ovirt-vmconsole/, and obviously nothing in /etc/pki/ on the host itself. -- Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant

8 16

4.5.4 with Ceph only storage
by Maurice Burrows 25 Jun '24

25 Jun '24

Hey ... A long story short ... I have an existing Red Hat Virt / Gluster hyperconverged solution that I am moving away from. I have an existing Ceph cluster that I primarily use for OpenStack and a small requirement for S3 via RGW. I'm planning to build a new oVirt 4.5.4 cluster on RHEL9 using Ceph for all storage requirements. I've read many online articles on oVirt and Ceph, and they all seem to use the Ceph iSCSI gateway, which is now in maintenance, so I'm not real keen to commit to iSCSI. So my question is, IS there any reason I cannot use CephFS for both hosted-engine and as a data storage domain? I'm currently running Ceph Pacific FWIW. Cheers

5 10

Changing disk QoS causes segfault with IO-Threads enabled (oVirt 4.3.0.4-1.el7)
by jloh＠squiz.net 23 Apr '24

23 Apr '24

We recently upgraded to 4.3.0 and have found that when changing disk QoS settings on VMs whilst IO-Threads is enabled causes them to segfault and the VM to reboot. We've been able to replicate this across several VMs. VMs with IO-Threads disabled/turned off do not segfault when changing the QoS. Mar 1 11:49:06 srvXX kernel: IO iothread1[30468]: segfault at fffffffffffffff8 ip 0000557649f2bd24 sp 00007f80de832f60 error 5 in qemu-kvm[5576498dd000+a03000] Mar 1 11:49:06 srvXX abrt-hook-ccpp: invalid number 'iothread1' Mar 1 11:49:11 srvXX libvirtd: 2019-03-01 00:49:11.116+0000: 13365: error : qemuMonitorIORead:609 : Unable to read from monitor: Connection reset by peer Happy to supply some more logs to someone if they'll help but just wondering whether anyone else has experienced this or knows of a current fix other than turning io-threads off. Cheers.

4 3

Deploy oVirt Engine fail behind proxy
by Matteo Bonardi 21 Mar '24

21 Mar '24

Hi, I am trying to deploy the ovirt engine following self-hosted engine installation procedure on documentation. Deployment servers are behind a proxy and I have set it in environment and in yum.conf before run deploy. Deploy fails because ovirt engine vm cannot resolve AppStream repository url: [ INFO ] TASK [ovirt.engine-setup : Install oVirt Engine package] [ ERROR ] fatal: [localhost -> ovirt-manager.mydomain]: FAILED! => {"changed": false, "msg": "Failed to download metadata for repo 'AppStream': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=AppStream&infra=st… [Could not resolve host: mirrorlist.centos.org]", "rc": 1, "results": []} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Clean local storage pools] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20201109165237.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20201109164244-b3e8sd.log How I can set proxy for the engine vm? Ovirt version: [root@myhost ~]# rpm -qa | grep ovirt-engine-appliance ovirt-engine-appliance-4.4-20200916125954.1.el8.x86_64 [root@myhost ~]# rpm -qa | grep ovirt-hosted-engine-setup ovirt-hosted-engine-setup-2.4.6-1.el8.noarch OS version: [root@myhost ~]# cat /etc/centos-release CentOS Linux release 8.2.2004 (Core) [root@myhost ~]# uname -a Linux myhost.mydomain 4.18.0-193.28.1.el8_2.x86_64 #1 SMP Thu Oct 22 00:20:22 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux Thanks for the help. Regards, Matteo

7 20

The oVirt Counter
by Sandro Bonazzola 21 Feb '24

21 Feb '24

Hi, for those who remember the Linux Counter project, if you'd like other to know you're using oVirt and know some details about your deployment, here's a way to count you in: https://ovirt.org/community/ovirt-counter.html Enjoy! -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D PERFORMANCE & SCALE Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 1

Cannot restart ovirt after massive failure.
by Gilboa Davara 18 Jan '24

18 Jan '24

Hello all, During the night, one of my (smaller) setups, a single node self hosted engine (localhost NFS) crashed due to what-looks-like a massive disk failure (Software RAID6, with 10 drives + spare). After a reboot, I let the RAID resync with a fresh drive) and went on to start oVirt. However, no such luck. Two issues: 1. ovirt-ha-broker fails due to broken hosted engine state (log attached). 2. ovirt-ha-agent fails due to network test (tcp) even though both remote-host and DNS servers are active. (log attached). Two questions: 1. Can I somehow force the agent to disable the network liveliness test? 2. Can I somehow force the broker to rebuild / fix the hosted engine state? - Gilboa

4 17

Please, Please Help - New oVirt Install/Deployment Failing - "Host is not up..."
by Matthew J Black 18 Jan '24

18 Jan '24

Hi Everyone, Could someone please help me - I've been trying to do an install of oVirt for *weeks* (including false starts and self-inflicted wounds/errors) and it is still not working. My setup: - oVirt v4.5.3 - A brand new fresh vanilla install of RockyLinux 8.6 - all working AOK - 2*NICs in a bond (802.3ad) with a couple of sub-Interfaces/VLANs - all working AOK - All relevant IPv4 Address in DNS with Reverse Lookups - all working AOK - All relevant IPv4 Address in "/etc/hosts" file - all working AOK - IPv6 (using "method=auto" in the interface config file) enabled on the relevant sub-Interface/VLAN - I'm not using IPv6 on the network, only IPv4, but I'm trying to cover all the bases. - All relevant Ports (as per the oVirt documentation) set up on the firewall - ie firewall-cmd --add-service={{ libvirt-tls | ovirt-imageio | ovirt-vmconsole | vdsm }} - All the relevant Repositories installed (ie RockyLinux BaseOS, AppStream, & PowerTools, and the EPEL, plus the ones from the oVirt documentation) I have followed the oVirt documentation (including the special RHEL-instructions and RockyLinux-instructions) to the letter - no deviations, no special settings, exactly as they are written. All the dnf installs, etc, went off without a hitch, including the "dnf install centos-release-ovirt45", "dnf install ovirt-engine-appliance", and "dnf install ovirt-hosted-engine-setup" - no errors anywhere. Here is the results of a "dnf repolist": - appstream Rocky Linux 8 - AppStream - baseos Rocky Linux 8 - BaseOS - centos-ceph-pacific CentOS-8-stream - Ceph Pacific - centos-gluster10 CentOS-8-stream - Gluster 10 - centos-nfv-openvswitch CentOS-8 - NFV OpenvSwitch - centos-opstools CentOS-OpsTools - collectd - centos-ovirt45 CentOS Stream 8 - oVirt 4.5 - cs8-extras CentOS Stream 8 - Extras - cs8-extras-common CentOS Stream 8 - Extras common packages - epel Extra Packages for Enterprise Linux 8 - x86_64 - epel-modular Extra Packages for Enterprise Linux Modular 8 - x86_64 - ovirt-45-centos-stream-openstack-yoga CentOS Stream 8 - oVirt 4.5 - OpenStack Yoga Repository - ovirt-45-upstream oVirt upstream for CentOS Stream 8 - oVirt 4.5 - powertools Rocky Linux 8 - PowerTools So I kicked-off the oVirt deployment with: "hosted-engine --deploy --4 --ansible-extra-vars=he_offline_deployment=true". I used "--ansible-extra-vars=he_offline_deployment=true" because without that flag I was getting "DNF timout" issues (see my previous post `Local (Deployment) VM Can't Reach "centos-ceph-pacific" Repo`). I answer the defaults to all of questions the script asked, or entered the deployment-relevant answers where appropriate. In doing this I double-checked every answer before hitting <Enter>. Everything progressed smoothly until the deployment reached the "Wait for the host to be up" task... which then hung for more than 30 minutes before failing. From the ovirt-hosted-engine-setup... log file: - 2022-10-20 17:54:26,285+1100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:113 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} I checked the following log files and found all of the relevant ERROR lines, then checked several 10s of proceeding and succeeding lines trying to determine what was going wrong, but I could not determine anything. - ovirt-hosted-engine-setup... - ovirt-hosted-engine-setup-ansible-bootstrap_local_vm... - ovirt-hosted-engine-setup-ansible-final_clean... - not really relevant, I believe I can include the log files (or the relevant parts of the log files) if people want - but that are very large: several 100 kilobytes each. I also googled "oVirt Host is not up" and found several entries, but after reading them all the most relevant seems to be a thread from these mailing list: `Install of RHV 4.4 failing - "Host is not up, please check logs, perhaps also on the engine machine"` - but this seems to be talking about an upgrade and I didn't gleam anything useful from it - I could, of course, be wrong about that. So my questions are: - Where else should I be looking (ie other log files, etc, and possible where to find them)? - Does anyone have any idea why this isn't working? - Does anyone have a work-around (including a completely manual process to get things working - I don't mind working in the CLI with virsh, etc)? - What am I doing wrong? Please, I'm really stumped with this, and I really do need help. Cheers Dulux-Oz

8 22

how to renew expired ovirt node vdsm cert manually ?
by dhanaraj.ramesh＠yahoo.com 11 Jan '24

11 Jan '24

below are the steps to renew the expired vdsm cert of ovirt node # To check CERT expired # openssl x509 -in /etc/pki/vdsm/certs/vdsmcert.pem -noout -dates 1. Backup vdsm folder # cd /etc/pki # mv vdsm vdsm.orig # mkdir vdsm ; chown vdsm:kvm vdsm # cd vdsm # mkdir libvirt-vnc certs keys libvirt-spice libvirt-migrate # chown vdsm:kvm libvirt-vnc certs keys libvirt-spice libvirt-migrate 2. Regenerate cert & keys # vdsm-tool configure --module certificates 3. Copy the cert to destination location chmod 440 /etc/pki/vdsm/keys/vdsmkey.pem chown root /etc/pki/vdsmcerts/*pem chmod 644 /etc/pki/vdsmcerts/*pem cp /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-spice/ca-cert.pem cp /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-spice/server-key.pem cp /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-spice/server-cert.pem cp /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-vnc/ca-cert.pem cp /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-vnc/server-key.pem cp /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-vnc/server-cert.pem cp -p /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/libvirt-migrate/ca-cert.pem cp -p /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/vdsm/libvirt-migrate/server-key.pem cp -p /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-migrate/server-cert.pem chown root:qemu /etc/pki/vdsm/libvirt-migrate/server-key.pem cp -p /etc/pki/vdsm.orig/keys/libvirt_password /etc/pki/vdsm/keys/ mv /etc/pki/libvirt/clientcert.pem /etc/pki/libvirt/clientcert.pem.orig mv /etc/pki/libvirt/private/clientkey.pem /etc/pki/libvirt/private/clientkey.pem.orig mv /etc/pki/CA/cacert.pem /etc/pki/CA/cacert.pem.orig cp -p /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/libvirt/clientcert.pem cp -p /etc/pki/vdsm/keys/vdsmkey.pem /etc/pki/libvirt/private/clientkey.pem cp -p /etc/pki/vdsm/certs/cacert.pem /etc/pki/CA/cacert.pem 3. cross check the backup folder /etc/pki/vdsm.orig vs /etc/pki/vdsm # refer to /etc/pki/vdsm.orig/*/ and set the correct owner & group permission in /etc/pki/vdsm/*/ 4. restart services # Make sure both services are up systemctl restart vdsmd libvirtd

5 4

Unable to install oVirt on RHEL7.5
by SS00514758＠techmahindra.com 05 Jan '24

05 Jan '24

Hi All, I am unable to install oVirt on RHEL7.5, to install it I am taking reference of below link, https://www.ovirt.org/documentation/install-guide/chap-Installing_oVirt.html But though it is not working for me, couple of dependencies is not getting installed, and because of this I am not able to run the ovirt-engine, below are the depencies packages that unable to install, Error: Package: collectd-write_http-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) Requires: collectd(x86-64) = 5.8.0-6.1.el7 Removing: collectd-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-6.1.el7 Updated By: collectd-5.8.1-1.el7.x86_64 (epel) collectd(x86-64) = 5.8.1-1.el7 Available: collectd-5.7.2-1.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-1.el7 Available: collectd-5.7.2-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-3.el7 Available: collectd-5.8.0-2.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-2.el7 Available: collectd-5.8.0-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-3.el7 Available: collectd-5.8.0-5.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-5.el7 Help me to install this. Looking forward to resolve this issue. Regards Sumit Sahay

6 8

Grafana - Origin Not Allowed
by Maton, Brett 14 Dec '23

14 Dec '23

oVirt 4.5.0.8-1.el8 I tried to connect to grafana via the monitoring portal link from the dash and all panels are failing to display any data with varying error messages, but all include 'Origin Not Allowed' I navigated to Data Sources and ran a test on the PostgreSQL connection (localhost) which threw the same Origin Not Allowed error message. Any suggestions?

6 8

Multiple hosts stuck in Connecting state waiting for storage pool to go up.
by ivan.lezhnjov.iv＠gmail.com 06 Nov '23

06 Nov '23

Hi! We have a problem with multiple hosts stuck in Connecting state, which I hoped somebody here could help us wrap our heads around. All hosts, except one, seem to have very similar symptoms but I'll focus on one host that represents the rest. So, the host is stuck in Connecting state and this what we see in oVirt log files. /var/log/ovirt-engine/engine.log: 2023-04-20 09:51:53,021+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-37) [] Command 'GetCapabilitiesAsyncVDSCommand(HostName = ABC010-176-XYZ, VdsIdAndVdsVDSCommandParametersBase:{hostId='2c458562-3d4d-4408-afc9-9a9484984a91', vds='Host[ABC010-176-XYZ,2c458562-3d4d-4408-afc9-9a9484984a91]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: SSL session is invalid 2023-04-20 09:55:16,556+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-67) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM ABC010-176-XYZ command Get Host Capabilities failed: Message timeout which can be caused by communication issues /var/log/vdsm/vdsm.log: 2023-04-20 17:48:51,977+0300 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList() from=internal, task_id=ebce7c8c-6ded-454e-9aee-86edf72764ef (api:31) 2023-04-20 17:48:51,977+0300 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=ebce7c8c-6ded-454e-9aee-86edf72764ef (api:37) 2023-04-20 17:48:51,978+0300 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:723) Both engine.log and vdsm.log are flooded with these messages. They are repeated at regular intervals ad infinitum. This is one common symptom shared by multiple hosts in our deployment. They all have these message loops in engine.log and vdsm.log files. On all Running vdsm-client Host getConnectedStoragePools also returns an empty list represented by [] on all hosts (but interestingly there is one that showed Storage Pool UUID and yet it was still stuck in Connecting state). This particular host (ABC010-176-XYZ) is connected to 3 CEPH iSCSI Storage Domains and lsblk shows 3 block devices with matching UUIDs in their device components. So, the storage seems to be connected but the Storage Pool is not? How is that even possible? Now, what's even more weird is that we tried rebooting the host (via Administrator Portal) and it didn't help. We even tried removing and re-adding the host in Administrator Portal but to no avail. Additionally, the host refused to go into Maintenance mode so we had to enforce it by manually updating Engine DB. We also tried reinstalling the host via Administrator Portal and ran into another weird problem, which I'm not sure if it's a related one or a problem that deserves a dedicated discussion thread but, basically, the underlying Ansible playbook exited with the following error message: "stdout" : "fatal: [10.10.10.176]: UNREACHABLE! => {\"changed\": false, \"msg\": \"Data could not be sent to remote host \\\"10.10.10.176\\\". Make sure this host can be reached over ssh: \", \"unreachable\": true}", Counterintuitively, just before running Reinstall via Administrator Portal we had been able to reboot the same host (which as you know oVirt does via Ansible as well). So, no changes on the host in between just different Ansible playbooks. To confirm that we actually had access to the host over ssh we successfully ran ssh -p $PORT root(a)10.10.10.176 -i /etc/pki/ovirt-engine/keys/engine_id_rsa and it worked. That made us scratch our heads for a while but what seems to had fixed Ansible's ssh access problems was manual full stop of all VDSM-related systemd services on the host. It was just a wild guess but as soon as we stopped all VDSM services Ansible stopped complaining about not being able to reach the target host and successfully did its job. I'm sure you'd like to see more logs but I'm not certain what exactly is relevant. There are a ton of logs as this deployment is comprised of nearly 80 hosts. So, I guess it's best if you just request to see specific logs, messages or configuration details and I'll cherry-pick what's relevant. We don't really understand what's going on and would appreciate any help. We tried just about anything we could think of to resolve this issue and are running out of ideas what to do next. If you have any questions just ask and I'll do my best to answer them.

2 4

Re: Failed to synchronize networks of Provider ovirt-provider-ovn
by Mail SET Inc. Group 27 Oct '23

27 Oct '23

Yes, i use same manual to change WebUI SSL. ovirt-ca-file= is a same SSL file which use WebUI. Yes, i restart ovirt-provider-ovn, i restart engine, i restart all what i can restart. Nothing... > 12 сент. 2018 г., в 16:11, Dominik Holler <dholler(a)redhat.com> написал(а): > > On Wed, 12 Sep 2018 14:23:54 +0300 > "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: > >> Ok! > > Not exactly, please use users(a)ovirt.org for such questions. > Other should benefit from this questions, too. > Please write the next mail to users(a)ovirt.org and keep me in CC. > >> What i did: >> >> 1) install oVirt «from box» (4.2.5.2-1.el7); >> 2) generate own ssl for my engine using my FreeIPA CA, Install it and > > What means "Install it"? You can use the doc from the following link > https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… > > Ensure that ovirt-ca-file= in > /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf > points to the correct file and ovirt-provider-ovn is restarted. > >> get tis issue; >> >> >> [root@engine ~]# tail -n 50 /var/log/ovirt-provider-ovn.log >> 2018-09-12 14:10:23,828 root [SSL: CERTIFICATE_VERIFY_FAILED] >> certificate verify failed (_ssl.c:579) Traceback (most recent call >> last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", >> line 133, in _handle_request method, path_parts, content >> File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", >> line 175, in handle_request return >> self.call_response_handler(handler, content, parameters) File >> "/usr/share/ovirt-provider-ovn/handlers/keystone.py", line 33, in >> call_response_handler return response_handler(content, parameters) >> File "/usr/share/ovirt-provider-ovn/handlers/keystone_responses.py", >> line 62, in post_tokens user_password=user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 26, in >> create_token return auth.core.plugin.create_token(user_at_domain, >> user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/plugin.py", line >> 48, in create_token timeout=self._timeout()) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 75, >> in create_token username, password, engine_url, ca_file, timeout) >> File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line >> 91, in _get_sso_token timeout=timeout File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, >> in wrapper response = func(*args, **kwargs) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, >> in wrapper raise BadGateway(e) BadGateway: [SSL: >> CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) >> >> >> [root@engine ~]# tail -n 20 /var/log/ovirt-engine/engine.log >> 2018-09-12 14:10:23,773+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:10:23,778+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:10:23,836+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:10:23,837+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:14:12,477+03 INFO >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default >> task-6) [] User admin@internal successfully logged in with scopes: >> ovirt-app-admin ovirt-app-api ovirt-app-portal >> ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all >> ovirt-ext=token-info:authz-search >> ovirt-ext=token-info:public-authz-search >> ovirt-ext=token-info:validate ovirt-ext=token:password-access >> 2018-09-12 14:14:12,587+03 INFO >> [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default >> task-6) [1bf1b763] Running command: CreateUserSessionCommand >> internal: false. 2018-09-12 14:14:12,628+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [1bf1b763] EVENT_ID: USER_VDC_LOGIN(30), User >> admin@internal-authz connecting from '10.0.3.61' using session >> 's8jAm7BUJGlicthm6yZBA3CUM8QpRdtwFaK3M/IppfhB3fHFB9gmNf0cAlbl1xIhcJ2WX+ww7e71Ri+MxJSsIg==' >> logged in. 2018-09-12 14:14:30,972+03 INFO >> [org.ovirt.engine.core.bll.provider.ImportProviderCertificateCommand] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] Running >> command: ImportProviderCertificateCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:30,982+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] EVENT_ID: >> PROVIDER_CERTIFICATE_IMPORTED(213), Certificate for provider >> ovirt-provider-ovn was imported. (User: admin@internal-authz) >> 2018-09-12 14:14:31,006+03 INFO >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Running >> command: TestProviderConnectivityCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:31,058+03 ERROR >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Command >> 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'default' is using 0 threads out of 1, 5 threads waiting for >> tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engine' is using 0 threads out of 500, 16 threads waiting for >> tasks and 0 tasks in queue. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineScheduled' is using 0 threads out of 100, 100 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads >> waiting for tasks. 2018-09-12 14:15:23,843+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:15:23,849+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:15:23,900+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:23,901+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' >> >> >> [root@engine ~]# >> cat /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf # >> This file is automatically generated by engine-setup. Please do not >> edit manually [OVN REMOTE] ovn-remote=ssl:127.0.0.1:6641 >> [SSL] >> https-enabled=true >> ssl-cacert-file=/etc/pki/ovirt-engine/ca.pem >> ssl-cert-file=/etc/pki/ovirt-engine/certs/ovirt-provider-ovn.cer >> ssl-key-file=/etc/pki/ovirt-engine/keys/ovirt-provider-ovn.key.nopass >> [OVIRT] >> ovirt-sso-client-secret=Ms7Gw9qNT6IkXu7oA54tDmxaZDIukABV >> ovirt-host=https://engine.set.local:443 >> ovirt-sso-client-id=ovirt-provider-ovn >> ovirt-ca-file=/etc/pki/ovirt-engine/apache-ca.pem >> [PROVIDER] >> provider-host=engine.set.local >> >> >>> 12 сент. 2018 г., в 13:59, Dominik Holler <dholler(a)redhat.com> >>> написал(а): >>> >>> On Wed, 12 Sep 2018 13:04:53 +0300 >>> "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: >>> >>>> Hello Dominik! >>>> I have a same issue with OVN provider and SSL >>>> https://www.mail-archive.com/users@ovirt.org/msg47020.html >>>> <https://www.mail-archive.com/users@ovirt.org/msg47020.html> But >>>> certificate changes not helps to resolve it. Maybe you can help me >>>> with this? >>> >>> Sure. Can you please share the relevant lines of >>> ovirt-provider-ovn.log and engine.log, and the information if you >>> are using the certificates generated by engine-setup with >>> users(a)ovirt.org ? Thanks, >>> Dominik >>> >> > >

5 13

engine-config -s UserSessionTimeOutInterval=X problem
by marek 28 Aug '23

28 Aug '23

ovirt 4.5.4, standalone engine, centos 8 stream [root@ovirt ~]# engine-config -g UserSessionTimeOutInterval Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false UserSessionTimeOutInterval: 30 version: general [root@ovirt ~]# engine-config -s UserSessionTimeOutInterval=60 Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value 60 to key UserSessionTimeOutInterval. any ideas where is the problem? Marek

5 6

Unable to upload or download iso via admin portal
by Igor Filipovic 23 Aug '23

23 Aug '23

Hi, I'm having a trouble on fresh 4.4.10.7 installation (on oracle linux), I'm not able to upload or download any file using storage domain upload image function. I've imported CA certificate and have tried on several browsers (firefow, chrome,edge), on different computers (and browsers are green - claiming that I'm securely connected), but I'm always getting error regarding CA certificate when I test connection, or when I try to upload ISO image. I've tried to upload ISO image via cli commands (upload_disk.py), and that scenario was successful, however this method It is not very convenient for my co-workers. I have 5 physical hosts, one is dedicated to run ovirt-engine, and other 4 are kvm hypervisors. When I try to upload ISO this is what engine.log logs: 2023-04-08 11:00:28,339+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Running command: TransferImageStatusCommand internal: false. Entities affected : ID: 1eb97088-b805-4616-af55-0ac9d1d7dfbe Type: SystemAction group CREATE_DISK with role type USER 2023-04-08 11:00:28,340+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Updating image transfer a78b18c5-e395-4c29-aa5c-15ffff8a1cb6 (image 4f758325-ac11-4071-a9fa-d180425e8604) phase to Paused by System (message: 'Sent 0MB') 2023-04-08 11:00:28,363+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] EVENT_ID: UPLOAD_IMAGE_NETWORK_ERROR(1,062), Unable to upload image to disk 4f758325-ac11-4071-a9fa-d180425e8604 due to a network error. Ensure ovirt-engine's CA certificate is registered as a trusted CA in the browser. The certificate can be fetched from https://engine-dr.somedomain/ovirt-engine/services/pki-resource?resource=ca… 2023-04-08 11:00:28,363+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] (default task-2) [f6b62add-0a0c-45ee-a985-a76171843382] Running command: TransferImageStatusCommand internal: false. Entities affected : ID: 1eb97088-b805-4616-af55-0ac9d1d7dfbe Type: SystemAction group CREATE_DISK with role type USER Can you please point me in some direction to try to fix this? Thanks, and best regards Igor

4 4

ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials
by cmicarelli＠fdmservices.it 22 Aug '23

22 Aug '23

Hi Guys, I'm tried to install ovirt 4.5 on centos 8 stream and everytime file with this error ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials Someone could help me? Regrards

2 2

engine-setup failing on 4.3.2 -> 4.3.3 fails during Engine schema refresh fail
by Edward Berger 18 Jul '23

18 Jul '23

I was trying to upgrade a hyperconverged oVirt hosted engine and failed in the engine-setup command with these error and warnings. ... [ INFO ] Creating/refreshing Engine database schema [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0830_add_foreign_key_to_image_transfers.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed ... [ INFO ] Yum Verify: 16/16: ovirt-engine-tools.noarch 0:4.3.3.5-1.el7 - e [WARNING] Rollback of DWH database postponed to Stage "Clean up" [ INFO ] Rolling back database schema ... [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Attaching engine-setup logfile.

4 6

Suggestion to switch to nightly
by Sandro Bonazzola 07 Jul '23

07 Jul '23

Hi, As you probably noticed there were no regular releases after oVirt 4.5.4 <https://ovirt.org/release/4.5.4/> in December 2022. Despite the calls to action to the community and to the companies involved with oVirt, there have been no uptake of the leading of the oVirt project yet. The developers at Red Hat still dedicating time to the project are now facing the fact they lack the time to do formal releases despite they keep fixing platform regressions like the recent ones due to the new ansible changes. That makes a nightly snapshot setup a more stable environment than oVirt 4.5.4. For this reason, we would like to suggest the user community to enable nightly repositories for oVirt by following the procedure at: https://www.ovirt.org/develop/dev-process/install-nightly-snapshot.html This will ensure that the latest fixes for the platform regressions will be promptly available. Regards, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING - Red Hat In-Vehicle Operating System Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

5 9

Bcp vm
by Ali Gusainov 27 Jun '23

27 Jun '23

Hello experts. Environment: 2 identical servers running CentOS Linux release 7.7.1908 oVirt Version:4.3.7.2-1.el7 No clusters configured. NFS share for backups on third server. Have some questions. 1. Need to create backups of virtual machines to NFS without downtime. Can an 'OVA export' be a complete policy for backups? 2. Is there a way to export vm to OVA via command line?

2 5

novnc console error: promise.js missing?
by karl.morgan＠gmail.com 02 Jun '23

02 Jun '23

Seeing the following on the engine when attempting to start a novnc console 2023-03-31 11:57:34,988-07 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-29) [307c22a9] START, SetVmTicketVDSCommand(HostName = ov2node02-mn, SetVmTicketVDSCommandParameters:{hostId='19a92de3-c6e4-4f4e-be31-1d5533a2b6b6', vmId='4481b0e9-a96c-4ee7-8bd2-572558eb9fda', protocol='VNC', ticket='LMl903dd', validTime='120', userName='admin@ovirt', userId='9e88a363-34cb-466a-8ba9-25e46819423b', disconnectAction='LOCK_SCREEN', consoleDisconnectActionDelay='0'}), log id: 1d6520d5 2023-03-31 11:57:35,031-07 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-29) [307c22a9] FINISH, SetVmTicketVDSCommand, return: , log id: 1d6520d5 2023-03-31 11:57:35,044-07 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-29) [307c22a9] EVENT_ID: VM_SET_TICKET(164), User admin@ovirt@internalkeycloak-authz initiated console session for VM first 2023-03-31 11:57:35,158-07 INFO [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-29) [] Can't read file '/usr/share/ovirt-engine/files/novnc/vendor/promise.js' for request '/ovirt-engine/services/files/novnc/vendor/promise.js' -- 404 Curious if this is obvious to anyone? How to resolve? ovirt-engine-webadmin-portal-4.5.4-1.el9.noarch ovirt-engine-4.5.4-1.el9.noarch

2 1

Ovirt 4.5.0 Support (End of Life Date)
by masood.ahmed＠digital.mod.uk 23 May '23

23 May '23

Hi, I am working on a project and we would like to utilise (oVirt 4.5.) as the platform for our enterprise infrastructure. We have arrived at this juncture because of a range of considerations related to hardware and software availability and compatibility. My question is if there is on-going vendor \ professional support for oVirt moving forward, as one of my colleagues spoke with Red Hat, who stated they are going to end their support for the product. we will not gain security accreditation for our project unless we have professional support available, community support only is not sufficient, Any ideas of firms available for a support contract for oVirt 4.5.0? thanks

2 1

Ovirt node disk broken
by marcel d'heureuse 09 May '23

09 May '23

Hi all, On a single Server the node disk is broken and I have to replace it. The glusterfs configuration is also gone but the glusterfs directorys are existing on a separate available disk. Did I have a Chance to install the ovirt Node on a New disk and make the old glusterfs running and also the 7 vms included the hosted engine? I can also deploy a New hosted engine but can I than import the existing gluster disk from the old Installation? I have installed the node and also mount the gluster_bricks but to make the volumes available I have not found any command. It is an ovirt 4.3.10 Installation. Is there any chance to save some time. The data inside the vms are good to have. Br Marcel

2 1

Unable to change the admin passsword on oVirt 4.5.2.5
by Ayansh Rocks 08 May '23

08 May '23

Hi All, Any idea hot to change password of admin user on oVirt 4.5.2.5 ? Below is not working - [root@ovirt]# ovirt-aaa-jdbc-tool user password-reset admin Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Password: Reenter password: updating user admin... user updated successfully [root@delhi-test-ovirtm-02 ~]# Above shows successful but password not changed. Thanks

5 7

VDSM certs expired, manual renewal not working
by cen 02 May '23

02 May '23

Hi Our VDSM certs have expired, both hosts are unassigned and can't be put into maintenance from UI. vdsm-client is not working, times out even with --insecure flag. Does host and port need to be specified when run locally or should defaults work? Error in console events is: Get Host Capabilities Failed: PKIX path validation failed... I followed a RHV guide for this exact situation and generated new vdsm certificate using the ovirt-engine CA. The new cert seems identical to the old one, everything matches (algos, extensions, CA, CN, SAN etc) just new date. After restarting libvirtd and vdsmd on the host with new cert in place the host is still not reachable. However, error message is now slightly different: get Host Capabilities failed: Received fatal error: certificate_expired Cert was replaced in the following locations: /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-spice/server-cert.pem /etc/pki/libvirt/clientcert.pem Is there another location missing? What else can I try? All help appreciated in advance

3 6

ovirt 4.5.4 install failure
by Selçuk N 02 May '23

02 May '23

Hello all, I tried to install ovirt 4.5.4 on ovirt node install. *hosted-engine --deploy* After this step installation is stuck. *[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the host to be up]* I checked the log file and details below. Apr 20 22:10:18 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85405) Apr 20 22:10:19 ovirt3 python3[51367]: ansible-ovirt_host_info Invoked with pattern=name=ovirt3.44c.net auth={'token': 'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJOTXdyenhDY284eERxZVlLaFRhWG5xblVpV0lFNDVBM2VmRzhXdndTaDVBIn0.eyJleHAiOjE2ODIwMzQzNzgsImlhdCI6MTY4MjAxNzA5OCwianRpIjoiODdjNDAwZTItNDZiMS00NmY1LTk2MWMtMWJhMDA3MDAxOGQxIiwiaXNzIjoiaHR0cHM6Ly9lbmcuNDRjLm5ldC9vdmlydC1lbmdpbmUtYXV0aC9yZWFsbXMvb3ZpcnQtaW50ZXJuYWwiLCJhdWQiOiJhY2NvdW50Iiwic3ViIjoiZmFiMDNmM2UtODVmZS00YjQ5LWE5ZWItZTExODRjOTYzYzdjIiwidHlwIjoiQmVhcmVyIiwiYXpwIjoib3ZpcnQtZW5naW5lLWludGVybmFsIiwic2Vzc2lvbl9zdGF0ZSI6IjYwOWJiMmMxLTJkNTItNDc4Zi1hYzg2LWMyMjVlNTVmYTMwNyIsImFjciI6IjEiLCJhbGxvd2VkLW9yaWdpbnMiOlsiaHR0cHM6Ly9lbmcuNDRjLm5ldCJdLCJyZWFsbV9hY2Nlc3MiOnsicm9sZXMiOlsiZGVmYXVsdC1yb2xlcy1vdmlydC1pbnRlcm5hbCIsIm9mZmxpbmVfYWNjZXNzIiwidW1hX2F1dGhvcml6YXRpb24iXX0sInJlc291cmNlX2FjY2VzcyI6eyJhY2NvdW50Ijp7InJvbGVzIjpbIm1hbmFnZS1hY2NvdW50IiwibWFuYWdlLWFjY291bnQtbGlua3MiLCJ2aWV3LXByb2ZpbGUiXX19LCJzY29wZSI6Im92aXJ0LWFwcC1hcGkgZW1haWwgb3ZpcnQtZXh0PXRva2VuLWluZm86YXV0aHotc2VhcmNoIG92aXJ0LWV4dD10b2tlbi1pbmZvOnZhbGlkYXRlIG92aXJ0LWV4dD10b2tlbi1pbmZvOnB1YmxpYy1hdXRoei1zZWFyY2ggcHJvZmlsZSBvdmlydC1leHQ9dG9rZW46cGFzc3dvcmQtYWNjZXNzIiwic2lkIjoiNjA5YmIyYzEtMmQ1Mi00NzhmLWFjODYtYzIyNWU1NWZhMzA3IiwiZW1haWxfdmVyaWZpZWQiOmZhbHNlLCJncm91cHMiOlsiL292aXJ0LWFkbWluaXN0cmF0b3IiXSwicHJlZmVycmVkX3VzZXJuYW1lIjoiYWRtaW5Ab3ZpcnQiLCJlbWFpbCI6ImFkbWluQGxvY2FsaG9zdCJ9.e47PgAtt_Sj-_4IQ8OIQynAV_AvrOfzalhwi1VJapCQB_sdQqxd0jIH7JGVM1a4TGEJb6E5ffTXBocqQabe5pBPIv4kqsgU1iadyTjjDjZ1elECnahPf6lrze-8hEO92GKFOepGLQ-iu7gRilAknvaXhoc309G1hyQvnP4Q-syffw6Eoo4RmgnLnztnPzsxBtGgkZrzAwFfTNDtdS2uj5lvzzAEIfvDPRFTjJhYwKXSx2hC1lnhXnmv1XEtCfXZZ3qqarXw8GAvOQbe10xklm5UAtu--C8NX32DE6659QtEqk-5g52SdFWIic_OlZ5-obHn3jOllo8qnsb-6mfEn_w', 'url': 'https://eng.44c.net/ovirt-engine/api', 'ca_file': None, 'insecure': True, 'timeout': 0, 'compress': True, 'kerberos': False, 'headers': None, 'hostname': None, 'username': None, 'password': None} fetch_nested=False nested_attributes=[] follow=[] all_content=False cluster_version=None *Apr 20 22:10:22 ovirt3 journal[47971]: Invalid value '-1' for 'cpu.max': Invalid argument* Apr 20 22:10:23 ovirt3 sssd_kcm[50811]: Shutting down (status = 0) Apr 20 22:10:23 ovirt3 systemd[1]: sssd-kcm.service: Deactivated successfully. Apr 20 22:10:23 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85400) Apr 20 22:10:28 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85395) What did I did wrong? Thanks.

2 1

checking engine vm status during global maintenance
by Alexey Valkov 02 May '23

02 May '23

Hi all, I tried to check engine status (via hosted-engine --vm-status) during global maintenance in oVirt 4.5.1 and discovered that it showed me status as it was just before entering global maintenance. Is it by design? And HA agent doesn't monitor and therefore doesn't update Engine VM status? If I remember right in oVirt 4.2 hosted-engine --vm-status showed correct status of Engine VM regardless of Global maintenance. I shutted down the engine but the output of hosted-engine --vm-status was Engine status : {"vm": "up", "health": "good", "detail": "Up"} Notice !! Cluster is in GLOBAL MAINTENANCE mode !! existed in the output. Host timestamp and extra metadata was up to date. All rest info looked good. Thi is my second attempt to ask the question (first was at 24/04 and still is being moderated). -- Best regards Alexei

2 1

richiesta accesso Zanata
by Rosario Grasso 02 May '23

02 May '23

Buongiorno, la presente per richiedere l'accesso a Zanata in lingua inglese e se possibile anche in italiano. Saluti, RG

2 2

Serial console VMs (vmconsole) only listed when admin user is logged into Manager WebUI?
by aleblanc＠lbl.gov 28 Apr '23

28 Apr '23

I am running a test\POC oVirt configuration with the following... oVirt engine: ovirt-engine-4.5.4-1.el8 engine OS: Rocky Linux release 8.7 (Green Obsidian) install type: stand-alone engine install I am able to access the serial console of VMs successfully, using the proper SSH command directly on the engine or remotely. Problem is, the VMs only show up in the list IF the 'admin' or 'admin@ovirt' user is presently logged into the manager UI. If I log out of the manager UI, the serial console returns 'no VMs'. Is there a setting or something that I am missing? ==== logged out of manager UI: [ovirt-vmconsole-proxy-helper]# /usr/libexec/ovirt-vmconsole-proxy-helper/ovirt-vmconsole-list.py --version "1" consoles --entityid "d55e4ab6-0318-46b0-95bc-12b21144eb88" {"consoles": [], "version": 1, "content": "console_list"} ==== logged into manager UI: [ovirt-vmconsole-proxy-helper]# /usr/libexec/ovirt-vmconsole-proxy-helper/ovirt-vmconsole-list.py --version "1" consoles --entityid "d55e4ab6-0318-46b0-95bc-12b21144eb88" {"consoles": [{"console": "3ecd0eda-130d-434b-9ece-32bbcc3b3e5a.sock", "vmid": "3ecd0eda-130d-434b-9ece-32bbcc3b3e5a", "host": "dldvovirt01", "vmname": "mytestvm_2", "vm": "mytestvm_2"}, {"console": "4e6abfbe-ede3-4e87-8d07-4ed1d6cb715c.sock", "vmid": "4e6abfbe-ede3-4e87-8d07-4ed1d6cb715c", "host": "dldvovirt02", "vmname": "testvm_4", "vm": "testvm_4"}, {"console": "dc4d017b-4f68-4eee-b80e-e49122345139.sock", "vmid": "dc4d017b-4f68-4eee-b80e-e49122345139", "host": "dldvovirt01", "vmname": "mytestvm_3", "vm": "mytestvm_3"}], "version": 1, "content": "console_list"} Any help would be appreciated.

1 0

Getting to the consoles of the Virtual machines
by destfinal＠googlemail.com 28 Apr '23

28 Apr '23

Hi, I have just deployed a functional oVirt cluster. I have created a few virtual machines and am able to ssh into them. However, I could not connect to the consoles of any of the running virtual machines. If I click on the console, from the management portal, it offers me to download a console.vv file. If I download it and double click on it, the file (console.vv itself) simply disappears. I connected to the kvm of the the node where the vm is running, from a VMM (from my local machine which is a Ubuntu 22.04) and when I tried to open the the console from there I get a "Viewer was disconnected" message in the machine Window. In the oVirt cluster, the VM console settings are: Video Type: VGA # Another available option is QXL Graphics protocol: VNC # Which is the only option available Could not find any useful information from the engin.log (all it say is that "Initiated console session for VM XXXXXX). What setting should I enable/change to get into the cnsole of my VM's? Please let me know if you need more information in this regard. Thanks

1 0

oVirt Self-hosted Engine Deployment fails
by destfinal＠googlemail.com 28 Apr '23

28 Apr '23

Hi, I am struggling to get an oVirt cluster setup (for a PoC with some workstations) for the past more than one week and am getting nowhere. Following is my environment: Machine: Dell Workstation with i7, 16G RAM, 256G (I have got couple of more of this machine but could not getr beyond the first one) OS: oVirt minimal (https://resources.ovirt.org/pub/ovirt-4.5/iso/ovirt-node-ng-installer/4.5.4…) Documentation followed: https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engin… Cluster name chosen: my.cluster First node host name: node1-ovirt.my.cluster Engine VM name: ovirt-engine.my.cluster The documentation states that there should be resolvable DNS entries for both the oVirt hosts *as well as* for the oVirt engine VM. I am a bit confused on this as the VM will get a DHCP address only after running the 'hosted-engine' script. What ip address should I have for the engine VM (say if I have my engine host name as ovirt-engine.my.cluster)? If I have no entry for the engine in the DNS I get the following error: [ ERROR ] Host name is not valid: ovirt-engine.my.cluster did not resolve into an IP address Please provide the FQDN you would like to use for the engine. Note: This will be the FQDN of the engine VM you are now going to launch, it should not point to the base host or to any other existing machine. Engine VM FQDN: So I simply added an entry for 'ovirt-engine.my.cluster' with a dummy value 192.168.0.222 (this is an ip address on the host subnet; but the engine gets a DHCP address from a different subnet from a virtual network from the host; I dont understand this) which moves away from the above problem and goes all the way (after providing the values for a few other questions) to hang at 'Wait for the host to be up' for a while and eventually fail with an error message: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} At this point a vm is running in the host. I logged on to the VM and searched the logs and found the following line in the /var/log/ovirt-engine/engine.log: ERROR [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-1) [728b2edd-d13a-48c3-a2c1-42a66a5334c5] Exception: Task Install ovs failed to execute. Please check logs for more details: /var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20230425210047-node1-ovirt.my.cluster-728b2edd-d13a-48c3-a2c1-42a66a5334c5.log and in the file /var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20230425210047-node1-ovirt.my.cluster-728b2edd-d13a-48c3-a2c1-42a66a5334c5.log I found the following error: "msg" : "The conditional check 'cluster_switch == \"ovs\" or (ovn_central is defined and ovn_central | ipaddr)' failed. The error was: The ipaddr filter requires python's netaddr be installed on the ansible controller\n\nThe error appears to be in '/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml': line 3, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n- block:\n - name: Install ovs\n ^ here\n" On the host (node1-ovirt.my.cluster) =========================== the result of 'rpm -qa | grep netaddr' is 'python3-netaddr-0.8.0-5.el9.noarch' the ansible version is: ansible [core 2.14.0] config file = /etc/ansible/ansible.cfg configured module search path = ['/root/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] ansible python module location = /usr/lib/python3.9/site-packages/ansible ansible collection location = /root/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible python version = 3.9.14 (main, Sep 21 2022, 00:00:00) [GCC 11.3.1 20220421 (Red Hat 11.3.1-2)] (/usr/bin/python3.9) jinja version = 3.1.2 libyaml = True # rpm -qi ovirt-engine-appliance Name : ovirt-engine-appliance Version : 4.5 Release : 20221206125848.1.el9 On the vm (ovirt-engine.my.cluster) =========================== the result of 'rpm -qa | grep netaddr' is: python3-netaddr-0.7.19-8.1.2.el8.noarch python39-netaddr-0.7.19-8.1.2.el8.noarch ansible version is: ansible [core 2.14.2] config file = /etc/ansible/ansible.cfg configured module search path = ['/root/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] ansible python module location = /usr/lib/python3.11/site-packages/ansible ansible collection location = /root/.ansible/collections:/usr/share/ansible/collections executable location = /usr/bin/ansible python version = 3.11.2 (main, Feb 28 2023, 23:00:48) [GCC 8.5.0 20210514 (Red Hat 8.5.0-18)] (/usr/bin/python3.11) jinja version = 3.1.2 libyaml = True At the moment I ran out of ideas. Am I not following something in the document correctly? Please let me know if you need more information in this regard Thanks

5 12

Problem when re-attaching domain - some vms disapered
by Ricardo Alonso 26 Apr '23

26 Apr '23

Hello all, Due to a maintenance in our glusterfs infrastructure, I moved the domain data to a different location (but before I took care of shutdown all machines and detach it from the manager). After the upgrade, I created a new glusterfs volume to hold the vms and attached the old one, using NFS, in order to move the vms to this new storage location. Out of 38 machines, 2 of them didn't appear in the list to be imported back. Analysing the storage I managed to find they volumes but Ovirt insists in not import them. I found an old thread that talks about a similar problem: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/MF5IUXURKIQZNN… but their solution didn't help. Those VMs were imported from Virtualbox in the past. This is the meta file: cat 80f95e3e-f92b-497a-aec5-440ba5282682.meta CAP=53687091200 CTIME=1665328113 DESCRIPTION=generated by virt-v2v 1.42.0rhel_8,release_19.module+el8.6.0+998+252a5635 DISKTYPE=2 DOMAIN=1102600c-eee7-40cc-86b2-ee90b3c4df6b FORMAT=RAW GEN=0 IMAGE=00e13c7f-d0e9-4d5b-8862-a28f0b91acfe LEGALITY=LEGAL PUUID=00000000-0000-0000-0000-000000000000 TYPE=SPARSE VOLTYPE=INTERNAL EOF I could get the disk manually and import, but it has 2 snapshots (two other volumes in the same directory) which I don't know how to "merge" them into the original disk (if it's possible). tree 00e13c7f-d0e9-4d5b-8862-a28f0b91acfe 00e13c7f-d0e9-4d5b-8862-a28f0b91acfe ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c.lease ├── 2e698005-d7f0-4387-a9ce-9d1f14a7c18c.meta ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7 ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7.lease ├── 618c5a68-3c34-42e1-b6cb-4d22f6a605f7.meta ├── 80f95e3e-f92b-497a-aec5-440ba5282682 ├── 80f95e3e-f92b-497a-aec5-440ba5282682.lease └── 80f95e3e-f92b-497a-aec5-440ba5282682.meta The Ovirt is 4.5.4 and the host Rocky 8, all updated to the latest version. On the vdsm.log, this is the only 2 lines related to this disk I could find. 2023-04-24 13:39:25,812-0300 INFO (jsonrpc/3) [vdsm.api] FINISH getImagesList return={'imageslist': ['d03f371f-0b86-4a06-b8e3-bbd602a81442', 'f1425fd4-fb4f-48ae-8df1-1bd44b026848', '9d52bfa9-d2dd-49c3-8a98-66cf950a7bcb', 'f7c69f63-c3a8-447c-baf2-751021fb7c26', 'bc76e648-e09d-448e-86f1-b3ae47509837', '00e13c7f-d0e9-4d5b-8862-a28f0b91acfe', '88b53eb4-9ca9-4162-9e91-f00b4f41f278', '0bd13065-cb21-4db3-9eb0-7582c65c4ca9', '06444eb3-52bf-48af-84fe-36baf1531853', '7ea966f8-72ed-421b-be71-e20b3dcc4e5a', '2e9dee7c-131b-427b-9e7a-33a49af7c6f0', 'e58171dc-5135-4462-b1f3-49d98785907e', 'f5d2e866-1d53-4243-8a6e-f5031c4be33d', 'ad5fe94a-4880-4dcf-af36-4a36ede9a6ab', '72a047f4-6546-4750-845f-ceb74c6503c8', '36d0ec3d-482b-4c90-a169-8b2b9abee158', '6e5afad2-5de0-463f-b04b-34b4828b7aa3', '565c2418-d43f-4138-8d31-50e8bd9c5c4e', '0d128f2c-3962-4f91-8231-a5772132d241', '0b9cbbc5-316c-453a-aab0-a3e6805796e9', 'b43bc279-000b-40dc-8c00-cc22b8caab5d', '6a401413-d2ae-4c14-b028-a7fc953d08f2', 'aa3b6e24-1b74-4890-897a-13f858844b3a', '20ae1e1f-fccd-40e8-a1b4-90339e6c7ca1', '8e9050ad-82a1-4a23-a461-5d1eca7c9d80', 'fc2e4d0b-c092-4e74-b69e-da5020ac396e', '4c5c3c74-307f-49a9-ae66-60dddfc1db67', 'd8463e92-5495-4e59-8d2f-bcfcdfa59987', '0342e096-cf34-4a8c-a9f6-36b13c3e39c3', 'f6714bec-37df-4aad-8b21-2ae146b0fa19', 'd4c77a6b-dfcf-424c-9025-cbc8795b2f46', 'f42cb81b-058b-4bd6-b55e-5b3ae3601ade', 'fe052d41-8e94-4145-8c8b-7fdf8d8adc37', '1fc4c7b8-d7c8-4c32-88ce-6cf5c9e65aa0', '3aef6a30-8757-4f65-b989-c1b40236f4cb', '2e9fc88d-e5c0-4a97-b590-481a1508c155', 'dcedf2e9-5e92-44bc-9113-5263dd0dda96', '393e02b4-5765-4ea5-8008-e7d3a3995794', 'b895f40b-17a2-4f08-9126-c25d8858601f', '1c9a3ff9-7434-4867-8880-7d11548aca53', 'fa64e6eb-7aad-4548-b944-1bc04b719256', 'f912af5e-9c51-45a6-8b01-6d9224c48893', '6611aba7-e201-4702-842a-4089deeb306d', '00098322-3ba9-4af9-9e6d-54cb07ec3d77', '666fd481-07e5-45ed-be2e-bd3cd78df7dc', '13eb4b21-2134-48ae-84b6-164d6a8141cc', '50c3d0b9-a850-487a-a213-fd9b87db91b3', '3573b171-2980-47a2-96c2-55d39fddda55', '9b3a156f-3cb4-485a-b357-f5c7ed1bb890']} from=::ffff:192.168.5.52,52296, flow_id=a2fe8beb-4f0a-4d71-bf08-3a0d0c3b6403, task_id=39d06e06-2b25-4a94-b3f7-15dc60a44164 (api:37) 2023-04-24 13:39:26,220-0300 INFO (jsonrpc/4) [vdsm.api] START getVolumesList(sdUUID='1102600c-eee7-40cc-86b2-ee90b3c4df6b', spUUID='f04dd188-b214-11ea-845b-00163e4ad29b', imgUUID='00e13c7f-d0e9-4d5b-8862-a28f0b91acfe') from=::ffff:192.168.5.52,52296, flow_id=a2fe8beb-4f0a-4d71-bf08-3a0d0c3b6403, task_id=387e8181-764b-47d7-aa4d-13abf66fd94b (api:31) Does anyone have an idea?? Thank you Best regards Ricardo

2 2

New hosted engine setup mailed : maybe local_vm_ip undefined?
by Fedele Stabile 25 Apr '23

25 Apr '23

Good morning, I have a fresh installed host node ovirt v.4.5 and i'm installing engine using the command hosted-engine --deploy host node has a ip on 160.97.xx and i want the engine on the same network (160.97.xx) The installation seems to be good but at the end it exit leaving the host-engine running on 192.168.222.x (i can connect) Reading the logs in the ovirt-host i found they are relatedated to the file: sync_on_engine_machine.yml and are an undefined local_vm_ip variable and dict object has no attribute engine Seems that the error is here: 2023-04-25 06:28:18,953+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'local_vm_ip' is undefined\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Set the name for add_host\n ^ here\n"} .... .... 2023-04-25 06:28:19,757+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"} 2023-04-25 06:28:19,857+0200 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] 2023-04-25 06:28:19,958+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n", '_ansible_no_log': None} 2023-04-25 06:28:20,058+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n"} Help me, please

1 0

Hosted engine setup Failed
by Fedele Stabile 25 Apr '23

25 Apr '23

Good morning, I have a fresh installed host node ovirt v.4.5 and i would install engine using terminal, using the commanda hosted-engine --deploy host node has a ip on 160.97.xx and i want the engine on the same network (160.97.xx) The installation seems to be good but at the end exit leaving the host-engine running on 192.168.222.x Seems that the error is here: 2023-04-25 06:28:18,953+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'local_vm_ip' is undefined\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Set the name for add_host\n ^ here\n"} .... .... 2023-04-25 06:28:19,757+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"} 2023-04-25 06:28:19,857+0200 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Sync on engine machine] 2023-04-25 06:28:19,958+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n", '_ansible_no_log': None} 2023-04-25 06:28:20,058+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"msg": "The field 'delegate_to' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'engine'\n\nThe error appears to be in '/usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/tasks/sync_on_engine_machine.yml': line 7, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n import_tasks: add_engine_as_ansible_host.yml\n- name: Sync on engine machine\n ^ here\n"} Help me, please

1 0

New host deployment failed: Task Configure OVN for oVirt failed to execute.
by Xavier Lauzon 24 Apr '23

24 Apr '23

Hi there, I have been trying to deploy a new host to my cluster and have been having some difficulties with one part of the installation. I've tried to add this host a few different times, and each time I get the same error. Current troubleshooting steps tried: Used three different distros: CentOS 9, oVirt Node 4.5.5, Rocky Linux 9,1 Used two separate machines with different network card configurations. Used both the stable and nightly branches. Workaround tried: Manually configuring the host networks through the "Network Interfaces" tab. Manually activated the host after the install failed - host is set to active state. This workaround seems to work; however, whenever any VMs are migrated to the host, they fail with the error 'Fatal exception'. Here is the error log: 2023-04-24 15:21:11 UTC - TASK [ovirt-provider-ovn-driver : Configure OVN for oVirt] ********************* 2023-04-24 15:21:14 UTC - { "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38", "counter" : 423, "stdout" : "fatal: [node.example.org] FAILED! => {\"changed\": true, \"cmd\": [\"vdsm-tool\", \"ovn-config\", \"10.0.0.2\", \"node.example.org\"], \"delta\": \"0:00:02.351900\", \"end\": \"2023-04-24 11:21:11.968404\", \"msg\": \"non-zero return code\", \"rc\": 1, \"start\": \"2023-04-24 11:21:09.616504\", \"stderr\": \"Traceback (most recent call last):\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\\n return networks[net_name]\\nKeyError: 'node.example.org'\\n\\nDuring handling of the above exception, another exception occurred:\\n\\nTraceback (most recent call last):\\n File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\\n return tool_command[cmd][\\\"command\\\"](*args)\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\\n File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\\n raise NetworkNotFoundError(net_name)\\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\", \"stderr_lines\": [\"Traceback (most recent call last):\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 117, in get_network\", \" return networks[net_name]\", \"KeyError: 'node.example.org'\", \"\", \"During handling of the above exception, another exception occurred:\", \"\", \"Traceback (most recent call last):\", \" File \\\"/usr/bin/vdsm-tool\\\", line 195, in main\", \" return tool_command[cmd][\\\"command\\\"](*args)\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 63, in ovn_config\", \" ip_address = get_ip_addr(get_network(network_caps(), net_name))\", \" File \\\"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\\\", line 119, in get_network\", \" raise NetworkNotFoundError(net_name)\", \"vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org\"], \"stdout\": \"\", \"stdout_lines\": []}", "start_line" : 416, "end_line" : 417, "runner_ident" : "a36144c0-97bc-4170-8f9e-1c2fbc10b7c3", "event" : "runner_on_failed", "pid" : 91786, "created" : "2023-04-24T15:21:11.993278", "parent_uuid" : "00163e19-a0e7-c330-a021-000000000041", "event_data" : { "playbook" : "ovirt-host-deploy.yml", "playbook_uuid" : "86e8189d-85f0-4040-9615-8eb13e614105", "play" : "all", "play_uuid" : "00163e19-a0e7-c330-a021-000000000002", "play_pattern" : "all", "task" : "Configure OVN for oVirt", "task_uuid" : "00163e19-a0e7-c330-a021-000000000041", "task_action" : "ansible.builtin.command", "task_args" : "", "task_path" : "/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml:43", "role" : "ovirt-provider-ovn-driver", "host" : "node.example.org", "remote_addr" : "node.example.org", "res" : { "changed" : true, "stdout" : "", "stderr" : "Traceback (most recent call last):\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network\n return networks[net_name]\nKeyError: 'node.example.org'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/bin/vdsm-tool\", line 195, in main\n return tool_command[cmd][\"command\"](*args)\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config\n ip_address = get_ip_addr(get_network(network_caps(), net_name))\n File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network\n raise NetworkNotFoundError(net_name)\nvdsm.tool.ovn_config.NetworkNotFoundError: node.example.org", "rc" : 1, "cmd" : [ "vdsm-tool", "ovn-config", "10.0.0.2", "node.example.org" ], "start" : "2023-04-24 11:21:09.616504", "end" : "2023-04-24 11:21:11.968404", "delta" : "0:00:02.351900", "msg" : "non-zero return code", "invocation" : { "module_args" : { "_raw_params" : "vdsm-tool ovn-config 10.0.0.2 node.example.org\n", "_uses_shell" : false, "stdin_add_newline" : true, "strip_empty_ends" : true, "argv" : null, "chdir" : null, "executable" : null, "creates" : null, "removes" : null, "stdin" : null } }, "stdout_lines" : [ ], "stderr_lines" : [ "Traceback (most recent call last):", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 117, in get_network", " return networks[net_name]", "KeyError: 'node.example.org'", "", "During handling of the above exception, another exception occurred:", "", "Traceback (most recent call last):", " File \"/usr/bin/vdsm-tool\", line 195, in main", " return tool_command[cmd][\"command\"](*args)", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 63, in ovn_config", " ip_address = get_ip_addr(get_network(network_caps(), net_name))", " File \"/usr/lib/python3.9/site-packages/vdsm/tool/ovn_config.py\", line 119, in get_network", " raise NetworkNotFoundError(net_name)", "vdsm.tool.ovn_config.NetworkNotFoundError: node.example.org" ], "_ansible_no_log" : null }, "start" : "2023-04-24T15:21:09.330408", "end" : "2023-04-24T15:21:11.993114", "duration" : 2.662706, "ignore_errors" : null, "event_loop" : null, "uuid" : "2b0f6916-ce5d-4f94-b153-972c1d7c5c38" } } Has anyone been experiencing the same issues? Cheers, Xavier Lauzon

1 0

A disk cannot be created because of the size and cannot delete it now
by cagdasbs＠gmail.com 24 Apr '23

24 Apr '23

Hi everyone, A colleague of mine tried to create a 1T preallocated disk on a 1T datastore. Ovirt failed to allocate enough space for the disk and throw an error. Now there is a 1T locked disk in the disks list and I cannot delete it, because it's locked. I tried unlock_entity.sh but it doesn't list anything when I run `unlock_entity.sh -t all -q` . Any suggestions on how do I delete this disk?

1 0

hosted-engine to standalone
by carl langlois 21 Apr '23

21 Apr '23

Hi, I plan to transform my hosted_engine setup to a standalone engine. Currently I have 3 hosts that can run the engine. The engine domain is located on a glusterfs. I want to simplify this setup by taking 1 of the 3 hosts and setting it as a standalone engine and re-installing the other host as a standard hypervisor. Also i want to remove the glusterfs. I am on 4.3 for now but the plan is to upgrade after this simplification. The step i plan to do is: 1. global maintenance 2. stop engine 3. backup engine 4. shutdown engine 5. install fresh standalone engine and restore from the backup 6. boot the standalone engine. 7. after not sure what the step to clean the old engine domain.. Any suggestion? Regards, Carl

2 3

Installing Server 2022 VM
by Devin A. Bougie 20 Apr '23

20 Apr '23

We've been struggling to install Windows Server 2022 on oVirt. We recently upgraded to the latest oVirt 4.5 on EL9 hosts, but it didn't help. In the past, we could boot a VM from the install CD, add the mass storage drivers from the virt-io CD, and proceed from there. However, oVirt 4.3 didn't have a Server 2022 selection. After upgrading to oVirt 4.5, we couldn't get it to boot from the CD. It just gave me Windows boot errors if I do q35 EFI. If I switch back to i440fx I get the same behavior as in oVirt 4.3 - it'll boot the DVD but doesn't find a disk with the virtio-scsi drivers. We'd greatly appreciate if anyone has successfully installed Server 2022 in oVirt. Many thanks, Devin

1 1

Not able to create a storage domain of
by kushagra.gupta＠hsc.com 20 Apr '23

20 Apr '23

Hi team, We have installed ovirt 4.4. We have a self hosted Engine setup in the environment which has 1 hosted engine on top of 1 deployment-host. Goal: We want to create a storage domain of POSIX compliant type for mounting a ceph based infrastructure. We have done SRV based resolution in our DNS server but we are unable to create a storage domain. Issue: We are passing the following information: path: :/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 vfs-type: ceph mounting option:rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA= We get the following errors: ====================vdsm.log================================== 2023-04-20 11:26:30,318+0530 INFO (jsonrpc/7) [storage.Mount] mounting :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 at /rhev/data-center/mnt/ :_volumes_xyz_conf_2ee9c2d0-873b-4d04-8c46-4c0da02787b8 (mount:207) 2023-04-20 11:26:30,384+0530 ERROR (jsonrpc/7) [storage.HSM] Could not connect to storageServer (hsm:2374) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 2371, in connectStorageServer conObj.connect() File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 180, in connect six.reraise(t, v, tb) File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise raise value File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 171, in connect self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 210, in mount cgroup=cgroup) File "/usr/lib/python3.6/site-packages/vdsm/common/supervdsm.py", line 56, in __call__ return callMethod() File "/usr/lib/python3.6/site-packages/vdsm/common/supervdsm.py", line 54, in <lambda> **kwargs) File "<string>", line 2, in mount File "/usr/lib64/python3.6/multiprocessing/managers.py", line 772, in _callmethod raise convert_to_error(kind, result) vdsm.storage.mount.MountError: Command ['/usr/bin/mount', '-t', 'ceph', '-o', 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', ' :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', '/rhev/data-center/mnt/ :_volumes_xyz_conf_2ee9c2d0-873b-4d04-8c46-4c0da02787b8'] failed with rc=32 out=b'' err=b'mount error 3 = No such process\n' 2023-04-20 11:31:05,715+0530 ERROR (jsonrpc/3) [storage.Dispatcher] FINISH connectStorageServer error=:/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 is not a valid hosttail address: (dispatcher:87) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/common/network/address.py", line 42, in hosttail_split raise ValueError ValueError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/dispatcher.py", line 74, in wrapper result = ctask.prepare(func, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 110, in wrapper return m(self, *a, **kw) File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 1190, in prepare raise self.error File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 884, in _run return fn(*args, **kargs) File "<decorator-gen-117>", line 2, in connectStorageServer File "/usr/lib/python3.6/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 2368, in connectStorageServer conObj = storageServer.ConnectionFactory.createConnection(conInfo) File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 741, in createConnection return ctor(**params) File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 154, in __init__ self._remotePath = fileUtils.normalize_path(spec) File "/usr/lib/python3.6/site-packages/vdsm/storage/fileUtils.py", line 98, in normalize_path host, tail = address.hosttail_split(path) File "/usr/lib/python3.6/site-packages/vdsm/common/network/address.py", line 45, in hosttail_split raise HosttailError('%s is not a valid hosttail address:' % hosttail) vdsm.common.network.address.HosttailError: :/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8 is not a valid hosttail address: 2023-04-20 11:31:05,715+0530 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer failed (error 451) in 0.00 seconds (__init__:312) ====================engine.log================================ 2023-04-20 11:31:03,818+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] HostName = deployment-host 2023-04-20 11:31:03,818+05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Command 'ConnectStorageServerVDSCommand(HostName = deployment-host, StorageServerConnectionManagementVDSParameters:{hostId='745b7584-0a43-47d9-985f-af0a0155e787', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='POSIXFS', connectionList='[StorageServerConnections:{id='null', connection=':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', iqn='null', vfsType='ceph', mountOptions='rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'})' execution failed: VDSGenericException: VDSErrorException: Failed to ConnectStorageServerVDS, error = Error storage server connection: ("domType=6, spUUID=00000000-0000-0000-0000-000000000000, conList=[{'password': '********', 'vfs_type' : 'ceph', 'port': '', 'mnt_options': 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', 'iqn': '', 'connection': ':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', 'ipv6_enabled': 'false', 'id': '00000000-0000-0000-0000-000000000000', 'user': '', 'tpgt': '1'}]",), code = 451 2023-04-20 11:31:03,818+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] FINISH, ConnectStorageServerVDSCommand, return: , log id: 19c06f3f 2023-04-20 11:31:03,819+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to ConnectStorageServerVDS, error = Error storage server connection: ("domType=6, spUUID=00000000-0000-0000-0000-000000000000, conList=[{'password': '********', 'vfs_type': 'ceph', 'port': '', 'mnt_options': 'rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', 'iqn': '', 'connection': ':/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8', 'ipv6_enabled': 'false', 'id': '00000000-0000-0000-0000-000000000000', 'user': '', 'tpgt': '1'}]",), code = 451 (Failed with error StorageServerConnectionError and code 451) 2023-04-20 11:31:03,824+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand'. 2023-04-20 11:31:03,847+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-29) [6d7913e2-83cf-450d-8746-40f1582d959d] Lock freed to object 'EngineLock:{exclusiveLocks='[:/volumes/xyz/conf/2ee9c2d0-873b-4d04-8c46-4c0da02787b8=STORAGE_CONNECTION]', sharedLocks=''}' 2023-04-20 11:34:27,788+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-28) [63fbb9de] Lock Acquired to object 'EngineLock:{exclusiveLocks='[c6e0aa38-20ff-4be3-9b34-81a7b0fabb6a=PROVIDER]', sharedLocks=''}' 2023-04-20 11:34:27,809+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-28) [63fbb9de] Running command: SyncNetworkProviderCommand internal: true. 2023-04-20 11:34:28,017+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-29) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access =============================================================================== We tried creating a NFS type storage domain using the hostname of the nfs server. This hostname is resolved using the dns server. We are able to create this storage domain. We also tried creating the POSIX compliant domain using the hostname of the ceph-mon node but it is failing. We are passing the following information: path: ceph-node2:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 vfs-type: ceph mounting option:rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA= In this scenario though the mounting is happening but the storage domain is not created correctly. we are getting the following errors: ====================vdsm.log================================== 2023-04-20 12:23:54,759+0530 INFO (jsonrpc/0) [api.virt] FINISH getStats return={'status': {'code': 0, 'message': 'Done'}, 'statsList': [{'statusTime': '3009297867', 'status': 'Up', 'vmId': '9ea50595-33cc-4fde-9cd2-ac35c4e97a2c', 'vmName': 'HostedEngine', 'vmType': 'kvm', 'kvmEnable': 'true', 'acpiEnable': 'true', 'elapsedTime': '71325', 'monitorResponse': '0', 'clientIp': '', 'timeOffset': '0', 'pauseCode': 'NOERR', 'cpuUser': '7.12', 'cpuSys': '1.80', 'cpuUsage': '1264730000000', 'network': {'vnet1': {'macAddr': '00:16:3e:54:7f:23', 'name': 'vnet1', 'speed': '1000', 'state': 'unknown', 'rxErrors': '0', 'rxDropped': '0', 'txErrors': '0', 'txDropped': '0', 'rx': '94068359', 'tx': '107873946', 'sampleTime': 861814.22111595}}, 'disks': {'sdc': {'truesize': '0', 'apparentsize': '0', 'readLatency': '0', 'writeLatency': '0', 'flushLatency': '0', 'writtenBytes': '0', 'writeOps': '0', 'readOps': '22', 'readBytes': '406', 'readRate': '0.0', 'writeRate': '0.0'}, 'vda': {'truesize': '76436357 12', 'apparentsize': '53689188352', 'readLatency': '0', 'writeLatency': '18963692.40625', 'flushLatency': '132326.26666666666', 'writtenBytes': '1946506752', 'writeOps': '165176', 'readOps': '31194', 'readBytes': '859866624', 'readRate': '0.0', 'writeRate': '14743.1258832571', 'imageID': 'bcd042b1-0978-43bd-bf24-eb1f554cd520'}}, 'balloonInfo': {'balloon_max': '13489152', 'balloon_min': '13489152', 'balloon_cur': '13489152', 'balloon_target': '13489152', 'ballooning_enabled': True}, 'vcpuCount': '4', 'memoryStats': {'mem_total': '12887304', 'mem_unused': '7100564', 'mem_free': '7994896', 'swap_in': 0, 'swap_out': 0, 'majflt': 0, 'minflt': 196, 'pageflt': 196}, 'displayInfo': [{'type': 'vnc', 'port': '5900', 'tlsPort': '', 'ipAddress': '10.0.1.47'}, {'type': 'spice', 'port': '5901', 'tlsPort': '5902', 'ipAddress': '10.0.1.47'}], 'hash': '-7465763413854713032', 'vmJobs': {}, 'vcpuQuota': '-1', 'vcpuPeriod': 100000, 'username': 'root', 'session': 'Unknown', 'memUsage': '40', 'guestCPUCo unt': -1, 'appsList': ('kernel-4.18.0-486.el8.x86_64', 'qemu-guest-agent-6.2.0'), 'guestIPs': '', 'guestFQDN': 'manager-hosted-engine.com', 'netIfaces': [{'hw': '00:00:00:00:00:00', 'inet': ['127.0.0.1'], 'inet6': ['::1'], 'name': 'lo'}, {'hw': '00:16:3e:54:7f:23', 'inet': ['10.0.1.48'], 'inet6': ['fe80::216:3eff:fe54:7f23'], 'name': 'eth0'}], 'disksUsage': [{'path': '/', 'total': '7505707008', 'used': '4872785920', 'fs': 'xfs'}, {'path': '/var', 'total': '21464350720', 'used': '1688195072', 'fs': 'xfs'}, {'path': '/home', 'total': '1063256064', 'used': '41271296', 'fs': 'xfs'}, {'path': '/tmp', 'total': '2136997888', 'used': '48943104', 'fs': 'xfs'}, {'path': '/var/log', 'total': '10726932480', 'used': '132661248', 'fs': 'xfs'}, {'path': '/var/log/audit', 'total': '1063256064', 'used': '42233856', 'fs': 'xfs'}, {'path': '/boot', 'total': '1063256064', 'used': '352448512', 'fs': 'xfs'}], 'guestName': 'manager-hosted-engine.com', 'guestOs': '4.18.0-486.el8.x86_64', 'guestOsInfo': {'t ype': 'linux', 'arch': 'x86_64', 'kernel': '4.18.0-486.el8.x86_64', 'distribution': 'CentOS Stream', 'version': '8', 'codename': ''}, 'guestTimezone': {'offset': 330, 'zone': 'IST'}}]} from=::1,57200, vmId=9ea50595-33cc-4fde-9cd2-ac35c4e97a2c (api:54) 2023-04-20 12:23:55,230+0530 INFO (jsonrpc/3) [vdsm.api] START repoStats(domains=['963b7fd2-c32f-400d-9abf-ade3d702cb4b']) from=::1,57200, task_id=0279b915-ac22-46d2-afbc-8466144d22d8 (api:48) 2023-04-20 12:23:55,231+0530 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={'963b7fd2-c32f-400d-9abf-ade3d702cb4b': {'code': 0, 'lastCheck': '5.1', 'delay': '0.000864457', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}} from=::1,57200, task_id=0279b915-ac22-46d2-afbc-8466144d22d8 (api:54) 2023-04-20 12:23:55,735+0530 ERROR (monitor/6ac48b4) [storage.Monitor] Error checking domain 6ac48b40-a9dc-4475-b17e-247b6018abc1 (monitor:453) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 434, in _checkDomainStatus self.domain.selftest() File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 48, in __getattr__ return getattr(self.getRealDomain(), attrName) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 51, in getRealDomain return self._cache._realProduce(self._sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 139, in _realProduce domain = self._findDomain(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 156, in _findDomain return findMethod(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/nfsSD.py", line 146, in findDomain return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID)) File "/usr/lib/python3.6/site-packages/vdsm/storage/nfsSD.py", line 136, in findDomainPath raise se.StorageDomainDoesNotExist(sdUUID) vdsm.storage.exception.StorageDomainDoesNotExist: Storage domain does not exist: ('6ac48b40-a9dc-4475-b17e-247b6018abc1',) 2023-04-20 12:23:56,307+0530 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/[abcd:abcd:abcd::51]:6789:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9/6ac48b40-a9dc-4475-b17e-247b6018abc1/dom_md/metadata (monitor:511) ====================engine.log================================ 2023-04-20 12:23:55,064+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Lock Acquired to object 'EngineLock:{exclusiveLocks='[ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9=STORAGE_CONNECTION]', sharedLocks=''}' 2023-04-20 12:23:55,118+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2023-04-20 12:23:55,119+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] START, ConnectStorageServerVDSCommand(HostName = deployment-host, StorageServerConnectionManagementVDSParameters:{hostId='745b7584-0a43-47d9-985f-af0a0155e787', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='POSIXFS', connectionList='[StorageServerConnections:{id='null', connection='ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9', iqn='null', vfsType='ceph', mountOptions='rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA==', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', sendNetworkEventOnFailure='true'}), log id: 7e34045e 2023-04-20 12:23:55,223+05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=100}, log id: 7e34045e 2023-04-20 12:23:55,248+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] EVENT_ID: STORAGE_DOMAIN_ERROR(996), The error message for connection ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 returned by VDSM was: General Exception 2023-04-20 12:23:55,248+05 ERROR [org.ovirt.engine.core.bll.storage.connection.FileStorageHelper] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] The connection with details 'ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9' failed because of error code '100' and error message is: general exception 2023-04-20 12:23:55,249+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand' failed: EngineException: GeneralException (Failed with error GeneralException and code 100) 2023-04-20 12:23:55,255+05 ERROR [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand'. 2023-04-20 12:23:55,278+05 INFO [org.ovirt.engine.core.bll.storage.connection.AddStorageServerConnectionCommand] (default task-37) [31e859ef-97d0-435c-81ba-9d29bf637527] Lock freed to object 'EngineLock:{exclusiveLocks='[ceph-node2.myhsc.com:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9=STORAGE_CONNECTION]', sharedLocks=''}' This also doesn't work. We tried mounting the ceph-mon nodes cluster manually on the deployment host CLI , we were able to mount the same. sudo mount -t ceph :/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 /rhev/data-center/mnt/:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9 -o rw,name=foo,secret=AQABDzRkTaJCEhAAC7rC6E68ofwULnx6qX/VDA== [root@deployment-host mnt]# df -kh df: /run/user/0/gvfs: Transport endpoint is not connected Filesystem Size Used Avail Use% Mounted on [abcd:abcd:abcd::51]:6789,[abcd:abcd:abcd::52]:6789,[abcd:abcd:abcd::53]:6789:/volumes/xyz/conf/00593e1d-b674-4b00-a289-20bec06761c9 19G 0 19G 0% /rhev/data-center/mnt/:_volumes_xyz_conf_00593e1d-b674-4b00-a289-20bec06761c9 Queries: 1. Could you help us in creating a storage domain for the same from UI. 2. Do we have any process of doing the same using the CLI. Thanks and Regards Kushagra Gupta

1 0

Ovirt installation, deployment failed..
by John Bnet 20 Apr '23

20 Apr '23

Hi, I'm new to ovirt. I'm trying to get it up and running but I stuck at the deployement point. Can someone have any idea of what is going on? this is what i did to install on cent0s8 --> hostnamectl set-hostname node1.local.net vi /etc/hosts dnf install -y centos-release-ovirt45 dnf module enable -y javapackages-tools pki-deps postgresql:12 389-ds mod_auth_openidc dnf update dnf install ovirt-engine engine-setup dnf install cockpit-ovirt-dashboard vdsm-gluster ovirt-host systemctl enable cockpit.socket systemctl start cockpit.socket firewall-cmd --list-services firewall-cmd --permanent --add-service=cockpit hosted-engine --deploy an here is a part of the log output: 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/internalPackageTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:36,628-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/mainTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.packagers.yumpackager.Plugin._setup 2023-04-19 09:32:36,629-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.packagers.yumpackager.Plugin._setup condition False 2023-04-19 09:32:36,630-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.engine.fqdn.Plugin._setup 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=NoneType:'None' 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=NoneType:'None' 2023-04-19 09:32:36,631-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,632-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._setup 2023-04-19 09:32:36,633-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.gateway.Plugin._setup 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.network.network_check.Plugin._setup 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=NoneType:'None' 2023-04-19 09:32:36,634-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=NoneType:'None' 2023-04-19 09:32:36,635-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,635-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.gr_he_common.vm.cloud_init.Plugin._setup 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=NoneType:'None' 2023-04-19 09:32:36,636-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.network.firewalld.Plugin._setup 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=NoneType:'None' 2023-04-19 09:32:36,637-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=NoneType:'None' 2023-04-19 09:32:36,638-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,638-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.network.hostname.Plugin._setup 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.openrc.Plugin._setup 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc=NoneType:'None' 2023-04-19 09:32:36,639-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc-update=NoneType:'None' 2023-04-19 09:32:36,640-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,640-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.rhel.Plugin._setup 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/initctl=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=NoneType:'None' 2023-04-19 09:32:36,641-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=NoneType:'None' 2023-04-19 09:32:36,642-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,642-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.services.systemd.Plugin._setup 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.system.clock.Plugin._setup 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=NoneType:'None' 2023-04-19 09:32:36,643-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ntpq=NoneType:'None' 2023-04-19 09:32:36,644-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context._executeMethod:127 Stage setup METHOD otopi.plugins.otopi.system.reboot.Plugin._setup 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:36,645-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=NoneType:'None' 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:36,646-0400 INFO otopi.context context.runSequence:616 Stage: Environment packages setup 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context.runSequence:620 STAGE internal_packages 2023-04-19 09:32:36,646-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.core.transaction.Plugin._pre_prepare 2023-04-19 09:32:36,647-0400 DEBUG otopi.transaction transaction._prepare:61 preparing 'DNF Transaction' 2023-04-19 09:32:36,647-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Creating transaction 2023-04-19 09:32:38,583-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.gr_he_common.vm.boot_disk.Plugin._internal_packages 2023-04-19 09:32:38,584-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.vm.boot_disk.Plugin._internal_packages condition False 2023-04-19 09:32:38,585-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.packagers.dnfpackager.Plugin._internal_packages_end 2023-04-19 09:32:38,585-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Building transaction 2023-04-19 09:32:38,870-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Transaction built 2023-04-19 09:32:38,871-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Empty transaction 2023-04-19 09:32:38,872-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.packagers.yumpackager.Plugin._internal_packages_end 2023-04-19 09:32:38,872-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.packagers.yumpackager.Plugin._internal_packages_end condition False 2023-04-19 09:32:38,873-0400 DEBUG otopi.context context._executeMethod:127 Stage internal_packages METHOD otopi.plugins.otopi.core.transaction.Plugin._pre_end 2023-04-19 09:32:38,873-0400 DEBUG otopi.transaction transaction.commit:152 committing 'DNF Transaction' 2023-04-19 09:32:38,873-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Closing transaction with commit 2023-04-19 09:32:38,873-0400 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpackager.verbose:75 DNF Calling _plugins._unload 2023-04-19 09:32:38,927-0400 INFO otopi.context context.runSequence:616 Stage: Programs detection 2023-04-19 09:32:38,927-0400 DEBUG otopi.context context.runSequence:620 STAGE programs 2023-04-19 09:32:38,927-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._check_NM 2023-04-19 09:32:38,928-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.network.bridge.Plugin._check_NM condition False 2023-04-19 09:32:38,929-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.system.command.Plugin._programs 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=str:'/usr/sbin/chkconfig' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=str:'/usr/bin/chronyc' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=str:'/usr/bin/date' 2023-04-19 09:32:38,930-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=str:'/usr/bin/dig' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=str:'/usr/bin/firewall-cmd' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=str:'/usr/sbin/hwclock' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=str:'/usr/sbin/ip' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=str:'/usr/bin/nc' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=str:'/usr/sbin/ping' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=str:'/usr/bin/python3' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=str:'/usr/sbin/reboot' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=str:'/usr/sbin/service' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=str:'/usr/bin/ssh-keygen' 2023-04-19 09:32:38,931-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=str:'/usr/bin/systemctl' 2023-04-19 09:32:38,932-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:38,932-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.openrc.Plugin._programs 2023-04-19 09:32:38,933-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.rhel.Plugin._programs 2023-04-19 09:32:38,934-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show-environment'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,943-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show-environment'), rc=0 2023-04-19 09:32:38,944-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show-environment') stdout: LANG=en_US.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2023-04-19 09:32:38,944-0400 DEBUG otopi.plugins.otopi.services.rhel plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show-environment') stderr: 2023-04-19 09:32:38,945-0400 DEBUG otopi.context context._executeMethod:127 Stage programs METHOD otopi.plugins.otopi.services.systemd.Plugin._programs 2023-04-19 09:32:38,945-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show-environment'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show-environment'), rc=0 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show-environment') stdout: LANG=en_US.UTF-8 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show-environment') stderr: 2023-04-19 09:32:38,954-0400 DEBUG otopi.plugins.otopi.services.systemd systemd._programs:49 registering systemd provider 2023-04-19 09:32:38,955-0400 INFO otopi.context context.runSequence:616 Stage: Environment setup (late) 2023-04-19 09:32:38,955-0400 DEBUG otopi.context context.runSequence:620 STAGE late_setup 2023-04-19 09:32:38,956-0400 DEBUG otopi.context context._executeMethod:127 Stage late_setup METHOD otopi.plugins.gr_he_common.vm.boot_disk.Plugin._late_setup 2023-04-19 09:32:38,956-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.gr_he_common.vm.boot_disk.Plugin._late_setup condition False 2023-04-19 09:32:38,957-0400 INFO otopi.context context.runSequence:616 Stage: Environment customization 2023-04-19 09:32:38,957-0400 DEBUG otopi.context context.runSequence:620 STAGE customization 2023-04-19 09:32:38,958-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.network.firewalld.Plugin._customization 2023-04-19 09:32:38,958-0400 DEBUG otopi.plugins.otopi.services.systemd systemd.exists:85 check if service firewalld exists 2023-04-19 09:32:38,958-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:813 execute: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service'), executable='None', cwd='None', env=None 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service'), rc=0 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:921 execute-output: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service') stdout: LoadState=loaded 2023-04-19 09:32:38,968-0400 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'show', '-p', 'LoadState', 'firewalld.service') stderr: 2023-04-19 09:32:38,969-0400 DEBUG otopi.plugins.otopi.network.firewalld firewalld._get_firewalld_cmd_version:116 firewalld version: 0.9.3 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldAvailable=bool:'True' 2023-04-19 09:32:38,970-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:38,971-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.core.config.Plugin._customize1 2023-04-19 09:32:38,972-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._storage_start 2023-04-19 09:32:38,972-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,973-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND --== STORAGE CONFIGURATION ==-- 2023-04-19 09:32:38,973-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,974-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.otopi.dialog.cli.Plugin._customize 2023-04-19 09:32:38,974-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.cli.Plugin._customize condition False 2023-04-19 09:32:38,975-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._storage_end 2023-04-19 09:32:38,976-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.core.titles.Plugin._network_start 2023-04-19 09:32:38,976-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,976-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND --== HOST NETWORK CONFIGURATION ==-- 2023-04-19 09:32:38,977-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND 2023-04-19 09:32:38,978-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._detect_bridges 2023-04-19 09:32:38,979-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.gateway.Plugin._customization 2023-04-19 09:32:38,979-0400 DEBUG otopi.plugins.otopi.dialog.human human.queryString:174 query OVEHOSTED_GATEWAY 2023-04-19 09:32:38,979-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Please indicate the gateway IP address [10.3.3.1]: 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/gateway=str:'10.3.3.1' 2023-04-19 09:32:40,455-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/OVEHOSTED_GATEWAY=str:'10.3.3.1' 2023-04-19 09:32:40,456-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:40,456-0400 DEBUG otopi.context context._executeMethod:127 Stage customization METHOD otopi.plugins.gr_he_common.network.bridge.Plugin._customization 2023-04-19 09:32:40,456-0400 INFO otopi.plugins.gr_he_common.network.bridge bridge._customization:143 Checking available network interfaces: 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:198 ansible-playbook: cmd: ['/bin/ansible-playbook', '--module-path=/usr/share/ovirt-hosted-engine-setup/he_ansible', '--inventory=localhost,', '--extra-vars=@/tmp/tmppje659zg', '--tags=get_network_interfaces', '--skip-tags=always', '/usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml'] 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:199 ansible-playbook: out_path: /tmp/tmp4gk4pm6s 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:200 ansible-playbook: vars_path: /tmp/tmppje659zg 2023-04-19 09:32:40,457-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:201 ansible-playbook: env: {'LS_COLORS': 'rs=0:di=38;5;33:ln=38;5;51:mh=00:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=01;05;37;41:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;40:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.zst=38;5;9:*.tzst=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.wim=38;5;9:*.swm=38;5;9:*.dwm=38;5;9:*.esd=38; 5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.mjpg=38;5;13:*.mjpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.m4a=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.oga=38;5;45:*.opus=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'SSH_CONNECTION': '10.3.3.95 33474 10.3.3.55 22', 'LANG': 'en_CA.UTF-8', 'HISTCONTROL': 'ignoredups', 'GUESTFISH_RESTORE': '\\e[0m', 'HOSTNAME': 'node1.local.net', 'GUESTFISH_INIT': '\\e[1;34m', 'S_COLORS': 'auto', 'which_declare': 'declare -f', 'XDG_SESSION_ID': '4', 'USER': 'root', 'GUESTFISH_PS1': '\\[\\e[1;32m\\]><fs>\\[\\e[0;31m\\] ', 'SELINUX_ROLE_REQUESTED': '', 'PWD': '/root', 'SSH_ASKPASS': '/usr/libexec/openssh/gnome-ssh-askpass', 'HOME': '/root', 'SSH_CLIENT': '10.3.3.95 33474 22', 'SELINUX_LEVEL_REQUESTED': '', 'XDG_DATA_DIRS': '/root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share', 'SSH_TTY': '/dev/pts/0', 'MAIL': '/var/spool/mail/root', 'SHELL': '/bin/bash', 'TERM': 'xterm-256color', 'SELINUX_USE_CURRENT_RANGE': '', 'SHLVL': '1', 'PYTHONPATH': '/usr/share/ovirt-hosted-engine-setup/scripts/..:', 'LOGNAME': 'root', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/0/bus', 'XDG_RUNTIME_DIR': '/run/user/0', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin', 'GUESTFISH_OUTPUT': ' \\e[0m', 'DEBUGINFOD_URLS': 'https://debuginfod.centos.org/ ', 'HISTSIZE': '1000', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'BASH_FUNC_which%%': '() { ( alias;\n eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@\n}', 'OTOPI_EXECDIR': '/root', 'OTOPI_LOGFILE': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log', 'OTOPI_CALLBACK_OF': '/tmp/tmp4gk4pm6s', 'ANSIBLE_CALLBACKS_ENABLED': '1_otopi_json,2_ovirt_logger', 'ANSIBLE_STDOUT_CALLBACK': '1_otopi_json', 'HE_ANSIBLE_LOG_PATH': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-ansible-get_network_interfaces-20230419093240-wm9s2d.log'} 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:226 ansible-playbook rc: 250 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:233 ansible-playbook stdout: 2023-04-19 09:32:41,363-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:235 b'to see the full traceback, use -vvv\n' 2023-04-19 09:32:41,364-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:236 ansible-playbook stderr: 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"import name 'Callable' from 'collections'\n" 2023-04-19 09:32:41,364-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'(/usr/lib64/python3.11/collections/__init__.py)\n' 2023-04-19 09:32:41,365-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" 2023-04-19 09:32:41,365-0400 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-common/network/bridge.py", line 152, in _customization r = ah.run() File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 240, in run raise RuntimeError(_('Failed executing ansible-playbook')) RuntimeError: Failed executing ansible-playbook 2023-04-19 09:32:41,367-0400 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Environment customization': Failed executing ansible-playbook 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/error=bool:'True' 2023-04-19 09:32:41,367-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>)]' 2023-04-19 09:32:41,368-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:41,368-0400 INFO otopi.context context.runSequence:616 Stage: Clean up 2023-04-19 09:32:41,368-0400 DEBUG otopi.context context.runSequence:620 STAGE cleanup 2023-04-19 09:32:41,369-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.gr_he_ansiblesetup.core.misc.Plugin._cleanup 2023-04-19 09:32:41,369-0400 INFO otopi.plugins.gr_he_ansiblesetup.core.misc misc._cleanup:546 Cleaning temporary resources 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:198 ansible-playbook: cmd: ['/bin/ansible-playbook', '--module-path=/usr/share/ovirt-hosted-engine-setup/he_ansible', '--inventory=localhost,', '--extra-vars=@/tmp/tmptom_o0os', '--tags=final_clean', '--skip-tags=always', '/usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml'] 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:199 ansible-playbook: out_path: /tmp/tmpjo8dbijt 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:200 ansible-playbook: vars_path: /tmp/tmptom_o0os 2023-04-19 09:32:41,370-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:201 ansible-playbook: env: {'LS_COLORS': 'rs=0:di=38;5;33:ln=38;5;51:mh=00:pi=40;38;5;11:so=38;5;13:do=38;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=01;05;37;41:su=48;5;196;38;5;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex=38;5;40:*.tar=38;5;9:*.tgz=38;5;9:*.arc=38;5;9:*.arj=38;5;9:*.taz=38;5;9:*.lha=38;5;9:*.lz4=38;5;9:*.lzh=38;5;9:*.lzma=38;5;9:*.tlz=38;5;9:*.txz=38;5;9:*.tzo=38;5;9:*.t7z=38;5;9:*.zip=38;5;9:*.z=38;5;9:*.dz=38;5;9:*.gz=38;5;9:*.lrz=38;5;9:*.lz=38;5;9:*.lzo=38;5;9:*.xz=38;5;9:*.zst=38;5;9:*.tzst=38;5;9:*.bz2=38;5;9:*.bz=38;5;9:*.tbz=38;5;9:*.tbz2=38;5;9:*.tz=38;5;9:*.deb=38;5;9:*.rpm=38;5;9:*.jar=38;5;9:*.war=38;5;9:*.ear=38;5;9:*.sar=38;5;9:*.rar=38;5;9:*.alz=38;5;9:*.ace=38;5;9:*.zoo=38;5;9:*.cpio=38;5;9:*.7z=38;5;9:*.rz=38;5;9:*.cab=38;5;9:*.wim=38;5;9:*.swm=38;5;9:*.dwm=38;5;9:*.esd=38; 5;9:*.jpg=38;5;13:*.jpeg=38;5;13:*.mjpg=38;5;13:*.mjpeg=38;5;13:*.gif=38;5;13:*.bmp=38;5;13:*.pbm=38;5;13:*.pgm=38;5;13:*.ppm=38;5;13:*.tga=38;5;13:*.xbm=38;5;13:*.xpm=38;5;13:*.tif=38;5;13:*.tiff=38;5;13:*.png=38;5;13:*.svg=38;5;13:*.svgz=38;5;13:*.mng=38;5;13:*.pcx=38;5;13:*.mov=38;5;13:*.mpg=38;5;13:*.mpeg=38;5;13:*.m2v=38;5;13:*.mkv=38;5;13:*.webm=38;5;13:*.ogm=38;5;13:*.mp4=38;5;13:*.m4v=38;5;13:*.mp4v=38;5;13:*.vob=38;5;13:*.qt=38;5;13:*.nuv=38;5;13:*.wmv=38;5;13:*.asf=38;5;13:*.rm=38;5;13:*.rmvb=38;5;13:*.flc=38;5;13:*.avi=38;5;13:*.fli=38;5;13:*.flv=38;5;13:*.gl=38;5;13:*.dl=38;5;13:*.xcf=38;5;13:*.xwd=38;5;13:*.yuv=38;5;13:*.cgm=38;5;13:*.emf=38;5;13:*.ogv=38;5;13:*.ogx=38;5;13:*.aac=38;5;45:*.au=38;5;45:*.flac=38;5;45:*.m4a=38;5;45:*.mid=38;5;45:*.midi=38;5;45:*.mka=38;5;45:*.mp3=38;5;45:*.mpc=38;5;45:*.ogg=38;5;45:*.ra=38;5;45:*.wav=38;5;45:*.oga=38;5;45:*.opus=38;5;45:*.spx=38;5;45:*.xspf=38;5;45:', 'SSH_CONNECTION': '10.3.3.95 33474 10.3.3.55 22', 'LANG': 'en_CA.UTF-8', 'HISTCONTROL': 'ignoredups', 'GUESTFISH_RESTORE': '\\e[0m', 'HOSTNAME': 'node1.local.net', 'GUESTFISH_INIT': '\\e[1;34m', 'S_COLORS': 'auto', 'which_declare': 'declare -f', 'XDG_SESSION_ID': '4', 'USER': 'root', 'GUESTFISH_PS1': '\\[\\e[1;32m\\]><fs>\\[\\e[0;31m\\] ', 'SELINUX_ROLE_REQUESTED': '', 'PWD': '/root', 'SSH_ASKPASS': '/usr/libexec/openssh/gnome-ssh-askpass', 'HOME': '/root', 'SSH_CLIENT': '10.3.3.95 33474 22', 'SELINUX_LEVEL_REQUESTED': '', 'XDG_DATA_DIRS': '/root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share', 'SSH_TTY': '/dev/pts/0', 'MAIL': '/var/spool/mail/root', 'SHELL': '/bin/bash', 'TERM': 'xterm-256color', 'SELINUX_USE_CURRENT_RANGE': '', 'SHLVL': '1', 'PYTHONPATH': '/usr/share/ovirt-hosted-engine-setup/scripts/..:', 'LOGNAME': 'root', 'DBUS_SESSION_BUS_ADDRESS': 'unix:path=/run/user/0/bus', 'XDG_RUNTIME_DIR': '/run/user/0', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin', 'GUESTFISH_OUTPUT': ' \\e[0m', 'DEBUGINFOD_URLS': 'https://debuginfod.centos.org/ ', 'HISTSIZE': '1000', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'BASH_FUNC_which%%': '() { ( alias;\n eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@\n}', 'OTOPI_EXECDIR': '/root', 'OTOPI_LOGFILE': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log', 'OTOPI_CALLBACK_OF': '/tmp/tmpjo8dbijt', 'ANSIBLE_CALLBACKS_ENABLED': '1_otopi_json,2_ovirt_logger', 'ANSIBLE_STDOUT_CALLBACK': '1_otopi_json', 'HE_ANSIBLE_LOG_PATH': '/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-ansible-final_clean-20230419093241-7kk3yj.log'} 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:226 ansible-playbook rc: 250 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:233 ansible-playbook stdout: 2023-04-19 09:32:42,276-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:235 b'to see the full traceback, use -vvv\n' 2023-04-19 09:32:42,277-0400 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:236 ansible-playbook stderr: 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"import name 'Callable' from 'collections'\n" 2023-04-19 09:32:42,277-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b'(/usr/lib64/python3.11/collections/__init__.py)\n' 2023-04-19 09:32:42,278-0400 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:238 b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" 2023-04-19 09:32:42,278-0400 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/misc.py", line 547, in _cleanup r = ah.run() File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 240, in run raise RuntimeError(_('Failed executing ansible-playbook')) RuntimeError: Failed executing ansible-playbook 2023-04-19 09:32:42,279-0400 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Clean up': Failed executing ansible-playbook 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>), (<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef3bc4988>)]' 2023-04-19 09:32:42,280-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,281-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.otopi.dialog.answer_file.Plugin._generate_answer_file 2023-04-19 09:32:42,281-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFileContent=str:'# OTOPI answer file, generated by human dialog [environment:default] QUESTION/1/DEPLOY_PROCEED=str:yes QUESTION/1/FORCE_IP_PROCEED=str:yes QUESTION/1/OVEHOSTED_GATEWAY=str:10.3.3.1 QUESTION/1/TMUX_PROCEED=str:yes ' 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,282-0400 DEBUG otopi.context context._executeMethod:127 Stage cleanup METHOD otopi.plugins.gr_he_common.core.answerfile.Plugin._save_answers_at_cleanup 2023-04-19 09:32:42,283-0400 INFO otopi.plugins.gr_he_common.core.answerfile answerfile._save_answers:74 Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20230419093242.conf' 2023-04-19 09:32:42,284-0400 INFO otopi.context context.runSequence:616 Stage: Pre-termination 2023-04-19 09:32:42,284-0400 DEBUG otopi.context context.runSequence:620 STAGE pre-terminate 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context._executeMethod:127 Stage pre-terminate METHOD otopi.plugins.otopi.core.misc.Plugin._preTerminate 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:765 ENVIRONMENT DUMP - BEGIN 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/aborted=bool:'False' 2023-04-19 09:32:42,285-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/debug=int:'0' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/error=bool:'True' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exceptionInfo=list:'[(<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef2a2b908>), (<class 'RuntimeError'>, RuntimeError('Failed executing ansible-playbook',), <traceback object at 0x7fdef3bc4988>)]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/executionDirectory=str:'/root' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/exitCode=list:'[{'priority': 90001, 'code': 0}]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/log=bool:'True' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/pluginGroups=str:'otopi:gr-he-common:gr-he-ansiblesetup' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/pluginPath=str:'/usr/share/otopi/plugins:/usr/share/ovirt-hosted-engine-setup/scripts/../plugins' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV BASE/suppressEnvironmentKeys=list:'[]' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chkconfig=str:'/usr/sbin/chkconfig' 2023-04-19 09:32:42,286-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/chronyc=str:'/usr/bin/chronyc' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/date=str:'/usr/bin/date' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/dig=str:'/usr/bin/dig' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/firewall-cmd=str:'/usr/bin/firewall-cmd' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/hwclock=str:'/usr/sbin/hwclock' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/initctl=NoneType:'None' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ip=str:'/usr/sbin/ip' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/nc=str:'/usr/bin/nc' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ntpq=NoneType:'None' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ping=str:'/usr/sbin/ping' 2023-04-19 09:32:42,287-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/python3=str:'/usr/bin/python3' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/rc-update=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/reboot=str:'/usr/sbin/reboot' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/service=str:'/usr/sbin/service' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/ssh-keygen=str:'/usr/bin/ssh-keygen' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV COMMAND/systemctl=str:'/usr/bin/systemctl' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/configFileAppend=NoneType:'None' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/configFileName=str:'/etc/ovirt-hosted-engine-setup.conf' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/failOnPrioOverride=bool:'True' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/ignoreMissingBeforeAfter=bool:'True' 2023-04-19 09:32:42,288-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/internalPackageTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logDir=str:'/var/log/ovirt-hosted-engine-setup' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileHandle=TextIOWrapper:'<_io.TextIOWrapper name='/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log' mode='a' encoding='UTF-8'>' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileName=str:'/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFileNamePrefix=str:'ovirt-hosted-engine-setup' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilter=_MyLoggerFilter:'filter' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterKeys=list:'['OVEHOSTED_ENGINE/adminPassword', 'OVEHOSTED_VM/cloudinitRootPwd']' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterQuestions=list:'[]' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterQuestionsKeys=set:'set()' 2023-04-19 09:32:42,289-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logFilterRe=list:'[re.compile('\n BEGIN\\ PRIVATE\\ KEY\n (?P<filter>.*)\n END\\ PRIVATE\\ KEY\n ', re.DOTALL|re.VERBOSE)]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/logRemoveAtExit=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/mainTransaction=Transaction:'[DNF Transaction]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/modifiedFiles=list:'[]' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV CORE/randomizeEvents=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFile=NoneType:'None' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/answerFileContent=str:'# OTOPI answer file, generated by human dialog [environment:default] QUESTION/1/DEPLOY_PROCEED=str:yes QUESTION/1/FORCE_IP_PROCEED=str:yes QUESTION/1/OVEHOSTED_GATEWAY=str:10.3.3.1 QUESTION/1/TMUX_PROCEED=str:yes ' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/autoAcceptDefault=bool:'False' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/boundary=str:'--=451b80dc-996f-432e-9e4f-2b29ef6d1141=--' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/cliVersion=int:'1' 2023-04-19 09:32:42,290-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/customization=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV DIALOG/dialect=str:'human' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV INFO/PACKAGE_NAME=str:'otopi' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV INFO/PACKAGE_VERSION=str:'1.10.3' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldAvailable=bool:'True' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldDisableServices=list:'[]' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/firewalldEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/iptablesEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/iptablesRules=NoneType:'None' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshEnable=bool:'False' 2023-04-19 09:32:42,291-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshKey=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV NETWORK/sshUser=str:'' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/checkRequirements=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/deployProceed=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/enableKeycloak=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/etcAnswerFile=str:'/etc/ovirt-hosted-engine/answers.conf' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/forceIpProceed=str:'yes' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/localVMDir=NoneType:'None' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/memCheckRequirements=bool:'True' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/miscReached=bool:'False' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/nodeSetup=bool:'False' 2023-04-19 09:32:42,292-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/pauseonRestore=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/renewPKIonRestore=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/restoreFromFile=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/screenProceed=bool:'True' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/skipTTYCheck=bool:'False' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/tempDir=str:'/var/tmp' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_CORE/userAnswerFile=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/adminPassword=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/adminUsername=str:'admin@internal' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/appHostName=NoneType:'None' 2023-04-19 09:32:42,293-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/clusterName=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/datacenterName=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/enableHcGlusterService=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/enableLibgfapi=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/engineSetupTimeout=int:'1800' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/insecureSSL=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/interactiveAdminPassword=bool:'True' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_ENGINE/temporaryCertificate=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_FIRST_HOST/deployWithHE35Hosts=NoneType:'None' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_FIRST_HOST/skipSharedStorageAF=bool:'False' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/allowInvalidBondModes=bool:'False' 2023-04-19 09:32:42,294-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/bridgeIf=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/bridgeName=str:'ovirtmgmt' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/forceIPv4=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/forceIPv6=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/fqdn=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/fqdnReverseValidation=bool:'False' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/gateway=str:'10.3.3.1' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/host_name=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test_tcp_address=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/network_test_tcp_port=NoneType:'None' 2023-04-19 09:32:42,295-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NETWORK/refuseDeployingWithNM=bool:'False' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/destEmail=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/smtpPort=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/smtpServer=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_NOTIF/sourceEmail=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_SANLOCK/lockspaceName=str:'hosted-engine' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_SANLOCK/serviceName=str:'sanlock' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/LunID=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/blockDeviceSizeGB=NoneType:'None' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/discardSupport=bool:'False' 2023-04-19 09:32:42,296-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/domainType=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIDiscoverPassword=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIDiscoverUser=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortal=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalIPAddress=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalPassword=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalPort=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSIPortalUser=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/iSCSITargetName=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgDesc=str:'Hosted Engine Image' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgSizeGB=NoneType:'None' 2023-04-19 09:32:42,297-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/imgUUID=str:'6259993f-beb7-4c29-91a9-9570dd12ac8a' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/lockspaceImageUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/lockspaceVolumeUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/metadataImageUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/metadataVolumeUUID=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/mntOptions=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/nfsVersion=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/ovfSizeGB=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/storageDomainConnection=NoneType:'None' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/storageDomainName=str:'hosted_storage' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_STORAGE/volUUID=str:'1c68fc63-4512-418e-9949-075cd297f40e' 2023-04-19 09:32:42,298-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/kvmGid=int:'36' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/serviceName=str:'vdsmd' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/useSSL=bool:'True' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/vdscli=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VDSM/vdsmUid=int:'36' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/OpenScapProfileName=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/acceptDownloadEApplianceRPM=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceMem=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceVCpus=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applianceVersion=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/applyOpenScapProfile=NoneType:'None' 2023-04-19 09:32:42,299-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/automateVMShutdown=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cdromUUID=str:'b941c4c0-7966-400c-a9fd-b2a85c9a4c33' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudInitISO=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitExecuteEngineSetup=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitInstanceDomainName=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitInstanceHostName=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitRootPwd=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMDNS=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMETCHOSTS=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMStaticCIDR=NoneType:'None' 2023-04-19 09:32:42,300-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/cloudinitVMTZ=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/consoleUUID=str:'4b2ee9e8-a64e-4288-8672-95d080193230' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/emulatedMachine=str:'pc' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/enableFips=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/localVmUUID=str:'a729bb55-b00c-4d2f-a6b1-d7a3008539ee' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/maxVCpus=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/nicUUID=str:'1a061d6c-8a0d-4a80-ab69-cf67d9558586' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/ovfArchive=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/rootSshAccess=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/rootSshPubkey=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmCDRom=NoneType:'None' 2023-04-19 09:32:42,301-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmMACAddr=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmMemSizeMB=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV OVEHOSTED_VM/vmVCpus=NoneType:'None' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfDisabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfExpireCache=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfRollback=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/dnfpackagerEnabled=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/keepAliveInterval=int:'30' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumDisabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumEnabledPlugins=list:'[]' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumExpireCache=bool:'True' 2023-04-19 09:32:42,302-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumRollback=bool:'True' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV PACKAGER/yumpackagerEnabled=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/DEPLOY_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/FORCE_IP_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/OVEHOSTED_GATEWAY=str:'10.3.3.1' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV QUESTION/1/TMUX_PROCEED=str:'yes' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/clockMaxGap=int:'5' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/clockSet=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/commandPath=str:'/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/reboot=bool:'False' 2023-04-19 09:32:42,303-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/rebootAllow=bool:'True' 2023-04-19 09:32:42,304-0400 DEBUG otopi.context context.dumpEnvironment:775 ENV SYSTEM/rebootDeferTime=int:'10' 2023-04-19 09:32:42,304-0400 DEBUG otopi.context context.dumpEnvironment:779 ENVIRONMENT DUMP - END 2023-04-19 09:32:42,305-0400 DEBUG otopi.context context._executeMethod:127 Stage pre-terminate METHOD otopi.plugins.otopi.dialog.cli.Plugin._pre_terminate 2023-04-19 09:32:42,305-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.cli.Plugin._pre_terminate condition False 2023-04-19 09:32:42,305-0400 INFO otopi.context context.runSequence:616 Stage: Termination 2023-04-19 09:32:42,306-0400 DEBUG otopi.context context.runSequence:620 STAGE terminate 2023-04-19 09:32:42,306-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.gr_he_common.core.misc.Plugin._terminate 2023-04-19 09:32:42,306-0400 ERROR otopi.plugins.gr_he_common.core.misc misc._terminate:167 Hosted Engine deployment failed 2023-04-19 09:32:42,307-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Log file is located at 2023-04-19 09:32:42,307-0400 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230419093227-vu7nay.log 2023-04-19 09:32:42,308-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.dialog.human.Plugin._terminate 2023-04-19 09:32:42,313-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.dialog.machine.Plugin._terminate 2023-04-19 09:32:42,313-0400 DEBUG otopi.context context._executeMethod:136 otopi.plugins.otopi.dialog.machine.Plugin._terminate condition False 2023-04-19 09:32:42,314-0400 DEBUG otopi.context context._executeMethod:127 Stage terminate METHOD otopi.plugins.otopi.core.log.Plugin._terminate

2 1

Administration portal doesn't load.
by kushagra.gupta＠hsc.com 19 Apr '23

19 Apr '23

I have an odd situation: When I go to https://ovengine/manager-engine.com/webadmin/?locale=en_US after authentication passes... it shows the top banner of oVirt OPEN VIRTUALIZATION MANAGER and the Loading ... in the center. but never gets past that. I also followed the thread and tried opening the admin portal in the private/incognito mode but I still face the issue. I rebooted the hosted engine as well but I am still facing the same issue. When I trigger the above url, in the engine.log, following logs are created: 2023-04-19 12:09:37,535+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-14) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2023-04-19 12:09:37,581+05 INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-14) [4593247b] Running command: CreateUserSessionCommand internal: false. 2023-04-19 12:09:37,655+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [4593247b] EVENT_ID: USER_VDC_LOGIN(30), User admin@internal-authz connecting from '10.0.1.2' using session 'tmdEg3zM+kPrJudpmQr+ITRboP8CWKVDlKP4XmYiB2GDqgWfSRj2H/kpNd96JfEXOuB+CjBNz72FkLx5//77kg==' logged in. 2023-04-19 12:11:01,457+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Lock Acquired to object 'EngineLock:{exclusiveLocks='[7a49bb81-3c73-4119-8cb0-f3f6d88fafb9=PROVIDER]', sharedLocks=''}' 2023-04-19 12:11:01,463+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Running command: SyncNetworkProviderCommand internal: true. 2023-04-19 12:11:01,564+05 INFO [org.ovirt.engine.core.sso.service.AuthenticationService] (default task-6) [] User admin@internal-authz with profile [internal] successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2023-04-19 12:11:01,647+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-60) [1e895f1c] Lock freed to object 'EngineLock:{exclusiveLocks='[7a49bb81-3c73-4119-8cb0-f3f6d88fafb9=PROVIDER]', sharedLocks=''}' As you can see there are no error logs. But at the same time I am able to see some prior errors in the engine.log file: ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-96) [] Command 'HSMGetAllTasksStatusesVDSCommand(HostName = ovirt-host, VdsIdVDSCommandParametersBase:{hostId='b2137069-b4e7-4c16-91e1-7f889c62ab88'})' execution failed: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () ERROR [org.ovirt.engine.core.bll.pm.FenceProxyLocator] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-47) [1e63b6f1] Can not run fence action on host 'ovirt-host', no suitable proxy host was found. WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineSch eduledThreadPool-Thread-14) [14a0ecc4] EVENT_ID: SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_WITH_ERROR(987), Invalid status on Data Center Default . Setting Data Center status to Non Responsive (On host ovirt-host, Error: Network error during communication with the Host.). 2023-04-18 19:15:13,838+05 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connection timeout for host 'ovirt-hos t', last response arrived 22501 ms ago. ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedScheduledExecutorService-engineScheduledThrea dPool-Thread-45) [] Unable to GetStats: VDSNetworkException: VDSGenericException: VDSNetworkException: Broken pipe Also I can see that there is a connection between the ovirt-host and the hosted-engine: ==========================Hosted Engine===================================================== [root@manager-engine ovirt-engine]# netstat -anlp | grep 54321 tcp6 0 0 10.0.1.103:39944 10.0.1.101:54321 ESTABLISHED 2971/ovirt-engine tcp6 0 0 10.0.1.103:44234 10.0.1.101:54321 ESTABLISHED 2971/ovirt-engine [root@manager-engine ovirt-engine]# ===========================Ovirt-host======================================================== [root@ovirt-host ~]# netstat -anlp | grep 54321 tcp6 0 0 :::54321 :::* LISTEN 114608/python3 tcp6 0 0 ::1:54321 ::1:37428 ESTABLISHED 114608/python3 tcp6 0 0 ::1:54321 ::1:37414 ESTABLISHED 114608/python3 tcp6 0 0 10.0.1.101:54321 10.0.1.103:44234 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37428 ::1:54321 ESTABLISHED 105702/platform-pyt tcp6 0 0 ::1:54321 ::1:37416 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37416 ::1:54321 ESTABLISHED 114861/platform-pyt tcp6 0 0 10.0.1.101:54321 10.0.1.103:39944 ESTABLISHED 114608/python3 tcp6 0 0 ::1:37414 ::1:54321 ESTABLISHED 105491/platform-pyt [root@ovirt-host ~]# netstat -anlp | grep vdsm unix 2 [ ACC ] STREAM LISTENING 770058 96907/python3 /run/vdsm/svdsm.sock unix 2 [ ACC ] STREAM LISTENING 1223139 114861/platform-pyt /run/vdsm/mom-vdsm.sock unix 3 [ ] STREAM CONNECTED 1226522 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6903654 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1230271 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1230065 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6823534 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 6838191 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1224904 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1225672 96907/python3 /run/vdsm/svdsm.sock unix 3 [ ] STREAM CONNECTED 1214103 96907/python3 /run/vdsm/svdsm.sock [root@ovirt-host ~]# [root@ovirt-host ~]# systemctl status vdsmd.service ? vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: disabled) Active: active (running) since Tue 2023-04-18 19:15:08 IST; 16h ago Process: 114535 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 114608 (vdsmd) Tasks: 63 (limit: 48695) Memory: 122.2M CGroup: /system.slice/vdsmd.service tq114608 /usr/bin/python3 /usr/share/vdsm/vdsmd mq114826 /usr/libexec/ioprocess --read-pipe-fd 50 --write-pipe-fd 49 --max-threads 10 --max-queued-requests 10 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing network: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing network: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:03:35 ovirt-host vdsm[114608]: WARN Attempting to remove a non existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 09:13:34 ovirt-host vdsm[114608]: WARN Attempting to add an existing net user: ovirtmgmt/dcaa480a-068c-4030-ba9b-2baddc6de8c0 Apr 19 11:18:27 ovirt-host vdsm[114608]: ERROR ssl handshake: socket error, address: ::ffff:10.0.1.103 Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable. [root@ovirt-host ~]# Current netwoking: [root@ovirt-host ~]# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp2s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 48:4d:7e:a8:d8:73 brd ff:ff:ff:ff:ff:ff 3: enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff 4: enp0s20f0u6.408@enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovirtmgmt state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff 5: enp0s20f0u6.400@enp0s20f0u6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff inet6 abcd:abcd:abcd::17/64 scope global noprefixroute valid_lft forever preferred_lft forever inet6 fe80::1a7:ccb1:ae9b:9b8f/64 scope link noprefixroute valid_lft forever preferred_lft forever 38: ;vdsmdummy;: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether de:b4:76:ba:04:82 brd ff:ff:ff:ff:ff:ff 39: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 6e:94:55:f5:51:12 brd ff:ff:ff:ff:ff:ff 40: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether b6:96:23:82:d2:48 brd ff:ff:ff:ff:ff:ff 73: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 80:3f:5d:08:4f:7e brd ff:ff:ff:ff:ff:ff inet 10.0.1.101/24 brd 10.0.1.255 scope global noprefixroute ovirtmgmt valid_lft forever preferred_lft forever 90: vnet2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovirtmgmt state UNKNOWN group default qlen 1000 link/ether fe:16:3e:0d:0f:b9 brd ff:ff:ff:ff:ff:ff inet6 fe80::fc16:3eff:fe0d:fb9/64 scope link valid_lft forever preferred_lft forever [root@ovirt-host ~]# Could anyone please help me with this? I have tried re-installation as well but still no luck. Thanks and Regards Kushagra Gupta

2 1

vm has very slow write speed on posix compliant fs disk.
by arc＠b4restore.com 19 Apr '23

19 Apr '23

Hi, we have noticed that we get around 30MB/s of write speed per vm in oVirt on our datastore that is a GPFS filesystem mounted as posix compliant fs. Read speeds are around 1.5-3.3GB/s. We tested directly on the mount from the host cli with some benchmarking tools and from the host directly into the gpfs filesystem we get line speeds but from vms we dont.. does anybody have some clues to what is going on and what to try? Br Andi

1 0