April 2021 - Users - oVirt List Archives

snapshot solution: Existing snapshots that were taken after this one will be erased.
by dhanaraj.ramesh＠yahoo.com 29 Jan '25

29 Jan '25

Hi Team, when I want to commit the older snapshots I'm getting warning stating " Existing snapshots that were taken after this one will be erased.". is there any way we can retain the latest snapshots as is in the chain? I knew cloning and template export options are there to secure that latest snapshot data but these are will consume additional space in storage and take time.

4 3

Restart oVirt-Engine
by Jeremey Wise 09 Jan '25

09 Jan '25

How ,without reboot of hosting system, do I restart the oVirt engine? # I tried below but do not seem to effect the virtual machine [root@thor iso]# systemctl restart ov ovirt-ha-agent.service ovirt-imageio.service ovn-controller.service ovs-delete-transient-ports.service ovirt-ha-broker.service ovirt-vmconsole-host-sshd.service ovsdb-server.service ovs-vswitchd.service [root@thor iso]# # You cannot restart the VM " HostedEngine " as it responses: Error while executing action: HostedEngine: - Cannot restart VM. This VM is not managed by the engine. Reason is I had to do some work on a node. Reboot it.. it is back up.. network is all fine.. Cockpit working fine... and gluster fine.. But oVirt-Engine refuses to accept the node is up. -- p <jeremey.wise(a)gmail.com>enguinpages

4 4

SPM and Task error ...
by Enrico 22 Nov '24

22 Nov '24

Hi all, my ovirt cluster has got 3 Hypervisors runnig Centos 7.5.1804 vdsm is 4.20.39.1-1.el7, ovirt engine is 4.2.4.5-1.el7, the storage systems are HP MSA P2000 and 2050 (fibre channel). I need to stop one of the hypervisors for maintenance but this system is the storage pool manager. For this reason I decided to manually activate SPM in one of the other nodes but this operation is not successful. In the ovirt engine (engine.log) the error is this: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. while in the hypervisor (SPM) vdsm.log: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 *ERROR* [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::logEndTaskFailure: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended with failure: 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,751+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 34ae2b2f 2019-07-25 12:39:18,752+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 34ae2b2f 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::onTaskEndSuccess: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended successfully. 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 42de0c2b 2019-07-25 12:39:18,759+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 42de0c2b 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Fri May 03 14:48:50 CEST 2019' 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,765+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: da77af2 2019-07-25 12:39:18,766+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: da77af2 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned there is some relation between this error and a task that has remained hanging, from SPM server: # vdsm-client Task getInfo taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "verb": "prepareMerge", "id": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e" } # vdsm-client Task getStatus taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "message": "running job 1 of 1", "code": 0, "taskID": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e", "taskResult": "", "taskState": "running" } How can I solve this problem ? Thanks a lot for your help !! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it _______________________________________________________________________

5 15

How to re-enroll (or renew) host certificates for a single-host hosted-engine deployment?
by Derek Atkins 28 Jun '24

28 Jun '24

Hi, I've got a single-host hosted-engine deployment that I originally installed with 4.0 and have upgraded over the years to 4.3.10. I and some of my users have upgraded remote-viewer and now I get an error when I try to view the console of my VMs: (remote-viewer:8252): Spice-WARNING **: 11:30:41.806: ../subprojects/spice-common/common/ssl_verify.c:477:openssl_verify: Error in server certificate verification: CA signature digest algorithm too weak (num=68:depth0:/O=<My Org Name>/CN=<Host's Name>) I am 99.99% sure this is because the old certs use SHA1. I reran engine-setup on the engine and it asked me if I wanted to renew the PKI, and I answered yes. This replaced many[1] of the certificates in /etc/pki/ovirt-engine/certs on the engine, but it did not update the Host's certificate. All the documentation I've seen says that to refresh this certificate I need to put the host into maintenance mode and then re-enroll.. However I cannot do that, because this is a single-host system so I cannot put the host in local mode -- there is no place to migrate the VMs (let alone the Engine VM). So.... Is there a command-line way to re-enroll manually and update the host certs? Or some other way to get all the leftover certs renewed? Thanks, -derek [1] Not only did it not update the Host's cert, it did not update any of the vmconsole-proxy certs, nor the certs in /etc/pki/ovirt-vmconsole/, and obviously nothing in /etc/pki/ on the host itself. -- Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant

8 16

Changing disk QoS causes segfault with IO-Threads enabled (oVirt 4.3.0.4-1.el7)
by jloh＠squiz.net 23 Apr '24

23 Apr '24

We recently upgraded to 4.3.0 and have found that when changing disk QoS settings on VMs whilst IO-Threads is enabled causes them to segfault and the VM to reboot. We've been able to replicate this across several VMs. VMs with IO-Threads disabled/turned off do not segfault when changing the QoS. Mar 1 11:49:06 srvXX kernel: IO iothread1[30468]: segfault at fffffffffffffff8 ip 0000557649f2bd24 sp 00007f80de832f60 error 5 in qemu-kvm[5576498dd000+a03000] Mar 1 11:49:06 srvXX abrt-hook-ccpp: invalid number 'iothread1' Mar 1 11:49:11 srvXX libvirtd: 2019-03-01 00:49:11.116+0000: 13365: error : qemuMonitorIORead:609 : Unable to read from monitor: Connection reset by peer Happy to supply some more logs to someone if they'll help but just wondering whether anyone else has experienced this or knows of a current fix other than turning io-threads off. Cheers.

4 3

Deploy oVirt Engine fail behind proxy
by Matteo Bonardi 21 Mar '24

21 Mar '24

Hi, I am trying to deploy the ovirt engine following self-hosted engine installation procedure on documentation. Deployment servers are behind a proxy and I have set it in environment and in yum.conf before run deploy. Deploy fails because ovirt engine vm cannot resolve AppStream repository url: [ INFO ] TASK [ovirt.engine-setup : Install oVirt Engine package] [ ERROR ] fatal: [localhost -> ovirt-manager.mydomain]: FAILED! => {"changed": false, "msg": "Failed to download metadata for repo 'AppStream': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for http://mirrorlist.centos.org/?release=8&arch=x86_64&repo=AppStream&infra=st… [Could not resolve host: mirrorlist.centos.org]", "rc": 1, "results": []} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Clean local storage pools] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ he_local_vm_dir | basename }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Destroy local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] TASK [ovirt.hosted_engine_setup : Undefine local storage-pool {{ local_vm_disk_path.split('/')[5] }}] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20201109165237.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20201109164244-b3e8sd.log How I can set proxy for the engine vm? Ovirt version: [root@myhost ~]# rpm -qa | grep ovirt-engine-appliance ovirt-engine-appliance-4.4-20200916125954.1.el8.x86_64 [root@myhost ~]# rpm -qa | grep ovirt-hosted-engine-setup ovirt-hosted-engine-setup-2.4.6-1.el8.noarch OS version: [root@myhost ~]# cat /etc/centos-release CentOS Linux release 8.2.2004 (Core) [root@myhost ~]# uname -a Linux myhost.mydomain 4.18.0-193.28.1.el8_2.x86_64 #1 SMP Thu Oct 22 00:20:22 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux Thanks for the help. Regards, Matteo

7 20

Unable to install oVirt on RHEL7.5
by SS00514758＠techmahindra.com 05 Jan '24

05 Jan '24

Hi All, I am unable to install oVirt on RHEL7.5, to install it I am taking reference of below link, https://www.ovirt.org/documentation/install-guide/chap-Installing_oVirt.html But though it is not working for me, couple of dependencies is not getting installed, and because of this I am not able to run the ovirt-engine, below are the depencies packages that unable to install, Error: Package: collectd-write_http-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) Requires: collectd(x86-64) = 5.8.0-6.1.el7 Removing: collectd-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-6.1.el7 Updated By: collectd-5.8.1-1.el7.x86_64 (epel) collectd(x86-64) = 5.8.1-1.el7 Available: collectd-5.7.2-1.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-1.el7 Available: collectd-5.7.2-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-3.el7 Available: collectd-5.8.0-2.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-2.el7 Available: collectd-5.8.0-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-3.el7 Available: collectd-5.8.0-5.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-5.el7 Help me to install this. Looking forward to resolve this issue. Regards Sumit Sahay

6 8

Re: Failed to synchronize networks of Provider ovirt-provider-ovn
by Mail SET Inc. Group 27 Oct '23

27 Oct '23

Yes, i use same manual to change WebUI SSL. ovirt-ca-file= is a same SSL file which use WebUI. Yes, i restart ovirt-provider-ovn, i restart engine, i restart all what i can restart. Nothing... > 12 сент. 2018 г., в 16:11, Dominik Holler <dholler(a)redhat.com> написал(а): > > On Wed, 12 Sep 2018 14:23:54 +0300 > "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: > >> Ok! > > Not exactly, please use users(a)ovirt.org for such questions. > Other should benefit from this questions, too. > Please write the next mail to users(a)ovirt.org and keep me in CC. > >> What i did: >> >> 1) install oVirt «from box» (4.2.5.2-1.el7); >> 2) generate own ssl for my engine using my FreeIPA CA, Install it and > > What means "Install it"? You can use the doc from the following link > https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… > > Ensure that ovirt-ca-file= in > /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf > points to the correct file and ovirt-provider-ovn is restarted. > >> get tis issue; >> >> >> [root@engine ~]# tail -n 50 /var/log/ovirt-provider-ovn.log >> 2018-09-12 14:10:23,828 root [SSL: CERTIFICATE_VERIFY_FAILED] >> certificate verify failed (_ssl.c:579) Traceback (most recent call >> last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", >> line 133, in _handle_request method, path_parts, content >> File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", >> line 175, in handle_request return >> self.call_response_handler(handler, content, parameters) File >> "/usr/share/ovirt-provider-ovn/handlers/keystone.py", line 33, in >> call_response_handler return response_handler(content, parameters) >> File "/usr/share/ovirt-provider-ovn/handlers/keystone_responses.py", >> line 62, in post_tokens user_password=user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 26, in >> create_token return auth.core.plugin.create_token(user_at_domain, >> user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/plugin.py", line >> 48, in create_token timeout=self._timeout()) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 75, >> in create_token username, password, engine_url, ca_file, timeout) >> File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line >> 91, in _get_sso_token timeout=timeout File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, >> in wrapper response = func(*args, **kwargs) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, >> in wrapper raise BadGateway(e) BadGateway: [SSL: >> CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) >> >> >> [root@engine ~]# tail -n 20 /var/log/ovirt-engine/engine.log >> 2018-09-12 14:10:23,773+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:10:23,778+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:10:23,836+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:10:23,837+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:14:12,477+03 INFO >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default >> task-6) [] User admin@internal successfully logged in with scopes: >> ovirt-app-admin ovirt-app-api ovirt-app-portal >> ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all >> ovirt-ext=token-info:authz-search >> ovirt-ext=token-info:public-authz-search >> ovirt-ext=token-info:validate ovirt-ext=token:password-access >> 2018-09-12 14:14:12,587+03 INFO >> [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default >> task-6) [1bf1b763] Running command: CreateUserSessionCommand >> internal: false. 2018-09-12 14:14:12,628+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [1bf1b763] EVENT_ID: USER_VDC_LOGIN(30), User >> admin@internal-authz connecting from '10.0.3.61' using session >> 's8jAm7BUJGlicthm6yZBA3CUM8QpRdtwFaK3M/IppfhB3fHFB9gmNf0cAlbl1xIhcJ2WX+ww7e71Ri+MxJSsIg==' >> logged in. 2018-09-12 14:14:30,972+03 INFO >> [org.ovirt.engine.core.bll.provider.ImportProviderCertificateCommand] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] Running >> command: ImportProviderCertificateCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:30,982+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] EVENT_ID: >> PROVIDER_CERTIFICATE_IMPORTED(213), Certificate for provider >> ovirt-provider-ovn was imported. (User: admin@internal-authz) >> 2018-09-12 14:14:31,006+03 INFO >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Running >> command: TestProviderConnectivityCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:31,058+03 ERROR >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Command >> 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'default' is using 0 threads out of 1, 5 threads waiting for >> tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engine' is using 0 threads out of 500, 16 threads waiting for >> tasks and 0 tasks in queue. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineScheduled' is using 0 threads out of 100, 100 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads >> waiting for tasks. 2018-09-12 14:15:23,843+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:15:23,849+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:15:23,900+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:23,901+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' >> >> >> [root@engine ~]# >> cat /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf # >> This file is automatically generated by engine-setup. Please do not >> edit manually [OVN REMOTE] ovn-remote=ssl:127.0.0.1:6641 >> [SSL] >> https-enabled=true >> ssl-cacert-file=/etc/pki/ovirt-engine/ca.pem >> ssl-cert-file=/etc/pki/ovirt-engine/certs/ovirt-provider-ovn.cer >> ssl-key-file=/etc/pki/ovirt-engine/keys/ovirt-provider-ovn.key.nopass >> [OVIRT] >> ovirt-sso-client-secret=Ms7Gw9qNT6IkXu7oA54tDmxaZDIukABV >> ovirt-host=https://engine.set.local:443 >> ovirt-sso-client-id=ovirt-provider-ovn >> ovirt-ca-file=/etc/pki/ovirt-engine/apache-ca.pem >> [PROVIDER] >> provider-host=engine.set.local >> >> >>> 12 сент. 2018 г., в 13:59, Dominik Holler <dholler(a)redhat.com> >>> написал(а): >>> >>> On Wed, 12 Sep 2018 13:04:53 +0300 >>> "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: >>> >>>> Hello Dominik! >>>> I have a same issue with OVN provider and SSL >>>> https://www.mail-archive.com/users@ovirt.org/msg47020.html >>>> <https://www.mail-archive.com/users@ovirt.org/msg47020.html> But >>>> certificate changes not helps to resolve it. Maybe you can help me >>>> with this? >>> >>> Sure. Can you please share the relevant lines of >>> ovirt-provider-ovn.log and engine.log, and the information if you >>> are using the certificates generated by engine-setup with >>> users(a)ovirt.org ? Thanks, >>> Dominik >>> >> > >

5 13

engine-setup failing on 4.3.2 -> 4.3.3 fails during Engine schema refresh fail
by Edward Berger 18 Jul '23

18 Jul '23

I was trying to upgrade a hyperconverged oVirt hosted engine and failed in the engine-setup command with these error and warnings. ... [ INFO ] Creating/refreshing Engine database schema [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0830_add_foreign_key_to_image_transfers.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed ... [ INFO ] Yum Verify: 16/16: ovirt-engine-tools.noarch 0:4.3.3.5-1.el7 - e [WARNING] Rollback of DWH database postponed to Stage "Clean up" [ INFO ] Rolling back database schema ... [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Attaching engine-setup logfile.

4 6

oVirt host deploy: disable multipath
by femi adegoke 27 Mar '23

27 Mar '23

https://bugzilla.redhat.com/show_bug.cgi?id=1472356 There are 2 drives in my install that oVirt is claiming as multipath. I have tried blacklisting at /etc/multipath/ but that hasn't worked. Any better solutions? I need these 2 drives to be non-multipathed.

4 19

Out-of-sync networks can only be detached
by Sakhi Hadebe 27 Feb '23

27 Feb '23

Hi, I have a 3-node oVirt cluster. I have configured 2 logical networks: ovirtmgmt and public. Public logical network is attached in only 2 nodes and failing to attach on the 3rd node with the below error Invalid operation, out-of-sync network 'public' can only be detached. Please have been stuck on this for almost the whole day now. How do I fix this error? -- Regards, Sakhi Hadebe

3 5

Network Address Change
by Paul.LKW 28 Dec '22

28 Dec '22

Hi All: I just has a case, I need to change the oVirt host and engine IP address due to data center decommission I checked in the hosted-engine host there are some files I could change ; in ovirt-hosted-engine/hosted-engine.conf ca_subject="O=simple.com, CN=1.2.3.4" gateway=1.2.3.254 and of course I need to change the ovirtmgmt interface IP too, I think just change the above line could do the tick, but where could I change the other host IP in the cluster ? I think I have to be lost all the host as once changed the hosted-engine host IP as it is in diff. sub net. Does there any command line tools could do that or someone has such experience could share? Best Regards, Paul.LKW

4 6

can't use vmconsole anymore
by Nathanaël Blanchet 13 Jun '22

13 Jun '22

Hi, I was used to use the vmconsole proxy, but since a while, I'm getting this issue (currently 4.4.5): # ssh -t -p 2222 ovirt-vmconsole(a)air.v100.abes.fr connect ovirt-vmconsole(a)air.v100.abes.fr: Permission denied (publickey). I found following in the engine.log 2021-04-15 17:55:43,094+02 ERROR [org.ovirt.engine.core.services.VMConsoleProxyServlet] (default task-4) [] Error validating ticket: : sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at java.base/sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141) at java.base/sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126) at java.base/java.security.cert.CertPathBuilder.build(CertPathBuilder.java:297) at org.ovirt.engine.core.uutils//org.ovirt.engine.core.uutils.crypto.CertificateChain.buildCertPath(CertificateChain.java:128) at org.ovirt.engine.core.uutils//org.ovirt.engine.core.uutils.crypto.ticket.TicketDecoder.decode(TicketDecoder.java:89) at deployment.engine.ear.services.war//org.ovirt.engine.core.services.VMConsoleProxyServlet.validateTicket(VMConsoleProxyServlet.java:175) at deployment.engine.ear.services.war//org.ovirt.engine.core.services.VMConsoleProxyServlet.doPost(VMConsoleProxyServlet.java:225) The user key is the good one, I use the same with my other engines and I can successfully connect to vm consoles. Thank you for helping -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

5 16

looking for some ISV backup software which integrates the backup API
by Nathanaël Blanchet 08 Jun '22

08 Jun '22

Hello, We are about to change our backup provider, and I find it is a great chance to choose a full supported ovirt backup solution. I currently use this python script vm-backup-scheduler (https://github.com/wefixit-AT/oVirtBackup) but it is not the workflow officially suggested by the community (https://www.ovirt.org/develop/release-management/features/storage/backup-re…) I've been looking for a long time an ISV who supports such an API, but the only one I found is this one : Acronis Backup Advanced suggested here https://access.redhat.com/ecosystem/search/#/ecosystem/Red%20Hat%20Enterpri… I ran the trial version, but it doesn't seem to do better than the vm-backup-scheduler script, and it doesn't seem to use the backup API (attach a clone as a disk to an existing vm). Can you suggest me some other ISV solutions, if they ever exist... or share me your backup experience?

5 4

VM HostedEngine is down with error
by souvaliotimaria＠mail.com 26 May '22

26 May '22

Hello everyone, I have a replica 2 + arbiter installation and this morning the Hosted Engine gave the following error on the UI and resumed on a different node (node3) than the one it was originally running(node1). (The original node has more memory than the one it ended up, but it had a better memory usage percentage at the time). Also, the only way I discovered the migration had happened and there was an Error in Events, was because I logged in the web interface of ovirt for a routine inspection. Βesides that, everything was working properly and still is. The error that popped is the following: VM HostedEngine is down with error. Exit message: internal error: qemu unexpectedly closed the monitor: 2020-09-01T06:49:20.749126Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config, ability to start up with partial NUMA mappings is obsoleted and will be removed in future 2020-09-01T06:49:20.927274Z qemu-kvm: -device virtio-blk-pci,iothread=iothread1,scsi=off,bus=pci.0,addr=0x7,drive=drive-ua-d5de54b6-9f8e-4fba-819b-ebf6780757d2,id=ua-d5de54b6-9f8e-4fba-819b-ebf6780757d2,bootindex=1,write-cache=on: Failed to get "write" lock Is another process using the image?. Which from what I could gather concerns the following snippet from the HostedEngine.xml and it's the virtio disk of the Hosted Engine: <disk type='file' device='disk' snapshot='no'> <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads' iothread='1'/> <source file='/var/run/vdsm/storage/80f6e393-9718-4738-a14a-64cf43c3d8c2/d5de54b6-9f8e-4fba-819b-ebf6780757d2/a48555f4-be23-4467-8a54-400ae7baf9d7'> <seclabel model='dac' relabel='no'/> </source> <target dev='vda' bus='virtio'/> <serial>d5de54b6-9f8e-4fba-819b-ebf6780757d2</serial> <alias name='ua-d5de54b6-9f8e-4fba-819b-ebf6780757d2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </disk> I've tried looking into the logs and the sar command but I couldn't find anything to relate with the above errors and determining the reason for it to happen. Is this a Gluster or a QEMU problem? The Hosted Engine was manually migrated five days before on node1. Is there a standard practice I could follow to determine what happened and secure my system? Thank you very much for your time, Maria Souvalioti

4 6

OVS switch type for hosted-engine
by Devin A. Bougie 06 May '22

06 May '22

Is it possible to setup a hosted engine using the OVS switch type instead of Legacy? If it's not possible to start out as OVS, instructions for switching from Legacy to OVS after the fact would be greatly appreciated. Many thanks, Devin

4 5

USB3 redirection
by Rik Theys 19 Apr '22

19 Apr '22

Hi, I'm trying to assign a USB3 controller to a CentOS 7.4 VM in oVirt 4.1 with USB redirection enabled. I've created the following file in /etc/ovirt-engine/osinfo.conf.d: 01-usb.properties with content os.other.devices.usb.controller.value = nec-xhci and have restarted ovirt-engine. If I disable USB-support in the web interface for the VM, the xhci controller is added to the VM (I can see it in the qemu-kvm commandline), but usb redirection is not available. If I enable USB-support in the UI, no xhci controller is added (only 4 uhci controllers). Is there a way to make the controllers for usb redirection xhci controllers? Regards, Rik -- Rik Theys System Engineer KU Leuven - Dept. Elektrotechniek (ESAT) Kasteelpark Arenberg 10 bus 2440 - B-3001 Leuven-Heverlee +32(0)16/32.11.07 ---------------------------------------------------------------- <<Any errors in spelling, tact or fact are transmission errors>>

3 5

OVN routing and firewalling in oVirt
by Gianluca Cecchi 19 Apr '22

19 Apr '22

Hello, how do we manage routing between different OVN networks in oVirt? And between OVN networks and physical ones? Based on architecture read here: http://openvswitch.org/support/dist-docs/ovn-architecture.7.html I see terms for logical routers and gateway routers respectively but how to apply to oVirt configuration? Do I have to choose between setting up a specialized VM or a physical one: is it applicable/advisable to put on oVirt host itself the gateway functionality? Is there any security policy (like security groups in Openstack) to implement? Thanks, Gianluca

4 6

Install hosted-engine - Task Get local VM IP failed
by florentl 10 Mar '22

10 Mar '22

Hi all, I try to install hosted-engine on node : ovirt-node-ng-4.2.3-0.20180518. Every times I get stuck on : [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 50, "changed": true, "cmd": "virsh -r net-dhcp-leases default | grep -i 00:16:3e:6c:5a:91 | awk '{ print $5 }' | cut -f1 -d'/'", "delta": "0:00:00.108872", "end": "2018-06-01 11:17:34.421769", "rc": 0, "start": "2018-06-01 11:17:34.312897", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} I tried with static IP Address and with DHCP but both failed. To be more specific, I installed three nodes, deployed glusterfs with the wizard. I'm in a nested virtualization environment for this lab (Vmware Esxi Hypervisor). My node IP is : 192.168.176.40 / and I want the hosted-engine vm has 192.168.176.43. Thanks, Florent

7 17

Host needs to be reinstalled after configuring power management
by Andrew DeMaria 02 Feb '22

02 Feb '22

Hi, I am running ovirt 4.3 and have found the following action item immediately after configuring power management for a host: Host needs to be reinstalled as important configuration changes were applied on it. The thing is - I've just freshly installed this host and it seems strange that I need to reinstall it. Is there a better way to install a host and configure power management without having to reinstall it after? Thanks, Andrew

4 3

Import an exported VM using Ansible
by paolo＠airaldi.it 25 Jan '22

25 Jan '22

Hello everybody! I'm trying to automate a copy of a VM from one Datacenter to another using an Ansible.playbook. I'm able to: - Create a snapshot of the source VM - create a clone from the snapshot - remove the snapshot - attach an Export Domain - export the clone to the Export Domain - remove the clone - detach the Export domain from the source Datacenter and attach to the destination. Unfortunately I cannot find a module to: - import the VM from the Export Domain - delete the VM image from the Export Domain. Any hint on how to do that? Thanks in advance. Cheers. Paolo PS: if someone is interested I can share the playbook.

4 3

did 4.3.9 reset bug https://bugzilla.redhat.com/show_bug.cgi?id=1590266
by kelley bryan 10 Jan '22

10 Jan '22

I am experiencing the error message in the ovirt-hosted-engine-setup-ansible-create_target_vm log {2020-05-06 14:15:30,024-0500 ERROR ansible failed {'status': 'FAILED', 'ansible_type': 'task', 'ansible_task': u"Fail if Engine IP is different from engine's he_fqdn resolved IP", 'ansible_result': u'type: <type \'dict\'>\nstr: {\'msg\': u"Engine VM IP address is while the engine\'s he_fqdn ovirt1-engine.kelleykars.org resolves to 192.168.122.2. If you are using DHCP, check your DHCP reservation configuration", \'changed\': False, \'_ansible_no_log\': False}', 'task_duration': 1, 'ansible_host': u'localhost', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml'}}:Q! The bug 1590266 says it should report the engine VM IP address xxx.xxx.xxx.xxx while the Engines he_fqdn is xxxxxxxxx I need to see what it thins is wrong as both dig fqdn engine name and dig -x ip return the correct information. Now this bug looks like it may play but I don't see the failed rediness check in the this log https://access.redhat.com/solutions/4462431 or is it because the vm fails or dies or ???

3 7

Lots of storage.MailBox.SpmMailMonitor
by Fabrice Bacchella 06 Jan '22

06 Jan '22

My vdsm log files are huge: -rw-r--r-- 1 vdsm kvm 1.8G Nov 22 11:32 vdsm.log And this is juste half an hour of logs: $ head -1 vdsm.log 2018-11-22 11:01:12,132+0100 ERROR (mailbox-spm) [storage.MailBox.SpmMailMonitor] mailbox 2 checksum failed, not clearing mailbox, clearing new mail (data='...lots of data', expected='\xa4\x06\x08\x00') (mailbox:612) I just upgraded vdsm: $ rpm -qi vdsm Name : vdsm Version : 4.20.43

3 5

How to renew vmconsole-proxy* certificates
by capelle＠labri.fr 19 Nov '21

19 Nov '21

Hi, Since a few weeks, we are not able to connect to the vmconsole proxy: $ ssh -t -p 2222 ovirt-vmconsole@ovirt ovirt-vmconsole@ovirt: Permission denied (publickey). Last successful login record: Mar 29 11:31:32 First login failure record: Mar 31 17:28:51 We tracked the issue to the following log in /var/log/ovirt-engine/engine.log: ERROR [org.ovirt.engine.core.services.VMConsoleProxyServlet] (default task-11) [] Error validating ticket: : sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target Indeed, certificate /etc/pki/ovirt-engine/certs/vmconsole-proxy-helper.cer and others did expire: -- # grep 'Not After' /etc/pki/ovirt-engine/certs/vmconsole-proxy-* /etc/pki/ovirt-engine/certs/vmconsole-proxy-helper.cer: Not After : Mar 31 13:18:44 2021 GMT /etc/pki/ovirt-engine/certs/vmconsole-proxy-host.cer: Not After : Mar 31 13:18:44 2021 GMT /etc/pki/ovirt-engine/certs/vmconsole-proxy-user.cer: Not After : Mar 31 13:18:44 2021 GMT -- But we did not manage to found how to renew them. Any advice ? -- Benoît

3 2

Snapshot and disk size allocation
by jorgevisentini＠gmail.com 28 Oct '21

28 Oct '21

Hello everyone. I would like to know how disk size and snapshot allocation works, because every time I create a new snapshot, it increases 1 GB in the VM's disk size, and when I remove the snap, that space is not returned to Domain Storage. I'm using the oVirt 4.3.10 How do I reprovision the VM disk? Thank you all.

5 7

How to renew an Ovirt host certificate (vdsmcert.pem) ?
by noua.toukourou＠uni.lu 19 Sep '21

19 Sep '21

Hi, I have an Ovirt host that the vdsmcert.pem expired. The problem is that host contains the self-hosted engine. How to renew the certificate without breaking the self-hosted engine ? Thanks,

3 3

oVirt 4.3 DWH with Grafana
by Vrgotic, Marko 14 Sep '21

14 Sep '21

Dear oVirt, We are currently running oVirt 4.3 and upgrade/migration to 4.4 won’t be possible for few more months. I am looking into guidelines, how to, for setting up Grafana using DataWarehouse as data source. Did anyone already did this, and would be willing to share the steps? Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

8 11

Template for Ubuntu 18.04 Server Issues
by jeremy_tourville＠hotmail.com 02 Sep '21

02 Sep '21

I have built a system as a template on oVirt. Specifically, Ubuntu 18.04 server. I am noticing an issue when creating new vms from that template. I used the check box for "seal template" when creating the template. When I create a new Ubuntu VM I am getting duplicate IP addresses for all the machines created from the template. It seems like the checkbox doesn't fully function as intended. I would need to do further manual steps to clear up this issue. Has anyone else noticed this behavior? Is this expected or have I missed something? Thanks for your input!

6 7

Restored engine backup: The provided authorization grant for the auth code has expired.
by Nicolás 05 Aug '21

05 Aug '21

Hi, I'm restoring a full ovirt engine backup, having used the --scope=all option, for oVirt 4.3. I restored the backup on a fresh CentOS7 machine. The process went well, but when trying to log into the restored authentication system I get the following message which won't allow me to log in: The provided authorization grant for the auth code has expired. What does that mean and how can it be fixed? Thanks. Nicolás

4 10

Removing Direct Mapped LUNs
by Ryan Chewning 16 Jul '21

16 Jul '21

Hi List, We need to add and remove directly mapped LUNs to multiple VMs in our Non-Production environment. The environment is backed by an iSCSI SAN. In testing when removing a directly mapped LUN it doesn't remove the underlying multipath and devices. Several questions. 1) Is this the expected behavior? 2) Are we supposed to go to each KVM host and manually remove the underlying multipath devices? 3) Is there a technical reason that oVirt doesn't do this as part of the steps to removing the storage? This is something that was handled by the manager in the previous virtualization that we used, Oracle's Xen based Oracle VM. Thanks! Ryan

5 11

Re: How to Upgrade Node with Local Storage ?
by Vojtech Juranek 06 Jul '21

06 Jul '21

On Wednesday, 21 April 2021 16:40:29 CEST Nur Imam Febrianto wrote: > Set global maintenance and then turn off all vm, do yum update but it > completed with failed. Am I missing something ? can you share the details? What failed, wthat was the error? > From: Adam Xu<mailto:adam_xu@adagene.com.cn> > Sent: 20 April 2021 7:36 > To: users(a)ovirt.org<mailto:users@ovirt.org> > Subject: [ovirt-users] Re: How to Upgrade Node with Local Storage ? > > > For oVirt Node that using Local Storage, I think you should shutdown all > your vms before you upgrade the Node. 在 2021/4/19 22:09, Nur Imam Febrianto > 写道: > Hi, > > How we can upgrade oVirt Node that using Local Storage ? Seems I cant find > any good documentation about this. Planning to upgrade one 4.4.4 node with > local storage to 4.4.5. > Thanks before. > > Regards, > Nur Imam Febrianto > > > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> > > To unsubscribe send an email to > users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> > > Privacy Statement: > https://www.ovirt.org/privacy-policy.html<https://apac01.safelinks.protecti > on.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fprivacy-policy.html&data=0 > 4%7C01%7C%7C2817620cd2134104f81908d90394654e%7C84df9e7fe9f640afb435aaaaaaaaa > aaa%7C1%7C0%7C637544758156873163%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDA > iLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=VV663qDHl6C24C0 > XTZLoUF4n%2Bm4umP4dkG1EsKS895E%3D&reserved=0> > > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/<https://apac01. > safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fcommunit > y%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7C%7C2817620cd2134104f81908 > d90394654e%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637544758156883118%7 > CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiL > CJXVCI6Mn0%3D%7C1000&sdata=XF1vC3JCyVjQCsD1x%2FDQinfKOImw5VJbZIryDg9sKKg%3D& > reserved=0> > > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZOCHCAJPXO4LT > IMA4JHK3WMR5CTKR37C/<https://apac01.safelinks.protection.outlook.com/?url=ht > tps%3A%2F%2Flists.ovirt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage% > 2FZOCHCAJPXO4LTIMA4JHK3WMR5CTKR37C%2F&data=04%7C01%7C%7C2817620cd2134104f819 > 08d90394654e%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637544758156883118 > %7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWw > iLCJXVCI6Mn0%3D%7C1000&sdata=raH9RGOWlZIWlj%2FCWFJUbqI94y0U2TR9lUukXhzi2B8%3 > D&reserved=0>

3 2

Libgfapi considerations
by Jayme 01 Jul '21

01 Jul '21

Are there currently any known issues with using libgfapi in the latest stable version of ovirt in hci deployments? I have recently enabled it and have noticed a significant (over 4x) increase in io performance on my vms. I’m concerned however since it does not seem to be an ovirt default setting. Is libgfapi considered safe and stable to use in ovirt 4.3 hci?

9 16

Grafana oVirt 4.4.4 Node install - Grafana Monitoring Portal not available
by simon＠justconnect.ie 22 Jun '21

22 Jun '21

Having installed oVirt 4.4.4 HCI 3 node cluster, the Grafana 'Monitoring Portal' was not visible on the Default page. It appears that Grafana is installed but not configured. I have checked a 4.4.3 environment and it is installed and running, so is this a bug with 4.4.4.7-1.el8? Any help would be appreciated.

4 9

Re: Parent checkpoint ID does not match the actual leaf checkpoint
by Nir Soffer 27 May '21

27 May '21

On Sun, Jul 19, 2020 at 5:38 PM Łukasz Kołaciński <l.kolacinski(a)storware.eu> wrote: > Hello, > Thanks to previous answers, I was able to make backups. Unfortunately, we > had some infrastructure issues and after the host reboots new problems > appeared. I am not able to do any backup using the commands that worked > yesterday. I looked through the logs and there is something like this: > > 2020-07-17 15:06:30,644+02 ERROR > [org.ovirt.engine.core.bll.StartVmBackupCommand] > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-54) > [944a1447-4ea5-4a1c-b971-0bc612b6e45e] Failed to execute VM backup > operation 'StartVmBackup': {}: > org.ovirt.engine.core.common.errors.EngineException: EngineException: > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: > VDSGenericException: VDSErrorException: Failed to StartVmBackupVDS, error = > Checkpoint Error: {'parent_checkpoint_id': None, 'leaf_checkpoint_id': > 'cd078706-84c0-4370-a6ec-654ccd6a21aa', 'vm_id': > '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'reason': '*Parent checkpoint ID > does not match the actual leaf checkpoint*'}, code = 1610 (Failed with > error unexpected and code 16) > > It looks like engine sent: parent_checkpoint_id: None This issue was fix in engine few weeks ago. Which engine and vdsm versions are you testing? > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2114) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.performVmBackupOperation(StartVmBackupCommand.java:368) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.runVmBackup(StartVmBackupCommand.java:225) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.performNextOperation(StartVmBackupCommand.java:199) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback.childCommandsExecutionEnded(SerialChildCommandsExecutionCallback.java:32) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.ChildCommandsCallbackBase.doPolling(ChildCommandsCallbackBase.java:80) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethodsImpl(CommandCallbacksPoller.java:175) > at > deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethods(CommandCallbacksPoller.java:109) > at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > at > java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) > at > org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) > at > org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:834) > at > org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) > > > And the last error is: > > 2020-07-17 15:13:45,835+02 ERROR > [org.ovirt.engine.core.bll.StartVmBackupCommand] > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-14) > [f553c1f2-1c99-4118-9365-ba6b862da936] Failed to execute VM backup > operation 'GetVmBackupInfo': {}: > org.ovirt.engine.core.common.errors.EngineException: EngineException: > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: > VDSGenericException: VDSErrorException: Failed to GetVmBackupInfoVDS, error > = No such backup Error: {'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', > 'backup_id': 'bf1c26f7-c3e5-437c-bb5a-255b8c1b3b73', 'reason': '*VM > backup not exists: Domain backup job id not found: no domain backup job > present'*}, code = 1601 (Failed with error unexpected and code 16) > > This is likely a result of the first error. If starting backup failed the backup entity is deleted. > (these errors are from full backup) > > Like I said this is very strange because everything was working correctly. > > > Regards > > Łukasz Kołaciński > > Junior Java Developer > > e-mail: l.kolacinski(a)storware.eu > <m.helbert(a)storware.eu> > > > > > *[image: STORWARE]* <http://www.storware.eu/> > > > > *ul. Leszno 8/44 01-192 Warszawa www.storware.eu > <https://www.storware.eu/>* > > *[image: facebook]* <https://www.facebook.com/storware> > > *[image: twitter]* <https://twitter.com/storware> > > *[image: linkedin]* <https://www.linkedin.com/company/storware> > > *[image: Storware_Stopka_09]* > <https://www.youtube.com/channel/UCKvLitYPyAplBctXibFWrkw> > > > > *Storware Spółka z o.o. nr wpisu do ewidencji KRS dla M.St. Warszawa > 000510131* *, NIP 5213672602.** Wiadomość ta jest przeznaczona jedynie > dla osoby lub podmiotu, który jest jej adresatem i może zawierać poufne > i/lub uprzywilejowane informacje. Zakazane jest jakiekolwiek przeglądanie, > przesyłanie, rozpowszechnianie lub inne wykorzystanie tych informacji lub > podjęcie jakichkolwiek działań odnośnie tych informacji przez osoby lub > podmioty inne niż zamierzony adresat. Jeżeli Państwo otrzymali przez > pomyłkę tę informację prosimy o poinformowanie o tym nadawcy i usunięcie > tej wiadomości z wszelkich komputerów. **This message is intended only > for the person or entity to which it is addressed and may contain > confidential and/or privileged material. Any review, retransmission, > dissemination or other use of, or taking of any action in reliance upon, > this information by persons or entities other than the intended recipient > is prohibited. If you have received this message in error, please contact > the sender and remove the material from all of your computer systems.* > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/S3PLYPOZGT6TL… >

3 4

What software used to take forever incremental backup from VM?
by annieblackwell77＠gmail.com 24 May '21

24 May '21

Hi there, I want forever incremental backup for over 150+ virtual machines inside oVirt to save more backup space, then restore in case some problem occurs, any good advice?

8 9

Gluster volumes not healing (perhaps after host maintenance?)
by David White 18 May '21

18 May '21

I discovered that the servers I purchased did not come with 10Gbps network cards, like I thought they did. So my storage network has been running on a 1Gbps connection for the past week, since I deployed the servers into the datacenter a little over a week ago. I purchased 10Gbps cards, and put one of my hosts into maintenance mode yesterday, prior to replacing the daughter card. It is now back online running fine on the 10Gbps card. All VMs seem to be working, even when I migrate them onto cha2, which is the host I did maintenance on yesterday morning. The other two hosts are still running on the 1Gbps connection, but I plan to do maintenance on them next week. The oVirt manager shows that all 3 hosts are up, and that all of my volumes - and all of my bricks - are up. However, every time I look at the storage, it appears that the self-heal info for 1 of the volumes is 10 minutes, and the self-heal info for another volume is 50+ minutes. This morning is the first time in the last couple of days that I've paid close attention to the numbers, but I don't see them going down. When I log into each of the hosts, I do see everything is connected in gluster. It is interesting to me, in this particular case, though that gluster on cha3 notices the hostname of 10.1.0.10 to be the IP address, and not the hostname (cha1). The host that I did the maintenance on is cha2. [root@cha3-storage dwhite]# gluster peer statusNumber of Peers: 2Hostname: 10.1.0.10Uuid: 87a4f344-321a-48b9-adfb-e3d2b56b8e7bState: Peer in Cluster (Connected)Hostname: cha2-storage.mgt.barredowlweb.comUuid: 93e12dee-c37d-43aa-a9e9-f4740b9cab14State: Peer in Cluster (Connected) When I run `gluster volume heal data`, I see the following: [root@cha3-storage dwhite]# gluster volume heal data Launching heal operation to perform index self heal on volume data has been unsuccessful: Commit failed on cha2-storage.mgt.barredowlweb.com. Please check log file for details. I get the same results if I run the command on cha2, for any volume: [root@cha2-storage dwhite]# gluster volume heal data Launching heal operation to perform index self heal on volume data has been unsuccessful: Glusterd Syncop Mgmt brick op 'Heal' failed. Please check glustershd log file for details. [root@cha2-storage dwhite]# gluster volume heal vmstore Launching heal operation to perform index self heal on volume vmstore has been unsuccessful: Glusterd Syncop Mgmt brick op 'Heal' failed. Please check glustershd log file for details. I see a lot of stuff like this on cha2 /var/log/glusterfs/glustershd.log: [2021-04-24 11:33:01.319888] I [rpc-clnt.c:1975:rpc_clnt_reconfig] 2-engine-client-0: changing port to 49153 (from 0)[2021-04-24 11:33:01.329463] I [MSGID: 114057] [client-handshake.c:1128:select_server_supported_programs] 2-engine-client-0: Using Program [{Program-name=GlusterFS 4.x v1}, {Num=1298437}, {Version=400}][2021-04-24 11:33:01.330075] W [MSGID: 114043] [client-handshake.c:727:client_setvolume_cbk] 2-engine-client-0: failed to set the volume [{errno=2}, {error=No such file or directory}][2021-04-24 11:33:01.330116] W [MSGID: 114007] [client-handshake.c:752:client_setvolume_cbk] 2-engine-client-0: failed to get from reply dict [{process-uuid}, {errno=22}, {error=Invalid argument}][2021-04-24 11:33:01.330140] E [MSGID: 114044] [client-handshake.c:757:client_setvolume_cbk] 2-engine-client-0: SETVOLUME on remote-host failed [{remote-error=Brick not found}, {errno=2}, {error=No such file or directory}][2021-04-24 11:33:01.330155] I [MSGID: 114051] [client-handshake.c:879:client_setvolume_cbk] 2-engine-client-0: sending CHILD_CONNECTING event [][2021-04-24 11:33:01.640480] I [rpc-clnt.c:1975:rpc_clnt_reconfig] 3-vmstore-client-0: changing port to 49154 (from 0)The message "W [MSGID: 114007] [client-handshake.c:752:client_setvolume_cbk] 3-vmstore-client-0: failed to get from reply dict [{process-uuid}, {errno=22}, {error=Invalid argument}]" repeated 4 times between [2021-04-24 11:32:49.602164] and [2021-04-24 11:33:01.649850][2021-04-24 11:33:01.649867] E [MSGID: 114044] [client-handshake.c:757:client_setvolume_cbk] 3-vmstore-client-0: SETVOLUME on remote-host failed [{remote-error=Brick not found}, {errno=2}, {error=No such file or directory}][2021-04-24 11:33:01.649969] I [MSGID: 114051] [client-handshake.c:879:client_setvolume_cbk] 3-vmstore-client-0: sending CHILD_CONNECTING event [][2021-04-24 11:33:01.650095] I [MSGID: 114018] [client.c:2225:client_rpc_notify] 3-vmstore-client-0: disconnected from client, process will keep trying to connect glusterd until brick's port is available [{conn-name=vmstore-client-0}] How do I further troubleshoot? Sent with ProtonMail Secure Email.

3 5

poweroff and reboot with ovirt_vm ansible module
by Nathanaël Blanchet 18 May '21

18 May '21

Hello, is there a way to poweroff or reboot (without stopped and running state) a vm with the ovirt_vm ansible module? -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

7 11

[OLVM] Host non responsive after installation
by alan＠softdrive.co 12 May '21

12 May '21

I am using Oracle Linux Virtualization Manager, following this guide: https://docs.oracle.com/en/virtualization/oracle-linux-virtualization-manag… After adding a host to the engine, the host becomes non responsive due to network errors: engine.log 2021-04-27 14:53:02,255Z ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-32356) [38586e0e] Host installation failed for host 'c97604b3-5774-4260-92fd-633257aa7498', 'GPU2-2': Network error during communication with the host Help resolving this would be much appreciated!

4 9

Something broke & took down multiple VMs for ~20 minutes
by David White 12 May '21

12 May '21

As the subject suggestions, something in oVirt HCI broke. I have no idea what, and it recovered on its own after about 20 minutes or so. I believe that the issue was limited to a single host (although I don't know that for sure), as we had two VMs go completely unresponsive, but a 3rd VM remained operational. For a while during the outage, I was able to log into the oVirt admin web portal, and I noticed at least 1-2 of my hosts (I have 3 hosts) showed the problematic VMs as being problematic inside of oVirt. Reviewing the oVirt Events, I see that this basically started right when the ETL Service Started. There were no events before that point since yesterday, but right when the ETL Service started, it seems like all hell broke loose. oVirt detected "No faulty multipaths" on any of the hosts, but then very quickly started indicating that hosts, vms, and storage targets were unavailable. See my screenshot below. Around 30 - 35 minutes later, it appears that the Hosted Engine terminated due to a storage issue, and auto recovered on a different host. There's a 2nd screenshot beneath the first. Everything came back up shortly before 9am, and has been stable since. In fact, the Volume replication issues that I saw in my environment after I performed maintenance on 1 of my hosts on Friday are no longer present. It appears that the Hosted Engine sees the storage as being perfectly healthy. How do I even begin to figure out what happened, and try to prevent it from happening again? [Screenshot from 2021-04-26 16-36-47.png] [Screenshot from 2021-04-26 16-44-08.png] Sent with ProtonMail Secure Email.

2 7

pool list vm assign user
by Dominique D 11 May '21

11 May '21

Is there a way to know how to see who the vm of a pool assigned to? I am able on the portal to see those who are "logged-in user" but the others VM I don't know to whom they are assigned.

2 3

oVirt 2021 Spring survey questions
by Sandro Bonazzola 07 May '21

07 May '21

Hi, it's about the usual time of the year when we ask the community to provide feedback with a survey. Any questions you'd like to be asked? -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

9 16

error id 980
by ozmen62＠hotmail.com 04 May '21

04 May '21

Hi, First of all, thanks for this great list and the people who try to help eachother. This time my problem is about engine OVF file or engine storage setting. How can i came with this idea, because every 2-3 hours engine try to migrate other host(From host1 to host2) "Invalid status on Data Center B300. Setting status to Non Responsive." when i check hosts log , see these ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config.vm ERROR Failed extracting VM OVF from the OVF_STORE volume, falling back to initial vm.conf ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine ERROR Engine VM stopped on localhost ovirt-ha-agent ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore ERROR Unable to extract HEVM OVF i believe there is some kind of fc storage path or config problem. My storage setting is good. there is no error about them Is there anyone who experienced about that to solve it thanks

2 5

Cluster level 4.5
by Don Dupuis 03 May '21

03 May '21

What version of libvirt is required for a host to be put in this cluster level? I am using CentOS 8.3 and cpu is Cascade Lake Server. It says that my host is only compatible with cluster version 4.2,4.3 and 4.4. I am doing a new install of Ovirt 4.4.5. I have tried to update libvirt version but have run into issues. Currently installed libvirt is libvirt-6.0.0-28.module_el8.3.0+555+a55c8938.x86_64. Don

2 1

new engine restore from backup
by ozmen62＠hotmail.com 03 May '21

03 May '21

Hi, I've built e new engine and tried to restore from backup after run engine-setup it returns; [ ERROR ] Failed to execute stage 'Misc configuration': function getdwhhistorytimekeepingbyvarname(unknown) does not exist LINE 2: select * from GetDwhHistoryTimekeepingByVarName( redhat page says seploy new engine, but already done it. old and new engine are same version Do you have any idea how can i restore engine. There is no another backup

2 4

How to assign a server disk and nic profile via REST API?
by ovirt.org＠nevim.eu 02 May '21

02 May '21

Hello to everybody, for about an hour I have stuck my nose in the ovirt and rhev documentation, but I still can't understand how to use the REST API to change the disk profile and nothing the server profile. Ideally, how to set it for them when setting up a VM. Thank you so much for the advice.

2 7

Slow VM replication
by David Johnson 01 May '21

01 May '21

Hi everyone, When cloning a VM, I discovered that the time to close appears excessive based on the underlying platform I am using. It appears that the clone operation is not making efficient use of the network. I have seen up to 4 GBits sustained throughput by applications on VM's on the cluster. Is there a configuration I might be missing? *System specifics:* Backing store: NFS on TrueNAS running zRaid 3 on 11 spinning disks Ovirt Controller: I7 desktop General network: 1 GBit Ethernet Ovirt Host: Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz, 2x32 cores, 256 GB RAM Data Network: 10 GBit 10GBase-Twinax, dedicated to this Host and the TrueNAS *Operation:* Copying the 60GB partition, the copy operation never exceeds 40 megabytes per second (less than 0.5 GBit), even though the dedicated 10 Gigabit data network is not otherwise busy. [image: image.png] *David Johnson* *Director of Development, Maxis Technology* 844.696.2947 ext 702 (o) | 479.531.3590 (c) <https://www.linkedin.com/in/pojoguy/> <https://maxistechnology.com/wp-content/uploads/vcards/vcard-David_Johnson.v…> <https://maxistechnology.com/> *Follow us:* <https://www.linkedin.com/company/maxis-tech-inc/>

3 5

Re%3A how to enable HA for all vms and entire cluster at global settings&In-Reply-To=<20210429060341.18703.30460%40mail.ovirt.org>
by Tivon Häberlein 30 Apr '21

30 Apr '21

Hi, I haven't found a global option to set this. You'll have to do it vm after vm, which isn't a bad thing in my opinion as you'll have to reboot every vm after enabling HA anyways. For new VMs depending on your workflow I'd create a template or an instance type with HA enabled. You can also enable HA in the preset instance types via "Administration" > "Configure" > "Instance Types". Keep in mind that you will have to enable advanced options to see the High Avalibitity tab. Best regards, Tivon

1 0

Unable to migrate Engine to another HE Host
by Marko Vrgotic 30 Apr '21

30 Apr '21

Dear oVirt, I have already reached out twice regarding the issues that occurred, due to power outage, but noticed only when upgrading engine to latest 4.3. version. I am unable to redeploy engine on Host2, the hosted-engine file stays empty and VDSM on Hosts1 and 3 is reporting, even though I cleared the metadata for the Host2, on Host 1 and Host3: 2021-04-30 05:57:58,454-0700 ERROR (jsonrpc/7) [ovirt_hosted_engine_ha.client.client.HAClient] Malformed metadata for host 2: received 0 of 512 expected bytes (client:137) Today I tried to migrate HE from Host 3 to Host 1 and it fails each time with following message: On Engine: 2021-04-30 12:57:56,961Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1233892) [] EVENT_ID: VM_MIGRATION_TO_SERVER_FAILED(120), Migration failed (VM: HostedEngine, Source: ovirt-sj-03.ictv.com, Destination: ovirt-sj-01.ictv.com) On source Host: 2021-04-30 05:57:56,705-0700 ERROR (migsrc/66b6d489) [virt.vm] (vmId='66b6d489-ceb8-486a-951a-355e21f13627') Failed to migrate (migration:450) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 431, in _regular_run time.time(), migrationParams, machineParams File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 505, in _startUnderlyingMigration self._perform_with_conv_schedule(duri, muri) File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 591, in _perform_with_conv_schedule self._perform_migration(duri, muri) File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 525, in _perform_migration self._migration_flags) File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 100, in f ret = attr(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1781, in migrateToURI3 if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed', dom=self) libvirtError: operation aborted: migration out job: canceled by client I know that this version is end of life – but I would very much appreciate if someone could help me asses if this means corruption in DB or the overall damage, simply to know how to plan further actions. My impression was that I still had to functional HE Hosts in the pool, but after seeing migration failure, it’s pretty much down to single host. This is production system, so I cannot just move on to upgrading/deploying to 4.4. Additionally – : * Is the effect of the engine-cleanup on HE Host local or it affects all HE Hosts? Could that help bringing the Host back to state so that HE can be re-deployed? * What is the effect or reinitialize-lockspace? Kindly awaiting your reply. Happy to provide any additional information needed. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

1 0

how to override host in console.vv
by Enrico Becchetti 30 Apr '21

30 Apr '21

Hi all, I use ovirt 4.3.10 with an engine running in a standalone virtual machine. The operating system of this engine and the hypervisors is CentOS 7. In the initial setup I chose a name for the engine, ovirt.local, then I added a second public IP address named ovirt.mydomain in order to allow the user portal also from the Internet. Now here's my problem. Users are able to connect to the VM portal but they cannot access the console of their virtual machines. Checking the console.vv file I noticed that there are two parts, the first [virt-viewer] which contains the hypervisor on which the virtual machine runs, and the second in this configuration [ovirt] inside ovirt I've got "host = ovirt.local: 443". Now I would like to change the value of the "host" parameter with the FQDN. Can you tell me how I can set an override of this variable ? Thanks a lot. Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Skype:enrico_becchetti Mail: Enrico.Becchetti<at>pg.infn.it ______________________________________________________________________

1 1

Re: Unable to provide network acces to second cluster in DC
by Miguel Garcia 29 Apr '21

29 Apr '21

Browsing at the path above I see prodvlan and havlan listed and manage network settings is the same as Public1. Compute > Clusters > Public2 > Logical Network > Manage Networks The problem is that when I try to create a vm for cluster Public2 on the nic sections no nic profile are listed, it remains <empty> option only.

2 1

[ANN] oVirt 4.4.6 Sixth Release Candidate is now available for testing
by Lev Veyde 29 Apr '21

29 Apr '21

oVirt 4.4.6 Sixth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Sixth Release Candidate for testing, as of April 29th, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 * oVirt Node 4.4 based on CentOS Stream 8 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS Stream 8 - oVirt Node NG is already available based on CentOS Stream 8 Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

how to enable HA for all vms and entire cluster at global settings
by dhanaraj.ramesh＠yahoo.com 29 Apr '21

29 Apr '21

Hi Team instead of enabling HA for each vm one by one, I want to enable HA for all vms that is already running in the cluster and also for the future vms that going to be installed. I already did configure HA reservation at the cluster level, any other settings or commands I should configure? how I can achieve the above

1 0

Unable to provide network acces to second cluster in DC
by Miguel Garcia 28 Apr '21

28 Apr '21

I have created the following DC and cluster structure in my ovirt server - Data Center Public - - cluster-public1 - - cluster-public2 Also created a couple Logical Network for DC-Public - - prodvlan - - havlan And added 4 host (two for each cluster because processor type) and each host has ports added to both logical networks (besides ovirtmgmt) When I create a new vm in cluster public1 and add nics I'm able to list prodvlan and havlan but when I try to create the vm for cluster public2 no logical networks are listed. Any idea how to get logical networks listed for cluster public2? Thanks in advance

2 1

Restoring hosted engine from backup fails on new FC storage domain creation
by Juhani Rautiainen 28 Apr '21

28 Apr '21

Hi! I started the upgrade from 4.3->4.4. Now I'm stuck as restoring the backup fails to create the correct storage domain for Hosted Engine. How can I create one? Error from ansible task is: [ ERROR ] ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Domain format is different from master storage domain format]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Domain format is different from master storage domain format]\". HTTP response code is 400."} And from UI I can see that what has been created is a data domain. Not data (master) domain as old one was. Now I'm stuck here. This is a fibre channel system where I'm trying to do this if it is relevant. What I could find from the logs is this: 2021-04-27 09:36:06,925+0300 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:105 storage_domain_details: {'changed': False, 'ovirt_storage_domains': [{'href': '/ovirt-engine/api/storagedomains/dd52022b-7616-47f6-9534-6f1a4084fdf4', 'comment': '', 'description': '', 'id': 'dd52022b-7616-47f6-9534-6f1a4084fdf4', 'name': 'hosted_storage', 'available': 531502202880, 'backup': False, 'block_size': 512, 'committed': 0, 'critical_space_action_blocker': 5, 'discard_after_delete': True, 'disk_profiles': [], 'disk_snapshots': [], 'disks': [], 'external_status': 'ok', 'master': False, 'permissions': [], 'status': 'unattached', 'storage': {'type': 'fcp', 'volume_group': {'id': 'HRLDCn-p7X2-5X2O-vm4h-1Wb9-wAMu-WkIwit', 'logical_units': [{'discard_max_size': 268435456, 'discard_zeroes_data': False, 'id': '36000d31005b4f6000000000000000029', 'lun_mapping': 3, 'paths': 0, 'product_id': 'Compellent Vol', 'serial': 'SCOMPELNTCompellent_Vol_0005b4f6-00000029', 'size': 536870912000, 'storage_domain_id': 'dd52022b-7616-47f6-9534-6f1a4084fdf4', 'vendor_id': 'COMPELNT', 'volume_group_id': 'HRLDCn-p7X2-5X2O-vm4h-1Wb9-wAMu-WkIwit'}]}}, 'storage_connections': [], 'storage_format': 'v5', 'supports_discard': True, 'supports_discard_zeroes_data': False, 'templates': [], 'type': 'data', 'used': 4294967296, 'vms': [], 'warning_low_space_indicator': 10, 'wipe_after_delete': False}], 'failed': False} 'master': False? I'm not sure if this creation or check. I tried this opration twice. I removed the new hosted_storage and remove also old hosted_engine domain on second try to make sure that it doesn't prevent creation of another master. No luck with that. Thanks, Juhani

3 14

Import VM with Xen Based in Ovirt
by hemaa＠emiratesnbd.com 28 Apr '21

28 Apr '21

Hi All, I am trying to migrate a VM from a Xen Based virtualization to Ovirt with the import option in GUI But I am not able to list any stopped VMs on the Xen host. So what I did is I started the VM and got it listed. Then selected the VM and moved to right hand section. Clicked on next button. But then it gave an error "All chosen VMs couldn't be retrieved by the external system and therefore have been filtered. Please see log for details." When I check the libvirt logs in xen hypervisor I see error as below. There is no other errors in engine logs or vdsm logs 2021-04-22 08:52:36.796+0000: 30219: error : do_connect:116 : internal error: failed to connect to xend 2021-04-22 08:52:36.830+0000: 30219: error : virNodeSuspendSupportsTarget:332 : internal error: Cannot probe for supported suspend types 2021-04-22 08:52:36.830+0000: 30219: warning : xenHypervisorMakeCapabilities:2550 : Failed to get host power management capabilities 2021-04-22 08:52:36.832+0000: 30220: error : virConnectListAllDomains:6803 : this function is not supported by the connection driver: virConnectListAllDomains This is the same error I got when I tried importing a running VM as well. Any idea on what could be a possible reason behind this?

5 5

Faild ovirt-websocket-proxy.
by jesado74＠gmail.com 28 Apr '21

28 Apr '21

Hello again. After getting the hosted-engine vm back, now I have the following problem. I can't use the graphic console. The websocket-proy fails me. Surely when I update the certificates I have missed some intermediate step, but I do not know how to follow. Anyone know of a link to follow the certificate change procedure in the websocket-proxy service. Thank you. PS: Here I leave the output of the service: ● ovirt-websocket-proxy.service - oVirt Engine websockets proxy Loaded: loaded (/usr/lib/systemd/system/ovirt-websocket-proxy.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Wed 2021-04-28 02:03:54 UTC; 7h ago Process: 1694 ExecStart = / usr / share / ovirt-engine / services / ovirt-websocket-proxy / ovirt-websocket-proxy.py --systemd = notify $ EXTRA_ARGS start (code = exited, status = 1 / FAILURE) Main PID: 1694 (code = exited, status = 1 / FAILURE) Apr 28 02:03:53 ovirt.myhostedengine.com systemd [1]: Starting oVirt Engine websockets proxy ... Apr 28 02:03:54 ovirt.myhostedengine.com ovirt-websocket [1694]: 2021-04-28 02: 03: 54,614 + 0000 ovirt-websocket-proxy: ERROR run: 554 Error: SSL_ONLY is set but SSL_CERTIFICATE or SSL_KEY file not found. Apr 28 02:03:54ovirt.hostedengine.com ovirt-websocket-proxy.py [1694]: ovirt-websocket-proxy [1694] ERROR run: 554 Error: SSL_ONLY is set but SSL_CERTIFICATE or SSL_KEY file not found. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: ovirt-websocket-proxy.service: main process exited, code = exited, status = 1 / FAILURE Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: Failed to start oVirt Engine websockets proxy. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: Unit ovirt-websocket-proxy.service entered failed state. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: ovirt-websocket-proxy.service failed. Sorry if I say any inconsistencies, but I'm new to this whole ovirt topic. Thanks again.

2 1

How i can set vnic while Create VM
by ovirt.org＠nevim.eu 28 Apr '21

28 Apr '21

How i can set vnic while Create VM via rest-api? I mean this (on screenshot), how to via rest-api? https://prnt.sc/126trb8 Thanks very much.

1 0

Ovirt-engine Setup Error-Failed to execute stage 'Misc configuration
by rajkumar madhu 28 Apr '21

28 Apr '21

Hi Team, Unable to install Ovirt in my centos server.while executing Engine-setup command ,I am getting below error.Please help me on this . Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Stage: Transaction setup [ INFO ] Stopping engine service [ INFO ] Stopping ovirt-fence-kdump-listener service [ INFO ] Stopping dwh service [ INFO ] Stopping vmconsole-proxy service [ INFO ] Stopping websocket-proxy service [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ ERROR ] Failed to execute stage 'Misc configuration': [Errno 2] No such file or directory: '/etc/ovirt-engine/extensions.d' [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20210427090149-r0i80v.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20210427090311-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Regards, Rajkumar M. 9176772077

2 4

Ovirt 4.4.6.5-1 engine-setup failed
by Don Dupuis 28 Apr '21

28 Apr '21

I am installing Ovirt 4.4.6.5-1 engine on CentOS Stream 8 on a dedicated vm. Towards the end of the engine-setup session I have a failure: [ INFO ] Stage: Transaction setup [ INFO ] Stopping engine service [ INFO ] Stopping ovirt-fence-kdump-listener service [ INFO ] Stopping dwh service [ INFO ] Stopping vmconsole-proxy service [ INFO ] Stopping websocket-proxy service [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Upgrading CA [ INFO ] Initializing PostgreSQL [ INFO ] Creating PostgreSQL 'engine' database [ INFO ] Configuring PostgreSQL [ INFO ] Creating PostgreSQL 'ovirt_engine_history' database [ INFO ] Configuring PostgreSQL [ INFO ] Creating CA: /etc/pki/ovirt-engine/ca.pem [ INFO ] Creating CA: /etc/pki/ovirt-engine/qemu-ca.pem [ INFO ] Updating OVN SSL configuration [ INFO ] Updating OVN timeout configuration [ INFO ] Creating/refreshing DWH database schema [ INFO ] Setting up ovirt-vmconsole proxy helper PKI artifacts [ INFO ] Setting up ovirt-vmconsole SSH PKI artifacts [ INFO ] Configuring WebSocket Proxy [ INFO ] Creating/refreshing Engine database schema [ INFO ] Creating a user for Grafana [ INFO ] Creating/refreshing Engine 'internal' domain database schema [ INFO ] Creating default mac pool range [ INFO ] Adding default OVN provider to database [ INFO ] Adding OVN provider secret to database [ INFO ] Setting a password for internal user admin [ INFO ] Install selinux module /usr/share/ovirt-engine/selinux/ansible-runner-service.cil [ INFO ] Generating post install configuration file '/etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf' [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up [ INFO ] Starting engine service [ INFO ] Starting dwh service [ INFO ] Starting Grafana service [ ERROR ] Failed to execute stage 'Closing up': Failed to start service 'ovirt-imageio' [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20210426111225-g31wa5.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20210426111501-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Below is output of /var/log/ovirt-imageio/daemon.log: 2021-04-26 11:15:01,481 ERROR (MainThread) [server] Server failed Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/server.py", line 46, in main server = Server(cfg) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/server.py", line 110, in __init__ self.remote_service = services.RemoteService(self.config, self.auth) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/services.py", line 73, in __init__ self._server = http.Server((config.remote.host, port), http.Connection) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/http.py", line 91, in __init__ self.create_socket(prefer_ipv4) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/http.py", line 123, in create_socket self.socket = socket.socket(self.address_family, self.socket_type) File "/usr/lib64/python3.6/socket.py", line 144, in __init__ _socket.socket.__init__(self, family, type, proto, fileno) OSError: [Errno 97] Address family not supported by protocol I am not seeing errors in /var/log/ovirt-engine/setup/setup.log. What other information do you need that is revelant to this issue? Thanks Don

3 8

Brick didn't come up after planned Poweroutage
by Marcel d'Heureuse 27 Apr '21

27 Apr '21

Hi Guys, We hat a planned power outage and we have stopped all VMS and try to keep the servers alive as long as possible. Some Servers made a Reboot by itself but the IPMI interface was not reachable for the engine. The some hosts have made a restart. Now all systems running and all 180 VMs too. But one Brick of the hosted engine didn't come up. Did you have an idea. Please find attached some screenshots. Our Hosted Engine has 6 bricks on 6 different Servers. A restart of the Host didn't work. The Server Restart of glusterd didn't work. I hope you have some more Ideas? Thanks Br Marcel

2 1

Re: [ceph-users] osd nearfull is not detected
by Konstantin Shalygin 27 Apr '21

27 Apr '21

Create tracker for this issue [1] [1] https://tracker.ceph.com/issues/50533 <https://tracker.ceph.com/issues/50533> k > On 21 Apr 2021, at 21:21, Dan van der Ster <dan(a)vanderster.com <mailto:dan@vanderster.com>> wrote: > > Are you currently doing IO on the relevant pool? Maybe nearfull isn't > reported until some pgstats are reported. > > Otherwise sorry I haven't seen this.

1 0

Re: Attempting to detach a storage domain
by Vojtech Juranek 27 Apr '21

27 Apr '21

On Tuesday, 27 April 2021 02:18:18 CEST Matthew.Stier(a)fujitsu.com wrote: > There is no /var/log/vdsm directory on the hosted-engine. > > This is from the current host, hosting the engine: aaa.bbb.ccc.100 is the > hosted-engine > 2021-04-26 19:12:42,760-0500 INFO (jsonrpc/2) [api.host] START > getCapabilities() from=::ffff:aaa.bbb.ccc.100,37812 (api:48) 2021-04-26 > 19:12:42,763-0500 INFO (jsonrpc/2) [api.host] FINISH getCapabilities > error=internal error: Duplicate key from=::ffff:168.127.151.100,37812 > (api:52) 2021-04-26 19:12:42,763-0500 ERROR (jsonrpc/2) > [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback > (most recent call last): > File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, > in _handle_request res = method(**params) > File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 198, in > _dynamicMethod result = fn(*methodArgs) > File "<string>", line 2, in getCapabilities > File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in > method ret = func(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1371, in > getCapabilities c = caps.get() > File "/usr/lib/python2.7/site-packages/vdsm/host/caps.py", line 95, in > get machinetype.compatible_cpu_models()) > File "/usr/lib/python2.7/site-packages/vdsm/common/cache.py", line 43, in > __call__ value = self.func(*args) > File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 142, in > compatible_cpu_models all_models = domain_cpu_models(c, arch, cpu_mode) > File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 97, in > domain_cpu_models domcaps = conn.getDomainCapabilities(None, arch, None, > virt_type, 0) File > "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line > 131, in wrapper ret = f(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, > in wrapper return func(inst, *args, **kwargs) > File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3844, in > getDomainCapabilities if ret is None: raise libvirtError > ('virConnectGetDomainCapabilities() failed', conn=self) libvirtError: > internal error: Duplicate key looks like https://bugzilla.redhat.com/show_bug.cgi?id=1791790 The fix should be contained in recent oVirt relases. > 2021-04-26 19:12:42,764-0500 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC > call Host.getCapabilities failed (error -32603) in 0.00 seconds > (__init__:312) > > -----Original Message----- > From: Nir Soffer <nsoffer(a)redhat.com> > Sent: Monday, April 26, 2021 5:12 PM > To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> > Cc: Benny Zlotnik <bzlotnik(a)redhat.com>; users(a)ovirt.org > Subject: Re: [ovirt-users] Re: Attempting to detach a storage domain > > On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com > <Matthew.Stier(a)fujitsu.com> wrote: > > > > > > I'm getting tons of these in the > > hosted-engine:/var/log/ovirt-engine/engine.log > > > > > > > > 2021-04-26 16:40:40,260-05 ERROR > > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > > (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: > > VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get > > Host Capabilities failed: Internal JSON-RPC error: {'reason': > > 'internal error: Duplicate key'} > > > This looks like bad response from vdsm. Can you share the vdsm log from the > host xxxx.yyyy.zzz? > /var/log/vdsm/vdsm.log > > Nir > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z2GOGEZ2DZX34 > ADZ5L2BATIINYGVWYJD/

1 0

Cannot delete snapshot
by Giulio Casella 27 Apr '21

27 Apr '21

Hi, I'm having (another) issue working with snapshots. Since a few days my backup system (storware vprotect) cannot delete a snapshot. Message reported by SPM is: HSMGetAllTasksStatusesVDS failed: value=Volume does not exist: ('6180c2e8-141a-4126-bcb1-5af5caa98175',) abortedcode=201 Other snapshots from other VMs are working fine (created and deleted as needed). I verified it, I can reach on SPM filesystem other snapshots from the same VM, but that one doesn't exist. I suspect that during normal backup management that snapshot has been correctly removed from file system, but still live in ovirt database. I'm pretty sure vProtect use ovirt API to operate, it doesn't directly interact with ovirt database. That's why I'm talking to you and not to storware guys. Is there a (safe) way to get rid of that snapshot? TIA Regards, Giulio Casella

5 11

Re: Ansible ovirt.ovirt_vm nics
by Matthew.Stier＠fujitsu.com 27 Apr '21

27 Apr '21

I believe I have identified the issue, variable inheritance. The inventory I include to define the hosts, includes several classes. ‘virtualmachines’ which the script uses to get the list of VMs it is going to process. All VM defaults are defined within its ‘:vars’ section. I also have groups of VMs where I want to override variables. Unfortunately, what is being defined in ‘virtualmachines’ is not being override in the class level, because they are considered sibling classes. I have found the ‘ansible_group_priority’ variable, which can be assigned at each class. I assigned the entry in [virtualmachines:vars] with the value of 2 (default is 1) and then in the other classes, I assigned a value of 3. Now the variable in [class:vars] will override the variables in [virtualmachines:vars]. Of course the host level can still override all. From: Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> Sent: Thursday, April 22, 2021 2:01 PM To: Martin Perina <mperina(a)redhat.com> Cc: users(a)ovirt.org; Martin Necas <mnecas(a)redhat.com> Subject: [ovirt-users] Re: Ansible ovirt.ovirt_vm nics It’s basically the one listed in the URL. The changes I’ve made is to add some addition ‘defaults’, and the code I mentioned below, to select different nic profiles for vms that are on different networks. I’m running an Oracle Linux 7u9 system, and the version of Ansible is 2.9.18 In my environment, I have created different networks, and labeled them based upon their vlan tag number (vlan20, vlan21, vlan22, …) A VM can be created on any of these vlans, so I need to be able to select the nic profile within ‘ini’ file holding all the configuration information. (hostname, fqdn, IP address, etc…) From: Martin Perina <mperina(a)redhat.com<mailto:mperina@redhat.com>> Sent: Thursday, April 22, 2021 2:51 AM To: Stier, Matthew <Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com>> Cc: users(a)ovirt.org<mailto:users@ovirt.org>; Martin Necas <mnecas(a)redhat.com<mailto:mnecas@redhat.com>> Subject: Re: [ovirt-users] Ansible ovirt.ovirt_vm nics Hi Matthew, Could you please share with us your playbook? Which ansible version are you using? Are you using ovirt_vm module from oVirt Ansible Collection which contains newer versions than the ovirt_vm module included in Ansible 2.9? https://docs.ansible.com/ansible/latest/collections/ovirt/ovirt/ovirt_vm_mo… Thanks, Martin On Thu, Apr 22, 2021 at 9:28 AM Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com> <Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com>> wrote: The ‘nics’ section of ovirt_vm is vague and with nearly no examples. My playbook is based upon https://blogs.oracle.com/scoter/ansible-with-oracle-linux-virtualization-ma… I’ve made several modifications, (more default) and added a few lines, which I believe is supposed to assign vnic profiles to the primary vnic (nic1), based upon the definition of ‘vm_nic1_profile’ defined in an included ‘ini’ file. (the profile defaulting to blank if it is not defined in the ini file.) It isn’t doing its job. nics: - name: “nic1” profile_name: "{{ hostvars[item]['vm_nic1_profile'] | default('') }}” The playbook runs without complaint. If I run it with option ‘-vvv’ part of the output lists the variables, but the ‘nics’ variable is an empty list (nics[]) Any hints on what I’m doing wrong? I’ve checked the forum, but it tends to strip leading spaces, which is bad for indent sensitive code. _______________________________________________ Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/MEZLXGSSRCRJR… -- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

1 0

HCI - oVirt for CEPH
by penguin pages 27 Apr '21

27 Apr '21

I have been building out HCI stack with KVM/RHEV + oVirt with the HCI deployment process. This is very nice for small / remote site use cases, but with Gluster being anounced as EOL in 18 months, what is the replacement plan? Are their working projects and plans to replace Gluster with CEPH? Are their deployment plans to get an HCI stack onto a supported file system? I liked gluster for the control plan for the oVirt engine and smaller utility VMs as each system has a full copy, I can retrieve /extract a copy of the VM without having all bricks back... it was just "easy" to use. CEPH just means more complexity.. and though it scales better and has better features, it means that repair means having critical mass of nodes up before you can extra data (vs any disk can be pulled out of a gluster node, plugged into my laptop and I can at least extract the data). I guess I am not trying to debate shifting to CEPH.. it does not matter.. that ship sailed... What I am asking is when / what are the plans for replacement of Gluster for HCI. Because right now, for small sites for HCI, when Gluster is no longer supported.. and CEPH does not make it... is to go VMWare and vSAN or some other total different stack.

4 9

Re: Attempting to detach a storage domain
by Matthew.Stier＠fujitsu.com 27 Apr '21

27 Apr '21

Problem solved. I used Ansible and ran 'grep Duplicate /var/log/vdsm/vdsm.log' on all 121 of my hosts. Only the log of the host currently running the hosted-engine had entries. I migrated the hosted-engine, and all other VMs to other hosts, and then put the affected host into maintenance. I then undeployed it; then patched it; and finally deployed it. Its back up and running and taking VMs, and no more 'Duplicate keys' errors. -----Original Message----- From: Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> Sent: Monday, April 26, 2021 7:18 PM To: Nir Soffer <nsoffer(a)redhat.com> Cc: users(a)ovirt.org Subject: [ovirt-users] Re: Attempting to detach a storage domain There is no /var/log/vdsm directory on the hosted-engine. This is from the current host, hosting the engine: aaa.bbb.ccc.100 is the hosted-engine 2021-04-26 19:12:42,760-0500 INFO (jsonrpc/2) [api.host] START getCapabilities() from=::ffff:aaa.bbb.ccc.100,37812 (api:48) 2021-04-26 19:12:42,763-0500 INFO (jsonrpc/2) [api.host] FINISH getCapabilities error=internal error: Duplicate key from=::ffff:168.127.151.100,37812 (api:52) 2021-04-26 19:12:42,763-0500 ERROR (jsonrpc/2) [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 198, in _dynamicMethod result = fn(*methodArgs) File "<string>", line 2, in getCapabilities File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1371, in getCapabilities c = caps.get() File "/usr/lib/python2.7/site-packages/vdsm/host/caps.py", line 95, in get machinetype.compatible_cpu_models()) File "/usr/lib/python2.7/site-packages/vdsm/common/cache.py", line 43, in __call__ value = self.func(*args) File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 142, in compatible_cpu_models all_models = domain_cpu_models(c, arch, cpu_mode) File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 97, in domain_cpu_models domcaps = conn.getDomainCapabilities(None, arch, None, virt_type, 0) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3844, in getDomainCapabilities if ret is None: raise libvirtError ('virConnectGetDomainCapabilities() failed', conn=self) libvirtError: internal error: Duplicate key 2021-04-26 19:12:42,764-0500 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities failed (error -32603) in 0.00 seconds (__init__:312) -----Original Message----- From: Nir Soffer <nsoffer(a)redhat.com> Sent: Monday, April 26, 2021 5:12 PM To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> Cc: Benny Zlotnik <bzlotnik(a)redhat.com>; users(a)ovirt.org Subject: Re: [ovirt-users] Re: Attempting to detach a storage domain On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > I'm getting tons of these in the > hosted-engine:/var/log/ovirt-engine/engine.log > > 2021-04-26 16:40:40,260-05 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: > VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get > Host Capabilities failed: Internal JSON-RPC error: {'reason': > 'internal error: Duplicate key'} This looks like bad response from vdsm. Can you share the vdsm log from the host xxxx.yyyy.zzz? /var/log/vdsm/vdsm.log Nir _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z2GOGEZ2DZX34…

1 0

Re: Attempting to detach a storage domain
by Nir Soffer 27 Apr '21

27 Apr '21

On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > I'm getting tons of these in the hosted-engine:/var/log/ovirt-engine/engine.log > > 2021-04-26 16:40:40,260-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get Host Capabilities failed: Internal JSON-RPC error: {'reason': 'internal error: Duplicate key'} This looks like bad response from vdsm. Can you share the vdsm log from the host xxxx.yyyy.zzz? /var/log/vdsm/vdsm.log Nir

2 1

Re: Attempting to detach a storage domain
by Benny Zlotnik 26 Apr '21

26 Apr '21

I think engine.log would be a good place to start, it would likely tell us on which host there's a problem (if there is one) On Sun, Apr 25, 2021 at 10:22 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > Which logs, on which hosts should I be looking through? > > I have a hint of that from my research, but all 121 hosts are up and running. > > -----Original Message----- > From: Benny Zlotnik <bzlotnik(a)redhat.com> > Sent: Sunday, April 25, 2021 1:53 AM > To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> > Cc: users(a)ovirt.org > Subject: Re: [ovirt-users] Attempting to detach a storage domain > > What do the logs say? > This usually means that not all hosts were able to disconnect from it > > On Sun, Apr 25, 2021 at 9:45 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > > > Ovirt: 4.3.10 > > > > Storage: iSCSI > > > > > > > > Problem: Attempting to place storage domain into ‘maintenance’ in preparation for detachment and destruction, has left it hung in a ‘Preparation for maintenance’ state. > > > > > > > > I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to ‘Preparing for Maintenance’, and has stuck there for hours. > > > > > > > > Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains. > > > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org Privacy > > Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: > > https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: > > https://lists.ovirt.org/archives/list/users@ovirt.org/message/HY3LWX7H > > MN56SDHNQWB3MDXLLU7GNLGX/ >

2 1

How to reduce load during create VM
by ovirt.org＠nevim.eu 26 Apr '21

26 Apr '21

Hi everyone, please, can you limit the "Create VM" process somewhere so that setting up quota does not load the server so much, especially storage when duplicating the template disk?

3 3

oVirt on GCP
by mario.gandara＠gmail.com 26 Apr '21

26 Apr '21

Hello, guys! I'm trying to deploy oVirt on GCP for the last two weeks. Someone did it on GCP using nested virtualization? My scenario is: One standalone oVirt Engine and two hosts. In the future I imagine to scale this solution. Thank you. Mário Gândara

2 1

How do I share a disk across multiple VMs?
by David White 26 Apr '21

26 Apr '21

I need to mount a partition across 3 different VMs. How do I attach a disk to multiple VMs? This looks like fairly old documentation-not-documentation: https://www.ovirt.org/develop/release-management/features/storage/sharedraw… Sent with ProtonMail Secure Email.

8 24

Problem with ISCSI multipathing identifying faild path to a LUN every few seconds.
by Gal Villaret 25 Apr '21

25 Apr '21

Hi All, In the past few days, we have been having problems with hosts becoming unmanageable due to multipathd identifying false failed paths and VDSM crashing because of it. We were running version 4.4.1 and upgrading to 4.4.5(engine) and 4.4.6(nodes) seems to have resolved the VDSM. However, currently, we see that the multipathing events continue. From what we have observed, the events start in correlation to the host reporting on low swap space. The low swap space seems to be related to Commvault backup operation running. By running top on the host while a backup operation is running I can see swap being consumed to 100% although there is plenty of RAM available. After the multipath events start happening the only means of stopping it was to reboot the host. This is the warning in oVirt UI: Apr 24, 2021, 9:14:07 PM - Available swap memory of host Ovirt-Node2 [953 MB] is under defined threshold [1024 MB]. This is the first appearance of the multipath event in /var/log/messages: Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=15s Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 Sense Key : Aborted Command [current] Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 <<vendor>>ASC=0xc1 ASCQ=0x1 Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 CDB: Read(16) 88 00 00 00 00 00 79 ac 75 a0 00 00 06 00 00 00 Apr 24 21:14:58 ovirt-node2 kernel: blk_update_request: I/O error, dev sdgi, sector 2041345440 op 0x0:(READ) flags 0x4200 phys_seg 192 prio class 0 Apr 24 21:14:58 ovirt-node2 kernel: device-mapper: multipath: 253:20: Failing path 131:224. Apr 24 21:14:58 ovirt-node2 multipathd[3044]: sdgi: mark as failed Apr 24 21:14:58 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: remaining active paths: 11 Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: sdgi - tur checker reports path is up Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 131:224: reinstated Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: remaining active paths: 12 Apr 24 21:15:03 ovirt-node2 kernel: device-mapper: multipath: 253:20: Reinstating path 131:224. Apr 24 21:15:03 ovirt-node2 kernel: sd 21:0:0:9: alua: port group 8091 state A preferred supports toluSNA Apr 24 21:15:03 ovirt-node2 kernel: sd 21:0:0:9: alua: port group 8091 state A preferred supports toluSNA Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=15s Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 Sense Key : Aborted Command [current] Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 <<vendor>>ASC=0xc1 ASCQ=0x1 Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 CDB: Read(16) 88 00 00 00 00 00 79 ac 75 a0 00 00 06 00 00 00 Apr 24 21:15:13 ovirt-node2 kernel: blk_update_request: I/O error, dev sdau, sector 2041345440 op 0x0:(READ) flags 0x4200 phys_seg 192 prio class 0 Apr 24 21:15:13 ovirt-node2 kernel: device-mapper: multipath: 253:20: Failing path 66:224. Apr 24 21:15:13 ovirt-node2 multipathd[3044]: sdau: mark as failed Underlying storage is Fujitsu DX200 S5 with all SSD drives. Each host has two 10Gbit network adapters dedicated to ISCSI. Any help with this would be highly appreciated. Thanks, Gal Villaret

2 1

Migration VM and Storage Domains
by LS CHENG 25 Apr '21

25 Apr '21

Hi I have a question about migrating VM's. If I have 2 VM and each VM is stored in separate Storage Domains can the VM migrate between physical hosts? Or the VM must be stored in the same Storage Domain? For example VM1 is stored in SD1 and runs in HOST-A VM2 is stored in SD2 and runs in HOST-B Can VM2 migrated to HOST-A? Thanks

2 2

Re: Attempting to detach a storage domain
by Benny Zlotnik 25 Apr '21

25 Apr '21

What do the logs say? This usually means that not all hosts were able to disconnect from it On Sun, Apr 25, 2021 at 9:45 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > Ovirt: 4.3.10 > > Storage: iSCSI > > > > Problem: Attempting to place storage domain into ‘maintenance’ in preparation for detachment and destruction, has left it hung in a ‘Preparation for maintenance’ state. > > > > I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to ‘Preparing for Maintenance’, and has stuck there for hours. > > > > Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains. > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HY3LWX7HMN56S…

2 1

Attempting to detach a storage domain
by Matthew.Stier＠fujitsu.com 25 Apr '21

25 Apr '21

Ovirt: 4.3.10 Storage: iSCSI Problem: Attempting to place storage domain into 'maintenance' in preparation for detachment and destruction, has left it hung in a 'Preparation for maintenance' state. I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to 'Preparing for Maintenance', and has stuck there for hours. Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains.

1 0

Can we remove Export and ISO Domain from KVM ?.
by smuthyala＠helenoftroy.com 23 Apr '21

23 Apr '21

I need to migrate both Export and ISO Domains to newer storage. Can i remove them and recreate. Or is there a way to export and import into a newer storage. TIA

1 0

ovsdb-server tlsv1 unknown ca
by ozmen62＠hotmail.com 23 Apr '21

23 Apr '21

1 0

Re: Ansible ovirt.ovirt_vm nics
by Martin Perina 22 Apr '21

22 Apr '21

Hi Matthew, Could you please share with us your playbook? Which ansible version are you using? Are you using ovirt_vm module from oVirt Ansible Collection which contains newer versions than the ovirt_vm module included in Ansible 2.9? https://docs.ansible.com/ansible/latest/collections/ovirt/ovirt/ovirt_vm_mo… Thanks, Martin On Thu, Apr 22, 2021 at 9:28 AM Matthew.Stier(a)fujitsu.com < Matthew.Stier(a)fujitsu.com> wrote: > The ‘nics’ section of ovirt_vm is vague and with nearly no examples. > > > > My playbook is based upon > https://blogs.oracle.com/scoter/ansible-with-oracle-linux-virtualization-ma… > > > > I’ve made several modifications, (more default) and added a few lines, > which I believe is supposed to assign vnic profiles to the primary vnic > (nic1), based upon the definition of ‘vm_nic1_profile’ defined in an > included ‘ini’ file. (the profile defaulting to blank if it is not defined > in the ini file.) > > > > It isn’t doing its job. > > > > nics: > > - name: “nic1” > > profile_name: "{{ hostvars[item]['vm_nic1_profile'] | default('') }}” > > > > > > The playbook runs without complaint. If I run it with option ‘-vvv’ part > of the output lists the variables, but the ‘nics’ variable is an empty list > (nics[]) > > > > Any hints on what I’m doing wrong? I’ve checked the forum, but it tends > to strip leading spaces, which is bad for indent sensitive code. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/MEZLXGSSRCRJR… > -- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

2 1

n00b Requesting Some Advice
by matthew＠peregrineit.net 22 Apr '21

22 Apr '21

Hi All, I need some "best practice" advice. We have a Ceph Storage Cluster (Octopus moving to Pacific) which we'd like to use with our new oVirt Cluster (all on CentOS 8 boxes). What I'd like to know is what is the "best" (ie recommended / best practice) way of doing this - via iSCSI, CFS, 'raw' RBD blocks, some other way I haven't read about yet, etc? I realise 'best' is a subjective term, but what I tend to do is do 'manual' installs so that I both actually understand what is happening (ie how things fit together - I pull apart and rebuild mechanical clocks and watches for the same reason) and also so I can '"Puppet-ise" the results for future use. This means that I am *not* necessarily looking for "quick and dirty" or "quick and easy" (ie, I have no trouble using the CLI and 'vim-ing' conf files as required) but I do want a solid, "best-practice" system when I'm done. So, can some please help? And also, would you mind pointing me towards the relevant documentation for the answer(s) supplied (yes, I *always* RTFM :-) ). Thanks in advance Dulux-Oz

6 6

not able to upload disks, iso - Connection to ovirt-imageio service has failed. Ensure that ovirt-engine certificate is registered as a valid CA in the browser.
by dhanaraj.ramesh＠yahoo.com 22 Apr '21

22 Apr '21

Hi We are unning with 4.4.3.12-1.el8 version and so far working fine, but today users complained they are unable to upload new disks and upon checking found "Connection to ovirt-imageio service has failed. Ensure that ovirt-engine certificate is registered as a valid CA in the browser" during testing option. please help on this and if there is any temp solution is available share me the steps

4 7

How to update ovirt-sdk
by Miguel Garcia 22 Apr '21

22 Apr '21

We integrate jenkins to launch vms dynamically to run smoketest from our builds but now we receive the following problem: "msg": "ovirtsdk4 version 4.3.0 or higher is required for this module" I had installed following packages in CentOs7 ovirt-engine-sdk-java.noarch 3.6.10.0-1.el7 epel ovirt-engine-sdk-java-javadoc.noarch 3.6.10.0-1.el7 epel ovirt-engine-sdk-python.noarch 3.6.9.1-1.el7 epel I tired to use yum upgrade but did not report more recent version from ovirt-sdk. How can I upgrade/install ovirt-sdk to version 4.3?

4 8

[ANN] oVirt 4.4.6 Fifth Release Candidate is now available for testing
by Lev Veyde 22 Apr '21

22 Apr '21

oVirt 4.4.6 Fifth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Fifth Release Candidate for testing, as of April 22nd, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 * oVirt Node 4.4 based on CentOS Stream 8 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS Stream 8 - oVirt Node NG is already available based on CentOS Stream 8 Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

host certification is about to expire
by Bill James 22 Apr '21

22 Apr '21

I get this message from ovirt: Message:Host <hostname> certification is about to expire at 2021-05-12. Please renew the host's certification. I tried putting host in maintenance mode and running "enroll certificate". Didn't help. How do I renew the certificate? I'm running* 4.3.9.4-1.el7* *Thanks.* -- This email, its contents and attachments contain information from J2 Global, Inc. and/or its affiliates which may be privileged, confidential or otherwise protected from disclosure. The information is intended to be for the addressee(s) only. If you are not an addressee, any disclosure, copy, distribution or use of the contents of this message is prohibited. If you have received this email in error, please notify the sender by reply email and delete the original message and any copies.

2 4

Ansible ovirt.ovirt_vm nics
by Matthew.Stier＠fujitsu.com 22 Apr '21

22 Apr '21

The 'nics' section of ovirt_vm is vague and with nearly no examples. My playbook is based upon https://blogs.oracle.com/scoter/ansible-with-oracle-linux-virtualization-ma… I've made several modifications, (more default) and added a few lines, which I believe is supposed to assign vnic profiles to the primary vnic (nic1), based upon the definition of 'vm_nic1_profile' defined in an included 'ini' file. (the profile defaulting to blank if it is not defined in the ini file.) It isn't doing its job. nics: - name: "nic1" profile_name: "{{ hostvars[item]['vm_nic1_profile'] | default('') }}" The playbook runs without complaint. If I run it with option '-vvv' part of the output lists the variables, but the 'nics' variable is an empty list (nics[]) Any hints on what I'm doing wrong? I've checked the forum, but it tends to strip leading spaces, which is bad for indent sensitive code.

1 0

Re: How to Upgrade Node with Local Storage ?
by Adam Xu 22 Apr '21

22 Apr '21

在 2021/4/21 22:40, Nur Imam Febrianto 写道: > > Set global maintenance and then turn off all vm, do yum update but it > completed with failed. > > Am I missing something ? > where is your ovirt engine ? is it running in that local storage or in a standalone server? > > *From: *Adam Xu <mailto:adam_xu@adagene.com.cn> > *Sent: *20 April 2021 7:36 > *To: *users(a)ovirt.org <mailto:users@ovirt.org> > *Subject: *[ovirt-users] Re: How to Upgrade Node with Local Storage ? > > For oVirt Node that using Local Storage, I think you should shutdown > all your vms before you upgrade the Node. > > 在 2021/4/19 22:09, Nur Imam Febrianto 写道: > > Hi, > > How we can upgrade oVirt Node that using Local Storage ? Seems I > cant find any good documentation about this. > > Planning to upgrade one 4.4.4 node with local storage to 4.4.5. > > Thanks before. > > Regards, > > Nur Imam Febrianto > > > > _______________________________________________ > > Users mailing list --users(a)ovirt.org <mailto:users@ovirt.org> > > To unsubscribe send an email tousers-leave(a)ovirt.org <mailto:users-leave@ovirt.org> > > Privacy Statement:https://www.ovirt.org/privacy-policy.html <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > > oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > > List Archives:https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZOCH… <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov…> > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZIWFVG73Y5CBS…

1 0

Moving templates and their thin based VMs
by Gianluca Cecchi 21 Apr '21

21 Apr '21

Hello, I had to free up and reformat a storage domain where I had some templates and many VMs. I was able to move to other existing storage domains disks of VMs created with "Clone" Storage Allocation But some of these VMs had disk with storage allocation of type "Thin" on their related template. So I was both unable to move these templates and VMs disks... I was able to export as OVA the templates and then import again them (with another name "_Copy") on to another storage domain.... then remove VMs and templates and rename templates' names... Are there any chances to better solve these kind of problems if one has to decommission a storage domain? Only export of all VMs and related templates? Is there a way to "consolidate" the disks of an existing "Thin" based storage allocation to Clone? Possibly I can clone the VM? Thanks in advance, Gianluca

2 3

Re: FreeBSD 13 and virtio
by thomas＠hoberg.net 21 Apr '21

21 Apr '21

I am attaching both working configs here. Von: Nur Imam Febrianto <nur_imam(a)outlook.com> Gesendet: Dienstag, 20. April 2021 14:14 An: Thomas Hoberg <thomas(a)hoberg.net>; users(a)ovirt.org Betreff: [ovirt-users] Re: FreeBSD 13 and virtio Seems strange. I want to use q35, but whenever I try even to start the installation (vm disk using virtio-scsi/virtio, net adapter using virtio) it always shows me the installer doesn't detect any disk. I have an existing VM too that recently upgraded from 12.2 to 13. It uses i440FX with virtio-scsi disk and virtio network. If I try to change the machine into q35, it keeps stuck at boot after "promiscuous mode enabled". Don't know what's wrong. Using oVirt 4.4.5. Can you share your VM Config ? From: Thomas Hoberg <mailto:thomas@hoberg.net> Sent: 20 April 2021 17:27 To: users(a)ovirt.org <mailto:users@ovirt.org> Subject: [ovirt-users] Re: FreeBSD 13 and virtio q35 with BIOS as that is the cluster default with >4.3. Running the dmesg messages through my mind as I remember them, the vio hardware may be all PCIe based, which would explain why this won't work on a virtual FX 440FX system, because those didn't have PCIe support AFAIK. Any special reason why you'd want them based on 440FX? And I also tested with GhostBSD, which is still 12.* based, and that doesn't seem to have vio support, at least I could not see a hard disk there, which confirms your observation there. _______________________________________________ Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt .org%2Fprivacy-policy.html <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir t.org%2Fprivacy-policy.html&data=04%7C01%7C%7C71e5972978224d31def708d903 e6f09b%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnk nown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXV CI6Mn0%3D%7C1000&sdata=effZxEik3q1lfTBn%2BBi4DXIQM6wVJfgiQ7%2Fqr0W1dLM%3 D&reserved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= effZxEik3q1lfTBn%2BBi4DXIQM6wVJfgiQ7%2Fqr0W1dLM%3D&reserved=0 oVirt Code of Conduct: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt .org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir t.org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7C%7C71 e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C 637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM zIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=rvQ12IpSElU9D23G7HJvPz%2F vqqZ0OaUhJ3wI%2BRslIQY%3D&reserved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= rvQ12IpSElU9D23G7HJvPz%2FvqqZ0OaUhJ3wI%2BRslIQY%3D&reserved=0 List Archives: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi rt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2F7ZWDRPXM6G25H4VRE3O UAH25UIY4JVI3%2F <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov irt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2F7ZWDRPXM6G25H4VRE3 OUAH25UIY4JVI3%2F&data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C8 4df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWF pbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D% 7C1000&sdata=qDf%2BRNi1PXI2cf%2F4XFc6qHCTY6lqOX9lE5Qvyhg4Xls%3D&rese rved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= qDf%2BRNi1PXI2cf%2F4XFc6qHCTY6lqOX9lE5Qvyhg4Xls%3D&reserved=0

2 1

Re: How to Upgrade Node with Local Storage ?
by Adam Xu 21 Apr '21

21 Apr '21

For oVirt Node that using Local Storage, I think you should shutdown all your vms before you upgrade the Node. 在 2021/4/19 22:09, Nur Imam Febrianto 写道: > > Hi, > > How we can upgrade oVirt Node that using Local Storage ? Seems I cant > find any good documentation about this. > > Planning to upgrade one 4.4.4 node with local storage to 4.4.5. > > Thanks before. > > Regards, > > Nur Imam Febrianto > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZOCHCAJPXO4LT…

2 1

oVirt Node's Future Regarding CentOS Stream
by eshwayri＠gmail.com 21 Apr '21

21 Apr '21

So I just finished migrating my 4.3 engine to 4.4 on a brand new RHvEL8 install; next step is to upgrade the hosts. When I first started with oVirt I used my own CentOS installs, but quickly decided that it made no sense for my use case. Now I am looking at upgrading from 4.3 to 4.4 and asking myself the same question. Up to now oVirt node has been using the same exact OS I would have used +/- a few extra packages, but with the traditional CentOS going away it really depends on what the new oVirt nodes are going to be based on. I have a feeling the answer to that question is CentOS Stream, which I don't feel comfortable with for this task. While I am sure the developers will test the combination before releasing a new node, they are still only testing whatever specific hardware combination they have. There could be numerous weird bugs that will only show up in certain situations. If Stream was as stable as an EL release, there wouldn't be EL releases. I also appreciate the fa ct that oVirt is itself a work in progress, but the stable branch is considerably more like an EL release than a stream. Anyway, back to the point. Just want to confirm the future for node is stream before I go wasting time building my own EL8 hosts.

3 3

Re: FreeBSD 13 and virtio
by Thomas Hoberg 20 Apr '21

20 Apr '21

q35 with BIOS as that is the cluster default with >4.3. Running the dmesg messages through my mind as I remember them, the vio hardware may be all PCIe based, which would explain why this won't work on a virtual FX 440FX system, because those didn't have PCIe support AFAIK. Any special reason why you'd want them based on 440FX? And I also tested with GhostBSD, which is still 12.* based, and that doesn't seem to have vio support, at least I could not see a hard disk there, which confirms your observation there.

2 3

Re: FreeBSD 13 and virtio
by Sandro Bonazzola 20 Apr '21

20 Apr '21

Maybe you can have a look at https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=236922 "Bug 236922 - Virtio fails as QEMU-KVM guest with Q35 chipset on Ubuntu 18.04.2 LTS" it's from ~20 days ago and the bug is still open Il giorno mar 20 apr 2021 alle ore 14:16 Nur Imam Febrianto < nur_imam(a)outlook.com> ha scritto: > Seems strange. I want to use q35, but whenever I try even to start the > installation (vm disk using virtio-scsi/virtio, net adapter using virtio) > it always shows me the installer doesn’t detect any disk. I have an > existing VM too that recently upgraded from 12.2 to 13. It uses i440FX with > virtio-scsi disk and virtio network. If I try to change the machine into > q35, it keeps stuck at boot after “promiscuous mode enabled”. > > Don’t know what’s wrong. Using oVirt 4.4.5. Can you share your VM Config ? > > > > *From: *Thomas Hoberg <thomas(a)hoberg.net> > *Sent: *20 April 2021 17:27 > *To: *users(a)ovirt.org > *Subject: *[ovirt-users] Re: FreeBSD 13 and virtio > > > > q35 with BIOS as that is the cluster default with >4.3. > > Running the dmesg messages through my mind as I remember them, the vio > hardware may be all PCIe based, which would explain why this won't work on > a virtual FX 440FX system, because those didn't have PCIe support AFAIK. > > Any special reason why you'd want them based on 440FX? > > And I also tested with GhostBSD, which is still 12.* based, and that > doesn't seem to have vio support, at least I could not see a hard disk > there, which confirms your observation there. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir… > oVirt Code of Conduct: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir… > List Archives: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov… > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFTCXCLC6Q5LV… > -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

1 0

oVirt Node
by KSNull Zero 20 Apr '21

20 Apr '21

Hello! We want to switch OS based oVirt instalation to oVirt-Node based. Is it safe to have OS based hosts and oVirt-Node hosts in the same cluster (with FC shared storage) during transition ? Thank you.

2 1

rhv-log-collector-analyzer available missing?
by Juhani Rautiainen 20 Apr '21

20 Apr '21

Hi! I'm trying to upgrade SHE from 4.3->4.4. Instructions from https://www.ovirt.org/documentation/upgrade_guide/#SHE_Upgrading_from_4-3 has step "4.2 Analyzing the Environment". My installation doesn't bring the tool rhv-log-collector-analyzer although wiki has a notice that it has been available since v4.2.5? [root@ovirtmgr ~]# yum install rhv-log-collector-analyzer Loaded plugins: fastestmirror, versionlock Determining fastest mirrors ovirt-4.3-epel/x86_64/metalink | 34 kB 00:00:00 * base: mirror.hosthink.net * extras: mirror.hosthink.net * ovirt-4.3: resources.ovirt.org * ovirt-4.3-epel: mirrors.nxthost.com * updates: mirror.hosthink.net base | 3.6 kB 00:00:00 centos-sclo-rh-release | 3.0 kB 00:00:00 extras | 2.9 kB 00:00:00 ovirt-4.3 | 3.0 kB 00:00:00 ovirt-4.3-centos-gluster6 | 3.0 kB 00:00:00 ovirt-4.3-centos-opstools | 2.9 kB 00:00:00 ovirt-4.3-centos-ovirt-common | 3.0 kB 00:00:00 ovirt-4.3-centos-ovirt43 | 2.9 kB 00:00:00 ovirt-4.3-centos-qemu-ev | 3.0 kB 00:00:00 ovirt-4.3-epel | 4.7 kB 00:00:00 ovirt-4.3-virtio-win-latest | 3.0 kB 00:00:00 sac-gluster-ansible | 3.3 kB 00:00:00 updates | 2.9 kB 00:00:00 (1/9): extras/7/x86_64/primary_db | 232 kB 00:00:00 (2/9): ovirt-4.3-centos-gluster6/x86_64/primary_db | 120 kB 00:00:00 (3/9): ovirt-4.3-epel/x86_64/group_gz | 96 kB 00:00:00 (4/9): base/7/x86_64/primary_db | 6.1 MB 00:00:00 (5/9): ovirt-4.3-epel/x86_64/updateinfo | 1.0 MB 00:00:00 (6/9): ovirt-4.3-epel/x86_64/primary_db | 6.9 MB 00:00:00 (7/9): centos-sclo-rh-release/x86_64/primary_db | 2.9 MB 00:00:00 (8/9): sac-gluster-ansible/x86_64/primary_db | 12 kB 00:00:00 (9/9): updates/7/x86_64/primary_db | 7.1 MB 00:00:00 No package rhv-log-collector-analyzer available. Error: Nothing to do Are we missing a repo or is this just copy/paste error from RHV docs and this step shouldn't even be in the oVirt docs? Thanks, Juhani -- Juhani Rautiainen jrauti(a)iki.fi

3 3

Re: FreeBSD 13 and virtio
by Thomas Hoberg 20 Apr '21

20 Apr '21

I've just given it a try: works just fine with me. But I did notice, that I chose virtio-scsi when I created the disk, don't now if that makes any difference, but as an old-timer, I still got "SCSI" ingrained as "better than ATA". Chose FreeBSD 9.2 x64 as OS type while creating the VM (nothing closer appears in the selection box), again don't know if there are better choices. iperf3 shows slightly lower performance than a typical Linux guest, still rather close to 10Gbit/s on my network from the FreeBSD13 guest to a host "next-door", around 40Gbit/s VM to host. Verfied usage of vtnet0/VirtIO NIC and vtscsi0/VirtIO SCSI via dmesg.

2 1

Is it possible to upgrade 3 node HCI from 4.3 to 4.4?
by Jayme 20 Apr '21

20 Apr '21

I have a fairly stock three node HCI setup running oVirt 4.3.9. The hosts are oVirt node. I'm using GlusterFS storage for the self hosted engine and for some VMs. I also have some other VMs running from an external NFS storage domain. Is it possible for me to upgrade this environment to 4.4 while keeping some of the VMs on GlusterFS storage domains running? Does the upgrade require an additional physical host? I'm reading through the upgrade guide and it's not very clear to me how the engine is reinstalled on CentOS8. Do you need a 4th host, or do you take one of the three existing hosts down, wipe it and install ovirt node 4.4? Would it be easier for me to just move all VMs to my NFS storage domain, wipe all hosts and deploy a brand new 4.4 HCI cluster then import the NFS storage domain? Will the 4.3 VMs on the NFS storage domain import/run properly into the new 4.4 deployment or are there any other considerations?

3 4

intel_iommu=on kvm-intel.nested=1 deactivates rp_filter kernel option
by Nathanaël Blanchet 20 Apr '21

20 Apr '21

Hello, I have two kind of hosts: * some with default ovirt node 4.4 kernel settings * some with custom kernel settings including intel_iommu=on kvm-intel.nested=1 I can't open vm console from the second category host when binding from a different vlan because the host is unreacheable But if I set sysctl -w net.ipv4.conf.all.rp_filter=2, I can bind the host and open a vm console. I didn't test if this behaviour is because of Hostdev Passthrough & SR-IOV or Nested Virtualization. Is it an expected behaviour or a bug? -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

Two selfhosted engines
by wilrikvdvliert＠hotmail.com 20 Apr '21

20 Apr '21

Dear forum, If I understand correctly, I need shared storage for the self-hosted engine to make it highly available. But is it possible to create 2 self-hosted engines on 2 hosts and make it high available this way? Kind regard

3 2

ova import
by eevans＠digitaldatatechs.com 20 Apr '21

20 Apr '21

I am running Ovirt 4.3 and exported machines as ova which includes disks. When I re import them. the disks are thin provisioned and the vm will not boot. Any idea how to get the import to preallocate disks? I have vms that will not boot. It states no bootable disk is available. It seems the virt2vm isn't working correctly. ANy help would be appreciated. Eric

4 5

[Help] The engine is not stable on HostedEngine with GlusterFS Herperverged deployment
by mengz.you＠outlook.com 20 Apr '21

20 Apr '21

Hi, I deployed a oVirt (4.3.10) cluster with HostedEngine and GlusterFS volumes (engine, vmstore, data), the glusterfs cluster on node1/node2/node3, and the engine vm can be running on those 3 nodes. Then I added a 4th nodes into cluster. But, when I operates on Eninge Web Portal, it's always reports 503 error, then I checked `hsoted-engine --vm-status`, see below: ``` [root@vhost1 ~]# hosted-engine –vm-status –== Host vhost1.yhmk.lan (id: 1) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost1.<span style=”background-color: rgb(255, 255, 255); color: rgb(51, 51, 51);”>alatest</span>.lan Host ID : 1 Engine status : {“reason”: “bad vm status”, “health”: “bad”, “vm”: “down_unexpected”, “detail”: “Down”} Score : 0 stopped : False Local maintenance : False crc32 : 1f25baff local_conf_timestamp : 1253650 Host timestamp : 1253649 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1253649 (Thu Apr 8 08:05:48 2021) host-id=1 score=0 vm_conf_refresh_time=1253650 (Thu Apr 8 08:05:48 2021) conf_on_shared_storage=True maintenance=False state=EngineUnexpectedlyDown stopped=False timeout=Thu Jan 15 20:23:29 1970 –== Host vhost2.yhmk.lan (id: 2) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost2.<span style=”background-color: rgb(255, 255, 255); color: rgb(51, 51, 51);”>alatest</span>.lan Host ID : 2 Engine status : {“reason”: “vm not running on this host”, “health”: “bad”, “vm”: “down_unexpected”, “detail”: “unknown”} Score : 3400 stopped : False Local maintenance : False crc32 : 539fc30c local_conf_timestamp : 1253343 Host timestamp : 1253343 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1253343 (Thu Apr 8 08:05:46 2021) host-id=2 score=3400 vm_conf_refresh_time=1253343 (Thu Apr 8 08:05:46 2021) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False –== Host vhost3.yhmk.lan (id: 3) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost3.alatest.lan Host ID : 3 Engine status : {“reason”: “bad vm status”, “health”: “bad”, “vm”: “up”, “detail”: “Powering up”} Score : 3400 stopped : False Local maintenance : False crc32 : 4072e0b8 local_conf_timestamp : 1252345 Host timestamp : 1252345 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1252345 (Thu Apr 8 08:05:42 2021) host-id=3 score=3400 vm_conf_refresh_time=1252345 (Thu Apr 8 08:05:42 2021) conf_on_shared_storage=True maintenance=False state=EngineStarting stopped=False ``` Then, wait a moment, can access web portal again, and check the hosts status, alway reports one or more hosts with label `unavaiable as HA score`, but it will dispear later. And I found, sometimes the engine vm will migrated to another nodes whill this problem occur. So, seems the HostedEngine is not stable, always occur this problem, could you please help me with this ? Thanks!

3 8

Re: ovirt-hosted-engine-cleanup
by Thomas Hoberg 20 Apr '21

20 Apr '21

ovirt-hosted-engine-cleanup will only operate on the host you run it on. In a cluster that might have side-effects, but as a rule it will try to undo all configuration settings that had a Linux host become an HCI member or just a host under oVirt management. While the GUI will try to do the same with Ansible only, the script seems to do a little more and be more thorough. My guess is that it's somewhat of a leftover from the older 'all scripts' legacy of oVirt, before they re-engineered much of it to fit Ansible. It's not perfect, however. I have come across things that it would not undo, and that were extremely difficult to find (a really clean re-install would then help). There was an issue around keys and certificates for KVM that I only remember as a nightmare and more recently I had an issue with it's ansible scripts inserting an LVM device filter specific for a UID that the HCI setup wizard had created, which then precluded it ever working again after running the *cleanup scripts. All I got was "device excluded by a filter" and only much later I found the added line in /etc/lvm.conf not undone, which caused this nail-biter. But generally that message "Is hosted engine setup finished?" mostly indicates that the four major daemons for HCI still have issues. It all starts with glusterd: If you just added a host in HCI with storage, that would like to be properly healed. AFAIK that doesn't actually preclude already using the machine to host VMs, but in the interest of keeping your head clear, I'd suggest concentrating on getting the storage all clean, with gluster happily showing connectivity all around (gluster volume status all etc.) and 'gluster volume heal <volume> [info]' giving good results. Then you need to check on the services ovirt-ha-broker and ovirt-ha-agent as well as vdsmd via 'servicectl status <servicename>' to see what they are complaining about. I typically restart them in this order to iron out the bumps. As long as you give them a bit of time, restarting them periodically doesn't seem to do any harm, but helps them recover from hangs. And then you simply need patience: Things don't happen immediately in oVirt, because few commands ever intervene into anything directly. Instead they set flags here and there which then a myriad of interlocking state machine gears will pick up and respond to, to do things in the proper order and by avoiding the race conditions manual intervention can so easily cause. Even the fastest systems won't give results in seconds. So have a coffee, better yet, some herbal tea, and then look again. There is a good chance oVirt will eventually sort it out (but restarting those daemons really can help things along, as will looking at those error messages and their potential cause).

1 0

Introduction & general question about oVirt
by Nicolas Kovacs 20 Apr '21

20 Apr '21

Hi, I'm a 53-year old Austrian living in Montpezat, a small village in South France. I'm an IT professional with a focus on Linux and free software, and I've been a Linux user since Slackware 7.1. I'm doing web & mail hosting for myself and several small structures like our local school and a handful of local companies. Up until recently these hostings have happened on "bare metal" root servers using CentOS 7. One main server is hosting most of the stuff: WordPress sites, one OwnCloud instance, Dolibarr management software, GEPI learning platform, Postfix/Dovecot mail server, Roundcube webmail, etc. This setup has become increasingly problematic to manage, since applications have more and more specific requirements, like different versions of PHP and corresponding modules. So I decided to split everything up nicely into a series of virtual machines, each one with a nicely tailored setup. I have a couple of sandbox servers, one public and one local, running Oracle Linux 7 (a RHEL clone like CentOS). I played around with it, and KVM-based virtualization already works quite nicely. While looking for documentation, I stumbled over oVirt, which I didn't even know existed until last week. Before I dive head first into it, I'd be curious to know a few general things. 1. Would it be overkill for a small structure like mine? 2. Will I be able to do HA on a series of modest KVM-capable root servers even if they are located in different datacenters across different countries? 3. One problem I couldn't resolve using a bone-headed keep-it-simple KVM setup is backup. For my bare-metal servers I've been using incremental backups using Rsnapshot for years. Here's a blog article I wrote on the subject: https://blog.microlinux.fr/rsnapshot-centos-7/ Unfortunately I can't use this approach with huge QCOW images, at least not without jumping through burning loops. Is there an easy way to perform remote incremental backups with oVirt? BTW, I took a peek at Proxmox and Ceph, but I admit I'm a die-hard RHEL-clone user. Cheers from the sunny South of France, Niki -- Microlinux - Solutions informatiques durables 7, place de l'église - 30730 Montpezat Site : https://www.microlinux.fr Blog : https://blog.microlinux.fr Mail : info(a)microlinux.fr Tél. : 04 66 63 10 32 Mob. : 06 51 80 12 12

4 3

Upgrading single host ovirt "clusters" to v4.5 via command line?
by Gilboa Davara 19 Apr '21

19 Apr '21

Hello all, As the title suggests I have a couple of single-host hyper converged setups, mostly used for testing. As I cannot use the GUI cluster upgrade method on a single host (it requires me to reboot the host, which will require me to shutdown the hosted engine), is there any method to upgrade the cluster / data-center via command line in maintenance=global mode? Beyond that, can I use the same method on my production setups? (multi-node, gluster based setups). Thanks, Gilboa

1 0

Re: FreeBSD 13 and virtio
by Nir Soffer 19 Apr '21

19 Apr '21

On Mon, Apr 19, 2021 at 5:11 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > I’m having an issue, if I’m using q35 and using virtio disk + virtio > network adapter, the guest OS wont detect any disk. I440fx work fine. This > issue happened on FBSD 12.2 too. On FBSD 13 release note, it was said q35 > should working okay now, a lot of people using pc-q35-4.2 machine type > confirm it works now on vanilla KVM. But seems it still doesn’t work on > oVirt. > It will help if you can file a bug about this, and attach a vm xml that works outside of ovirt (e.g using virt-manger, or virsh), so we can compare to our vm xml. Nir > > > *From: *Sandro Bonazzola <sbonazzo(a)redhat.com> > *Sent: *19 April 2021 19:35 > *To: *Nur Imam Febrianto <nur_imam(a)outlook.com> > *Cc: *oVirt Users <users(a)ovirt.org> > *Subject: *Re: [ovirt-users] FreeBSD 13 and virtio > > > > Hi, can you please provide some more details on the issues you're seeing? > > > > Il giorno sab 17 apr 2021 alle ore 06:35 Nur Imam Febrianto < > nur_imam(a)outlook.com> ha scritto: > > Hi, > > > > Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? > > I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it > was the q35 spec issue with the kernel. Lot of people now it works nicely > on FBSD 13, but I cant get it working on oVirt. > > > > Thanks before. > > > > Regards, > > Nur Imam Febrianto > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/FCPJBK3AV4BSB… > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov…> > > > > > -- > > *Sandro Bonazzola* > > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > > Red Hat EMEA > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redh…> > > sbonazzo(a)redhat.com > > > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redh…> > > > *Red Hat respects your work life balance. Therefore there is no need to > answer this email out of your office hours. > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmojo.red…>* > > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/ADIC2ERITKAMC… >

1 0

How to Upgrade Node with Local Storage ?
by Nur Imam Febrianto 19 Apr '21

19 Apr '21

Hi, How we can upgrade oVirt Node that using Local Storage ? Seems I cant find any good documentation about this. Planning to upgrade one 4.4.4 node with local storage to 4.4.5. Thanks before. Regards, Nur Imam Febrianto

1 0

Re: FreeBSD 13 and virtio
by Sandro Bonazzola 19 Apr '21

19 Apr '21

Hi, can you please provide some more details on the issues you're seeing? Il giorno sab 17 apr 2021 alle ore 06:35 Nur Imam Febrianto < nur_imam(a)outlook.com> ha scritto: > Hi, > > > > Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? > > I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it > was the q35 spec issue with the kernel. Lot of people now it works nicely > on FBSD 13, but I cant get it working on oVirt. > > > > Thanks before. > > > > Regards, > > Nur Imam Febrianto > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/FCPJBK3AV4BSB… > -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

2 1

Why and when does oVirt make a compute host part of the HCI Gluster?
by Thomas Hoberg 19 Apr '21

19 Apr '21

My understanding is that in a HCI environment, the storage nodes should be rather static, but that the pure compute nodes, can be much more dynamic or opportunistic: actually those should/could even be switched off and restarted as part of oVirt's resource optimization. The 'pure compute' nodes fall into two major categories, a) those who can run the management engine, b) those who can't. What I don't quite understand is why both types seem to be made 'gluster peers', when they don't contribute storage bricks: shouldn't they just be able to mount Gluster volumes? The reason for my concern is that I actually want to manage these computing hosts with much more freedom. I may have them join and take on workloads, or not and I may want to shut them down. To my irritation I sometimes even see these 'missing' hosts being considered for quorum decisions or being listed e.g. when I do a 'gluster volume engine status'. I find hosts there, that definitely are not contributing bricks to 'engine' (or any other volume). Then I'm not even sure I have consistent behavior when I remove hosts from oVirt: I'd swear that quite a few remain as Gluster peers, even if they are completely invisible from the oVirt GUI (while hosted-engine --vm-status will still list them). So what's the theory here and would it be a bug if removed hosts remain gluster members?

2 3

Expand gluster volumes
by David White 19 Apr '21

19 Apr '21

Is it possible to expand an existing gluster volume? I have a hyperconverged environment, and have enough space right now, but I'm going to have to significantly over-provision my environment. The vast majority of our customers are using a small fraction of the amount of space that they are technically allocated, but we still need to make that space available to them. As a result, I'd like to plan ahead, and go ahead and have a plan to add storage later down the road. I'd like to plan to shut down each server in the cluster (individually, not at once), add storage, and then bring them back online. Once all 3 are back online with the additional storage, I'd like to expand the gluster volume to use the additional space. Is that possible? How? Sent with ProtonMail Secure Email.

3 3

After upgrade to 4.4.5: cockpit login error
by ovirt＠r5d.de 18 Apr '21

18 Apr '21

Hello, 1. Installation ovirt node iso 4.4.4 2. dnf upgrade -> 4.4.5 -> error login cockpit: Message: pr 18 13:02:53 h2 systemd[1]: cockpit-wsinstance-https-factory(a)2-7789-995.service: Succeeded. Apr 18 13:02:53 h2 cockpit-ws[7796]: cockpit-ws: Failed to open certificate file /run/cockpit/tls/e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855: No such file or directory Apr 18 13:02:55 h2 cockpit-ws[7796]: cockpit-session: open(/var/log/btmp) failed: Permission denied What is todo? Thx.

1 0

Ovirt and gluster 9 volume
by eevans＠digitaldatatechs.com 17 Apr '21

17 Apr '21

My setup is 3 Centos 7 servers hyper-converged with a 4th stand alone engine server. My issue is Ovirt is reading the cluster disk as 49GiB instead of 5.5 TB is should be. One server has a 928 GB raid 5 volume, the second has a 7,7 TB raid 10 volume and the third has a 5.5 TB raid 10 volume. How is Ovirt translating this to 49 GiB?? Here is a link to the screen shots for verification. https://1drv.ms/u/s!AvgvEzKKSZHbhLIrRBvQRLmoZOeEyw?e=rO83vw Logs look good unless I missed something. Any help is appreciated. Eric

2 2

Intel Optane DC Persistent Memory - Ovirt / RHEV
by jorgevisentini＠gmail.com 17 Apr '21

17 Apr '21

What is the usage experience of the Intel Optane DC Persistent Memory with oVirt? It's compatible? Have any document for configuration?

3 3

Remote VNC
by David White 17 Apr '21

17 Apr '21

I'm running into the issue described in this thread: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KT3B6N3UZ3DS3… In short, I have ssh to the datacenter. I can ssh to a public IP address with the "-D 8080" option to forward local port 8080 act as a SOCKS proxy. I then edit my local computer's proxy settings and set the SOCKS host to 8080. So this is a system-wide change. I'm not setting the SOCKS proxy in the browser preferences. After I do all that, I'm able to use my browser to get to the engine web UI, and I'm able to login. However, the console for each VM isn't working. In the thread I linked to above, Alan says to do this: 2. SSH to the hypervisor tunneling a local port to that remote console port. 3. Click on the console link in the Engine and locally save the vv file.4. Edit the vv file; change host to localhost and port to whichever port you configured for the local side of the tunnel. Question: I'm confused why I need to tunnel a local port to the remote console port, if I'm already tunneling port 8080 to the host. Question: I don't have much experience with ssh port forwarding. If I already have the SOCKS proxy working, how, exactly, would I accomplish step #2? With the 8080 socks proxy working, I've now tried to run this command: ssh -L 5902:127.0.0.1:5901 username@ovirt-host-ip And in this case, I'm "assuming" that 5902 is going to listen on my local computer, and that I need to edit the vv file to connect to 127.0.0.1, port 5902. That's not working. Maybe I don't understand how SOCKS proxies work, but I was hoping / under the impression that all of my network traffic would go through the ssh tunnel on port 8080, and that vnc would work at that point. Sent with ProtonMail Secure Email.

1 1

FreeBSD 13 and virtio
by Nur Imam Febrianto 17 Apr '21

17 Apr '21

Hi, Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it was the q35 spec issue with the kernel. Lot of people now it works nicely on FBSD 13, but I cant get it working on oVirt. Thanks before. Regards, Nur Imam Febrianto

1 0

Re: Strange Issue with imageio
by Nir Soffer 17 Apr '21

17 Apr '21

On Fri, Apr 16, 2021 at 7:22 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > After upgrading to 4.4.5 from 4.4.4, I’m having a strange issue. Whenever I try to upload something (image or iso) to Storage Domain without clicking Test Connection, upload process wont start. It will shows the file area already uploaded but no upload process. When I try to open the log, seems if I don’t click test connection, it wont open any session in imageio. Upload process will going normally, if I click Test connection first and proceed to upload. Please file ovirt-engine bug, testing the connection should not be required for upload. > Any idea why this is happening ? Don’t have this issue before in 4.4.4. Rebooting the engine doesn’t help either. This is most likely a bug introduced in engine 4.4.5. Nir

2 1

Odd question: changing network MTU
by Chris Adams 16 Apr '21

16 Apr '21

I have an oVirt 4.3 cluster, running in one location. I have to move it to another location. I've got a couple of 1G links between the sites, and that's enough bandwidth for this (at least temporarily), but... I have my iSCSI networks defined with a MTU of 9000, and it turns out the site-to-site links only allow 1500 (and these links are going away after this is done, so I don't think either carrier would be interested in changing things to support larger). Because of that, the storage won't connect up. I tried going "under the hood" and setting a firewalld rule to force the MSS to a smaller value, but that didn't seem to get it. What happens if I change the MTU of an active iSCSI network in oVirt? I could just go manually change it on each node's iSCSI interfaces, but I'm not sure if oVirt might change it back. Also, I'm not sure what would happen to open iSCSI TCP connections (would they reduce gracefully). Any other suggestions/tips/etc.? I'd like to make this as transparent as possible, so was hoping to live-migrate VMs and storage. -- Chris Adams <cma(a)cmadams.net>

3 5

Strange Issue with imageio
by Nur Imam Febrianto 16 Apr '21

16 Apr '21

Hi, After upgrading to 4.4.5 from 4.4.4, I’m having a strange issue. Whenever I try to upload something (image or iso) to Storage Domain without clicking Test Connection, upload process wont start. It will shows the file area already uploaded but no upload process. When I try to open the log, seems if I don’t click test connection, it wont open any session in imageio. Upload process will going normally, if I click Test connection first and proceed to upload. Any idea why this is happening ? Don’t have this issue before in 4.4.4. Rebooting the engine doesn’t help either. Regards, Nur Imam Febrianto

1 0

Re: Expand gluster volumes
by David White 16 Apr '21

16 Apr '21

Sorry, I meant to reply-all, to Strahil's most recent message. So I'm doing so now. In addition to my comments below, this StackOverflow thread summarizes what I have in mind: https://stackoverflow.com/questions/43756405/extend-glusterfs-on-top-of-lvm Sent with ProtonMail Secure Email. ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Friday, April 16, 2021 5:33 AM, David White <dmwhite823(a)protonmail.com> wrote: > I don't think I would have the capability to take on the expense of adding two more servers to my environment, on top of the 4th server I already have, right now. > > I realize the following isn't recommended, but would it be possible to, instead, intentionally degrade the gluster cluster by shutting 1 of the hosts down (put it in maintenance mode), add storage, and bring it back online? > > Perhaps that would be a better approach, rather than try to shift things around with a 4th server. > > Sent with ProtonMail Secure Email. > > ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ > On Thursday, April 15, 2021 7:36 PM, Strahil Nikolov hunter86_bg(a)yahoo.com wrote: > > > Gluster allows converting from replicted to distributed-replicated (so called expansion) of the volume. > > Of course you need to add the same amount of bricks as the replica count (which should be either 'replica 3' or 'replica 3 arbiter 1'). > > The Gluster documentation on the topic is quite extensive , but it's worth mentioning that you need to 'rebalance' your cluster after the expansion or you risk filling the old bricks - while having free space on the new bricks. > > That is expected ,as each file/dir's name is hashed and each subvolume (new vs old bricks) will have it's own range of hashes. When you expand the volume, some of the files/dirs on the old bricks have hashes that match to the new "triplet". > > Also , if you do not rebalance - that will have some performance impact as gluster will search the new bricks (for the files' whose hash matches the new subvolume) before searching the old bricks. > > P.S: I think that the Engine's web interface fully supports that operation, although I'm used to the cli. > > Best Regards, > > Strahil Nikolov > > В четвъртък, 15 април 2021 г., 20:05:50 ч. Гринуич+3, David White via Users users(a)ovirt.org написа: > > Is it possible to expand an existing gluster volume? > > I have a hyperconverged environment, and have enough space right now, but I'm going to have to significantly over-provision my environment. The vast majority of our customers are using a small fraction of the amount of space that they are technically allocated, but we still need to make that space available to them. > > As a result, I'd like to plan ahead, and go ahead and have a plan to add storage later down the road. > > I'd like to plan to shut down each server in the cluster (individually, not at once), add storage, and then bring them back online. Once all 3 are back online with the additional storage, I'd like to expand the gluster volume to use the additional space. Is that possible? How? > > Sent with ProtonMail Secure Email. > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/A7C3X2PW4D42G…

2 5

glance repo in 4.3
by Christoph Köhler 16 Apr '21

16 Apr '21

I use ovirt 4.3.10 and need to get access to a glance repo for vm images/templates. The buld-in external provider 'Public Glance repository for oVirt' (glance.ovirt.org) does not work, it seems not to be maintained. Does someone knows what to do? Greetings from Christoph

2 1

ovirt-hosted-engine-cleanup
by Marko Vrgotic 16 Apr '21

16 Apr '21

Dear oVirt, I have three HE Hosts. Upon upgrade from 4.3.5 to 4.3.10 the Hosted Engine did not start anymore on Host2, but working just fine on Host1 and Host3. I tried to Undeploy – Deploy on Host2 but I noticed that hosted-engine.conf contains only ca path and host id. It looks like either Undeploy properly or Deploy is failing due to reason I am unable to find in the logs. When checking the hosted-engine –vm-status, even though undeployed, the output was still containing Host2 in the list. Than I cleaned metadata on the Host1 and 3 for Host2 and at that point it was forgotten. After that I tried adding the Host2 back to HE pool, first installed the Host2 with fresh OS and than added it to Hosts pool with HostedEngine DEPLOY option. Result was the same. The VDSM on the Host2 was showing ERROR: “2021-04-16 06:47:30,422+0000 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA score '[Errno 2] No such file or directory'Is the Hosted Engine setup finished? (api:196)” The broker is showing the error: “MainThread::WARNING::2021-04-16 06:47:27,514::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Atm, I am thinking of executing the /usr/sbin/ovirt-hosted-engine-cleanup but its effect is not clear to me. Is it going to cleanup any HE deploy remains from the Host its executed on, or its going to cleanup the other two Hosts, rendering my platfrom offline? I have been reading through https://www.ovirt.org/images/Hosted-Engine-4.3-deep-dive.pdf but its effect is not clear. I would have tested it already but this issue is on our production platform, so I need some experts input before taking further action. Please advise. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

1 0

Need to change switch... ovirt kvm concerns?
by jpedrolima＠gmail.com 16 Apr '21

16 Apr '21

Hi I need to migrate the switch (equipment change and VLAN implementation) so I ask you to tell me what to do about the ovirt KVM cluster. What procedures and concerns I must have ? best regards, PL

2 4

Moving hosted engine storage
by Chris Adams 16 Apr '21

16 Apr '21

I'm moving a 4.3 cluster to new storage, and I'm down to the hosted engine. I am reading the following: https://www.ovirt.org/documentation/migrating_from_a_standalone_manager_to_… https://www.ovirt.org/develop/developer-guide/engine/migrate-to-hosted-engi… https://lists.ovirt.org/pipermail/users/2017-January/078739.html The last mentions a couple of options added to engine-backup to filter out the old hosted engine parts, but where do I use them? It looks like they only apply during restore, but from the last time I rebuilt the engine (mvoing from CentOS 6 to CentOS 7), I thought I just provided the backup file to hosted-engine --deploy and it handled the restore. Is there a way to pass those options to hosted-engine --deploy, or should I do like the example and just deploy a brand new engine, then log in and manually apply the backup (and filter options) then? Just trying to make sure I understand current (well, current for 4.3) best practice for replacing the hosted engine's storage array (iSCSI in this case, if that matters). -- Chris Adams <cma(a)cmadams.net>

1 1

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Adding screenshot representing the state: [Graphical user interface, text Description automatically generated] ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 23:00 To: users(a)ovirt.org <users(a)ovirt.org> Cc: Yedidyah Bar David <didi(a)redhat.com> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Looking further onto storage part, checking the host which I am unable to re-add to HE Host pool: [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# ls -la total 8 drwxr-xr-x. 3 nobody nobody 4096 Apr 15 20:47 . drwxr-xr-x. 3 vdsm kvm 42 Apr 15 14:30 .. drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 054c43fc-1924-4106-9f80-0f2ac62b9886 -rwxr-xr-x. 1 nobody nobody 0 Feb 18 2020 __DIRECT_IO_TEST__ [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# cd 054c43fc-1924-4106-9f80-0f2ac62b9886/ [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# ls dom_md ha_agent images master [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# cd ha_agent/ [root@ovirt-sj-02 ha_agent]# ls hosted-engine.lockspace hosted-engine.metadata [root@ovirt-sj-02 ha_agent]# cat hosted-engine.lockspace cat: hosted-engine.lockspace: No such file or directory [root@ovirt-sj-02 ha_agent]# ls -la total 16 drwxr-xr-x. 2 nobody nobody 4096 Mar 31 10:30 . drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 .. lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.lockspace -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.metadata -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/16b3e5ac-e70b-46e3-bf81-322954fe0b44/b6326e48-a7d2-4cba-af91-441db9f353c2 [root@ovirt-sj-02 ha_agent]# cat ^C [root@ovirt-sj-02 ha_agent]# cat /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 cat: /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108: No such file or directory It looks like there is still lockspace and metalinks which point to location thatno longer exists – the links are marked with red. The broker.log is showing the following: Main Thread WARNING storage_broker ovirt_hosted_engine_ha.broker.storage_broker.Storage Broker Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' I am starting to think that I need to run the lockspace reinitialization: 1. on each HE host systemctl stop ovirt-ha-agent ovirt-ha-brokersanlock client shutdown -f 1 # carefully, it could trigger the watchdog and reboot 2. on a single hosthosted-engine --reinitialize-lockspace 3. on each HE hostsystemctl start ovirt-ha-agent ovirt-ha-broker Is action 2 required to be executed only on Host with an issue or the action itself is gonna reinitialize lockspace on all HE Hosts? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 16:57 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Looking further onto storage part, checking the host which I am unable to re-add to HE Host pool: [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# ls -la total 8 drwxr-xr-x. 3 nobody nobody 4096 Apr 15 20:47 . drwxr-xr-x. 3 vdsm kvm 42 Apr 15 14:30 .. drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 054c43fc-1924-4106-9f80-0f2ac62b9886 -rwxr-xr-x. 1 nobody nobody 0 Feb 18 2020 __DIRECT_IO_TEST__ [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# cd 054c43fc-1924-4106-9f80-0f2ac62b9886/ [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# ls dom_md ha_agent images master [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# cd ha_agent/ [root@ovirt-sj-02 ha_agent]# ls hosted-engine.lockspace hosted-engine.metadata [root@ovirt-sj-02 ha_agent]# cat hosted-engine.lockspace cat: hosted-engine.lockspace: No such file or directory [root@ovirt-sj-02 ha_agent]# ls -la total 16 drwxr-xr-x. 2 nobody nobody 4096 Mar 31 10:30 . drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 .. lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.lockspace -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.metadata -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/16b3e5ac-e70b-46e3-bf81-322954fe0b44/b6326e48-a7d2-4cba-af91-441db9f353c2 [root@ovirt-sj-02 ha_agent]# cat ^C [root@ovirt-sj-02 ha_agent]# cat /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 cat: /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108: No such file or directory It looks like there is still lockspace and metalinks which point to location thatno longer exists – the links are marked with red. The broker.log is showing the following: Main Thread WARNING storage_broker ovirt_hosted_engine_ha.broker.storage_broker.Storage Broker Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' I am starting to think that I need to run the lockspace reinitialization: 1. on each HE host systemctl stop ovirt-ha-agent ovirt-ha-brokersanlock client shutdown -f 1 # carefully, it could trigger the watchdog and reboot 2. on a single hosthosted-engine --reinitialize-lockspace 3. on each HE hostsystemctl start ovirt-ha-agent ovirt-ha-broker Is action 2 required to be executed only on Host with an issue or the action itself is gonna reinitialize lockspace on all HE Hosts? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 16:57 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

[ANN] oVirt 4.4.6 Fourth Release Candidate is now available for testing
by Sandro Bonazzola 15 Apr '21

15 Apr '21

oVirt 4.4.6 Fourth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Fourth Release Candidate for testing, as of April 15th, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. Rebase on CentOS Stream Starting with oVirt 4.4.6 RC4 both oVirt Node and oVirt Engine Appliance are based on CentOS Stream. You can still install oVirt 4.4.6 on Red Hat Enterprise Linux, CentOS Linux or equivalent. Please note that when 4.4.6 will be released as generally available, existing oVirt Nodes updating to 4.4.6 will automatically be based on CentOS Stream. Help testing this release candidate will help ensuring a smooth experience for your main installation. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Known issues: - Bug 1946095 <https://bugzilla.redhat.com/show_bug.cgi?id=1946095> - "No valid network interface has been found" when starting HE deployment via cockpit - For testing purposes you can use the command line <https://ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine_us…> Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS 8 Stream * CentOS Linux (or similar) 8.3 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS 8 Stream * CentOS Linux (or similar) 8.3 or newer * oVirt Node 4.4 based on CentOS 8 Stream (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS 8 Stream - oVirt Node NG is already available based on CentOS 8 Stream Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

Failed certificate expiration
by Fabrice Bacchella 15 Apr '21

15 Apr '21

I missed the certificate expiration for the oVirt PKI. So the engine is now totally unable to talk to the hosts. Is there any documentation for this kind of failure recovery ?

1 0

hosted-engine volume removed 3 bricks (replica 3) out of 12 bricks, now I cant start hosted-engine vm
by adrianquintero＠gmail.com 15 Apr '21

15 Apr '21

Hi, I tried removing a replica 3 brick from a distributed replicated volume which holds the ovirt hosted-engine VM. As soon as I hit commit the VM went into pause, I tried to recover the volume ID "daa292aa-be5c-426e-b124-64263bf8a3ee" from the remvoed bricks and now I am able to do a "hosted-engine --vm-status Error I see in the logs: --------------------------------- MainThread::WARNING::2021-04-14 17:26:12,348::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: Command Image.prepare with args {'imageID': '9feffcfa-6af2-4de3-b7d8-e57b84d56003', 'storagepoolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'daa292aa-be5c-426e-b124-64263bf8a3ee', 'storagedomainID': '8db17b28-ecbb-4853-8a90-6ed2f69301eb'} failed: (code=201, message=Volume does not exist: (u'daa292aa-be5c-426e-b124-64263bf8a3ee',)) --------------------------------- on the following mount I see the volumeID twice: ------------------------ [root@vmm10 images]# find /rhev/data-center/mnt/glusterSD/192.168.0.4\:_engine/ -name "daa292aa-be5c-426e-b124-64263bf8a3ee" /rhev/data-center/mnt/glusterSD/192.168.0.4:_engine/8db17b28-ecbb-4853-8a90-6ed2f69301eb/images/9feffcfa-6af2-4de3-b7d8-e57b84d56003/daa292aa-be5c-426e-b124-64263bf8a3ee /rhev/data-center/mnt/glusterSD/192.168.0.4:_engine/8db17b28-ecbb-4853-8a90-6ed2f69301eb/images/9feffcfa-6af2-4de3-b7d8-e57b84d56003/daa292aa-be5c-426e-b124-64263bf8a3ee [root@vmm10 9feffcfa-6af2-4de3-b7d8-e57b84d56003]# ls -lh total 131M -rw-rw----. 1 vdsm kvm 64M Apr 14 19:40 daa292aa-be5c-426e-b124-64263bf8a3ee -rw-rw----. 1 vdsm kvm 64M Apr 14 19:40 daa292aa-be5c-426e-b124-64263bf8a3ee -rw-rw----. 1 vdsm kvm 1.0M Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.lease -rw-rw----. 1 vdsm kvm 1.0M Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.lease -rw-r--r--. 1 vdsm kvm 329 Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.meta -rw-r--r--. 1 vdsm kvm 329 Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.meta Any ideas on how to recover ?

1 0

Can't Create VM from Template in VM portal
by Andrey Rusakov 14 Apr '21

14 Apr '21

We are trying to orginize self manage VM portal for our customers. And there is VM portal in oVirt. What did we do - Create user, Crate group, create quota, create Vm template. All permissions by default + VmCreator (to allow user create disks from template). Problem Can't Create VM from Template - we got "No Disks Defined" on "Storage" page (create new VM) Posible solution - Grant "Disk Operator" Role, But in this case, All users can see All VMs. Is it posible to limit users to see VMs in a users group and permissions to create new VMs from template?

1 0

Ovirt node - 4.4.4 -> 4.4.5 upgrade failed - do i need a reinstall ? tried removing /dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 to reinstall rpm..
by morgan cox 14 Apr '21

14 Apr '21

Hi. I have a 2 node cluster (both installed from the Ovirt-node iso) , 1 server is 100% fine, but one server I tried to update when there were issues with the ovirtmgmt network (I wasn't aware of at the time) - as a result the server update failed, and was still on ovirt-node 4.4.4 after - I could see the LVM layer for 4.4.5 though. The network is fine now (hence the other server being ok) - I tried reinstalling the package ovirt-node-ng-image-update-4.4.5.1-1.el8.noarch.rpm but it failed due to LVM lv for 4.4.5 already existing ... So I tried removing the LV - i.e # lvremove /dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 however now I'm sure I have less 4.4.4 lvs .. i.e ------ [root@ng2-ovirt-kvm3 mcox]# lvs LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert home onn Vwi-aotz-- 1.00g pool00 10.05 ovirt-node-ng-4.4.4.1-0.20210208.0+1 onn Vwi-aotz-- 191.00g pool00 2.27 pool00 onn twi-aotz-- 218.00g 2.48 1.92 swap onn -wi-ao---- 4.00g tmp onn Vwi-aotz-- 1.00g pool00 2.24 var onn Vwi-aotz-- 15.00g pool00 2.80 var_crash onn Vwi-aotz-- 10.00g pool00 0.21 var_log onn Vwi-aotz-- 8.00g pool00 5.97 var_log_audit onn Vwi-aotz-- 2.00g pool00 1.14 ---- Where as on the working server I have these Ovirt Node LVs ovirt-node-ng-4.4.4.1-0.20210208.0 onn Vwi---tz-k 191.00g pool00 root ovirt-node-ng-4.4.4.1-0.20210208.0+1 onn Vwi-a-tz-- 191.00g pool00 ovirt-node-ng-4.4.4.1-0.20210208.0 1.86 ovirt-node-ng-4.4.5.1-0.20210323.0 onn Vri---tz-k 191.00g pool00 ovirt-node-ng-4.4.5.1-0.20210323.0+1 onn Vwi-aotz-- 191.00g pool00 ovirt-node-ng-4.4.5.1-0.20210323.0 1.58 Anyway I tried to reinstall the ovirt-node-ng-image-update-4.4.5.1-1.el8.noarch.rpm package after removal of lv and files in /boot But install still fails .. Is there anything I can do to update this node - or should I bite the bullet and reinstall ? this is from /var/log/imgbased.log -> -------------------------------------- 2021-04-14 16:05:56,634 [INFO] (MainThread) Adding a new layer after <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [INFO] (MainThread) Adding a new layer after <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Basing new layer on previous: <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Finding next layer based on <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Suggesting for layer for base ovirt-node-ng-4.4.5.1-0.20210323.0 2021-04-14 16:05:56,635 [DEBUG] (MainThread) ... without layers 2021-04-14 16:05:56,635 [INFO] (MainThread) New layer will be: <Layer ovirt-node-ng-4.4.5.1-0.20210323.0+1 /> 2021-04-14 16:05:56,635 [DEBUG] (MainThread) Calling: (['vgs', '--noheadings', '--ignoreskippedcluster', '--select', 'vg_tags = imgbased:vg', '-o', 'vg_name'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,697 [DEBUG] (MainThread) Returned: b'onn' 2021-04-14 16:05:56,698 [DEBUG] (MainThread) Calling: (['vgs', '--noheadings', '--ignoreskippedcluster', '@imgbased:pool', '-o', 'lv_full_name'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,757 [DEBUG] (MainThread) Returned: b'onn/pool00' 2021-04-14 16:05:56,758 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '--nosuffix', '--units', 'm', '-o', 'metadata_percent,lv_metadata_size', 'onn/pool00'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,829 [DEBUG] (MainThread) Returned: b'2.05 1024.00' 2021-04-14 16:05:56,830 [DEBUG] (MainThread) Pool: onn/pool00, metadata size=1024.0M (2.05%) 2021-04-14 16:05:56,830 [DEBUG] (MainThread) Calling: (['lvchange', '--activate', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0', '--ignoreactivationskip'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,953 [DEBUG] (MainThread) Calling: (['lvcreate', '--snapshot', '--name', 'ovirt-node-ng-4.4.5.1-0.20210323.0+1', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,111 [DEBUG] (MainThread) Returned: b'WARNING: Sum of all thin volume sizes (610.00 GiB) exceeds the size of thin pool onn/pool00 and the size of whole volume group (<277.78 GiB).\n Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0+1" created.' 2021-04-14 16:05:57,112 [DEBUG] (MainThread) Calling: (['lvchange', '--activate', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1', '--ignoreactivationskip'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,231 [DEBUG] (MainThread) Calling: (['lvchange', '--addtag', 'imgbased:layer', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,310 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 changed.' 2021-04-14 16:05:57,311 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,383 [DEBUG] (MainThread) Returned: b'/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' 2021-04-14 16:05:57,400 [DEBUG] (MainThread) Calling: (['mktemp', '-d', '--tmpdir', 'mnt.XXXXX'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,404 [DEBUG] (MainThread) Returned: b'/tmp/mnt.aGJ3A' 2021-04-14 16:05:57,404 [DEBUG] (MainThread) Calling: (['mount', '-onouuid', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,537 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,561 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,565 [DEBUG] (MainThread) Running: ['xfs_admin', '-U', 'generate', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:05:57,566 [DEBUG] (MainThread) Calling: (['xfs_admin', '-U', 'generate', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': -2, 'close_fds': True} 2021-04-14 16:05:57,957 [DEBUG] (MainThread) Calling: (['lvchange', '--setactivationskip', 'n', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:58,040 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 changed.' 2021-04-14 16:05:58,041 [DEBUG] (MainThread) Calling: (['lvchange', '--setactivationskip', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:58,116 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0 changed.' 2021-04-14 16:05:58,117 [DEBUG] (MainThread) Got: <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' /> and <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' /> 2021-04-14 16:05:58,117 [DEBUG] (MainThread) Calling: (['mount', '--make-rprivate', '/var'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:58,122 [DEBUG] (MainThread) Calling: (['systemctl', 'is-active', 'vdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:58,141 [DEBUG] (MainThread) Returned: b'active' 2021-04-14 16:05:58,141 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'vdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:08,940 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'supervdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,072 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'vdsm-network'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,090 [DEBUG] (MainThread) Calling: (['vgchange', '-ay', '--select', 'vg_tags = imgbased:vg'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,167 [DEBUG] (MainThread) Returned: b'11 logical volume(s) in volume group "onn" now active' 2021-04-14 16:06:09,168 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-o', 'lv_full_name', '--select', 'lv_tags = imgbased:base || lv_tags = imgbased:layer'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,229 [DEBUG] (MainThread) Returned: b'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1\n onn/ovirt-node-ng-4.4.5.1-0.20210323.0 \n onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' 2021-04-14 16:06:09,230 [DEBUG] (MainThread) All LV names: ['onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:06:09,230 [DEBUG] (MainThread) All LVS: [<LV 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' />] 2021-04-14 16:06:09,230 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,293 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,294 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,357 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,358 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,417 [DEBUG] (MainThread) Returned: b'imgbased:base' 2021-04-14 16:06:09,418 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,490 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,491 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,557 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Our LVS: [<LV 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' />] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Names: ['ovirt-node-ng-4.4.4.1-0.20210208.0+1', 'ovirt-node-ng-4.4.5.1-0.20210323.0', 'ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Images: [<Layer ovirt-node-ng-4.4.4.1-0.20210208.0+1 />, <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] />, <Layer ovirt-node-ng-4.4.5.1-0.20210323.0+1 />] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.o5bFp'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,579 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.o5bFp'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,583 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.CcHrE'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,601 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.CcHrE'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,605 [ERROR] (MainThread) Update failed, resetting registered LVs 2021-04-14 16:06:09,606 [DEBUG] (MainThread) Calling: (['sync'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,615 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_dm_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,683 [DEBUG] (MainThread) Returned: b'/dev/mapper/onn-ovirt--node--ng--4.4.5.1--0.20210323.0' 2021-04-14 16:06:09,684 [DEBUG] (MainThread) Calling: (['lvremove', '-ff', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,820 [DEBUG] (MainThread) Returned: b'Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0" successfully removed' 2021-04-14 16:06:09,821 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_dm_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,886 [DEBUG] (MainThread) Returned: b'/dev/mapper/onn-ovirt--node--ng--4.4.5.1--0.20210323.0+1' 2021-04-14 16:06:09,887 [DEBUG] (MainThread) Calling: (['lvremove', '-ff', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:10,207 [DEBUG] (MainThread) Returned: b'Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0+1" successfully removed' Traceback (most recent call last): File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code exec(code, run_globals) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/__main__.py", line 53, in <module> CliApplication() File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/__init__.py", line 82, in CliApplication app.hooks.emit("post-arg-parse", args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/hooks.py", line 120, in emit cb(self.context, *args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 75, in post_argparse six.reraise(*exc_info) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/six.py", line 703, in reraise raise value File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 66, in post_argparse base, _ = LiveimgExtractor(app.imgbase).extract(args.FILENAME) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 148, in extract "%s" % size, nvr) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 128, in add_base_with_tree new_layer_lv = self.imgbase.add_layer(new_base) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/imgbase.py", line 213, in add_layer self.hooks.emit("new-layer-added", prev_lv, new_lv) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/hooks.py", line 120, in emit cb(self.context, *args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/osupdater.py", line 88, in on_new_layer previous_layer_lv = get_prev_layer_lv(imgbase, new_lv) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/osupdater.py", line 143, in get_prev_layer_lv layer_before = imgbase.naming.layer_before(new_layer) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 74, in layer_before layers = self.layers() File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 58, in layers for b in self.tree(): File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 226, in tree bases[img.base.nvr].layers.append(img) KeyError: <NVR ovirt-node-ng-4.4.4.1-0.20210208.0 /> --------------------

1 0

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Yedidyah Bar David 14 Apr '21

14 Apr '21

Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://www.ovirt.org/images/Hosted-Engine-4.3-deep-dive.pdf Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: www.activevideo.com > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: www.activevideo.com > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

2 1

Install oVirt using the Cockpit wizard
by rajkumar madhu 14 Apr '21

14 Apr '21

Hi Team, I have installed oVirt repo in my centos8 server ( dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm ) then while executing Engine-setup command in my server .I am getting the below error message.Could you please check and give me some suggestions to resolve the issue . engine-setup [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20210412024224-fvaq4e.log Version: otopi-1.9.4 (otopi-1.9.4-1.el8) [ ERROR ] Failed to execute stage 'Environment setup': Cannot connect to ovirt cinderlib database using existing credentials: ovirt_cinderlib@localhost:5432 [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20210412024224-fvaq4e.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20210412024227-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Regards, Rajkumar M 9176772077.

2 1

Ovirt with Oracle Linux 8.3 & Cockpit - Direct Luns
by hansontodd＠gmail.com 14 Apr '21

14 Apr '21

Is Ovirt compatible with Oracle Linux 8.3? I have KVM & Cockpit running on Oracle Linux 8.3 but don't see a way to map direct luns (like RDM's) to the VM in the Cockpit interface. Do I need to move back to Centos 7.x or RHEL 7.x with Ovirt to be able to use direct luns? Can Ovirt and Cockpit coexist?

3 2

Error hosted-engine: Engine status: {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"}
by jesado74＠gmail.com 14 Apr '21

14 Apr '21

Hello. I have a 4 host infrastructure in ovirt and a few days ago the hosted-engine was turned off and I cannot turn it on from any host. Any ideas? Thanks. --== Host host1.myhost.com (id: 7) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : host1.myhost.com Host ID : 7 Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"} Score : 0 stopped : False Local maintenance : False crc32 : d5633613 local_conf_timestamp : 31176590 Host timestamp : 31176590

3 3

Add Gluster only nodes?
by mathias.westerlund＠wdmab.se 14 Apr '21

14 Apr '21

Hello! We have a medium sized hyper converged setup where we run SSD based bricks on the hosts. we also have an iscsi storage domain towards some spinner boxes for slow bulk storage but now we would like to add an medium sized storage option where mid sized requirements and mid level I/O requirements can exist. Our hyperconverged is NVME Our spinner is Sata. We now want to add an sata SSD storage option. We have some 25 slot hosts that are going to fill this usecase and we are now wondering, is there a way we can deploy gluster on these nodes using ovirt without giving them the VM role? Due to this storage being aimed towards things such as databases and other intensive (But not as intensive as our NVME layer) use cases we dont want there to be any VM load on these machines because of the pure number of bricks on the machines and the redhat best practice of 1 core per brick. Can i use cockpit/ovirt to deploy the above or do i have to set up an gluster cluster manually and then add it to ovirt???

1 0

New Setup - hosts - are not synchronized with their Logical Network configuration: ovirtmgmt.
by morgan cox 14 Apr '21

14 Apr '21

Hi After installing new hosts they show as status 'up'. however I get a warning such as Host ng2-ovirt-kvm4's following network(s) are not synchronized with their Logical Network configuration: ovirtmgmt. Which means ovirtmgmt is not working. I realise the issue is due to no network config for it - its set to DHCP and there is no server. The way I have setup the network on the hosts is (I used the ovirt-node 4.4.4 iso to install the nodes) /var/lib/vdsm/persistence/ ├── netconf -> /var/lib/vdsm/persistence/netconf.JkcBbtya └── netconf.JkcBbtya ├── bonds │ └── bond0 ├── devices └── nets ├── ovirtmgmt └── td-hv td-hv - is a bonded bridge + VLAN and has the network config with correct ip and where the firewall access is allowing the ports used for ovirt (see config below) Can I make the existing td-hv profile replace ovirtmgmt ? (i.e add ovirtmgmt functionality to existing network device td-hv) Or should I use the existing settings from td-hv and add them to ovirtmgmt and remove td-hv ? Config below - any advice would be great --- /etc/sysconfig/network-scripts/ifcfg-bond0.1700 BONDING_OPTS="mode=active-backup downdelay=0 miimon=100 updelay=0" TYPE=Bond BONDING_MASTER=yes NAME=bond0 UUID=5ab633aa-cd30-4ca8-9109-dbb4541f039b DEVICE=bond0 ONBOOT=yes HWADDR= MACADDR=3C:A8:2A:15:F6:12 MTU=1500 LLDP=no BRIDGE=ovirtmgmt --- --- [root@ng2-ovirt-kvm4 mcox]# cat /etc/sysconfig/network-scripts/ifcfg-bond0.1700 VLAN=yes TYPE=Vlan PHYSDEV=bond0 VLAN_ID=1700 REORDER_HDR=yes GVRP=no MVRP=no HWADDR= NAME=bond0.1700 UUID=e2b318e8-83af-4573-a637-fe20326f2c1a DEVICE=bond0.1700 ONBOOT=yes MTU=1500 LLDP=no BRIDGE=td-hv --- --- [root@ng2-ovirt-kvm4 mcox]# cat /etc/sysconfig/network-scripts/ifcfg-ovirtmgmt STP=no TYPE=Bridge HWADDR= MTU=1500 PROXY_METHOD=none BROWSER_ONLY=no BOOTPROTO=dhcp DEFROUTE=yes DHCP_CLIENT_ID=mac IPV4_DHCP_TIMEOUT=2147483647 IPV4_FAILURE_FATAL=no IPV6_DISABLED=yes IPV6INIT=no NAME=ovirtmgmt UUID=202586b0-ebe7-48ae-b316-e2cfd2dc4cc8 DEVICE=ovirtmgmt ONBOOT=yes AUTOCONNECT_SLAVES=yes LLDP=no ---

2 3

Need help recovering ovirt engine (was: New Management VLAN for hyperconverged cluster)
by David White 13 Apr '21

13 Apr '21

I was able to fix the connectivity issues between all 3 hosts. It turned out that I hadn't completely deleted the old vlan settings from the host. I re-ran "nmcli connection delete" on the old vlan. After that, I had to edit a network-scripts file and change/fix the bridge to use ifcfg-ovirtmgmt. After I did all that, the problematic host was accessible again. All 3 Gluster peers are now able to see each other and communicate over the management network. From the command line, I was then able to successfully run "hosted-engine --connect-storage" without errors. I was also able to then run "hosted-engine --vm-start". Unfortunately, the engine itself is still unstable, and when I access the web UI / oVirt Manager, it shows that all 3 hosts are inaccessible and down. I don't understand how the web UI is operational at all if the engine thinks that all 3 hosts are inaccessible. What's going on there? Although the initial problem was my own doing (I changed the management vlan), I'm deeply concerned with how unstable everything became - and has continued to be- ever since I lost connectivity to the 1 host. I thought the point of all of this was that things would (should) continue to work if 1 of the hosts went away. Anyway, at that point, all 3 hosts are able to communicate with each other over the management network, but the engine still thinks that all 3 hosts are down, and is unable to manage anything. Any suggestions on how to proceed would be much appreciated. Sent with ProtonMail Secure Email. ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Wednesday, April 7, 2021 8:28 PM, David White <dmwhite823(a)protonmail.com> wrote: > I still haven't been able to resurrect the 1st host, so I've spent some time trying to get the hosted engine stable. I would welcome input on how to fix the problematic host so that it can be accessible again. > > As per my original email, this all started when I tried to change the management vlan. I honestly cannot remember what I did (if anything) to the actual hosts when this all started, but my troubleshooting steps today have been to try to fiddle with the vlan settings and /etc/sysconfig/network-scripts/ files on the problematic host to switch from the original vlan (1) to the new vlan (10). > > Until then, I'm troubleshooting why the hosted engine isn't really working, since the other two hosts are operational. > > The hosted engine is "running" -- I can access and navigate around the oVirt Manager. > However, it appears that all of the storage domains are down, and all of the hosts are "NonOperational". I was, however, able to put two of the hosts into Maintenance Mode, including the problematic 1st host. > > This is what I see on the 2nd host: > > [root@cha2-storage network-scripts]# gluster peer status > Number of Peers: 2 > > Hostname: cha1-storage.mgt.example.com > Uuid: 348de1f3-5efe-4e0c-b58e-9cf48071e8e1 > State: Peer in Cluster (Disconnected) > > Hostname: cha3-storage.mgt.example.com > Uuid: 0563c3e8-237d-4409-a09a-ec51719b0da6 > State: Peer in Cluster (Connected) > > [root@cha2-storage network-scripts]# hosted-engine --vm-status > The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. > > [root@cha2-storage network-scripts]# hosted-engine --connect-storage > Traceback (most recent call last): > File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main > "__main__", mod_spec) > File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code > exec(code, run_globals) > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/connect_storage_server.py", line 30, in <module> > timeout=ohostedcons.Const.STORAGE_SERVER_TIMEOUT, > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 312, in connect_storage_server > sserver.connect_storage_server(timeout=timeout) > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/storage_server.py", line 394, in connect_storage_server > 'Connection to storage server failed' > RuntimeError: Connection to storage server failed > > The ovirt-engine-ha service seems to be continuously trying to load / activate, but failing: > [root@cha2-storage network-scripts]# systemctl status -l ovirt-ha-agent > ● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent > Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service; enabled; vendor preset: disabled) > Active: activating (auto-restart) (Result: exit-code) since Wed 2021-04-07 20:24:46 EDT; 60ms ago > Process: 124306 ExecStart=/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent (code=exited, status=157) > Main PID: 124306 (code=exited, status=157) > > Some recent entries in /var/log/ovirt-hosted-engine-ha/agent.log > MainThread::ERROR::2021-04-07 20:22:59,115::agent::144::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Trying to restart agent > MainThread::INFO::2021-04-07 20:22:59,115::agent::89::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Agent shutting down > MainThread::INFO::2021-04-07 20:23:09,717::agent::67::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 2.4.6 started > MainThread::INFO::2021-04-07 20:23:09,742::hosted_engine::242::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Certificate common name not found, using hostname to identify host > MainThread::INFO::2021-04-07 20:23:09,837::hosted_engine::548::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection > MainThread::INFO::2021-04-07 20:23:09,838::brokerlink::82::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor network, options {'addr': '10.1.0.1', 'network_test': 'dns', 'tcp_t_address': '', 'tcp_t_port': ''} > MainThread::ERROR::2021-04-07 20:23:09,839::hosted_engine::564::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Failed to start necessary monitors > MainThread::ERROR::2021-04-07 20:23:09,842::agent::143::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Traceback (most recent call last): > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 85, in start_monitor > response = self._proxy.start_monitor(type, options) > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1112, in __call__ > return self.__send(self.__name, args) > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1452, in __request > verbose=self.__verbose > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1154, in request > return self.single_request(host, handler, request_body, verbose) > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1166, in single_request > http_conn = self.send_request(host, handler, request_body, verbose) > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1279, in send_request > self.send_content(connection, request_body) > File "/usr/lib64/python3.6/xmlrpc/client.py", line 1309, in send_content > connection.endheaders(request_body) > File "/usr/lib64/python3.6/http/client.py", line 1249, in endheaders > self._send_output(message_body, encode_chunked=encode_chunked) > File "/usr/lib64/python3.6/http/client.py", line 1036, in _send_output > self.send(msg) > File "/usr/lib64/python3.6/http/client.py", line 974, in send > self.connect() > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py", line 74, in connect > self.sock.connect(base64.b16decode(self.host)) > FileNotFoundError: [Errno 2] No such file or directory > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 131, in _run_agent > return action(he) > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 55, in action_proper > return he.start_monitoring() > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 437, in start_monitoring > self._initialize_broker() > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 561, in _initialize_broker > m.get('options', {})) > File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 91, in start_monitor > ).format(t=type, o=options, e=e) > ovirt_hosted_engine_ha.lib.exceptions.RequestError: brokerlink - failed to start monitor via ovirt-ha-broker: [Errno 2] No such file or directory, [monitor: 'network', options: {'addr': '10.1.0.1', 'network_test': 'dns', 'tcp_t_address': '', 'tcp_t_port': ''}] > > MainThread::ERROR::2021-04-07 20:23:09,842::agent::144::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Trying to restart agent > MainThread::INFO::2021-04-07 20:23:09,842::agent::89::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Agent shutting down > > Sent with ProtonMail Secure Email. > > ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ > On Wednesday, April 7, 2021 5:36 PM, David White via Users <users(a)ovirt.org> wrote: > > > I'm working on setting up my environment prior to production, and have run into an issue. > > > > I got most things configured, but due to a limitation on one of my switches, I decided to change the management vlan that the hosts communicate on. Over the course of changing that vlan, I wound up resetting my router to default settings. > > > > I have the router operational again, and I also have 1 of my switches operational. > > Now, I'm trying to bring the oVirt cluster back online. > > This is oVirt 4.5 running on RHEL 8.3. > > > > The old vlan is 1, and the new vlan is 10. > > > > Currently, hosts 2 & 3 are accessible over the new vlan, and can ping each other. > > I'm able to ssh to both hosts, and when I run "gluster peer status", I see that they are connected to each other. > > > > However, host 1 is not accessible from anything. I can't ping it, and it cannot get out. > > > > As part of my troubleshooting, I've done the following: > > From the host console, I ran `nmcli connection delete` to delete the old vlan (VLAN 1). > > I moved the /etc/sysconfig/network-scripts/interface.1 file to interface.10, and edited the file accordingly to make sure the vlan and device settings are set to 10 instead of 1, and I rebooted the host. > > > > The engine seems to be running, but I don't understand why. > > From each of the hosts that are working (host 2 and host 3), I ran "hosted-engine --check-liveliness" and both hosts indicate that the engine is NOT running. > > > > Yet the engine loads in a web browser, and I'm able to log into /ovirt-engine/webadmin/. > > The engine thinks that all 3 hosts is nonresponsive. See screenshot below: > > > > [Screenshot from 2021-04-07 17-33-48.png] > > > > What I'm really looking for help with is to get the first host back online. > > Once it is healthy and gluster is healthy, I feel confident I can get the engine operational again. > > > > What else should I look for on this host? > > > > Sent with ProtonMail Secure Email.

3 7

what host os version or ovirt node version I choose for my production setup
by dhanaraj.ramesh＠yahoo.com 13 Apr '21

13 Apr '21

We had done successful POC of ovirt node & HE with 4.4.5 version and now planning for production. However since 4.4.5 ovirt node& HE based on centOS 8.3, yet Red hat announced CentOs8.3 EOL by End of this year, is there any progress/plan to release ovirt nodes with CentOS stream soon? if we choose to go with Centos 8.3 based oVirt node, what could be the consequences in near term especially when it's come to next production release upgrade? Kindly suggest me which Host version I should choose for Production setup?

2 1

Adding physical RAM to the hosts
by David White 13 Apr '21

13 Apr '21

As readers will already know, I have three oVirt hosts in a hyperconverged cluster. I had a DIMM with too many errors on it, so I scavenged from a spare server that I had in my office precisely for this purpose. I went ahead and replaced all of the RAM, because the DIMMs in my spare were a different speed. While I was at it, I doubled the RAM on this 1 oVirt host. So now, two hosts have 32GB each. And the 3rd host now has 64GB. So total, I should have 128GB of RAM available to the cluster. The engine recognizes that the host now has 64GB of RAM. Screenshot below: [Screenshot from 2021-04-12 19-59-59.png] However, the engine dashboard still shows that only ~93GB of RAM are available to the cluster (screenshot below). [Screenshot from 2021-04-12 19-58-15.png] Should I be worried that the oVirt dashboard hasn't updated to ~128GB (or a bit less, I guess)? Do I need to do anything else? Sent with ProtonMail Secure Email.

2 2

Re: Engine Upgrade to 4.4.5 Version Number Question
by Yedidyah Bar David 13 Apr '21

13 Apr '21

On Tue, Apr 13, 2021 at 7:42 AM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > Fixes the issue by changing OVESETUP_ENGINE_CORE/enable=bool:'False' to OVESETUP_ENGINE_CORE/enable=bool:'True’ > > Still don’t know why it shows false, but now I can confirm after changing that to True, running engine-setup again upgraded my Engien to 4.4.5. > > > > Thanks for your help. Glad that it worked, and thanks for the report! I strongly recommend that you spend some time investigating what/who/why it was changed. This is most likely a mistake someone made at some point. It might be broader than just this file, or it might be some other kind of problem (e.g. a machine crashed in the middle of engine-setup and left files corrupted). If you can't find why/who, and suspect it's a bug, we'd definitely like to get more information. Some things you can check (other than usual site-specific things like who logged in, when you changed stuff there, etc.): - All /var/log/ovirt-engine/setup/* logs, their timestamps, and their contents (e.g. grep them all for "OVESETUP_ENGINE_CORE/enable"). - /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf* - the file itself, and backups (made by engine-setup or otherwise), timestamps etc. - /etc/ovirt-engine/uninstall.d/* - engine-setup (and other related tools) keep there information about all files it created/chagned - mainly used by engine-cleanup Good luck and best regards, -- Didi

1 0

Re: Engine Upgrade to 4.4.5 Version Number Question
by Yedidyah Bar David 13 Apr '21

13 Apr '21

On Sun, Apr 11, 2021 at 10:19 AM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > Only DWH are deployed on another machine. Please provide more details. The setup log you provided shows nothing as configured - all of engine+dwh+grafana are disabled. Best regards, > I don't edit any configuration manually beside the one that used for SSO. Any clue why is this happened? > > Thanks before. > > Regards, > > Nur Imam Febrianto > Sent from Nine > ________________________________ > From: Yedidyah Bar David <didi(a)redhat.com> > Sent: Sunday, April 11, 2021 13:45 > To: Nur Imam Febrianto > Cc: oVirt Users > Subject: Re: [ovirt-users] Engine Upgrade to 4.4.5 Version Number Question > > On Sat, Apr 10, 2021 at 8:08 AM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > > > Here is the setup logs. > > Do you have "everything" (engine, dwh, etc.) on the same machine, or > different stuff set up on different machines? > > Any chance you manually edited > /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf for any > reason? > > I see there: > > 2021-03-18 22:45:25,952+0700 DEBUG otopi.context > context.dumpEnvironment:775 ENV > OVESETUP_ENGINE_CORE/enable=bool:'False' > > This normally happens only if the engine was not configured on this machine. > > Best regards, > > > > > Thanks. > > > > > > > > From: Yedidyah Bar David > > Sent: 07 April 2021 12:36 > > To: Nur Imam Febrianto > > Cc: oVirt Users > > Subject: Re: [ovirt-users] Engine Upgrade to 4.4.5 Version Number Question > > > > > > > > On Tue, Apr 6, 2021 at 6:49 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > > > > > I’m currently trying to upgrade our cluster from 4.4.4 to 4.4.5. All using oVirt Node. > > > > > > All host are successfully upgraded to 4.4.5 (I can see the image layer was changed from 4.4.4 to 4.4.5, cockpit also shows same version), but in Engine VM, already run engine-upgrade-check, upgrading ovirt-setup, running engine-setup successfully, reboot the engine but whenever I open the engine web page, it still showing Version 4.4.4.5-1.el8. Is this version correct ? Because my second Cluster that use their own hosted engine shows different version (4.4.5.11-1.el8). Anybody having a same issues like me ? > > > > Please share the setup log (in /var/log/ovirt-engine/setup). Thanks. > > > > Best regards, > > -- > > Didi > > > > > > > > -- > Didi > -- Didi

2 1

Ovirt with Oracle Linux 8.3 & Cockpit - Direct Luns
by hansontodd＠gmail.com 12 Apr '21

12 Apr '21

Is Ovirt compatible with Oracle Linux 8.3? I have KVM & Cockpit running on Oracle Linux 8.3 but don't see a way to map direct luns (like RDM's) to the VM in the Cockpit interface. Do I need to move back to Centos 7.x or RHEL 7.x with Ovirt to be able to use direct luns? Can Ovirt and Cockpit coexist?

1 0

Cannot edit VM. Maximum SATA devices exceeded
by adm＠m-go.ru 12 Apr '21

12 Apr '21

I tried to delete one of the disks, but I can't do it. https://m-go.ru/stream/item/4780 Disk as SATA

2 2

ipxe support with Q35 chipset and UEFI
by Gianluca Cecchi 12 Apr '21

12 Apr '21

Hello, I'm doing some tests with iPXE (downloaded latest version cloning the git repo some days ago). I'm using oVirt 4.4.5 with VMs configured with different chipset/firmware type. It seems that using dhcpd.conf directive of type if exists user-class and option user-class = "iPXE" { filename "http://my_http_server/..."; } else { ... } the VM boot catches it when I use Q35 Chipset with BIOS, while it goes inside the "else" section if using Q35 Chipset with UEFI (not the SecureBoot one) Does this mean that the Q35 UEFI doesn't support iPXE? BTW: if anyone has suggestions about an utility that can let me boot via network and give the user a general menu from which he/she can go and choose standard pxe with bios or uefi boot, to be able to install both Linux based systems and other ones, such as ESXi hosts, both with BIOS and UEFI, it is welcome Gianluca

1 0

where I can find 4.4.5 Data warehouse repo
by dhanaraj.ramesh＠yahoo.com 12 Apr '21

12 Apr '21

below repo is not working in CentOS 7 OS, is there any repo available for centos? yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm

2 2

Re: Engine Upgrade to 4.4.5 Version Number Question
by Yedidyah Bar David 11 Apr '21

11 Apr '21

On Sat, Apr 10, 2021 at 8:08 AM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > Here is the setup logs. Do you have "everything" (engine, dwh, etc.) on the same machine, or different stuff set up on different machines? Any chance you manually edited /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf for any reason? I see there: 2021-03-18 22:45:25,952+0700 DEBUG otopi.context context.dumpEnvironment:775 ENV OVESETUP_ENGINE_CORE/enable=bool:'False' This normally happens only if the engine was not configured on this machine. Best regards, > > Thanks. > > > > From: Yedidyah Bar David > Sent: 07 April 2021 12:36 > To: Nur Imam Febrianto > Cc: oVirt Users > Subject: Re: [ovirt-users] Engine Upgrade to 4.4.5 Version Number Question > > > > On Tue, Apr 6, 2021 at 6:49 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > > > I’m currently trying to upgrade our cluster from 4.4.4 to 4.4.5. All using oVirt Node. > > > > All host are successfully upgraded to 4.4.5 (I can see the image layer was changed from 4.4.4 to 4.4.5, cockpit also shows same version), but in Engine VM, already run engine-upgrade-check, upgrading ovirt-setup, running engine-setup successfully, reboot the engine but whenever I open the engine web page, it still showing Version 4.4.4.5-1.el8. Is this version correct ? Because my second Cluster that use their own hosted engine shows different version (4.4.5.11-1.el8). Anybody having a same issues like me ? > > Please share the setup log (in /var/log/ovirt-engine/setup). Thanks. > > Best regards, > -- > Didi > > -- Didi

2 1

Re: Engine Upgrade to 4.4.5 Version Number Question
by Yedidyah Bar David 10 Apr '21

10 Apr '21

On Tue, Apr 6, 2021 at 6:49 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > I’m currently trying to upgrade our cluster from 4.4.4 to 4.4.5. All using oVirt Node. > > All host are successfully upgraded to 4.4.5 (I can see the image layer was changed from 4.4.4 to 4.4.5, cockpit also shows same version), but in Engine VM, already run engine-upgrade-check, upgrading ovirt-setup, running engine-setup successfully, reboot the engine but whenever I open the engine web page, it still showing Version 4.4.4.5-1.el8. Is this version correct ? Because my second Cluster that use their own hosted engine shows different version (4.4.5.11-1.el8). Anybody having a same issues like me ? Please share the setup log (in /var/log/ovirt-engine/setup). Thanks. Best regards, -- Didi

2 1

How to detach FC Storage Domain
by Miguel Garcia 09 Apr '21

09 Apr '21

I have added some FC storage domains into incorrect Data Center, I'm trying to detach them by moving to Storage -> Storage domain select storage domain -> Data Center tab and click on detach button then got the following error: Failing detaching storage domain from Data Center In log files so far found next lines: 2021-03-25 22:58:41,621-04 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2636) [0a08dff7-13c4-49c2-b451-0dea136941ec] START, DetachStorageDomainVDSCommand( DetachStorageDomainVDSCommandParameters:{storagePoolId='68b8d8e9-af51-457d-9b9d-36e37ad60d55', ignoreFailoverLimit='false', storageDomainId='a1f6a779-a65f-427c-b034-174e1150361d', masterDomainId='00000000-0000-0000-0000-000000000000', masterVersion='1', force='false'}), log id: 42974429 2021-03-25 22:58:42,941-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2636) [0a08dff7-13c4-49c2-b451-0dea136941ec] Failed in 'DetachStorageDomainVDS' method 2021-03-25 22:58:42,944-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-2636) [0a08dff7-13c4-49c2-b451-0dea136941ec] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command DetachStorageDomainVDS failed: Storage domain does not exist: (u'a1f6a779-a65f-427c-b034-174e1150361d',) 2021-03-25 22:58:42,945-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2636) [0a08dff7-13c4-49c2-b451-0dea136941ec] Command 'DetachStorageDomainVDSCommand( DetachStorageDomainVDSCommandParameters:{storagePoolId='68b8d8e9-af51-457d-9b9d-36e37ad60d55', ignoreFailoverLimit='false', storageDomainId='a1f6a779-a65f-427c-b034-174e1150361d', masterDomainId='00000000-0000-0000-0000-000000000000', masterVersion='1', force='false'})' execution failed: IRSGenericException: IRSErrorException: Failed to DetachStorageDomainVDS, error = Storage domain does not exist: (u'a1f6a779-a65f-427c-b034-174e1150361d',), code = 358 Seems that the storage domain does not exists. Is there a way to force detach action? Thanks in advance

3 4

extending vm disk when vm is up
by Nathanaël Blanchet 08 Apr '21

08 Apr '21

Hello, Why it is not possible to extend disk size into UI when a vm is up while it is possible to do the same with API/SDK/ansible? -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

Destroyed VM blocking hosts/filling logs
by davidk＠riavera.com 08 Apr '21

08 Apr '21

Hello, I've somehow gotten one of my VMs stuck in a state that ovirt seems to be rather confused about its existence of now. I'm running oVirt 4.3.10 and using oVirt Node on all the hosts. My engine and host event logs are now filling up very rapidly with this error: VDSM node217 command DestroyVDS failed: General Exception: ("'1048576'",) I was playing with hugetable support, and that error number or string looks suspiciously like the "hugetable size" custom property I set on the VM. This VM was migrated to another host at one point as well, and now that host is also generating the same error as well. When I try to move these hosts to maintenance mode, they get stuck in "Preparing for Maintenance" while it tries to migrate/deal with the VM that's not there any more. Forcibly rebooting the hosts does not change anything. The VM state/host seems to be captured somewhere persistent in this case. The VM in question is not running, and I can start it up on another host successfully, but ovirt still thinks it exists on the other 2 hosts no matter what I do. Is there perhaps some way to delete it from the engine database directly to straighten things out? Here's a dump of the vdsm log on one of the hosts. I haven't been able to pinpoint what the exact issue is or how to fix it, but hopefully someone here will have seen this before? 2021-04-03 04:40:35,515+0000 INFO (jsonrpc/1) [api.virt] START destroy(gracefulAttempts=1) from=::ffff:10.100.0.210,58150, vmId=58abf0cf-d7b9-4067-a86a-e619928368e7 (api:48) 2021-04-03 04:40:35,516+0000 INFO (jsonrpc/1) [virt.vm] (vmId='58abf0cf-d7b9-4067-a86a-e619928368e7') Release VM resources (vm:5186) 2021-04-03 04:40:35,516+0000 WARN (jsonrpc/1) [virt.vm] (vmId='58abf0cf-d7b9-4067-a86a-e619928368e7') trying to set state to Powering down when already Down (vm:626) 2021-04-03 04:40:35,516+0000 INFO (jsonrpc/1) [virt.vm] (vmId='58abf0cf-d7b9-4067-a86a-e619928368e7') Stopping connection (guestagent:455) 2021-04-03 04:40:35,517+0000 INFO (jsonrpc/1) [vdsm.api] START teardownImage(sdUUID='a08af6be-3802-4bb1-9fa5-4b6a10227290', spUUID='78dc095a-5238-11e8-b8bf-00163e6a7af9', imgUUID='9c896907-59b0-4983-9478-b36b2c2eb01e', volUUID=None) from=::ffff:10.100.0.210,58150, task_id=fc946d20-126a-4fd0-9078-91 4b4a64b1d9 (api:48) 2021-04-03 04:40:35,518+0000 INFO (jsonrpc/1) [storage.StorageDomain] Removing image rundir link u'/var/run/vdsm/storage/a08af6be-3802-4bb1-9fa5-4b6a10227290/9c896907-59b0-4983-9478-b36b2c2eb01e' (fileSD:592) 2021-04-03 04:40:35,518+0000 INFO (jsonrpc/1) [vdsm.api] FINISH teardownImage return=None from=::ffff:10.100.0.210,58150, task_id=fc946d20-126a-4fd0-9078-914b4a64b1d9 (api:54) 2021-04-03 04:40:35,519+0000 INFO (jsonrpc/1) [vdsm.api] START teardownImage(sdUUID='b891448d-dd92-4a7b-a51a-22abc3d7da67', spUUID='78dc095a-5238-11e8-b8bf-00163e6a7af9', imgUUID='c0e95483-35f1-4a61-958e-4e308b70d3f8', volUUID=None) from=::ffff:10.100.0.210,58150, task_id=77c0fdca-e13a-44b5-9a00-29 0522b194b2 (api:48) 2021-04-03 04:40:35,520+0000 INFO (jsonrpc/1) [storage.StorageDomain] Removing image rundir link u'/var/run/vdsm/storage/b891448d-dd92-4a7b-a51a-22abc3d7da67/c0e95483-35f1-4a61-958e-4e308b70d3f8' (fileSD:592) 2021-04-03 04:40:35,520+0000 INFO (jsonrpc/1) [vdsm.api] FINISH teardownImage return=None from=::ffff:10.100.0.210,58150, task_id=77c0fdca-e13a-44b5-9a00-290522b194b2 (api:54) 2021-04-03 04:40:35,521+0000 INFO (jsonrpc/1) [virt.vm] (vmId='58abf0cf-d7b9-4067-a86a-e619928368e7') Stopping connection (guestagent:455) 2021-04-03 04:40:35,521+0000 WARN (jsonrpc/1) [root] File: /var/lib/libvirt/qemu/channels/58abf0cf-d7b9-4067-a86a-e619928368e7.ovirt-guest-agent.0 already removed (fileutils:54) 2021-04-03 04:40:35,521+0000 WARN (jsonrpc/1) [root] Attempting to remove a non existing network: ovirtmgmt/58abf0cf-d7b9-4067-a86a-e619928368e7 (libvirtnetwork:198) 2021-04-03 04:40:35,522+0000 WARN (jsonrpc/1) [root] Attempting to remove a non existing net user: ovirtmgmt/58abf0cf-d7b9-4067-a86a-e619928368e7 (libvirtnetwork:205) 2021-04-03 04:40:35,526+0000 WARN (jsonrpc/1) [root] Attempting to remove a non existing network: ovirtmgmt/58abf0cf-d7b9-4067-a86a-e619928368e7 (libvirtnetwork:198) 2021-04-03 04:40:35,526+0000 WARN (jsonrpc/1) [root] Attempting to remove a non existing net user: ovirtmgmt/58abf0cf-d7b9-4067-a86a-e619928368e7 (libvirtnetwork:205) 2021-04-03 04:40:35,527+0000 WARN (jsonrpc/1) [root] File: /var/lib/libvirt/qemu/channels/58abf0cf-d7b9-4067-a86a-e619928368e7.org.qemu.guest_agent.0 already removed (fileutils:54) 2021-04-03 04:40:35,528+0000 WARN (jsonrpc/1) [virt.vm] (vmId='58abf0cf-d7b9-4067-a86a-e619928368e7') timestamp already removed from stats cache (vm:2445) 2021-04-03 04:40:35,531+0000 ERROR (jsonrpc/1) [api] FINISH destroy error='1048576' (api:134) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 124, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 333, in destroy res = self.vm.destroy(gracefulAttempts) File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 5283, in destroy result = self.doDestroy(gracefulAttempts, reason) File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 5302, in doDestroy return self.releaseVm(gracefulAttempts) File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 5207, in releaseVm self._cleanup() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2382, in _cleanup self._cleanup_hugepages() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2393, in _cleanup_hugepages self.nr_hugepages, self.hugepagesz File "/usr/lib/python2.7/site-packages/vdsm/hugepages.py", line 243, in calculate_required_deallocation _preallocated_hugepages(vm_hugepagesz)) File "/usr/lib/python2.7/site-packages/vdsm/hugepages.py", line 262, in _preallocated_hugepages kernel_args['hugepagesz'] File "/usr/lib/python2.7/site-packages/vdsm/hugepages.py", line 291, in _cmdline_hugepagesz_to_kb }[cmdline] KeyError: '1048576' 2021-04-03 04:40:35,531+0000 INFO (jsonrpc/1) [api.virt] FINISH destroy return={'status': {'message': 'General Exception: ("\'1048576\'",)', 'code': 100}} from=::ffff:10.100.0.210,58150, vmId=58abf0cf-d7b9-4067-a86a-e619928368e7 (api:54) 2021-04-03 04:40:35,532+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.destroy failed (error 100) in 0.02 seconds (__init__:312)

4 9

[ANN] oVirt 4.4.6 Third Release Candidate is now available for testing
by Lev Veyde 08 Apr '21

08 Apr '21

oVirt 4.4.6 Third Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Third Release Candidate for testing, as of April 8th, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * oVirt Node 4.4 based on CentOS Linux 8.3 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 - We found a few issues while testing on CentOS Stream so we are still basing oVirt 4.4.6 Node and Appliance on CentOS Linux. Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

Q: Sparsify/fstrim don't reduce actual disk image size
by Andrei Verovski 08 Apr '21

08 Apr '21

Hi ! I have VM (under oVirt) with single disk thin provision (~600 GB) running NextCloud on Debian 9. Right now VM HD is almost empty. Unfortunately, it occupies 584 GB (virtual size = 600 GB) All partition (except swap and boot) are EXT4 with discard option. in oVirt “enable discard = on”. # fstrim -av runs successfully: /var: 477.6 GiB (512851144704 bytes) trimmed on /dev/mapper/vg--system-lv4--data /boot: 853.8 MiB (895229952 bytes) trimmed on /dev/mapper/vg--system-lv2--boot /: 88.4 GiB (94888611840 bytes) trimmed on /dev/mapper/vg--system-lv3—sys When fstrim runs again, it trims zero. I even run “Sparsify” in oVirt. Unfortunately, actual size is still 584 GB. Here is /etc/fstab /dev/mapper/vg--system-lv3--sys / ext4 discard,noatime,nodiratime,errors=remount-ro 0 1 /dev/mapper/vg--system-lv2--boot /boot ext2 defaults 0 2 /dev/mapper/vg--system-lv4--data /var ext4 discard,noatime,nodiratime 0 2 /dev/mapper/vg--system-lv1--swap none swap sw 0 0 When disk was partitioned/formatted, swap and boot were created first and positioned at the beginning. What is wrong here? Is it possible to fix all this ? Thanks in advance. Andrei

2 3

cannot export - "r.original_template is undefined"
by Diggy Mc 08 Apr '21

08 Apr '21

I cannot export a VM to a data domain. I receive the error: Export VM Failed r.original_template is undefined The VM originated as an OVA provided by a third party. After importing the OVA and customizing the VM, I wanted to export it for backup purposes, but cannot. I am running oVirt 4.4.4. You can download the OVA directly from ERPNext.org if that helps troubleshooting. Download the "Production Image" from here: https://erpnext.org/get-started Any help is appreciated and let me know if additional information is needed.

2 3

oVirt longevity after CentOS 8, RHV changes
by David White 08 Apr '21

08 Apr '21

I'm replying to Thomas's thread below, but am creating a new subject so as not to hijack the original thread. I'm sure that this topic has come up before. I first joined this list last fall, when I began planning and testing with oVirt, but as of the past few weeks, I'm paying closer attention to the mailing list now that I'm actually using oVirt and am getting ready to deploy to a production environment. I'll also try to jump in and help other people as time permits and as my experience grow. I echo Thomas's concerns here. While I'm thankful for Red Hat's gesture to allow people to use up to 16 Red Hat installs at no charge, I'm concerned about the longevity of oVirt, now that Red Hat is no longer going to support RHV going forward. What is the benefit to Red Hat / IBM of supporting this platform now that it is no longer being commercialized as a Red Hat product? What is to prevent Red Hat from pulling the plug on this project, similar to what happened to CentOS 8? As a user of oVirt (4.5, installed on Red Hat 8.3), how can I and others help to contribute to the project to ensure its longevity? Or should I really just go find an alternative in the future? (I had been planning to use oVirt for a while, and did some testing last fall, so the announcement of RHV's (commercial) demise was poor timing for me, because I don't have time to switch gears and change my plans to use something else, like Proxmox or something. From what I've seen, this is a great product, and I guess I can understand Red Hat's decision to pull the plug on the commercial project, now that OpenShift supports full VMs. But my understanding is that OpenShift is a lot more complicated and requires more resources. I really don't need a full kubernetes environment. I just need a stable virtualization platform. Sent with ProtonMail Secure Email. ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Thursday, April 1, 2021 5:44 PM, Thomas Hoberg <thomas(a)hoberg.net> wrote: > I personally consider the fact that you gave up on 4.3/CentOS7 before CentOS 8 could have even been remotely reliable to run "a free open-source virtualization solution for your entire enterprise", a rather violent break of trust. > > I understand Redhat's motivation with Python 2/3 etc., but users just don't. Please just try for a minute to view this from a user's perspective. > > With CentOS 7 supported until 2024, we naturally expect the added value on top via oVirt to persist just as long. > > And with CentOS 8 support lasting until the end of this year, oVirt 4.4 can't be considered "Petrus" or a rock to build on. > > Most of us run oVirt simply because we are most interested in the VMs it runs (tenants paying rent). > > We're not interested in keeping oVirt itself stable and from failing after any update to the house of cards. > > And yes, by now I am sorry to have chosen oVirt at all, finding that 4.3 was abandonend before 4.4 or the CentOS 8 below was even stable and long before the base OS ran out of support. > > To the users out there oVirt is a platform, a tool, not a means to itself.

6 9

New Management VLAN for hyperconverged cluster
by David White 08 Apr '21

08 Apr '21

I'm working on setting up my environment prior to production, and have run into an issue. I got most things configured, but due to a limitation on one of my switches, I decided to change the management vlan that the hosts communicate on. Over the course of changing that vlan, I wound up resetting my router to default settings. I have the router operational again, and I also have 1 of my switches operational. Now, I'm trying to bring the oVirt cluster back online.This is oVirt 4.5 running on RHEL 8.3. The old vlan is 1, and the new vlan is 10. Currently, hosts 2 & 3 are accessible over the new vlan, and can ping each other. I'm able to ssh to both hosts, and when I run "gluster peer status", I see that they are connected to each other. However, host 1 is not accessible from anything. I can't ping it, and it cannot get out. As part of my troubleshooting, I've done the following: From the host console, I ran `nmcli connection delete` to delete the old vlan (VLAN 1). I moved the /etc/sysconfig/network-scripts/interface.1 file to interface.10, and edited the file accordingly to make sure the vlan and device settings are set to 10 instead of 1, and I rebooted the host. The engine seems to be running, but I don't understand why. From each of the hosts that are working (host 2 and host 3), I ran "hosted-engine --check-liveliness" and both hosts indicate that the engine is NOT running. Yet the engine loads in a web browser, and I'm able to log into /ovirt-engine/webadmin/. The engine thinks that all 3 hosts is nonresponsive. See screenshot below: [Screenshot from 2021-04-07 17-33-48.png] What I'm really looking for help with is to get the first host back online. Once it is healthy and gluster is healthy, I feel confident I can get the engine operational again. What else should I look for on this host? Sent with ProtonMail Secure Email.

1 1

How to restore Storage Domain from disaster recovery
by miguel.garcia＠toshibagcs.com 07 Apr '21

07 Apr '21

My engine drop dead so had to create a new one and I'm trying to recover virtual drives from previous engine. I'm using next instructions to import storage domain https://www.ovirt.org/develop/release-management/features/storage/importsto… but in order to do it well need to unattach storage domain from previous engine which that is not possible right now since the engine has died. Anyway discarting requirements I got the following warning message: This operation might be unrecoverable and destructive! Storage Domain(s) are already attached to a Data Center. Aproving this operation might cause data corruption if both Data Centers are Active. Do you have an idea how to deactivate a Storage domain without ovirt-engine? Is there any chance to export virtual drives as backups without engine? Thanks in advance.

2 1

oVirt 4.4.4 not dislaying Sign-on Screen
by louisb＠ameritech.net 07 Apr '21

07 Apr '21

I recently installed oVirt 4.4.4, everything appeared to run successfully, however, I’m unable to get the sign-on screen to display on my RHEL 8.3 machine. I did do an install using the remote database installation. I encountered no issue with the install, I can see the “engine” and “ovirt_engine_history” in PostgreSQL 13.3. The tables and table spaces have all been created as designed by the installation process. When I enter the URL that was displayed once the installation completed I get the following information displayed on the screen: Internal Error I’ve tried using the port 443 and port 80 URL and get the same results. The URL are as follows: http://WorkstationName:80/ovirt-engine https://WorkstationName:443/ovirt-engine For three days I’ve been trying to locate logs that will help me located and resolve the problem, but so far I’ve had no luck. Can anyone tell where I should start looking to resolve my issue? I’ve checked several system logs and logs for Apache with luck. What should I be looking for within the logs? What logs should I be looking at? I don’t believe my issue is with the back-end database, I thinks its something with Apache not being able to find the web pages to display. How can I start to investigate my problem an develop a solution? My Linux/RHEL 8.3 OS has all of the latest patches and fixes applied. Thanks

3 10

Experience on using HCI with geo-replication for DR
by wodel youchi 07 Apr '21

07 Apr '21

Hi, Does anyone use ovirt HCI with geo-replication for DR? if yes, could you share your experience? We recently did a setup of 2 HCI platforms, and we configured geo-replication between them. The two platforms were configured with encryption and VDO. When testing the DR, we had some surprises : - Sometimes VMs are not imported - Sometimes some VMs are imported others not - Sometimes VMs are imported without their disks - Sometimes deleted items from the source are imported!!! - And sometimes the imported VMs are corrupted. Regards. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

Re: Restored engine backup: The provided authorization grant for the auth code has expired.
by Nicolás 07 Apr '21

07 Apr '21

Hi Shani, El 6/4/21 a las 15:15, Shani Leviim escribió: > Hi, > Did you try to refresh the page and try again? Yes, several times. Also different browsers with no difference. > Can you share a screenshot? Sure. Adding the screenshot in this e-mail. This happens after authenticating like admin (internal) on either the administration panel or the VM portal. Thanks. > > *Regards, > * > *Shani Leviim > * > > > On Tue, Apr 6, 2021 at 4:20 PM Nicolás <nicolas(a)devels.es > <mailto:nicolas@devels.es>> wrote: > > bump... > > El 26/3/21 a las 8:21, Nicolás escribió: > > Please, any help with this? > > > > El 24/3/21 a las 10:05, Nicolás escribió: > >> Hi, > >> > >> I'm restoring a full ovirt engine backup, having used the > --scope=all > >> option, for oVirt 4.3. > >> > >> I restored the backup on a fresh CentOS7 machine. The process went > >> well, but when trying to log into the restored authentication > system > >> I get the following message which won't allow me to log in: > >> > >> The provided authorization grant for the auth code has expired. > >> > >> What does that mean and how can it be fixed? > >> > >> Thanks. > >> > >> Nicolás > >> _______________________________________________ > >> Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> > >> To unsubscribe send an email to users-leave(a)ovirt.org > <mailto:users-leave@ovirt.org> > >> Privacy Statement: https://www.ovirt.org/privacy-policy.html > >> oVirt Code of Conduct: > >> https://www.ovirt.org/community/about/community-guidelines/ > >> List Archives: > >> > https://lists.ovirt.org/archives/list/users@ovirt.org/message/PADF5SSC6XUYC… > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> > > To unsubscribe send an email to users-leave(a)ovirt.org > <mailto:users-leave@ovirt.org> > > Privacy Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: > > https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: > > > https://lists.ovirt.org/archives/list/users@ovirt.org/message/5VYLMSCUGDDBW… > _______________________________________________ > Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> > To unsubscribe send an email to users-leave(a)ovirt.org > <mailto:users-leave@ovirt.org> > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/N6Q4EEC3KKK7P… >

1 0

Engine Upgrade to 4.4.5 Version Number Question
by Nur Imam Febrianto 06 Apr '21

06 Apr '21

I’m currently trying to upgrade our cluster from 4.4.4 to 4.4.5. All using oVirt Node. All host are successfully upgraded to 4.4.5 (I can see the image layer was changed from 4.4.4 to 4.4.5, cockpit also shows same version), but in Engine VM, already run engine-upgrade-check, upgrading ovirt-setup, running engine-setup successfully, reboot the engine but whenever I open the engine web page, it still showing Version 4.4.4.5-1.el8. Is this version correct ? Because my second Cluster that use their own hosted engine shows different version (4.4.5.11-1.el8). Anybody having a same issues like me ? Thanks before. Regards, Nur Imam Febrianto

1 0

Re: Upgrading DWH from 4.4.4 to 4.4.5
by Yedidyah Bar David 06 Apr '21

06 Apr '21

On Thu, Mar 18, 2021 at 6:47 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > Hi, > > > > I’m currently trying to upgrade my oVirt Cluster into 4.4.5. Hosted engine upgrade work successfully. But whenever I tried upgrading DWH on separate machine it keep giving me this error : Failed to execute stage 'Misc configuration': 'OVESETUP_SYSTEM/selinuxBooleans' > > > > In engine-setup log : > > > > 2021-03-18 23:34:10,976+0700 DEBUG otopi.context context._executeMethod:145 method exception > > Traceback (most recent call last): > > File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod > > method['method']() > > File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine-common/apache/selinux.py", line 40, in _misc > > osetupcons.SystemEnv.SELINUX_BOOLEANS > > KeyError: 'OVESETUP_SYSTEM/selinuxBooleans' > > 2021-03-18 23:34:10,977+0700 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Misc configuration': 'OVESETUP_SYSTEM/selinuxBooleans' > > > > Using CentOS 8.3 as separate DWH machine. Anybody maybe can help me ? > > Thanks before. Sorry, this is looks like a bug, caused by [1]. Would you like to report it on bugzilla? I think a workaround is to run engine-setup like this: # engine-setup --otopi-environment=OVESETUP_SYSTEM/selinuxBooleans=multi-str:\ The shell will prompt with '> '. Just press Enter. Martin - seems like I was wrong when commenting on [1] that it seems harmless... Marcin: we should probably add separate-dwh to ovirt-system-tests or something like that. [1] https://gerrit.ovirt.org/c/ovirt-engine/+/113263 Sorry and best regards, -- Didi

2 2

4.4 -> 4.3
by KSNull Zero 06 Apr '21

06 Apr '21

Hi, What is the most simpliest way to backward migrate VMs from oVirt 4.4 to oVirt 4.3 ? Is it possible to use export domain or there are some other ways ? Thank you.

3 4

EMC Unity300 with iSCSI
by Dan Yasny 06 Apr '21

06 Apr '21

Hi all, I've got a brand new Unity300 that I'm trying to hook up to a 4.3 setup with iSCSI. The way I have it organized is simple: - each hypervisor has two NICs set to 192.168.10.x and 192.168.20.x - the SAN has 4 ports on each controller (A and B), amounting to 8 portal IPs I can log into. The problem with the EMC is that at any time, only either A or B addresses would be active, so I can only login to 4 out of the 8 addresses, while the engine, in order to add all the possible target IQNs needs to log into all 8 of them. I've been trying to find a solution for a while now, EMC generally suggest I use powerpath (not an option here obviously). Did anyone set up one of these EMC boxes with oVirt before? Thanks

1 0

Accidentally changed VM Assigned Bridge for Hosted-Engine
by phunyguy＠neverserio.us 06 Apr '21

06 Apr '21

Hello, exactly as the title suggests, I did something stupid, and I am not sure how to fix this. I also cannot be certain that this was the exact cause of the problem, as I was troubleshooting another issue with a different VM refusing to start. What I did by accident, was selected the hosted-engine VM, rather than the VM I was attempting to troubleshoot, and changed the assigned network of the VM adapter to something else, and of course, lost connectivity to the engine VM. This caused HA to kick in and restart the engine, however, like the other VM, it is now refusing to start. Can anyone give me any pointers? agent/broker/vdsm.log are not showing anything useful that I can see. Thanks in advance. -phunyguy

2 1

Problem-VDSM command failed:Received fatal alert certificate_expire
by fmendoza＠red.com.sv 06 Apr '21

06 Apr '21

Recently Ovirt sent certificate expiration messages. And it does not let me manage the server VMs, I have looked for information about this and I can not find something that is clear. The version of Ovirt that I own is 3.6.3.4-1.el7.cents. I have at least 4 operational VMs of vital importance. Thanks for the support

2 1

Problems after upgrade from 4.4.3 to 4.4.4
by tferic＠swissonline.ch 06 Apr '21

06 Apr '21

Hi I have problems after upgrading my 2-node cluster from 4.4.3 to 4.4.4. Initially, I performed the upgrade of the oVirt hosts using the oVirt GUI (I wasn't planning any changes). It appears that the upgrade broke the system. On host1, the ovirt-engine was configured to run on the oVirt host itself (not self-hosted engine). After the upgrade, the oVirt GUI didn't load in the Browser anymore. I tried to fix the issue by migrating to self-hosted engine, which did not work, so I ran engine restore and engine-setup in order to get back to the initial state. I am now able to login to the oVirt GUI again, but I am having the following problems: host1 is in status "Unassigned", and it has the SPM role. It cannot be set to maintenance mode, nor re-installed from GUI, but I am able to reboot the host from oVirt. All Storage Domains are inactive. (all NFS) In the /var/log/messages log, I can see the following message appearing frequently: "vdsm[5935]: ERROR ssl handshake: socket error, address: ::ffff:192.168.100.61" The cluster is down and no VM's can be run. I don't know how to fix either of the issues. Does anyone have an idea? I am appending a tar file containing log files to this email. http://gofile.me/5fp92/d7iGEqh3H <http://gofile.me/5fp92/d7iGEqh3H> Many thanks Toni

2 7

No option to remove OpenStack Glance storage domain.
by Gary Taylor 05 Apr '21

05 Apr '21

Hi, I was playing around a few months ago and added an ovirt-image-repository storage domain. There wasn't a real purpose for doing it, just trying to learn and play around. I tried to remove it earlier but couldn't figure out how because the Remove button is greyed out. I got busy and forgot about it. I am trying to clean it up now but the Remove button is still greyed out for that domain. How do I get rid of it now? It isn't being used. It's unattached. I'm the admin. https://imgur.com/KBKUu16.png oVirt Open Virtualization Manager Software Version:4.4.4.7-1.el8 Thank-you, Gary

2 2

Hosted-Engine vs Standalone Engine
by Ian Easter 05 Apr '21

05 Apr '21

Hello Folks, I have had to install a Hosted-Engine a few times in my environment. There have been some hardware issues and power issues that left the HE unrecoverable. In this situation, would the Standalone Engine install be more viable and less prone to become inoperable due to the previous issues? My assumption would be to have a head baremetal server run the Engine to control and maintain my blades. *Thank you,* *Ian*

3 2

Error while updating volume meta data: [Errno 17] File exists", ), code = 208
by adrianquintero＠gmail.com 05 Apr '21

05 Apr '21

Hi, I am encountering the following error every hour in the ovirt-engine.log file and I can also see the same in the oVirt engine UI --------------------------------------- 2021-04-05 01:49:20,072-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [7dd3eb3d] Command 'SetVolumeDescriptionVDSCommand( SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088', ignoreFailoverLimit='false', storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e', imageGroupId='2af73aad-5079-4583-824c-a93b20b93835', imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed: IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error while updating volume meta data: ("(u'/rhev/data-center/mnt/glusterSD192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno 17] File exists",), code = 208 2021-04-05 02:49:14,333-04 ERROR [org.ovirt.engine.core.bll.gluster.GlusterGeoRepSyncJob] (DefaultQuartzScheduler3) [2bf694b9] VDS error Command execution failed: rc=2 out='geo-replication command failed\n' err='' 2021-04-05 02:49:20,332-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-5) [6b6dd1af] Command 'SetVolumeDescriptionVDSCommand( SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088', ignoreFailoverLimit='false', storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e', imageGroupId='2af73aad-5079-4583-824c-a93b20b93835', imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed: IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error while updating volume meta data: ("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno 17] File exists",), code = 208 --------------------------------------- I looked up the mentioned error codes but not sure if these are the correct ones: https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/ht… --------------------------------------- 17 > VDS_MAINTENANCE_FAILED > Error > Failed to switch Host ${VdsName} to Maintenance mode. 208 > PROVIDER_UPDATE_FAILED > Error > Failed to update provider ${ProviderName}. (User: ${UserName}) --------------------------------------- From the Engine UI's event tab I can see: --------------------------------------- Failed to update VMs/Templates OVF data for Storage Domain data1 in Data Center Default. Failed to update OVF disks 2af73aad-5079-4583-824c-a93b20b93835, OVF data isn't updated on those OVF stores (Data Center Default, Storage Domain data1). VDSM command SetVolumeDescriptionVDS failed: Error while updating volume meta data: ("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno 17] File exists",) --------------------------------------- I know the error belongs to the "data1" storage domain and this is a 12 node Distributed Replicate volume (Replicat 3) HCI. If I try to update the OVF using the UI I get the following log entries in the engine --------------------------------------- 2021-04-05 03:20:03,101-04 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (default task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] The message key 'UpdateOvfStoreForStorageDomain' is missing from 'bundles/ExecutionMessages' 2021-04-05 03:20:03,178-04 INFO [org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[9ed31575-9cc4-4b05-a5d9-23d21d6e915e=STORAGE]', sharedLocks=''}' 2021-04-05 03:20:03,204-04 INFO [org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] Running command: UpdateOvfStoreForStorageDomainCommand internal: false. Entities affected : ID: 9ed31575-9cc4-4b05-a5d9-23d21d6e915e Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2021-04-05 03:20:03,505-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] Failed in 'SetVolumeDescriptionVDS' method 2021-04-05 03:20:03,512-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command SetVolumeDescriptionVDS failed: Error while updating volume meta data: ("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno 17] File exists",) 2021-04-05 03:20:03,513-04 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] Command 'SetVolumeDescriptionVDSCommand( SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088', ignoreFailoverLimit='false', storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e', imageGroupId='2af73aad-5079-4583-824c-a93b20b93835', imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed: IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error while updating volume meta data: ("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno 17] File exists",), code = 208 2021-04-05 03:20:03,538-04 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID: UPDATE_FOR_OVF_STORES_FAILED(1,016), Failed to update OVF disks 2af73aad-5079-4583-824c-a93b20b93835, OVF data isn't updated on those OVF stores (Data Center Default, Storage Domain data1). 2021-04-05 03:20:03,513-04 WARN [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] failed to update domain '9ed31575-9cc4-4b05-a5d9-23d21d6e915e' ovf store disk '2af73aad-5079-4583-824c-a93b20b93835' 2021-04-05 03:20:03,558-04 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID: UPDATE_OVF_FOR_STORAGE_DOMAIN_FAILED(190), Failed to update VMs/Templates OVF data for Storage Domain data1 in Data Center Default. --------------------------------------- Any ideas on how to overcome this issue? Thanks, Adrian

1 0

Upgrade to release for oVirt 4.4.5 failing
by Gary Pedretty 05 Apr '21

05 Apr '21

Upgraded hosted-engine installation to latest version 4.4.5 today and engine will not come online. It starts and I can ssh and connect via cockpit, but it never passes liveliness check according to command line vm-status and Web portal for engine never loads. All processes appear to be working and nothing jumps out to me in the logs but ha agent keeps rebooting it on different hosts with the same result. 8 host in the cluster all are also updated to the latest updates across the board. This is Centos Stream 8 Ideas? Gary _______________________________ Gary Pedretty IT Manager Ravn Alaska Office: 907-266-8451 Mobile: 907-388-2247 Email: gary.pedretty(a)ravnalaska.com "We call Alaska......Home!" Ravn Alaska CONFIDENTIALITY NOTICE: The information in this email may be confidential and/or privileged. This email is intended to be reviewed by only the individual or organization named above. If you are not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any review, dissemination, forwarding or copying of the email and its attachments, if any, or the information contained herein is prohibited. If you have received this email in error, please immediately notify the sender by return email and delete this email from your system. Thank you.

4 3

Standard operating procedure for a node failure on HCI required
by Thomas Hoberg 04 Apr '21

04 Apr '21

oVirt may have started as a vSphere 'look-alike', but it graduated to a Nutanix 'clone', at least in terms of marketing. IMHO that means the 3-node hyperconverged default oVirt setup (2 replicas and 1 arbiter) deserves special love in terms of documenting failure scenarios. 3-node HCI is supposed to defend you against long-term effects of any single point of failure. There is no protection against the loss of dynamic state/session data, but state-free services should recover or resume: that's what it's all about. Sadly, what I find missing in the oVirt and Gluster documentation is an SOP (standard operating procedure) that one should follow in case of a late-night/early-morning on-call wakeup when one of those three HCI nodes should have failed... dramatically or via a 'brown out' e.g. where only the storage part was actually lost. My impression is that the oVirt and Gluster teams are barely talking, but in HCI that's fatal. And I sure can't find those recovery procedures, not even in the commercial RH documents. So please, either add them or show me where I missed them.

2 2

oVirt cannot start VM after reboot with cluster chipset set to i440fx
by Joris Dobbelsteen 03 Apr '21

03 Apr '21

Hi I’m running a oVirt 4.4.4 installation (with a single node and single cluster). After a recent reboot, I’m trying to start the VMs, which fails with: VM udc1 is down with error. Exit message: XML error: The device at PCI address 0000:00:02.0 cannot be plugged into the PCI controller with index='0'. It requires a controller that accepts a pcie-root-port.. Dmesg shows: Mar 15 17:07:48 ovirt1 journal[2245]: internal error: a PCI slot is needed to connect a PCI controller model='pcie-root-port', but none is available, and it cannot be automatically added The issue seems with the “custom chipset/firmware” set to i440fx rather than Q35 for the cluster. The VM is configured to cluster default. The rationale for running i440 is that Debian doesn’t actually support Q35 with cloud-init, leading to an uninitialized VM. Since I’m running mainly Debian/Ubuntu VMs it’s needed to have i440 set instead. The error is also visible in oVirt Manager, when checking out the “Vm Devices” for the failed VM (all of them). The workaround for starting the VM seems to be to do: Edit -> System -> Advanced Parameters -> Custom Chipset/Firmware Type -> Change to Q35 and back to cluster default (being i440). This resets the list to remove the need for a pcie-root-port. I gives the impressions that there is an initialization error of the ovirt engine, where the Q35 devices are loaded in incorrectly or maybe not fetched as the right cluster default. I’ve not tested what happens if the configured for i440fx is applied at VM level, rather than cluster level. Does anyone know how to resolve this for future versions? Or what can be done to make this work after a reboot? Best regards, Joris

1 0

VMConsole: Certificate invalid: name is not a listed principal
by Stefan Seifried 02 Apr '21

02 Apr '21

Hi, I recently tried out the vm console feature on an ovirt eval environment running 4.4.4.7-1.el8: 1.) pasted the pub-key of my local user into the web interface (User->Options) 2.) connected via ssh like so ssh -p 2222 sevm -l ovirt-vmconsole 3.) got the list of all the vm's :) 4.) choose a vm with a virtio serial console enabled 5.) Certificate invalid :( --- Please, enter the id of the Serial Console you want to connect to. To disconnect from a Serial Console, enter the sequence: <Enter><~><.> SELECT> 24 Certificate invalid: name is not a listed principal Host key verification failed. Connection to sevm closed. --- I guess somethings wrong in "/etc/pki/ovirt-vmconsole". Is there any additional information I can get out from the logs or the console proxy (e.g. the "name" which is not a listed principal)? To be honest I never really worked with SSH certificates, so I fear I will do something stupid if I try to fix this head on. So any advice or help on this issue is appreciated. Thanks, Stefan

1 0

Re: Power failure makes cluster and hosted engine unusable
by Thomas Hoberg 01 Apr '21

01 Apr '21

I am glad you got it done! I find that oVirt resembles more an adventure game (with all its huge emotional rewards, once you prevail), than a streamlined machine, that just works every time you push a button. Those are boring, sure, but really what I am looking for when the mission is to run infrastructure.

1 0

Re: Power failure makes cluster and hosted engine unusable
by Roman Bednar 01 Apr '21

01 Apr '21

Hi Seann, On Mon, Mar 29, 2021 at 8:31 PM Seann G. Clark via Users <users(a)ovirt.org> wrote: > All, > > > > After a power failure, and generator failure I lost my cluster, and the > Hosted engine refused to restart after power was restored. I would expect, > once storage comes up that the hosted engine comes back online without too > much of a fight. In practice because the SPM went down as well, there is no > (clearly documented) way to clear any of the stale locks, and no way to > recover both the hosted engine and the cluster. > Could you provide more details/logs on storage not coming up? Also more information about the current locks would be great, is there any procedure you tried that did not work for cleaning those up? I have spent the last 12 hours trying to get a functional hosted-engine > back online, on a new node and each attempt hits a new error, from the > installer not understanding that 16384mb of dedicated VM memory out of > 192GB free on the host is indeed bigger than 4096MB, to ansible dying on > an error like this “Error while executing action: Cannot add Storage > Connection. Storage connection already exists.” > > The memory error referenced above shows up as: > > [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": > "Available memory ( {'failed': False, 'changed': False, 'ansible_facts': > {u'max_mem': u'180746'}}MB ) is less then the minimal requirement (4096MB). > Be aware that 512MB is reserved for the host and cannot be allocated to the > engine VM."} > > That is what I typically get when I try the steps outlined in the KB > “CHAPTER 7. RECOVERING A SELF-HOSTED ENGINE FROM AN EXISTING BACKUP” from > the RH Customer portal. I have tried this numerous ways, and the cluster > still remains in a bad state, with the hosted engine being 100% inoperable. > This could be a bug in the ansible role, did that happen during "hosted-engine --deploy" or other part of the recovery guide? Provide logs here as well please, its seems like a completely separate issue though. > > What I do have are the two host that are part of the cluster and can host > the engine, and backups of the original hosted engine, both disk and > engine-backup generated. I am not sure what I can do next, to recover this > cluster, any suggestions would be apricated. > > > > Regards, > > Seann > > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/JLDIFTKYDPQ6Y… >

3 3

[ANN] oVirt 4.4.6 Second Release Candidate is now available for testing
by Lev Veyde 01 Apr '21

01 Apr '21

oVirt 4.4.6 Second Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Second Release Candidate for testing, as of April 1st, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * oVirt Node 4.4 based on CentOS Linux 8.3 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 - We found a few issues while testing on CentOS Stream so we are still basing oVirt 4.4.6 Node and Appliance on CentOS Linux. Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

Locked disks
by Giulio Casella 01 Apr '21

01 Apr '21

Since yesterday I found a couple VMs with locked disk. I don't know the reason, I suspect some interaction made by our backup system (vprotect, snapshot based), despite it's working for more than a year. I'd give a chance to unlock_entity.sh script, but it reports: CAUTION, this operation may lead to data corruption and should be used with care. Please contact support prior to running this command Do you think I should trust? Is it safe? VMs are in production... My manager is 4.4.4.7-1.el8 (CentOS stream 8), hosts are oVirt Node 4.4.4 TIA, Giulio

3 7