May 2020 - Users - oVirt List Archives

SPM and Task error ...
by Enrico 22 Nov '24

22 Nov '24

Hi all, my ovirt cluster has got 3 Hypervisors runnig Centos 7.5.1804 vdsm is 4.20.39.1-1.el7, ovirt engine is 4.2.4.5-1.el7, the storage systems are HP MSA P2000 and 2050 (fibre channel). I need to stop one of the hypervisors for maintenance but this system is the storage pool manager. For this reason I decided to manually activate SPM in one of the other nodes but this operation is not successful. In the ovirt engine (engine.log) the error is this: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. while in the hypervisor (SPM) vdsm.log: 2019-07-25 12:39:16,744+02 INFO [org.ovirt.engine.core.bll.storage.pool.ForceSelectSPMCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 81c9bd3c-ae0a-467f-bf7f-63ab30cd8d9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2019-07-25 12:39:16,745+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopOnIrsVDSCommand( SpmStopOnIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false'}), log id: 37bf4639 2019-07-25 12:39:16,747+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, ResetIrsVDSCommand( ResetIrsVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', vdsId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', ignoreStopFailed='false'}), log id: 2522686f 2019-07-25 12:39:16,749+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] START, SpmStopVDSCommand(HostName = infn-vm05.management, SpmStopVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7'}), log id: 1810fd8b 2019-07-25 12:39:16,758+02 *ERROR* [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] SpmStopVDSCommand::Not stopping SPM on vds 'infn-vm05.management', pool id '18d57688-6ed4-43b8-bd7c-0665b55950b7' as there are uncleared tasks 'Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e', status 'running'' 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopVDSCommand, log id: 1810fd8b 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, ResetIrsVDSCommand, log id: 2522686f 2019-07-25 12:39:16,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] FINISH, SpmStopOnIrsVDSCommand, log id: 37bf4639 2019-07-25 12:39:16,760+02 *ERROR* [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-30) [7c374384-f884-4dc9-87d0-7af27dce706b] EVENT_ID: USER_FORCE_SELECTED_SPM_STOP_FAILED(4,096), Failed to force select infn-vm07.management as the SPM due to a failure to stop the current SPM. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,660+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,750+02 *ERROR* [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::logEndTaskFailure: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended with failure: 2019-07-25 12:39:18,750+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,751+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 34ae2b2f 2019-07-25 12:39:18,752+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: d3a78ad 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 34ae2b2f 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] BaseAsyncTask::onTaskEndSuccess: Task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' (Parent Command 'Unknown', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended successfully. 2019-07-25 12:39:18,757+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,758+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 42de0c2b 2019-07-25 12:39:18,759+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 4895c79c 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: 42de0c2b 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Task id 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Fri May 03 14:48:50 CEST 2019' 2019-07-25 12:39:18,764+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' 2019-07-25 12:39:18,765+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='18d57688-6ed4-43b8-bd7c-0665b55950b7', ignoreFailoverLimit='false', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: da77af2 2019-07-25 12:39:18,766+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] START, HSMClearTaskVDSCommand(HostName = infn-vm05.management, HSMTaskGuidBaseVDSCommandParameters:{hostId='751f3e99-b95e-4c31-bc38-77f5661a0bdc', taskId='fdcf4d1b-82fe-49a6-b233-323ebe568f8e'}), log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, HSMClearTaskVDSCommand, log id: 530694fb 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] FINISH, SPMClearTaskVDSCommand, log id: da77af2 2019-07-25 12:39:18,771+02 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task 'fdcf4d1b-82fe-49a6-b233-323ebe568f8e' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned there is some relation between this error and a task that has remained hanging, from SPM server: # vdsm-client Task getInfo taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "verb": "prepareMerge", "id": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e" } # vdsm-client Task getStatus taskID=fdcf4d1b-82fe-49a6-b233-323ebe568f8e { "message": "running job 1 of 1", "code": 0, "taskID": "fdcf4d1b-82fe-49a6-b233-323ebe568f8e", "taskResult": "", "taskState": "running" } How can I solve this problem ? Thanks a lot for your help !! Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it _______________________________________________________________________

5 15

Changing disk QoS causes segfault with IO-Threads enabled (oVirt 4.3.0.4-1.el7)
by jloh＠squiz.net 23 Apr '24

23 Apr '24

We recently upgraded to 4.3.0 and have found that when changing disk QoS settings on VMs whilst IO-Threads is enabled causes them to segfault and the VM to reboot. We've been able to replicate this across several VMs. VMs with IO-Threads disabled/turned off do not segfault when changing the QoS. Mar 1 11:49:06 srvXX kernel: IO iothread1[30468]: segfault at fffffffffffffff8 ip 0000557649f2bd24 sp 00007f80de832f60 error 5 in qemu-kvm[5576498dd000+a03000] Mar 1 11:49:06 srvXX abrt-hook-ccpp: invalid number 'iothread1' Mar 1 11:49:11 srvXX libvirtd: 2019-03-01 00:49:11.116+0000: 13365: error : qemuMonitorIORead:609 : Unable to read from monitor: Connection reset by peer Happy to supply some more logs to someone if they'll help but just wondering whether anyone else has experienced this or knows of a current fix other than turning io-threads off. Cheers.

4 3

Unable to install oVirt on RHEL7.5
by SS00514758＠techmahindra.com 05 Jan '24

05 Jan '24

Hi All, I am unable to install oVirt on RHEL7.5, to install it I am taking reference of below link, https://www.ovirt.org/documentation/install-guide/chap-Installing_oVirt.html But though it is not working for me, couple of dependencies is not getting installed, and because of this I am not able to run the ovirt-engine, below are the depencies packages that unable to install, Error: Package: collectd-write_http-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) Requires: collectd(x86-64) = 5.8.0-6.1.el7 Removing: collectd-5.8.0-6.1.el7.x86_64 (@ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-6.1.el7 Updated By: collectd-5.8.1-1.el7.x86_64 (epel) collectd(x86-64) = 5.8.1-1.el7 Available: collectd-5.7.2-1.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-1.el7 Available: collectd-5.7.2-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.7.2-3.el7 Available: collectd-5.8.0-2.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-2.el7 Available: collectd-5.8.0-3.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-3.el7 Available: collectd-5.8.0-5.el7.x86_64 (ovirt-4.2-centos-opstools) collectd(x86-64) = 5.8.0-5.el7 Help me to install this. Looking forward to resolve this issue. Regards Sumit Sahay

6 8

Re: Failed to synchronize networks of Provider ovirt-provider-ovn
by Mail SET Inc. Group 27 Oct '23

27 Oct '23

Yes, i use same manual to change WebUI SSL. ovirt-ca-file= is a same SSL file which use WebUI. Yes, i restart ovirt-provider-ovn, i restart engine, i restart all what i can restart. Nothing... > 12 сент. 2018 г., в 16:11, Dominik Holler <dholler(a)redhat.com> написал(а): > > On Wed, 12 Sep 2018 14:23:54 +0300 > "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: > >> Ok! > > Not exactly, please use users(a)ovirt.org for such questions. > Other should benefit from this questions, too. > Please write the next mail to users(a)ovirt.org and keep me in CC. > >> What i did: >> >> 1) install oVirt «from box» (4.2.5.2-1.el7); >> 2) generate own ssl for my engine using my FreeIPA CA, Install it and > > What means "Install it"? You can use the doc from the following link > https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… > > Ensure that ovirt-ca-file= in > /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf > points to the correct file and ovirt-provider-ovn is restarted. > >> get tis issue; >> >> >> [root@engine ~]# tail -n 50 /var/log/ovirt-provider-ovn.log >> 2018-09-12 14:10:23,828 root [SSL: CERTIFICATE_VERIFY_FAILED] >> certificate verify failed (_ssl.c:579) Traceback (most recent call >> last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", >> line 133, in _handle_request method, path_parts, content >> File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", >> line 175, in handle_request return >> self.call_response_handler(handler, content, parameters) File >> "/usr/share/ovirt-provider-ovn/handlers/keystone.py", line 33, in >> call_response_handler return response_handler(content, parameters) >> File "/usr/share/ovirt-provider-ovn/handlers/keystone_responses.py", >> line 62, in post_tokens user_password=user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 26, in >> create_token return auth.core.plugin.create_token(user_at_domain, >> user_password) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/plugin.py", line >> 48, in create_token timeout=self._timeout()) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 75, >> in create_token username, password, engine_url, ca_file, timeout) >> File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line >> 91, in _get_sso_token timeout=timeout File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, >> in wrapper response = func(*args, **kwargs) File >> "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, >> in wrapper raise BadGateway(e) BadGateway: [SSL: >> CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) >> >> >> [root@engine ~]# tail -n 20 /var/log/ovirt-engine/engine.log >> 2018-09-12 14:10:23,773+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:10:23,778+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:10:23,836+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:10:23,837+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [316db685] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:14:12,477+03 INFO >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default >> task-6) [] User admin@internal successfully logged in with scopes: >> ovirt-app-admin ovirt-app-api ovirt-app-portal >> ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all >> ovirt-ext=token-info:authz-search >> ovirt-ext=token-info:public-authz-search >> ovirt-ext=token-info:validate ovirt-ext=token:password-access >> 2018-09-12 14:14:12,587+03 INFO >> [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default >> task-6) [1bf1b763] Running command: CreateUserSessionCommand >> internal: false. 2018-09-12 14:14:12,628+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [1bf1b763] EVENT_ID: USER_VDC_LOGIN(30), User >> admin@internal-authz connecting from '10.0.3.61' using session >> 's8jAm7BUJGlicthm6yZBA3CUM8QpRdtwFaK3M/IppfhB3fHFB9gmNf0cAlbl1xIhcJ2WX+ww7e71Ri+MxJSsIg==' >> logged in. 2018-09-12 14:14:30,972+03 INFO >> [org.ovirt.engine.core.bll.provider.ImportProviderCertificateCommand] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] Running >> command: ImportProviderCertificateCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:30,982+03 INFO >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] >> (default task-6) [ee3cc8a7-4485-4fdf-a0c2-e9d67b5cfcd3] EVENT_ID: >> PROVIDER_CERTIFICATE_IMPORTED(213), Certificate for provider >> ovirt-provider-ovn was imported. (User: admin@internal-authz) >> 2018-09-12 14:14:31,006+03 INFO >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Running >> command: TestProviderConnectivityCommand internal: false. Entities >> affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: >> SystemAction group CREATE_STORAGE_POOL with role type ADMIN >> 2018-09-12 14:14:31,058+03 ERROR >> [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] >> (default task-6) [a48d94ab-b0b2-42a2-a667-0525b4c652ea] Command >> 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'default' is using 0 threads out of 1, 5 threads waiting for >> tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engine' is using 0 threads out of 500, 16 threads waiting for >> tasks and 0 tasks in queue. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineScheduled' is using 0 threads out of 100, 100 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads >> waiting for tasks. 2018-09-12 14:15:10,954+03 INFO >> [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] >> (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread >> pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads >> waiting for tasks. 2018-09-12 14:15:23,843+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> Acquired to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' 2018-09-12 14:15:23,849+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Running command: SyncNetworkProviderCommand internal: true. >> 2018-09-12 14:15:23,900+03 ERROR >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] >> Command >> 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' >> failed: EngineException: (Failed with error Bad Gateway and code >> 5050) 2018-09-12 14:15:23,901+03 INFO >> [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] >> (EE-ManagedThreadFactory-engineScheduled-Thread-61) [2455041f] Lock >> freed to object >> 'EngineLock:{exclusiveLocks='[14e4fb72-9764-4757-b37d-4d487995571a=PROVIDER]', >> sharedLocks=''}' >> >> >> [root@engine ~]# >> cat /etc/ovirt-provider-ovn/conf.d/10-setup-ovirt-provider-ovn.conf # >> This file is automatically generated by engine-setup. Please do not >> edit manually [OVN REMOTE] ovn-remote=ssl:127.0.0.1:6641 >> [SSL] >> https-enabled=true >> ssl-cacert-file=/etc/pki/ovirt-engine/ca.pem >> ssl-cert-file=/etc/pki/ovirt-engine/certs/ovirt-provider-ovn.cer >> ssl-key-file=/etc/pki/ovirt-engine/keys/ovirt-provider-ovn.key.nopass >> [OVIRT] >> ovirt-sso-client-secret=Ms7Gw9qNT6IkXu7oA54tDmxaZDIukABV >> ovirt-host=https://engine.set.local:443 >> ovirt-sso-client-id=ovirt-provider-ovn >> ovirt-ca-file=/etc/pki/ovirt-engine/apache-ca.pem >> [PROVIDER] >> provider-host=engine.set.local >> >> >>> 12 сент. 2018 г., в 13:59, Dominik Holler <dholler(a)redhat.com> >>> написал(а): >>> >>> On Wed, 12 Sep 2018 13:04:53 +0300 >>> "Mail SET Inc. Group" <mail(a)set-pro.net> wrote: >>> >>>> Hello Dominik! >>>> I have a same issue with OVN provider and SSL >>>> https://www.mail-archive.com/users@ovirt.org/msg47020.html >>>> <https://www.mail-archive.com/users@ovirt.org/msg47020.html> But >>>> certificate changes not helps to resolve it. Maybe you can help me >>>> with this? >>> >>> Sure. Can you please share the relevant lines of >>> ovirt-provider-ovn.log and engine.log, and the information if you >>> are using the certificates generated by engine-setup with >>> users(a)ovirt.org ? Thanks, >>> Dominik >>> >> > >

5 13

engine-setup failing on 4.3.2 -> 4.3.3 fails during Engine schema refresh fail
by Edward Berger 18 Jul '23

18 Jul '23

I was trying to upgrade a hyperconverged oVirt hosted engine and failed in the engine-setup command with these error and warnings. ... [ INFO ] Creating/refreshing Engine database schema [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0830_add_foreign_key_to_image_transfers.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed ... [ INFO ] Yum Verify: 16/16: ovirt-engine-tools.noarch 0:4.3.3.5-1.el7 - e [WARNING] Rollback of DWH database postponed to Stage "Clean up" [ INFO ] Rolling back database schema ... [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Attaching engine-setup logfile.

4 6

oVirt host deploy: disable multipath
by femi adegoke 27 Mar '23

27 Mar '23

https://bugzilla.redhat.com/show_bug.cgi?id=1472356 There are 2 drives in my install that oVirt is claiming as multipath. I have tried blacklisting at /etc/multipath/ but that hasn't worked. Any better solutions? I need these 2 drives to be non-multipathed.

4 19

Out-of-sync networks can only be detached
by Sakhi Hadebe 27 Feb '23

27 Feb '23

Hi, I have a 3-node oVirt cluster. I have configured 2 logical networks: ovirtmgmt and public. Public logical network is attached in only 2 nodes and failing to attach on the 3rd node with the below error Invalid operation, out-of-sync network 'public' can only be detached. Please have been stuck on this for almost the whole day now. How do I fix this error? -- Regards, Sakhi Hadebe

3 5

Network Address Change
by Paul.LKW 28 Dec '22

28 Dec '22

Hi All: I just has a case, I need to change the oVirt host and engine IP address due to data center decommission I checked in the hosted-engine host there are some files I could change ; in ovirt-hosted-engine/hosted-engine.conf ca_subject="O=simple.com, CN=1.2.3.4" gateway=1.2.3.254 and of course I need to change the ovirtmgmt interface IP too, I think just change the above line could do the tick, but where could I change the other host IP in the cluster ? I think I have to be lost all the host as once changed the hosted-engine host IP as it is in diff. sub net. Does there any command line tools could do that or someone has such experience could share? Best Regards, Paul.LKW

4 6

looking for some ISV backup software which integrates the backup API
by Nathanaël Blanchet 08 Jun '22

08 Jun '22

Hello, We are about to change our backup provider, and I find it is a great chance to choose a full supported ovirt backup solution. I currently use this python script vm-backup-scheduler (https://github.com/wefixit-AT/oVirtBackup) but it is not the workflow officially suggested by the community (https://www.ovirt.org/develop/release-management/features/storage/backup-re…) I've been looking for a long time an ISV who supports such an API, but the only one I found is this one : Acronis Backup Advanced suggested here https://access.redhat.com/ecosystem/search/#/ecosystem/Red%20Hat%20Enterpri… I ran the trial version, but it doesn't seem to do better than the vm-backup-scheduler script, and it doesn't seem to use the backup API (attach a clone as a disk to an existing vm). Can you suggest me some other ISV solutions, if they ever exist... or share me your backup experience?

5 4

OVS switch type for hosted-engine
by Devin A. Bougie 06 May '22

06 May '22

Is it possible to setup a hosted engine using the OVS switch type instead of Legacy? If it's not possible to start out as OVS, instructions for switching from Legacy to OVS after the fact would be greatly appreciated. Many thanks, Devin

4 5

USB3 redirection
by Rik Theys 19 Apr '22

19 Apr '22

Hi, I'm trying to assign a USB3 controller to a CentOS 7.4 VM in oVirt 4.1 with USB redirection enabled. I've created the following file in /etc/ovirt-engine/osinfo.conf.d: 01-usb.properties with content os.other.devices.usb.controller.value = nec-xhci and have restarted ovirt-engine. If I disable USB-support in the web interface for the VM, the xhci controller is added to the VM (I can see it in the qemu-kvm commandline), but usb redirection is not available. If I enable USB-support in the UI, no xhci controller is added (only 4 uhci controllers). Is there a way to make the controllers for usb redirection xhci controllers? Regards, Rik -- Rik Theys System Engineer KU Leuven - Dept. Elektrotechniek (ESAT) Kasteelpark Arenberg 10 bus 2440 - B-3001 Leuven-Heverlee +32(0)16/32.11.07 ---------------------------------------------------------------- <<Any errors in spelling, tact or fact are transmission errors>>

3 5

OVN routing and firewalling in oVirt
by Gianluca Cecchi 19 Apr '22

19 Apr '22

Hello, how do we manage routing between different OVN networks in oVirt? And between OVN networks and physical ones? Based on architecture read here: http://openvswitch.org/support/dist-docs/ovn-architecture.7.html I see terms for logical routers and gateway routers respectively but how to apply to oVirt configuration? Do I have to choose between setting up a specialized VM or a physical one: is it applicable/advisable to put on oVirt host itself the gateway functionality? Is there any security policy (like security groups in Openstack) to implement? Thanks, Gianluca

4 6

Install hosted-engine - Task Get local VM IP failed
by florentl 10 Mar '22

10 Mar '22

Hi all, I try to install hosted-engine on node : ovirt-node-ng-4.2.3-0.20180518. Every times I get stuck on : [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 50, "changed": true, "cmd": "virsh -r net-dhcp-leases default | grep -i 00:16:3e:6c:5a:91 | awk '{ print $5 }' | cut -f1 -d'/'", "delta": "0:00:00.108872", "end": "2018-06-01 11:17:34.421769", "rc": 0, "start": "2018-06-01 11:17:34.312897", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} I tried with static IP Address and with DHCP but both failed. To be more specific, I installed three nodes, deployed glusterfs with the wizard. I'm in a nested virtualization environment for this lab (Vmware Esxi Hypervisor). My node IP is : 192.168.176.40 / and I want the hosted-engine vm has 192.168.176.43. Thanks, Florent

7 17

Host needs to be reinstalled after configuring power management
by Andrew DeMaria 02 Feb '22

02 Feb '22

Hi, I am running ovirt 4.3 and have found the following action item immediately after configuring power management for a host: Host needs to be reinstalled as important configuration changes were applied on it. The thing is - I've just freshly installed this host and it seems strange that I need to reinstall it. Is there a better way to install a host and configure power management without having to reinstall it after? Thanks, Andrew

4 3

Import an exported VM using Ansible
by paolo＠airaldi.it 25 Jan '22

25 Jan '22

Hello everybody! I'm trying to automate a copy of a VM from one Datacenter to another using an Ansible.playbook. I'm able to: - Create a snapshot of the source VM - create a clone from the snapshot - remove the snapshot - attach an Export Domain - export the clone to the Export Domain - remove the clone - detach the Export domain from the source Datacenter and attach to the destination. Unfortunately I cannot find a module to: - import the VM from the Export Domain - delete the VM image from the Export Domain. Any hint on how to do that? Thanks in advance. Cheers. Paolo PS: if someone is interested I can share the playbook.

4 3

did 4.3.9 reset bug https://bugzilla.redhat.com/show_bug.cgi?id=1590266
by kelley bryan 10 Jan '22

10 Jan '22

I am experiencing the error message in the ovirt-hosted-engine-setup-ansible-create_target_vm log {2020-05-06 14:15:30,024-0500 ERROR ansible failed {'status': 'FAILED', 'ansible_type': 'task', 'ansible_task': u"Fail if Engine IP is different from engine's he_fqdn resolved IP", 'ansible_result': u'type: <type \'dict\'>\nstr: {\'msg\': u"Engine VM IP address is while the engine\'s he_fqdn ovirt1-engine.kelleykars.org resolves to 192.168.122.2. If you are using DHCP, check your DHCP reservation configuration", \'changed\': False, \'_ansible_no_log\': False}', 'task_duration': 1, 'ansible_host': u'localhost', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml'}}:Q! The bug 1590266 says it should report the engine VM IP address xxx.xxx.xxx.xxx while the Engines he_fqdn is xxxxxxxxx I need to see what it thins is wrong as both dig fqdn engine name and dig -x ip return the correct information. Now this bug looks like it may play but I don't see the failed rediness check in the this log https://access.redhat.com/solutions/4462431 or is it because the vm fails or dies or ???

3 7

Lots of storage.MailBox.SpmMailMonitor
by Fabrice Bacchella 06 Jan '22

06 Jan '22

My vdsm log files are huge: -rw-r--r-- 1 vdsm kvm 1.8G Nov 22 11:32 vdsm.log And this is juste half an hour of logs: $ head -1 vdsm.log 2018-11-22 11:01:12,132+0100 ERROR (mailbox-spm) [storage.MailBox.SpmMailMonitor] mailbox 2 checksum failed, not clearing mailbox, clearing new mail (data='...lots of data', expected='\xa4\x06\x08\x00') (mailbox:612) I just upgraded vdsm: $ rpm -qi vdsm Name : vdsm Version : 4.20.43

3 5

Template for Ubuntu 18.04 Server Issues
by jeremy_tourville＠hotmail.com 02 Sep '21

02 Sep '21

I have built a system as a template on oVirt. Specifically, Ubuntu 18.04 server. I am noticing an issue when creating new vms from that template. I used the check box for "seal template" when creating the template. When I create a new Ubuntu VM I am getting duplicate IP addresses for all the machines created from the template. It seems like the checkbox doesn't fully function as intended. I would need to do further manual steps to clear up this issue. Has anyone else noticed this behavior? Is this expected or have I missed something? Thanks for your input!

6 7

Libgfapi considerations
by Jayme 01 Jul '21

01 Jul '21

Are there currently any known issues with using libgfapi in the latest stable version of ovirt in hci deployments? I have recently enabled it and have noticed a significant (over 4x) increase in io performance on my vms. I’m concerned however since it does not seem to be an ovirt default setting. Is libgfapi considered safe and stable to use in ovirt 4.3 hci?

9 16

poweroff and reboot with ovirt_vm ansible module
by Nathanaël Blanchet 18 May '21

18 May '21

Hello, is there a way to poweroff or reboot (without stopped and running state) a vm with the ovirt_vm ansible module? -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

7 11

supervdsm failing during network_caps
by Alan G 24 Mar '21

24 Mar '21

Hi, I have issues with one host where supervdsm is failing in network_caps. I see the following trace in the log. MainProcess|jsonrpc/1::ERROR::2020-01-06 03:01:05,558::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) Error in network_caps Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/supervdsm_server.py", line 98, in wrapper res = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 56, in network_caps return netswitch.configurator.netcaps(compatibility=30600) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch/configurator.py", line 317, in netcaps net_caps = netinfo(compatibility=compatibility) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch/configurator.py", line 325, in netinfo _netinfo = netinfo_get(vdsmnets, compatibility) File "/usr/lib/python2.7/site-packages/vdsm/network/netinfo/cache.py", line 150, in get return _stringify_mtus(_get(vdsmnets)) File "/usr/lib/python2.7/site-packages/vdsm/network/netinfo/cache.py", line 59, in _get ipaddrs = getIpAddrs() File "/usr/lib/python2.7/site-packages/vdsm/network/netinfo/addresses.py", line 72, in getIpAddrs for addr in nl_addr.iter_addrs(): File "/usr/lib/python2.7/site-packages/vdsm/network/netlink/addr.py", line 33, in iter_addrs with _nl_addr_cache(sock) as addr_cache: File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/vdsm/network/netlink/__init__.py", line 92, in _cache_manager cache = cache_allocator(sock) File "/usr/lib/python2.7/site-packages/vdsm/network/netlink/libnl.py", line 469, in rtnl_addr_alloc_cache raise IOError(-err, nl_geterror(err)) IOError: [Errno 16] Message sequence number mismatch A restart of supervdsm will resolve the issue for a period, maybe 24 hours, then it will occur again. So I'm thinking it's resource exhaustion or a leak of some kind? Running 4.2.8.2 with VDSM at 4.20.46. I've had a look through the bugzilla and can't find an exact match, closest was this one https://bugzilla.redhat.com/show_bug.cgi?id=1666123 which seems to be a RHV only fix. Thanks, Alan

2 3

OVN and change of mgmt network
by Gianluca Cecchi 27 Jan '21

27 Jan '21

Hello, I previously had OVN running on engine (as OVN provider with northd and northbound and southbound DBs) and hosts (with OVN controller). After changing mgmt ip of hosts (engine has retained instead the same ip), I executed again on them the command: vdsm-tool ovn-config <ip_of_engine> <nel_local_ip_of_host> Now I think I have to clean up some things, eg: 1) On engine where I get these lines below systemctl status ovn-northd.service -l . . . Sep 29 14:41:42 ovmgr1 ovsdb-server[940]: ovs|00005|reconnect|ERR|tcp: 10.4.167.40:37272: no response to inactivity probe after 5 seconds, disconnecting Oct 03 11:52:00 ovmgr1 ovsdb-server[940]: ovs|00006|reconnect|ERR|tcp: 10.4.167.41:52078: no response to inactivity probe after 5 seconds, disconnecting The two IPs are the old ones of two hosts It seems that a restart of the services has fixed... Can anyone confirm if I have to do anything else? 2) On hosts (there are 3 hosts with OVN on ip 10.4.192.32/33/34) where I currently have this output [root@ov301 ~]# ovs-vsctl show 3a38c5bb-0abf-493d-a2e6-345af8aedfe3 Bridge br-int fail_mode: secure Port "ovn-1dce5b-0" Interface "ovn-1dce5b-0" type: geneve options: {csum="true", key=flow, remote_ip="10.4.192.32"} Port "ovn-ddecf0-0" Interface "ovn-ddecf0-0" type: geneve options: {csum="true", key=flow, remote_ip="10.4.192.33"} Port "ovn-fd413b-0" Interface "ovn-fd413b-0" type: geneve options: {csum="true", key=flow, remote_ip="10.4.168.74"} Port br-int Interface br-int type: internal ovs_version: "2.7.2" [root@ov301 ~]# The IPs of kind 10.4.192.x are ok. But there is a left-over of an old host I initially used for tests, corresponding to 10.4.168.74, that now doesn't exist anymore How can I clean records for 1) and 2)? Thanks, Gianluca

3 4

encrypted GENEVE traffic
by Pavel Nakonechnyi 18 Jan '21

18 Jan '21

Dear oVirt Community, From my understanding oVirt does not support Open vSwitch IPSEC tunneling for GENEVE traffic (which is described on pages http://docs.openvswitch.org/en/latest/howto/ipsec/ and http://docs.openvswitch.org/en/latest/tutorials/ipsec/) Are there plans to introduce such support? (or explicitly not to..) Is it possible to somehow manually configure such tunneling for existing virtual networks? (even in a limited way) Alternatively, is it possible to deploy oVirt on top of the tunneled (i.e. via VXLAN, IPSec) interfaces? This will allow to encrypt all management traffic. Such requirement arises when using oVirt deployment on third-party premises with untrusted network. Thank in advance for any clarifications. :) -- WBR, Pavel +32478910884

2 7

oVirt 4.4: Self-hosted engine deployment fails with backup restore from 4.3 engine
by Oliver Leinfelder 11 Dec '20

11 Dec '20

Hi there, I'm a bit puzzled about an possible upgrade paths from a 4.3 cluster to version 4.4 in a self-hosted engine environment. My idea was: Set up a new host with a clean ovirt node 4.4 installation, then deploy the hosted engine on this with a restored backup from the production cluster and go from there. This however fails with the following error: 2020-05-27 00:17:08,886+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:103 {'msg': 'non-zero return code', 'cmd': ['engine-setup', '--accept-defaults', '--config-append=/root/ovirt-engine-answers'], 'stdout': "[ INFO ] Stage: Initializing\n[ INFO ] Stage: Environment setup\n C onfiguration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/10-packaging.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf, /root/ovirt-engine-answers\n Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20200527001657-fyeueu.log\n Version: otop i-1.9.1 (otopi-1.9.1-1.el8)\n[ INFO ] DNF Downloading 1 files, 0.00KB\n[ INFO ] DNF Downloaded CentOS-8 - AppStream\n[ INFO ] DNF Downloading 1 files, 0.00KB\n[ INFO ] DNF Downloaded CentOS-8 - Base\n[ INFO ] DNF Downloading 1 files, 0.00KB\n [...] ... anwsers from backup config follow .... [...] 2020-05-27 00:17:12,396+0200 DEBUG otopi.context context._executeMethod:145 method exception Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/context.py", line 132, in _executeMethod method['method']() File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/misc.py", line 403, in _closeup r = ah.run() File "/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/ansible_utils.py", line 229, in run raise RuntimeError(_('Failed executing ansible-playbook')) Is this approach (restoring from 4.3) generally supposed to work? If not, what is the appropriate upgrade path? Thank you! Regards Oli

3 7

Can't import some VMs after storage domain detach and reattach to new datacenter.
by m black 10 Dec '20

10 Dec '20

7 14

"gluster-ansible-roles is not installed on Host" error on Cockpit
by Hesham Ahmed 26 Nov '20

26 Nov '20

On a new 4.3.1 oVirt Node installation, when trying to deploy HCI (also when trying adding a new gluster volume to existing clusters) using Cockpit, an error is displayed "gluster-ansible-roles is not installed on Host. To continue deployment, please install gluster-ansible-roles on Host and try again". There is no package named gluster-ansible-roles in the repositories: [root@localhost ~]# yum install gluster-ansible-roles Loaded plugins: enabled_repos_upload, fastestmirror, imgbased-persist, package_upload, product-id, search-disabled-repos, subscription-manager, vdsmupgrade This system is not registered with an entitlement server. You can use subscription-manager to register. Loading mirror speeds from cached hostfile * ovirt-4.3-epel: mirror.horizon.vn No package gluster-ansible-roles available. Error: Nothing to do Uploading Enabled Repositories Report Cannot upload enabled repos report, is this client registered? This is due to check introduced here: https://gerrit.ovirt.org/#/c/98023/1/dashboard/src/helpers/AnsibleUtil.js Changing the line from: [ "rpm", "-qa", "gluster-ansible-roles" ], { "superuser":"require" } to [ "rpm", "-qa", "gluster-ansible" ], { "superuser":"require" } resolves the issue. The above code snippet is installed at /usr/share/cockpit/ovirt-dashboard/app.js on oVirt node and can be patched by running "sed -i 's/gluster-ansible-roles/gluster-ansible/g' /usr/share/cockpit/ovirt-dashboard/app.js && systemctl restart cockpit"

2 1

Error exporting into ova
by Gianluca Cecchi 31 Aug '20

31 Aug '20

Hello, I'm playing with export_vm_as_ova.py downloaded from the examples github: https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/export_v… My environment is oVirt 4.3.3.7 with iSCSI storage domain. It fails leaving an ova.tmp file In webadmin gui: Starting to export Vm enginecopy1 as a Virtual Appliance 7/19/1911:55:12 AM VDSM ov301 command TeardownImageVDS failed: Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume fa33df49-b09d-4f86-9719-ede649542c21/0420ef47-0ad0-4cf9-babd-d89383f7536b in use.\']\\nfa33df49-b09d-4f86-9719-ede649542c21/[\'a7480dc5-b5ca-4cb3-986d-77bc12165be4\', \'0420ef47-0ad0-4cf9-babd-d89383f7536b\']",)',) 7/19/1912:25:36 PM Failed to export Vm enginecopy1 as a Virtual Appliance to path /save_ova/base/dump/myvm2.ova on Host ov301 7/19/1912:25:37 PM During export I have this qemu-img process creating the disk over the loop device: root 30878 30871 0 11:55 pts/2 00:00:00 su -p -c qemu-img convert -T none -O qcow2 '/rhev/data-center/mnt/blockSD/fa33df49-b09d-4f86-9719-ede649542c21/images/59a4a324-4c99-4ff5-abb1-e9bbac83292a/0420ef47-0ad0-4cf9-babd-d89383f7536b' '/dev/loop1' vdsm vdsm 30882 30878 10 11:55 ? 00:00:00 qemu-img convert -T none -O qcow2 /rhev/data-center/mnt/blockSD/fa33df49-b09d-4f86-9719-ede649542c21/images/59a4a324-4c99-4ff5-abb1-e9bbac83292a/0420ef47-0ad0-4cf9-babd-d89383f7536b /dev/loop1 The ova.tmp file is getting filled while command runs eg: [root@ov301 ]# du -sh /save_ova/base/dump/myvm2.ova.tmp 416M /save_ova/base/dump/myvm2.ova.tmp [root@ov301 sysctl.d]# [root@ov301 sysctl.d]# du -sh /save_ova/base/dump/myvm2.ova.tmp 911M /save_ova/base/dump/myvm2.ova.tmp [root@ov301 ]# and the final generated / not completed file is in this state: [root@ov301 ]# qemu-img info /save_ova/base/dump/myvm2.ova.tmp image: /save_ova/base/dump/myvm2.ova.tmp file format: raw virtual size: 30G (32217446400 bytes) disk size: 30G [root@ov301 sysctl.d]# But I notice that the timestamp of the file is about 67 minutes after start of job and well after the notice of its failure.... [root@ov301 sysctl.d]# ll /save_ova/base/dump/ total 30963632 -rw-------. 1 root root 32217446400 Jul 19 13:02 myvm2.ova.tmp [root@ov301 sysctl.d]# [root@ov301 sysctl.d]# du -sh /save_ova/base/dump/myvm2.ova.tmp 30G /save_ova/base/dump/myvm2.ova.tmp [root@ov301 sysctl.d]# In engine.log the first error I see is 30 minutes after start 2019-07-19 12:25:31,563+02 ERROR [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [2001ddf4] Ansible playbook execution failed: Timeout occurred while executing Ansible playbook. 2019-07-19 12:25:31,563+02 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [2001ddf4] Ansible playbook command has exited with value: 1 2019-07-19 12:25:31,564+02 ERROR [org.ovirt.engine.core.bll.CreateOvaCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [2001ddf4] Failed to create OVA. Please check logs for more details: /var/log/ovirt-engine/ova/ovirt-export-ova-ansible-20190719115531-ov301-2001ddf4.log 2019-07-19 12:25:31,565+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.TeardownImageVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [2001ddf4] START, TeardownImageVDSCommand(HostName = ov301, ImageActionsVDSCommandParameters:{hostId='8ef1ce6f-4e38-486c-b3a4-58235f1f1d06'}), log id: 3d2246f7 2019-07-19 12:25:36,569+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [2001ddf4] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM ov301 command TeardownImageVDS failed: Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\' Logical volume fa33df49-b09d-4f86-9719-ede649542c21/0420ef47-0ad0-4cf9-babd-d89383f7536b in use.\']\\nfa33df49-b09d-4f86-9719-ede649542c21/[\'a7480dc5-b5ca-4cb3-986d-77bc12165be4\', \'0420ef47-0ad0-4cf9-babd-d89383f7536b\']",)',) In ansible playbook suggested log file I don't see anything useful. It ends with timestamps when the script has been launched. Last lines are: 2019-07-19 11:55:33,877 p=5699 u=ovirt | TASK [ovirt-ova-export-pre-pack : Retrieving the temporary path for the OVA file] *** 2019-07-19 11:55:34,198 p=5699 u=ovirt | changed: [ov301] => { "changed": true, "dest": "/save_ova/base/dump/myvm2.ova.tmp", "gid": 0, "group": "root", "mode": "0600", "owner": "root", "secontext": "system_u:object_r:nfs_t:s0", "size": 32217446912, "state": "file", "uid": 0 } 2019-07-19 11:55:34,204 p=5699 u=ovirt | TASK [ovirt-ova-pack : Run packing script] ************************************* It seems 30 minutes... for timeout? About what, ansible job? Or possibly implicit user session created when running the python script? The snapshot has been correctly deleted (as I see also in engine.log), I don't see it in webadmin gui. Any known problem? Just for test I executed again at 14:24 and I see same Ansible error at 14:54 The snapshot gets deleted, while the qemu-img command still continues.... [root@ov301 sysctl.d]# ps -ef | grep qemu-img root 13504 13501 0 14:24 pts/1 00:00:00 su -p -c qemu-img convert -T none -O qcow2 '/rhev/data-center/mnt/blockSD/fa33df49-b09d-4f86-9719-ede649542c21/images/59a4a324-4c99-4ff5-abb1-e9bbac83292a/0420ef47-0ad0-4cf9-babd-d89383f7536b' '/dev/loop0' vdsm vdsm 13505 13504 3 14:24 ? 00:01:26 qemu-img convert -T none -O qcow2 /rhev/data-center/mnt/blockSD/fa33df49-b09d-4f86-9719-ede649542c21/images/59a4a324-4c99-4ff5-abb1-e9bbac83292a/0420ef47-0ad0-4cf9-babd-d89383f7536b /dev/loop0 root 17587 24530 0 15:05 pts/0 00:00:00 grep --color=auto qemu-img [root@ov301 sysctl.d]# [root@ov301 sysctl.d]# du -sh /save_ova/base/dump/myvm2.ova.tmp 24G /save_ova/base/dump/myvm2.ova.tmp [root@ov301 sysctl.d]# ll /save_ova/base/dump/myvm2.ova.tmp -rw-------. 1 root root 32217446400 Jul 19 15:14 /save_ova/base/dump/myvm2.ova.tmp [root@ov301 sysctl.d]# and then continues until image copy completes, but at this time the job has already aborted and so the completion of the ova composition doesn't go ahead... and I remain with the ova.tmp file... How to extend timeout? Thanks in advance, Gianluca

4 11

deprecating export domain?
by Charles Kozler 30 Aug '20

30 Aug '20

Hello, I recently read on this list from a redhat member that export domain is either being deprecated or looking at being deprecated To that end, can you share details? Can you share any notes/postings/bz's that document this? I would imagine something like this would be discussed in larger audience This seems like a somewhat significant change to make and I am curious where this is scheduled? Currently, a lot of my backups rely explicitly on an export domain for online snapshots, so I'd like to plan accordingly Thanks!

11 21

Upgrade Memory of oVirt Nodes
by souvaliotimaria＠mail.com 19 Aug '20

19 Aug '20

Hello everyone, I have an oVirt 4.3.2.5 hyperconverged 3 node production environment and we want to add some RAM to it. Can I upgrade the RAM without my users noticing any disruptions and keep the VMs running? The way I thought I should do it was to migrate any running VMs to the other nodes, then set one node in maintenance mode, shut it down, place the new memory, bring it back up, remove it from maintenance mode and see how the installation reacts and repeat for the other two nodes. Is this correct or should I follow another way? Will there be a problem during the time when the nodes will not be identical in their resources? Thank you for your time, Souvalioti Maria

4 5

Support for Shared SAS storage
by Vinícius Ferrão 13 Aug '20

13 Aug '20

Hello, I’ve two compute nodes with SAS Direct Attached sharing the same disks. Looking at the supported types I can’t see this on the documentation: https://www.ovirt.org/documentation/admin-guide/chap-Storage.html There’s is local storage on this documentation, but my case is two machines, both using SAS, connected to the same machines. It’s the VRTX hardware from Dell. Is there any support for this? It should be just like Fibre Channel and iSCSI, but with SAS instead. Thanks,

7 11

oVirt 4.4.0 Release is now generally available
by Sandro Bonazzola 12 Aug '20

12 Aug '20

oVirt 4.4.0 Release is now generally available The oVirt Project is excited to announce the general availability of the oVirt 4.4.0 Release, as of May 20th, 2020 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses hundreds of individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics, as compared to oVirt 4.3. Important notes before you install / upgrade Some of the features included in the oVirt 4.4.0 release require content that will be available in CentOS Linux 8.2 but cannot be tested on RHEL 8.2 yet due to some incompatibility in the openvswitch package that is shipped in CentOS Virt SIG, which requires rebuilding openvswitch on top of CentOS 8.2. The cluster switch type OVS is not implemented for CentOS 8 hosts. Please note that oVirt 4.4 only supports clusters and datacenters with compatibility version 4.2 and above. If clusters or datacenters are running with an older compatibility version, you need to upgrade them to at least 4.2 (4.3 is recommended). Please note that in RHEL 8 / CentOS 8 several devices that worked on EL7 are no longer supported. For example, megaraid_sas driver is removed. If you use Enterprise Linux 8 hosts you can try to provide the necessary drivers for the deprecated hardware using the DUD method (See users mailing list thread on this at https://lists.ovirt.org/archives/list/users@ovirt.org/thread/NDSVUZSESOXEFJ… ) Installation instructions For the engine: either use the oVirt appliance or install CentOS Linux 8 minimal by following these steps: - Install the CentOS Linux 8 image from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8…, selecting the minimal installation. - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm - dnf update (reboot if needed) - Attach the host to the engine and let it be deployed. Update instructionsUpdate from oVirt 4.4 Release Candidate On the engine side and on CentOS hosts, you’ll need to switch from ovirt44-pre to ovirt44 repositories. In order to do so, you need to: 1. dnf remove ovirt-release44-pre 2. rm -f /etc/yum.repos.d/ovirt-4.4-pre-dependencies.repo 3. rm -f /etc/yum.repos.d/ovirt-4.4-pre.repo 4. dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm 5. dnf update On the engine side you’ll need to run engine-setup only if you were not already on the latest release candidate. On oVirt Node, you’ll need to upgrade with: 1. Move node to maintenance 2. dnf install https://resources.ovirt.org/pub/ovirt-4.4/rpm/el8/noarch/ovirt-node-ng-imag… 3. Reboot 4. Activate the host Update from oVirt 4.3 oVirt 4.4 is available only for CentOS 8. In-place upgrades from previous installations, based on CentOS 7, are not possible. For the engine, use backup, and restore that into a new engine. Nodes will need to be reinstalled. A 4.4 engine can still manage existing 4.3 hosts, but you can’t add new ones. For a standalone engine, please refer to upgrade procedure at https://ovirt.org/documentation/upgrade_guide/#Upgrading_from_4-3 If needed, run ovirt-engine-rename (see engine rename tool documentation at https://www.ovirt.org/documentation/admin-guide/chap-Utilities.html ) When upgrading hosts: You need to upgrade one host at a time. 1. Turn host to maintenance. Virtual machines on that host should migrate automatically to a different host. 2. Remove it from the engine 3. Re-install it with el8 or oVirt Node as per installation instructions 4. Re-add the host to the engine Please note that you may see some issues live migrating VMs from el7 to el8. If you hit such a case, please turn off the vm on el7 host and get it started on the new el8 host in order to be able to move the next el7 host to maintenance. What’s new in oVirt 4.4.0 Release? - Hypervisors based on CentOS Linux 8 (rebuilt from award winning RHEL8), for both oVirt Node and standalone CentOS Linux hosts. - Easier network management and configuration flexibility with NetworkManager. - VMs based on a more modern Q35 chipset with legacy SeaBIOS and UEFI firmware. - Support for direct passthrough of local host disks to VMs. - Live migration improvements for High Performance guests. - New Windows guest tools installer based on WiX framework now moved to VirtioWin project. - Dropped support for cluster level prior to 4.2. - Dropped API/SDK v3 support deprecated in past versions. - 4K block disk support only for file-based storage. iSCSI/FC storage do not support 4K disks yet. - You can export a VM to a data domain. - You can edit floating disks. - Ansible Runner (ansible-runner) is integrated within the engine, enabling more detailed monitoring of playbooks executed from the engine. - Adding and reinstalling hosts is now completely based on Ansible, replacing ovirt-host-deploy, which is not used anymore. - The OpenStack Neutron Agent cannot be configured by oVirt anymore, it should be configured by TripleO instead. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.0 release highlights: http://www.ovirt.org/release/4.4.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.0/ [2] http://resources.ovirt.org/pub/ovirt-4.4/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

11 35

4.4 HCI Install Failure - Missing /etc/pki/CA/cacert.pem
by Stephen Panicho 10 Aug '20

10 Aug '20

Hi all! I'm using Cockpit to perform an HCI install, and it fails at the hosted engine deploy. Libvirtd can't restart because of a missing /etc/pki/CA/cacert.pem file. The log (tasks seemingly from /usr/share/ansible/roles/ovirt.hosted_engine_setup/tasks/initial_clean.yml): [ INFO ] TASK [ovirt.hosted_engine_setup : Stop libvirt service] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Drop vdsm config statements] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Restore initial abrt config files] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Restart abrtd service] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Stop and disable services] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Restore initial libvirt default network configuration] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Start libvirt] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Unable to start service libvirtd: Job for libvirtd.service failed because the control process exited with error code.\nSee \"systemctl status libvirtd.service\" and \"journalctl -xe\" for details.\n"} journalctl -u libvirtd: May 22 04:33:25 node1 libvirtd[26392]: libvirt version: 5.6.0, package: 10.el8 (CBS <cbs(a)centos.org>, 2020-02-27-01:09:46, ) May 22 04:33:25 node1 libvirtd[26392]: hostname: node1 May 22 04:33:25 node1 libvirtd[26392]: Cannot read CA certificate '/etc/pki/CA/cacert.pem': No such file or directory May 22 04:33:25 node1 systemd[1]: libvirtd.service: Main process exited, code=exited, status=6/NOTCONFIGURED May 22 04:33:25 node1 systemd[1]: libvirtd.service: Failed with result 'exit-code'. May 22 04:33:25 node1 systemd[1]: Failed to start Virtualization daemon. From a fresh CentOS 8.1 minimal install, I've installed the following: - The 4.4 repo - cockpit - ovirt-cockpit-dashboard - vdsm-gluster (providing glusterfs-server and allowing the Gluster Wizard to complete) - gluster-ansible-roles (only on the bootstrap host) I'm not exactly sure what that initial bit of the playbook does. Comparing the bootstrap node with another that has yet to be touched, both /etc/libvirt/libvirtd.conf and /etc/sysconfig/libvirtd are the same on both hosts. Yet the bootstrap host can no longer start libvirtd while the other host can. Neither host has the /etc/pki/CA/cacert.pem file. Please let me know if I can provide any more information. Thanks!

9 15

oVirt thrashes Docker network during installation
by thomas＠hoberg.net 30 Jul '20

30 Jul '20

I want to run containers and VMs side by side and not necessarily nested. The main reason for that is GPUs, Voltas mostly, used for CUDA machine learning not for VDI, which is what most of the VM orchestrators like oVirt or vSphere seem to focus on. And CUDA drivers are notorious for refusing to work under KVM unless you pay $esla. oVirt is more of a side show in my environment, used to run some smaller functional VMs alongside bigger containers, but also in order to consolidate and re-distribute the local compute node storage as a Gluster storage pool: Kibbutz storage and compute, if you want, very much how I understand the HCI philosophy behind oVirt. The full integration of containers and VMs is still very much on the roadmap I believe, but I was surprised to see that even co-existence seems to be a problem currently. So I set-up a 3-node HCI on CentOS7 (GPU-less and older) hosts and then added additional (beefier GPGPU) CentOS7 hosts, that have been running CUDA workloads on the latest Docker-CE v19 something. The installation works fine, I can migrate VMs to these extra hosts etc., but to my dismay Docker containers on these hosts lose access to the local network, that is the entire subnet the host is in. For some strange reason I can still ping Internet hosts, perhaps even everything behind the host's gateway, but local connections are blocked. It would seem that the ovritmgmt network that the oVirt installation puts in breaks the docker0 bridge that Docker put there first. I'd consider that a bug, but I'd like to gather some feedback first, if anyone else has run into this problem. I've repeated this several times in completely distinct environments with the same results: Simply add a host with a working Docker-CE as an oVirt host to an existing DC/cluster and then try if you can still ping anyone on that net, including the Docker host from a busybox container afterwards (should try that ping just before you actually add it). No, I didn't try this with podman yet, because that's separate challenge with CUDA: Would love to know if that is part of QA for oVirt already.

5 9

Non storage nodes erronously included in quota calculations for HCI?
by thomas＠hoberg.net 30 Jul '20

30 Jul '20

For my home-lab I operate a 3 node HCI cluster on 100% passive Atoms, mostly to run light infrastructure services such as LDAP and NextCloud. I then add workstations or even laptops as pure compute hosts to the cluster for bigger but temporary things, that might actually run a different OS most of the time or just be shut off. From oVirt's point of view, these are just first put into maintenance and then shut down until needed again. No fencing or power management, all manual. All nodes, even the HCI ones, run CentOS7 with more of a workstation configuration, so updates pile up pretty quickly. After I recently upgraded one of these extra compute nodes, I found my three node HCI cluster not just faltering, but indeed very hard to reactivate at all. The faltering is a distinct issue: I have the impression that reboots of oVirt nodes cause broadcast storms on my rather simplistic 10Gibt L2 switch, which a normal CentOS instance (or any other OS) doesn't, but that's for another post. No what struck me, was that the gluster daemons on the three HCI nodes kept complaining about a lack of quorum long after the network was all back to normal, even if all three of them were there, saw each other perfectly on "gluster show status all", ready and without any healing issues pending at all. Glusterd would complain on all three nodes that there was no quota for the bricks and stop them. That went away as soon as I started one additional compute node, a node that was a gluster peer (because an oVirt host added to a HCI cluster always gets put into the Gluster, even if it's not contributing storage) but had no bricks. Immediately the gluster daemon on the three nodes with contributing bricks would report back good quota and launch the volumes (and thus all the rest of oVirt), even if in terms of *storage bricks* nothing had changed. I am afraid that downing the extra compute-only oVirtNode will bring down the HCI: Clearly not the type of redundancy it's designed to deliver. Evidently such compute-only hosts (and gluster members) get included into some quorum deliberations even if they hold not a single brick, neither storage nor arbitration. To me that seems like a bug, if that is indeed what happens: There I need your advice and suggestions. AFAIK HCI is a late addition to oVirt/RHEV as storage and compute were orginally designed to be completely distinct. In fact there are still remnants of documentation which seem to prohibit using a node for both compute and storage... what HCI is all about. And I have seen compute nodes with "matching" storage (parts of a distinct HCI setup, that was taken down but still had all the storage and Gluster elements operable), being happliy absorbed into a HCI cluster with all Gluster storage appearing in the GUI etc., without any manual creation or inclusion of bricks: Fully automatic (and undocumented)! In that case it makes sense to widen the scope of quota calculations when additional nodes are hyperconverged elements with contributing bricks. It also seems the only way to turn a 3 node HCI into 6 or 9 node one. But if you really just want to add compute nodes without bricks, those can't get "quota votes" without storage to play a role in the redundancy. I can easily imagine the missing "if then else" in the code here, but I was actually very surprised to see those failure and success messages coming from glusterd itself, which to my understanding is pretty unrelated to oVirt on top. Not from the management engine (wasn't running anyway), not from VDSM. Re-creating the scenario is very scary even if I have gone through this three times already, trying to just bring my HCI back up. And then there is so verbose logs all over the place that I'd like some advice which ones I should post. But simply speaking: Gluster peers should get no quota voting rights on volumes unless they contribute bricks. That rule seems broken. Those in the know, please let me know if am on a goose chase or if there is a real issue here that deserves a bug report.

2 5

Shutdown procedure for single host HCI Gluster
by Gianluca Cecchi 25 Jul '20

25 Jul '20

Hello, I'm testing the single node HCI with ovirt-node-ng 4.3.9 iso. Very nice and many improvements over the last time I tried it. Good! I have a doubt related to shutdown procedure of the server. Here below my steps: - Shutdown all VMs (except engine) - Put into maintenance data and vmstore domains - Enable Global HA Maintenance - Shutdown engine - Shutdown hypervisor It seems that the last step doesn't end and I had to brutally power off the hypervisor. Here the screenshot regarding infinite failure in unmounting /gluster_bricks/engine https://drive.google.com/file/d/1ee0HG21XmYVA0t7LYo5hcFx1iLxZdZ-E/view?usp=… What would be the right step to do before the final shutdown of hypervisor? Thanks, Gianluca

3 10

Upgrade ovirt from 3.4 to 4.3
by lu.alfonsi＠almaviva.it 19 Jun '20

19 Jun '20

Good morning, i have a difficult enviroment with 20 Hypervisors based on ovirt 3.4.3-1 and i would like to reach the 4.3 version. Which are the best steps to achieve these objective? Thanks in advance Luigi

3 10

PKIX path error
by Stack Korora 11 Jun '20

11 Jun '20

Greetings, I have a running oVirt install that's been working for almost 2 years. I'm building a _completely_ new install. I mention it because it is useful for me to compare configurations when I run into issues like this one. Right now there are three physical hosts: 1x management where I run the engine and db 2x hypervisor nodes. I had it up and installed and running smooth this morning on 4.3.9.4-1.el7 on Scientific Linux 7.8 (fully patched). I copied over our 3rd party certs from the running system and restarted httpd. Perfect. SSL is running! /etc/pki/ovirt-engine/apache-ca.pem /etc/pki/ovirt-engine/certs/apache.cer /etc/pki/ovirt-engine/keys/apache.key.nopass Next I used ovirt-engine-extension-aaa-ldap-setup to point to our ldap server. I did the login and search test and both passed on the command line! Horray! Then I went to the web interface... sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target I'm digging through logs and I don't see anything close to this error except nearly the identical message in engine.log. ERROR [org.ovirt.engine.core.aaa.servlet.SslPostLoginServlet] (default task-2) [] server_error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target I can't log in via the web at all, I only get that message (so I can't even test out the local admin). The aaa ldap configuration it generated is darn near perfectly identical (just a name change). The certs are the same. Even when I look in the keystore, the sha1 hashes are the same between the two environments! After over an hour poking at this, I'm completely stumped. Can someone please give me a pointer on what I should try next? Thanks! ~Stack~

3 8

First ovirt 4.4 installation failing
by wart＠caltech.edu 09 Jun '20

09 Jun '20

I'm having some trouble setting up my first oVirt system. I have the CentOS 8 installation on the bare metal (ovirt1.ldas.ligo-la.caltech.edu) the ovirt4.4 packages installed, and then try running 'hosted-engine --deploy' to set up my engine (ovirt-engine1.ldas.ligo-la.caltech.edu) For this initial deployment, I accept almost all of the defaults (other than local network-specific settings). However, the hosted-engine deployment fails with: [ INFO ] TASK [ovirt.hosted_engine_setup : Obtain SSO token using username/pass word credentials] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Wait for the host to be up] [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120, "changed": false, "ov irt_hosts": []} [...cleanup...] [ INFO ] TASK [ovirt.hosted_engine_setup : Notify the user about a failure] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"} However, when I run 'virsh list', I can still see a HostedEngine1 vm running. In virt-hosted-engine-setup-20200522153439-e7iw3k.log I see the error: 2020-05-25 11:57:03,897-0500 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:103 {'changed': False, 'ovirt_hosts': [], 'invocation': {'module_args': {'pattern': 'name=ovirt1.ldas.ligo-la.caltech.edu', 'fetch_nested': False, 'nested_attributes': [], 'all_content': False, 'cluster_version': None}}, '_ansible_no_log': False, 'attempts': 120} 2020-05-25 11:57:03,998-0500 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:107 fatal: [localhost]: FAILED! => {"attempts": 120, "changed": false, "ovirt_hosts": []} In ovirt-hosted-engine-setup-ansible-bootstrap_local_vm-20200525112504-y2mmzu.log I see the following ansible errors: 2020-05-25 11:36:22,300-0500 DEBUG ansible on_any args localhostTASK: ovirt.hosted_engine_setup : Always revoke the SSO token kwargs 2020-05-25 11:36:23,766-0500 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "changed": false, "invocation": { "module_args": { "ca_file": null, "compress": true, "headers": null, "hostname": null, "insecure": null, "kerberos": false, "ovirt_auth": { "ansible_facts": { "ovirt_auth": { "ca_file": null, "compress": true, "headers": null, "insecure": true, "kerberos": false, "timeout": 0, "token": "tF4ZMU0Q23zS13W2vzyhkswGMB4XAXZCFiPg9IVvbJXkPq9MFmne40wvCKaQOJO_TkYOpfxe78r9HHJcSrUWCQ", "url": "https://ovirt-engine1.ldas.ligo-la.caltech.edu/ovirt-engine/api" } }, "attempts": 1, "changed": false, "failed": false }, "password": null, "state": "absent", "timeout": 0, "token": null, "url": null, "username": null } }, "msg": "You must specify either 'url' or 'hostname'." }, "ansible_task": "Always revoke the SSO token", "ansible_type": "task", "status": "FAILED", "task_duration": 2 } 2020-05-25 11:36:23,767-0500 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7f15adaffa58> kwargs ignore_errors:True Then further down: 2020-05-25 11:57:05,063-0500 DEBUG var changed: host "localhost" var "ansible_failed_result" type "<class 'dict'>" value: "{ "_ansible_no_log": false, "_ansible_parsed": true, "attempts": 120, "changed": false, "failed": true, "invocation": { "module_args": { "all_content": false, "cluster_version": null, "fetch_nested": false, "nested_attributes": [], "pattern": "name=ovirt1.ldas.ligo-la.caltech.edu" } }, "ovirt_hosts": [] }" 2020-05-25 11:57:05,063-0500 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "attempts": 120, "changed": false, "invocation": { "module_args": { "all_content": false, "cluster_version": null, "fetch_nested": false, "nested_attributes": [], "pattern": "name=ovirt1.ldas.ligo-la.caltech.edu" } }, "ovirt_hosts": [] }, "ansible_task": "Wait for the host to be up", "ansible_type": "task", "status": "FAILED", "task_duration": 1235 } 2020-05-25 11:57:05,063-0500 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7f15ad92dcc0> kwargs ignore_errors:None Not being very familiar with ansible, I'm not sure where to look next for the root cause of the problem. --Michael Thomas

5 11

Q: Which types of tests and tools are used?
by Juergen Novak 05 Jun '20

05 Jun '20

Hi, can anybody help me to find some information about test types used in the project and tools used? Particularly interesting would be tools and tests used for the Python coding, but also any information about Java would be appreciated. I already scanned the documentation, but I mainly found only information about Mocking tools. Thank you! /juergen

3 2

Ovirt 4.4 Migration assistance needed.
by Strahil Nikolov 05 Jun '20

05 Jun '20

Hello All, I would like to ask for some assistance with the planing of the upgrade to 4.4 . I have issues with the OVN (doesn't work at all), thus I would like to start fresh with the HE. The plan so far (downtime is not an issue) : 1. Reinstall the nodes one by 1 and rejoin them in the Gluster TSP 2. Wipe the HostedEngine's gluster volume 3. Deploy a fresh hosted engine 4. Import the storage domains (gluster) back to the engine and import the VMs Do you see any issues with the plan ? Any problems expected if the VMs do have snapshots? What about the storage domain version ? Thanks in Advance. Best Regards, Strahil Nikolov

3 4

Tasks stuck waiting on another after failed storage migration (yet not visible on SPM)
by David Sekne 05 Jun '20

05 Jun '20

Hello, I'm running oVirt version 4.3.9.4-1.el7. After a failed live storage migration a VM got stuck with snapshot. Checking the engine logs I can see that the snapshot removal task is waiting for Merge to complete and vice versa. 2020-05-26 18:34:04,826+02 INFO [org.ovirt.engine.core.bll.snapshots.RemoveSnapshotSingleDiskLiveCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshotSingleDiskLive' (id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40') waiting on child command id: 'f7d1de7b-9e87-47ba-9ba0-ee04301ba3b1' type:'Merge' to complete 2020-05-26 18:34:04,827+02 INFO [org.ovirt.engine.core.bll.MergeCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Waiting on merge command to complete (jobId = f694590a-1577-4dce-bf0c-3a8d74adf341) 2020-05-26 18:34:04,845+02 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshot' (id: '47c9a847-5b4b-4256-9264-a760acde8275') waiting on child command id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40' type:'RemoveSnapshotSingleDiskLive' to complete 2020-05-26 18:34:14,277+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmJobsMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM Job [f694590a-1577-4dce-bf0c-3a8d74adf341]: In progress (no change) I cannot see any runnig tasks on the SPM (vdsm-client Host getAllTasksInfo). I also cannot find the task ID in any of the other node's logs. I already tried restarting the Engine (didn't help). To start I'm puzzled as to where this task is queueing? Any Ideas on how I could resolve this? Thank you. Regards, David

3 12

Re: Single instance scaleup.
by Strahil 05 Jun '20

05 Jun '20

Hi Leo, As you do not have a distributed volume , you can easily switch to replica 2 arbiter 1 or replica 3 volumes. You can use the following for adding the bricks: https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.1/html/Admi… Best Regards, Strahil NikolivOn May 26, 2019 10:54, Leo David <leoalex(a)gmail.com> wrote: > > Hi Stahil, > Thank you so much for yout input ! > > gluster volume info > > > Volume Name: engine > Type: Distribute > Volume ID: d7449fc2-cc35-4f80-a776-68e4a3dbd7e1 > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: 192.168.80.191:/gluster_bricks/engine/engine > Options Reconfigured: > nfs.disable: on > transport.address-family: inet > storage.owner-uid: 36 > storage.owner-gid: 36 > features.shard: on > performance.low-prio-threads: 32 > performance.strict-o-direct: off > network.remote-dio: off > network.ping-timeout: 30 > user.cifs: off > performance.quick-read: off > performance.read-ahead: off > performance.io-cache: off > cluster.eager-lock: enable > Volume Name: ssd-samsung > Type: Distribute > Volume ID: 76576cc6-220b-4651-952d-99846178a19e > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: 192.168.80.191:/gluster_bricks/sdc/data > Options Reconfigured: > cluster.eager-lock: enable > performance.io-cache: off > performance.read-ahead: off > performance.quick-read: off > user.cifs: off > network.ping-timeout: 30 > network.remote-dio: off > performance.strict-o-direct: on > performance.low-prio-threads: 32 > features.shard: on > storage.owner-gid: 36 > storage.owner-uid: 36 > transport.address-family: inet > nfs.disable: on > > The other two hosts will be 192.168.80.192/193 - this is gluster dedicated network over 10GB sfp+ switch. > - host 2 wil have identical harware configuration with host 1 ( each disk is actually a raid0 array ) > - host 3 has: > - 1 ssd for OS > - 1 ssd - for adding to engine volume in a full replica 3 > - 2 ssd's in a raid 1 array to be added as arbiter for the data volume ( ssd-samsung ) > So the plan is to have "engine" scaled in a full replica 3, and "ssd-samsung" scalled in a replica 3 arbitrated. > > > > > On Sun, May 26, 2019 at 10:34 AM Strahil <hunter86_bg(a)yahoo.com> wrote: >> >> Hi Leo, >> >> Gluster is quite smart, but in order to provide any hints , can you provide output of 'gluster volume info <glustervol>'. >> If you have 2 more systems , keep in mind that it is best to mirror the storage on the second replica (2 disks on 1 machine -> 2 disks on the new machine), while for the arbiter this is not neccessary. >> >> What is your network and NICs ? Based on my experience , I can recommend at least 10 gbit/s interfase(s). >> >> Best Regards, >> Strahil Nikolov >> >> On May 26, 2019 07:52, Leo David <leoalex(a)gmail.com> wrote: >>> >>> Hello Everyone, >>> Can someone help me to clarify this ? >>> I have a single-node 4.2.8 installation ( only two gluster storage domains - distributed single drive volumes ). Now I just got two identintical servers and I would like to go for a 3 nodes bundle. >>> Is it possible ( after joining the new nodes to the cluster ) to expand the existing volumes across the new nodes and change them to replica 3 arbitrated ? >>> If so, could you share with me what would it be the procedure ? >>> Thank you very much ! >>> >>> Leo > > > > -- > Best regards, Leo David

4 5

oVirt 4.4 install fails
by Me 04 Jun '20

04 Jun '20

Hi All Not sure where to start, but here goes. I'm not totally new to oVirt, I used RHEV V3.x in production for several years, it was a breeze to setup. Installing 4.4 on to a host with local SSD and FC for storage. Issue 1, having selected the SSD for install which has failed 4.4 beta on it (several times), I reclaim the space and after a few minutes of not being able to enter a root password on the next install screen, it fails as it can't delete the data on the SSD! Yes, really tried this several times, choosing the recover option and getting a prompt, fdisk /dev/sda delete the two partitions created by oVirt and I can install. This was the case with the beta I tried a few weeks ago too. Having reconfigured the switch attached the the host as a dumb 10GBE port as the enterprise OS installer still doesn't appear to support anything more advanced like teaming and VLANS, I have the initial install on the single SSD and a network connection. Issue 2, I use FF 72.0.2 on Linux x64 to connect by https://hostname:9090 to the web interface, but I can't enter login details as the boxes (everything) are disabled???? There is no warning like "we don't like your choice of browser", but the screen is a not very accessible dark grey on darker grey (a poor choice in what I thought were more enlightened times) so this maybe the case. I have disabled all security add-ons in FF, makes no difference. Any suggestions? M

4 5

basic infra and glusterfs sizing question
by Jiří Sléžka 04 Jun '20

04 Jun '20

Hello, I am just curious if basic gluster HCI layout which is suggested in cockpit has some deeper meaning. There are suggested 3 volumes * engine - it is clear, it is the volume where engine vm is running. When this vm is 51GB big how small could this volume be? I have 1TB SSD storage and I would like utilize it as much as possible. Could I create this volume as small as this vm is? Is it safe for example for future upgrades? * vmstore - it make sense it is a space for all other vms running in oVirt. Right? * data - which purpose has this volume? other data like for example ISOs? Direct disks? Another infra question... or maybe request for comment I have small amount of public ipv4 addresses in my housing (but I have own switches there so I can create vlans and separate internal traffic). I can access only these public ipv4 addresses directly. I would like to conserve these addressess as much as possible so what is the best approach in your opinion? * Install all hosts and HE with management network on private addressess * have small router (hw appliance with for example LEDE) which will utilize one ipv4 address and will do NAT and vpn for accessing my internals vlans. + looks like simple approach to me - single point of failure in this router (not really - just in case oVirt is badly broken and I need to access internal vlans to recover it) * have this router as virtual appliance inside oVirt (something like pfSense for example) + no need hw router + not sure but I could probably configure vrrp redundancy - still single point of failure like in first case * any other approach? Could ovn help here somehow? * Install all hosts and HE with public addresses :-) + access to all hosts directly - 3 node HCI cluster uses 4 public ip addressess Thanks for your opinions Cheers, Jiri

4 6

ETL service aggregation error
by Ayansh Rocks 04 Jun '20

04 Jun '20

Hi, I am using 4.3.7 self hosted engine. From Few days i am getting regular below error messages :- [image: image.png] Logs in /var/log/ovirt-engine-dwh/ovirt-engine-dwhd.log [image: image.png] What could be the reason for this? Thanks Shashank

2 2

4.4 regression: engine-setup fails if admin password in answerfile contains a "%"
by Stephen Panicho 03 Jun '20

03 Jun '20

I encountered this error when deploying the Hosted Engine via Cockpit: [ INFO ] TASK [ovirt.engine-setup : Run engine-setup with answerfile] [ ERROR ] fatal: [localhost -> engine.ovirt.trashnet.xyz]: FAILED! => {"changed": true, "cmd": ["engine-setup", "--accept-defaults", "--config-append=/root/ovirt-engine-answers"], "delta": "0:00:01.396490", "end": "2020-05-22 18:32:41.965984", "msg": "non-zero return code", "rc": 1, "start": "2020-05-22 18:32:40.569494", "stderr": "", "stderr_lines": [], "stdout": "[ INFO ] Stage: Initializing\n[ ERROR ] Failed to execute stage 'Initializing': '%' must be followed by '%' or '(', found: '%JUUj'\n[ INFO ] Stage: Clean up\n Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20200522183241-c7d1kh.log\n[ ERROR ] Failed to execute stage 'Clean up': 'NoneType' object has no attribute 'cleanup'\n[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20200522183241-setup.conf'\n[ INFO ] Stage: Pre-termination\n[ INFO ] Stage: Termination\n[ ERROR ] Execution of setup failed", "stdout_lines": ["[ INFO ] Stage: Initializing", "[ ERROR ] Failed to execute stage 'Initializing': '%' must be followed by '%' or '(', found: '%JUUj'", "[ INFO ] Stage: Clean up", " Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20200522183241-c7d1kh.log", "[ ERROR ] Failed to execute stage 'Clean up': 'NoneType' object has no attribute 'cleanup'", "[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20200522183241-setup.conf'", "[ INFO ] Stage: Pre-termination", "[ INFO ] Stage: Termination", "[ ERROR ] Execution of setup failed"]} The important bit is this: Failed to execute stage 'Initializing': '%' must be followed by '%' or '(', found: '%JUUj'" Hey! Those are the last few characters of the admin password. Note that I don't mean the root password to the VM, but the one for the "admin" user of the web interface. I added some debug lines to the Ansible play to see the answerfile that was being generated. OVESETUP_CONFIG/adminPassword=str:&6&yGfcWf#b%JUUj Apparently engine-setup can no longer handle an answerfile with a "%" character in it. This same password worked in 4.3. Once I changed the admin password, installation progressed normally.

5 14

ovirt imageio problem...
by matteo fedeli 01 Jun '20

01 Jun '20

Hi! I' installed CentOS 8 and ovirt package following this step: systemctl enable --now cockpit.socket yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm yum module -y enable javapackages-tools yum module -y enable pki-deps yum module -y enable postgresql:12 yum -y install glibc-locale-source glibc-langpack-en localedef -v -c -i en_US -f UTF-8 en_US.UTF-8 yum update yum install ovirt-engine engine-setup (by keeping all default) It's possible ovirt-imageio-proxy service is not installed? (service ovirt-imageio-proxy status --> not found, yum install ovirt-imageio-proxy --> not found) I'm not able to upload iso... I also installed CA cert in firefox...

5 7

Issues deploying 4.4 with HE on new EPYC hosts
by Mark R 01 Jun '20

01 Jun '20

Hello all, I have some EPYC servers that are not yet in production, so I wanted to go ahead and move them off of 4.3 (which was working) to 4.4. I flattened and reinstalled the hosts with CentOS 8.1 Minimal and installed all updates. Some very simple networking, just a bond and two iSCSI interfaces. After adding the oVirt 4.4 repo and installing the requirements, I run 'hosted-engine --deploy' and proceed through the setup. Everything looks as though it is going nicely and the local HE starts and runs perfectly. After copying the HE disks out to storage, the system tries to start it there but is using a different CPU definition and it's impossible to start it. At this point I'm stuck but hoping someone knows the fix, because this is as vanilla a deployment as I could attempt and it appears EPYC CPUs are a no-go right now with 4.4. When the HostedEngineLocal VM is running, the CPU definition is: <cpu mode='custom' match='exact' check='full'> <model fallback='forbid'>EPYC-IBPB</model> <vendor>AMD</vendor> <feature policy='require' name='x2apic'/> <feature policy='require' name='tsc-deadline'/> <feature policy='require' name='hypervisor'/> <feature policy='require' name='tsc_adjust'/> <feature policy='require' name='clwb'/> <feature policy='require' name='umip'/> <feature policy='require' name='arch-capabilities'/> <feature policy='require' name='cmp_legacy'/> <feature policy='require' name='perfctr_core'/> <feature policy='require' name='wbnoinvd'/> <feature policy='require' name='amd-ssbd'/> <feature policy='require' name='skip-l1dfl-vmentry'/> <feature policy='disable' name='monitor'/> <feature policy='disable' name='svm'/> <feature policy='require' name='topoext'/> </cpu> Once the HostedEngine VM is defined and trying to start, the CPU definition is simply: <cpu mode='custom' match='exact' check='partial'> <model fallback='allow'>EPYC</model> <topology sockets='16' cores='4' threads='1'/> <feature policy='require' name='ibpb'/> <feature policy='require' name='virt-ssbd'/> <numa> <cell id='0' cpus='0-63' memory='16777216' unit='KiB'/> </numa> </cpu> On attempts to start it, the host is logging this error: "CPU is incompatible with host CPU: Host CPU does not provide required features: virt-ssbd". So, the HostedEngineLocal VM works because it has a requirement set for 'amd-ssbd' instead of 'virt-ssbd', and a VM requiring 'virt-ssbd' can't run on EPYC CPUs with CentOS 8.1. As mentioned, the HostedEngine ran fine on oVirt 4.3 with CentOS 7.8, and on 4.3 the cpu definition also required 'virt-ssbd', so I can only imagine that perhaps this is due to the more recent 4.x kernel that I now need HE to require 'amd-ssbd' instead? Any clues to help with this? I can completely wipe/reconfigure the hosts as needed so I'm willing to try whatever so that I can move forward with a 4.4 deployment. Thanks! Mark

7 26

tun: unexpected GSO type: 0x0, gso_size 1368, hdr_len 66
by lejeczek 01 Jun '20

01 Jun '20

hi everyone, With 4.4 I get: ... tun: unexpected GSO type ... It happens to a "third-party" kernel, namely: 5.6.15-1.el8.elrepo.x86_64 on Centos 8. I wonder if anybody sees the same or similar and I also wonder if I should report it somewhere in Bugzilla as "heads-up" towards new kernels? [Fri May 29 08:00:02 2020] tun: unexpected GSO type: 0x0, gso_size 1368, hdr_len 66 [Fri May 29 08:00:02 2020] tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ [Fri May 29 08:00:02 2020] tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ [Fri May 29 08:00:02 2020] tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ [Fri May 29 08:00:02 2020] tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ [Fri May 29 08:00:02 2020] ------------[ cut here ]------------ [Fri May 29 08:00:02 2020] WARNING: CPU: 2 PID: 3605 at drivers/net/tun.c:2123 tun_do_read+0x524/0x6c0 [tun] [Fri May 29 08:00:02 2020] Modules linked in: sd_mod sg vhost_net vhost tap xt_CHECKSUM xt_MASQUERADE xt_conntrack nf_nat_tftp nf_conntrack_tftp tun nft_nat ipt_REJECT bridge nft_counter nft_objref nf_conntrack_netbios_ns nf_conntrack_broadcast nft_masq nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nf_tables_set nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 qedf qed ip6_tables crc8 nft_compat bnx2fc ip_set cnic uio libfcoe 8021q garp mrp stp llc libfc scsi_transport_fc nf_tables nfnetlink sunrpc vfat fat ext4 mbcache jbd2 snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device edac_mce_amd snd_pcm kvm_amd kvm eeepc_wmi asus_wmi sp5100_tco sparse_keymap irqbypass rfkill wmi_bmof pcspkr joydev i2c_piix4 k10temp snd_timer snd soundcore gpio_amdpt gpio_generic acpi_cpufreq ip_tables xfs libcrc32c dm_crypt ax88179_178a usbnet mii hid_lenovo nouveau video mxm_wmi i2c_algo_bit [Fri May 29 08:00:02 2020] drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crc32_pclmul crc32c_intel ahci libahci drm ghash_clmulni_intel libata nvme ccp r8169 nvme_core realtek wmi t10_pi pinctrl_amd dm_mirror dm_region_hash dm_log dm_mod [Fri May 29 08:00:02 2020] CPU: 2 PID: 3605 Comm: vhost-3578 Not tainted 5.6.15-1.el8.elrepo.x86_64 #1 [Fri May 29 08:00:02 2020] Hardware name: System manufacturer System Product Name/PRIME B450M-A, BIOS 2006 11/13/2019 [Fri May 29 08:00:02 2020] RIP: 0010:tun_do_read+0x524/0x6c0 [tun] [Fri May 29 08:00:02 2020] Code: 00 6a 01 0f b7 44 24 22 b9 10 00 00 00 48 c7 c6 cb 33 09 c1 48 c7 c7 d1 33 09 c1 83 f8 40 48 0f 4f c2 31 d2 50 e8 4c 14 df c5 <0f> 0b 58 5a 48 c7 c5 ea ff ff ff e9 d2 fc ff ff 4c 89 e2 be 04 00 [Fri May 29 08:00:02 2020] RSP: 0018:ffffaaf301dfbcb8 EFLAGS: 00010292 [Fri May 29 08:00:02 2020] RAX: 0000000000000000 RBX: ffff88ceae6b4800 RCX: 0000000000000007 [Fri May 29 08:00:02 2020] RDX: 0000000000000000 RSI: 0000000000000096 RDI: ffff88d14e8996b0 [Fri May 29 08:00:02 2020] RBP: 000000000000004e R08: 0000000000000516 R09: 0000000000000055 [Fri May 29 08:00:02 2020] R10: 000000000000072e R11: ffffaaf301dfba88 R12: ffffaaf301dfbe50 [Fri May 29 08:00:02 2020] R13: ffff88d0e98b8900 R14: 0000000000000000 R15: 0000000000000000 [Fri May 29 08:00:02 2020] FS: 0000000000000000(0000) GS:ffff88d14e880000(0000) knlGS:0000000000000000 [Fri May 29 08:00:02 2020] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Fri May 29 08:00:02 2020] CR2: 000055f6b3af2bd8 CR3: 00000003c6c84000 CR4: 0000000000340ee0 [Fri May 29 08:00:02 2020] Call Trace: [Fri May 29 08:00:02 2020] ? __wake_up_common+0x77/0x140 [Fri May 29 08:00:02 2020] tun_recvmsg+0x6b/0xf0 [tun] [Fri May 29 08:00:02 2020] handle_rx+0x573/0x940 [vhost_net] [Fri May 29 08:00:02 2020] ? log_used.part.45+0x20/0x20 [vhost] [Fri May 29 08:00:02 2020] vhost_worker+0xcc/0x140 [vhost] [Fri May 29 08:00:02 2020] kthread+0x10c/0x130 [Fri May 29 08:00:02 2020] ? kthread_park+0x80/0x80 [Fri May 29 08:00:02 2020] ret_from_fork+0x22/0x40 [Fri May 29 08:00:02 2020] ---[ end trace 9df20668f2e81977 ]--- many thanks, L.

2 1

Problem with Ovirt Machines
by aigini82＠gmail.com 31 May '20

31 May '20

Hi, Our company uses Ovirt to host some of its virtual machines. The version used is 4.2.6.4-1.el7. There are about 36 virtual hosts in it. The specifications used for the host machine is 30G RAM and 6 CPUs. Some of the VMs in the ovirt host run with 4 CPUs. Some with 2 CPUs. The problem I face now is that recently there was a need for high CPU and memory specs to setup a VM for DR. I created a VM with 16G RAM and 6 CPUs, without checking the CPUs available in the host first. After DR, the VM was brought down already. Then later another person in the team brought the VM back up for a different DR use, for a much larger DB restoration purpose. This caused the VM to pause due to storage error. And then worse things happened, whereby 2 other VMs inadvertently went down. Although I assumed that this was caused by storage errors/problems, the senior admins in the team concluded that the problem was due to fencing because of the max allotted CPU for the host being used for the VM. Now what I need to know is how to properly allocate CPU resources to a host to run multiple virtual machines in it like the situation above. I even tried to look for errors in vdsm.log, but this log was not available in the host machine nor in the affected VM. My colleague asked me to check "Events" section of the ovirt management interface to see past the past events. However, I don't find much details about the fencing activity or how the fencing occurred or what caused the fencing. And how did they conclude that the CPU count caused the fencing and not the storage?

2 1

Failed to add storage domain
by thunderlight1＠gmail.com 31 May '20

31 May '20

Hi! I have installed oVirt using the iso ovirt-node-ng-installer-4.3.2-2019031908.el7. I the did run the Host-engine deployment through Cockpit. I got an error when it tries to create the domain storage. It sucessfully mounted the NFS-share on the host. Bellow is the error I got: 2019-04-14 10:40:38,967+0200 INFO ansible skipped {'status': 'SKIPPED', 'ansible_task': u'Check storage domain free space', 'ansible_host': u'localhost', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', 'ansible_type': 'task'} 2019-04-14 10:40:38,967+0200 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7fb6918ad9d0> kwargs 2019-04-14 10:40:39,516+0200 INFO ansible task start {'status': 'OK', 'ansible_task': u'ovirt.hosted_engine_setup : Activate storage domain', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', 'ansible_type': 'task'} 2019-04-14 10:40:39,516+0200 DEBUG ansible on_any args TASK: ovirt.hosted_engine_setup : Activate storage domain kwargs is_conditional:False 2019-04-14 10:40:41,923+0200 DEBUG var changed: host "localhost" var "otopi_storage_domain_details" type "<type 'dict'>" value: "{ "changed": false, "exception": "Traceback (most recent call last):\n File \"/tmp/ansible_ovirt_storage_domain_payload_xSFxOp/__main__.py\", line 664, in main\n storage_domains_module.post_create_check(sd_id)\n File \"/tmp/ansible_ovirt_storage_domain_payload_xSFxOp/__main__.py\", line 526, in post_create_check\n id=storage_domain.id,\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py\", line 3053, in add\n return self._internal_add(storage_domain, headers, query, wait)\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py\", line 232, in _internal_add\n return future.wait() if wait else future\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py\", line 55, in wait\n return self._code(response)\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py\", line 229, in callback\n self._check_fault(response)\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py\", line 132, in _check_fault\n self._raise_error(response , body)\n File \"/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py\", line 118, in _raise_error\n raise error\nError: Fault reason is \"Operation Failed\". Fault detail is \"[]\". HTTP response code is 400.\n", "failed": true, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[]\". HTTP response code is 400." }" 2019-04-14 10:40:41,924+0200 DEBUG var changed: host "localhost" var "ansible_play_hosts" type "<type 'list'>" value: "[]" 2019-04-14 10:40:41,924+0200 DEBUG var changed: host "localhost" var "play_hosts" type "<type 'list'>" value: "[]" 2019-04-14 10:40:41,924+0200 DEBUG var changed: host "localhost" var "ansible_play_batch" type "<type 'list'>" value: "[]" 2019-04-14 10:40:41,924+0200 ERROR ansible failed {'status': 'FAILED', 'ansible_type': 'task', 'ansible_task': u'Activate storage domain', 'ansible_result': u'type: <type \'dict\'>\nstr: {\'_ansible_parsed\': True, u\'exception\': u\'Traceback (most recent call last):\\n File "/tmp/ansible_ovirt_storage_domain_payload_xSFxOp/__main__.py", line 664, in main\\n storage_domains_module.post_create_check(sd_id)\\n File "/tmp/ansible_ovirt_storage_domain_payload_xSFxOp/__main__.py", line 526', 'task_duration': 2, 'ansible_host': u'localhost', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml'} 2019-04-14 10:40:41,924+0200 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7fb691843190> kwargs ignore_errors:None 2019-04-14 10:40:41,928+0200 INFO ansible stats { "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_playbook_duration": "00:37 Minutes", "ansible_result": "type: <type 'dict'>\nstr: {u'localhost': {'unreachable': 0, 'skipped': 6, 'ok': 23, 'changed': 1, 'failures': 1}}", "ansible_type": "finish", "status": "FAILED" } 2019-04-14 10:40:41,928+0200 INFO SUMMARY: Duration Task Name -------- -------- [ < 1 sec ] Execute just a specific set of steps [ 00:01 ] Force facts gathering [ 00:01 ] Check local VM dir stat [ 00:01 ] Obtain SSO token using username/password credentials [ 00:01 ] Fetch host facts [ < 1 sec ] Fetch cluster ID [ 00:01 ] Fetch cluster facts [ 00:01 ] Fetch Datacenter facts [ < 1 sec ] Fetch Datacenter ID [ < 1 sec ] Fetch Datacenter name [ 00:02 ] Add NFS storage domain [ 00:01 ] Get storage domain details [ 00:01 ] Find the appliance OVF [ 00:01 ] Parse OVF [ < 1 sec ] Get required size [ FAILED ] Activate storage domain 2019-04-14 10:40:41,928+0200 DEBUG ansible on_any args <ansible.executor.stats.AggregateStats object at 0x7fb69404eb90> kwargs Any suggestions on how fix this?

2 2

OVirt Upgrade from 4.3 to 4.4 - Hosted engine
by ccesario＠blueit.com.br 30 May '20

30 May '20

Hello, Could someone please inform if Upgrade from OVirt 4.3 to 4.4 when using Hosted engine is it supported !? According the documentation https://www.ovirt.org/documentation/upgrade_guide/#Upgrading_from_4-3 the upgrade procedure make reference only to "standalone engine". If it is supported, what is correct steps to do it? Best regards Carlos

4 5

Q: Fixing SELinux Permissions on oVirt node
by Andrei Verovski 29 May '20

29 May '20

Hi ! I’m struggling with SELinux blocking SNMP script from reading log file (oVirt node manually installed on CentOS 7). Log file is readable by all (chmod ugo+r). Scripts working fine when executed from terminal. I did not dig deep into CentOS internals, I’m mostly use Debian and SuSE. As far as I know, SELinux can’t be turned off on oVirt node. Thanks in advance for any suggestion(s). ********************** option in snmpd.conf extend .1.3.6.1.4.1.2021.7890.5 checkraid /opt/4anvcheckraid_hp.sh ********************** script 4anvcheckraid_hp.sh #!/bin/bash LOGFILE='/var/log/anvraidcheck.log' if [ ! -f $LOGFILE ]; then exit 0 fi # Variant 1 with sed sed '/^[ \t]*$/d' $LOGFILE | while read line; do echo "$line" exit 1 done # Variant 2 without sed while read line do if [[ "$line" =~ [^[:space:]] ]]; then echo "$line" exit 1 fi done < $LOGFILE ********************** SELinux audit log: type=AVC msg=audit(1590673970.198:469304): avc: denied { read } for pid=12142 comm="sed" name="anvraidcheck.log" dev="dm-8" ino=138 scontext=system_u:system_r:snmpd_t:s0 tcontext=system_u:object_r:cron_log_t:s0 tclass=file permissive=0 type=AVC msg=audit(1590673970.197:469303): avc: denied { read } for pid=12141 comm="4anvcheckraid_h" name="anvraidcheck.log" dev="dm-8" ino=138 scontext=system_u:system_r:snmpd_t:s0 tcontext=system_u:object_r:cron_log_t:s0 tclass=file permissive=0

4 6

How to connect to a guest with vGPU ?
by Josep Manel Andrés Moscardó 29 May '20

29 May '20

Hi, I got vGPU through mdev working but I am wondering how I would connect to the client and make use of the GPU. So far I try to access the console through SPICE and at some point in the boot process it switches to GPU and I cannot see anything else. Thanks. -- Josep Manel Andrés Moscardó Systems Engineer, IT Operations EMBL Heidelberg T +49 6221 387-8394

3 4

oVirt 4.3.9 Standalone Engine local DB install documentation
by msantoro＠lanl.gov 29 May '20

29 May '20

Hello, I am new to oVirt and installing our first dev deployment. The 4.4 documentation is RHEL 8.1 specific (i.e. "yum module <module>"), and I cannot seem to easily find similar install documentation for the Standalone local DB case for 4.3.x. I am using RHEL 7.x for the time being. Can someone point me to install docs 4.3.x? Thanks, Marc

2 1

ovirt-websocket-proxy errors when trying noVNC
by Louis Bohm 29 May '20

29 May '20

OS: Oracle Linux 7.8 (unbreakable kernel) Using Oracle Linux Virtualization Manager: Software Version:4.3.6.6-1.0.9.el7 Since I am running all of it on one physical machine I opted to install the ovirt-engine using the accept defaults option. When I try to start a noVNC console I see this in the messages file: May 26 16:49:12 lfg-kvm saslpasswd2: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory May 26 16:49:12 lfg-kvm saslpasswd2: error deleting entry from sasldb: BDB0073 DB_NOTFOUND: No matching key/data pair found May 26 16:49:12 lfg-kvm saslpasswd2: error deleting entry from sasldb: BDB0073 DB_NOTFOUND: No matching key/data pair found May 26 16:49:12 lfg-kvm saslpasswd2: error deleting entry from sasldb: BDB0073 DB_NOTFOUND: No matching key/data pair found May 26 16:49:12 lfg-kvm saslpasswd2: error deleting entry from sasldb: BDB0073 DB_NOTFOUND: No matching key/data pair found May 26 16:49:14 lfg-kvm journal: 2020-05-26 16:49:14,704-0400 ovirt-websocket-proxy: INFO msg:824 handler exception: [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] sslv3 alert certificate unknown (_ssl.c:618) May 26 16:49:14 lfg-kvm ovirt-websocket-proxy.py: ovirt-websocket-proxy[14582] INFO msg:824 handler exception: [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] sslv3 alert certificate unknown (_ssl.c:618) I have checked the following: [root@lfg-kvm ~]# engine-config -g WebSocketProxy WebSocketProxy: lfg-kvm.corp.lfg.com:6100 version: general [root@lfg-kvm ~]# engine-config -g SpiceProxyDefault SpiceProxyDefault: http://lfg-kvm.corp.lfg.com:6100 version: general This is a brand new install. I also am unable to get a VNC console up and running. I have tried with an Ubuntu VM running on my MAC where I installed virt-manager. The viewer comes up for a second says it cannot connect and then shutsdown. Anyone have any clue? -<<—->>- Louis Bohm louisbohm(a)gmail.com <https://www.youracclaim.com/badges/f11e0d65-21ad-4458-895b-2c5b5cb11134/pub…> <https://www.youracclaim.com/badges/f11e0d65-21ad-4458-895b-2c5b5cb11134/pub…>

4 10

oVirt 4.4 and installer problem on Dell M620
by Gianluca Cecchi 29 May '20

29 May '20

Hello, I'm trying to install what in subject but it seems the graphical part fails... In fact the console remains black and if I switch witch Ctrl+Alt+ F1 I see this screen https://drive.google.com/file/d/1mt9ipxNLpe1xadbkXsU-Avh_GnFafNek/view?usp=… Anyone tried on this kind of hardware? Can I try to give any particular boot option? Thanks, Gianluca

2 2

oVirt4.4 HCI single host mortal combat
by Jiří Sléžka 28 May '20

28 May '20

Hi, I am still fighting with oVirt 4.4 installation in HCI single host configuration. Seems to be hard fighter... ;-) It looks like there is no 4.4 HCI single host installation guide so I am using compilation of this sources * https://www.ovirt.org/download/ * https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Single_node… I did * clean minimal install of CentOS 8.1 * setup networks (I am using vlans on bond for internal traffic) dnf update -y dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm dnf install cockpit cockpit-ovirt-dashboard vdsm-gluster ovirt-engine-appliance glusterfs-server gluster-ansible-roles systemctl enable --now cockpit.socket firewall-cmd --add-service=cockpit firewall-cmd --add-service=cockpit --permanent ssh-keygen ssh-copy-id root(a)10.0.4.11 ssh root(a)10.0.4.11 (10.0.4.11 is local address on vlan which I would like use as storage network) I would like to run gluster-ansible-roles from command line but I am not sure how exactly do it right way so I am going the cockpit way and the gluster part works like expected. Next Boss is HE install Round 1, Fight! The hosted engine wizzard ends with missing ca-cert.pem (unfortunately I close the window and cannot find that log anymore). But it looks to me like problem mentioned in https://lists.ovirt.org/archives/list/users@ovirt.org/message/4PUIES2JGAFHJ… I have switched to command line... Round 2, Fight! ovirt-hosted-engine-cleanup ovirt-hosted-engine-setup [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, deployment errors: code 505: Host ovirt-hci01.stud.slu.cz installation failed. Failed to configure management network on the host., code 9000: Failed to verify Power Management configuration for Host ovirt-hci01.stud.slu.cz., fix accordingly and re-deploy."} /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20200526210340-h7waks.log interesting thing is the vm looks like running in some way ps aux | grep kvm qemu 26790 58.2 6.6 6927972 3295760 ? Sl 21:28 12:40 /usr/libexec/qemu-kvm -name guest=HostedEngineLocal,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-1-HostedEngineLocal/master-key.aes -machine pc-q35-rhel8.1.0,accel=kvm,usb=off,dump-guest-core=off -cpu Nehalem-IBRS,vme=on,ss=on,x2apic=on,tsc... ... but hosted-engine --vm-status It seems like a previous attempt to deploy hosted-engine failed or it's still in progress. Please clean it up before trying again hosted-engine --check-deployed The hosted engine has not been deployed ok... Round 3, Fight! ovirt-hosted-engine-cleanup ovirt-hosted-engine-setup --config-append=/root/answers-20200526214934.conf [ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["virt-install", "-n", "HostedEngineLocal", "--os-variant", "rhel8.0", "--virt-type", "kvm", "--memory", "4096", "--vcpus", "2", "--network", "network=default,mac=00:16:3e:7a:ce:77,model=virtio", "--disk", "/var/tmp/localvmc7szuw4y/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0", "--import", "--disk", "path=/var/tmp/localvmc7szuw4y/seed.iso,device=cdrom", "--noautoconsole", "--rng", "/dev/random", "--graphics", "vnc", "--video", "vga", "--sound", "none", "--controller", "usb,model=none", "--memballoon", "none", "--boot", "hd,menu=off", "--clock", "kvmclock_present=yes"], "delta": "0:00:04.419991", "end": "2020-05-26 22:27:20.730780", "msg": "non-zero return code", "rc": 1, "start": "2020-05-26 22:27:16.310789", "stderr": "ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:27:19.254675Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory\nDomain installation does not appear to have been successful.\nIf it was, you can restart your domain by running:\n virsh --connect qemu:///system start HostedEngineLocal\notherwise, please restart your installation.", "stderr_lines": ["ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:27:19.254675Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory", "Domain installation does not appear to have been successful.", "If it was, you can restart your domain by running:", " virsh --connect qemu:///system start HostedEngineLocal", "otherwise, please restart your installation."], "stdout": "\nStarting install...", "stdout_lines": ["", "Starting install..."]} ...and this error I get every round relevant lines from /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20200526223648-dvejcr.log 2020-05-26 22:49:15,303+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:103 {'msg': 'non-zero return code', 'cmd': ['virt-install', '-n', 'HostedEngineLocal', '--os-variant', 'rhel8.0', '--virt-type', 'kvm', '--memory', '4096', '--vcpus', '2', '--network', 'network=default,mac=00:16:3e:7a:ce:77,model=virtio', '--disk', '/var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0', '--import', '--disk', 'path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom', '--noautoconsole', '--rng', '/dev/random', '--graphics', 'vnc', '--video', 'vga', '--sound', 'none', '--controller', 'usb,model=none', '--memballoon', 'none', '--boot', 'hd,menu=off', '--clock', 'kvmclock_present=yes'], 'stdout': '\nStarting install...', 'stderr': 'ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory\nDomain installation does not appear to have been successful.\nIf it was, you can restart your domain by running:\n virsh --connect qemu:///system start HostedEngineLocal\notherwise, please restart your installation.', 'rc': 1, 'start': '2020-05-26 22:49:09.336828', 'end': '2020-05-26 22:49:15.046389', 'delta': '0:00:05.709561', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'virt-install -n HostedEngineLocal --os-variant rhel8.0 --virt-type kvm --memory 4096 --vcpus 2 --network network=default,mac=00:16:3e:7a:ce:77,model=virtio --disk /var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0 --import --disk path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom --noautoconsole --rng /dev/random --graphics vnc --video vga --sound none --controller usb,model=none --memballoon none --boot hd,menu=off --clock kvmclock_present=yes', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['', 'Starting install...'], 'stderr_lines': ['ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory', 'Domain installation does not appear to have been successful.', 'If it was, you can restart your domain by running:', ' virsh --connect qemu:///system start HostedEngineLocal', 'otherwise, please restart your installation.'], '_ansible_no_log': False} 2020-05-26 22:49:15,404+0200 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:107 fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["virt-install", "-n", "HostedEngineLocal", "--os-variant", "rhel8.0", "--virt-type", "kvm", "--memory", "4096", "--vcpus", "2", "--network", "network=default,mac=00:16:3e:7a:ce:77,model=virtio", "--disk", "/var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0", "--import", "--disk", "path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom", "--noautoconsole", "--rng", "/dev/random", "--graphics", "vnc", "--video", "vga", "--sound", "none", "--controller", "usb,model=none", "--memballoon", "none", "--boot", "hd,menu=off", "--clock", "kvmclock_present=yes"], "delta": "0:00:05.709561", "end": "2020-05-26 22:49:15.046389", "msg": "non-zero return code", "rc": 1, "start": "2020-05-26 22:49:09.336828", "stderr": "ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory\nDomain installation does not appear to have been successful.\nIf it was, you can restart your domain by running:\n virsh --connect qemu:///system start HostedEngineLocal\notherwise, please restart your installation.", "stderr_lines": ["ERROR internal error: process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no: Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No such file or directory", "Domain installation does not appear to have been successful.", "If it was, you can restart your domain by running:", " virsh --connect qemu:///system start HostedEngineLocal", "otherwise, please restart your installation."], "stdout": "\nStarting install...", "stdout_lines": ["", "Starting install..."]} ll /etc/pki/vdsm/libvirt-vnc/ total 0 Any help is much appreciated... Thanks in advance, Jiri

1 1

Engine expands CPU and memory
by xilazz＠126.com 28 May '20

28 May '20

Hi, everyone. When I use the ovirt cluster, there are multiple virtual machines in the cluster.Engine controller shows excessive CPU load during administration, I would like to ask if there is a way to extend engine controller CPU and memory online, I would be very grateful.thank you

2 1

oVirt not using local GlusterFS bricks
by Randall Wood 28 May '20

28 May '20

I have a three node oVirt 4.3.7 cluster that is using GlusterFS as the underlying storage (each oVirt node is a GlusterFS node). The nodes are named ovirt1, ovirt2, and ovirt3. This has been working wonderfully until last week when ovirt2 crashed (it is *old* hardware; this was not entirely unexpected). Now I have this situation: all three oVirt nodes are acting as if the GlusterFS volumes only exist on ovirt2. The bricks on all three nodes appear to be in sync. I *think* this began happening after I restarted ovirt2 (once hard, and once soft) and then restarted glusterd (and only glusterd) on ovirt1 and ovirt3 after `gluster-eventsapi status` on those two nodes showed inconsistent results (this had been used with success before). How can I make the oVirt nodes read and write from their local bricks?

3 2

oVirt 4.4 pending VM changes on HostedEngine VM
by Radoslav Milanov 28 May '20

28 May '20

Hello I'm not sure how but I've got pending changes on the HostedEngine VM on a 3 node 4.4 cluster and those changes are never applied. Is there a way to cancel pending VM changes in general ? Thanks.

2 2

Adding extra parameters to qemu-kvm
by Sakari Poussa 28 May '20

28 May '20

Hi, Before I dive in too deeply to vdsm-hook-qemucmdline I'd like to know if it is the correct solution to my needs. I want to add the following (type of) parameters to VM startup -object memory-backend-file,id=mem1,share=on,mem-path=/dev/dax0.0,size=$PMEM_SIZE,align=2M \-device nvdimm,id=nvdimm1,memdev=mem1,label-size=128k \ Is the vdsm-hook-qemucmdline the correct tool? Can I use (add the params) it also from the ansible playbook (via ovirt roles) somehow? Thanks, Sakari

1 0

Current Architecture of oVirt and Quality Assurance measures
by Juergen Novak 28 May '20

28 May '20

I am currently evaluating oVirt for the usage in big companies as base system for edge computing applications. I already tried to find a current architecture overview regarding the oVirt modules -- particularly ovirt-node-ng and imgbased. But I did not manage to find any. There is some architecture documentation, but marked as outdated and many links go to 404. So I would ask, if somebody could provide any current architecture overview (no user documentation), particularly of the node module(s). An other question I have, is which quality measures are used in development? * Tools used (for Unit-Tests, Component-Tests, Integration-Tests) * Are there any statistics about test coverage? Any assistance would be appreciated. Best Regards /juergen

1 0

oVirt 4.4 gluster single host vm paused due to unknown storage error
by Gianluca Cecchi 28 May '20

28 May '20

Hello, in environment in subject, I downloaded from glance repository the CentOS 8 image CentOS 8 Generic Cloud Image v20200113.3 for x86_64 (5e35c84) and imported as a template. I created a vm based on it (I got the message: "In order to create a VM from a template with a different chipset, device configuration will be changed. This may affect functionality of the guest software. Are you sure you want to proceed?") When running "dnf update", during I/O of packages updates the VM went into pause. VM c8desktop started on Host novirt2.example.net 5/28/201:29:04 PM VM c8desktop has been paused. 5/28/201:41:52 PM VM c8desktop has been paused due to unknown storage error. 5/28/201:41:52 PM VM c8desktop has recovered from paused back to up. 5/28/201:43:50 PM In messages of (nested) host I see: May 28 13:28:06 novirt2 systemd-machined[1497]: New machine qemu-7-c8desktop. May 28 13:28:06 novirt2 systemd[1]: Started Virtual Machine qemu-7-c8desktop. May 28 13:28:06 novirt2 kvm[57798]: 2 guests now active May 28 13:28:07 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:12 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:17 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:22 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:27 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:32 novirt2 journal[13368]: Guest agent is not responding: QEMU guest agent is not connected May 28 13:28:37 novirt2 journal[13368]: Domain id=7 name='c8desktop' uuid=63e27cb5-087d-435e-bf61-3fe25e3319d 6 is tainted: custom-ga-command May 28 13:28:37 novirt2 journal[26984]: Cannot open log file: '/var/log/libvirt/qemu/c8desktop.log': Device o r resource busy May 28 13:28:37 novirt2 journal[13368]: Cannot open log file: '/var/log/libvirt/qemu/c8desktop.log': Device o r resource busy May 28 13:28:37 novirt2 journal[13368]: Unable to open domainlog May 28 13:30:00 novirt2 systemd[1]: Starting system activity accounting tool... May 28 13:30:00 novirt2 systemd[1]: Started system activity accounting tool. May 28 13:37:21 novirt2 python3[62512]: detected unhandled Python exception in '/usr/lib/python3.6/site-packages/vdsm/gluster/gfapi.py' May 28 13:37:21 novirt2 abrt-server[62514]: Deleting problem directory Python3-2020-05-28-13:37:21-62512 (dup of Python3-2020-05-28-10:32:57-29697) May 28 13:37:21 novirt2 dbus-daemon[1502]: [system] Activating service name='org.freedesktop.problems' requested by ':1.3111' (uid=0 pid=62522 comm="/usr/libexec/platform-python /usr/bin/abrt-action-" label="system_u:system_r:abrt_t:s0-s0:c0.c1023") (using servicehelper) May 28 13:37:21 novirt2 dbus-daemon[1502]: [system] Successfully activated service 'org.freedesktop.problems' May 28 13:37:21 novirt2 abrt-server[62514]: /bin/sh: reporter-systemd-journal: command not found May 28 13:37:21 novirt2 python3[62550]: detected unhandled Python exception in '/usr/lib/python3.6/site-packages/vdsm/gluster/gfapi.py' May 28 13:37:21 novirt2 abrt-server[62552]: Not saving repeating crash in '/usr/lib/python3.6/site-packages/vdsm/gluster/gfapi.py' May 28 13:37:22 novirt2 python3[62578]: detected unhandled Python exception in '/usr/lib/python3.6/site-packages/vdsm/gluster/gfapi.py' May 28 13:37:22 novirt2 abrt-server[62584]: Not saving repeating crash in '/usr/lib/python3.6/site-packages/vdsm/gluster/gfapi.py' May 28 13:40:00 novirt2 systemd[1]: Starting system activity accounting tool... May 28 13:40:00 novirt2 systemd[1]: Started system activity accounting tool. On the related gluster volume log where vm disk is I have: [2020-05-28 11:41:33.892074] W [MSGID: 114031] [client-rpc-fops_v2.c:679:client4_0_writev_cbk] 0-vmstore-client-0: remote operation failed [Invalid argument] [2020-05-28 11:41:33.892140] W [fuse-bridge.c:2925:fuse_writev_cbk] 0-glusterfs-fuse: 348168: WRITE => -1 gfid=35ae86e8-0ccd-48b8-9ef2-6ca9a108ccf9 fd=0x7fd1d800cf38 (Invalid argument) [2020-05-28 11:41:33.902984] I [MSGID: 133022] [shard.c:3693:shard_delete_shards] 0-vmstore-shard: Deleted shards of gfid=35ae86e8-0ccd-48b8-9ef2-6ca9a108ccf9 from backend [2020-05-28 11:41:52.434362] E [MSGID: 133010] [shard.c:2339:shard_common_lookup_shards_cbk] 0-vmstore-shard: Lookup on shard 6 failed. Base file gfid = 3e12e7fe-6a77-41b8-932a-d4f50c41ac00 [No such file or directory] [2020-05-28 11:41:52.434423] W [fuse-bridge.c:2925:fuse_writev_cbk] 0-glusterfs-fuse: 353565: WRITE => -1 gfid=3e12e7fe-6a77-41b8-932a-d4f50c41ac00 fd=0x7fd208093fb8 (No such file or directory) [2020-05-28 11:46:34.095697] W [MSGID: 114031] [client-rpc-fops_v2.c:679:client4_0_writev_cbk] 0-vmstore-client-0: remote operation failed [Invalid argument] [2020-05-28 11:46:34.095758] W [fuse-bridge.c:2925:fuse_writev_cbk] 0-glusterfs-fuse: 384006: WRITE => -1 gfid=7b804a1a-1734-4bec-b8f4-9ba33ffefe8b fd=0x7fd1d0005fd8 (Invalid argument) [2020-05-28 11:46:34.104494] I [MSGID: 133022] [shard.c:3693:shard_delete_shards] 0-vmstore-shard: Deleted shards of gfid=7b804a1a-1734-4bec-b8f4-9ba33ffefe8b from backend Very similar sharding message when in 4.3.9 in single host with gluster and "heavy"/sudden I/O operations when using thin provisioned disks..... I see in 4.4 Gluster is glusterfs-7.5-1.el8.x86_64 Can this be a problem that only appears in single host as there are indeed no data travellling to the network to sync nodes and sharding feature for some reason is not able to keep pace, when local disk is very fast? In 4.3.9 single host with gluster 6.8-1 my only way to solve was to disable sharding.. and I got final stability see here https://lists.ovirt.org/archives/list/users@ovirt.org/thread/OIN4R63I6ITOQS… Still waiting for Gluster devs comments on logs provided at that time As I already wrote, in my opinion the single host wizard should set sharding off in automatic, because in that environment can make thin provisioned disks unusable. In case of future additions of nodes, the setup can make a check and say the user that he/she should re-enable sharding.... Just my 0.2 eurocent Gianluca

1 0

oVirt 4.4 HE on Copy local VM disk to shared storage (NFS) failing
by Anton Gonzalez 28 May '20

28 May '20

Deploy via cockpit fails after copy local VM disk to shared storage, Exit HE maintenance mode, Check engine VM health. The HE VM does not start from shared storage with hosted-engine --vm-status returning down_unexpected. I've also tried with iSCSI, with similar results. I'm using CentOS 8.1 now, but also tried with Node 4.4 with same results. VDSM log attached. If any other logs are needed, please let me know and I'll add. I've used the same NFS server to deploy 4.3 without issue, and I ran the nfs-check.py script to verify that the NFS share was correctly provisioned. [ INFO ] TASK [ovirt.hosted_engine_setup : Copy local VM disk to shared storage] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Start ovirt-ha-broker service on the host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Initialize lockspace volume] [ INFO ] TASK [ovirt.hosted_engine_setup : Workaround for ovirt-ha-broker start failures] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Initialize lockspace volume] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Start ovirt-ha-agent service on the host] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Exit HE maintenance mode] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Check engine VM health] [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 180, "changed": true, "cmd": ["hosted-engine", "--vm-status", "--json"], "delta": "0:00:00.186082", "end": "2020-05-26 20:05:40.063450", "rc": 0, "start": "2020-05-26 20:05:39.877368", "stderr": "", "stderr_lines": [], "stdout": "{\"1\": {\"host-id\": 1, \"host-ts\": 2500, \"score\": 0, \"engine-status\": {\"vm\": \"down_unexpected\", \"health\": \"bad\", \"detail\": \"Down\", \"reason\": \"bad vm status\"}, \"hostname\": \"ovirthost02.po-lite.local\", \"maintenance\": false, \"stopped\": false, \"crc32\": \"3b77b8b8\", \"conf_on_shared_storage\": true, \"local_conf_timestamp\": 2500, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2500 (Tue May 26 20:05:36 2020)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=2500 (Tue May 26 20:05:36 2020)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUnexpectedlyDown\\nstopped=False\\ntimeout=Wed Dec 31 19:47:59 1969\\n\", \"live-data\": true}, \"global_maintenance\": false}", "stdout_lines": ["{\"1\": {\"host-id\": 1, \"host-ts\": 2500, \"score\": 0, \"engine-status\": {\"vm\": \"down_unexpected\", \"health\": \"bad\", \"detail\": \"Down\", \"reason\": \"bad vm status\"}, \"hostname\": \"ovirthost02.po-lite.local\", \"maintenance\": false, \"stopped\": false, \"crc32\": \"3b77b8b8\", \"conf_on_shared_storage\": true, \"local_conf_timestamp\": 2500, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2500 (Tue May 26 20:05:36 2020)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=2500 (Tue May 26 20:05:36 2020)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUnexpectedlyDown\\nstopped=False\\ntimeout=Wed Dec 31 19:47:59 1969\\n\", \"live-data\": true}, \"global_maintenance\": false}"]} [ INFO ] TASK [ovirt.hosted_engine_setup : Check VM status at virt level] [ INFO ] TASK [ovirt.hosted_engine_setup : Fail if engine VM is not running] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Engine VM is not running, please check vdsm logs"}

4 7

[ANN] oVirt 4.4.1 Second Release Candidate
by Sandro Bonazzola 28 May '20

28 May '20

oVirt 4.4.1 Second Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.1 Second Release Candidate for testing, as of May 28th, 2020. This update is the first in a series of stabilization updates to the 4.4 series. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Some of the features included in oVirt 4.4.1 Release Candidate require content that will be available in CentOS Linux 8.2 but can’t be tested on RHEL 8.2 yet due to some incompatibility in openvswitch package shipped in CentOS Virt SIG which requires to rebuild openvswitch on top of CentOS 8.2. Installation instructions For the engine: either use appliance or: - Install CentOS Linux 8 minimal from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… ; select minimal installation - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - Attach the host to engine and let it be deployed. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.1 release highlights: http://www.ovirt.org/release/4.4.1/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.1/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

Re: AutoStart VMs (was Re: Re: oVirt 4.4.0 Release is now generally available)
by Derek Atkins 27 May '20

27 May '20

Eh, no point in creating a repo for that, so I just put them on the web: https://www.ihtfp.org/ovirt/ -derek On Wed, May 27, 2020 11:05 am, Staniforth, Paul wrote: > > Thanks Derek, > GitHub or GitLab probably. > > Regards, > Paul S. > ________________________________ > From: Derek Atkins <derek(a)ihtfp.com> > Sent: 27 May 2020 15:50 > To: Gianluca Cecchi <gianluca.cecchi(a)gmail.com> > Cc: thomas(a)hoberg.net <thomas(a)hoberg.net>; users <users(a)ovirt.org> > Subject: [ovirt-users] AutoStart VMs (was Re: Re: oVirt 4.4.0 Release is > now generally available) > > Caution External Mail: Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > > Hi, > > (Sorry if you get this twice -- looks like it didn't like the python > script in there so I'm resending without the code) > > Gianluca Cecchi <gianluca.cecchi(a)gmail.com> writes: > >> Hi Derek, >> today I played around with Ansible to accomplish, I think, what you >> currently >> do in oVirt shell. >> It was the occasion to learn, as always, something new: as "blocks" in >> Ansible >> dont' support looping, a workaround to get that. >> Furthermore I have a single host environment where it can turn usefull >> too... > [snip] > > I found the time to work on this using the Python SDK. Took me longer > than I wanted but I think I've got something working now. I just > haven't done a FULL test, yet, but a runtime time on the online system > works (I commented out the start call). > > I still have two files, a vm_list.py which is a config file that > contains the list of VMs, in order, and then the main program itself > (start_vms.py) which is based on several of the examples available in > github. > > Unfortunately I can't seem to send the script in email because it's > getting blocked by the redhat server -- so I have no idea the best way > to share it. > > -derek > > -- > Derek Atkins 617-623-3745 > derek(a)ihtfp.com > https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.ihtfp.… > Computer and Internet Security Consultant > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: > https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… > oVirt Code of Conduct: > https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… > List Archives: > https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi… > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > -- Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant

1 0

ovirt 4.4.0 - Live merge failure with libvirt error "virDomainBlockCommit() failed"
by Marco Fais 27 May '20

27 May '20

Hi, I have upgraded one of my nodes to oVirt-node 4.4.0 and I am testing the basic functionality in preparation for the full cluster migration. Unfortunately snapshot deletions are not working at the moment; I have a live merge failure most of the times due to a libvirt error -- virDomainBlockCommit() failed I have opened a bug on this as well (https://bugzilla.redhat.com/show_bug.cgi?id=1840414) See the most relevant portion of the vdsm.log here: 2020-05-26 22:43:39,067+0100 ERROR (jsonrpc/1) [virt.vm] (vmId='baaf6be8-dcf4-4f26-b0f1-435287eeed95') Live merge failed (job: 7b96452b-0e60-46c6-9236-6b8a906b0ed8) (vm:5381) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/virt/vm.py", line 5379, in merge bandwidth, flags) File "/usr/lib/python3.6/site-packages/vdsm/virt/virdomain.py", line 101, in f ret = attr(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python3.6/site-packages/libvirt.py", line 728, in blockCommit if ret == -1: raise libvirtError ('virDomainBlockCommit() failed', dom=self) libvirt.libvirtError: internal error: qemu block name 'json:{"backing": {"driver": "raw", "file": {"driver": "file", "filename": "/rhev/data-center/mnt/glusterSD/192.168.30.2:_Temp__Storage/246845e5-5546-4f04-948e-66a9532b403f/images/64955343-da61-4b76-9158-8df8363dc5a3/b0558698-bc82-4941-ac52-9fa2385a9f00"}}, "driver": "qcow2", "file": {"driver": "file", "filename": "/rhev/data-center/mnt/glusterSD/192.168.30.2:_Temp__Storage/246845e5-5546-4f04-948e-66a9532b403f/images/64955343-da61-4b76-9158-8df8363dc5a3/be844ebe-10b6-4ac7-89c1-9f8526a52762"}}' doesn't match expected '/rhev/data-center/mnt/glusterSD/192.168.30.2:_Temp__Storage/246845e5-5546-4f04-948e-66a9532b403f/images/64955343-da61-4b76-9158-8df8363dc5a3/be844ebe-10b6-4ac7-89c1-9f8526a52762' 2020-05-26 22:43:39,075+0100 INFO (jsonrpc/1) [api.virt] FINISH merge return={'status': {'code': 52, 'message': 'Merge failed'}} from=::ffff:10.144.138.240,60914, flow_id=dbf9c831-e0cb-4891-a38c-d61136daf029, vmId=baaf6be8-dcf4-4f26-b0f1-435287eeed95 (api:54) 2020-05-26 22:43:39,075+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.merge failed (error 52) in 0.18 seconds (__init__:312) This issue was reported also on https://bugzilla.redhat.com/show_bug.cgi?id=1785939; according to the comments the resolution seems to be in libvirt 6.x. However I am not quite sure if / how I can get libvirt 6 in my setup... is there a test image (ideally ovirt-node) I can use? Any suggestions? Unrelated: I had also a problem during the hosted-engine deployment due to the fact the machine is not connected directly to internet and could not complete the dnf update steps (even with the proxy configured it was still failing at a later stage during the engine setup, same problem..). I might open another thread on it... Thanks, Marco

1 0

oVirt 4.3.9.4-1:--> VM Has been paused due to storage I/O error
by adrianquintero＠gmail.com 27 May '20

27 May '20

Team, I've been having issues all my VMs cant be started, error is "VM Has been paused due to storage I/O error" Any ideas are welcome as all my VMs are down Gluster log (gluster version 6.8): [2020-05-27 09:10:28.132619] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=8674ab5f-56b9-4136-9b30-a65ca86be204, fd=0x7f12b807e6d8, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.132694] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3286: READV 3 (8674ab5f-56b9-4136-9b30-a65ca86be204), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:10:28.211930] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=8674ab5f-56b9-4136-9b30-a65ca86be204, fd=0x7f12b825ed18, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.211995] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3306: READV 2 (8674ab5f-56b9-4136-9b30-a65ca86be204), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:10:28.226451] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=755664db-2d04-4ed0-9333-251c6cc3dcb1, fd=0x7f12b807e6d8, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.226511] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3317: READV 2 (755664db-2d04-4ed0-9333-251c6cc3dcb1), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:10:28.232122] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=755664db-2d04-4ed0-9333-251c6cc3dcb1, fd=0x7f12b807e6d8, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.232181] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3319: READV 2 (755664db-2d04-4ed0-9333-251c6cc3dcb1), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:10:28.237043] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=8674ab5f-56b9-4136-9b30-a65ca86be204, fd=0x7f12b82038b8, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.237100] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3321: READV 3 (8674ab5f-56b9-4136-9b30-a65ca86be204), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:10:28.242176] E [MSGID: 113040] [posix-inode-fd-ops.c:1572:posix_readv] 0-vmstore-posix: read failed on gfid=755664db-2d04-4ed0-9333-251c6cc3dcb1, fd=0x7f12b807e6d8, offset=0 size=1, buf=0x7f134fbd9000 [Invalid argument] [2020-05-27 09:10:28.242235] E [MSGID: 115068] [server-rpc-fops_v2.c:1425:server4_readv_cbk] 0-vmstore-server: 3323: READV 2 (755664db-2d04-4ed0-9333-251c6cc3dcb1), client: CTX_ID:03354525-5de3-4390-b775-3db7a85c0022-GRAPH_ID:0-PID:29372-HOST:jrz-061-ovirt3.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0, error-xlator: vmstore-posix [Invalid argument] [2020-05-27 09:11:18.990877] I [MSGID: 115036] [server.c:499:server_rpc_notify] 0-vmstore-server: disconnecting connection from CTX_ID:87270d80-4310-4795-9f4d-2c1a61d16cee-GRAPH_ID:0-PID:28815-HOST:jrz-059-ovirt1.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 [2020-05-27 09:11:18.991896] I [MSGID: 101055] [client_t.c:436:gf_client_unref] 0-vmstore-server: Shutting down connection CTX_ID:87270d80-4310-4795-9f4d-2c1a61d16cee-GRAPH_ID:0-PID:28815-HOST:jrz-059-ovirt1.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 [2020-05-27 09:11:19.329120] I [MSGID: 115036] [server.c:499:server_rpc_notify] 0-vmstore-server: disconnecting connection from CTX_ID:5858e269-923e-4a38-9c6b-62f337a6abac-GRAPH_ID:0-PID:20791-HOST:jrz-060-ovirt2.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 [2020-05-27 09:11:19.329419] I [MSGID: 101055] [client_t.c:436:gf_client_unref] 0-vmstore-server: Shutting down connection CTX_ID:5858e269-923e-4a38-9c6b-62f337a6abac-GRAPH_ID:0-PID:20791-HOST:jrz-060-ovirt2.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 [2020-05-27 09:11:21.044186] I [addr.c:54:compare_addr_and_update] 0-/gluster_bricks/vmstore/vmstore: allowed = "*", received addr = "192.168.0.59" [2020-05-27 09:11:21.044227] I [login.c:110:gf_auth] 0-auth/login: allowed user names: c2ef048a-b354-4f91-8e41-a2aab6e65dbc [2020-05-27 09:11:21.044265] I [MSGID: 115029] [server-handshake.c:553:server_setvolume] 0-vmstore-server: accepted client from CTX_ID:c2426c68-ad6c-4d3a-b6a4-decce8d18b75-GRAPH_ID:0-PID:1558-HOST:jrz-059-ovirt1.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 (version: 6.8) with subvol /gluster_bricks/vmstore/vmstore [2020-05-27 09:11:21.383131] I [addr.c:54:compare_addr_and_update] 0-/gluster_bricks/vmstore/vmstore: allowed = "*", received addr = "192.168.0.60" [2020-05-27 09:11:21.383168] I [login.c:110:gf_auth] 0-auth/login: allowed user names: c2ef048a-b354-4f91-8e41-a2aab6e65dbc [2020-05-27 09:11:21.383190] I [MSGID: 115029] [server-handshake.c:553:server_setvolume] 0-vmstore-server: accepted client from CTX_ID:5a363377-0bc7-40eb-a7cb-f4f5757a102b-GRAPH_ID:0-PID:27173-HOST:jrz-060-ovirt2.example.com-PC_NAME:vmstore-client-2-RECON_NO:-0 (version: 6.8) with subvol /gluster_bricks/vmstore/vmstore

1 0

Tasks stuck waiting on another after failed storage migration (yet not visible on SPM)
by david.sekne＠gmail.com 27 May '20

27 May '20

Hello, I'm running oVirt version 4.3.9.4-1.el7. After a failed live storage migration VM got stuck with snapshot. Checking the engine logs I can see that the snapshot removal task is waiting for Merge to complete and vice versa. 2020-05-26 18:34:04,826+02 INFO [org.ovirt.engine.core.bll.snapshots.RemoveSnapshotSingleDiskLiveCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshotSingleDiskLive' (id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40') waiting on child command id: 'f7d1de7b-9e87-47ba-9ba0-ee04301ba3b1' type:'Merge' to complete 2020-05-26 18:34:04,827+02 INFO [org.ovirt.engine.core.bll.MergeCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Waiting on merge command to complete (jobId = f694590a-1577-4dce-bf0c-3a8d74adf341) 2020-05-26 18:34:04,845+02 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshot' (id: '47c9a847-5b4b-4256-9264-a760acde8275') waiting on child command id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40' type:'RemoveSnapshotSingleDiskLive' to complete 2020-05-26 18:34:14,277+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmJobsMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM Job [f694590a-1577-4dce-bf0c-3a8d74adf341]: In progress (no change) I cant see any tasks on sPM via command 2020-05-26 18:34:04,826+02 INFO [org.ovirt.engine.core.bll.snapshots.RemoveSnapshotSingleDiskLiveCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshotSingleDiskLive' (id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40') waiting on child command id: 'f7d1de7b-9e87-47ba-9ba0-ee04301ba3b1' type:'Merge' to complete 2020-05-26 18:34:04,827+02 INFO [org.ovirt.engine.core.bll.MergeCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Waiting on merge command to complete (jobId = f694590a-1577-4dce-bf0c-3a8d74adf341) 2020-05-26 18:34:04,845+02 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshot' (id: '47c9a847-5b4b-4256-9264-a760acde8275') waiting on child command id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40' type:'RemoveSnapshotSingleDiskLive' to complete 2020-05-26 18:34:14,277+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmJobsMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM Job [f694590a-1577-4dce-bf0c-3a8d74adf341]: In progress (no change) I cannot see any runnig tasks on the SPM (vdsm-client Host getAllTasksInfo). I also cannot find the task ID in any of the other node's logs. I already tried restarting the Engine (didn't help). To start I'm puzzled where is the engine getting the task info? Any Ideas on how I could resolve this? Thank you. Regards, David

1 0

oVirt 4.4 and management network requirements
by Gianluca Cecchi 26 May '20

26 May '20

Hello, does oVirt 4.4. support management network distributed between routed networks and not bound to a single one? In some environments I see situations where there are 2 different server farms with networks not necessarily mapped to the same ranges and so it could be useful to let oVirt hosts of the same cluster to be able to communicate but not on the same physical network. Eg vSphere can do it. Thanks in advance, Gianluca

3 7

Re: Reconfigure Websocket Proxy
by Yedidyah Bar David 26 May '20

26 May '20

On Tue, May 26, 2020 at 3:15 PM Anton Louw via Users <users(a)ovirt.org> wrote: > > > Hi Everybody, > > > > I tried looking around, but I am stuck. I am trying to reconfigure my > Websocket proxy in order to use noVNC. This is after the Hosted Engine name > was changed and also after a new SSL cert was added to the Hosted Engine. > > > > Most of the articles say that I should run “engine-cleanup”, but after > learning the hard way, I would rather not do that again 😊 Any other way > anybody knows of? I want to completely remove it and then reinstall it. > Didn't test this, but you can try: 1. Keep a backup of /etc somewhere, just in case. 2. Stop ovirt-websocket-proxy.service 3. Edit /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf , remove the line with: OVESETUP_CONFIG/websocketProxyConfig 4. Remove: /etc/ovirt-engine/ovirt-websocket-proxy.conf.d/10-setup.conf /etc/pki/ovirt-engine/requests/websocket-proxy.req /etc/pki/ovirt-engine/keys/websocket-proxy.key.nopass /etc/pki/ovirt-engine/keys/websocket-proxy.p12 /etc/pki/ovirt-engine/certs/websocket-proxy.cer 5. Run engine-setup (perhaps with '--offline', if you want to prevent it from checking for updates) Good luck and best regards, > > > Thanks > > *Anton Louw* > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > [image: F] <https://www.facebook.com/voxtelecomZA> > [image: T] <https://www.twitter.com/voxtelecom> > [image: I] <https://www.instagram.com/voxtelecomza/> > [image: L] <https://www.linkedin.com/company/voxtelecom> > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > [image: #VoxBrand] > <https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> > *Disclaimer* > > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal > nature, they are subject to copyright in favour of the holding company of > the Vox group of companies. Any recipient who receives this email in error > should immediately report the error to the sender and permanently delete > this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by *Mimecast Ltd*, an innovator in Software as a > Service (SaaS) for business. Providing a *safer* and *more useful* place > for your human generated data. Specializing in; Security, archiving and > compliance. To find out more Click Here > <https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>. > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/NXNCD2LSLV2OD… > -- Didi

1 0

Reconfigure Websocket Proxy
by Anton Louw 26 May '20

26 May '20

Hi Everybody, I tried looking around, but I am stuck. I am trying to reconfigure my Websocket proxy in order to use noVNC. This is after the Hosted Engine name was changed and also after a new SSL cert was added to the Hosted Engine. Most of the articles say that I should run “engine-cleanup”, but after learning the hard way, I would rather not do that again 😊 Any other way anybody knows of? I want to completely remove it and then reinstall it. Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

Terraform - Ovirt - seting or get some parameters
by Michal Obeslo 26 May '20

26 May '20

Hi all, we need a help, we have problem to set and get IP Address when we created virtual machine when we use terraform. step by step: what we created 1) we created virtual machine Debian 9 - installed the software ovirt-guest-agent) [systemctl status ovirt-guest agent = OK - we created private and public key to connectivity from another computer by .ssh ) /Jenkins Slave/ 2) we created template from virtual machine Debian 9 - set this parameter in template initial Run > user, set static IP in Ovirt Managemet 3) downloaded project from GitHub - create virtual machine from template - terraform main file = OK ? - terraform init = OK - terraform apply = OK : yes create new virtual machine = OK start automatically virtual machine = OK - when I check IP Address > IP address not set - when I check settings in Ovirt management > network > NOT SET - virtual machine not has IP addres > not working - when I change settings in Ovirt management in template Debian from Static IP dhcp > to DHCP - when I check settings in Ovirt management > network > IP in Ovit have DHCP, Virtual machine have dhcp OK But wee need set static IP to Virtual machine and get this IP from terraform. Thank you all. Best regard Michal --- This is the file main.tf: provider "ovirt" { url = "${var.ovirt_url}" username = "${var.ovirt_username}" password = "${var.ovirt_password}" } terraform { backend "local" { path = "terraform.tfstate" } } # Create VM call temp02 module "temp01-pipeline" { source = "../modules/vms" vm_authorized_ssh_key = "${file(pathexpand("c:/cygwin64/home/Administrator/.ssh/id_rsa.pub"))}" vm_custom_script = " ${file(pathexpand("c:/Jenkins/workspace/AT_PipelineVM/config/basic/terraform/ovirt/init_script.yml"))}" cluster_id = "aa583cf2-a07a-11e8-aa92-525400491e5b" vm_name = "cd-pipeline-1.0.0" vm_memory = "4096" vm_cpu_cores = "1" vm_template_id = "876a260b-26c7-482e-bc19-19b10b9c48bb" vm_hostname = "temp01.example.com" vm_user_name = "root" vm_dns_servers = "8.8.8.8" vm_dns_search = "example.com" vm_timezone = "Africa/Nairobi" vm_nic_device = "env3" vm_nic_ip_address = "192.168.26.36" vm_nic_gateway = "192.168.26.2" vm_nic_netmask = "255.255.255.0" }

2 1

How to change IP range of node and hosted engine without break anything ?
by Stéphane Paillet 26 May '20

26 May '20

Hello, I installed an ovirt node and its hosted engine in a lab. After several difficulties to install the engine (I don't know why, I didn't have any problem in the past), I would like to change IPs of both to put them on another vlan. How can I do that without break anything ? My main fear is that the data domain used by the hosted engine use the IP of the node rather than its FQDN. I change other data domains paths, but don't find how to change this one, 'cause I can't modify it, and I can't detach / delete it to recreate another one. I didn't find how to move the engine on another data domain using the node's FQDN in its path. For now, I don't use DNS, I just updated /etc/hosts defs on both servers. If someone could help me, telling me step by step how to change IPs on each element in good order, I would be grateful. Thank you. Cheers, Stephane

2 3

ovirt node 4.4 and infiniband
by Giulio Casella 26 May '20

26 May '20

Hi all, I have in production a 4.3.9 setup of ovirt, based on a standalone engine, not HE. I have 3 datacenters (an 3 clusters). One of these clusters is composed of many tenth of HP blades, accessing storage via InfiniBand (used as normal NICs, via ipoib). They're not the state of the art, but I cannot renew the entire hardware. After a setup of ovirt node 4.4 I cannot see ib0 nic. I managed to see it installing CentOS 8, enabling Mellanox repo (https://linux.mellanox.com/public/repo/mlnx_ofed/latest/rhel8.1/mellanox_ml…) and installing package "mlnx-ofed-basic". In Ovirt Node it's not possible, that package require dependencies from CentOS 8 repos, not present in ovirt repo. Is there any chances to have infiniband NICs working in ovirt? TIA, gc

3 3

Error encountered when running ovirt-engine-rename
by Aidilf Fitri 26 May '20

26 May '20

Hello All, I have encountered an error when trying to execute the ovirt engine rename script. Below is the error I have encountered. Any advise? ----------------Start of Error---------------------------------------------------------------------------------------------------------------------------------------------------- ***L:ERROR Internal error: No module named 'urlparse' Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/main.py", line 141, in execute self.context.loadPlugins() File "/usr/lib/python3.6/site-packages/otopi/context.py", line 803, in loadPlugins self._loadPluginGroups(plugindir, needgroups, loadedgroups) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 112, in _loadPluginGroups self._loadPlugins(path, path, groupname) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 69, in _loadPlugins self._loadPlugins(base, d, groupname) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 100, in _loadPlugins os.path.basename(path), File "/usr/lib/python3.6/site-packages/otopi/util.py", line 109, in loadModule spec.loader.exec_module(module) File "<frozen importlib._bootstrap_external>", line 678, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-rename/vmconsole_proxy_helper/__init__.py", line 15, in <module> from . import config File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-rename/vmconsole_proxy_helper/config.py", line 14, in <module> import urlparse ModuleNotFoundError: No module named 'urlparse' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/otopi/__main__.py", line 88, in main installer.execute() File "/usr/lib/python3.6/site-packages/otopi/main.py", line 147, in execute sys.exc_info()[2], File "/usr/lib/python3.6/site-packages/otopi/util.py", line 84, in raiseExceptionInformation raise info[1].with_traceback(info[2]) File "/usr/lib/python3.6/site-packages/otopi/main.py", line 141, in execute self.context.loadPlugins() File "/usr/lib/python3.6/site-packages/otopi/context.py", line 803, in loadPlugins self._loadPluginGroups(plugindir, needgroups, loadedgroups) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 112, in _loadPluginGroups self._loadPlugins(path, path, groupname) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 69, in _loadPlugins self._loadPlugins(base, d, groupname) File "/usr/lib/python3.6/site-packages/otopi/context.py", line 100, in _loadPlugins os.path.basename(path), File "/usr/lib/python3.6/site-packages/otopi/util.py", line 109, in loadModule spec.loader.exec_module(module) File "<frozen importlib._bootstrap_external>", line 678, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-rename/vmconsole_proxy_helper/__init__.py", line 15, in <module> from . import config File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-rename/vmconsole_proxy_helper/config.py", line 14, in <module> import urlparse otopi.main.PluginLoadException: No module named 'urlparse' ----------------End of Error----------------------------------------------------------------------------------------------------------------------------------------------------

3 2

where is ovirt-iso-uploader in 4.4?
by dan.creed＠thecreeds.net 25 May '20

25 May '20

Can't seem to find this, maybe I'm old school but in 4.4 how do I upload ISO's I want to boot as CD's on my virtual machine?

4 4

[ANN] oVirt 4.4.1 First Release Candidate is now available for testing
by Lev Veyde 25 May '20

25 May '20

oVirt 4.4.1 First Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.1 First Release Candidate for testing, as of May 25th, 2020. This update is the first in a series of stabilization updates to the 4.4 series. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Some of the features included in oVirt 4.4.1 Release Candidate require content that will be available in CentOS Linux 8.2 but can’t be tested on RHEL 8.2 beta yet due to some incompatibility in openvswitch package shipped in CentOS Virt SIG which requires to rebuild openvswitch on top of CentOS 8.2. Installation instructions For the engine: either use appliance or: - Install CentOS Linux 8 minimal from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… ; select minimal installation - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - Attach the host to engine and let it be deployed. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.1 release highlights: http://www.ovirt.org/release/4.4.1/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.1/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

Failed to import vmware vm to ovirt use web UI
by stone＠onlyos.com 25 May '20

25 May '20

2 1

searching in manager
by Jiří Sléžka 25 May '20

25 May '20

Hi, oVirt 4.3.9.4-1.el7 I am trying to search a vms which has storage domain other than RHEV-SSDStorage so I entered this search string in Manager in Compute / Virtual Machines search form. Storage != "RHEV-SSDStorage" but it looks like all vms are listed. When I try... Storage = "RHEV-SSDStorage" ...it works like expected and only right vms are listed. Also combinations seems does not work. Storage = "RHEV-SlowStorage" or Storage = "RHEV-MidStorage" ...returns 0 rows. Should it work? Cheers, Jiri

2 2

how to save stateless disk
by Jiří Sléžka 25 May '20

25 May '20

Hi, I have one vm configured as stateless (useful for example for testing ansible deploying). But now I am in the middle of work and we have planned power outage. If I power down this wm now I will lost my work. It looks like I am unable to create snapshot if vm is in stateless state. Is there any trick how to not loose my stateless state? Is it RFE worth problem? Cheers, Jiri

3 3

How to upgrade my cluster to 4.4 without pain (it will be useful not only to me)
by Patrick Lomakin 25 May '20

25 May '20

We have four hosts with self-hosted engines. Installed version of the engine 4.3.9. I have the power reserve to migrate all virtual machines to three hosts and spend on construction on the remaining host. I really want someone to help me make a plan to upgrade and upgrade to version 4.4 without pain. I will describe the configuration in more detail: 4 hosts where ovirt node 4.3.9 was deployed, and then one of them has an ovirt engine with a control panel deployed. In the process the storage was added and everything works fine. In the ovirt settings, when adding a host, I deployed a backup engine (gray crown icon). Backup engine is available on each host and was specially tested when one of the hosts was turned off. "Now as I think it will update and there will be questions immediately." 1. My first step is to remove a free host from the control panel and deploy ovirt node (4.4) on it 2. Next, the question arises: since I have to restore the new engine from backup 4.3.9, will it not show a version incompatibility? 3. If I need to restore the backup, then logically I have to disable all my engines and then restore? 4. When I restore the engine, will my hosts and virtual machines go nowhere? Will hosts with old version 4.3.9 be available? Please do not criticize me and understand correctly - there are over 100 virtual machines with important data. A rough plan could help me minimize serious errors. In addition, I could share my upgrade experience with the real configuration, which could help both developers and administrators. Regards!

1 0

Issues encountered performing HE install on 4.3
by Alan G 24 May '20

24 May '20

Hi, I hit a few issues while performing a recent HE install of 4.3. While I managed to find solutions/workarounds to all the problems I thought I might share them here * As defined in the Ansible defaults the temp dir for building the local HE VM is /var/tmp. I was 80M short of the required space and there did not appear to be a (supported) way to specify a different location. I ended up having to do a bind mount of /var/tmp to get me through the install. Would be nice to be able to specify a custom location. * Permissive umask required. Our CIS CentOS 7 build requires that default umask is 027. This breaks the installer as it creates the VM image under /var/tmp as root and cannot then access it as qemu user. As the temp files are cleaned up on failure it took me a while to track this one down. My solution was to temporarily set the umask to 022 for the session while running the installer. It would be nice if the installer either handled this by doing a chmod/chown as required, or at least doing a umask pre-check and failing with a meaningful error. * SSH root login required on host. Again for CIS we have "PermitRoologin no" configured in sshd. This means the add host task fails on the Engine, but instead of a hard failure we get a timeout on the installer. Which left me chasing some imagined routing/bridging/DNS issue. Eventually I realised I could get to the engine logs and found the issue but took several hours. Would be nice if the installer could either support a sudo option or at least perform a root login pre-check and fail with a meaningful error. Thanks, Alan

2 1

Bug with ovirt-hosted-engine-setup
by dan.creed＠thecreeds.net 24 May '20

24 May '20

This is 100% repeatable for me. Brand new environment, all using the ovirt node ISO. 4.3.9 downloaded a couple of days ago. [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 5, "changed": true, "cmd": ["hosted-engine", "--reinitialize-lockspace", "--force"], "delta": "0:00:00.412864", "end": "2020-05-19 09:23:03.856435", "msg": "non-zero return code", "rc": 1, "start": "2020-05-19 09:23:03.443571", "stderr": "Traceback (most recent call last):\n File \"/usr/lib64/python2.7/runpy.py\", line 162, in _run_module_as_main\n \"__main__\", fname, loader, pkg_name)\n File \"/usr/lib64/python2.7/runpy.py\", line 72, in _run_code\n exec code in run_globals\n File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>\n ha_cli.reset_lockspace(force)\n File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace\n stats = broker.get_stats_from_storage()\n File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 146, in get_stats_from_storage\n result = self ._proxy.get_stats()\n File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1233, in __call__\n return self.__send(self.__name, args)\n File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1591, in __request\n verbose=self.__verbose\n File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1273, in request\n return self.single_request(host, handler, request_body, verbose)\n File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1301, in single_request\n self.send_content(h, request_body)\n File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1448, in send_content\n connection.endheaders(request_body)\n File \"/usr/lib64/python2.7/httplib.py\", line 1052, in endheaders\n self._send_output(message_body)\n File \"/usr/lib64/python2.7/httplib.py\", line 890, in _send_output\n self.send(msg)\n File \"/usr/lib64/python2.7/httplib.py\", line 852, in send\n self.connect()\n File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 60, in connect\n self. sock.connect(base64.b16decode(self.host))\n File \"/usr/lib64/python2.7/socket.py\", line 224, in meth\n return getattr(self._sock,name)(*args)\nsocket.error: [Errno 2] No such file or directory", "stderr_lines": ["Traceback (most recent call last):", " File \"/usr/lib64/python2.7/runpy.py\", line 162, in _run_module_as_main", " \"__main__\", fname, loader, pkg_name)", " File \"/usr/lib64/python2.7/runpy.py\", line 72, in _run_code", " exec code in run_globals", " File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>", " ha_cli.reset_lockspace(force)", " File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace", " stats = broker.get_stats_from_storage()", " File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 146, in get_stats_from_storage", " result = self._proxy.get_stats()", " File \"/usr/lib64/python2.7/ xmlrpclib.py\", line 1233, in __call__", " return self.__send(self.__name, args)", " File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1591, in __request", " verbose=self.__verbose", " File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1273, in request", " return self.single_request(host, handler, request_body, verbose)", " File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1301, in single_request", " self.send_content(h, request_body)", " File \"/usr/lib64/python2.7/xmlrpclib.py\", line 1448, in send_content", " connection.endheaders(request_body)", " File \"/usr/lib64/python2.7/httplib.py\", line 1052, in endheaders", " self._send_output(message_body)", " File \"/usr/lib64/python2.7/httplib.py\", line 890, in _send_output", " self.send(msg)", " File \"/usr/lib64/python2.7/httplib.py\", line 852, in send", " self.connect()", " File \"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 60, in connect", " self.sock.connect(base 64.b16decode(self.host))", " File \"/usr/lib64/python2.7/socket.py\", line 224, in meth", " return getattr(self._sock,name)(*args)", "socket.error: [Errno 2] No such file or directory"], "stdout": "", "stdout_lines": []} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook

2 1

storage domain cross data center status
by Николай Чаплинский 24 May '20

24 May '20

Hello! Wich table in ovirt database contains column with "cross data center status" оf Storage Domains?

3 2

[ANN] oVirt 4.3.10 Fifth Release Candidate is now available for testing
by Lev Veyde 23 May '20

23 May '20

The oVirt Project is pleased to announce the availability of oVirt 4.3.10 Fifth Release Candidate for testing as of May 22nd, 2020. This update is the tenth in a series of stabilization updates to the 4.3 series. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) * oVirt Node 4.3 (available for x86_64 only) See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] Additional Resources: * Read more about the oVirt 4.3.10 release highlights: http://www.ovirt.org/release/4.3.10/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.10/ [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

oVirt hosted engine install error: Failed to verify Power Management configuration
by fawzi＠kdsplumbing.com 22 May '20

22 May '20

Hello, i am new to ovirt and i am trying to install it on minimal-install centos 7. i have been able to iron out all the wrinkles to create the host-engine, except for this error: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, deployment errors: code 505: Host ovirt.kdsplumbing.com installation failed. Failed to configure management network on the host., code 9000: Failed to verify Power Management configuration for Host ovirt.kdsplumbing.com., fix accordingly and re-deploy."} can someone layout what this issue is all about or point me in the right direction? i have been battling ith this for 2 days now, without any clue on what it is about. thanks

2 1

Getting the same bug in 4.4 as I did in 4.3.. brand new install 100% repeatable for me.
by dan.creed＠thecreeds.net 22 May '20

22 May '20

Brand new install, I get past the gluster setup, setting up the the hosted VM, get to finalize and hits this issue with lockspace every time. [ INFO ] TASK [ovirt.hosted_engine_setup : Initialize lockspace volume] [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 5, "changed": true, "cmd": ["hosted-engine", "--reinitialize-lockspace", "--force"], "delta": "0:00:00.302914", "end": "2020-05-21 14:23:50.413353", "msg": "non-zero return code", "rc": 1, "start": "2020-05-21 14:23:50.110439", "stderr": "Traceback (most recent call last):\n File \"/usr/lib64/python3.6/runpy.py\", line 193, in _run_module_as_main\n \"__main__\", mod_spec)\n File \"/usr/lib64/python3.6/runpy.py\", line 85, in _run_code\n exec(code, run_globals)\n File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>\n ha_cli.reset_lockspace(force)\n File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace\n stats = broker.get_stats_from_storage()\n File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 148, in get_stats_from_storage\n result = self._proxy.get_stats()\n File \"/usr/li b64/python3.6/xmlrpc/client.py\", line 1112, in __call__\n return self.__send(self.__name, args)\n File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1452, in __request\n verbose=self.__verbose\n File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1154, in request\n return self.single_request(host, handler, request_body, verbose)\n File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1166, in single_request\n http_conn = self.send_request(host, handler, request_body, verbose)\n File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1279, in send_request\n self.send_content(connection, request_body)\n File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1309, in send_content\n connection.endheaders(request_body)\n File \"/usr/lib64/python3.6/http/client.py\", line 1249, in endheaders\n self._send_output(message_body, encode_chunked=encode_chunked)\n File \"/usr/lib64/python3.6/http/client.py\", line 1036, in _send_output\n self.send(msg)\n File \"/usr/lib64/python3.6/http/client.py\ ", line 974, in send\n self.connect()\n File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 74, in connect\n self.sock.connect(base64.b16decode(self.host))\nFileNotFoundError: [Errno 2] No such file or directory", "stderr_lines": ["Traceback (most recent call last):", " File \"/usr/lib64/python3.6/runpy.py\", line 193, in _run_module_as_main", " \"__main__\", mod_spec)", " File \"/usr/lib64/python3.6/runpy.py\", line 85, in _run_code", " exec(code, run_globals)", " File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>", " ha_cli.reset_lockspace(force)", " File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace", " stats = broker.get_stats_from_storage()", " File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 148, in get_stats_from_storage", " result = self._proxy.get_stats()", " File \"/usr/lib64/ python3.6/xmlrpc/client.py\", line 1112, in __call__", " return self.__send(self.__name, args)", " File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1452, in __request", " verbose=self.__verbose", " File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1154, in request", " return self.single_request(host, handler, request_body, verbose)", " File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1166, in single_request", " http_conn = self.send_request(host, handler, request_body, verbose)", " File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1279, in send_request", " self.send_content(connection, request_body)", " File \"/usr/lib64/python3.6/xmlrpc/client.py\", line 1309, in send_content", " connection.endheaders(request_body)", " File \"/usr/lib64/python3.6/http/client.py\", line 1249, in endheaders", " self._send_output(message_body, encode_chunked=encode_chunked)", " File \"/usr/lib64/python3.6/http/client.py\", line 1036, in _send_output", " self.send(msg)", " File \"/usr/lib 64/python3.6/http/client.py\", line 974, in send", " self.connect()", " File \"/usr/lib/python3.6/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 74, in connect", " self.sock.connect(base64.b16decode(self.host))", "FileNotFoundError: [Errno 2] No such file or directory"], "stdout": "", "stdout_lines": []}

2 4

Re: ovrt node ng 4.4 different fs layout and error if changed
by jan.kleefeld.1996＠gmail.com 22 May '20

22 May '20

Same here. I let the installer automatically set the partition configuration. I changed nothing. Same error as you have. On ovirt-node-ng-installer-4.4.0-2020052110.el8

1 0

4.4 bug? Seems 100% repeatable
by dan.creed＠thecreeds.net 21 May '20

21 May '20

[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, deployment errors: code 505: Host quigonn installation failed. Failed to configure management network on the host., code 1120: Failed to configure management network on host quigonn due to setup networks failure., code 9000: Failed to verify Power Management configuration for Host quigonn., code 10802: VDSM quigonn command HostSetupNetworksVDS failed: Internal JSON-RPC error: {'reason': 'Three or more nameservers are only supported when using either IPv4 or IPv6 nameservers but not both.'}, fix accordingly and re-deploy."} This has me utterly confused, I only have 1 name server specified in /etc/resolv.conf Not sure where it's getting this from?

1 1

Reddit questions
by Sandro Bonazzola 21 May '20

21 May '20

Q1: Regarding the support for Ignition; how is that handled in ansible? Is that done from the cloud-init section? ( https://www.reddit.com/r/ovirt/comments/gnb3x9/ovirt_44_available/fr8q1t8/) +Ryan Barry <rbarry(a)redhat.com> can you please follow up? -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

ovirt 4.4 GA
by dan.creed＠thecreeds.net 21 May '20

21 May '20

Just downloaded the ISO 4.4. an hour ago from link on the home page, and FYI: Still has the pop-up during install that it is pre-release, etc..

2 2

HostedEngine HA Engine Network Status
by Joseph Goldman 21 May '20

21 May '20

Hi List, Running a 3 node setup for a client, i'm constantly having the HostedEngine move itself around, whatever node its on ends up penalizing its score so low that it forces a migrate to the other node. Looking at /var/log/ovirt-hosted-engine-ha/agent.log shows a decent amount of: MainThread::INFO::2020-05-21 15:47:54,742::states::135::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 319 due to network status What I want to know is how do I get more debug out of this to know what network status its concerned about, so I can go about stablising it. The system is heavily monitored with ping checks, never drops link and never drops ICMP. None of its VM's falter accessing shared NFS space for disk storage so I'm not sure what the concern is. The node will literally over time penalise itself down to ~2000 and then HA agent will want it to swap nodes. It's not necessarily a bad thing but generates a heap of status emails multiple times a day which is just garbage - and makes the HE unavailable sometimes when mid-admin task. Any help is appreciated. Thanks, Joe

3 2

Are the Host storage requirements changed in oVirt 4.4?
by Stefano Stagnaro 21 May '20

21 May '20

Seems like the new minimum local storage for an Host is now 63 GiB, compared to the 55 GiB of the 4.3. If so, the four Installation guides should be updated reflecting the new value. Thank you and congratulations for the new release. — Stefano

2 2

Re: oVirt 4.4.0 Release is now generally available
by Sandro Bonazzola 20 May '20

20 May '20

Il giorno mer 20 mag 2020 alle ore 15:07 Staniforth, Paul < P.Staniforth(a)leedsbeckett.ac.uk> ha scritto: > > > Thanks and well done everyone. > > No virtual release party ? 🙂 > You're welcome helping organizing one :-) I would be happy to join! I wonder how a virtual release party may look like? -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

oVirt and Fedora
by Sandro Bonazzola 20 May '20

20 May '20

If you have followed the oVirt project for a few releases you already know oVirt has struggled to keep the pace with the fast innovation cycles Fedora Project is following. Back in September 2019 CentOS project launched CentOS Stream as a rolling preview of future RHEL kernels and features, providing an upstream development platform for ecosystem developers that sits between Fedora and RHEL. Since then the oVirt project tried to keep the software working on Fedora, CenOS Stream, and RHEL/CentOS but it became quickly evident the project lacked resources to keep the project running on three platforms. Further, our user surveys show that oVirt users strongly prefer using oVirt on CentOS and RHEL. With the upcoming end of life of Fedora 30 the oVirt project has decided to stop trying to keep the pace with this amazing platform, focusing on stabilizing the software codebase on RHEL / CentOS Linux. By focusing our resources and community efforts on RHEL/CentOS Linux and Centos Stream, we can provide better support for those platforms and use more time for moving oVirt forward. -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

4 11

Re: Migrate hosted engine to standalone host
by Yedidyah Bar David 20 May '20

20 May '20

On Mon, May 18, 2020 at 1:33 PM Anton Louw via Users <users(a)ovirt.org> wrote: > > > Hello, > > > > I am not sure if the below thread went missing somewhere. Just to add on > as well, when moving the hosted engine to a standalone host, will the > process look similar to the below: > I never tried that, but: > > > Backup and remove Hosted Engine: > > > > 1. Backup Hosted Engine (engine-backup --scope=all --mode=backup > --file=Full --log=Log_Full) > > 2. Download the backup files from HE using WinSCP > > 3. Enable global Maintenance (hosted-engine --set-maintenance > --mode=global) > > 4. Power down hosted engine (hosted-engine --vm-shutdown) > > > > > --------------------------------------------------------------------------------------------- > > Redeploy Hosted Engine: > > > > Build new CentOS VM in another environment > > *Same IP > > *Same name > > *Same resources > > > > 1. sudo yum install > https://resources.ovirt.org/pub/yum-repo/ovirt-release43.rpm > > 2. sudo yum install -y ovirt-engine > > 3. Copy backup files to newly deployed CentOS VM > > 4. engine-backup --mode=restore --file=Full --log=Log_Full --provision-db > --provision-dwh-db --restore-permissions > You might want to pass also --he-remove-storage-vm , and perhaps also --he-remove-hosts . This removes them, obviously, only from the database, does not connect to them or do anything on them. You'll then have to add them again. You will not be able to do that if there are running VMs on them, I think. So: If you need to keep the VMs up, and have some of them on the hosted-engine hosts, do not use these options, but do test very well, and study the bugs for which these options were added - you can check git log for this file searching this: https://github.com/oVirt/ovirt-engine/commits/master?after=3cd2766ae1576b22… https://github.com/oVirt/ovirt-engine/commit/542e4a318584c8601159b4bd6d576f… Bug-Url: https://bugzilla.redhat.com/1240466 Bug-Url: https://bugzilla.redhat.com/1235200 The engine will still think that it's a hosted-engine, so it will likely be confused. Perhaps --he-remove-storage-vm is enough for that. This is likely to be problematic, see above bugs. If you don't need to keep the VMs up, it's probably safer to just take all of them down, pass also --he-remove-hosts, and then, in the new engine, add back the hosts. Or even: Install a new engine, do not restore the backup, add the hosts, and import the storage domains. > 5. after retore has completed, run engine-setup > > > > Or are there any additional steps I need to take? I have tried this in my > one lab environment, and it works without any issues, however when trying > this on my second lab environment, everything shows as “down”, ie. Hosts, > Data Center and Storage Domains. > No idea why they are down. Check engine.log. How long did you wait? Did the engine have access to the hosts? Can you manually ssh to them from the engine machine? Best regards, -- Didi

2 1

locked snapshot after snapshot preview
by Jiří Sléžka 20 May '20

20 May '20

Hi, Ovirt 4.3.9.4-1.el7, CentOS7... colleague of me tried yesterday do a snapshot preview on his vm but operation got stalled. I can see in Task list in Manager operation "Preview VM Snapshot před AD test of VM install_W10_LTSC-REK" in state Finalizing (6 hours ago) In the Events I see May 19, 2020, 4:00:17 PM Failed to complete Snapshot-Preview před AD test for VM install_W10_LTSC-REK. 18acb86e-581c-43f5-bf99-f8d738870976 May 19, 2020, 3:57:40 PM Failed to run VM install_W10_LTSC-REK due to a failed validation: [Cannot run VM. The VM is performing an operation on a Snapshot. Please wait for the operation to finish, and try again.] (User: ******@*********). d892b7dd-741b-4c61-ac37-b1077eaeaf79 When I grepping correlation id from failed run from engine log a got zcat /var/log/ovirt-engine/engine.log-20200520.gz | grep "d892b7dd-741b-4c61-ac37-b1077eaeaf79" 2020-05-19 15:57:40,435+02 INFO [org.ovirt.engine.core.bll.RunVmCommand] (default task-210) [d892b7dd-741b-4c61-ac37-b1077eaeaf79] Lock Acquired to object 'EngineLock:{exclusiveLocks='[2f1fb183-55ea-477c-a75b-625f889e4c79=VM]', sharedLocks=''}' 2020-05-19 15:57:40,489+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-210) [d892b7dd-741b-4c61-ac37-b1077eaeaf79] EVENT_ID: USER_FAILED_RUN_VM(54), Failed to run VM install_W10_LTSC-REK due to a failed validation: [Cannot run VM. The VM is performing an operation on a Snapshot. Please wait for the operation to finish, and try again.] (User: kra0002(a)CRO.slu.cz) 2020-05-19 15:57:40,489+02 WARN [org.ovirt.engine.core.bll.RunVmCommand] (default task-210) [d892b7dd-741b-4c61-ac37-b1077eaeaf79] Validation of action 'RunVm' failed for user kra0002(a)CRO.slu.cz. Reasons: VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IS_DURING_SNAPSHOT 2020-05-19 15:57:40,489+02 INFO [org.ovirt.engine.core.bll.RunVmCommand] (default task-210) [d892b7dd-741b-4c61-ac37-b1077eaeaf79] Lock freed to object 'EngineLock:{exclusiveLocks='[2f1fb183-55ea-477c-a75b-625f889e4c79=VM]', sharedLocks=''}' greping correlation id on failed snapshot preview shows only INFO events, not ERRORS nor WARNINGS and it looks to me like everything was FINISHed When I try to display locked entities a got cd /usr/share/ovirt-engine/setup/dbutils ./unlock_entity.sh -q -t all -c Locked VMs vm_name | snapshot_id ----------------------+-------------------------------------- install_W10_LTSC-REK | 9d53c7b4-8ec5-4d31-8ab1-16bb75ab8f2b Locked templates template_name | disk_id ---------------+--------- Locked disks vm_id | disk_id --------------------------------------+-------------------------------------- 2f1fb183-55ea-477c-a75b-625f889e4c79 | 707db1f6-0859-48ab-b9d0-a97619ed8b0b Locked snapshots vm_id | snapshot_id --------------------------------------+-------------------------------------- 2f1fb183-55ea-477c-a75b-625f889e4c79 | 9d53c7b4-8ec5-4d31-8ab1-16bb75ab8f2b Illegal images vm_name | image_guid ---------+------------ I am about to try unlock that snapshot but for sure... * how can I be sure that snapshot operations is not still running (it would be nice to have some sort of progress bar o better reporting what is happening in Manager...) * looks it like bug? Should I fill bugreport or publish more logs? Cheers, Jiri

2 1

Host "Unassigned Logical Networks" list is wrong
by Matthias Leopold 20 May '20

20 May '20

Hi, I'm having a special issue with assigning logical networks to host interfaces via label. I'm used to assigning logical networks (tagged VLANs, VM network flag) a "Network label", which I can choose from a drop down menu in the UI dialog. These networks are automatically flagged "assign" and "require" in my cluster and I expect them to be synced to hosts physical interface to which I "drag and dropped" the label. This always seemed to work and I never worried. Now I noticed that when I look at the host "Setup Host Networks" dialog again, that the last(?) logical networks I provisioned as explained above show up as "Unassigned Logical Networks" with a mouse over text of "Network should be assigned to 'foo' via label 'bar'. However for some reason it isn't". This has to be some presentation error, because the networks are in fact assigned which is also visible in the hosts "Network Interfaces" tab. The "Sync All Network" buttons in "Host" - "Network Interfaces" and "Cluster" - "Logical Networks" tabs are inactive. When hosts are put to maintenance and activated again the error disappears. My oVirt version is 4.3.7. Cluster switch type is "Linux Bridge". This may seem a minor error, but since it affects my production clusters and a couple of VLANs I can't afford to play around with host network configuration. Can anybody explain this? Any help would be appreciated. thx Matthias

2 2

[Feedback needed] oVirt 4.4.0 Test week
by Sandro Bonazzola 19 May '20

19 May '20

Hi, oVirt team is planning to release oVirt 4.4.0 Ga in the next couple of weeks. oVirt 4.4.0 release candidate was released yesterday and we'd like to gather as much feedback as possible. Please join us testing this release candidate next week, starting Sunday May 10th 2020 till Friday May 15th 2020! We are going to coordinate the testing effort with a public Trello board at https://trello.com/b/5ZNJgPC3/ovirt-440-test-day You'll find instructions on how to use the board there. For joining the board you can use this link: https://trello.com/invite/b/5ZNJgPC3/f1b1826ee4902f348c44607765a15099/ovirt… If you have not an environment dedicated to testing, remember you can set up a few VMs and test the deployment with nested virtualization using your production environment creating a virtual test environment. In this case please be careful avoiding touching the production environment from the testing one. The oVirt team will monitor the Trello board, the #ovirt IRC channel on irc.oftc.net server and the users(a)ovirt.org mailing list to assist with the testing and debugging issues. Basic instructions for setting up a minimal system are available in release candidate announce at: https://lists.ovirt.org/archives/list/announce@ovirt.org/message/3QORBKVKTA… Release notes for this release candidate are available here: https://ovirt.org/release/4.4.0/ Thanks -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

7 14

HostedEngine add more RAM
by Joseph Goldman 19 May '20

19 May '20

Hi List, I'm having troubles adding more RAM to my HostedEngine VM. When the cluster first got up and running I only had a little bit of RAM so I only gave the HE 4GB, but i'm constantly getting BadHealth alerts so I want to up it to 8GB. I have tried multiple ways - mostly any time i edit the HE VM through the UI it simply reverts back to 4096MB RAM, never upgrades to 8192MB. I have tried with global HA maintenance on as well but no luck. No errors, it saves as if it has completed the action but when I re-open the VM (or even after a fresh boot) it has simply reverted back to 4096MB. Any help appreciated. Thanks, Joe

3 5

Re: Migrate hosted engine to standalone host
by Anton Louw 18 May '20

18 May '20

Hello, I am not sure if the below thread went missing somewhere. Just to add on as well, when moving the hosted engine to a standalone host, will the process look similar to the below: Backup and remove Hosted Engine: 1. Backup Hosted Engine (engine-backup --scope=all --mode=backup --file=Full --log=Log_Full) 2. Download the backup files from HE using WinSCP 3. Enable global Maintenance (hosted-engine --set-maintenance --mode=global) 4. Power down hosted engine (hosted-engine --vm-shutdown) --------------------------------------------------------------------------------------------- Redeploy Hosted Engine: Build new CentOS VM in another environment *Same IP *Same name *Same resources 1. sudo yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release43.rpm 2. sudo yum install -y ovirt-engine 3. Copy backup files to newly deployed CentOS VM 4. engine-backup --mode=restore --file=Full --log=Log_Full --provision-db --provision-dwh-db --restore-permissions 5. after retore has completed, run engine-setup Or are there any additional steps I need to take? I have tried this in my one lab environment, and it works without any issues, however when trying this on my second lab environment, everything shows as “down”, ie. Hosts, Data Center and Storage Domains. Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za From: Anton Louw via Users <users(a)ovirt.org> Sent: 14 May 2020 14:49 To: users(a)ovirt.org Subject: [ovirt-users] Migrate hosted engine to standalone host Hi All, So I have been playing around a bit, and I would just like some recommendations. I moved my HE from an oVirt node to my VMware environment, basically running as a standalone host now. Is there anything I should look out for? I can see there is a problem when configuring the HE after the move, where it says that global maintenance is not enabled. How will this work if the hosted engine is not sitting on a oVirt node anymore? Any feedback\suggestions will be greatly appreciated. Thanks Anton Louw Cloud Engineer: Storage and Virtualization at Vox ________________________________ T: 087 805 0000 | D: 087 805 1572 M: N/A E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg www.vox.co.za<http://www.vox.co.za> [F]<https://www.facebook.com/voxtelecomZA> [T]<https://www.twitter.com/voxtelecom> [I]<https://www.instagram.com/voxtelecomza> [L]<https://www.linkedin.com/company/voxtelecom> [Y]<https://www.youtube.com/user/VoxTelecom> [#VoxBrand]<https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> Disclaimer The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here<https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>.

1 0

Convert unmanaged Gluster to managed one
by Николаев Алексей 16 May '20

16 May '20

2 1

ovirt-node-ng-installer-4.4.0-2020051507.el8.iso does not support PREC5 raid controller ?
by bjkelley＠us.ibm.com 16 May '20

16 May '20

Trying to use my dell 2850 as ovirt node the install does not show the raid0 disk pair that ovirt-node-4.3.9 was able to use as install destination. The Installer shows no disk at all in system it has 6 seen by 4.3.9. Thanks Bryan

4 4

oVirt 4.4 new VM cannot be created in the datacenter other than Default?
by bjkelley＠us.ibm.com 16 May '20

16 May '20

So after setup of new DC and Storage and Host at 4.3 as the CPU technology is lower than the Hosted-Engine machine. when I try and create a VM the only DC choice is the Default one. Is this Normal or issue with 4.4? Thanks Bryan

2 1

Bridge not forwarding frames on node.
by s.danzi 15 May '20

15 May '20

Hi to all!I'm having an issue with networks bridges on ovirt node.It's look like this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1279161On VM I have a bridge between a tap device and network interface. On node side the interface is bridged with bond0 vlan 128 (bond0.128 lacp).When I ping an host on the other side of tap device I can see this:Arp request goes from my lan to the tap device on vm. Arp reply return from tap vm and bridge forward this to vm networks interface. Using tcpdump on vm interface on node I can see the arp reply, using tcpdump on bond0.128 or on bridge I can't see the arp reply. Arp request is forwarded from bond0.128 to vm net but arp reply isn't forwarded from vm net to bond0.128. Very strange.....

5 11

Glance disk images credentials oVirt4.4
by bjkelley＠us.ibm.com 15 May '20

15 May '20

So if I use this to build a VM and I setup Cloud_init to set user id and passwords. should I not be able to login to the VM from Console? Bryan

2 1

[ANN] oVirt 4.4.0 Second Release Candidate is now available for testing
by Lev Veyde 15 May '20

15 May '20

oVirt 4.4.0 Second Release Candidate is now available for testing The oVirt Project is excited to announce the availability of oVirt 4.4.0 Second Release Candidate for testing, as of May 15th, 2020 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses hundreds of individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics on top of oVirt 4.3. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not to be used in production. Some of the features included in oVirt 4.4.0 Release Candidate require content that will be available in CentOS Linux 8.2 but can’t be tested on RHEL 8.2 beta yet due to some incompatibility in openvswitch package shipped in CentOS Virt SIG which requires to rebuild openvswitch on top of CentOS 8.2. Installation instructions For the engine: either use appliance or: - Install CentOS Linux 8 minimal from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 389-ds - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… ; select minimal installation - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - Attach the host to engine and let it be deployed. What’s new in oVirt 4.4.0? - Hypervisors based on CentOS Linux 8 (rebuilt from award winning RHEL8), for both oVirt Node and standalone CentOS Linux hosts - Easier network management and configuration flexibility with NetworkManager - VMs based on a more modern Q35 chipset with legacy seabios and UEFI firmware - Support for direct passthrough of local host disks to VMs - Live migration improvements for High Performance guests. - New Windows Guest tools installer based on WiX framework now moved to VirtioWin project - Dropped support for cluster level prior to 4.2 - Dropped SDK3 support - 4K disks support - Exporting a VM to a data domain - Editing of floating disks - Integrating ansible-runner into engine, which allows a more detailed monitoring of playbooks executed from engine - Adding/reinstalling hosts are now completely based on Ansible - The OpenStack Neutron Agent cannot be configured by oVirt anymore, it should be configured by TripleO instead This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 or newer * CentOS Linux (or similar) 8.1 or newer * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.0 release highlights: http://www.ovirt.org/release/4.4.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.0/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

POWER9 Support: VDSM requiring LVM2 package that's missing
by Vinícius Ferrão 15 May '20

15 May '20

Hello, I would like to know if this is a bug or not, if yes I will submit to Red Hat. I’m trying to add a ppc64le (POWER9) machine to the hosts pool, but there’s missing dependencies on VDSM: --> Processing Dependency: lvm2 >= 7:2.02.186-7.el7_8.1 for package: vdsm-4.30.44-1.el7ev.ppc64le --> Finished Dependency Resolution Error: Package: vdsm-4.30.44-1.el7ev.ppc64le (rhel-7-server-rhv-4-mgmt-agent-for-power-9-rpms) Requires: lvm2 >= 7:2.02.186-7.el7_8.1 Available: 7:lvm2-2.02.171-8.el7.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.171-8.el7 Available: 7:lvm2-2.02.177-4.el7.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.177-4.el7 Available: 7:lvm2-2.02.180-8.el7.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-8.el7 Available: 7:lvm2-2.02.180-10.el7_6.1.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.1 Available: 7:lvm2-2.02.180-10.el7_6.2.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.2 Available: 7:lvm2-2.02.180-10.el7_6.3.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.3 Available: 7:lvm2-2.02.180-10.el7_6.7.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.7 Available: 7:lvm2-2.02.180-10.el7_6.8.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.8 Installing: 7:lvm2-2.02.180-10.el7_6.9.ppc64le (rhel-7-for-power-9-rpms) lvm2 = 7:2.02.180-10.el7_6.9 Thanks,

2 3

[ANN] oVirt 4.3.10 Fourth Release Candidate is now available for testing
by Lev Veyde 14 May '20

14 May '20

The oVirt Project is pleased to announce the availability of oVirt 4.3.10 Fourth Release Candidate for testing as of May 14th, 2020. This update is the tenth in a series of stabilization updates to the 4.3 series. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) * oVirt Node 4.3 (available for x86_64 only) See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] Additional Resources: * Read more about the oVirt 4.3.10 release highlights: http://www.ovirt.org/release/4.3.10/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.10/ [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

Migrate hosted engine to standalone host
by Anton Louw 14 May '20

14 May '20

Hi All, So I have been playing around a bit, and I would just like some recommendations. I moved my HE from an oVirt node to my VMware environment, basically running as a standalone host now. Is there anything I should look out for? I can see there is a problem when configuring the HE after the move, where it says that global maintenance is not enabled. How will this work if the hosted engine is not sitting on a oVirt node anymore? Any feedback\suggestions will be greatly appreciated. Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

Unable to connect to cockpit
by Parth Dhanjal 14 May '20

14 May '20

Hey! I have a remote machine on which I have installed RHVH4.4 I'm unable to access the cockpit-plugin. journalctl -u cockpit returns this error cockpit-tls: gnutls_handshake failed: A TLS fatal alert has been received. Screenshot while trying to reach cockpit through the browser attached. Is anyone else facing this issue as well? And does anyone has a solution/workaround to this?

6 7

Networking documentation
by s.danzi 14 May '20

14 May '20

Hello!In this page https://www.ovirt.org/documentation/admin-guide/chap-Logical_Networks.html there are a link to https://www.ovirt.org/documentation/admin-guide/Marking_vNIC_as_Passthrough that does not work. Does anyone have the correct link?

2 1

Can't add freshly installed node.. host has no default route
by Giorgio Biacchi 13 May '20

13 May '20

Hi list, I've spent a couple of days trying to understand why this was happening... For the installation I have a well tested installation server with a custom kickstart file to setup ssh keys and custom hooks for infiniband and I'm installing Ovirt Node 4.3.9 via pxe, this is particularly useful when I have to install a bunch of blades at once.. In the past I had no issues and all was working like a charm until now when some hardware failed and I had to replace it. As expected I have no issues in the node installation process.. the troubles begins when I try to add the node, installation fails and in the UI I have an exclamation mark with the message "Host has no default route." but I can ping and do ssh to the host from the manager.. the problem is somewhere else in the communication between the engine and vdsmd preventing the engine to refresh the host capabilities. So from the engine I tried: [root@manager ~]# openssl s_client -connect 172.20.22.78:54321 CONNECTED(00000003) --- Certificate chain 0 s:/CN=cn128.lagrange.di.unimi.it/O=VDSM Certificate i:/CN=VDSM Certificate Authority 1 s:/CN=VDSM Certificate Authority i:/CN=VDSM Certificate Authority --- The host has still the self signed vdsm certificate.. and on the host in vdsm.log I find: 2020-05-11 09:52:25,433+0000 ERROR (Reactor thread) [ProtocolDetector.SSLHandshakeDispatcher] ssl handshake: SSLError, address: ::ffff:159.149.129.220 (sslutils:264) So I tried to enroll the certificate from the UI and from the events tab I sow the enrolling was successful but: [root@manager ~]# openssl s_client -connect 172.20.22.78:54321 140084336994192:error:140790E5:SSL routines:ssl23_write:ssl handshake failure:s23_lib.c:177: CONNECTED(00000003) --- no peer certificate available --- there's still some issue with the certificates.. so on the host again: [root@cn128 vdsm]# find /etc/pki/vdsm/ -type f -cmin -10| xargs ls -l -rw-------. 1 root kvm 1424 May 11 09:56 /etc/pki/vdsm/certs/cacert.pem -rw-------. 1 root kvm 5108 May 11 09:57 /etc/pki/vdsm/certs/vdsmcert.pem -r--r-----. 1 root kvm 1704 May 11 09:56 /etc/pki/vdsm/keys/vdsmkey.pem -rw-r--r--. 1 root root 1424 May 11 09:57 /etc/pki/vdsm/libvirt-spice/ca-cert.pem -rw-r--r--. 1 root root 5108 May 11 09:57 /etc/pki/vdsm/libvirt-spice/server-cert.pem -r--r-----. 1 root root 1704 May 11 09:56 /etc/pki/vdsm/libvirt-spice/server-key.pem It seems that cacert.pem and vdsmcert.pem have wrong permissions.. let's try to fix it.. [root@cn128 vdsm]# chown 36:36 /etc/pki/vdsm/certs/cacert.pem /etc/pki/vdsm/certs/vdsmcert.pem And now: [root@manager ~]# openssl s_client -connect 172.20.22.78:54321| less CONNECTED(00000003) --- Certificate chain 0 s:/O=lagrange.di.unimi.it/CN=172.20.22.78 i:/C=US/O=lagrange.di.unimi.it/CN=cn305.lagrange.di.unimi.it.35941 1 s:/C=US/O=lagrange.di.unimi.it/CN=cn305.lagrange.di.unimi.it.35941 i:/C=US/O=lagrange.di.unimi.it/CN=cn305.lagrange.di.unimi.it.35941 --- Now I can finally refresh the host capabilities and setup the host networks.. In attachment all the relevant logs, I don't know if I've found some bug.. this is the first time i had so many troubles adding a new host.. so I decided to share my experience with the list.. Cheers -- gb PGP Key: http://pgp.mit.edu/ Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34

5 12

Any official support list of SAS RAID controller?
by hkexdong＠yahoo.com.hk 13 May '20

13 May '20

I am not going to use those servers from HP, IBM, etc. My computer is desktop level and plan to insert a PCI-E SAS RAID controller card, that use to connect to an external SAN storage (https://www.areca.com.tw/products/storage-8042.html) I afraid I might buy the wrong RAID card that oVirt can't recognize. Is there any official support list of SAS RAID controller?

2 2

he_gluster_vars.json for HCI deployment ovirt 4.3.x
by adrianquintero＠gmail.com 13 May '20

13 May '20

Hello, I am trying to find all the possible variables that can be passed inside /etc/ansible/roles/gluste.ansible/playbooks/hc-ansible-deployment/he_gluster_vars.json for an Hyperconverged deployment. RHHI 1.6/1.7 only offers a limited list thank you, Adrian

1 1

Re: ovirt, SATA for VM Disks
by Michal Skrivanek 12 May '20

12 May '20

> On 12 May 2020, at 17:09, kubuntu70(a)gmail.com wrote: > > is it possible to change the Interface to SATA? (like KVM) yes. SATA is used with q35 VMs (default in 4.4)

2 1

Re: 503 Service Unavailable
by Yedidyah Bar David 12 May '20

12 May '20

On Tue, May 12, 2020 at 11:02 AM Anton Louw <Anton.Louw(a)voxtelecom.co.za> wrote: > > > > Apologies, for got to add the below in the previous mail. > > > > I do see a few of these “Bad Gateway” errors in the engine.log as well, not sure what this means though: > > > > [root@virt ovirt-engine]# tail -f engine.log > > 2020-05-12 09:48:03,941+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [52bf537e] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' > > 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1, 5 threads waiting for tasks. > > 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engine' is using 0 threads out of 500, 16 threads waiting for tasks and 0 tasks in queue. > > 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100, 100 threads waiting for tasks. > > 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads waiting for tasks. > > 2020-05-12 09:53:00,274+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads waiting for tasks. > > 2020-05-12 09:53:03,951+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' > > 2020-05-12 09:53:03,959+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Running command: SyncNetworkProviderCommand internal: true. > > 2020-05-12 09:53:04,018+02 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: EngineException: (Failed with error Bad Gateway and code 5050) > > 2020-05-12 09:53:04,019+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' > > 2020-05-12 09:58:04,028+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Lock Acquired to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' > > 2020-05-12 09:58:04,036+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Running command: SyncNetworkProviderCommand internal: true. > > 2020-05-12 09:58:04,327+02 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: EngineException: (Failed with error Bad Gateway and code 5050) > > 2020-05-12 09:58:04,328+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' > > > > > Anton Louw > Cloud Engineer: Storage and Virtualization at Vox > ________________________________ > T: 087 805 0000 | D: 087 805 1572 > M: N/A > E: anton.louw(a)voxtelecom.co.za > A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > > > > > From: Anton Louw > Sent: 12 May 2020 10:00 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org > Subject: RE: [ovirt-users] 503 Service Unavailable > > > > Thanks for the reply Didi. > > > > I have checked the logs, but it does not seem to show anything when I try and access the WebUI. I run tail -f engine.log and tail -f server.log, but it remains still. This is the same case with the httpd logs. If you don't see anything in any of the httpd logs, it means the request that your browser sent didn't arrive to httpd. Perhaps indeed you have some networking issue? Can you ping/ssh/etc from inside the engine some machine outside (other than the host it's on)? The other way around - from the engine vm to outside? If not, you should first fix that. That said, I'd not expect a 503 in that case, but a timeout on your browser. So either you didn't check the right log file (or there is some other problem, such as full disk, iptables, whatever) or some other machine returns you 503. You can also check with a sniffer (tcpdump) on the engine machine to see if it gets traffic, e.g. tcpdump -i any port 80 or port 443 > > > > I checked the status of the engine from my node, and it displays the below: > > > > [root@jb2-client-node01 ~]# hosted-engine --vm-status > > > > > > !! Cluster is in GLOBAL MAINTENANCE mode !! > > > > > > > > --== Host jb2-client-node01.kvm.voxvm.co.za (id: 1) status ==-- > > > > conf_on_shared_storage : True > > Status up-to-date : True > > Hostname : jb2-client-node01.kvm.voxvm.co.za > > Host ID : 1 > > Engine status : {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"} I am not sure the HA services show something different for "Can't connect to the engine at all" vs "Health page didn't say it's healthy". > > Score : 3400 > > stopped : False > > Local maintenance : False > > crc32 : 75d3e273 > > local_conf_timestamp : 3547513 > > Host timestamp : 3547513 > > Extra metadata (valid at timestamp): > > metadata_parse_version=1 > > metadata_feature_version=1 > > timestamp=3547513 (Tue May 12 09:43:29 2020) > > host-id=1 > > score=3400 > > vm_conf_refresh_time=3547513 (Tue May 12 09:43:29 2020) > > conf_on_shared_storage=True > > maintenance=False > > state=GlobalMaintenance > > stopped=False > > > > Everything network related seems to run fine, I can connect to the engine via ssh etc. as well. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Sent: 12 May 2020 09:26 > To: Anton Louw <Anton.Louw(a)voxtelecom.co.za> > Cc: users(a)ovirt.org > Subject: Re: [ovirt-users] 503 Service Unavailable > > > > On Tue, May 12, 2020 at 9:53 AM Anton Louw via Users <users(a)ovirt.org> wrote: > > > > > > > > Hi All, > > > > > > > > So due to some bad decisions etc. I have accidently removed the hosted engine setup by running engine-cleanup. I initially just wanted to remove the websocket proxy, and as advised by an article, this can be done by running engine-cleanup. Obviously this was not the case, and it removed everything. > > Not necessarily everything, but even if you ask to remove only > something specific, it does more than that. We recently decided this > is too risky and removed that question: > > https://bugzilla.redhat.com/show_bug.cgi?id=1792874 > > > > > > > > > I at least had a backup that I took, so I restored the backup to the engine, and ran engine-setup. Everything runs fine, but when I try and access the webUI, I get an error: “503 Service Unavailable” “No server is available to handle this request” > > > > > > > > I have checked the ovirt-engine service, and it is running, as well as the httpd service. > > > > > > > > I have also attached the engine log as well as the server log. > > 1. When attaching complete logs (thanks for that!), please state the > exact time you tried > to do something that failed (access the web ui, in this case). Your > attached logs have > several different ERRORs, which might be due to unrelated things, and > it's hard to tell > where to look first. Once found, going backwards to try to find the > root cause is usually > easier. > > 2. Please check/share also httpd logs, and also /etc/httpd/conf.d - > you can compare it > with a fresh engine you can setup on some test vm somewhere, it should > be mostly the > same. > > 3. Also please check/share engine-setup logs, at > /var/log/ovirt-engine/setup. You can search > there for httpd or apache. > > 4. I have a feeling, just a guess, that you are missing > /etc/httpd/conf.d/z-ovirt-engine-proxy.conf . > Not sure what might have caused that. setup after cleanup should have > created it. > > Best regards, > > > > > > > > > Does anybody have any idea where I can check, or perhaps I missed something. > > > > > > > > Thank you > > > > > > Anton Louw > > Cloud Engineer: Storage and Virtualization at Vox > > ________________________________ > > T: 087 805 0000 | D: 087 805 1572 > > M: N/A > > E: anton.louw(a)voxtelecom.co.za > > A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > > www.vox.co.za > > > > > > > > > > > > > > > > > > Disclaimer > > > > The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. > > > > This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here. > > > > > > > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/FDUEFMIUCOMC4… > > > > -- > Didi > > -- Didi

2 1

Re: 503 Service Unavailable
by Anton Louw 12 May '20

12 May '20

Apologies, for got to add the below in the previous mail. I do see a few of these “Bad Gateway” errors in the engine.log as well, not sure what this means though: [root@virt ovirt-engine]# tail -f engine.log 2020-05-12 09:48:03,941+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [52bf537e] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1, 5 threads waiting for tasks. 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engine' is using 0 threads out of 500, 16 threads waiting for tasks and 0 tasks in queue. 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100, 100 threads waiting for tasks. 2020-05-12 09:53:00,273+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1, 0 threads waiting for tasks. 2020-05-12 09:53:00,274+02 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'hostUpdatesChecker' is using 0 threads out of 5, 2 threads waiting for tasks. 2020-05-12 09:53:03,951+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' 2020-05-12 09:53:03,959+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Running command: SyncNetworkProviderCommand internal: true. 2020-05-12 09:53:04,018+02 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: EngineException: (Failed with error Bad Gateway and code 5050) 2020-05-12 09:53:04,019+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [3546d22f] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' 2020-05-12 09:58:04,028+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Lock Acquired to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' 2020-05-12 09:58:04,036+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Running command: SyncNetworkProviderCommand internal: true. 2020-05-12 09:58:04,327+02 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: EngineException: (Failed with error Bad Gateway and code 5050) 2020-05-12 09:58:04,328+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-64) [476ee6aa] Lock freed to object 'EngineLock:{exclusiveLocks='[44725bec-4d4a-496d-bd05-97eff7996a61=PROVIDER]', sharedLocks=''}' From: Anton Louw Sent: 12 May 2020 10:00 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org Subject: RE: [ovirt-users] 503 Service Unavailable Thanks for the reply Didi. I have checked the logs, but it does not seem to show anything when I try and access the WebUI. I run tail -f engine.log and tail -f server.log, but it remains still. This is the same case with the httpd logs. I checked the status of the engine from my node, and it displays the below: [root@jb2-client-node01 ~]# hosted-engine --vm-status !! Cluster is in GLOBAL MAINTENANCE mode !! --== Host jb2-client-node01.kvm.voxvm.co.za (id: 1) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : jb2-client-node01.kvm.voxvm.co.za Host ID : 1 Engine status : {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"} Score : 3400 stopped : False Local maintenance : False crc32 : 75d3e273 local_conf_timestamp : 3547513 Host timestamp : 3547513 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=3547513 (Tue May 12 09:43:29 2020) host-id=1 score=3400 vm_conf_refresh_time=3547513 (Tue May 12 09:43:29 2020) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False Everything network related seems to run fine, I can connect to the engine via ssh etc. as well. From: Yedidyah Bar David <didi(a)redhat.com<mailto:didi@redhat.com>> Sent: 12 May 2020 09:26 To: Anton Louw <Anton.Louw(a)voxtelecom.co.za<mailto:Anton.Louw@voxtelecom.co.za>> Cc: users(a)ovirt.org<mailto:users@ovirt.org> Subject: Re: [ovirt-users] 503 Service Unavailable On Tue, May 12, 2020 at 9:53 AM Anton Louw via Users <users(a)ovirt.org<mailto:users@ovirt.org>> wrote: > > > > Hi All, > > > > So due to some bad decisions etc. I have accidently removed the hosted engine setup by running engine-cleanup. I initially just wanted to remove the websocket proxy, and as advised by an article, this can be done by running engine-cleanup. Obviously this was not the case, and it removed everything. Not necessarily everything, but even if you ask to remove only something specific, it does more than that. We recently decided this is too risky and removed that question: https://bugzilla.redhat.com/show_bug.cgi?id=1792874<https://bugzilla.redhat.com/show_bug.cgi?id=1792874> > > > > I at least had a backup that I took, so I restored the backup to the engine, and ran engine-setup. Everything runs fine, but when I try and access the webUI, I get an error: “503 Service Unavailable” “No server is available to handle this request” > > > > I have checked the ovirt-engine service, and it is running, as well as the httpd service. > > > > I have also attached the engine log as well as the server log. 1. When attaching complete logs (thanks for that!), please state the exact time you tried to do something that failed (access the web ui, in this case). Your attached logs have several different ERRORs, which might be due to unrelated things, and it's hard to tell where to look first. Once found, going backwards to try to find the root cause is usually easier. 2. Please check/share also httpd logs, and also /etc/httpd/conf.d - you can compare it with a fresh engine you can setup on some test vm somewhere, it should be mostly the same. 3. Also please check/share engine-setup logs, at /var/log/ovirt-engine/setup. You can search there for httpd or apache. 4. I have a feeling, just a guess, that you are missing /etc/httpd/conf.d/z-ovirt-engine-proxy.conf . Not sure what might have caused that. setup after cleanup should have created it. Best regards, > > > > Does anybody have any idea where I can check, or perhaps I missed something. > > > > Thank you > > > Anton Louw > Cloud Engineer: Storage and Virtualization at Vox > ________________________________ > T: 087 805 0000 | D: 087 805 1572 > M: N/A > E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> > A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za<http://www.vox.co.za> > > > > > > > > > Disclaimer > > The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here. > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> > To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> > Privacy Statement: https://www.ovirt.org/privacy-policy.html<https://www.ovirt.org/privacy-policy.html> > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/<https://www.ovirt.org/community/about/community-guidelines> > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/FDUEFMIUCOMC4…<https://lists.ovirt.org/archives/list/users@ovirt.org/message/FDUEFMIUCOMC4…> -- Didi Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

Re: 503 Service Unavailable
by Yedidyah Bar David 12 May '20

12 May '20

On Tue, May 12, 2020 at 9:53 AM Anton Louw via Users <users(a)ovirt.org> wrote: > > > > Hi All, > > > > So due to some bad decisions etc. I have accidently removed the hosted engine setup by running engine-cleanup. I initially just wanted to remove the websocket proxy, and as advised by an article, this can be done by running engine-cleanup. Obviously this was not the case, and it removed everything. Not necessarily everything, but even if you ask to remove only something specific, it does more than that. We recently decided this is too risky and removed that question: https://bugzilla.redhat.com/show_bug.cgi?id=1792874 > > > > I at least had a backup that I took, so I restored the backup to the engine, and ran engine-setup. Everything runs fine, but when I try and access the webUI, I get an error: “503 Service Unavailable” “No server is available to handle this request” > > > > I have checked the ovirt-engine service, and it is running, as well as the httpd service. > > > > I have also attached the engine log as well as the server log. 1. When attaching complete logs (thanks for that!), please state the exact time you tried to do something that failed (access the web ui, in this case). Your attached logs have several different ERRORs, which might be due to unrelated things, and it's hard to tell where to look first. Once found, going backwards to try to find the root cause is usually easier. 2. Please check/share also httpd logs, and also /etc/httpd/conf.d - you can compare it with a fresh engine you can setup on some test vm somewhere, it should be mostly the same. 3. Also please check/share engine-setup logs, at /var/log/ovirt-engine/setup. You can search there for httpd or apache. 4. I have a feeling, just a guess, that you are missing /etc/httpd/conf.d/z-ovirt-engine-proxy.conf . Not sure what might have caused that. setup after cleanup should have created it. Best regards, > > > > Does anybody have any idea where I can check, or perhaps I missed something. > > > > Thank you > > > Anton Louw > Cloud Engineer: Storage and Virtualization at Vox > ________________________________ > T: 087 805 0000 | D: 087 805 1572 > M: N/A > E: anton.louw(a)voxtelecom.co.za > A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > > > > > > Disclaimer > > The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here. > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/FDUEFMIUCOMC4… -- Didi

2 1

503 Service Unavailable
by Anton Louw 12 May '20

12 May '20

Hi All, So due to some bad decisions etc. I have accidently removed the hosted engine setup by running engine-cleanup. I initially just wanted to remove the websocket proxy, and as advised by an article, this can be done by running engine-cleanup. Obviously this was not the case, and it removed everything. I at least had a backup that I took, so I restored the backup to the engine, and ran engine-setup. Everything runs fine, but when I try and access the webUI, I get an error: "503 Service Unavailable" "No server is available to handle this request" I have checked the ovirt-engine service, and it is running, as well as the httpd service. I have also attached the engine log as well as the server log. Does anybody have any idea where I can check, or perhaps I missed something. Thank you Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

oVirt engine / node & snmp
by Andrei Verovski 12 May '20

12 May '20

Hi, oVirt node seems to run snmp by defeult, “service snmpd status” returns some data. I’m going to connect all servers to LibreNMS, and it requires custom snmp options. What options I should keep in oVirt node default nsmp.conf? Or I may just fully overwrite this file with my own? Please note my oVirt node installed manually on CentOS, I don’t use node DVD image from oVirt project. with best regards Thanks in advance. Andrei

2 1

Upgrade scenario to 4.4 for HCI Gluster
by Gianluca Cecchi 11 May '20

11 May '20

Hello, I saw from some mails in the list that the approach for upgrading from 4.3 to 4.4 will be similar to the 3.6 => 4.0 one. Reading the RHV 4.0 Self Hosted Engine Guide it seems it was necessary to have a second host, going through this: 5.4. Upgrading a RHEV-H-Based Self-Hosted Engine Environment https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.0/ht… and also https://www.ovirt.org/develop/release-management/features/sla/hosted-engine… upgrade process involved: - set global ha maintenance - install a new host (and set it as on hosted engine one) - migrate engine VM to this host and set the host as the SPM - create a backup with engine-backup, verify its contents and copy to the host in some directory - run the upgrade utility on the host to update the engine VM hosted-engine --upgrade-appliance this will create a backup floating disk of the engine vm disk for rollback purposes and override the existing engine disk with a new one where to deploy the new engine version applying also the restore from the engine-backup --> what are requirements for 4.4 engine VM and so free storage to have on engine storage domain? The engine-setup will be automatically executed on the new version engine VM - exit from global maintenance - update remaining hosts Is the above procedure the correct one that I can test on a 4.3.9 lab? The 3.6 -> 4.0 flow implied that a 4.0 host could run a 3.6 engine VM Because the backup disk operation is done by the current running engine itself. So it should be true also for 4.3 -> 4.4 and a 4.4. host should be able to run a 4.3 engine, correct? In case of single 4.3.9 ovirt-node-ng host HCI with Gluster, can I apply the upgrade in a similar way? Something like: - create engine-backup and copy over to the host - put host into global maintenace - shutdown all VMS, engine included - enable 4.4. repo - install new image-base 4.4 is this correct and I can use 4.3 and 4.4 image base versions or do I have to sort-of-scratch necessarily? because 4.3 host is based on el7 while 4.4 on el8... but perhaps on mage based system I have flexibility..? what version of gluster will it be applied? Incompatibilities with the current 4.3.9 one (version 6.8-1.el7) - reboot host - exit global maintenance and wait for engine vm to come up correctly - enter global maintenance again - run the upgrade utility on the host Or do I need at least temporarily a new server to use as the 4.4. host, or what will be the expected path? Thanks, Gianluca

2 3

ovirt 4.4 on Fedora 30
by kelley bryan 09 May '20

09 May '20

Hello everyone new test of 4.4 on Fedora 30: Prepare Vm fails with {"attempts": 10, "changed": false, "cmd": "dnf install -y python2-dnf", "msg": "Could not import the dnf python module using /usr/bin/python (2.7.18 (default, Apr 21 2020, 18:49:31) [GCC 9.3.1 20200408 (Red Hat 9.3.1-2)]). Please install `python2-dnf` package or ensure you have specified the correct ansible_python_interpreter.", "rc": 1, "results": [], "stderr": "Error: Unable to find a match: python2-dnf\n", "stderr_lines": ["Error: Unable to find a match: python2-dnf"], "stdout": "Last metadata expiration check: 2:38:48 ago on Fri 08 May 2020 12:16:25 PM MST.\nNo match for argument: python2-dnf\n", "stdout_lines": ["Last metadata expiration check: 2:38:48 ago on Fri 08 May 2020 12:16:25 PM MST.", "No match for argument: python2-dnf"]} Is this due to Fedora 30 being based on RH7?

2 2

ovirt 4.4 RC1 HCI single host problem unknown CPU feature: tsx-ctrl
by Gianluca Cecchi 08 May '20

08 May '20

Hello, I have this problem I posted for beta4 also with the RC1 installation: https://lists.ovirt.org/archives/list/users@ovirt.org/message/CR6XYIEYHT4N7… At final stage when engine VM has to start from hosted engine storage domain libvirt.libvirtError: unsupported configuration: unknown CPU feature: tsx-ctrl 2020-05-08 17:13:51,080+0200 INFO (vm/7194f9ff) [virt.vm] (vmId='7194f9ff-1d73-4a0d-987e-3e82060c2d99') Changed state to Down: unsupported configuration: unknown CPU feature: tsx-ctrl (code=1) (vm:1629) any hint on how to workaround and test on my nested environment? Thanks, Gianluca

2 2

centos 8 stream status
by Nathanaël Blanchet 08 May '20

08 May '20

Hello, Centos 8 stream should be the preview of centos 8, so why not using right now it instead of waiting GA 8.2? -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

3 2

Creating an Isolated/External Network
by dsullivan56＠fordham.edu 08 May '20

08 May '20

Hi all, Obligatory I'm not sure if this is the right place to post and obligatory I am very new here. I could really use some help. I'd like to build an isolated/external network so that I can build two VMs that need to interact with each other and each other alone while they are being built. I'd like to protect them from interacting with other VMs I have and I'd like to protect my other VMs from interacting with them. I attempt to create this network by going to Network > Networks > New, and I make sure to click the "create on external provider" checkbox and select "Disabled" under the "Network Port Security" drop-down menu. When I click "ok" I get the error message: "Error while executing this action: User is not authorized to perform this action". This isn't an issue, I just went to the super user and had him try the same thing, and he gets this error message: "Error while executing action AddNetworkOnProvider: Failed to communicate with the external provider, see logs for additional details". The oVirt log wasn't that helpful, as it just told me the time oVirt failed to create the network. Neither my super user nor I can figure out why this is happening. Would greatly appreciate any advice you can give me. Thanks!

2 1

Proxy setup for image repositories
by Gianluca Cecchi 08 May '20

08 May '20

Eg, for the default ovirt-image-repository storage domain, is it possible to setup a proxy server for access? Thanks Gianluca

2 1

ERROR [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand]
by Николаев Алексей 08 May '20

08 May '20

1 0

Re: Node Unresponsive
by Staniforth, Paul 07 May '20

07 May '20

Hi Anton, should be yum instead of dnf as it using centos7 Regards, Paul S. ________________________________ From: Anton Louw via Users <users(a)ovirt.org> Sent: 07 May 2020 15:22 To: Artur Socha <asocha(a)redhat.com>; users(a)ovirt.org <users(a)ovirt.org> Subject: [ovirt-users] Re: Node Unresponsive Caution External Mail: Do not click any links or open any attachments unless you trust the sender and know that the content is safe. Hi Artur, I tried running the dnf list --installed | egrep "ovirt|vdsm|jsonrpc" command, but that command is not found. I have attached the logs as requested. Thanks Anton Louw Cloud Engineer: Storage and Virtualization at Vox ________________________________ T: 087 805 0000 | D: 087 805 1572 M: N/A E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg www.vox.co.za<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.vox.co…> [F]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.faceb…> [T]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.twitt…> [I]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.insta…> [L]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linke…> [Y]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.youtu…> From: Artur Socha <asocha(a)redhat.com> Sent: 07 May 2020 15:55 To: Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org Subject: Re: [ovirt-users] Node Unresponsive On Thu, 2020-05-07 at 13:07 +0000, Anton Louw via Users wrote: Hi All, One of my nodes went into a unresponsive state, but the VMs running on that host are still up. I just want to know, can I restart VDSM on that node, or will it impact the running VMs? In another article, somebody restarted the engine, and that resolved their issue. I would like to first test the VDSM and if that does not work, I will restart the engine. Hi Anton, Would it be possible to post /var/log/vdsm.log from that affected host + relevant engine.log? I am currently investigating engine-to-host connectivity issue that may or may not be related [1]. What are the exact versions of engine and vdsm packages? ( dnf list --installed | egrep "ovirt|vdsm|jsonrpc" ) [1] https://bugzilla.redhat.com/show_bug.cgi?id=1828669<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugzilla.…> thanks! Artur Thanks Anton Louw Cloud Engineer: Storage and Virtualization at Vox ________________________________ T: 087 805 0000 | D: 087 805 1572 M: N/A E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg www.vox.co.za<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.vox.co…> [F]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.faceb…> [T]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.twitt…> [I]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.insta…> [L]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linke…> [Y]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.youtu…> [#VoxBrand]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.vox.c…> Disclaimer The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.voxte…>. _______________________________________________ Users mailing list -- <mailto:users@ovirt.org> users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to <mailto:users-leave@ovirt.org> users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> https://www.ovirt.org/privacy-policy.html<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> oVirt Code of Conduct: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> https://www.ovirt.org/community/about/community-guidelines/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> List Archives: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi…> https://lists.ovirt.org/archives/list/users@ovirt.org/message/2SDQ32OZPQ7KG…<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi…> To view the terms under which this email is distributed, please go to:- http://leedsbeckett.ac.uk/disclaimer/email/

1 0

Automatic reply: [Non-DoD Source] Re: Node Unresponsive
by Mangin, Samuel R CIV USN (USA) 07 May '20

07 May '20

Be it known that I no longer work for NAVOCEANO. I have transferred to the Air Force. If you need assistance please submit Ripken Ticket or call the Help Desk at x5122. V/r Sam

1 0

Re: Node Unresponsive
by Anton Louw 07 May '20

07 May '20

Oh I see, so just the service. Perfect, I will give that a bash as well. Just running through a couple more things. Thanks Paul Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za From: Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk> Sent: 07 May 2020 16:20 To: Artur Socha <asocha(a)redhat.com>; Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org Subject: Re: [ovirt-users] Re: Node Unresponsive Hi Anton, I wasn't considering the hosted-engine just in the engine VM systemctl restart ovirt-engine.service Regards, Paul S. ________________________________ From: Artur Socha <asocha(a)redhat.com<mailto:asocha@redhat.com>> Sent: 07 May 2020 14:54 To: Anton Louw <Anton.Louw(a)voxtelecom.co.za<mailto:Anton.Louw@voxtelecom.co.za>>; users(a)ovirt.org<mailto:users@ovirt.org> <users(a)ovirt.org<mailto:users@ovirt.org>> Subject: [ovirt-users] Re: Node Unresponsive Caution External Mail: Do not click any links or open any attachments unless you trust the sender and know that the content is safe. On Thu, 2020-05-07 at 13:07 +0000, Anton Louw via Users wrote: Hi All, One of my nodes went into a unresponsive state, but the VMs running on that host are still up. I just want to know, can I restart VDSM on that node, or will it impact the running VMs? In another article, somebody restarted the engine, and that resolved their issue. I would like to first test the VDSM and if that does not work, I will restart the engine. Hi Anton, Would it be possible to post /var/log/vdsm.log from that affected host + relevant engine.log? I am currently investigating engine-to-host connectivity issue that may or may not be related [1]. What are the exact versions of engine and vdsm packages? ( dnf list --installed | egrep "ovirt|vdsm|jsonrpc" ) [1] https://bugzilla.redhat.com/show_bug.cgi?id=1828669<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugzilla.…> thanks! Artur Thanks Anton Louw Cloud Engineer: Storage and Virtualization at Vox ________________________________ T: 087 805 0000 | D: 087 805 1572 M: N/A E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg www.vox.co.za<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.vox.co…> [F]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.faceb…> [T]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.twitt…> [I]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.insta…> [L]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linke…> [Y]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.youtu…> [#VoxBrand]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.vox.c…> Disclaimer The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.voxte…>. _______________________________________________ Users mailing list -- <mailto:users@ovirt.org> users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to <mailto:users-leave@ovirt.org> users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> https://www.ovirt.org/privacy-policy.html<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> oVirt Code of Conduct: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> https://www.ovirt.org/community/about/community-guidelines/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt…> List Archives: <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi…> https://lists.ovirt.org/archives/list/users@ovirt.org/message/2SDQ32OZPQ7KG…<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi…> To view the terms under which this email is distributed, please go to:- http://leedsbeckett.ac.uk/disclaimer/email/<http://leedsbeckett.ac.uk/disclaimer/email/>

1 0

Re: Node Unresponsive
by Artur Socha 07 May '20

07 May '20

On Thu, 2020-05-07 at 13:07 +0000, Anton Louw via Users wrote: > > > > Hi All, > > > > One of my nodes went into a unresponsive state, but the VMs running on that > host are still up. I just want to know, can I restart VDSM on that node, or > will it impact the running VMs? In another article, somebody restarted > the engine, and that resolved their issue. I would like to first test the > VDSM and if that does not work, I will restart the engine. > Hi Anton,Would it be possible to post /var/log/vdsm.log from that affected host + relevant engine.log? I am currently investigating engine-to-host connectivity issue that may or may not be related [1]. What are the exact versions of engine and vdsm packages? ( dnf list --installed | egrep "ovirt|vdsm|jsonrpc" ) [1] https://bugzilla.redhat.com/show_bug.cgi?id=1828669 thanks!Artur > > Thanks > > > > > > > > Anton Louw > > > Cloud Engineer: Storage and Virtualization at Vox > > > > > > > T: 087 805 0000 | D: 087 805 1572 > M: N/A > > E: anton.louw(a)voxtelecom.co.za > A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > > www.vox.co.za > > > > > > > > > > > > > > > > > > > > > > Disclaimer > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal nature, > they are subject to copyright in favour of the holding company of the Vox > group of companies. Any recipient who receives this email in error should > immediately report the error to the sender and permanently delete this email > from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by Mimecast Ltd, an innovator in Software as a Service > (SaaS) for business. Providing a safer and more useful place for your human > generated data. Specializing in; Security, archiving and compliance. To find > out more Click Here. > > > > > > > > > > _______________________________________________Users mailing list -- > users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/2SDQ32OZPQ7KG…

3 2

Node Unresponsive
by Anton Louw 07 May '20

07 May '20

Hi All, One of my nodes went into a unresponsive state, but the VMs running on that host are still up. I just want to know, can I restart VDSM on that node, or will it impact the running VMs? In another article, somebody restarted the engine, and that resolved their issue. I would like to first test the VDSM and if that does not work, I will restart the engine. Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

Ubuntu 18.04 and 16.04 cloud images hang at boot up
by suaro＠live.com 07 May '20

07 May '20

I'm using oVirt 4.3 (latest ) and able to successfully provision Centos VMs without any problems. When I attempt to provision Ubuntu VMs, they hang at startup. The console shows : ... ... [ 4.010016] Btrfs loaded [ 101.268594] random: nonblocking pool is initialized It stays like this indefinitely. Again, I have no problems with Centos images, but need Ubuntu Any tips greatly appreciated.

3 2

[ANN] oVirt 4.3.10 Third Release Candidate is now available for testing
by Lev Veyde 07 May '20

07 May '20

The oVirt Project is pleased to announce the availability of oVirt 4.3.10 Third Release Candidate for testing as of May 6th, 2020. This update is the tenth in a series of stabilization updates to the 4.3 series. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) * oVirt Node 4.3 (available for x86_64 only) See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] Additional Resources: * Read more about the oVirt 4.3.10 release highlights: http://www.ovirt.org/release/4.3.10/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.10/ [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

oVirt 4.4.0 First Release Candidate is now available for testing!
by Sandro Bonazzola 07 May '20

07 May '20

The oVirt Project is excited to announce the availability of the first Release Candidate of oVirt 4.4.0 for testing, as of May 6th, 2020 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses hundreds of individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics on top of oVirt 4.3. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not to be used in production. Some of the features included in oVirt 4.4.0 Release Candidate require content that will be available in CentOS Linux 8.2 but can’t be tested on RHEL 8.2 beta yet due to some incompatibility in openvswitch package shipped in CentOS Virt SIG which requires to rebuild openvswitch on top of CentOS 8.2. Installation instructions For the engine: either use appliance or: - Install CentOS Linux 8 minimal from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… ; select minimal installation - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - Attach the host to engine and let it be deployed. What’s new in oVirt 4.4.0 Release Candidate? - Hypervisors based on CentOS Linux 8 (rebuilt from award winning RHEL8), for both oVirt Node and standalone CentOS Linux hosts - Easier network management and configuration flexibility with NetworkManager - VMs based on a more modern Q35 chipset with legacy seabios and UEFI firmware - Support for direct passthrough of local host disks to VMs - Live migration improvements for High Performance guests. - New Windows Guest tools installer based on WiX framework now moved to VirtioWin project - Dropped support for cluster level prior to 4.2 - Dropped SDK3 support - 4K disks support only for file based storage. iSCSI/FC storage do not support 4k disks yet. - Exporting a VM to a data domain - Editing of floating disks - Integrating ansible-runner into engine, which allows a more detailed monitoring of playbooks executed from engine - Adding/reinstalling hosts are now completely based on Ansible - The OpenStack Neutron Agent cannot be configured by oVirt anymore, it should be configured by TripleO instead This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.0 release highlights: http://www.ovirt.org/release/4.4.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.0/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

Fwd: Install of new ovirt baremetal system 4.3.9
by Anton Marchukov 07 May '20

07 May '20

Forwarding to oVirt users list since it looks to be better suited there. ---------- Forwarded message --------- From: kelley bryan <kelley.bryan10(a)gmail.com> Date: Wed, May 6, 2020 at 12:02 PM Subject: Install of new ovirt baremetal system 4.3.9 To: <infra(a)ovirt.org> Engine deployment fails near end: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd": "set -euo pipefail && firewall-cmd --get-active-zones | grep -v \"^\\s*interfaces\"", "delta": "0:00:00.352904", "end": "2020-05-05 22:28:01.561606", "msg": "non-zero return code", "rc": 1, "start": "2020-05-05 22:28:01.208702", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"} were does ovirt store logs? _______________________________________________ Infra mailing list -- infra(a)ovirt.org To unsubscribe send an email to infra-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/infra@ovirt.org/message/XALRUKVRYFC2N… -- Anton Marchukov Associate Manager - RHV DevOps - Red Hat

4 4

Fwd: Ovirt host GetGlusterVolumeHealInfoVDS failed events
by Anton Marchukov 07 May '20

07 May '20

Forwarding to oVirt users list. ---------- Forwarded message --------- From: <srivathsa.puliyala(a)dunami.com> Date: Wed, May 6, 2020 at 12:01 PM Subject: Ovirt host GetGlusterVolumeHealInfoVDS failed events To: <infra(a)ovirt.org> Hi, We have a oVirt cluster with 4 hosts and hosted engine running on one of them (all the nodes provide the storage with GlusterFS) Currently there are 53 VMs running. The version of the oVirt-Engine is 4.2.8.2-1.el7 and GlusterFS is 3.12.15. From past 1 week, we seem to have multiple events popping up on Ovirt-UI about the GetGlusterVolumeHealInfoVDS from all the nodes randomly like one ERROR event for every ~13minutes. Sample Event dashboard example: May 4, 2020, 2:32:14 PM - Status of host <host-1> was set to Up. May 4, 2020, 2:32:11 PM - Manually synced the storage devices from host <host-1> May 4, 2020, 2:31:55 PM - Host <host-1> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 2:31:55 PM - VDSM <host-1> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 2:19:14 PM - Status of host <host-2> was set to Up. May 4, 2020, 2:19:12 PM - Manually synced the storage devices from host <host-2> May 4, 2020, 2:18:49 PM - Host <host-2> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 2:18:49 PM - VDSM <host-2> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 2:05:55 PM - Status of host <host-2> was set to Up. May 4, 2020, 2:05:54 PM - Manually synced the storage devices from host <host-2> May 4, 2020, 2:05:35 PM - Host <host-2> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 2:05:35 PM - VDSM <host-2> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 1:52:45 PM - Status of host <host-3> was set to Up. May 4, 2020, 1:52:44 PM - Manually synced the storage devices from host <host-3> May 4, 2020, 1:52:22 PM - Host <host-3> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 1:52:22 PM - VDSM <host-3> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 1:39:11 PM - Status of host <host-4> was set to Up. May 4, 2020, 1:39:11 PM - Manually synced the storage devices from host <host-4> May 4, 2020, 1:39:11 PM - Host <host-4> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 1:39:11 PM - VDSM <host-4> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 1:26:29 PM - Status of host <host-3> was set to Up. May 4, 2020, 1:26:28 PM - Manually synced the storage devices from host <host-3> May 4, 2020, 1:26:11 PM - Host <host-3> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 1:26:11 PM - VDSM <host-3> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues May 4, 2020, 1:13:10 PM - Status of host <host-1> was set to Up. May 4, 2020, 1:13:08 PM - Manually synced the storage devices from host <host-1> May 4, 2020, 1:12:51 PM - Host <host-1> is not responding. Host cannot be fenced automatically because power management for the host is disabled. May 4, 2020, 1:12:51 PM - VDSM <host-1> command GetGlusterVolumeHealInfoVDS failed: Message timeout which can be caused by communication issues and so on..... When I look at the Compute > Hosts dashboard, I see the host status to be DOWN when VDSM event (GetGlusterVolumeHealInfoVDS failed) is popped and automatically the host status is set to UP within no time. FYI: when host status is DOWN, the VM's running on that host are not migrating and everything is running perfectly fine. This is happening all day. Is there something I can troubleshoot? Appreciate your comments. _______________________________________________ Infra mailing list -- infra(a)ovirt.org To unsubscribe send an email to infra-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/infra@ovirt.org/message/GNE3QC7GLEER4… -- Anton Marchukov Associate Manager - RHV DevOps - Red Hat

2 1

Contribution opportunity: oVirt website links maintenance
by Sandro Bonazzola 06 May '20

06 May '20

Hi, oVirt website accumulated a good amount of broken links over the years. You can see them listed in this etherpad: https://review.rdoproject.org/etherpad/p/SLEq1-6FwW9aw7344eRr You can help fixing the links by edit text files written in markdown language, it's pretty easy to understand and can be done even by somebody without any development skill. This is a good chance to contribute back to oVirt project, looking forward to review your patches at https://github.com/oVirt/ovirt-site ! Thanks! -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> [image: |Our code is open_] <https://www.redhat.com/en/our-code-is-open> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

1 0

Safe to go to 7.8 for CentOS based hypervisors?
by Gianluca Cecchi 06 May '20

06 May '20

Hello, supposing to be already at 4.3.9 level and to have CentOS 7.7 based hosts, are there any blocking factors to update them to 7.8, just released some days ago? Thanks, Gianluca

2 1

NFS storage domain forced to use /exports/data ?
by kelley bryan 06 May '20

06 May '20

Hello Should the documentation point out that the /exports/data mount point is hard coded in ovirt-hosted-engine-setup-ansible-create_storage_domain.yaml. I think some Data Centers will want to use a different mount path or Did I miss a prompt or entry in the Deployment screen for Hosted-engine-deployment? Bryan

1 1

Unable to import CA certificate list
by Sakari Poussa 06 May '20

06 May '20

Hi, I am using 4.4 beta4 and not able to add new hosts to the datacenter. Also "Enroll Certificate" fails. On nodes, I get the following error message: libvirtd[20399]: Unable to import CA certificate list /etc/pki/vdsm/certs/cacert.pem The root cause is the malformed cert: $ cat /etc/pki/vdsm/certs/cacert.pem -----BEGIN CERTIFICATE-----\nMIID XXX That, is the .pem file is just one long line with \n characters instead of real newlines. If I convert the \n to real newlines libvirtd starts but that is not the end solution since other issues surfaces. The malforming happens when the engine copies (via ansible) the CA cert to the node(s). Any ideas what is going on? Thanks, Sakari

2 6

Backup software recommendations
by Colin Coe 06 May '20

06 May '20

Hi all I'm looking for recommendations for backup software. It needs to handle physical and virtual Linux and Windows, RHV and Hyper-V. It doesn't have to be open source and it doesn't have to be free. The main features we need are: - disk to disk backups - inter-site replication with rate limiting - be able to handle Linux thin volumes (think RHGS) - support BMR ans granular file / directory restore - correctly handle Windows VSS - support RHEL point releases as soon as they are released I'm as much after "stay away from" as recommendations. We currently use Arcserve UDP and it is ... well ... sub optimal Thanks in advance CC

3 4

VM Portal --> Windows SSO
by Andrey Rusakov 05 May '20

05 May '20

Hi, Resently I configure oVirt, FreeIPA and Windows Guest VM. I would like to SSO to Windows VM thrue VM portal or Rest API (dowloading spice config) or Admin Port ... I don't see any login attemps in log file, errors, or ... I found a lot of docs for SSO setup - it is so simple (Agent, Correct Domain name in login profile ...), But at the end i found that SSO module was deleted from 4.3 agent. Is it true? The major question - Is it working ?

1 0

Requesting Permission to Post
by Daniel S 05 May '20

05 May '20

1 0

node down due to gluster storage
by suporte＠logicworks.pt 05 May '20

05 May '20

Hello, I'm running an ovirt 2 nodes and 2 gluster storages. The second gluster sotrage is down due to an hardware problem The node 1 is allways trying to connect to the second storage and does not come up. I'm running 4.3.6 version Any idea? thanks -- Jose Ferradeira http://www.logicworks.pt

4 3

Gluster deployment fails with missing UUID
by Shareef Jalloq 05 May '20

05 May '20

Hi, I'm running the gluster deployment flow and am trying to use a second drive as the gluster volume. It's /dev/sdb on each node and I'm using the JBOD mode. I'm seeing the following gluster ansible task fail and a google search doesn't bring up much. TASK [gluster.infra/roles/backend_setup : Create volume groups] **************** failed: [ovirt-gluster-01.jalloq.co.uk] (item={u'vgname': u'gluster_vg_sdb', u'pvname': u'/dev/sdb'}) => {"ansible_loop_var": "item", "changed": false, "err": " Couldn't find device with uuid Y8FVs8-LP6w-R6CR-Yosh-c40j-17XP-ttP3Np.\n Couldn't find device with uuid tA4lpO-hM9f-S8ci-BdPh-lTve-0Rh1-3Bcsfy.\n Couldn't find device with uuid RG3w6j-yrxn-2iMw-ngd0-HgMS-i5dP-CGjaRk.\n Couldn't find device with uuid lQV02e-TUZE-PXCd-GWEd-eGqe-c2xC-pauHG7.\n Device /dev/sdb excluded by a filter.\n", "item": {"pvname": "/dev/sdb", "vgname": "gluster_vg_sdb"}, "msg": "Creating physical volume '/dev/sdb' failed", "rc": 5}

4 11

stty: standard tty: inappropriate ioctl for device
by Charles Kozler 05 May '20

05 May '20

I'd like to share this with the list because its something that I changed for convenience, in .bashrc, but had a not so obvious rippling impact on the ovirt self hosted installer. I could imagine a few others doing this too and I'd rather save future them hours of google time Every install failed no matter what and it was always at the SSO step to revoke token (here: https://github.com/machacekondra/ansible/blob/71547905fab67a876450f95c9ca71…) and then reissue new token but the engine log yielded different information. The SSO failure was a red herring engine.log:2020-05-04 22:09:17,150-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [61038b68] Host installation failed for host '672be551-9259-4d2d-823d-07f586b4e0f1', 'node1': Unexpected error during execution: stty: standard input: Inappropriate ioctl for device engine.log:2020-05-04 22:09:17,145-04 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [61038b68] SSH error running command root@node1:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': RuntimeException: Unexpected error during execution: stty: standard input: Inappropriate ioctl for device I was on the hunt for this for the better part of 2 days or so, because who else has anything to do during quarantine, wracking my brain and trying everything to figure out what was going on Well, it was my own fault # cat .bashrc | grep -i stty stty erase ^? With this set in the .bashrc of the node I was running the installer via cockpit from, ovirt installer will fail to install This was set for convenience to have backspace work in vim since at some point it stopped working for me Should I file this as a bug? The message generated is more of a warning then a failure but I do not know the internals of ovirt like that. Commands still actually execute fine ovirt-engine(a)192.168.222.84) # ssh 10.0.16.221 "uptime" root(a)10.0.16.221's password: stty: standard input: Inappropriate ioctl for device 22:30:01 up 22:45, 2 users, load average: 0.80, 0.62, 0.80 One thing I think should be called out in the docs, and called out very loud, is that the entire ovirt installer expects a clean 110% machine that is done right after install and provided and IP and hostname. Its not that obvious, but it is now

2 3

Sometimes VM fails to power on: device busy in adding vnet port
by Gianluca Cecchi 05 May '20

05 May '20

Hi, my environment info: centos-release.x86_64 7-7.1908.0.el7.centos glusterfs.x86_64 6.8-1.el7 ovirt-engine.noarch 4.3.9.4-1.el7 ovirt-release43.noarch 4.3.9-1.el7 I have an external agent (openstack staging_oviirt) that powers on/off VMs during bulk install. See also here some other details: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/B4CDWTAR7YLRLR… I repeat many times the installation for test purposes and during these phases the application powers on (through ostacpm user) about 8 VMs in the same moment. Sometimes it happens that one or more of them fail to start and in web admin gui I see this kind of sequence of events: VM ostack-ceph2 was started by ostackpm@internal-authz (Host: ovirt.mydomain). User <UNKNOWN> got disconnected from VM ostack-ceph2. VM ostack-ceph2 is down with error. Exit message: Unable to add bridge vlan23 port vnet21: Device or resource busy. Failed to run VM ostack-ceph2 on Host ovirt.mydomain Failed to run VM ostack-ceph2 (User: ostackpm@internal-authz). Soon I press the start button from web admin gui and the VM powers on without problems. I think this kind of problem doesn't depend on the rest api agent. Could it be a sort of bug or concurrency of power on commands? If I grep VM UUID and name of the VM for the one above, I get this in engine.log: https://drive.google.com/file/d/1QsedDqvlbvVPCifDNted4ipSsJ2GeBJV/view?usp=… On ovirt host I see: 2020-05-04 10:16:05,491+0200 ERROR (vm/38f806e7) [virt.vm] (vmId='38f806e7-5c48-4ffe-90e8-671b1a585256') The vm start process failed (vm:934) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 868, in _startUnderlyingVm self._run() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2895, in _run dom.createWithFlags(flags) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1110, in createWithFlags if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: Unable to add bridge vlan23 port vnet21: Device or resource busy 2020-05-04 10:16:05,492+0200 INFO (vm/38f806e7) [virt.vm] (vmId='38f806e7-5c48-4ffe-90e8-671b1a585256') Changed state to Down: Unable to add bridge vlan23 port vnet21: Device or resource busy (code=1) (vm:1702) Let me know if you meed more information Gianluca

1 0

oVirt 4.4.0 Beta release refresh is now available for testing
by Sandro Bonazzola 03 May '20

03 May '20

oVirt 4.4.0 Beta release refresh is now available for testing The oVirt Project is excited to announce the availability of the beta release of oVirt 4.4.0 refresh (beta 4) for testing, as of April 17th, 2020 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses hundreds of individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics on top of oVirt 4.3. Important notes before you try it Please note this is a Beta release. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not to be used in production. In particular, please note that upgrades from 4.3 and future upgrades from this beta to the final 4.4 release from this version are not supported. Some of the features included in oVirt 4.4.0 Beta require content that will be available in CentOS Linux 8.2 but can’t be tested on RHEL 8.2 beta yet due to some incompatibility in openvswitch package shipped in CentOS Virt SIG which requires to rebuild openvswitch on top of CentOS 8.2. Known Issues - ovirt-imageio development is still in progress. In this beta you can’t upload images to data domains using the engine web application. You can still copy iso images into the deprecated ISO domain for installing VMs or upload and download to/from data domains is fully functional via the REST API and SDK. For uploading and downloading via the SDK, please see: - https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/upload_d… - https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/download… Both scripts are standalone command line tool, try --help for more info. Installation instructions For the engine: either use appliance or: - Install CentOS Linux 8 minimal from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - dnf module enable -y javapackages-tools pki-deps postgresql:12 - dnf install ovirt-engine - engine-setup For the nodes: Either use oVirt Node ISO or: - Install CentOS Linux 8 from http://centos.mirror.garr.it/centos/8.1.1911/isos/x86_64/CentOS-8.1.1911-x8… ; select minimal installation - dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44-pre.rpm - dnf update (reboot if needed) - Attach the host to engine and let it be deployed. What’s new in oVirt 4.4.0 Beta? - Hypervisors based on CentOS Linux 8 (rebuilt from award winning RHEL8), for both oVirt Node and standalone CentOS Linux hosts - Easier network management and configuration flexibility with NetworkManager - VMs based on a more modern Q35 chipset with legacy seabios and UEFI firmware - Support for direct passthrough of local host disks to VMs - Live migration improvements for High Performance guests. - New Windows Guest tools installer based on WiX framework now moved to VirtioWin project - Dropped support for cluster level prior to 4.2 - Dropped SDK3 support - 4K disks support only for file based storage. iSCSI/FC storage do not support 4k disks yet. - Exporting a VM to a data domain - Editing of floating disks - Integrating ansible-runner into engine, which allows a more detailed monitoring of playbooks executed from engine - Adding/reinstalling hosts are now completely based on Ansible - The OpenStack Neutron Agent cannot be configured by oVirt anymore, it should be configured by TripleO instead This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.1 * CentOS Linux (or similar) 8.1 * oVirt Node 4.4 based on CentOS Linux 8.1 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. If you manage more than one oVirt instance, OKD or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such a case, please be sure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG is already available for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.0 release highlights: http://www.ovirt.org/release/4.4.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.0/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/>* <https://www.redhat.com/en/summit?sc_cid=7013a000002D2QxAAK>* *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

5 4

Engine UI exception while viewing unattached hosts in Network tab
by Shareef Jalloq 03 May '20

03 May '20

Hi, I'm following the Gluster setup blog post ( https://blogs.ovirt.org/2018/02/up-and-running-with-ovirt-4-2-and-gluster-s…) and am at the 'Storage network' section. I've created a new 'gluster' network, selected the network and navigated to the 'Hosts' tab. The guide tells you to click the 'Unattached' button and then 'Setup Host Networks' for each host. However, clicking the 'Unattached' button fires off a bunch of exceptions rather than displaying my 3 hosts. The message is: "Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read property 'N' of null Please have your administrator check the UI logs" Anyone seen this before? Where is the UI log located? Shareef.

3 3

Unable to remove system roles from Everyone group
by miguel.garcia＠toshibagcs.com 02 May '20

02 May '20

I opened Everyone group and added system role UserRole and realized now that everybody can see all VMS which is not good. I tried to remove the role from the group but got the error "Error while executing action: It's not allowed to remove system permissions assigned to built-in Everyone group" Looking into Ovirt forums I see that this change should be made through the engine database but I was not able to reach that part. Can someone help me out how to remove the system role from Everyone group? or at least reset the group?

2 1