- Users - oVirt List Archives

Uncaught exception on Network Interfaces tab of a newly added host to oVirt 4.5.0
by Hean-Seng Tan 01 Oct '22

01 Oct '22

I added a few hosts to oVirt that runs engine version 4.5.0.8-1.el8. Most of the hosts work well except that Network Interfaces tab of a host shows the below error on the web browser: Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read properties of null (reading 'e') Please have your administrator check the UI logs I tried the following steps but they do not help: - clearing web browser cache - using a different web browser - deleting and re-adding the host back to oVirt /var/log/ovirt-engine/ui.log logged below error when the network interface tab of the host was accessed: 2022-09-28 01:52:51,527Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-1381) [] Permutation name: 06C89A2CB3005B8E9B9129A6A121B6E2 2022-09-28 01:52:51,527Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-1381) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : a is null at java.math.Elementary.add(Elementary.java:52) at org.ovirt.engine.ui.webadmin.widget.host.HostNetworkInterfaceBondedListViewItem$8.$getValue(HostNetworkInterfaceBondedListViewItem.java:167) at org.ovirt.engine.ui.webadmin.widget.host.HostNetworkInterfaceBondedListViewItem$8.getValue(HostNetworkInterfaceBondedListViewItem.java:167) at com.google.gwt.user.cellview.client.Column.render(Column.java:164) at com.google.gwt.user.cellview.client.AbstractCellTableBuilder.$renderCell(AbstractCellTableBuilder.java:188) at com.google.gwt.user.cellview.client.DefaultCellTableBuilder.$buildRowImpl(DefaultCellTableBuilder.java:62) at com.google.gwt.user.cellview.client.AbstractCellTableBuilder.$buildRow(AbstractCellTableBuilder.java:85) at com.google.gwt.user.cellview.client.AbstractCellTable.$buildRowValues(AbstractCellTable.java:2350) at com.google.gwt.user.cellview.client.AbstractCellTable.replaceAllChildren(AbstractCellTable.java:2149) at com.google.gwt.user.cellview.client.AbstractHasData$View.replaceAllChildren(AbstractHasData.java:265) at com.google.gwt.user.cellview.client.HasDataPresenter.$resolvePendingState(HasDataPresenter.java:1062) at com.google.gwt.user.cellview.client.HasDataPresenter$2.execute(HasDataPresenter.java:981) at com.google.gwt.core.client.impl.SchedulerImpl.runScheduledTasks(SchedulerImpl.java:167) at com.google.gwt.core.client.impl.SchedulerImpl.$flushFinallyCommands(SchedulerImpl.java:272) at com.google.gwt.core.client.impl.Impl.exit(Impl.java:383) at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:345) at Unknown.Ny/<(https://atlnpkvmoc01.amd.com/ovirt-engine/webadmin/?locale=en_US line 9 > injectedScript) at Unknown.anonymous(Unknown) Does anyone have any idea of what could be wrong?

1 1

adding foreman as an external provider
by eevans＠digitaldatatechs.com 30 Sep '22

30 Sep '22

I had an ovirt engine failure which corrupted my foreman/katello vm. My ovirt-engine is 4.3 and I was using foreman 3.0 with Katello 4.5. Once the ovirt-engine was repaired, still 4.3, I updated the foreman katello install to foreman 3.3 and Katello 4.5. I can connect from foreman to Ovirt as a compute resource but cannot add foreman to ovirt as an external provider. The engine.log: 2022-09-30 15:51:24,213-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-158) [12e3a290-09e7-42b3-a849-e57b56bc338d] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:51:24,214-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-158) [12e3a290-09e7-42b3-a849-e57b56bc338d] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 15:52:26,240-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-162) [33322f35-2e34-4e64-bda7-dd43c5d9c157] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:52:26,240-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-162) [33322f35-2e34-4e64-bda7-dd43c5d9c157] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 15:54:53,279-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-164) [8d49c923-9269-4637-a858-659ede223c0a] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:54:53,280-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-164) [8d49c923-9269-4637-a858-659ede223c0a] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:19:31,467-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-164) [320557dc-da95-4cb2-9a58-735fe960dc78] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:19:31,468-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-164) [320557dc-da95-4cb2-9a58-735fe960dc78] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:29:40,606-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-5) [2e10f6a6-36e3-4812-a029-c64c2bf927e8] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:29:40,607-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-5) [2e10f6a6-36e3-4812-a029-c64c2bf927e8] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:54:19,240-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-2) [5c103548-4b63-48a7-a76e-89175d76dd62] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:54:19,240-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-2) [5c103548-4b63-48a7-a76e-89175d76dd62] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:55:02,397-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-4) [5f2e8594-6b91-4ff6-8bdb-73df987ccf94] Exception is Server returned HTTP response code: 401 for URL: https://katello.digitaldatatechs.com:443/api/v2 2022-09-30 16:55:02,398-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-4) [5f2e8594-6b91-4ff6-8bdb-73df987ccf94] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: Server returned HTTP response code: 401 for URL: https://katello.digitaldatatechs.com:443/api/v2 (Failed with error PROVIDER_FAILURE and code 5050) The foreman host name and IP are the same. I believe it's a certificate error vnd renamed the katello certs with a .bak suffix. I'm not sure ifit's a compatability issue but I researched it to death and so far came up empty. Any help would be appreciated. Thanks, Eric

1 0

Permissions
by boris.golemovic＠eir.ie 29 Sep '22

29 Sep '22

Hi Does anybody have any solution that I want give some user or group permissions to create vm and fully manage only vm what he creates. So users should not be able to see or make any changes on vm what are not created by him/groups where user belong,

2 1

Storage domain deletion not possible because not possible to detach
by Diego Ercolani 28 Sep '22

28 Sep '22

(I'm always talking about the last ovirt version that is currently engine: 4.5.2.5-1.el8, node: ovirt-node-ng-4.5.2-0.20220810.0) I tried to add an iSCSI storage domain adding a new vlan network where the storage is attached.... this gave a completely mess-up of the storage engine. I would like to restart the procedure again and to accomplish this I have do remove the storage domain. To do this, I added manually the vlan to the nodes as I'm configured using linux bridge simple networking, so I discovered I have not to manage ovs environment. I currently have the storage domain in maintenance mode and I've successfully regenerated the discovery informations as the network to connecto to the storage is online. But I cannot detach the storage and I cannot activate the storage domain, so I'm completely stuck. This is the related log in the engine while I was trying to detach the storage: 2022-09-26 07:20:48,043Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (EE-ManagedThreadFactory-engine-Thread-55008) [7a5a5413-36d0-4a15-b555-c9801f92483d] Command 'DetachStorageDomainVDSCommand( DetachStorageDomainVDSCommandParameters:{storagePoolId='da146814-f823-40e0-bd7b-8478dcfa38cd', ignoreFailoverLimit='false', storageDomainId='aac79175-ab2b-4b5b-a6e4-9feef9ce17ab', masterDomainId='00000000-0000-0000-0000-000000000000', masterVersion='8', force='false'})' execution failed: IRSGenericException: IRSErrorException: Storage domain not in pool: 'domain=aac79175-ab2b-4b5b-a6e4-9feef9ce17ab, pool=da146814-f823-40e0-bd7b-8478dcfa38cd' as you can see it seem there is a problem in the engine database. I saw here (https://lists.ovirt.org/pipermail/users/2015-January/030504.html) that someone worked directly on the engine db to delete the storage domain but I read somewhere else that the domain information is also mapped in a lvm volume metadata. What can I do from here? Thank you.

1 1

Editing vm devices
by Patrick Hibbs 28 Sep '22

28 Sep '22

Hello, I was trying to get some guest os hardware working and ultimately had to use the qemu-cmdline vdsm hook to set the pci bus id and address for a given vm device. I noticed that ovirt had a vmdevices tab in the Admin UI with this information in it, but it could not be edited. After looking through things I found this: https://www.ovirt.org/develop/release-management/features/virt/expose-vm-de… Apparently ovirt had at one point planned on allowing the administrator to change individual vm device properties, and some of this support such as the property persistence in the ovirt database, was already implemented. The only thing that seems to be missing is marking the fields in the Admin UI as editable, and the hook to update the database from those fields. Does anyone know if there are any plans on actually finishing this feature and getting it into a ovirt release? Or if not, why? The linked page is outdated, and claims the original target was ovirt 3.6. -Patrick Hibbs

2 2

ovirtmgmt Bridge - Which NIC? - Advice Please
by Matthew J Black 28 Sep '22

28 Sep '22

I need a quick piece of advice, please. I'm at setting up the oVirt Engine VM (ie doing a "hosted-engine --deploy") stage. The Host has 3 NICs. NIC_1 and NIC_2 are bonded (bond1) and run 2 VLANs (on bond1.1 and bond1.2). VLAN_1 is to be used as the "everyday connection VLAN for the VMs" (including the oVirt Engine VM - I think). VLAN_2 is *only* to be used for data traffic to-and-from our Ceph Cluster (ie via the Ceph iSCSI Gateway Nodes). NIC_3 (running VLAN_3) is to be used for oVirt-host-to-oVirt-host comms (including "local" Gluster traffic - yes, the (oVirt) hosts are running a couple of Gluster drives). My question is: Which interface should we use for the "ovirtmgmt" Bridge? I suspect it should be NIC_3 (VLAN_3), and I'm 99.999% sure it *shouldn't* be bond1.2 (VLAN_2), but it might be bond1.1 (VLAN_1), so I thought I'd better get peoples' input. You see, I'm not sure what the purpose of the "ovirtmgmt" bridge is. Is it for humans to talk to the oVirt Engine, or is it for the oVirt Engine to talk to the VMs (and hosts), or is it for some other purpose, or is it for some combination of the these? (I have read the doco on the ovirtmgmt bridge, and I'm still somewhat confused.) So, if someone wouldn't mind getting back to me about this, I'd appreciate it. Cheers Dulux-Oz

3 2

Backup/restore of Hosted Engine VM
by Volenbovskyi, Konstantin 27 Sep '22

27 Sep '22

Hi, I am aware that there is a procedure of backup/restore documented in https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… , but I would like to have also else as well when it comes to backup (and restore) of hosted engine VM and avoid using hosted-engine --deploy / engine-backup Is anyone doing Libvirt snapshot or any other similar thing to back up ovengine VM? Part of that is the XML of the HE VM should be intact, so currently I am considering https://libvirt.org/kbase/live_full_disk_backup.html#full-backup-with-older… and https://gist.github.com/cabal95/e36c06e716d3328b512 BR, Konstantin

2 1

No online ovirt conference this year?
by Nathanaël Blanchet 27 Sep '22

27 Sep '22

Hello ovirt community, Will there be an upcoming ovirt conference this year? Last year it took place on mi- September. Cheers,

2 1

Manually Remove Snapshots
by Clint Boggio 26 Sep '22

26 Sep '22

I've got a VM with a pair of snapshots that won't delete and I'm needing a procedure to manually remove the snapshots. I don't need the VM and so while i'd prefer not to destroy it, it wouldn't be critical if I did damage the VM in the process. When I try to delete the snapshots that procedure fails, and when I try to delete the disk that procedure fails. Any pointers would be greatly appreciated.

2 6

Hosted-Engine VM wont start after physical CPU change
by douglasddr8＠gmail.com 25 Sep '22

25 Sep '22

I currently have a selfhosted engine with two cascadelake xeon silver 4208 cpu with 8 cores I changed both to two skylake xeon platinum 8160 with 24cores After initialization the vm hosted-engine wont start, I found in the logs that the cpu is not compatible because its not contain the avx512vnni flag Is it possible to work around the problem or these processors cannot be used?

1 0

Certificate expiration
by Joseph Gelinas 23 Sep '22

23 Sep '22

Hi, The certificates on our oVirt stack recently expired, while all the VMs are still up, I can't put the cluster into global maintenance via ovirt-engine, or do anything via ovirt-engine for that matter. Just get event logs about cert validity. VDSM ovirt-1.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed VDSM ovirt-2.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed VDSM ovirt-3.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed Under Compute -> Hosts, all are status Unassigned. Default data center is status Non Responsive. I have tried a couple of solutions to regenerate the certificates without much luck and have copied the originals back in place. https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/ht… https://access.redhat.com/solutions/2409751 I have seen things saying running engine-setup will generate new certs, however engine doesn't think the cluster is in global maintenance so won't run that, I believe I can get around the check with `engine-setup --otopi-environment=OVESETUP_CONFIG/continueSetupOnHEVM=bool:True` but is that the right thing to do? Will it deploy the certs on to the hosts as well so things communicate properly? Looks like one is supposed to put a node into maintenance and reenroll it after doing the engine-setup, but will it even be able to put the nodes into maintenance given I can't do anything with them now? Appreciate any ideas.

3 18

QXL vs VGA
by Andrea Chierici 23 Sep '22

23 Sep '22

Dear all, on latest 4.5, as many others have noticed, default is to use video type VGA and VNC as graphics protocol. Problem is, in my current environments, I can't seem to make this to work. When the machine power ups I get the "usual" error from virt-viewer: I found some docs on the web, like this from redhat: https://access.redhat.com/solutions/5695951 but it does not seem to work. Indeed I reinstalled a host and forced the creation of the vm on it, but the console is still unreachable. Any hint how I can solve this? I am quite surprised I could not find anything on standard documentation. Thanks, Andrea -- Andrea Chierici - INFN-CNAF Viale Berti Pichat 6/2, 40127 BOLOGNA Office Tel: +39 051 2095463 SkypeID ataruz --

2 2

Failed to deploy ovirt engine with CLI
by Pablo Olivera 23 Sep '22

23 Sep '22

Hi community, I'm trying to deploy the engine via CLI on an ovirt 4.5.2 (CentOS 8) node over a clean install. Previously I was trying to deploy it via cockpit but I got the following error: [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ ERROR ] ovirtsdk4.AuthError: Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials. [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 50, "changed": false, "msg": "Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials."} After researching in different threads of this forum, I decided to setup it via CLI by recommendation of different users, since it seems that cockpit hosted-engine deployment is broken. I attach the hosted-engine setup log but I am not sure where is the problem now. Can you help me? Thanks in advance. Pablo.

3 5

oVirt bug reports to move from bugzilla to github issues in future
by Michal Skrivanek 23 Sep '22

23 Sep '22

Hi all, as a final stage of out gerrit to github transition that started ~9 months ago we are planning to eliminate the use of bugzilla.redhat.com for all oVirt projects (bugs with Classification: "oVirt") and use the native issue tracking in github as well. We used to have integrations with gerrit and bugzilla that we moved to github actions instead, and the overhead (and notorious slowness) of bugzilla.redhat.com becomes the only "benefit" of using it these days. There's about 50 bugs total left in oVirt bugzilla so it's not that much to move, the biggest change would be that the new bugs are to be filed elsewhere. This is just a heads up for now, we haven't set a cut off date just yet, but you can expect this change in the coming weeks. Thanks, michal

1 1

oVirt API access when using Keycloak
by jonas＠rabe.ch 22 Sep '22

22 Sep '22

Hello all I just recently installed a fresh oVirt appliance. Now I want to use the API to perform some actions but fail to provide the correct username. Can you help? Here's my script: import ovirtsdk4 as sdk from getpass import getpass dc_name = "Default" clu_name = "Default" connection = sdk.Connection( url="https://ovirt-engine-test.admin.int.rabe.ch/ovirt-engine/api", username="admin@ovirt", password=getpass(), # ca_file="/etc/pki/ovirt-engine/ca.pem", insecure=True, ) ... That's the error I get: Traceback (most recent call last): File "/home/user/ovirt_iso_script/./setup_networks.py", line 25, in <module> dc = next(d for d in dcs_svc.list() if d.name == dc_name) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/services.py", line 6863, in list return self._internal_get(headers, query, wait) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/service.py", line 202, in _internal_get context = self._connection.send(request) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 371, in send return self.__send(request) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 389, in __send self.authenticate() File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 382, in authenticate self._sso_token = self._get_access_token() File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 624, in _get_access_token raise AuthError( ovirtsdk4.AuthError: Error during SSO authentication access_denied : Cannot authenticate user No valid profile found in credentials..

2 1

cancel export task - no qemu-img process on host
by goosesk blabla 22 Sep '22

22 Sep '22

Hi, i tried to find way how to cancel hanged export task. I found that there should be some hidden possibility, but it is still not released and i cannot find how to allow it. i found how to remove this task directly from pg database on engine, but i am not sure if this also will unlock that VM. i cannot kill it by qemu-img process, because this process is not running. stucked VM is ubuntu 20.04 with 3 disks 20 + 80 + 300GB . Already running more than 12 hours and still did not start making ova file (checking in export folder) . qemu-img process on the host is missing . i tried to export smaller VM 7GB and it was successfully done by 2 minutes. During export qemu-img process was running on the host. Thank you for any help. BR jan

1 2

Uncaught exception occurred
by nikkognt＠gmail.com 22 Sep '22

22 Sep '22

Hi all, recently I have upgraded from 4.4 to 4.5, since while a create or edit a new pool an error occurr in a pop up red: "Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read properties of undefined (reading 'Kh') Please have your administrator check the UI logs" and the pool is create but with wrong settings. I checked the ui.log file: 2022-09-21 16:33:21,382+02 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Permutation name: 872EE01DC49AC3F81586694F1584D19D 2022-09-21 16:33:21,382+02 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : Cannot read properties of undefined (reading 'Kh') at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView.$addDiskList(DisksAllocationView.java:190) at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView.$lambda$0(DisksAllocationView.java:179) at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView$lambda$0$Type.eventRaised(DisksAllocationView.java:179) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.storage.DisksAllocationModel.$onPropertyChanged(DisksAllocationModel.java:310) at org.ovirt.engine.ui.uicommonweb.models.storage.DisksAllocationModel.$setQuotaEnforcementType(DisksAllocationModel.java:121) at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.$compatibilityVersionChanged(UnitVmModel.java:2384) at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.eventRaised(UnitVmModel.java:2223) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.ListModel.$setSelectedItem(ListModel.java:82) at org.ovirt.engine.ui.uicommonweb.builders.vm.CoreVmBaseToUnitBuilder.$postBuild(CoreVmBaseToUnitBuilder.java:35) at org.ovirt.engine.ui.uicommonweb.builders.vm.CoreVmBaseToUnitBuilder.postBuild(CoreVmBaseToUnitBuilder.java:35) at org.ovirt.engine.ui.uicommonweb.builders.CompositeBuilder$LastBuilder.build(CompositeBuilder.java:45) at org.ovirt.engine.ui.uicommonweb.builders.BaseSyncBuilder.build(BaseSyncBuilder.java:13) at org.ovirt.engine.ui.uicommonweb.builders.BaseSyncBuilder.build(BaseSyncBuilder.java:13) at org.ovirt.engine.ui.uicommonweb.builders.vm.IconVmBaseToUnitBuilder.lambda$0(IconVmBaseToUnitBuilder.java:23) at org.ovirt.engine.ui.uicommonweb.builders.vm.IconVmBaseToUnitBuilder$lambda$0$Type.onSuccess(IconVmBaseToUnitBuilder.java:23) at org.ovirt.engine.ui.uicommonweb.models.vms.IconCache.$lambda$0(IconCache.java:57) at org.ovirt.engine.ui.uicommonweb.models.vms.IconCache$lambda$0$Type.onSuccess(IconCache.java:57) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:239) at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:239) at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) at Unknown.eval(webadmin-0.js) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:306) at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:345) at Unknown.eval(webadmin-0.js) Any suggestions for resolve the problem? Thank you

2 2

GUI snapshot issue
by Facundo Badaracco 22 Sep '22

22 Sep '22

Hi everyone. I have made several snapshot of my vm, the interface says everything is good. But, when i go to the snapshot section of any vm, there is no snapshot. But, in disk section, all my snapshot are there. Any hint?

1 0

VMs hang periodically: gluster problem?
by Diego Ercolani 22 Sep '22

22 Sep '22

Hello, I have a cluster made by 3 nodes in a "self-hosted-engine" topology. I implemented the storage with gluster implementation in 2 replica + arbiter topology. I have two gluster volumes glen - is the volume used by hosted-engine vm gv0 - is the volume used by VMs The physical disks are 4TB SSD used only to accomodate VMs (also hosted-engine) I have continuos VMs hangs, even hosted-engine, this give full of troubles as I have continuous hangs by hosted-engine and this happen asyncrounosly even while there is management operation on VMs (mobility, cloning...) after a while it happens that the VM is freed but in the VMs I have in console kernel complaining by CPU hang or timer hangs and the solution is only to shutdown/poweroff the VM... even hosted engine in fact it happens that hosted-engine -vm-status give "state=EngineUpBadHealth" This is the log during the event in the host while there is the event: Sep 01 07:48:58 ovirt-node3.ovirt NetworkManager[1923]: <info> [1662018538.0166] device (vnet73): state change: activated -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Sep 01 07:48:58 ovirt-node3.ovirt NetworkManager[1923]: <info> [1662018538.0168] device (vnet73): released from master device ovirtmgmt Sep 01 07:48:58 ovirt-node3.ovirt libvirtd[2496]: Unable to read from monitor: Connection reset by peer Sep 01 07:48:58 ovirt-node3.ovirt libvirtd[2496]: internal error: qemu unexpectedly closed the monitor: 2022-09-01T07:48:57.930955Z qemu-kvm: -device virtio-blk-pci,iothread=iothread1,bus=pci.6,addr=0x0,drive=libvirt-1-format,id=ua-0a1a501c-fc45-430f-bfd3-076172cec406,bootindex=1,write-cache=on,serial=0a1a501c-fc45-430f-bfd3-076172cec406,werror=stop,rerror=stop: Failed to get "write" lock Is another process using the image [/run/vdsm/storage/3577c21e-f757-4405-97d1-0f827c9b4e22/0a1a501c-fc45-430f-bfd3-076172cec406/f65dab86-67f1-46fa-87c0-f9076f479741]? Sep 01 07:48:58 ovirt-node3.ovirt kvm[268578]: 5 guests now active Sep 01 07:48:58 ovirt-node3.ovirt systemd[1]: machine-qemu\x2d67\x2dHostedEngine.scope: Succeeded. Sep 01 07:48:58 ovirt-node3.ovirt systemd-machined[1613]: Machine qemu-67-HostedEngine terminated. Sep 01 07:49:08 ovirt-node3.ovirt systemd[1]: NetworkManager-dispatcher.service: Succeeded. Sep 01 07:49:08 ovirt-node3.ovirt ovirt-ha-agent[3338]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine ERROR Engine VM stopped on localhost Sep 01 07:49:14 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:18 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:18 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:28 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:28 ovirt-node3.ovirt sanlock[1633]: 2022-09-01 07:49:28 1706161 [5083]: s4 delta_renew long write time 11 sec Sep 01 07:49:28 ovirt-node3.ovirt sanlock[1633]: 2022-09-01 07:49:28 1706161 [5033]: s3 delta_renew long write time 11 sec Sep 01 07:49:34 ovirt-node3.ovirt libvirtd[2496]: Domain id=65 name='ocr-Brain-28-ovirt.dmz.ssis' uuid=00425fb1-c24b-4eaa-9683-534d66b2cb04 is tainted: custom-ga-command Sep 01 07:49:47 ovirt-node3.ovirt sudo[268984]: root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/privsep-helper --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1iolt06i/privsep.sock This is the indication I have on gluster: [root@ovirt-node3 ~]# gluster volume heal gv0 info Brick ovirt-node2.ovirt:/brickgv0/_gv0 Status: Connected Number of entries: 0 Brick ovirt-node3.ovirt:/brickgv0/gv0_1 Status: Connected Number of entries: 0 Brick ovirt-node4.ovirt:/dati/_gv0 Status: Connected Number of entries: 0 [root@ovirt-node3 ~]# gluster volume heal glen info Brick ovirt-node2.ovirt:/brickhe/_glen Status: Connected Number of entries: 0 Brick ovirt-node3.ovirt:/brickhe/glen Status: Connected Number of entries: 0 Brick ovirt-node4.ovirt:/dati/_glen Status: Connected Number of entries: 0 So it seem healty. I don't know how to address the issue but this is a great problem.

2 19

iSCSI domain not seen by a node if the topology differ from the topology of the other nodes?
by Diego Ercolani 21 Sep '22

21 Sep '22

Hello, I think I0ve found another issue: I have the three node that are under heavy test and, after having problem with gluster I configured them to use with iSCSI (without multipath now) so I configured via the gui a new iscsi data domain using a single target under a single VLAN. I suspect there is an issue reporting the correct volume in my case: I try to explain. This are the scsi devices in the three nodes: [root@ovirt-node2 ~]# lsscsi [4:0:0:0] disk ATA ST4000NM000A-2HZ TN02 /dev/sda [5:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sdb [6:0:0:0] disk IBM 2145 0000 /dev/sdc [N:0:1:1] disk Force MP600__1 /dev/nvme0n1 [root@ovirt-node3 ~]# lsscsi [0:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sda [6:0:0:0] disk IBM 2145 0000 /dev/sdb [N:0:0:1] disk WD Blue SN570 500GB__1 /dev/nvme0n1 [root@ovirt-node4 ~]# lsscsi [3:0:0:0] disk ATA ST4000NM000A-2HZ TN02 /dev/sda [4:0:0:0] disk ATA KINGSTON SA400S3 1103 /dev/sdb [5:0:0:0] disk IBM 2145 0000 /dev/sdc So you see, the SCSI target (IBM 2145) are mapped as /dev/sdc in node2 and node4, but in node3 is mapped as /dev/sdb. In vdsm log of node3 I can find: 2022-09-21 15:53:57,831+0000 INFO (monitor/aac7917) [storage.storagedomaincache] Looking up domain aac79175-ab2b-4b5b-a6e4-9feef9ce17ab (sdc:171) 2022-09-21 15:53:57,899+0000 INFO (monitor/aac7917) [storage.storagedomaincache] Looking up domain aac79175-ab2b-4b5b-a6e4-9feef9ce17ab: 0.07 seconds (utils:390) 2022-09-21 15:53:57,899+0000 ERROR (monitor/aac7917) [storage.monitor] Setting up monitor for aac79175-ab2b-4b5b-a6e4-9feef9ce17ab failed (monitor:363) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 360, in _setupLoop self._setupMonitor() File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 382, in _setupMonitor self._setupDomain() File "/usr/lib/python3.6/site-packages/vdsm/utils.py", line 153, in wrapper value = meth(self, *a, **kw) File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 598, in _setupDomain domain = sdCache.produce(self.sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 115, in produce domain.getRealDomain() File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 51, in getRealDomain return self._cache._realProduce(self._sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 139, in _realProduce domain = self._findDomain(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 156, in _findDomain return findMethod(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 186, in _findUnfetchedDomain raise se.StorageDomainDoesNotExist(sdUUID) vdsm.storage.exception.StorageDomainDoesNotExist: Storage domain does not exist: ('aac79175-ab2b-4b5b-a6e4-9feef9ce17ab',) So the node is kicked out of the ovirt cluster telling that it's not possible to connect to iSCSI domain.....

1 0

VM Down With "Bad Volume Specification"
by Clint Boggio 21 Sep '22

21 Sep '22

I had occasion to shutdown a VM for the purpose of adding RAM and processor to it and the VM willnot boot back up. I'm seeing "VM Issabel_PBX is down with error. Exit message: Bad volume specification {'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'serial': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'index': 0, 'iface': 'scsi', 'apparentsize': '5706743808', 'specParams': {}, 'cache': 'none', 'imageID': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'truesize': '5950070784', 'type': 'disk', 'domainID': '24c4dc1b-c843-4ae2-963f-9d0548305192', 'reqsize': '0', 'format': 'cow', 'poolID': '31fdd642-6b06-11ea-a4c4-00163e333bd2', 'device': 'disk', 'path': '/rhev/data-center/31fdd642-6b06-11ea-a4c4-00163e333bd2/24c4dc1b-c843-4ae2-963f-9d0548305192/images/6af66318-e6f8-45d7-8b4e-2183faf0a917/576b2761-a5bc-427b-95a9-0594447f0705', 'propagateErrors': 'off', 'name': 'sda', 'bootOrder': '1', 'volumeID': '576b2761-a5bc-427b-95a9-0594447f0705', 'diskType': 'file', 'a lias': 'ua-6af66318-e6f8-45d7-8b4e-2183faf0a917', 'discard': False}." in the log. I tried to move the VMs disk from one gluster datastore to another to see if the problem would clear and now the disk is locked and the move is stuck at %10. In the engine logs I have "2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Task id '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] EVENT_ID: TASK_CLEARING_ASYNC_TASK(9,501), Clearing asynchronous task Unknown that started at Tue Jul 12 12:19:21 CDT 2022 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Tue Jul 12 12:19:21 CDT 2022' since it reached a timeout of 3000 minutes 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' 2022-09-19 12:48:25,632-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='31fdd642-6b06-11ea-a4c4-00163e333bd2', ignoreFailoverLimit='false', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 40d6d67f 2022-09-19 12:48:25,633-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, HSMClearTaskVDSCommand(HostName = hprvsr00.locacore.com, HSMTaskGuidBaseVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 22c28060 2022-09-19 12:48:25,638-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, HSMClearTaskVDSCommand, return: , log id: 22c28060 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, SPMClearTaskVDSCommand, return: , log id: 40d6d67f 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,876-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-98) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupWithData' (id: '9e73adde-e485-461a-b349-7fd814890aa6') waiting on child command id: '5b4d0a00-7e40-4016-bf5c-0db013e22983' type:'CopyImageGroupVolumesData' to complete 2022-09-19 12:48:26,878-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-84) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupVolumesData' (id: '5b4d0a00-7e40-4016-bf5c-0db013e22983') waiting on child command id: '1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0' type:'CopyData' to complete 2022-09-19 12:48:27,886-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] START, GetHostJobsVDSCommand(HostName = hprvsr00.locacore.com, GetHostJobsVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2', type='storage', jobIds='[06208564-b66d-4947-a96f-4d163ef2fbe0]'}), log id: 75ca6198 2022-09-19 12:48:27,894-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] FINISH, GetHostJobsVDSCommand, return: {06208564-b66d-4947-a96f-4d163ef2fbe0=HostJobInfo:{id='06208564-b66d-4947-a96f-4d163ef2fbe0', type='storage', description='copy_data', status='running', progress='null', error='null'}}, log id: 75ca6198 2022-09-19 12:48:27,902-05 INFO [org.ovirt.engine.core.bll.StorageJobCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] Command CopyData id: '1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0': waiting for job '06208564-b66d-4947-a96f-4d163ef2fbe0' on host 'hprvsr00.locacore.com' (id: '6c910725-fb42-4a64-b614-2a29bf0800e2') to complete 2022-09-19 12:48:29,911-05 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'MoveOrCopyDisk' (id: '2ec06560-b552-4418-abd7-e2945cd98c12') waiting on child command id: '80a2481e-707f-49bf-b469-33cd90c1a51c' type:'MoveImageGroup' to complete 2022-09-19 12:48:29,915-05 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'MoveImageGroup' (id: '80a2481e-707f-49bf-b469-33cd90c1a51c') waiting on child command id: '9e73adde-e485-461a-b349-7fd814890aa6' type:'CopyImageGroupWithData' to complete" Any help would be appreciated as the client's PBX is currently down as a result.

2 4

Re: Self-hosted-engine timeout and recovering time
by Yedidyah Bar David 21 Sep '22

21 Sep '22

On Wed, Sep 21, 2022 at 12:22 AM Marcos Sungaila <marcos.sungaila(a)oracle.com> wrote: > > Hi all, > > I have a cluster running the 4.4.10 release with 6 KVM hosts and Self-Hosted-Engine. What storage? > I'm testing some network outage scenarios, and I faced strange behavior. I suppose you have redundancy in your network. It's important to clarify (for yourself, mainly) what exactly you test, what's important, what's expected, etc. > After disconnecting the KVM hosts hosting the SHE, there was a long timeout until switching the Self-Hosted-Engine to another host as expected. I suggest studying the ha-agent logs, /var/log/ovirt-hosted-engine-ha/agent.log. Much of the relevant code is in ovirt_hosted_engine_ha/agent/states.py (in the git repo, or under /usr/lib/python3.6/site-packages/ on your machine). > Also, there took a relatively long time to take over the HA VMs from the failing server. That's a separate issue, about which I personally know very little. You might want to start a separate thread about it. I do know, though, that if you keep the storage connected, the host might be able to keep updating VM leases on the storage. See e.g.: https://www.ovirt.org/develop/release-management/features/storage/vm-leases… I didn't check the admin guide, but I suppose it has some material about HA VMs. > Is there a configuration where I can reduce the SHE timeout to make this recover process faster? IIRC there is nothing user-configurable. You can see most relevant constants in ovirt_hosted_engine_ha/agent/constants.py{,.in}. Nothing stops you from changing them, but please note that this is somewhat risky, and I strongly suggest to do very careful testing with your new settings. It might make sense to try to methodically go through all the possible state changes in the above state machine. The general assumption is that network and storage, for critical setups, are redundant, and that the engine itself is not considered critical, in the sense that if it's dead, all your VMs are still alive. And also, that it's more important to not corrupt VM disk images (e.g. by starting the VM concurrently on two hosts) than to keep the VM alive. Best regards, -- Didi

2 1

all active domains with status unknown in old 4.3 cluster
by Jorick Astrego 21 Sep '22

21 Sep '22

Hi, Currently I'm debugging a client's ovirt 4.3 cluster. I was adding two new gluster domains and got a timeout "VDSM command AttachStorageDomainVDS failed: Resource timeout: ()" and "Failed to attach Storage Domain *** to Data Center **". Then I had to restart ovirt-engine and now all the domains including NFS domains have status "unknown" and I see "VDSM command GetStoragePoolInfoVDS failed: Resource timeout: ()" in the events. Anyone fixed this before or have any tips? Met vriendelijke groet, With kind regards, Jorick Astrego Netbulae Virtualization Experts ---------------- Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK 08198180 Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01 ----------------

1 0

Snapshot task stuck at oVirt 4.4.8
by nicolas＠devels.es 21 Sep '22

21 Sep '22

Hi, We're running oVirt 4.4.8 and one of our users tried to create a snapshot on a VM. The snapshot task got stuck (not sure why) and since then a "locked" icon is being shown on the VM. We need to remove this VM, but since it has a pending task, we're unable. The ovirt-engine log shows hundreds of events like: [2022-09-20 09:23:09,286+01 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-27) [2769dad5-3ec3-4c46-90a2-924746ea8d97] Command 'CreateSnapshotForVm' (id: '4fcb6ab7-2cd7-4a0c-be97-f6979be25bb9') waiting on child command id: 'cbb7a2c0-2111-4958-a55d-d48bf2d8591b' type:'CreateLiveSnapshotForVm' to complete An ovirt-engine restart didn't make any difference. Is there a way to remove this task manually, even changing something in the DB? Thanks.

4 4

oVirt Engine VM On Rocky Linux
by Matthew J Black 21 Sep '22

21 Sep '22

Hi Everybody (Hi Dr. Nick), Has anyone attempted to migrate the oVirt Engine VM over to Rocky Linux (v8.6), and if so, any "gotchas" we need to know about? Cheers Dulux-Oz

1 0

oVirt & (Ceph) iSCSI
by Matthew J Black 21 Sep '22

21 Sep '22

Hi Everybody (Hi Dr. Nick), So, next question in my on-going saga: *somewhere* in the documentation I read that when using oVirt with multiple iSCSI paths (in my case, multiple Ceph iSCSI Gateways) we need to set up DM Multipath. My question is: Is this still relevant information when using oVirt v4.5.2? Relevant link referred to by the oVirt Documentation: - https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/ht… Cheers Dulux-Oz

1 0

Self-hosted-engine timeout and recovering time
by Marcos Sungaila 20 Sep '22

20 Sep '22

Hi all, I have a cluster running the 4.4.10 release with 6 KVM hosts and Self-Hosted-Engine. I'm testing some network outage scenarios, and I faced strange behavior. After disconnecting the KVM hosts hosting the SHE, there was a long timeout until switching the Self-Hosted-Engine to another host as expected. Also, there took a relatively long time to take over the HA VMs from the failing server. Is there a configuration where I can reduce the SHE timeout to make this recover process faster? Regards, Marcos Sungaila

1 0

How do I migrate a running VM off unassigned host?
by David White 20 Sep '22

20 Sep '22

Ok, now that I'm able to (re)deploy ovirt to new hosts, I now need to migrate VMs that are running on hosts that are currently in an "unassigned" state in the cluser. This is the result of having moved the oVirt engine OUT of a hyperconverged environment onto its own stand-alone system, while simultaneously upgrading oVirt from v4.4 to the latest v4.5. See the following email threads: - https://lists.ovirt.org/archives/list/users@ovirt.org/thread/TZAUCM3GB5ERST… - https://lists.ovirt.org/archives/list/users@ovirt.org/thread/3IWXZ7VXM6CYYS… The oVirt engine knows about the VMs, and oVirt knows about the storage that those VMs are on. But the engine sees 2 of my hosts as "unassigned", and I've been unable to migrate the disks to new storage, nor live migrate a VM from an unassigned host, nor make a clone of an existing VM. Is there a way to recover from this scenario? I was thinking something along the lines of manually shutting down the VM on the unassigned host, and then somehow force the engine to bring the VM online again from a healthy host? Thanks, David Sent with Proton Mail secure email.

2 4

long time running backup (hanged in image finalizing state )
by Jirka Simon 19 Sep '22

19 Sep '22

Hello there. we have issue with backups on our cluster, one backup started 2 days ago and is is still in state finalizing. select * from vm_backups; backup_id | from_checkpoint_id | to_checkpoint_id | vm_id | phase | _create_date | host_id | des cription | _update_date | backup_type | snapshot_id | is_stopped --------------------------------------+--------------------+--------------------------------------+--------------------------------------+-------+----------------------------+---------+---- ---------+----------------------------+-------------+--------------------------------------+------------ b9c458e6-64e2-41c2-93b8-96761e71f82b | | 7a558f2a-57b6-432f-b5dd-85f5fb9dac8e | c3b2199f-35cc-41dc-8787-835e945217d2 | Ready | 2022-09-17 00:44:56.877+02 | | | 2022-09-17 00:45:19.057+02 | hybrid | 0c6ebd56-dcfe-46a8-91cc-327cc94e9773 | f (1 row) and if I check imagetransfer table, I see bytes_sent = bytes_total. engine=# select it.disk_id,bd.disk_alias,it.last_updated, it.bytes_sent, it.bytes_total from image_transfers as it , base_disks as bd where it.disk_id = bd.disk_id; disk_id | disk_alias | last_updated | bytes_sent | bytes_total --------------------------------------+-------------------------------------------------------+----------------------------+--------------+-------------- 950279ef-485c-400e-ba66-a3f545618de5 | log1.util.prod.hq.sldev.cz_log1.util.prod.hq.sldev.cz | 2022-09-17 01:43:09.229+02 | 214748364800 | 214748364800 there is no error in logs if i use /usr/share/ovirt-engine/setup/dbutils/unlock_entity.sh -t all -qc there is no record in any part. I can clean these record from DB to fix it but it will happen again in few days. vdsm.x86_64 4.50.2.2-1.el8 ovirt-engine.noarch 4.5.2.4-1.el8 is there anything i can check to find reason of this ? Thank you Jirka

2 8

Unable to deploy to new host
by David White 19 Sep '22

19 Sep '22

I currently have a self-hosted engine that was restored from a backup of an engine that was originally in a hyperconverged state. (See https://lists.ovirt.org/archives/list/users@ovirt.org/message/APQ3XBUM34TG7…) This was also an upgrade from ovirt 4.4 to ovirt 4.5. There were 4 hosts in this cluster. Unfortunately, 2 of them are completely in an "Unassigned" state right now, and I don't know why. The VMs on those hosts are working fine, but I have no way to move the VMs or manage them. More to the point of this email: I'm trying to re-deploy onto a 3rd host. I did a fresh install of Rocky Linux 8, and followed the instructions at https://ovirt.org/download/ and at https://ovirt.org/download/install_on_rhel.html, including the part there that is specific to Rocky. After installing the centos-release-ovirt45 package, I then logged into the oVirt engine web UI, and went to Compute -> Hosts -> New, and have tried (and failed) many times to install / deploy to this new host. The last error in the host deploy log is the following: 2022-09-18 21:29:39 EDT - { "uuid" : "94b93e6a-5410-4d26-b058-d7d1db0a151e", "counter" : 404, "stdout" : "fatal: [cha2-storage.mgt.example.com] FAILED! => {\"msg\": \"The conditional check 'cluster_switch == \\\"ovs\\\" or (ovn_central is defined and ovn_central | ipaddr)' failed. The error was: The ipaddr filter requires python's netaddr be installed on the ansible controller\\n\\nThe error appears to be in '/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml': line 3, column 5, but may\\nbe elsewhere in the file depending on the exact syntax problem.\\n\\nThe offending line appears to be:\\n\\n- block:\\n - name: Install ovs\\n ^ here\\n\"}", "start_line" : 405, "end_line" : 406, "runner_ident" : "e2cbd38d-64fa-4ecd-82c6-114420ea14a4", "event" : "runner_on_failed", "pid" : 65899, "created" : "2022-09-19T01:29:38.983937", "parent_uuid" : "02113221-f1b3-920f-8bd4-00000000003d", "event_data" : { "playbook" : "ovirt-host-deploy.yml", "playbook_uuid" : "73a6e8f1-3836-49e1-82fd-5367b0bf4e90", "play" : "all", "play_uuid" : "02113221-f1b3-920f-8bd4-000000000006", "play_pattern" : "all", "task" : "Install ovs", "task_uuid" : "02113221-f1b3-920f-8bd4-00000000003d", "task_action" : "package", "task_args" : "", "task_path" : "/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml:3", "role" : "ovirt-provider-ovn-driver", "host" : "cha2-storage.mgt.example.com", "remote_addr" : "cha2-storage.mgt.example.com", "res" : { "msg" : "The conditional check 'cluster_switch == \"ovs\" or (ovn_central is defined and ovn_central | ipaddr)' failed. The error was: The ipaddr filter requires python's netaddr be installed on the ansible controller\n\nThe error appears to be in '/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-provider-ovn-driver/tasks/configure.yml': line 3, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n- block:\n - name: Install ovs\n ^ here\n", "_ansible_no_log" : false }, "start" : "2022-09-19T01:29:38.919334", "end" : "2022-09-19T01:29:38.983680", "duration" : 0.064346, "ignore_errors" : null, "event_loop" : null, "uuid" : "94b93e6a-5410-4d26-b058-d7d1db0a151e" } } On the engine, I have verified that netaddr is installed. And just for kicks, I've installed as many different versions as I can find: [root@ovirt-engine1 host-deploy]# rpm -qa | grep netaddrpython38-netaddr-0.7.19-8.1.1.el8.noarch python2-netaddr-0.7.19-8.1.1.el8.noarch python3-netaddr-0.7.19-8.1.1.el8.noarch The engine is based on CentOS Stream 8 (when I moved the engine out of the hyperconverged environment, my goal was to keep things as close to the original environment as possible) [root@ovirt-engine1 host-deploy]# cat /etc/redhat-release CentOS Stream release 8 The engine is fully up-to-date: [root@ovirt-engine1 host-deploy]# uname -a Linux ovirt-engine1.mgt.barredowlweb.com 4.18.0-408.el8.x86_64 #1 SMP Mon Jul 18 17:42:52 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux And the engine has the following repos: [root@ovirt-engine1 host-deploy]# yum repolistrepo id repo name appstream CentOS Stream 8 - AppStream baseos CentOS Stream 8 - BaseOS centos-ceph-pacific CentOS-8-stream - Ceph Pacific centos-gluster10 CentOS-8-stream - Gluster 10 centos-nfv-openvswitch CentOS-8 - NFV OpenvSwitch centos-opstools CentOS-OpsTools - collectd centos-ovirt45 CentOS Stream 8 - oVirt 4.5 extras CentOS Stream 8 - Extras extras-common CentOS Stream 8 - Extras common packages ovirt-45-centos-stream-openstack-yoga CentOS Stream 8 - oVirt 4.5 - OpenStack Yoga Repository ovirt-45-upstream oVirt upstream for CentOS Stream 8 - oVirt 4.5 powertools CentOS Stream 8 - PowerTools Why does deploying to this new Rocky host keep failing? Sent with Proton Mail secure email.

2 5

How i can shutdown the virtual servers on a note when the ovirt network is down
by manfred.bohensky＠bohensky-it.gmbh 19 Sep '22

19 Sep '22

Hello, i have a question. When on an ovirt note the ovirt network down how i can shutdown the virtual server local on the ovirt note in the local cli? Thanks

3 3

oVirt 4.5 on Rocky 9
by Bjorn M 19 Sep '22

19 Sep '22

Hi, I'm moving all my infra nodes to Rocky 9 and my oVirt cluster is next on the list. I'm deploying a standalone oVirt VM on a KVM box and will set up the hosts afterwards. All are to run on Rocky 9 x86_64. I followed https://www.ovirt.org/download/install_on_rhel.html and created an Ansible playbook to set up the customisations. I now have all repos set up correctly, or at least that is my understanding. When I run yum search ovirt-engine I get a number of packages available from the repos, but not the ovirt-engine package. I do see the ovirt-hosted-engine, but I prefer the standalone option. This makes sense as I don't find the package at http://mirror.stream.centos.org/SIGs/9-stream/virt/x86_64/ovirt-45/Packages… , which I where all ovirt- packages are, except this one. Yum whatprovides engine-setup also turns out negative. I then decided to install ovirt-engine-appliance 4.5-20220419160254.1.el9 from ovirt-45-upstream, but that package produces an error on the GPG key import. It's unclear whether the issue is on my specific stack or wider. The missing ovirt-engine package is confusing though. Any help is appreciated, Cheers, Bjorn OUTPUT : (0)[root@ovirt ~]# yum repolist Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. repo id repo name appstream Rocky Linux 9 - AppStream baseos Rocky Linux 9 - BaseOS c9s-extras-common CentOS Stream 9 - Extras packages centos-ceph-pacific CentOS-9-stream - Ceph Pacific centos-gluster10 CentOS-9-stream - Gluster 10 centos-nfv-openvswitch CentOS Stream 9 - NFV OpenvSwitch centos-openstack-yoga CentOS-9 - OpenStack yoga centos-opstools CentOS Stream 9 - OpsTools - collectd centos-ovirt45 CentOS Stream 9 - oVirt 4.5 centos-rabbitmq-38 CentOS-9 - RabbitMQ 38 crb Rocky Linux 9 - CRB epel Extra Packages for Enterprise Linux 9 - x86_64 extras Rocky Linux 9 - Extras ovirt-45-upstream oVirt upstream for CentOS Stream 9 - oVirt 4.5 resilientstorage Rocky Linux 9 - Resilient Storage (0)[root@ovirt ~]# yum search ovirt-engine Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. Last metadata expiration check: 3:37:50 ago on Wed 14 Sep 2022 08:24:39 AM CEST. ======================================================================================================== Name Matched: ovirt-engine ======================================================================================================== ovirt-engine-appliance.x86_64 : The oVirt Engine Appliance image (OVA) ovirt-engine-extension-aaa-ldap.noarch : oVirt Engine LDAP Users Management Extension ovirt-engine-extension-aaa-ldap-setup.noarch : oVirt Engine LDAP Users Management Extension Setup Tool ovirt-engine-extensions-api.noarch : oVirt engine extensions API ovirt-engine-extensions-api-javadoc.noarch : oVirt engine extensions API documentation ovirt-engine-nodejs-modules.noarch : Node.js modules required to build oVirt JavaScript applications ovirt-engine-wildfly.x86_64 : WildFly Application Server for oVirt Engine python3-ovirt-engine-sdk4.x86_64 : oVirt Engine Software Development Kit (Python) (0)[root@ovirt ~]# yum install ovirt-engine Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. Last metadata expiration check: 3:37:57 ago on Wed 14 Sep 2022 08:24:39 AM CEST. No match for argument: ovirt-engine Error: Unable to find a match: ovirt-engine (1)[root@ovirt ~]# (1)[root@ovirt ~]# yum search ovirt-hosted Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. Last metadata expiration check: 3:46:40 ago on Wed 14 Sep 2022 08:24:39 AM CEST. ======================================================================================================== Name Matched: ovirt-hosted ======================================================================================================== ovirt-hosted-engine-ha.noarch : oVirt Hosted Engine High Availability Manager ovirt-hosted-engine-setup.noarch : oVirt Hosted Engine setup tool (0)[root@ovirt ~]# (0)[root@ovirt ~]# yum whatprovides engine-setup Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. Last metadata expiration check: 3:51:37 ago on Wed 14 Sep 2022 08:24:39 AM CEST. Error: No Matches found (1)[root@ovirt ~]# (1)[root@ovirt ~]# yum install ovirt-engine-appliance.x86_64 Updating Subscription Management repositories. Unable to read consumer identity This system is not registered with an entitlement server. You can use subscription-manager to register. Last metadata expiration check: 4:08:35 ago on Wed 14 Sep 2022 08:24:39 AM CEST. Dependencies resolved. ============================================================================================================================================================================================================================================ Package Architecture Version Repository Size ============================================================================================================================================================================================================================================ Installing: ovirt-engine-appliance x86_64 4.5-20220419160254.1.el9 ovirt-45-upstream 1.6 G Transaction Summary ============================================================================================================================================================================================================================================ Install 1 Package Total size: 1.6 G Installed size: 1.6 G Is this ok [y/N]: y Downloading Packages: [SKIPPED] ovirt-engine-appliance-4.5-20220419160254.1.el9.x86_64.rpm: Already downloaded oVirt upstream for CentOS Stream 9 - oVirt 4.5 2.8 MB/s | 2.9 kB 00:00 Importing GPG key 0xFE590CB7: Userid : "oVirt <infra(a)ovirt.org>" Fingerprint: 31A5 D783 7FAD 7CB2 86CD 3469 AB8C 4F9D FE59 0CB7 From : /etc/pki/rpm-gpg/RPM-GPG-KEY-oVirt-4.5 Is this ok [y/N]: y Key import failed (code 2). Failing package is: ovirt-engine-appliance-4.5-20220419160254.1.el9.x86_64 GPG Keys are configured as: file:///etc/pki/rpm-gpg/RPM-GPG-KEY-oVirt-4.5 The downloaded packages were saved in cache until the next successful transaction. You can remove cached packages by executing 'yum clean packages'. Error: GPG check FAILED (1)[root@ovirt ~]#

2 1

Re: Error during deployment of ovirt-engine
by Peter H 19 Sep '22

19 Sep '22

Hi Jonas, I get the same error when I try to install. Last weekend I managed to do it (but with a lot of other problems) so something has changed during the week. After the VM is up I logged in through ssh and saw that the oVirt appliance comes with Python-3.6 and Python-3.8 which both have netaddr installed. Part of the log: ... [ INFO ] TASK [ovirt.ovirt.engine_setup : Update setup packages] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.engine_setup : Copy yum configuration file] [ INFO ] changed: [localhost -> 192.168.222.35] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set 'best' to false] [ INFO ] changed: [localhost -> 192.168.222.35] [ INFO ] TASK [ovirt.ovirt.engine_setup : Update all packages] [ INFO ] changed: [localhost -> 192.168.222.35] [ INFO ] TASK [ovirt.ovirt.engine_setup : Remove temporary yum configuration file] [ INFO ] changed: [localhost -> 192.168.222.35] [ INFO ] TASK [ovirt.ovirt.engine_setup : Set offline parameter if variable is set] ... I noticed that after the task "Update all packages" Python-3.9 gets installed and that version does not have netaddr installed. My theory is that the playbook somehow uses the newest version of Python which is installed. pip3.9 list Package Version ------------ ------- ansible-core 2.13.3 cffi 1.14.3 cryptography 3.3.1 idna 2.10 pip 20.2.4 ply 3.11 pycparser 2.20 PyYAML 5.4.1 setuptools 50.3.2 six 1.15.0 I have tried another run where I installed the netaddr module as soon as Python-3.9 got installed and that installation went further but then it had another error. When I log into my hosted engine VM from last week there is no Python-3.9. My dnf(1) skills are not good enough to figure out which dependency is causing Python-3.9 to be installed. There are probably a lot of other modules missing that can explain the other error(s) I see. I will see if I can find out how to file a proper bug report. BR Peter

2 1

Re: Should I migrate existing oVirt Engine, or deploy new?
by David White 19 Sep '22

19 Sep '22

Hi Paul, Thanks for the response. I think you're suggesting that I take a hybrid approach, and do a restore of the current Engine onto the new VM. I hadn't thought about this option. Essentially what I was considering was either: - Export to OVA or something OR - Build a completely new oVirt engine with a completely new domain, etc... and try to live migrate the VMs from the old engine to the new engine. Do I understand you correctly that you're suggesting I install the OS onto a new VM, and try to do a restore of the oVirt settings onto the new VM (after I put the cluster into Global maintenance mode and shutdown the old oVirt)? Sent with Proton Mail secure email. ------- Original Message ------- On Friday, August 19th, 2022 at 10:46 AM, Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk> wrote: > Hello David, > I don't think there's a documentated method to go from a Hosted Engine to standalone just the other way standalone to HE. > > I would suggest doing a full backup of the engine prepare the new VM and restore to that rather than trying to export it. > This way you can shut down the original engine and run the new engine VM to test it works as you will be able to restart the original engine if it doesn't work. > > Regards, > Paul S. > > > > > > From: David White via Users <users(a)ovirt.org> > Sent: 19 August 2022 15:27 > To: David White <dmwhite823(a)protonmail.com> > Cc: oVirt Users <users(a)ovirt.org> > Subject: [ovirt-users] Re: Should I migrate existing oVirt Engine, or deploy new? > > Caution External Mail: Do not click any links or open any attachments unless you trust the sender and know that the content is safe. > > In other words, I want to migrate the Engine from a hyperconverged environment into a stand-alone setup. > > > Sent with Proton Mail secure email. > > ------- Original Message ------- > On Friday, August 19th, 2022 at 10:17 AM, David White via Users <users(a)ovirt.org> wrote: > > > > Hello, > > I have just purchased a Synology SA3400 which I plan to use for my oVirt storage domain(s) going forward. I'm currently using Gluster storage in a hyperconverged environment. > > > > My goal now is to: > > > > - Use the Synology Virtual Machine manager to host the oVirt Engine on the Synology > > - Setup NFS storage on the Synology as the storage domain for all VMs in our environment > > - Migrate all VM storage onto the new NFS domain > > - Get rid of Gluster > > > > > > My first step is to migrate the oVirt Engine off of Gluster storage / off the Hyperconverged hosts into the Synology Virtual Machine manager. > > > > Is it possible to migrate the existing oVirt Engine (put the cluster into Global Maintenance Mode, shutdown oVirt, export to VDI or something, and then import into Synology's virtualization)? Or would it be better for me to install a completely new Engine, and then somehow migrate all of the VMs from the old engine into the new engine? > > > > Thanks, > > David > > > > > > Sent with Proton Mail secure email. > > To view the terms under which this email is distributed, please go to:- > https://leedsbeckett.ac.uk/disclaimer/email

2 2

Re: Gluster setup for oVirt
by Jonas 19 Sep '22

19 Sep '22

https://access.redhat.com/documentation/en-us/red_hat_hyperconverged_infras… > The logical volumes that comprise the engine gluster volume must be thick provisioned. This protects the Hosted Engine from out of space conditions, disruptive volume configuration changes, I/O overhead, and migration activity. Or is that extremely dated information? Am 18. September 2022 21:08:45 MESZ schrieb Strahil Nikolov via Users <users(a)ovirt.org>: >Can you share the RH recommendation to use Thick LV ? >Best Regards,Strahil Nikolov > > I don't have that anymore, but I assume that gluster_infra_lv_logicalvols requires a thin pool: https://github.com/gluster/gluster-ansible-infra/blob/master/roles/backend_… >_______________________________________________ >Users mailing list -- users(a)ovirt.org >To unsubscribe send an email to users-leave(a)ovirt.org >Privacy Statement: https://www.ovirt.org/privacy-policy.html >oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XQ4Q4SELENO6E… >

2 1

Migrating VM from old ovirt to a new one
by Facundo Badaracco 18 Sep '22

18 Sep '22

Hi everyone I would like to ask you a question I have an ovirt 4.4 which got corrupted certs and I can't access the gui. It gives me error 500 internal when I want to access. I have a new ovirt 4.5 on glusterfs which I would like to migrate all my vm's to. Is this possible? Can it be done by cli? It would save me from having to reinstall all the vm's.

2 1

Gluster setup for oVirt
by Jonas 18 Sep '22

18 Sep '22

Hello all I tried to setup Gluster volumes in cockpit using the wizard. Based on Red Hat's recommendations I wanted to put the Volume for the oVirt Engine on a thick provisioned logical volume [1] and therefore removed the line thinpoolname and corresponding configuration from the yml file (see below). Unfortunately, this approach was not successful. My solution is now to only create a data volume and manually create a thick provisioned gluster volume manually. What would you recommend doing? Thanks your any input :) Regards, Jonas [1]: https://access.redhat.com/documentation/en-us/red_hat_hyperconverged_infras… hc_nodes: hosts: server-005.storage.int.rabe.ch: gluster_infra_volume_groups: - vgname: vg_tier1_01 pvname: /dev/md/raid_tier1_gluster gluster_infra_mount_devices: - path: /gluster_bricks/tier1-ovirt-engine-01/gb-01 lvname: lv_tier1_ovirt_engine_01 vgname: vg_tier1_01 - path: /gluster_bricks/tier1-ovirt-data-01/gb-01 lvname: lv_tier1_ovirt_data_01 vgname: vg_tier1_01 blacklist_mpath_devices: - raid_tier1_gluster gluster_infra_thinpools: - vgname: vg_tier1_01 thinpoolname: lv_tier1_ovirt_data_01_tp poolmetadatasize: 16G gluster_infra_lv_logicalvols: - vgname: vg_tier1_01 lvname: lv_tier1_ovirt_engine_01 lvsize: 100G - vgname: vg_tier1_01 thinpool: lv_tier1_ovirt_data_01_tp lvname: lv_tier1_ovirt_data_01 lvsize: 16000G server-006.storage.int.rabe.ch: gluster_infra_volume_groups: - vgname: vg_tier1_01 pvname: /dev/md/raid_tier1_gluster gluster_infra_mount_devices: - path: /gluster_bricks/tier1-ovirt-engine-01/gb-01 lvname: lv_tier1_ovirt_engine_01 vgname: vg_tier1_01 - path: /gluster_bricks/tier1-ovirt-data-01/gb-01 lvname: lv_tier1_ovirt_data_01 vgname: vg_tier1_01 blacklist_mpath_devices: - raid_tier1_gluster gluster_infra_thinpools: - vgname: vg_tier1_01 thinpoolname: lv_tier1_ovirt_data_01_tp poolmetadatasize: 16G gluster_infra_lv_logicalvols: - vgname: vg_tier1_01 lvname: lv_tier1_ovirt_engine_01 lvsize: 100G - vgname: vg_tier1_01 thinpool: lv_tier1_ovirt_data_01_tp lvname: lv_tier1_ovirt_data_01 lvsize: 16000G server-007.storage.int.rabe.ch: gluster_infra_volume_groups: - vgname: vg_tier0_01 pvname: /dev/md/raid_tier0_gluster gluster_infra_mount_devices: - path: /gluster_bricks/tier1-ovirt-engine-01/gb-01 lvname: lv_tier1_ovirt_engine_01 vgname: vg_tier0_01 - path: /gluster_bricks/tier1-ovirt-data-01/gb-01 lvname: lv_tier1_ovirt_data_01 vgname: vg_tier0_01 blacklist_mpath_devices: - raid_tier0_gluster gluster_infra_thinpools: - vgname: vg_tier0_01 thinpoolname: lv_tier1_ovirt_data_01_tp poolmetadatasize: 1G gluster_infra_lv_logicalvols: - vgname: vg_tier0_01 lvname: lv_tier1_ovirt_engine_01 lvsize: 20G - vgname: vg_tier0_01 thinpool: lv_tier1_ovirt_data_01_tp lvname: lv_tier1_ovirt_data_01 lvsize: 32G vars: gluster_infra_disktype: JBOD gluster_infra_daling: 1024K gluster_set_selinux_labels: true gluster_infra_fw_ports: - 2049/tcp - 54321/tcp - 5900/tcp - 5900-6923/tcp - 5666/tcp - 16514/tcp gluster_infra_fw_permanent: true gluster_infra_fw_state: enabled gluster_infra_fw_zone: public gluster_infra_fw_services: - glusterfs gluster_features_force_varlogsizecheck: false cluster_nodes: - server-005.storage.int.rabe.ch - server-006.storage.int.rabe.ch - server-007.storage.int.rabe.ch gluster_features_hci_cluster: '{{ cluster_nodes }}' gluster_features_hci_volumes: - volname: tier1-ovirt-engine-01 brick: /gluster_bricks/tier1-ovirt-engine-01/gb-01 arbiter: 1 - volname: tier1-ovirt-data-01 brick: /gluster_bricks/tier1-ovirt-data-01/gb-01 arbiter: 1

4 4

static IP with OVN subnet
by ravi k 16 Sep '22

16 Sep '22

Hello, Hope you are all doing well. We have an interesting thing going on and so wanted to share with you all for some ideas and feedback. We configured a cluster with OVS switch and added an external network with subnet. So OVN started managing the subnet using DHCP. But here's the problem. When we add a nic with this network, an ip is assigned by DHCP. But we want an IP of our choice to be assigned. Here's what we tried. 1. We tried using the ovn-nbctl lsp-set-address like ovn-nbctl lsp-set-addresses 7840c97b-73c2-4246-a2a8-0e9e5b7f420a "56:6f:6b:54:00:ec 10.19.3.8" to update the static IP. But this does not persist a NIC unplug or a VM reboot. So you might ask why not just try assigning a static IP and not add the external subnet. We want to use security groups. For security groups to work, the ip assigned to the NIC and the IP in the value for fixed_ips in `openstack port show` should be the same. So the same thing repeats here as well. If we use the `openstack port set` to update the fixed_ips, a NIC unplug or a VM reboot will remove the IP. We have an internal IPAM that provides us IPs during our automated provisioning. Did anyone try this or have any ideas how to work around this? The only option seems to be just use DHCP and then update that IP in our internal IPAM tool. Please let me know if I'm unclear and any more info is required. Regards, rav

1 0

How does ovirt use cloudbase-init to initialize the Windows image
by labose＠126.com 16 Sep '22

16 Sep '22

How does ovirt use cloudbase-init to initialize the Windows image? Sorry, I'm a beginner. I don't know if I use cloudbase-init, I install this program in the virtual machine image, but I don't know how to operate it in the ovirt console.

1 0

Re: Network usage for VMs not displayed
by jplorier＠gmail.com 16 Sep '22

16 Sep '22

Hi, I have the same scenario with 4.0 setup El vie, 16 de sep. de 2022 5:58 a. m., <users-request(a)ovirt.org> escribió: > Send Users mailing list submissions to > users(a)ovirt.org > > To subscribe or unsubscribe via email, send a message with subject or > body 'help' to > users-request(a)ovirt.org > > You can reach the person managing the list at > users-owner(a)ovirt.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Users digest..."Today's Topics: > > 1. Re: Error during deployment of ovirt-engine (Jonas) > 2. Re: Error during deployment of ovirt-engine (Yedidyah Bar David) > 3. Resize hosted-engine disk (Jorge Visentini) > 4. Network usage for VMs not displayed (0%) (Ricardo Alonso) > > > > ---------- Forwarded message ---------- > From: Jonas <jonas(a)rabe.ch> > To: Yedidyah Bar David <didi(a)redhat.com>, oVirt Users <users(a)ovirt.org> > Cc: > Bcc: > Date: Thu, 15 Sep 2022 21:46:37 +0200 > Subject: [ovirt-users] Re: Error during deployment of ovirt-engine > Ok, thanks for the info. Do you have any further information? > > On 9/15/22 09:11, Yedidyah Bar David wrote: > > On Wed, Sep 14, 2022 at 11:31 PM Jonas <jonas(a)rabe.ch> wrote: > >> Ok even after resetting the password through SSH it is not accepted on > the web page. > >> > >> [root@ovirt-engine-test ~]# ovirt-aaa-jdbc-tool user password-reset > admin --password-valid-to="2222-09-14 20:07:39Z" --password="interactive:" > --force > >> Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false > >> Password: > >> Reenter password: > >> updating user admin... > >> user updated successfully > >> > >> On 9/14/22 21:40, Jonas wrote: > >> > >> Hello all > >> > >> I'm trying to deploy an oVirt Engine through the cockpit interface. > Unfortunately the deployment fails with the following error: > > Sorry, but the cockpit hosted-engine deployment is broken. Please use > > the CLI. Thanks. > > > > Best regards, > > > ---------- Forwarded message ---------- > From: Yedidyah Bar David <didi(a)redhat.com> > To: Jonas <jonas(a)rabe.ch> > Cc: oVirt Users <users(a)ovirt.org> > Bcc: > Date: Thu, 15 Sep 2022 23:01:26 +0300 > Subject: [ovirt-users] Re: Error during deployment of ovirt-engine > On Thu, Sep 15, 2022 at 10:46 PM Jonas <jonas(a)rabe.ch> wrote: > > > > Ok, thanks for the info. Do you have any further information? > > Not sure what you mean. How to deploy HE using the CLI? Here: > > > https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engin… > > Best regards, > > > > > On 9/15/22 09:11, Yedidyah Bar David wrote: > > > On Wed, Sep 14, 2022 at 11:31 PM Jonas <jonas(a)rabe.ch> wrote: > > >> Ok even after resetting the password through SSH it is not accepted > on the web page. > > >> > > >> [root@ovirt-engine-test ~]# ovirt-aaa-jdbc-tool user password-reset > admin --password-valid-to="2222-09-14 20:07:39Z" --password="interactive:" > --force > > >> Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false > > >> Password: > > >> Reenter password: > > >> updating user admin... > > >> user updated successfully > > >> > > >> On 9/14/22 21:40, Jonas wrote: > > >> > > >> Hello all > > >> > > >> I'm trying to deploy an oVirt Engine through the cockpit interface. > Unfortunately the deployment fails with the following error: > > > Sorry, but the cockpit hosted-engine deployment is broken. Please use > > > the CLI. Thanks. > > > > > > Best regards, > > > > > -- > Didi > > > > ---------- Forwarded message ---------- > From: Jorge Visentini <jorgevisentini(a)gmail.com> > To: users <users(a)ovirt.org> > Cc: > Bcc: > Date: Fri, 16 Sep 2022 00:53:15 -0300 > Subject: [ovirt-users] Resize hosted-engine disk > Hi all. > Is it possible to resize the disk of the HostedEngine VM? > I resized the LUN on Storage, but I can't resize the disk/LVM. > > How is it possible to resize the disk? > > All the best! > -- > Att, > Jorge Visentini > +55 55 98432-9868 > > > > ---------- Forwarded message ---------- > From: Ricardo Alonso <ricardoalonsos(a)gmail.com> > To: users <users(a)ovirt.org> > Cc: > Bcc: > Date: Fri, 16 Sep 2022 09:57:48 +0100 > Subject: [ovirt-users] Network usage for VMs not displayed (0%) > Hello guys, > > I notice for several weeks that the network usage is displaying 0% for all > VMs. I notice an old message ( > https://lists.ovirt.org/archives/list/users@ovirt.org/thread/NNK6ERGAWDGIOL…) > but still seems to have no solution. > > Also on Grafana, no data is displayed. Has anyone noticed this issue? I > can open a bug to verify. > > Best regards, > -- > Ricardo Alonso > ricardoalonsos(a)gmail.com > +44 7340-546916 > Skype: ricardoalonso > GPG Fingerprint: FC7E 4A5F B7A4 > 87F4 6876 5325 D95F BFBF B7AC EE54 > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ >

1 0

Network usage for VMs not displayed (0%)
by Ricardo Alonso 16 Sep '22

16 Sep '22

Hello guys, I notice for several weeks that the network usage is displaying 0% for all VMs. I notice an old message ( https://lists.ovirt.org/archives/list/users@ovirt.org/thread/NNK6ERGAWDGIOL…) but still seems to have no solution. Also on Grafana, no data is displayed. Has anyone noticed this issue? I can open a bug to verify. Best regards, -- Ricardo Alonso ricardoalonsos(a)gmail.com +44 7340-546916 Skype: ricardoalonso GPG Fingerprint: FC7E 4A5F B7A4 87F4 6876 5325 D95F BFBF B7AC EE54

1 0

Resize hosted-engine disk
by Jorge Visentini 16 Sep '22

16 Sep '22

Hi all. Is it possible to resize the disk of the HostedEngine VM? I resized the LUN on Storage, but I can't resize the disk/LVM. How is it possible to resize the disk? All the best! -- Att, Jorge Visentini +55 55 98432-9868

1 0

Certificate doesn't contain valid subject alternative name
by Ayansh Rocks 15 Sep '22

15 Sep '22

Hi All, I am getting below alert on my single node ovirt. Can anyone tell me more about it and how I can fix it.I am using ovirt 4.3.8.2. Certificate of host host-name.example.com is invalid. The certificate doesn't contain valid subject alternative name, please enroll new certificate for the host. Thank you

3 5

OLVM gets error "VDSM hostname command AddImageTicketVDS failed: Image daemon is unsupported: ()" when uploading iso file
by Raul Diaz 14 Sep '22

14 Sep '22

Hello guys. I'm new with OLVM and KVM. Right now I have installed a fresh OL8 with kvm in an HPE Superdome Flex. And I have installed OLVM in a VMware VM, but when I want to upload an iso file to create a VM in the KVM I get an error "VDSM hostname command AddImageTicketVDS failed: Image daemon is unsupported: ()" This is my environment: KVM - OL8.6; qemu-kvm-6.2.0-11 HPE Superdome Flex OLVM - OL8.6; ovirt-engine-4.4.10.7-1.0.10.el8.noarch, VMware Virtual Machine. Best regards.

3 2

Ovirt version 4.4.9.5-1.el8 vm doesn't start after power outage
by florianvanoudgaarden＠gmail.com 14 Sep '22

14 Sep '22

After we had a power outrage 2 of my 7 vm's doesn't start anymore. When i look at the logfile while starting i get the following errors in the engine.log 2022-09-14 15:18:29,078+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-138161) [40d05c63] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command GetVmLeaseInfoVDS failed: Command ['/usr/bin/dd', 'if=/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases', 'iflag=direct,skip_bytes', 'skip=1048576', 'bs=253952', 'count=1'] failed with rc=1 out='[suppressed]' err=b"/usr/bin/dd: failed to open '/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases': No such file or directory\n" 2022-09-14 15:18:29,079+02 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (EE-ManagedThreadFactory-engine-Thread-138161) [40d05c63] IrsBroker::Failed::GetVmLeaseInfoVDS: IRSGenericException: IRSErrorException: Failed to GetVmLeaseInfoVDS, error = Command ['/usr/bin/dd', 'if=/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases', 'iflag=direct,skip_bytes', 'skip=1048576', 'bs=253952', 'count=1'] failed with rc=1 out='[suppressed]' err=b"/usr/bin/dd: failed to open '/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases': No such file or directory\n", code = 100 2022-09-14 15:18:29,085+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmLeaseInfoVDSCommand] (EE-ManagedThreadFactory-engine-Thread-138161) [40d05c63] FINISH, GetVmLeaseInfoVDSCommand, return: , log id: 7d38bb40 2022-09-14 15:18:29,085+02 ERROR [org.ovirt.engine.core.bll.storage.lease.GetVmLeaseInfoCommand] (EE-ManagedThreadFactory-engine-Thread-138161) [40d05c63] Failure in getting lease info for VM '831e1a9d-2f87-48b5-af69-93d13f24d95d' from storage domains 'd036345b-be92-453d-a822-c08977fe3982', message: EngineException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to GetVmLeaseInfoVDS, error = Command ['/usr/bin/dd', 'if=/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases', 'iflag=direct,skip_bytes', 'skip=1048576', 'bs=253952', 'count=1'] failed with rc=1 out='[suppressed]' err=b"/usr/bin/dd: failed to open '/rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md/xleases': No such file or directory\n", code = 100 (Failed with error GeneralException and code 100) What noticed is the "No such file or directory" message so did a manual look at the "dom_md" directory and i notice the file "xleases" doesn't exist. Output from commandline listing [root@ovirt dom_md]# ll totaal 4 -rw-rw----. 1 vdsm kvm 0 14 jan 2022 ids -rw-rw----. 1 vdsm kvm 16777216 14 jan 2022 inbox -rw-rw----. 1 vdsm kvm 0 14 jan 2022 leases -rw-r--r--. 1 vdsm kvm 481 14 jan 2022 metadata -rw-rw----. 1 vdsm kvm 16777216 14 jan 2022 outbox [root@ovirt dom_md]# pwd /rhev/data-center/mnt/_data_images/d036345b-be92-453d-a822-c08977fe3982/dom_md What can I do to get the 2 vm's started again?

1 0

How to restore full vmbackups that was created with backup_vm.py
by Don Dupuis 13 Sep '22

13 Sep '22

Hello I have used the backup_vm.py script in 4.5.2.4 to make full backups of my vms to a nfs share. What is the process to restore the backups if needed? Thanks Don

2 2

gerrit.ovirt.org migration
by Denis Volkov 13 Sep '22

13 Sep '22

Hello There's a migration of gerrit to another server. Server should change IP address I'll post update when it's done -- Denis Volkov

1 1

Failure Of Latest oVirt Installation - Missing Packages
by Matthew J Black 13 Sep '22

13 Sep '22

Hi All, This is all on a Rocky Linux 8.6 box, as a CLI oVirt self-hosted engine install. I have followed all of the instructions (include the special RHEL and derivatives and Rocky Linux instructions) in the oVirt documentation. So, I'm attempting to install the ovirt-hosted-engine-setup rpm (ie dnf -y install ovirt-hosted-engine-setup), and I'm getting failures involving the following packages (ie the following packages cannot be found): - collectd >= 5.12.0-7 - collectd-disk >= 5.12.0-7 - collectd-write_http >= 5.12.0-7 - collectd-write_syslog >= 5.12.0-7 - collectd-netlink >= 5.12.0-7 - collectd-virt >= 5.12.0-7 - python3-os-brick The full dnf error message is: ~~~ Error: Problem: package ovirt-hosted-engine-setup-2.6.5-1.el8.noarch requires ovirt-host >= 4.5.0, but none of the providers can be installed - package ovirt-host-4.5.0-3.el8.x86_64 requires ovirt-host-dependencies = 4.5.0-3.el8, but none of the providers can be installed - cannot install the best candidate for the job - nothing provides collectd >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides collectd-disk >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides collectd-write_http >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides collectd-write_syslog >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides collectd-netlink >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides collectd-virt >= 5.12.0-7 needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 - nothing provides python3-os-brick needed by ovirt-host-dependencies-4.5.0-3.el8.x86_64 ~~~ Doing a dnf with --nobest produces similar results ie: ~~~ Error: Problem: conflicting requests - package ovirt-hosted-engine-setup-2.6.3-1.el8.noarch requires ovirt-host >= 4.5.0, but none of the providers can be installed - package ovirt-hosted-engine-setup-2.6.4-1.el8.noarch requires ovirt-host >= 4.5.0, but none of the providers can be installed - package ovirt-hosted-engine-setup-2.6.5-1.el8.noarch requires ovirt-host >= 4.5.0, but none of the providers can be installed etc ~~~ In all of the repos (& mirrors) I've looked at the latest version of collectd* (for EL8) is 5.9.0-5, and I can't locate python3-os-block at all. pkgs.org says that even the version of collectd* in the Centos 8 Repos is v5.9.0-5 in the EPEL EL8 repo. According to rpmfind.net there is a 5.12.0-23 version of collectd* in the EPEL EL9 repo, but I read somewhere that oVirt is not-production-ready on EL9, so I don't have the EPEL EL9 repo "available". pkgs.org says that the only versions it knows about for pyton3-os-brick are for Debian and Ubuntu, and rpmfind.net doesn't list it at all (which makes sense if there are only versions from Debia-based distros). Could someone please point me towards an EL8 repo where I can get the required packages, or, if I'm being totally stupid, what I'm doing wrong? Thanks in advance Dulux-Oz

2 6

Slow upload via oVirt Manager
by markeczzz＠gmail.com 13 Sep '22

13 Sep '22

Hi! I am trying to upload some rather large disk images via oVirt Web Manager, but I am getting rather slow speeds. Network is 1Gbps between my pc and oVirt node via which I am uploading, but I am getting around 200Mbps transfer speed. Last time when I was uploading was when I had version 4.4 of oVirt and I haven't had that problem then. Now I am using latest version. Any steps how to troubleshoot this?

1 0

vdsm.log full of "error" because node don't run the "engine"
by Diego Ercolani 12 Sep '22

12 Sep '22

Hello, I don't know if it's normal but in all the nodes of the cluster (except the one that runs the engine) I have something like: 2022-09-12 15:41:54,563+0000 INFO (jsonrpc/0) [api.virt] START getStats() from=::1,57578, vmId=8486ed73-df34-4c58-bfdc-7025dec63b7f (api:48) 2022-09-12 15:41:54,563+0000 INFO (jsonrpc/0) [api] FINISH getStats error=Virtual machine does not exist: {'vmId': '8486ed73-df34-4c58-bfdc-7025dec63b7f'} (api:129) 2022-09-12 15:41:54,563+0000 INFO (jsonrpc/0) [api.virt] FINISH getStats return={'status': {'code': 1, 'message': "Virtual machine does not exist: {'vmId': '8486ed73-df34-4c58-bfdc-7025dec63b7f'}"}} from=::1,57578, vmId=8486ed73-df34-4c58-bfdc-7025dec63b7f (api:54) 2022-09-12 15:41:54,563+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call VM.getStats failed (error 1) in 0.00 seconds (__init__:312) The UUID 8486ed73-df34-4c58-bfdc-7025dec63b7f is the UUID of the Hosted-engine VM, obviously it run only in one noe and, as I undestand, the other nodes are querying the VM state only to fence the VMs if is started on more node at a time... but having the log full of these "error" are annoying. I would prefer to have the word "error" only in meaningful context. This if the hypotesis of my interpretation is correct, if it's a true error, then please address me how to fix it. Thank you.

1 0