- Users - oVirt List Archives

Creating an oVirt Engine Appliance on a different EL Distro (eg Rocky Linux)
by Matthew J Black 03 Oct '22

03 Oct '22

Hi All, Here's an interesting question: What is the process (ie the Step-By-Step process) to create an/the oVirt Engine Appliance based on another version of EL (ie in my case, Rocky Linux)? Is there a "Manual" somewhere? I mean, surely the oVirt Project's Release Manager has *something* that they follow to create the relevant rpm file - no? Cheers Dulux-Oz

4 4

ovirt-engine-appliance Location (Pre-Installation)
by Matthew J Black 03 Oct '22

03 Oct '22

Hi All, A couple of Qs: During the `TASK [ovirt.ovirt.engine_setup : Install oVirt Engine package]` stage of the Management Engine deployment, is this trying to install the ovirt-engine-appliance, or something else? When we do a pre-install of the ovirt-engine-appliance (ie dnf install ovirt-engine-appliance) where is this installed too, so that we can enter this information into the deployment script at the `Engine Appliance Image Path` stage? Cheers Dulux-Oz

3 2

Totally outstanding disk performance
by murilo＠evocorp.com.br 01 Oct '22

01 Oct '22

Good evening everyone. I'm implementing oVirt in my infrastructure using Ceph as Storage (I'm using 10 Gibabits interfaces), I managed to raise the Storage correctly, reaching rates of 1.2 Gigabytes per second via NFS. When I went to depoy the hosted-engine via NFS, everything went fine, but when I booted the first VM and tested the disk's performance, I got very low rates. Depending on how I'm writing to disk, I get rates of only 88 Megabytes per second, far below what was expected. Through FIO I get approximately 250 Megabytes per second, which is still quite low compared to what I can get via NFS on the same Host. I've already tried some Disk Cache configurations and tried to put CephFS as Storage Domain, but I always achieve the same rate, always with the IOPS quite low. Is there anything else I can do to try to improve these rates? Because I'm finding this quite weird considering how much data I can reach between the Host and Storage.

1 0

Uncaught exception on Network Interfaces tab of a newly added host to oVirt 4.5.0
by Hean-Seng Tan 01 Oct '22

01 Oct '22

I added a few hosts to oVirt that runs engine version 4.5.0.8-1.el8. Most of the hosts work well except that Network Interfaces tab of a host shows the below error on the web browser: Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read properties of null (reading 'e') Please have your administrator check the UI logs I tried the following steps but they do not help: - clearing web browser cache - using a different web browser - deleting and re-adding the host back to oVirt /var/log/ovirt-engine/ui.log logged below error when the network interface tab of the host was accessed: 2022-09-28 01:52:51,527Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-1381) [] Permutation name: 06C89A2CB3005B8E9B9129A6A121B6E2 2022-09-28 01:52:51,527Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-1381) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : a is null at java.math.Elementary.add(Elementary.java:52) at org.ovirt.engine.ui.webadmin.widget.host.HostNetworkInterfaceBondedListViewItem$8.$getValue(HostNetworkInterfaceBondedListViewItem.java:167) at org.ovirt.engine.ui.webadmin.widget.host.HostNetworkInterfaceBondedListViewItem$8.getValue(HostNetworkInterfaceBondedListViewItem.java:167) at com.google.gwt.user.cellview.client.Column.render(Column.java:164) at com.google.gwt.user.cellview.client.AbstractCellTableBuilder.$renderCell(AbstractCellTableBuilder.java:188) at com.google.gwt.user.cellview.client.DefaultCellTableBuilder.$buildRowImpl(DefaultCellTableBuilder.java:62) at com.google.gwt.user.cellview.client.AbstractCellTableBuilder.$buildRow(AbstractCellTableBuilder.java:85) at com.google.gwt.user.cellview.client.AbstractCellTable.$buildRowValues(AbstractCellTable.java:2350) at com.google.gwt.user.cellview.client.AbstractCellTable.replaceAllChildren(AbstractCellTable.java:2149) at com.google.gwt.user.cellview.client.AbstractHasData$View.replaceAllChildren(AbstractHasData.java:265) at com.google.gwt.user.cellview.client.HasDataPresenter.$resolvePendingState(HasDataPresenter.java:1062) at com.google.gwt.user.cellview.client.HasDataPresenter$2.execute(HasDataPresenter.java:981) at com.google.gwt.core.client.impl.SchedulerImpl.runScheduledTasks(SchedulerImpl.java:167) at com.google.gwt.core.client.impl.SchedulerImpl.$flushFinallyCommands(SchedulerImpl.java:272) at com.google.gwt.core.client.impl.Impl.exit(Impl.java:383) at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:345) at Unknown.Ny/<(https://atlnpkvmoc01.amd.com/ovirt-engine/webadmin/?locale=en_US line 9 > injectedScript) at Unknown.anonymous(Unknown) Does anyone have any idea of what could be wrong?

1 1

adding foreman as an external provider
by eevans＠digitaldatatechs.com 30 Sep '22

30 Sep '22

I had an ovirt engine failure which corrupted my foreman/katello vm. My ovirt-engine is 4.3 and I was using foreman 3.0 with Katello 4.5. Once the ovirt-engine was repaired, still 4.3, I updated the foreman katello install to foreman 3.3 and Katello 4.5. I can connect from foreman to Ovirt as a compute resource but cannot add foreman to ovirt as an external provider. The engine.log: 2022-09-30 15:51:24,213-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-158) [12e3a290-09e7-42b3-a849-e57b56bc338d] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:51:24,214-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-158) [12e3a290-09e7-42b3-a849-e57b56bc338d] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 15:52:26,240-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-162) [33322f35-2e34-4e64-bda7-dd43c5d9c157] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:52:26,240-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-162) [33322f35-2e34-4e64-bda7-dd43c5d9c157] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 15:54:53,279-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-164) [8d49c923-9269-4637-a858-659ede223c0a] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 15:54:53,280-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-164) [8d49c923-9269-4637-a858-659ede223c0a] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:19:31,467-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-164) [320557dc-da95-4cb2-9a58-735fe960dc78] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:19:31,468-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-164) [320557dc-da95-4cb2-9a58-735fe960dc78] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:29:40,606-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-5) [2e10f6a6-36e3-4812-a029-c64c2bf927e8] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:29:40,607-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-5) [2e10f6a6-36e3-4812-a029-c64c2bf927e8] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:54:19,240-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-2) [5c103548-4b63-48a7-a76e-89175d76dd62] Exception is https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… 2022-09-30 16:54:19,240-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-2) [5c103548-4b63-48a7-a76e-89175d76dd62] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: https://katello.digitaldatatechs.com:443/api/v2/discovered_hosts?format=jso… (Failed with error PROVIDER_FAILURE and code 5050) 2022-09-30 16:55:02,397-04 ERROR [org.ovirt.engine.core.bll.host.provider.foreman.ForemanHostProviderProxy] (default task-4) [5f2e8594-6b91-4ff6-8bdb-73df987ccf94] Exception is Server returned HTTP response code: 401 for URL: https://katello.digitaldatatechs.com:443/api/v2 2022-09-30 16:55:02,398-04 ERROR [org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand] (default task-4) [5f2e8594-6b91-4ff6-8bdb-73df987ccf94] Command 'org.ovirt.engine.core.bll.provider.TestProviderConnectivityCommand' failed: EngineException: Server returned HTTP response code: 401 for URL: https://katello.digitaldatatechs.com:443/api/v2 (Failed with error PROVIDER_FAILURE and code 5050) The foreman host name and IP are the same. I believe it's a certificate error vnd renamed the katello certs with a .bak suffix. I'm not sure ifit's a compatability issue but I researched it to death and so far came up empty. Any help would be appreciated. Thanks, Eric

1 0

Permissions
by boris.golemovic＠eir.ie 29 Sep '22

29 Sep '22

Hi Does anybody have any solution that I want give some user or group permissions to create vm and fully manage only vm what he creates. So users should not be able to see or make any changes on vm what are not created by him/groups where user belong,

2 1

Storage domain deletion not possible because not possible to detach
by Diego Ercolani 28 Sep '22

28 Sep '22

(I'm always talking about the last ovirt version that is currently engine: 4.5.2.5-1.el8, node: ovirt-node-ng-4.5.2-0.20220810.0) I tried to add an iSCSI storage domain adding a new vlan network where the storage is attached.... this gave a completely mess-up of the storage engine. I would like to restart the procedure again and to accomplish this I have do remove the storage domain. To do this, I added manually the vlan to the nodes as I'm configured using linux bridge simple networking, so I discovered I have not to manage ovs environment. I currently have the storage domain in maintenance mode and I've successfully regenerated the discovery informations as the network to connecto to the storage is online. But I cannot detach the storage and I cannot activate the storage domain, so I'm completely stuck. This is the related log in the engine while I was trying to detach the storage: 2022-09-26 07:20:48,043Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (EE-ManagedThreadFactory-engine-Thread-55008) [7a5a5413-36d0-4a15-b555-c9801f92483d] Command 'DetachStorageDomainVDSCommand( DetachStorageDomainVDSCommandParameters:{storagePoolId='da146814-f823-40e0-bd7b-8478dcfa38cd', ignoreFailoverLimit='false', storageDomainId='aac79175-ab2b-4b5b-a6e4-9feef9ce17ab', masterDomainId='00000000-0000-0000-0000-000000000000', masterVersion='8', force='false'})' execution failed: IRSGenericException: IRSErrorException: Storage domain not in pool: 'domain=aac79175-ab2b-4b5b-a6e4-9feef9ce17ab, pool=da146814-f823-40e0-bd7b-8478dcfa38cd' as you can see it seem there is a problem in the engine database. I saw here (https://lists.ovirt.org/pipermail/users/2015-January/030504.html) that someone worked directly on the engine db to delete the storage domain but I read somewhere else that the domain information is also mapped in a lvm volume metadata. What can I do from here? Thank you.

1 1

Editing vm devices
by Patrick Hibbs 28 Sep '22

28 Sep '22

Hello, I was trying to get some guest os hardware working and ultimately had to use the qemu-cmdline vdsm hook to set the pci bus id and address for a given vm device. I noticed that ovirt had a vmdevices tab in the Admin UI with this information in it, but it could not be edited. After looking through things I found this: https://www.ovirt.org/develop/release-management/features/virt/expose-vm-de… Apparently ovirt had at one point planned on allowing the administrator to change individual vm device properties, and some of this support such as the property persistence in the ovirt database, was already implemented. The only thing that seems to be missing is marking the fields in the Admin UI as editable, and the hook to update the database from those fields. Does anyone know if there are any plans on actually finishing this feature and getting it into a ovirt release? Or if not, why? The linked page is outdated, and claims the original target was ovirt 3.6. -Patrick Hibbs

2 2

ovirtmgmt Bridge - Which NIC? - Advice Please
by Matthew J Black 28 Sep '22

28 Sep '22

I need a quick piece of advice, please. I'm at setting up the oVirt Engine VM (ie doing a "hosted-engine --deploy") stage. The Host has 3 NICs. NIC_1 and NIC_2 are bonded (bond1) and run 2 VLANs (on bond1.1 and bond1.2). VLAN_1 is to be used as the "everyday connection VLAN for the VMs" (including the oVirt Engine VM - I think). VLAN_2 is *only* to be used for data traffic to-and-from our Ceph Cluster (ie via the Ceph iSCSI Gateway Nodes). NIC_3 (running VLAN_3) is to be used for oVirt-host-to-oVirt-host comms (including "local" Gluster traffic - yes, the (oVirt) hosts are running a couple of Gluster drives). My question is: Which interface should we use for the "ovirtmgmt" Bridge? I suspect it should be NIC_3 (VLAN_3), and I'm 99.999% sure it *shouldn't* be bond1.2 (VLAN_2), but it might be bond1.1 (VLAN_1), so I thought I'd better get peoples' input. You see, I'm not sure what the purpose of the "ovirtmgmt" bridge is. Is it for humans to talk to the oVirt Engine, or is it for the oVirt Engine to talk to the VMs (and hosts), or is it for some other purpose, or is it for some combination of the these? (I have read the doco on the ovirtmgmt bridge, and I'm still somewhat confused.) So, if someone wouldn't mind getting back to me about this, I'd appreciate it. Cheers Dulux-Oz

3 2

Backup/restore of Hosted Engine VM
by Volenbovskyi, Konstantin 27 Sep '22

27 Sep '22

Hi, I am aware that there is a procedure of backup/restore documented in https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/ht… , but I would like to have also else as well when it comes to backup (and restore) of hosted engine VM and avoid using hosted-engine --deploy / engine-backup Is anyone doing Libvirt snapshot or any other similar thing to back up ovengine VM? Part of that is the XML of the HE VM should be intact, so currently I am considering https://libvirt.org/kbase/live_full_disk_backup.html#full-backup-with-older… and https://gist.github.com/cabal95/e36c06e716d3328b512 BR, Konstantin

2 1

No online ovirt conference this year?
by Nathanaël Blanchet 27 Sep '22

27 Sep '22

Hello ovirt community, Will there be an upcoming ovirt conference this year? Last year it took place on mi- September. Cheers,

2 1

Manually Remove Snapshots
by Clint Boggio 26 Sep '22

26 Sep '22

I've got a VM with a pair of snapshots that won't delete and I'm needing a procedure to manually remove the snapshots. I don't need the VM and so while i'd prefer not to destroy it, it wouldn't be critical if I did damage the VM in the process. When I try to delete the snapshots that procedure fails, and when I try to delete the disk that procedure fails. Any pointers would be greatly appreciated.

2 6

Hosted-Engine VM wont start after physical CPU change
by douglasddr8＠gmail.com 25 Sep '22

25 Sep '22

I currently have a selfhosted engine with two cascadelake xeon silver 4208 cpu with 8 cores I changed both to two skylake xeon platinum 8160 with 24cores After initialization the vm hosted-engine wont start, I found in the logs that the cpu is not compatible because its not contain the avx512vnni flag Is it possible to work around the problem or these processors cannot be used?

1 0

Certificate expiration
by Joseph Gelinas 23 Sep '22

23 Sep '22

Hi, The certificates on our oVirt stack recently expired, while all the VMs are still up, I can't put the cluster into global maintenance via ovirt-engine, or do anything via ovirt-engine for that matter. Just get event logs about cert validity. VDSM ovirt-1.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed VDSM ovirt-2.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed VDSM ovirt-3.xxxxx.com command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed Under Compute -> Hosts, all are status Unassigned. Default data center is status Non Responsive. I have tried a couple of solutions to regenerate the certificates without much luck and have copied the originals back in place. https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/ht… https://access.redhat.com/solutions/2409751 I have seen things saying running engine-setup will generate new certs, however engine doesn't think the cluster is in global maintenance so won't run that, I believe I can get around the check with `engine-setup --otopi-environment=OVESETUP_CONFIG/continueSetupOnHEVM=bool:True` but is that the right thing to do? Will it deploy the certs on to the hosts as well so things communicate properly? Looks like one is supposed to put a node into maintenance and reenroll it after doing the engine-setup, but will it even be able to put the nodes into maintenance given I can't do anything with them now? Appreciate any ideas.

3 18

QXL vs VGA
by Andrea Chierici 23 Sep '22

23 Sep '22

Dear all, on latest 4.5, as many others have noticed, default is to use video type VGA and VNC as graphics protocol. Problem is, in my current environments, I can't seem to make this to work. When the machine power ups I get the "usual" error from virt-viewer: I found some docs on the web, like this from redhat: https://access.redhat.com/solutions/5695951 but it does not seem to work. Indeed I reinstalled a host and forced the creation of the vm on it, but the console is still unreachable. Any hint how I can solve this? I am quite surprised I could not find anything on standard documentation. Thanks, Andrea -- Andrea Chierici - INFN-CNAF Viale Berti Pichat 6/2, 40127 BOLOGNA Office Tel: +39 051 2095463 SkypeID ataruz --

2 2

Failed to deploy ovirt engine with CLI
by Pablo Olivera 23 Sep '22

23 Sep '22

Hi community, I'm trying to deploy the engine via CLI on an ovirt 4.5.2 (CentOS 8) node over a clean install. Previously I was trying to deploy it via cockpit but I got the following error: [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ ERROR ] ovirtsdk4.AuthError: Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials. [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 50, "changed": false, "msg": "Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials."} After researching in different threads of this forum, I decided to setup it via CLI by recommendation of different users, since it seems that cockpit hosted-engine deployment is broken. I attach the hosted-engine setup log but I am not sure where is the problem now. Can you help me? Thanks in advance. Pablo.

3 5

oVirt bug reports to move from bugzilla to github issues in future
by Michal Skrivanek 23 Sep '22

23 Sep '22

Hi all, as a final stage of out gerrit to github transition that started ~9 months ago we are planning to eliminate the use of bugzilla.redhat.com for all oVirt projects (bugs with Classification: "oVirt") and use the native issue tracking in github as well. We used to have integrations with gerrit and bugzilla that we moved to github actions instead, and the overhead (and notorious slowness) of bugzilla.redhat.com becomes the only "benefit" of using it these days. There's about 50 bugs total left in oVirt bugzilla so it's not that much to move, the biggest change would be that the new bugs are to be filed elsewhere. This is just a heads up for now, we haven't set a cut off date just yet, but you can expect this change in the coming weeks. Thanks, michal

1 1

oVirt API access when using Keycloak
by jonas＠rabe.ch 22 Sep '22

22 Sep '22

Hello all I just recently installed a fresh oVirt appliance. Now I want to use the API to perform some actions but fail to provide the correct username. Can you help? Here's my script: import ovirtsdk4 as sdk from getpass import getpass dc_name = "Default" clu_name = "Default" connection = sdk.Connection( url="https://ovirt-engine-test.admin.int.rabe.ch/ovirt-engine/api", username="admin@ovirt", password=getpass(), # ca_file="/etc/pki/ovirt-engine/ca.pem", insecure=True, ) ... That's the error I get: Traceback (most recent call last): File "/home/user/ovirt_iso_script/./setup_networks.py", line 25, in <module> dc = next(d for d in dcs_svc.list() if d.name == dc_name) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/services.py", line 6863, in list return self._internal_get(headers, query, wait) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/service.py", line 202, in _internal_get context = self._connection.send(request) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 371, in send return self.__send(request) File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 389, in __send self.authenticate() File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 382, in authenticate self._sso_token = self._get_access_token() File "/usr/lib64/python3.10/site-packages/ovirtsdk4/__init__.py", line 624, in _get_access_token raise AuthError( ovirtsdk4.AuthError: Error during SSO authentication access_denied : Cannot authenticate user No valid profile found in credentials..

2 1

cancel export task - no qemu-img process on host
by goosesk blabla 22 Sep '22

22 Sep '22

Hi, i tried to find way how to cancel hanged export task. I found that there should be some hidden possibility, but it is still not released and i cannot find how to allow it. i found how to remove this task directly from pg database on engine, but i am not sure if this also will unlock that VM. i cannot kill it by qemu-img process, because this process is not running. stucked VM is ubuntu 20.04 with 3 disks 20 + 80 + 300GB . Already running more than 12 hours and still did not start making ova file (checking in export folder) . qemu-img process on the host is missing . i tried to export smaller VM 7GB and it was successfully done by 2 minutes. During export qemu-img process was running on the host. Thank you for any help. BR jan

1 2

Uncaught exception occurred
by nikkognt＠gmail.com 22 Sep '22

22 Sep '22

Hi all, recently I have upgraded from 4.4 to 4.5, since while a create or edit a new pool an error occurr in a pop up red: "Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read properties of undefined (reading 'Kh') Please have your administrator check the UI logs" and the pool is create but with wrong settings. I checked the ui.log file: 2022-09-21 16:33:21,382+02 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Permutation name: 872EE01DC49AC3F81586694F1584D19D 2022-09-21 16:33:21,382+02 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : Cannot read properties of undefined (reading 'Kh') at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView.$addDiskList(DisksAllocationView.java:190) at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView.$lambda$0(DisksAllocationView.java:179) at org.ovirt.engine.ui.common.widget.uicommon.storage.DisksAllocationView$lambda$0$Type.eventRaised(DisksAllocationView.java:179) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.storage.DisksAllocationModel.$onPropertyChanged(DisksAllocationModel.java:310) at org.ovirt.engine.ui.uicommonweb.models.storage.DisksAllocationModel.$setQuotaEnforcementType(DisksAllocationModel.java:121) at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.$compatibilityVersionChanged(UnitVmModel.java:2384) at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.eventRaised(UnitVmModel.java:2223) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.ListModel.$setSelectedItem(ListModel.java:82) at org.ovirt.engine.ui.uicommonweb.builders.vm.CoreVmBaseToUnitBuilder.$postBuild(CoreVmBaseToUnitBuilder.java:35) at org.ovirt.engine.ui.uicommonweb.builders.vm.CoreVmBaseToUnitBuilder.postBuild(CoreVmBaseToUnitBuilder.java:35) at org.ovirt.engine.ui.uicommonweb.builders.CompositeBuilder$LastBuilder.build(CompositeBuilder.java:45) at org.ovirt.engine.ui.uicommonweb.builders.BaseSyncBuilder.build(BaseSyncBuilder.java:13) at org.ovirt.engine.ui.uicommonweb.builders.BaseSyncBuilder.build(BaseSyncBuilder.java:13) at org.ovirt.engine.ui.uicommonweb.builders.vm.IconVmBaseToUnitBuilder.lambda$0(IconVmBaseToUnitBuilder.java:23) at org.ovirt.engine.ui.uicommonweb.builders.vm.IconVmBaseToUnitBuilder$lambda$0$Type.onSuccess(IconVmBaseToUnitBuilder.java:23) at org.ovirt.engine.ui.uicommonweb.models.vms.IconCache.$lambda$0(IconCache.java:57) at org.ovirt.engine.ui.uicommonweb.models.vms.IconCache$lambda$0$Type.onSuccess(IconCache.java:57) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:239) at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:239) at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) at Unknown.eval(webadmin-0.js) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:306) at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:345) at Unknown.eval(webadmin-0.js) Any suggestions for resolve the problem? Thank you

2 2

GUI snapshot issue
by Facundo Badaracco 22 Sep '22

22 Sep '22

Hi everyone. I have made several snapshot of my vm, the interface says everything is good. But, when i go to the snapshot section of any vm, there is no snapshot. But, in disk section, all my snapshot are there. Any hint?

1 0

VMs hang periodically: gluster problem?
by Diego Ercolani 22 Sep '22

22 Sep '22

Hello, I have a cluster made by 3 nodes in a "self-hosted-engine" topology. I implemented the storage with gluster implementation in 2 replica + arbiter topology. I have two gluster volumes glen - is the volume used by hosted-engine vm gv0 - is the volume used by VMs The physical disks are 4TB SSD used only to accomodate VMs (also hosted-engine) I have continuos VMs hangs, even hosted-engine, this give full of troubles as I have continuous hangs by hosted-engine and this happen asyncrounosly even while there is management operation on VMs (mobility, cloning...) after a while it happens that the VM is freed but in the VMs I have in console kernel complaining by CPU hang or timer hangs and the solution is only to shutdown/poweroff the VM... even hosted engine in fact it happens that hosted-engine -vm-status give "state=EngineUpBadHealth" This is the log during the event in the host while there is the event: Sep 01 07:48:58 ovirt-node3.ovirt NetworkManager[1923]: <info> [1662018538.0166] device (vnet73): state change: activated -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Sep 01 07:48:58 ovirt-node3.ovirt NetworkManager[1923]: <info> [1662018538.0168] device (vnet73): released from master device ovirtmgmt Sep 01 07:48:58 ovirt-node3.ovirt libvirtd[2496]: Unable to read from monitor: Connection reset by peer Sep 01 07:48:58 ovirt-node3.ovirt libvirtd[2496]: internal error: qemu unexpectedly closed the monitor: 2022-09-01T07:48:57.930955Z qemu-kvm: -device virtio-blk-pci,iothread=iothread1,bus=pci.6,addr=0x0,drive=libvirt-1-format,id=ua-0a1a501c-fc45-430f-bfd3-076172cec406,bootindex=1,write-cache=on,serial=0a1a501c-fc45-430f-bfd3-076172cec406,werror=stop,rerror=stop: Failed to get "write" lock Is another process using the image [/run/vdsm/storage/3577c21e-f757-4405-97d1-0f827c9b4e22/0a1a501c-fc45-430f-bfd3-076172cec406/f65dab86-67f1-46fa-87c0-f9076f479741]? Sep 01 07:48:58 ovirt-node3.ovirt kvm[268578]: 5 guests now active Sep 01 07:48:58 ovirt-node3.ovirt systemd[1]: machine-qemu\x2d67\x2dHostedEngine.scope: Succeeded. Sep 01 07:48:58 ovirt-node3.ovirt systemd-machined[1613]: Machine qemu-67-HostedEngine terminated. Sep 01 07:49:08 ovirt-node3.ovirt systemd[1]: NetworkManager-dispatcher.service: Succeeded. Sep 01 07:49:08 ovirt-node3.ovirt ovirt-ha-agent[3338]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine ERROR Engine VM stopped on localhost Sep 01 07:49:14 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:18 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:18 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:28 ovirt-node3.ovirt vdsm[3335]: WARN Failed to retrieve Hosted Engine HA info: timed out Sep 01 07:49:28 ovirt-node3.ovirt sanlock[1633]: 2022-09-01 07:49:28 1706161 [5083]: s4 delta_renew long write time 11 sec Sep 01 07:49:28 ovirt-node3.ovirt sanlock[1633]: 2022-09-01 07:49:28 1706161 [5033]: s3 delta_renew long write time 11 sec Sep 01 07:49:34 ovirt-node3.ovirt libvirtd[2496]: Domain id=65 name='ocr-Brain-28-ovirt.dmz.ssis' uuid=00425fb1-c24b-4eaa-9683-534d66b2cb04 is tainted: custom-ga-command Sep 01 07:49:47 ovirt-node3.ovirt sudo[268984]: root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/bin/privsep-helper --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1iolt06i/privsep.sock This is the indication I have on gluster: [root@ovirt-node3 ~]# gluster volume heal gv0 info Brick ovirt-node2.ovirt:/brickgv0/_gv0 Status: Connected Number of entries: 0 Brick ovirt-node3.ovirt:/brickgv0/gv0_1 Status: Connected Number of entries: 0 Brick ovirt-node4.ovirt:/dati/_gv0 Status: Connected Number of entries: 0 [root@ovirt-node3 ~]# gluster volume heal glen info Brick ovirt-node2.ovirt:/brickhe/_glen Status: Connected Number of entries: 0 Brick ovirt-node3.ovirt:/brickhe/glen Status: Connected Number of entries: 0 Brick ovirt-node4.ovirt:/dati/_glen Status: Connected Number of entries: 0 So it seem healty. I don't know how to address the issue but this is a great problem.

2 19

iSCSI domain not seen by a node if the topology differ from the topology of the other nodes?
by Diego Ercolani 21 Sep '22

21 Sep '22

Hello, I think I0ve found another issue: I have the three node that are under heavy test and, after having problem with gluster I configured them to use with iSCSI (without multipath now) so I configured via the gui a new iscsi data domain using a single target under a single VLAN. I suspect there is an issue reporting the correct volume in my case: I try to explain. This are the scsi devices in the three nodes: [root@ovirt-node2 ~]# lsscsi [4:0:0:0] disk ATA ST4000NM000A-2HZ TN02 /dev/sda [5:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sdb [6:0:0:0] disk IBM 2145 0000 /dev/sdc [N:0:1:1] disk Force MP600__1 /dev/nvme0n1 [root@ovirt-node3 ~]# lsscsi [0:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sda [6:0:0:0] disk IBM 2145 0000 /dev/sdb [N:0:0:1] disk WD Blue SN570 500GB__1 /dev/nvme0n1 [root@ovirt-node4 ~]# lsscsi [3:0:0:0] disk ATA ST4000NM000A-2HZ TN02 /dev/sda [4:0:0:0] disk ATA KINGSTON SA400S3 1103 /dev/sdb [5:0:0:0] disk IBM 2145 0000 /dev/sdc So you see, the SCSI target (IBM 2145) are mapped as /dev/sdc in node2 and node4, but in node3 is mapped as /dev/sdb. In vdsm log of node3 I can find: 2022-09-21 15:53:57,831+0000 INFO (monitor/aac7917) [storage.storagedomaincache] Looking up domain aac79175-ab2b-4b5b-a6e4-9feef9ce17ab (sdc:171) 2022-09-21 15:53:57,899+0000 INFO (monitor/aac7917) [storage.storagedomaincache] Looking up domain aac79175-ab2b-4b5b-a6e4-9feef9ce17ab: 0.07 seconds (utils:390) 2022-09-21 15:53:57,899+0000 ERROR (monitor/aac7917) [storage.monitor] Setting up monitor for aac79175-ab2b-4b5b-a6e4-9feef9ce17ab failed (monitor:363) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 360, in _setupLoop self._setupMonitor() File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 382, in _setupMonitor self._setupDomain() File "/usr/lib/python3.6/site-packages/vdsm/utils.py", line 153, in wrapper value = meth(self, *a, **kw) File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 598, in _setupDomain domain = sdCache.produce(self.sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 115, in produce domain.getRealDomain() File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 51, in getRealDomain return self._cache._realProduce(self._sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 139, in _realProduce domain = self._findDomain(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 156, in _findDomain return findMethod(sdUUID) File "/usr/lib/python3.6/site-packages/vdsm/storage/sdc.py", line 186, in _findUnfetchedDomain raise se.StorageDomainDoesNotExist(sdUUID) vdsm.storage.exception.StorageDomainDoesNotExist: Storage domain does not exist: ('aac79175-ab2b-4b5b-a6e4-9feef9ce17ab',) So the node is kicked out of the ovirt cluster telling that it's not possible to connect to iSCSI domain.....

1 0

VM Down With "Bad Volume Specification"
by Clint Boggio 21 Sep '22

21 Sep '22

I had occasion to shutdown a VM for the purpose of adding RAM and processor to it and the VM willnot boot back up. I'm seeing "VM Issabel_PBX is down with error. Exit message: Bad volume specification {'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'serial': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'index': 0, 'iface': 'scsi', 'apparentsize': '5706743808', 'specParams': {}, 'cache': 'none', 'imageID': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'truesize': '5950070784', 'type': 'disk', 'domainID': '24c4dc1b-c843-4ae2-963f-9d0548305192', 'reqsize': '0', 'format': 'cow', 'poolID': '31fdd642-6b06-11ea-a4c4-00163e333bd2', 'device': 'disk', 'path': '/rhev/data-center/31fdd642-6b06-11ea-a4c4-00163e333bd2/24c4dc1b-c843-4ae2-963f-9d0548305192/images/6af66318-e6f8-45d7-8b4e-2183faf0a917/576b2761-a5bc-427b-95a9-0594447f0705', 'propagateErrors': 'off', 'name': 'sda', 'bootOrder': '1', 'volumeID': '576b2761-a5bc-427b-95a9-0594447f0705', 'diskType': 'file', 'a lias': 'ua-6af66318-e6f8-45d7-8b4e-2183faf0a917', 'discard': False}." in the log. I tried to move the VMs disk from one gluster datastore to another to see if the problem would clear and now the disk is locked and the move is stuck at %10. In the engine logs I have "2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Task id '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] EVENT_ID: TASK_CLEARING_ASYNC_TASK(9,501), Clearing asynchronous task Unknown that started at Tue Jul 12 12:19:21 CDT 2022 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Tue Jul 12 12:19:21 CDT 2022' since it reached a timeout of 3000 minutes 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' 2022-09-19 12:48:25,632-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='31fdd642-6b06-11ea-a4c4-00163e333bd2', ignoreFailoverLimit='false', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 40d6d67f 2022-09-19 12:48:25,633-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, HSMClearTaskVDSCommand(HostName = hprvsr00.locacore.com, HSMTaskGuidBaseVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 22c28060 2022-09-19 12:48:25,638-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, HSMClearTaskVDSCommand, return: , log id: 22c28060 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, SPMClearTaskVDSCommand, return: , log id: 40d6d67f 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,876-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-98) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupWithData' (id: '9e73adde-e485-461a-b349-7fd814890aa6') waiting on child command id: '5b4d0a00-7e40-4016-bf5c-0db013e22983' type:'CopyImageGroupVolumesData' to complete 2022-09-19 12:48:26,878-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-84) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupVolumesData' (id: '5b4d0a00-7e40-4016-bf5c-0db013e22983') waiting on child command id: '1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0' type:'CopyData' to complete 2022-09-19 12:48:27,886-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] START, GetHostJobsVDSCommand(HostName = hprvsr00.locacore.com, GetHostJobsVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2', type='storage', jobIds='[06208564-b66d-4947-a96f-4d163ef2fbe0]'}), log id: 75ca6198 2022-09-19 12:48:27,894-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHostJobsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] FINISH, GetHostJobsVDSCommand, return: {06208564-b66d-4947-a96f-4d163ef2fbe0=HostJobInfo:{id='06208564-b66d-4947-a96f-4d163ef2fbe0', type='storage', description='copy_data', status='running', progress='null', error='null'}}, log id: 75ca6198 2022-09-19 12:48:27,902-05 INFO [org.ovirt.engine.core.bll.StorageJobCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-89) [149db168-34c0-4814-869e-1ca0fdbde768] Command CopyData id: '1b496e55-9407-4fd7-a2f2-bb70bf4e7aa0': waiting for job '06208564-b66d-4947-a96f-4d163ef2fbe0' on host 'hprvsr00.locacore.com' (id: '6c910725-fb42-4a64-b614-2a29bf0800e2') to complete 2022-09-19 12:48:29,911-05 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'MoveOrCopyDisk' (id: '2ec06560-b552-4418-abd7-e2945cd98c12') waiting on child command id: '80a2481e-707f-49bf-b469-33cd90c1a51c' type:'MoveImageGroup' to complete 2022-09-19 12:48:29,915-05 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-57) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'MoveImageGroup' (id: '80a2481e-707f-49bf-b469-33cd90c1a51c') waiting on child command id: '9e73adde-e485-461a-b349-7fd814890aa6' type:'CopyImageGroupWithData' to complete" Any help would be appreciated as the client's PBX is currently down as a result.

2 4

Re: Self-hosted-engine timeout and recovering time
by Yedidyah Bar David 21 Sep '22

21 Sep '22

On Wed, Sep 21, 2022 at 12:22 AM Marcos Sungaila <marcos.sungaila(a)oracle.com> wrote: > > Hi all, > > I have a cluster running the 4.4.10 release with 6 KVM hosts and Self-Hosted-Engine. What storage? > I'm testing some network outage scenarios, and I faced strange behavior. I suppose you have redundancy in your network. It's important to clarify (for yourself, mainly) what exactly you test, what's important, what's expected, etc. > After disconnecting the KVM hosts hosting the SHE, there was a long timeout until switching the Self-Hosted-Engine to another host as expected. I suggest studying the ha-agent logs, /var/log/ovirt-hosted-engine-ha/agent.log. Much of the relevant code is in ovirt_hosted_engine_ha/agent/states.py (in the git repo, or under /usr/lib/python3.6/site-packages/ on your machine). > Also, there took a relatively long time to take over the HA VMs from the failing server. That's a separate issue, about which I personally know very little. You might want to start a separate thread about it. I do know, though, that if you keep the storage connected, the host might be able to keep updating VM leases on the storage. See e.g.: https://www.ovirt.org/develop/release-management/features/storage/vm-leases… I didn't check the admin guide, but I suppose it has some material about HA VMs. > Is there a configuration where I can reduce the SHE timeout to make this recover process faster? IIRC there is nothing user-configurable. You can see most relevant constants in ovirt_hosted_engine_ha/agent/constants.py{,.in}. Nothing stops you from changing them, but please note that this is somewhat risky, and I strongly suggest to do very careful testing with your new settings. It might make sense to try to methodically go through all the possible state changes in the above state machine. The general assumption is that network and storage, for critical setups, are redundant, and that the engine itself is not considered critical, in the sense that if it's dead, all your VMs are still alive. And also, that it's more important to not corrupt VM disk images (e.g. by starting the VM concurrently on two hosts) than to keep the VM alive. Best regards, -- Didi

2 1