- Users - oVirt List Archives

clock skew in hosted engine and VMs due to slow IO storage
by Diego Ercolani 28 Mar '23

28 Mar '23

I don't know why (but I suppose is related to storage speed) the virtual machines tend to present a skew in the clock from some days to a century forward (2177) I see in the journal of the engine: Mar 28 13:19:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680009580.2045] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Mar 28 13:24:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680009880.2042] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Mar 28 13:29:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680010180.2039] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Apr 01 08:15:42 ovirt-engine.ovirt chronyd[1072]: Forward time jump detected! Apr 01 08:15:42 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680336942.4396] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds) Apr 01 08:15:42 ovirt-engine.ovirt chronyd[1072]: Can't synchronise: no selectable sources When this happens in the hosted-engine tipically: 1. the DWH became unconsistent as I stated here: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/KPW5FFKG3AI6EI… or https://lists.ovirt.org/archives/list/users@ovirt.org/thread/WUNZUSZ2ARRLGN… 2. the skew causes the engine to kick off the nodes that appears "down" in "connecting" state This compromises all the task in pending state and raise countermeasures to the ovirt-engine manager and also vdsm daemon. I currently tried to put in engine's crontab every 5 minutes a "hwclock --hctosys" as it seem the hwclock don't skew

1 0

How to enable the storage pool correctly
by ziyi Liu 28 Mar '23

28 Mar '23

The /var/ folder is full, I can't enter the web ui to set it, I can only use the command line mode vdsm-client StorageDomain activate vdsm-client StorageDomain attach vdsm-client StoragePool connect vdsm-client StoragePool connectStorageServer I have tried these commands and they all prompt message=Unknown pool id, pool not connected

1 0

Failing vm backup
by Giulio Casella 28 Mar '23

28 Mar '23

Hi, since yesterday backup for one of my VMs is failing. Backup is performed by Storware vprotect, based on CBT strategy. In ovirt events I can see: VDSM host03 command StartNbdServerVDS failed: Bitmap does not exist: "{'reason': 'Bitmap does not exist in /rhev/data-center/mnt/blockSD/459011cf-ebb6-46ff-831d-8ccfafd82c8a/images/a9ec8085-6ac3-4be0-bbd2-7752f7e29368/083f5dc5-9003-4908-96b1-5f750b5a4197', 'bitmap': '1b88a937-0ab8-4f6e-a117-bbd522e21448'}" Transfer was stopped by system. Reason: failed to create a signed image ticket. Backups for other VMs are working correctly. What could it be? Somehow corrupted image? I tried to migrate VM to other hypervisors, with no luck. Didn't tried to move disks (two, one for the OS, one for data) to another data domain, not so fast operation (about 2.8TB). The VM is working correctly, but Murphy's law states this machine is a fileserver with users' data and email :-( Any hint? TIA, gc -- Giulio Casella giulio at di.unimi.it System and network architect Computer Science Dept. - University of Milano

2 2

Fail to import VM from Export Domain
by carl langlois 27 Mar '23

27 Mar '23

Hi, Our main storage domain has failed and we are trying to recover it. On our system we also have an Export Domain that adds some clone vm in it. But when trying to import the vm from the export domain i always get a fail. 023-03-27 08:45:40,273-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (default task-31) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock Acquired to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:28,697-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-35) [30eb771d-ccd6-4484-97bd-825aaf9b2443] EVENT_ID: IMPORTEXPORT_IMPORT_VM_FAILED(1,153), Failed to import Vm flexlm_clone to Data Center Default, Cluster Default 2023-03-27 08:47:28,798-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (EE-ManagedThreadFactory-engine-Thread-35) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock freed to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:39,737-04 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Trying to release exclusive lock which does not exist, lock key: 'flexlm_cloneVM_NAME' 2023-03-27 08:47:39,737-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock freed to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:40,091-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] EVENT_ID: IMPORTEXPORT_IMPORT_VM_FAILED(1,153), Failed to import Vm flexlm_clone to Data Center Default, Cluster Default I was able to import 1 of them. but all the others fail. Any hints to suggest? Regards Carl

1 0

Setup oVirt self hosted engine on Rocky LInux 8 using cockpit - stuck in deadlock
by dirk.schulz＠geniodata.de 27 Mar '23

27 Mar '23

Hi all, I have set up 3 servers in 3 data centers, each having one physical interface and a vlan interface parented by it. The connection between the 3 servers over the vlan interfaces (using private ip addresses) works (using icmp ping as the test). Now I want to turn them into an ovirt cluster creating the self hosted engine on the first server. I have - made sure the engine fqdn is in dns forward and reverse and in /etc/hosts - made sure that both interfaces have unique dns entries which can be resolved forward and reverse - made sure that both interfaces' fqdns are in /etc/hosts - made sure only the primary hostname (not fqdn) is in /etc/hostname, - made sure ipv6 is available on the physical interface, - made sure ipv6 method is "disabled" on the vlan interface, - set /usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/defaults/main.yml:he_force_ip4: true to make sure no ipv6 attempts to interfere. Now when I use cockpit's hosted engine wizard (not hyperconverged), i run into 2 opposing problems. If I set the FQDN in the "Advanced" sub pane to the FQDN of the vlan interface, the wizards gets stuck at "preparing VM" with "The resolved address doesn't resolve on the selected interface\n". If I set the FQDN in the "Advanced" sub pane to the FQDN of the physical interface, I get the same result. If i add the physical interfaces FQDN to the vlan ip address in /etc/hosts, i get "hostname 'x.y.z' doesn't uniquely match the interface 'enp5s0.4000' selected for the management bridge; it matches also interface with IP ['physical']. Please make sure that the hostname got from the interface for the management network resolves only there." So clearly separating the two interfaces namewise is mandatory. I tried to follow the ansible workflow step by step to see what it does. I seems the validate hostname is triggered twice, second time on filling in FQDN in "Advanced" sub pane - it succeeds with both hostnames (physiscal interface and vlan ip), but that does not prevent the "prepare VM" workflow in doing the same verification and failing, as far as I can see. This is where it happens: 2023-03-20 14:31:48,354+0100 DEBUG ansible on_any args TASK: ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface kwargs is_conditional:False 2023-03-20 14:31:48,355+0100 DEBUG ansible on_any args localhost TASK: ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface kwargs 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "ansible_play_hosts" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "ansible_play_batch" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "play_hosts" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "changed": false, "msg": "The resolved address doesn't resolve on the selected interface\n" }, "ansible_task": "Check the resolved address resolves on the selected interface", "ansible_type": "task", "status": "FAILED", "task_duration": 0 } So I am really stuck there. I do not have any idea how and where to go on. I can try changing bits in the playbooks and parameters (like using "hostname -A" instead of "hostname -f" for the failing test), but that can't really be the idea - I am to new to this to run into a bug or similar, I will suspect I do overlook something. Any hint or help is appreciated. Cheers, Dirk

4 4

oVirt host deploy: disable multipath
by femi adegoke 27 Mar '23

27 Mar '23

https://bugzilla.redhat.com/show_bug.cgi?id=1472356 There are 2 drives in my install that oVirt is claiming as multipath. I have tried blacklisting at /etc/multipath/ but that hasn't worked. Any better solutions? I need these 2 drives to be non-multipathed.

4 19

Uncertain what to do with "Master storage domain" residing on obsolete storage domain.
by goestin＠intert00bz.nl 27 Mar '23

27 Mar '23

Hello All, I want to phase out a storage domain however it is marked as "master", I have the following questions: 1. What does it mean when a storage domain is "master". 2. What is the correct way to remove a storage domain that is assigned the "master" status. Any insight on the matter would be highly appreciated. Kind regards, Justin

1 0

Emergency Mode following Disk addition
by simon＠justconnect.ie 27 Mar '23

27 Mar '23

Hi All, I added a new local disk and created a new LVM thinpool, VG and lVm’s for Gluster in a 4.5.3 HCI environment. Following reboot the server enters Emergency Mode caused by inactive LV/VG. Running ‘vgchange - ay vg’ activates the LV’s. LVM is configured to use device file but disabling this and using a filter allows the system to start normally. Unfortunately ‘lsblk’ shows that the disk is under multipath control. I’ve tried to exclude this disk from multipath but all efforts have failed. ‘pvscan’ shows the device as /dev/mapper/‘wwid’ instead of /dev/sd* I’ve added the wwid to the blacklists manually and restarted multipath but males no change. Regards Simon

1 0

VDI management on top of Ovirt
by samuel.xhu＠horebdata.cn 26 Mar '23

26 Mar '23

Hello, Ovirt folks, What is the most popular VDI management framework for Ovirt? After googling, I find adfinis/virtesk however which is not active now. I would be much apppreciated if anyone can point out the best open source VDI solutions with Ovirt? best regards, Samuel Do Right Thing (做正确的事) / Pursue Excellence (追求卓越) / Help Others Succeed (成就他人)

2 1

Unable to change engine-config
by James Wadsworth 25 Mar '23

25 Mar '23

I wanted to change the default keyboard layout. I ran # engine-config -s VncKeyboardLayout=it Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value it to key VncKeyboardLayout. Valid values are [ar,cz,da,de,de-ch,en-gb,en-us,es,et,fi,fo,fr,fr-be,fr-ca,fr-ch,hr,hu,is,it,ja,lt,lv,mk,nl,no,pl,pt,pt-br,ru,sl,sv,th,tr] I have tried with other values but the same result: # engine-config -s ClientModeConsoleDefault=vnc Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value vnc to key ClientModeConsoleDefault. Valid values are [vnc,spice] Am I making a mistake with the syntax or should I open a bug? Thanks, James

1 0