- Users - oVirt List Archives

Future of ovirt - end-of-life RHV
by Margit Meyer 06 Apr '23

06 Apr '23

What about the future of ovirt when RHV comes to end-of-life? Is there a chance for further usage? RedHat OpenShift will not be an option for us.... Margit

3 3

Renewing certificates - How it affects running vms?
by markeczzz＠gmail.com 06 Apr '23

06 Apr '23

Hi! Simple question - does procedure to renew certificates affects running virtual machines? I have a question regarding renewing certificates that are about to expire. I have a cluster with 5 hosts and a self-hosted engine. I have already updated the host certificates by logging in to each host, migrating virtual machines from that host to another, putting it into maintenance mode, and enrolling certificates via the web interface. Now, I have a question regarding renewing Engine certificates (self signed). I know the procedure is to log in to the host where the hosted engine is running (Host1 in my case), put it into global maintenance mode via the command "hosted-engine --set-maintenance --mode=global," and then log in to the Engine and run the command "engine-setup --offline" to renew it. My question is, will these two commands affect the running virtual machines on Host1 (where the hosted-engine is also hosted) and virtual machines on other hosts? Will they be shut down? Should I migrate virtual machines first from Host1 to some other host and then run the commands? I have a lot of virtual machines that i can't shut down or restart, any way to do it without that? Regards,

2 1

Failure to deploy oVirt node with security profile (PCIDSS)
by Guillaume Pavese 06 Apr '23

06 Apr '23

Hi oVirt community I tried with el8 & el9 oVirt Node 4.5.4 isos, But in both cases, the installation failed when selecting the PCI-DSS security profile. Please see screenshots attached According to 4.5.0 release note this is a supported feature : *BZ 2030226 [RFE] oVirt hypervisors should support running on hosts with the PCI-DSS security profile applied* *The oVirt Hypervisor is now capable of running on machine with PCI-DSS security profile.* https://bugzilla.redhat.com/show_bug.cgi?id=2030226 As the RFE says that deployment works, I guess this is a regression somewhere between 4.5.0 & 4.5.4 Is there a chance that this bug gets fixed? Is it up to the community? In the meantime, what can we do to deploy hosts with a PCI-DSS profile? Best regards, Guillaume Pavese Ingénieur Système et Réseau Interactiv-Group -- Ce message et toutes les pièces jointes (ci-après le “message”) sont établis à l’intention exclusive de ses destinataires et sont confidentiels. Si vous recevez ce message par erreur, merci de le détruire et d’en avertir immédiatement l’expéditeur. Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse. L’internet ne permettant pas d’assurer l’intégrité de ce message . Interactiv-group (et ses filiales) décline(nt) toute responsabilité au titre de ce message, dans l’hypothèse ou il aurait été modifié. IT, ES, UK. <https://interactiv-group.com/disclaimer.html>

2 1

Issue with hyper-converged node and rhel9
by Robert Pouliot 04 Apr '23

04 Apr '23

Hi, I have a 3 node cluster with gluster (2 rhel 8.7 and one rhel 9.1). I updated one of my nodes to rhel9 and I'm unable to start any VM that's running on gluster volumes on the rhel9 node or move a running VM on the rhel9 node. However, I'm able to start a node stored on a NFS node on the rhel9 node. According to gluster (10.3) all 3 nodes are working fine. I don't want to render my setup useless, that's why I didn't move the 2 other nodes. wells = rhel9 node. In the event log I'm getting the following error: Failed to sync storage devices from host wells VDSM wells command GetStorageDeviceListVDS failed: Internal JSON-RPC error Here is a part of the vdsm.log: 2023-04-03 23:25:01,242-0400 INFO (vm/69f6480f) [vds] prepared volume path: (clientIF:506) 2023-04-03 23:25:01,243-0400 INFO (vm/69f6480f) [vdsm.api] START prepareImage(sdUUID='a874a247-d8de-4951-86e8-99aaeda1a510', spUUID='595abf38-2c6d-11eb-9ba9-3ca82afed888', imgUUID='69de5e2b-dfb7-4e47-93d0-65ed4f978017', leafUUID='e66df35e-1254-48ef-bb83-ae8957fe8651', allowIllegal=False) from=internal, task_id=bf3e89e0-5d4e-47a1-8d86-3933c5004d25 (api:31) 2023-04-03 23:25:01,243-0400 INFO (vm/69f6480f) [vdsm.api] FINISH prepareImage error=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) from=internal, task_id=bf3e89e0-5d4e-47a1-8d86-3933c5004d25 (api:35) 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [storage.taskmanager.task] (Task='bf3e89e0-5d4e-47a1-8d86-3933c5004d25') aborting: Task is aborted: "value=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) abortedcode=309" (task:1165) 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [storage.dispatcher] FINISH prepareImage error=Unknown pool id, pool not connected: ('595abf38-2c6d-11eb-9ba9-3ca82afed888',) (dispatcher:64) 2023-04-03 23:25:01,244-0400 ERROR (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') The vm start process failed (vm:1001) Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 928, in _startUnderlyingVm self._run() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2769, in _run self._devices = self._make_devices() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2649, in _make_devices disk_objs = self._perform_host_local_adjustment() File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 2687, in _perform_host_local_adjustment self._preparePathsForDrives(disk_params) File "/usr/lib/python3.9/site-packages/vdsm/virt/vm.py", line 1109, in _preparePathsForDrives drive['path'] = self.cif.prepareVolumePath( File "/usr/lib/python3.9/site-packages/vdsm/clientIF.py", line 418, in prepareVolumePath raise vm.VolumeError(drive) vdsm.virt.vm.VolumeError: Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'file', 'specParams': {}, 'alias': 'ua-69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'address': {'bus': '0', 'controller': '0', 'target': '0', 'type': 'drive', 'unit': '0'}, 'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'guestName': '/dev/sdb', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'poolID': '595abf38-2c6d-11eb-9ba9-3ca82afed888', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651', 'managed': False, 'volumeChain': [{'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'leaseOffset': 0, 'leasePath': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651.lease', 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651'}], 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'discard': False, 'format': 'raw', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'scsi', 'name': 'sda', 'bootOrder': '1', 'serial': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'index': 0, 'reqsize': '0', 'truesize': '5331688448', 'apparentsize': '42949672960'} 2023-04-03 23:25:01,244-0400 INFO (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Changed state to Down: Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'file', 'specParams': {}, 'alias': 'ua-69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'address': {'bus': '0', 'controller': '0', 'target': '0', 'type': 'drive', 'unit': '0'}, 'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'guestName': '/dev/sdb', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'poolID': '595abf38-2c6d-11eb-9ba9-3ca82afed888', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651', 'managed': False, 'volumeChain': [{'domainID': 'a874a247-d8de-4951-86e8-99aaeda1a510', 'imageID': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'leaseOffset': 0, 'leasePath': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651.lease', 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'volumeID': 'e66df35e-1254-48ef-bb83-ae8957fe8651'}], 'path': '/rhev/data-center/mnt/glusterSD/192.168.8.11:_GlusterVolLow/a874a247-d8de-4951-86e8-99aaeda1a510/images/69de5e2b-dfb7-4e47-93d0-65ed4f978017/e66df35e-1254-48ef-bb83-ae8957fe8651', 'discard': False, 'format': 'raw', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'scsi', 'name': 'sda', 'bootOrder': '1', 'serial': '69de5e2b-dfb7-4e47-93d0-65ed4f978017', 'index': 0, 'reqsize': '0', 'truesize': '5331688448', 'apparentsize': '42949672960'} (code=1) (vm:1743) 2023-04-03 23:25:01,245-0400 INFO (vm/69f6480f) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Stopping connection (guestagent:421) 2023-04-03 23:25:01,252-0400 INFO (jsonrpc/7) [api.virt] START destroy(gracefulAttempts=1) from=::ffff:192.168.2.24,56838, vmId=69f6480f-5ee0-4210-84b9-58b4dbb4e423 (api:31) 2023-04-03 23:25:01,252-0400 INFO (jsonrpc/7) [virt.vm] (vmId='69f6480f-5ee0-4210-84b9-58b4dbb4e423') Release VM resources (vm:5324)

1 0

ovirt 4.6 compatibility with el8
by Nathanaël Blanchet 01 Apr '23

01 Apr '23

Hello community! I noticed that rhel9 doesn't not support anymore ISP2532-based 8Gb Fibre Channel HBA. Given that all of my ovirt hosts are ISP2532-based, I d'like to know if ovirt 4.6 will be still compatible with el8 or will only support el9. -- Nathanaël Blanchet Administrateur Systèmes et Réseaux Service Informatique et REseau (SIRE) Département des systèmes d'information 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

oVirt hosted-engine deployment times out while "Wait for the host to be up"
by brwsergmslst＠gmail.com 01 Apr '23

01 Apr '23

Hi all, I am currently trying to deploy the hosted-engine without success. Unfortunately I cannot see what I am missing here. It'd be nice if you could put an eye on it and help me out. Below is an excerpt of the logfile generated. ``` 2023-03-22 20:34:10,417+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Get active list of active firewalld zones] 2023-03-22 20:34:12,222+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:13,527+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Configure libvirt firewalld zone] 2023-03-22 20:34:20,246+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:21,550+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Reload firewall-cmd] 2023-03-22 20:34:23,957+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:25,462+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Add host] 2023-03-22 20:34:27,469+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 changed: [localhost] 2023-03-22 20:34:28,672+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Include after_add_host tasks files] 2023-03-22 20:34:30,678+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 TASK [ovirt.ovirt.hosted_engine_setup : Let the user connect to the bootstrap engine VM to manually fix host configuration] 2023-03-22 20:34:31,882+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 skipping: [localhost] 2023-03-22 20:34:32,987+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:33,890+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 skipping: [localhost] 2023-03-22 20:34:34,893+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:36,096+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:37,100+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Always revoke the SSO token] 2023-03-22 20:34:38,705+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:40,111+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] 2023-03-22 20:34:41,015+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:42,020+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] 2023-03-22 20:34:44,028+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 ok: [localhost] 2023-03-22 20:34:45,032+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Wait for the host to be up] 2023-03-22 20:56:33,746+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'changed': False, 'ovirt_hosts': [{'href': '/ovirt-engine/api/hosts/17ad8088-c9e9-433f-90b9-ce8023a625e6', 'comment': '', ' id': '17ad8088-c9e9-433f-90b9-ce8023a625e6', 'name': 'vhost-tmp01.example.com', 'address': 'vhost-tmp01.example.com', 'affinity_labels': [], 'auto_numa_status': 'unknown', 'certificate': {'organization': 'example.com', 'subject': 'O=example.com,CN=vhost-tmp01.example.com'}, 'cluster': {'href': '/ovirt-engine/api/clusters/4effacb7-e5dd-4e52-86c9-90ebd2aafa0d', 'id': '4effacb7-e5dd-4e52-86c9-90ebd2aafa0d'}, 'cpu ': {'speed': 0.0, 'topology': {}}, 'cpu_units': [], 'device_passthrough': {'enabled': False}, 'devices': [], 'external_network_provider_configurations': [], 'external_status': 'ok', 'hardware_information': {'supported_rng_sources': []}, 'h ooks': [], 'katello_errata': [], 'kdump_status': 'unknown', 'ksm': {'enabled': False}, 'max_scheduling_memory': 0, 'memory': 0, 'network_attachments': [], 'nics': [], 'numa_nodes': [], 'numa_supported': False, 'os': {'custom_kernel_cmdline ': ''}, 'ovn_configured': False, 'permissions': [], 'port': 54321, 'power_management': {'automatic_pm_enabled': True, 'enabled': False, 'kdump_detection': True, 'pm_proxies': []}, 'protocol': 'stomp', 'reinstallation_required': False, 'se_linux': {}, 'spm': {'priority': 5, 'status': 'none'}, 'ssh': {'fingerprint': 'SHA256:IDhzMTO49OoNIHmLGnOIGwTn8LQB/lYrJdUnak144Q4', 'port': 22, 'public_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWbUlwbIiSliqc6OCFwG4w6/OaJb63JijJ1okaj6Y3gqNPO2XZWDTfwraIqm0S0SGlVk/g0oYcYIQ/0hU5Q+bE='}, 'statistics': [], 'status': 'install_failed', 'storage_connection_extensions': [], 'summary': {'total': 0}, 'tags': [], 'transparent_huge_pages': {'enabled': False}, 'type': 'rhel', 'unmanaged_networks': [], 'update_available': False, 'vgpu_placement': 'consolidated'}], 'invocation': {'module_args': {'pattern': 'name=vhost-tmp01.example.com', 'fetch_nested': False, 'nested_attributes': [], 'follow': [], 'all_content': False, 'cluster _version': None}}, '_ansible_no_log': None, 'attempts': 120} 2023-03-22 20:56:33,847+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 ignored: [localhost]: FAILED! => {"attempts": 120, "changed": false, "ovirt_hosts": [{"address": "vhost-tmp01.example.com", "affinity_labels": [], "auto_numa_status": "unknown", "certificate": {"organization": "example.com", "subject": "O=example.com,CN=vhost-tmp01.example.com"}, "cluster": {"href": "/ovirt-engine/api/clusters/4effacb7-e5dd-4e52-86c9-90ebd2aafa0d", "id": "4effacb7-e5dd-4e52-86c9-90ebd2aafa0d"}, "comment": "", "cpu": {"speed": 0.0, "topology": {}}, "cpu_units": [], "device_passthrough": {"enabled": false}, "devices": [], "external_network_provider_configurations": [], "external_status": "ok", "hardware_information": {"supported_rng_sources": []}, "hooks": [], "href": "/ovirt-engine/api/hosts/17ad8088-c9e9-433f-90b9-ce8023a625e6", "id": "17ad8088-c9e9-433f-90b9-ce8023a625e6", "katello_errata": [], "kdump_status": "unknown", "ksm": {"enabled": false}, "max_ scheduling_memory": 0, "memory": 0, "name": "vhost-tmp01.example.com", "network_attachments": [], "nics": [], "numa_nodes": [], "numa_supported": false, "os": {"custom_kernel_cmdline": ""}, "ovn_configured": false, "permissions": [], "port": 54321, "power_management": {"automatic_pm_enabled": true, "enabled": false, "kdump_detection": true, "pm_proxies": []}, "protocol": "stomp", "reinstallation_required": false, "se_linux": {}, "spm": {"priority": 5, "status": "none"}, "ssh": {"fingerprint": "SHA256:IDhzMTO49OoNIHmLGnOIGwTn8LQB/lYrJdUnak144Q4", "port": 22, "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWbUlwbIiSliqc6OCFwG4w6/OaJb63JijJ1okaj6Y3gqNPO2XZWDTfwraIqm0S0SGlVk/g0oYcYIQ/0hU5Q+bE="}, "statistics": [], "status": "install_failed", "storage_connection_extensions": [], "summary": {"total": 0}, "tags": [], "transparent_huge_pages": {"enabled": false}, "type": "rhel", "unmanaged_networks": [], "update_available": false, "vgpu_placement": " consolidated"}]} 2023-03-22 20:56:34,750+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:115 TASK [ovirt.ovirt.hosted_engine_setup : Notify the user about a failure] 2023-03-22 20:56:35,655+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 {'msg': 'Host is not up, please check logs, perhaps also on the engine machine', '_ansible_no_log': None, 'changed': False} 2023-03-22 20:56:35,755+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:113 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Host is not up, please check logs, perhaps also on the engine machine"} ``` Thank you in advance. Best regards

1 1

IBM ESS remote filesystem as POSIX compliant fs?
by arc＠b4restore.com 31 Mar '23

31 Mar '23

Hi all, We are trying to mount a remote filesystem in oVirt from an IBM ESS3500. but it seems to be a little against us. everyting i try to mount it i get this in supervdsm.log(two different tries): MainProcess|jsonrpc/7::DEBUG::2023-03-31 10:55:41,808::supervdsm_server::78::SuperVdsm.ServerCallback::(wrapper) call mount with (<vdsm.supervdsm_server._SuperVdsm object at 0x7f7595dba9b0>, '/essovirt01', '/rhev/data-center/mnt/_essovirt01') {'mntOpts': 'rw,relatime,dev=essovirt01', 'vfstype': 'gpfs', 'cgroup': None} MainProcess|jsonrpc/7::DEBUG::2023-03-31 10:55:41,808::commands::217::root::(execCmd) /usr/bin/taskset --cpu-list 0-63 /usr/bin/mount -t gpfs -o rw,relatime,dev=essovirt01 /essovirt01 /rhev/data-center/mnt/_essovirt01 (cwd None) MainProcess|jsonrpc/7::DEBUG::2023-03-31 10:55:41,941::commands::230::root::(execCmd) FAILED: <err> = b'mount: /rhev/data-center/mnt/_essovirt01: mount(2) system call failed: Stale file handle.\n'; <rc> = 32 MainProcess|jsonrpc/7::ERROR::2023-03-31 10:55:41,941::supervdsm_server::82::SuperVdsm.ServerCallback::(wrapper) Error in mount Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 80, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 119, in mount cgroup=cgroup) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 263, in _mount _runcmd(cmd) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 291, in _runcmd raise MountError(cmd, rc, out, err) vdsm.storage.mount.MountError: Command ['/usr/bin/mount', '-t', 'gpfs', '-o', 'rw,relatime,dev=essovirt01', '/essovirt01', '/rhev/data-center/mnt/_essovirt01'] failed with rc=32 out=b'' err=b'mount: /rhev/data-center/mnt/_essovirt01: mount(2) system call failed: Stale file handle.\n' MainProcess|mpathhealth::DEBUG::2023-03-31 10:55:48,993::supervdsm_server::78::SuperVdsm.ServerCallback::(wrapper) call dmsetup_run_status with ('multipath',) {} MainProcess|mpathhealth::DEBUG::2023-03-31 10:55:48,993::commands::137::common.commands::(start) /usr/bin/taskset --cpu-list 0-63 /usr/sbin/dmsetup status --target multipath (cwd None) MainProcess|mpathhealth::DEBUG::2023-03-31 10:55:49,000::commands::82::common.commands::(run) SUCCESS: <err> = b''; <rc> = 0 MainProcess|mpathhealth::DEBUG::2023-03-31 10:55:49,000::supervdsm_server::85::SuperVdsm.ServerCallback::(wrapper) return dmsetup_run_status with b'360050764008100e42800000000000223: 0 629145600 multipath 2 0 1 0 2 1 A 0 1 2 8:192 A 0 0 1 E 0 1 2 8:144 A 0 0 1 \n360050764008100e42800000000000229: 0 629145600 multipath 2 0 1 0 2 1 A 0 1 2 8:208 A 0 0 1 E 0 1 2 8:160 A 0 0 1 \n360050764008100e4280000000000022a: 0 10485760 multipath 2 0 1 0 2 1 A 0 1 2 8:176 A 0 0 1 E 0 1 2 8:224 A 0 0 1 \n360050764008100e42800000000000260: 0 1048576000 multipath 2 0 1 0 2 1 A 0 2 2 8:16 A 0 0 1 8:80 A 0 0 1 E 0 2 2 8:48 A 0 0 1 8:112 A 0 0 1 \n360050764008100e42800000000000261: 0 209715200 multipath 2 0 1 0 2 1 A 0 2 2 8:64 A 0 0 1 8:128 A 0 0 1 E 0 2 2 8:32 A 0 0 1 8:96 A 0 0 1 \n360050764008102edd8000000000001ab: 0 8589934592 multipath 2 0 1 0 2 1 A 0 1 2 65:128 A 0 0 1 E 0 1 2 65:32 A 0 0 1 \n360050764008102f558000000000001a9: 0 8589934592 multipath 2 0 1 0 2 1 A 0 1 2 65:16 A 0 0 1 E 0 1 2 65:48 A 0 0 1 \n3600507640081820ce800000000000077: 0 838860800 multipath 2 0 1 0 2 1 A 0 1 2 8:240 A 0 0 1 E 0 1 2 65:0 A 0 0 1 \n3600507680c800058d000000000000484: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 65:160 A 0 0 1 E 0 1 2 66:80 A 0 0 1 \n3600507680c800058d000000000000485: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 65:176 A 0 0 1 E 0 1 2 66:96 A 0 0 1 \n3600507680c800058d000000000000486: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 66:112 A 0 0 1 E 0 1 2 65:192 A 0 0 1 \n3600507680c800058d000000000000487: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 66:128 A 0 0 1 E 0 1 2 65:208 A 0 0 1 \n3600507680c800058d000000000000488: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 65:224 A 0 0 1 E 0 1 2 66:144 A 0 0 1 \n3600507680c800058d000000000000489: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 66:160 A 0 0 1 E 0 1 2 65:240 A 0 0 1 \n3600507680c800058d00000000000048a: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 66:0 A 0 0 1 E 0 1 2 66:176 A 0 0 1 \n3600507680c800058d00000000000048b: 0 20971520 multipath 2 0 1 0 2 1 A 0 1 2 66:192 A 0 0 1 E 0 1 2 66:16 A 0 0 1 \n3600507680c800058d00000000000048c: 0 419430400 multipath 2 0 1 0 2 1 A 0 1 2 65:144 A 0 0 1 E 0 1 2 66:64 A 0 0 1 \n3600507680c800058d0000000000004b1: 0 41943040 multipath 2 0 1 0 2 1 A 0 1 2 66:208 A 0 0 1 E 0 1 2 66:32 A 0 0 1 \n3600507680c800058d0000000000004b2: 0 41943040 multipath 2 0 1 0 2 1 A 0 1 2 66:48 A 0 0 1 E 0 1 2 66:224 A 0 0 1 \n360050768108100c9d0000000000001aa: 0 8589934592 multipath 2 0 1 0 2 1 A 0 1 2 65:64 A 0 0 1 E 0 1 2 65:112 A 0 0 1 \n360050768108180ca48000000000001a9: 0 8589934592 multipath 2 0 1 0 2 1 A 0 1 2 65:96 A 0 0 1 E 0 1 2 65:80 A 0 0 1 \n' MainProcess|jsonrpc/0::DEBUG::2023-03-31 10:55:49,938::supervdsm_server::78::SuperVdsm.ServerCallback::(wrapper) call mount with (<vdsm.supervdsm_server._SuperVdsm object at 0x7f7595dba9b0>, '/essovirt01', '/rhev/data-center/mnt/_essovirt01') {'mntOpts': 'rw,relatime', 'vfstype': 'gpfs', 'cgroup': None} MainProcess|jsonrpc/0::DEBUG::2023-03-31 10:55:49,939::commands::217::root::(execCmd) /usr/bin/taskset --cpu-list 0-63 /usr/bin/mount -t gpfs -o rw,relatime /essovirt01 /rhev/data-center/mnt/_essovirt01 (cwd None) MainProcess|jsonrpc/0::DEBUG::2023-03-31 10:55:49,944::commands::230::root::(execCmd) FAILED: <err> = b'mount: /rhev/data-center/mnt/_essovirt01: wrong fs type, bad option, bad superblock on /essovirt01, missing codepage or helper program, or other error.\n'; <rc> = 32 MainProcess|jsonrpc/0::ERROR::2023-03-31 10:55:49,944::supervdsm_server::82::SuperVdsm.ServerCallback::(wrapper) Error in mount Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 80, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 119, in mount cgroup=cgroup) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 263, in _mount _runcmd(cmd) File "/usr/lib/python3.6/site-packages/vdsm/storage/mount.py", line 291, in _runcmd raise MountError(cmd, rc, out, err) vdsm.storage.mount.MountError: Command ['/usr/bin/mount', '-t', 'gpfs', '-o', 'rw,relatime', '/essovirt01', '/rhev/data-center/mnt/_essovirt01'] failed with rc=32 out=b'' err=b'mount: /rhev/data-center/mnt/_essovirt01: wrong fs type, bad option, bad superblock on /essovirt01, missing codepage or helper program, or other error.\n' i have tried earlier in the same oVirt version two map a SAN LUN directly to the hypervisor and create a local gpfs filesystem and that was able to mount with the below parameters within the gui: Storage Type : POSIX Compliant FS HOST : The host that has scale installed and mounted Path : /essovirt01 VFS Type: gpfs Mount Options: rw,relatime,dev=essovirt01 This works. but with a remote filesystem it does not. im not sure why as it should pretty close to a local filesystem as it is granted with : File system access: essovirt01 (rw, root allowed) and mounted with /essovirt01 on /essovirt01 type gpfs (rw,relatime,seclabel) Anybody have a clue what to do ? seems weird there should be such a difference from a locally owned to a remote owned fs when mounted through gpfs remotefs/remotecluster option. and just to verify, i have given the filesystem the correct permission for ovirt : drwxr-xr-x. 2 vdsm kvm 262144 Mar 31 10:33 essovirt01 Thanks in advance. Christiansen

1 1

OVirt Self Hosted Enging VM issue
by linim＠gdls.com 31 Mar '23

31 Mar '23

Hello If this is a repeat discussion, I do apologize but I am looking to see if anyone else out there as had or heard of this issue happening? I am attempting to install a KVM hosts with a Self-Hosted-Engine. When it goes to install the OVIRT engine on the VM being created under its temporary IP, I am noticing that the VM will disconnect, and I lose all network connectivity on it. This is in attempt to install OLVM using the self-hosted-engine referencing oracle Doc ID 2933018.1. I have engaged oracle support, but I am just hoping that perhaps someone else has run into this issue and they can offer up avenues of investigation? If his is outside the scope of an oVirt discussion as it is OLVM, then this can be closed out.

1 0

Encrypted VNC request using SASL not maintained after VM migration
by Jon Sattelberger 29 Mar '23

29 Mar '23

I recently followed the instructions for enabling VNC encryption for FIPS enabled hosts [1]. The VNC console seem to be fine on the host where the VM is initially started (excluding noVNC in the browser). The qemu-kvm arguments are not maintained properly upon VM migration, declaring "password=on" in the -vnc argument. Subsequent VNC console requests will result in an authentication failure. SPICE seems to be fine. All hosts and the engine are FIPS enabled running oVirt-4.5.4-1.el8. Is there a way to maintain the absence of "password=on"after VM migation? Perhaps a hook in the interim. Initial VM start: -object {"qom-type":"tls-creds-x509","id":"vnc-tls-creds0","dir":"/etc/pki/vdsm/libvirt-vnc","endpoint":"server","verify-peer":false} -vnc 192.168.100.67:0,tls-creds=vnc-tls-creds0,sasl=on,audiodev=audio1 -k en-us Debug output from remote-viewer: (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.812: vncconnection.c Possible VeNCrypt sub-auth 263 (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.812: vncconnection.c Emit main context 12 (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.812: vncconnection.c Requested auth subtype 263 (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.813: vncconnection.c Waiting for VeNCrypt auth subtype (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.813: vncconnection.c Choose auth 263 (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.813: vncconnection.c Checking if credentials are needed (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.813: vncconnection.c No credentials required (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.813: vncconnection.c Read error Resource temporarily unavailable (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.841: vncconnection.c Do TLS handshake (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.944: vncconnection.c Checking if credentials are needed (remote-viewer:1495470): gtk-vnc-DEBUG: 12:51:55.944: vncconnection.c Want a TLS clientname ... snip ... Migrated VM: -object {"qom-type":"tls-creds-x509","id":"vnc-tls-creds0","dir":"/etc/pki/vdsm/libvirt-vnc","endpoint":"server","verify-peer":false} -vnc 192.168.100.68:0,password=on,tls-creds=vnc-tls-creds0,sasl=on,audiodev=audio1 -k en-us Debug output from remote-viewer: (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.487: vncconnection.c Possible VeNCrypt sub-auth 261 (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.487: vncconnection.c Emit main context 12 (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.488: vncconnection.c Requested auth subtype 261 (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.488: vncconnection.c Waiting for VeNCrypt auth subtype (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.488: vncconnection.c Choose auth 261 (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.488: vncconnection.c Checking if credentials are needed (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.488: vncconnection.c No credentials required ... snip ... (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.780: vncconnection.c Checking auth result (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.808: vncconnection.c Fail Authentication failed (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.808: vncconnection.c Error: Authentication failed (remote-viewer:1495270): gtk-vnc-DEBUG: 12:50:29.808: vncconnection.c Emit main context 16 (remote-viewer:1495270): virt-viewer-WARNING **: 12:50:29.808: vnc-session: got vnc error Authentication failed Thank you, Jon [1] https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.4/ht…

1 1

Disable "balancing" and authomatic migration
by Diego Ercolani 28 Mar '23

28 Mar '23

Hello, in my installation I have to use poor storage... the oVirt installation doesn't manage such a case and begin to "balance" and move VMs around... taking too many snapshots stressing a poor performance all the cluster mess up.... Why the vms don't go in "Pause" state but the cluster prefer to migrate things around messing up everything? This is a reference I found and for notice I'm disabling the auto-migration on every VM, hoping this help https://lists.ovirt.org/archives/list/users@ovirt.org/thread/24KQZFP2PCW462…

2 8

Failing "change Master storage domain" from gluster to iscsi
by Diego Ercolani 28 Mar '23

28 Mar '23

In the current release of ovirt (4.5.4) I'm currently experiencing a fail in change master storage domain from a gluster volume to everywhere. The GUI talk about a "general" error. watching the engine log: 2023-03-28 11:51:16,601Z WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-46) [] Unexpected return value: TaskStatus [code=331, message=value=Tar command failed: ({'reader': {'cmd': ['/usr/bin/tar', 'cf', '-', '--exclude=./lost+found', '-C', '/rhev/data-center/mnt/glusterSD/ovirt-node3.ovirt:_gv0/4745320f-bfc3-46c4-8849-b4fe8f1b2de6/master', '.'], 'rc': 1, 'err': '/usr/bin/tar: ./tasks/20a9aa7f-80f5-403b-b296-ea95d9fd3f97: file changed as we read it\n/usr/bin/tar: ./tasks/87783efa-42ac-4cd9-bda5-ad68c59bb881/87783efa-42ac-4cd9-bda5-ad68c59bb881.task: file changed as we read it\n'}},) abortedcode=331] 2023-03-28 11:51:16,601Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-46) [] Failed in 'HSMGetAllTasksStatusesVDS' method Seeming that somewhat is changing file under the directory but: [vdsm@ovirt-node2 4745320f-bfc3-46c4-8849-b4fe8f1b2de6]$ /usr/bin/tar -cf - --exclude=./lost+found -C '/rhev/data-center/mnt/glusterSD/ovirt-node3.ovirt:_gv0/4745320f-bfc3-46c4-8849-b4fe8f1b2de6/master' '.' > /tmp/tar.tar /usr/bin/tar: ./tasks/20a9aa7f-80f5-403b-b296-ea95d9fd3f97: file changed as we read it /usr/bin/tar: ./tasks: file changed as we read it [vdsm@ovirt-node2 master]$ find '/rhev/data-center/mnt/glusterSD/ovirt-node3.ovirt:_gv0/4745320f-bfc3-46c4-8849-b4fe8f1b2de6/master' -mtime -1 /rhev/data-center/mnt/glusterSD/ovirt-node3.ovirt:_gv0/4745320f-bfc3-46c4-8849-b4fe8f1b2de6/master/tasks [vdsm@ovirt-node2 master]$ ls -l /rhev/data-center/mnt/glusterSD/ovirt-node3.ovirt:_gv0/4745320f-bfc3-46c4-8849-b4fe8f1b2de6/master/ total 0 drwxr-xr-x. 6 vdsm kvm 182 Mar 28 11:51 tasks drwxr-xr-x. 2 vdsm kvm 6 Mar 26 20:36 vms [vdsm@ovirt-node2 master]$ date; stat tasks Tue Mar 28 12:04:06 UTC 2023 File: tasks Size: 182 Blocks: 0 IO Block: 131072 directory Device: 31h/49d Inode: 12434008067414313592 Links: 6 Access: (0755/drwxr-xr-x) Uid: ( 36/ vdsm) Gid: ( 36/ kvm) Context: system_u:object_r:fusefs_t:s0 Access: 2023-03-28 11:55:17.771046746 +0000 Modify: 2023-03-28 11:51:16.641145314 +0000 Change: 2023-03-28 11:51:16.641145314 +0000 Birth: - It seem the task directory isn't touched since

1 1

clock skew in hosted engine and VMs due to slow IO storage
by Diego Ercolani 28 Mar '23

28 Mar '23

I don't know why (but I suppose is related to storage speed) the virtual machines tend to present a skew in the clock from some days to a century forward (2177) I see in the journal of the engine: Mar 28 13:19:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680009580.2045] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Mar 28 13:24:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680009880.2042] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Mar 28 13:29:40 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680010180.2039] dhcp4 (eth0): state changed new lease, address=192.168.123.20 Apr 01 08:15:42 ovirt-engine.ovirt chronyd[1072]: Forward time jump detected! Apr 01 08:15:42 ovirt-engine.ovirt NetworkManager[1158]: <info> [1680336942.4396] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds) Apr 01 08:15:42 ovirt-engine.ovirt chronyd[1072]: Can't synchronise: no selectable sources When this happens in the hosted-engine tipically: 1. the DWH became unconsistent as I stated here: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/KPW5FFKG3AI6EI… or https://lists.ovirt.org/archives/list/users@ovirt.org/thread/WUNZUSZ2ARRLGN… 2. the skew causes the engine to kick off the nodes that appears "down" in "connecting" state This compromises all the task in pending state and raise countermeasures to the ovirt-engine manager and also vdsm daemon. I currently tried to put in engine's crontab every 5 minutes a "hwclock --hctosys" as it seem the hwclock don't skew

1 0

How to enable the storage pool correctly
by ziyi Liu 28 Mar '23

28 Mar '23

The /var/ folder is full, I can't enter the web ui to set it, I can only use the command line mode vdsm-client StorageDomain activate vdsm-client StorageDomain attach vdsm-client StoragePool connect vdsm-client StoragePool connectStorageServer I have tried these commands and they all prompt message=Unknown pool id, pool not connected

1 0

Failing vm backup
by Giulio Casella 28 Mar '23

28 Mar '23

Hi, since yesterday backup for one of my VMs is failing. Backup is performed by Storware vprotect, based on CBT strategy. In ovirt events I can see: VDSM host03 command StartNbdServerVDS failed: Bitmap does not exist: "{'reason': 'Bitmap does not exist in /rhev/data-center/mnt/blockSD/459011cf-ebb6-46ff-831d-8ccfafd82c8a/images/a9ec8085-6ac3-4be0-bbd2-7752f7e29368/083f5dc5-9003-4908-96b1-5f750b5a4197', 'bitmap': '1b88a937-0ab8-4f6e-a117-bbd522e21448'}" Transfer was stopped by system. Reason: failed to create a signed image ticket. Backups for other VMs are working correctly. What could it be? Somehow corrupted image? I tried to migrate VM to other hypervisors, with no luck. Didn't tried to move disks (two, one for the OS, one for data) to another data domain, not so fast operation (about 2.8TB). The VM is working correctly, but Murphy's law states this machine is a fileserver with users' data and email :-( Any hint? TIA, gc -- Giulio Casella giulio at di.unimi.it System and network architect Computer Science Dept. - University of Milano

2 2

Fail to import VM from Export Domain
by carl langlois 27 Mar '23

27 Mar '23

Hi, Our main storage domain has failed and we are trying to recover it. On our system we also have an Export Domain that adds some clone vm in it. But when trying to import the vm from the export domain i always get a fail. 023-03-27 08:45:40,273-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (default task-31) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock Acquired to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:28,697-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-35) [30eb771d-ccd6-4484-97bd-825aaf9b2443] EVENT_ID: IMPORTEXPORT_IMPORT_VM_FAILED(1,153), Failed to import Vm flexlm_clone to Data Center Default, Cluster Default 2023-03-27 08:47:28,798-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (EE-ManagedThreadFactory-engine-Thread-35) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock freed to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:39,737-04 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Trying to release exclusive lock which does not exist, lock key: 'flexlm_cloneVM_NAME' 2023-03-27 08:47:39,737-04 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] Lock freed to object 'EngineLock:{exclusiveLocks='[flexlm_clone=VM_NAME, e36327c2-9019-4eb4-8309-4df0557961cb=VM]', sharedLocks='[99eae7e7-29b4-4226-907a-02011ca5eec1=REMOTE_VM]'}' 2023-03-27 08:47:40,091-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-16) [30eb771d-ccd6-4484-97bd-825aaf9b2443] EVENT_ID: IMPORTEXPORT_IMPORT_VM_FAILED(1,153), Failed to import Vm flexlm_clone to Data Center Default, Cluster Default I was able to import 1 of them. but all the others fail. Any hints to suggest? Regards Carl

1 0

Setup oVirt self hosted engine on Rocky LInux 8 using cockpit - stuck in deadlock
by dirk.schulz＠geniodata.de 27 Mar '23

27 Mar '23

Hi all, I have set up 3 servers in 3 data centers, each having one physical interface and a vlan interface parented by it. The connection between the 3 servers over the vlan interfaces (using private ip addresses) works (using icmp ping as the test). Now I want to turn them into an ovirt cluster creating the self hosted engine on the first server. I have - made sure the engine fqdn is in dns forward and reverse and in /etc/hosts - made sure that both interfaces have unique dns entries which can be resolved forward and reverse - made sure that both interfaces' fqdns are in /etc/hosts - made sure only the primary hostname (not fqdn) is in /etc/hostname, - made sure ipv6 is available on the physical interface, - made sure ipv6 method is "disabled" on the vlan interface, - set /usr/share/ansible/collections/ansible_collections/ovirt/ovirt/roles/hosted_engine_setup/defaults/main.yml:he_force_ip4: true to make sure no ipv6 attempts to interfere. Now when I use cockpit's hosted engine wizard (not hyperconverged), i run into 2 opposing problems. If I set the FQDN in the "Advanced" sub pane to the FQDN of the vlan interface, the wizards gets stuck at "preparing VM" with "The resolved address doesn't resolve on the selected interface\n". If I set the FQDN in the "Advanced" sub pane to the FQDN of the physical interface, I get the same result. If i add the physical interfaces FQDN to the vlan ip address in /etc/hosts, i get "hostname 'x.y.z' doesn't uniquely match the interface 'enp5s0.4000' selected for the management bridge; it matches also interface with IP ['physical']. Please make sure that the hostname got from the interface for the management network resolves only there." So clearly separating the two interfaces namewise is mandatory. I tried to follow the ansible workflow step by step to see what it does. I seems the validate hostname is triggered twice, second time on filling in FQDN in "Advanced" sub pane - it succeeds with both hostnames (physiscal interface and vlan ip), but that does not prevent the "prepare VM" workflow in doing the same verification and failing, as far as I can see. This is where it happens: 2023-03-20 14:31:48,354+0100 DEBUG ansible on_any args TASK: ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface kwargs is_conditional:False 2023-03-20 14:31:48,355+0100 DEBUG ansible on_any args localhost TASK: ovirt.ovirt.hosted_engine_setup : Check the resolved address resolves on the selected interface kwargs 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "ansible_play_hosts" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "ansible_play_batch" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 DEBUG var changed: host "localhost" var "play_hosts" type "<class 'list'>" value: "[]" 2023-03-20 14:31:48,481+0100 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "changed": false, "msg": "The resolved address doesn't resolve on the selected interface\n" }, "ansible_task": "Check the resolved address resolves on the selected interface", "ansible_type": "task", "status": "FAILED", "task_duration": 0 } So I am really stuck there. I do not have any idea how and where to go on. I can try changing bits in the playbooks and parameters (like using "hostname -A" instead of "hostname -f" for the failing test), but that can't really be the idea - I am to new to this to run into a bug or similar, I will suspect I do overlook something. Any hint or help is appreciated. Cheers, Dirk

4 4

oVirt host deploy: disable multipath
by femi adegoke 27 Mar '23

27 Mar '23

https://bugzilla.redhat.com/show_bug.cgi?id=1472356 There are 2 drives in my install that oVirt is claiming as multipath. I have tried blacklisting at /etc/multipath/ but that hasn't worked. Any better solutions? I need these 2 drives to be non-multipathed.

4 19

Uncertain what to do with "Master storage domain" residing on obsolete storage domain.
by goestin＠intert00bz.nl 27 Mar '23

27 Mar '23

Hello All, I want to phase out a storage domain however it is marked as "master", I have the following questions: 1. What does it mean when a storage domain is "master". 2. What is the correct way to remove a storage domain that is assigned the "master" status. Any insight on the matter would be highly appreciated. Kind regards, Justin

1 0

Emergency Mode following Disk addition
by simon＠justconnect.ie 27 Mar '23

27 Mar '23

Hi All, I added a new local disk and created a new LVM thinpool, VG and lVm’s for Gluster in a 4.5.3 HCI environment. Following reboot the server enters Emergency Mode caused by inactive LV/VG. Running ‘vgchange - ay vg’ activates the LV’s. LVM is configured to use device file but disabling this and using a filter allows the system to start normally. Unfortunately ‘lsblk’ shows that the disk is under multipath control. I’ve tried to exclude this disk from multipath but all efforts have failed. ‘pvscan’ shows the device as /dev/mapper/‘wwid’ instead of /dev/sd* I’ve added the wwid to the blacklists manually and restarted multipath but males no change. Regards Simon

1 0

VDI management on top of Ovirt
by samuel.xhu＠horebdata.cn 26 Mar '23

26 Mar '23

Hello, Ovirt folks, What is the most popular VDI management framework for Ovirt? After googling, I find adfinis/virtesk however which is not active now. I would be much apppreciated if anyone can point out the best open source VDI solutions with Ovirt? best regards, Samuel Do Right Thing (做正确的事) / Pursue Excellence (追求卓越) / Help Others Succeed (成就他人)

2 1

Unable to change engine-config
by James Wadsworth 25 Mar '23

25 Mar '23

I wanted to change the default keyboard layout. I ran # engine-config -s VncKeyboardLayout=it Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value it to key VncKeyboardLayout. Valid values are [ar,cz,da,de,de-ch,en-gb,en-us,es,et,fi,fo,fr,fr-be,fr-ca,fr-ch,hr,hu,is,it,ja,lt,lv,mk,nl,no,pl,pt,pt-br,ru,sl,sv,th,tr] I have tried with other values but the same result: # engine-config -s ClientModeConsoleDefault=vnc Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Cannot set value vnc to key ClientModeConsoleDefault. Valid values are [vnc,spice] Am I making a mistake with the syntax or should I open a bug? Thanks, James

1 0

Unable to reinstall 2nd and 3rd Host after restore HE backup onto 1st host
by James Wadsworth 25 Mar '23

25 Mar '23

Hi there, We are running ovirt 4.5.4 on 3 RHEL 8.7 host with a on self hosted engine again using RHEL 8.7. We are making some changes to our company network so we followed these instructions here to move the ovirt engine onto a new storage with different IP address. https://access.redhat.com/solutions/6529691 We used a host to redeploy the hosted engine from a backup and we managed to get the hosted engine running on the new storage with the IP address. We then tried to reinstall the 2 other hosts but the reinstallation failed with the message: Host ovirt2.ad.tintolav.com installation failed. Task Restart services failed to execute. Please check logs for more details: /var/log/ovirt-engine/host-deploy/ovirt-host-deploy-ansible-20230323083407-ovirt2.ad.tintolav.com-d950815b-f1b9-4dcf-b609-3ff1866a6b70.log In the ovirt-engie host deploy log we see [ "Traceback (most recent call last):", " File \"/usr/bin/vdsm-tool\", line 18, in <module>", " import vdsm.tool", "ModuleNotFoundError: No module named 'vdsm'" ] In the vdsm log on the host there are no errors except for a couple of warnings 2023-03-23 07:58:22,335+0100 WARN (periodic/1) [throttled] MOM not available. Error: [Errno 2] No such file or directory (throttledlog:87) 2023-03-23 07:58:22,336+0100 WARN (periodic/1) [throttled] MOM not available, KSM stats will be missing. Error: (throttledlog:87) We have tried a completely new install for ovirt2, but we have finished back at the same point with the same error. [root@ovirt2 ~]# systemctl status vdsmd ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: disabled) Active: inactive (dead) since Thu 2023-03-23 08:35:32 CET; 56min ago Process: 22942 ExecStart=/usr/libexec/vdsm/daemonAdapter -0 /dev/null -1 /dev/null -2 /dev/null /usr/libexec/vdsm/vdsmd (code=exited, status=0/SUCCESS) Process: 22876 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 22942 (code=exited, status=0/SUCCESS) Mar 23 07:58:20 ovirt2.ad.tintolav.com vdsmd_init_common.sh[22876]: vdsm: Running test_space Mar 23 07:58:20 ovirt2.ad.tintolav.com vdsmd_init_common.sh[22876]: vdsm: Running test_lo Mar 23 07:58:20 ovirt2.ad.tintolav.com systemd[1]: Started Virtual Desktop Server Manager. Mar 23 07:58:22 ovirt2.ad.tintolav.com vdsm[22942]: WARN MOM not available. Error: [Errno 2] No such file or directory Mar 23 07:58:22 ovirt2.ad.tintolav.com vdsm[22942]: WARN MOM not available, KSM stats will be missing. Error: Mar 23 08:35:32 ovirt2.ad.tintolav.com systemd[1]: Stopping Virtual Desktop Server Manager... Mar 23 08:35:32 ovirt2.ad.tintolav.com systemd[1]: vdsmd.service: Succeeded. Mar 23 08:35:32 ovirt2.ad.tintolav.com systemd[1]: Stopped Virtual Desktop Server Manager. Mar 23 08:35:33 ovirt2.ad.tintolav.com systemd[1]: Dependency failed for Virtual Desktop Server Manager. Mar 23 08:35:33 ovirt2.ad.tintolav.com systemd[1]: vdsmd.service: Job vdsmd.service/start failed with result 'dependency'. Mar 23 08:35:33 ovirt2.ad.tintolav.com systemd[1]: vdsmd.service: Job vdsmd.service/start failed with result 'dependency'. [root@ovirt2 ~]# systemctl start vdsmd A dependency job for vdsmd.service failed. See 'journalctl -xe' for details. [root@ovirt2 ~]# journalctl -xe Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: Stopped Auxiliary vdsm service for running helper functions as root. -- Subject: Unit supervdsmd.service has finished shutting down -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- Unit supervdsmd.service has finished shutting down. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: Started Auxiliary vdsm service for running helper functions as root. -- Subject: Unit supervdsmd.service has finished start-up -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- Unit supervdsmd.service has finished starting up. -- -- The start-up result is done. Mar 23 09:34:35 ovirt2.ad.tintolav.com daemonAdapter[28677]: Traceback (most recent call last): Mar 23 09:34:35 ovirt2.ad.tintolav.com daemonAdapter[28677]: File "/usr/libexec/vdsm/daemonAdapter", line 16, in <module> Mar 23 09:34:35 ovirt2.ad.tintolav.com daemonAdapter[28677]: from vdsm.config import config Mar 23 09:34:35 ovirt2.ad.tintolav.com daemonAdapter[28677]: ModuleNotFoundError: No module named 'vdsm' Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Main process exited, code=exited, status=1/FAILURE Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Failed with result 'exit-code'. -- Subject: Unit failed -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- The unit supervdsmd.service has entered the 'failed' state with result 'exit-code'. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Service RestartSec=100ms expired, scheduling restart. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Scheduled restart job, restart counter is at 5. -- Subject: Automatic restarting of a unit has been scheduled -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- Automatic restarting of the unit supervdsmd.service has been scheduled, as the result for -- the configured Restart= setting for the unit. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: Stopped Auxiliary vdsm service for running helper functions as root. -- Subject: Unit supervdsmd.service has finished shutting down -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- Unit supervdsmd.service has finished shutting down. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Start request repeated too quickly. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: supervdsmd.service: Failed with result 'exit-code'. -- Subject: Unit failed -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- The unit supervdsmd.service has entered the 'failed' state with result 'exit-code'. Mar 23 09:34:35 ovirt2.ad.tintolav.com systemd[1]: Failed to start Auxiliary vdsm service for running helper functions as root. -- Subject: Unit supervdsmd.service has failed -- Defined-By: systemd -- Support: https://access.redhat.com/support -- -- Unit supervdsmd.service has failed. -- -- The result is failed. It gives the same error on the 3rd host. Is this a python dependency issue? We are currently using python3.9. Does anyone have any ideas how we get host 2 and 3 up and running again in the cluster? Thanks James

1 1

Re: Expand the disk space of the hosting engine
by BJ一哥 24 Mar '23

24 Mar '23

Hello I got an error when adding a hard disk to HostedEngine in wei ui An error occurred while performing the operation: HostedEngine: Unable to add virtual disk. The engine is not managing this virtual machine. Should I use the command line to add disks Use vdsm-client VM diskSizeExtend or vdsm-client Volume extendSize. I have not tested these two commands successfully Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> 于2023年1月3日周二 13:27写道： > You allocated a 100G storage domain. > > Within that storage domain, you allocated a 50G disk to hold the disk > image. > > Just like any other storage domain, you can create additional disks. I > have seen warnings, for going over 80% allocated within this storage domain. > > When building the Self-Hosted-Engine, I specify 75GB when asked about the > size of the disk to create, and then use LVM to add the unused storage of > the disk to the root and swap logical volumes. > > You should be able to add a second disk of about 25G to the SHE, and use > LVM to add it to the existing volume groups and expand the existing logical > volumes. > > Of course, I have not tested this. > > > > -----Original Message----- > From: ziyi Liu <lzy19930211(a)gmail.com> > Sent: Thursday, December 29, 2022 9:21 PM > To: users(a)ovirt.org > Subject: [ovirt-users] Re: Expand the disk space of the hosting engine > > Thank you very much, I know the operation steps, but there is still one > point that I don’t quite understand, fdisk -l only shows 50G, the actual > disk allocation has 100G, how can I display the remaining 50G. > The second question is that if the allocated 100G is also full, how should > I expand it? I can’t expand it using wei ui > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: > https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/QRKI2S4WLJ2JD… >

1 0

Update oVirt Node to 4.5.4 fails do to disk full (with urandom)
by Sven Jansen 24 Mar '23

24 Mar '23

Hi, i try to update my oVirt Nodes from 4.5.3 to 4.5.4 but it always fails on my hosts. Watching the rpm install process i see that the rpm is building the boot image/bank and /var/tmp filling up quickly. Looking deeper into this folders i see that there is a dracut folder created by the update process that contains a urandom file with the size of all available space in /var/tmp. [root@ovnode01 dev]# df -h Filesystem Size Used Avail Use% Mounted on devtmpfs 4.0M 0 4.0M 0% /dev tmpfs 504G 4.0K 504G 1% /dev/shm tmpfs 202G 11M 202G 1% /run /dev/mapper/onn_ovnode01-ovirt--node--ng--4.5.3--0.20221018.0+1 136G 5.4G 130G 4% / /dev/mapper/onn_ovnode01-home 1014M 40M 975M 4% /home /dev/mapper/onn_ovnode01-tmp 1014M 40M 975M 4% /tmp /dev/mapper/onn_ovnode01-var 5.0G 110M 4.9G 3% /var /dev/sda2 1014M 577M 438M 57% /boot /dev/sda1 599M 7.5M 592M 2% /boot/efi /dev/mapper/onn_ovnode01-var_crash 10G 105M 9.9G 2% /var/crash /dev/mapper/onn_ovnode01-var_log 8.0G 1.8G 6.3G 22% /var/log /dev/mapper/onn_ovnode01-var_tmp 10G 10G 44K 100% /var/tmp /dev/mapper/onn_ovnode01-var_log_audit 2.0G 50M 2.0G 3% /var/log/audit /dev/loop1 4.2G 4.0G 171M 96% /tmp/tmp.crVxhNRBFq tmpfs 101G 0 101G 0% /run/user/0 [root@ovnode01 dev]# pwd /var/tmp/dracut.H2mKd4/initramfs/dev [root@ovnode01 dev]# ls -lh total 9.9G -rw-r--r--. 1 root root 9.9G Mar 20 16:18 urandom For me it looks like that imgbase (or whatever build this images) copies /dev/urandom into the new image, as expected this is not possible. Anyone know an workaround for this issue?

1 0

HostedEngine: Unable to add virtual disk
by ziyi Liu 24 Mar '23

24 Mar '23

I want to add a disk to HostedEngine, and the following error occurs when adding a disk in the web ui HostedEngine: Unable to add virtual disk. The engine is not managing this virtual machine. Does HostedEngine need to use vdms to add disks? Is it the following operation 1. Set managed engine maintenance mode to global 2. Close HostedEngine 3. Extend the disk vdsm-client Volume extendSize 4. start vm 5. Use fdisk to partition and expand

1 0

Deploy hosted-engine by command line failed
by pengCH 24 Mar '23

24 Mar '23

Hi, ovirt-node-ng-installer-4.5.4-2022120615.el8.iso ovirt-engine-appliance-4.5-20221206133948.1.el8.x86_64.rpm After deployed gfs cluster, then install hosted engine by commad line prompt the follwing message:

1 0

TypeError: Cannot read properties of undefined (reading 'toString')
by charnet1019＠163.com 24 Mar '23

24 Mar '23

Env: oVirt version: ovirt-node-ng-installer-4.5.4-2022120615.el8.iso oVirt engine appliance: ovirt-engine-appliance-4.5-20221206133948.1.el8.x86_64.rpm I have three nodes, each node has two disks, one for installing ovirt node and one for installing gfs. after intalled gfs by web wizard and to install hosted engine by web console, at this time, the installation wizard page does not pop up, and the following error is reported in the browser console: PackageKit went away from D-Bus Failed to read file /usr/share/cockpit/ovirt-dashboard/gdeploy-templates/he-common.conf. Check that the file exists and is not empty HostedEngineSetup.js:260 Failed to read certificate HostedEngineSetup.js:230 General system data retrieval started. DefaultValueProvider.js:95 No gdeploy answer files found. HeSetupWizardContainer.js:117 Ansible output file directory created successfully. PlaybookUtil.js:156 Host FQDN: node210.com Validation.js:138 Execution of /usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml with tags get_network_interfaces started PlaybookUtil.js:30 Ansible output file directory created successfully. PlaybookUtil.js:156 Execution of /usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml with tags validate_hostnames started PlaybookUtil.js:30 General system data retrieved successfully. DefaultValueProvider.js:98 Execution of /usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml with tags validate_hostnames completed successfully PlaybookUtil.js:67 Validation of host FQDN, node210.com, succeeded Validation.js:176 Execution of /usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml with tags get_network_interfaces completed successfully PlaybookUtil.js:67 Network interfaces retrieved successfully TypeError: Cannot read properties of undefined (reading 'toString') react-dom.production.min.js:188 at Ds.getDisplayValue (ReviewGenerator.js:24:31) at Ds.<anonymous> (ReviewGenerator.js:45:49) at Array.forEach (<anonymous>) at Ds.<anonymous> (ReviewGenerator.js:39:53) at Array.forEach (<anonymous>) at Ds.generateReviewSections (ReviewGenerator.js:36:48) at Ds.getReviewSections (ReviewGenerator.js:77:31) at Ps.render (AnsiblePhasePreviewContainer.js:138:30) at Io (react-dom.production.min.js:167:226) at Lo (react-dom.production.min.js:180:75) DefaultValueProvider.js:73 Promise.all failed TypeError: Cannot read properties of undefined (reading 'toString') DefaultValueProvider.js:74 at Ds.getDisplayValue (ReviewGenerator.js:24:31) at Ds.<anonymous> (ReviewGenerator.js:45:49) at Array.forEach (<anonymous>) at Ds.<anonymous> (ReviewGenerator.js:39:53) at Array.forEach (<anonymous>) at Ds.generateReviewSections (ReviewGenerator.js:36:48) at Ds.getReviewSections (ReviewGenerator.js:77:31) at Ps.render (AnsiblePhasePreviewContainer.js:138:30) at Io (react-dom.production.min.js:167:226) at Lo (react-dom.production.min.js:180:75) Error: dig exited with code 9 HostedEngineSetupUtil.js:1411

1 0

Re: ovirt and network outages
by Gianluca Cecchi 22 Mar '23

22 Mar '23

On Mon, Mar 20, 2023 at 7:59 PM Fedele Stabile <fedele.stabile(a)fis.unical.it> wrote: > Ok i will prepare all to the next outage > If the latest outage was not long ago, you could still find some preliminary and useful information inside /var/log/ovirt-engine/engine.log of the engine In general, for all oVirt related log files you can refer to this url: https://www.ovirt.org/documentation/administration_guide/#chap-Log_Files some of them are also rotated Gianluca

2 1

How to delete/detach a disk from online VM ?
by morgan cox 22 Mar '23

22 Mar '23

Hello. Is it possible to remove a (unmounted, unused) disk from a VM when online? I tried via the UI and I get 'Error while executing action: Cannot remove Virtual Disk. At least one of the VMs is not down.' I know you can with standard KVM/Libvirt/virt-manager - is there any way I can remove a disk from a VM whilst it is online in Ovirt ? Thanks

3 3

I can't enable cinderlib
by fsayd＠derecho.uncu.edu.ar 21 Mar '23

21 Mar '23

Hello: I am trying to deploy a 4.5 cluster with 3 hosts that also provides Ceph storage. I am running the engine in a standalone host (No hosted engine). I followed the steps to enable cinderlib (https://access.redhat.com/solutions/5605141) but the managed domain option doesn't show in the add storage domain dialog. I don't know what I am doing wrong Do I need to add a primary storage domain (iSCSI, NFS, etc) in order to add a Ceph domain?? * engine: 4.5.4-1.el8 * hosts: Rocky Linux release 8.7 Thanks engine: 4.5.4-1.el8 hosts: Rocky Linux release 8.7

2 1

oVirt 4.5.x User Creation with Keycloak
by simon＠justconnect.ie 21 Mar '23

21 Mar '23

Can anyone point me in the direction of documentation to create new users and groups to provide specific permissions please? Thanks Simon...

2 2

HostedEngine restarts from time to time
by ziyi Liu 21 Mar '23

21 Mar '23

Version 4.5.3.2-1.el8 There are two red warnings in the /var/log/messages file kernel shpchp 0000:01:00.0: Slot initialization failed kernel shpchp 0000:01:00.0: pci_hp_register failed with error -16

1 0

Gluster Geo-Replication session not visible in oVirt Manager UI
by simon＠justconnect.ie 20 Mar '23

20 Mar '23

I have previously created Gluster geo-replicated sessions from the command line on 4.4.5. These sessions appear in the 'Geo-Replication' Tab of the Gluster Volume on the Master. I've just built 2 new oVirt clusters 4.5.3.2 and configured a geo-replicated session. The session doesn't appear in the WebUI but appears to be working when checked from the command line. Any ideas anyone please? Regards Simon

1 1

4.5.2 Create Additional Gluster Logical Volumes fails
by simon＠justconnect.ie 20 Mar '23

20 Mar '23

Hi, In 4.4 adding additional gluster volumes was a simple ansible task (or via cockpit). With 4.5.2 I tried to add new volumes but the logic has changed/broken. Here's the error I am getting: TASK [gluster.infra/roles/backend_setup : Create volume groups] ******************************************************************************************************************************** failed: [bdtovirthcidmz02-strg.mydomain.com] (item={'key': 'gluster_vg_sda', 'value': [{'vgname': 'gluster_vg_sda', 'pvname': '/dev/sda'}]}) => {"ansible_loop_var": "item", "changed": true, "cmd": ["vgcreate", "--dataalignment", "2048K", "-s", "2048K", "gluster_vg_sda", "/dev/sda"], "delta": "0:00:00.010442", "end": "2022-11-10 13:11:16.717772", "item": {"key": "gluster_vg_sda", "value": [{"pvname": "/dev/sda", "vgname": "gluster_vg_sda"}]}, "msg": "non-zero return code", "rc": 3, "start": "2022-11-10 13:11:16.707330", "stderr": " Configuration setting \"filter\" invalid. It's not part of any section.\n /dev/gluster_vg_sda: already exists in filesystem\n Run `vgcreate --help' for more information.", "stderr_lines": [" Configuration setting \"filter\" invalid. It's not part of any section.", " /dev/gluster_vg_sda: already exists in filesystem", " Run `vgcreate --help' for more information."], "stdout": "", "stdout_lines": []} failed: [bdtovirthcidmz03-strg.mydomain.com] (item={'key': 'gluster_vg_sda', 'value': [{'vgname': 'gluster_vg_sda', 'pvname': '/dev/sda'}]}) => {"ansible_loop_var": "item", "changed": true, "cmd": ["vgcreate", "--dataalignment", "2048K", "-s", "2048K", "gluster_vg_sda", "/dev/sda"], "delta": "0:00:00.010231", "end": "2022-11-10 13:12:35.607565", "item": {"key": "gluster_vg_sda", "value": [{"pvname": "/dev/sda", "vgname": "gluster_vg_sda"}]}, "msg": "non-zero return code", "rc": 3, "start": "2022-11-10 13:12:35.597334", "stderr": " Configuration setting \"filter\" invalid. It's not part of any section.\n /dev/gluster_vg_sda: already exists in filesystem\n Run `vgcreate --help' for more information.", "stderr_lines": [" Configuration setting \"filter\" invalid. It's not part of any section.", " /dev/gluster_vg_sda: already exists in filesystem", " Run `vgcreate --help' for more information."], "stdout": "", "stdout_lines": []} failed: [bdtovirthcidmz01-strg.mydomain.com] (item={'key': 'gluster_vg_sda', 'value': [{'vgname': 'gluster_vg_sda', 'pvname': '/dev/sda'}]}) => {"ansible_loop_var": "item", "changed": true, "cmd": ["vgcreate", "--dataalignment", "2048K", "-s", "2048K", "gluster_vg_sda", "/dev/sda"], "delta": "0:00:00.011282", "end": "2022-11-10 13:13:24.336233", "item": {"key": "gluster_vg_sda", "value": [{"pvname": "/dev/sda", "vgname": "gluster_vg_sda"}]}, "msg": "non-zero return code", "rc": 3, "start": "2022-11-10 13:13:24.324951", "stderr": " Configuration setting \"filter\" invalid. It's not part of any section.\n /dev/gluster_vg_sda: already exists in filesystem\n Run `vgcreate --help' for more information.", "stderr_lines": [" Configuration setting \"filter\" invalid. It's not part of any section.", " /dev/gluster_vg_sda: already exists in filesystem", " Run `vgcreate --help' for more information."], "stdout": "", "stdout_lines": []} The vg was created as part of the initial ansible build with logical volumes being added when required. Any assistance would be greatly appreciated. Kind regards Simon

6 21

oVirt On Rocky 8.x - Upgrade To Rocky 9.1
by Matthew J Black 20 Mar '23

20 Mar '23

Hi All, Sorry if this was mentioned previously (I obviously missed it if it was) but can we upgrade an oVirt (latest version) Host/Cluster and/or the oVirt Engine VM from Rocky Linux (RHEL) v8.6/8.7 to v9.1 (yet), and if so, what is / where can I find the procedure to do this - ie is there anything "special" that needs to be done because of oVirt, or can we just do a "simple" v8.x +> v9.1 upgrade? Thanks in advance Cheers Dulux-Oz

4 3

Re: ovirt and network outages
by Gianluca Cecchi 20 Mar '23

20 Mar '23

Il Lun 20 Mar 2023, 17:32 Fedele Stabile <fedele.stabile(a)fis.unical.it> ha scritto: > Thank you Gianluca for your answer. > Population of /etc/hosts as a backup with host and ovirt engine ip: > this has already been done. > > Fedele > > ______________ > Fedele, I think you should define better what "misaligned" means in your case, give some details on versions in play, architecture (self hosted vs standalone engine) and provide some logs from the engine and hosts (preferably through a link to a file sharing service if big), so that you can get better help. Gianluca >

2 1

ovirt and network outages
by Fedele Stabile 20 Mar '23

20 Mar '23

Hi, I would like to know if it is possible to configure oVirt so as not to be affected by internet connection loss. I have three ovirt hosts and together with the switch that connects them they are powered by a UPS. Currently, when I have an internet outage, the oVirt hosts get misaligned and the VMs shut down. Fedele Stabile

3 2

oVirt 4.5.4 - passing dot1q trunk into VM
by serh＠list.ru 20 Mar '23

20 Mar '23

Hello collegues! Is there a way to pass a dot1q trunk (all VLANs, or specified list of VLANs as an option) to a VM in oVirt 4.5.4 to define a subinterfaces (like eth0.5 , eth0.10, eth0.15 etc) over a single underlying L2 interface inside a VM instead of defining every single VM Network in oVirt and passing it into a VM as a set of untagged interfaces (eth0, eth1, eth2 etc)? Disclaimer: pls don't offer SR-IOV passthrough as a solusion =] ----------------------- WBR, Serhio Go

1 0

Error importing OVF - VM windows server 2019
by wcordero8＠gmail.com 20 Mar '23

20 Mar '23

Infrastructure: VMware ESXi, 7.0.3, 19193900 oVirt Version 4.5.4-1.el8 oVirt self-hosted engine Steps to Reproduce: 1.Export Windows VM Microsoft Windows Server 2019 (64-bit) to OVA/OVF from VSphere with ovftool. 2. import the VM in oVirt I don't see an error, apparently everything ends well, but the import fails. Grep the log /var/log/vdsm/import/import- by message I see: { "message": "Setting up the source: -i ova /imports_ovf/Implementacion_01-Clon/", "timestamp": "2023-02-28T17:52:07.755714728-05:00", "type": "message" } { "message": "Opening the source", "timestamp": "2023-02-28T18:00:18.825466713-05:00", "type": "message" } { "message": "Inspecting the source", "timestamp": "2023-02-28T18:00:24.101543928-05:00", "type": "message" } -q, --quiet suppress extra info messages { "message": "Checking for sufficient free disk space in the guest", "timestamp": "2023-02-28T18:00:37.367137882-05:00", "type": "message" } { "message": "Converting Windows Server 2019 Datacenter to run on KVM", "timestamp": "2023-02-28T18:00:37.367187336-05:00", "type": "message" } { "message": "this guest has Windows Group Policy Objects (GPO) and a new virtio block device driver was installed. In some circumstances, Group Policy may prevent new drivers from working (resulting in a 7B boot error). If this happens, try disabling Group Policy before doing the conversion.", "timestamp": "2023-02-28T18:01:01.789748487-05:00", "type": "warning" } { "message": "This guest has virtio drivers installed.", "timestamp": "2023-02-28T18:01:01.789934703-05:00", "type": "info" } { "message": "Mapping filesystem data to avoid copying unused and blank areas", "timestamp": "2023-02-28T18:01:02.152024602-05:00", "type": "message" } { "message": "Closing the overlay", "timestamp": "2023-02-28T18:01:07.569706626-05:00", "type": "message" } { "message": "Assigning disks to buses", "timestamp": "2023-02-28T18:01:07.868223883-05:00", "type": "message" } { "message": "Checking if the guest needs BIOS or UEFI to boot", "timestamp": "2023-02-28T18:01:07.868318538-05:00", "type": "message" } { "message": "This guest requires UEFI on the target to boot.", "timestamp": "2023-02-28T18:01:07.868357947-05:00", "type": "info" } { "message": "Setting up the destination: -o vdsm", "timestamp": "2023-02-28T18:01:07.868509025-05:00", "type": "message" } { "message": "Copying disk 1/3", "timestamp": "2023-02-28T18:01:11.002279668-05:00", "type": "message" } { "message": "Copying disk 2/3", "timestamp": "2023-02-28T18:07:59.995602736-05:00", "type": "message" } { "message": "Copying disk 3/3", "timestamp": "2023-02-28T18:18:09.997678507-05:00", "type": "message" } { "message": "Creating output metadata", "timestamp": "2023-02-28T18:18:55.349317923-05:00", "type": "message" } { "message": "Finishing off", "timestamp": "2023-02-28T18:18:55.380422772-05:00", "type": "message" } Any idea what I can check?

2 1

Re: [External] : Re: Error: Host is not up, please check logs, perhaps also on the engine machine
by Андрей Ваник 20 Mar '23

20 Mar '23

Hello, OS Host Version: Rocky Linux 8.7 I try to deploy as a self-hosted engine. ( https://www.ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engin… ) Failed step on err5.jpg in attachment. [image: err5.JPG] And then in Engine VM I see Ansible error (attach failed_install_ovs.jpg) Attach deployment log from host machine (zip). Please help me understand why it doesn't work. Thanks. пт, 17 мар. 2023 г. в 18:45, Marcos Sungaila <marcos.sungaila(a)oracle.com>: > Hi > > > > Let me try something. > > > > You sent some messages, but all of them needed more information. > > You can send as many e-mails as you need, but it will help if you provide > enough information to help us help you. > > > > You didn’t say which OS version you use to deploy the hosted engine. Which > oVirt version are you using? > > The log you sent is the ansible log, not the deployment log. It should be > better to send both if you want. > > Also, a simple search for failed in your log shows your installation is > missing some packages. > > > > Regards > > Marcos > > > > *From:* Андрей Ваник <staybox(a)gmail.com> > *Sent:* Friday, March 17, 2023 9:39 AM > *To:* users(a)ovirt.org > *Subject:* [External] : [ovirt-users] Re: Error: Host is not up, please > check logs, perhaps also on the engine machine > > > > I see errors in the Ovirt Engine VM. > > In attach. > > > > пт, 17 мар. 2023 г. в 12:37, Андрей Ваник <staybox(a)gmail.com>: > > Hello, > > > > We are trying to deploy ovirt hosted environment, but we are facing an > error: > > Host is not up, please check logs, perhaps also on the engine machine > > > > Screenshots in attachment. > > > > Please help. > >

1 0

Error: Host is not up, please check logs, perhaps also on the engine machine
by Андрей Ваник 17 Mar '23

17 Mar '23

Hello, We are trying to deploy ovirt hosted environment, but we are facing an error: Host is not up, please check logs, perhaps also on the engine machine Screenshots in attachment. Please help.

2 2

Host is not up, please check logs, perhaps also on the engine machine
by staybox＠gmail.com 17 Mar '23

17 Mar '23

Hello, What I install: over-hosted engine (command: hosted-engine --deploy --4) What is the error: Host is not up, please check logs, perhaps also on the engine machine Please help.

1 0

Ovirt on GCP
by Hideo Goto 17 Mar '23

17 Mar '23

Dear sirs, I installed an ovirt4.5 platform on Google Cloud (2x N1 VMs / Centos stream8: 1 engine, 1 node / Nested virtualization enabled). While it works well and I could import an existing VM from our onpremiss oivrt site, I m just facing to a fundemental problem: How to assign an IP address to Level2 VM ? I tried to assign a static IP usually reserved for a GCP L1 VM in vain; it cannot comunicate with outside. If anyone could give me any advise, I would be happy. Thanks in advance. Hideo Goto

1 0

Error 500 when adding a new host
by Murilo Morais 16 Mar '23

16 Mar '23

Good afternoon everybody. I'm using oVirt 4.4.10 at the moment. After activating Cinder, I believe that some packages were updated, which is causing some problems, one of them is occurring when I try to add a Host, then it shows a 500 error, the same is happening when editing a Host. The following error is happening in the server.log: 2023-03-16 10:54:39,651-04 ERROR [io.undertow.servlet] (default task-133) Exception while dispatching incoming RPC call: com.google.gwt.user.server.rpc.UnexpectedException: Service method 'public abstract java.util.ArrayList org.ovirt.engine.ui.frontend.gwtservices.GenericApiGWTService.runMultipleQueries(java.util.ArrayList,java.util.ArrayList)' threw an unexpected exception: javax.ejb.EJBException: WFLYEJB0442: Unexpected Error at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RPC.encodeResponseForFailure(RPC.java:416) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:605) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:333) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:303) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:373) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.api(a)2.0.0.Final //javax.servlet.http.HttpServlet.service(HttpServlet.java:523) at deployment.engine.ear.webadmin.war//org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.service(GenericApiGWTServiceImpl.java:78) at javax.servlet.api(a)2.0.0.Final //javax.servlet.http.HttpServlet.service(HttpServlet.java:590) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) at org.ovirt.engine.core.utils//org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils//org.ovirt.engine.core.utils.servlet.CachingFilter.doFilter(CachingFilter.java:133) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at deployment.engine.ear.webadmin.war//org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils//org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:65) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.core(a)2.2.5.Final //io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.core(a)2.2.5.Final //io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.core(a)2.2.5.Final //io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.core(a)2.2.5.Final //io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.core(a)2.2.5.Final //io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.core(a)2.2.5.Final //io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.core(a)2.2.5.Final //io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.core(a)2.2.5.Final //io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.core(a)2.2.5.Final //io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52) at io.undertow.core(a)2.2.5.Final //io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:269) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:78) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:133) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:130) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at org.wildfly.extension.undertow(a)23.0.2.Final //org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1530) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:249) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:78) at io.undertow.servlet(a)2.2.5.Final //io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:99) at io.undertow.core(a)2.2.5.Final //io.undertow.server.Connectors.executeRootHandler(Connectors.java:387) at io.undertow.core(a)2.2.5.Final //io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:841) at org.jboss.threads(a)2.4.0.Final //org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) at org.jboss.threads(a)2.4.0.Final //org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1990) at org.jboss.threads(a)2.4.0.Final //org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486) at org.jboss.threads(a)2.4.0.Final //org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377) at org.jboss.xnio(a)3.8.4.Final //org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1280) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: javax.ejb.EJBException: WFLYEJB0442: Unexpected Error at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:234) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:446) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:164) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.module.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:81) at org.jboss.as.weld.common(a)23.0.2.Final //org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.elytron-private(a)1.15.3.Final //org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:633) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:191) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.common.interfaces.BackendLocal$$$view2.runQuery(Unknown Source) at deployment.engine.ear.webadmin.war//org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:90) at deployment.engine.ear.webadmin.war//org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runMultipleQueries(GenericApiGWTServiceImpl.java:121) at jdk.internal.reflect.GeneratedMethodAccessor149.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at deployment.engine.ear.webadmin.war//com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:587) ... 65 more Caused by: java.lang.NoClassDefFoundError: org/apache/sshd/common/util/io/output/SecureByteArrayOutputStream at org.ovirt.engine.core.utils//org.ovirt.engine.core.utils.crypt.EngineEncryptionUtils.getEngineSSHPublicKey(EngineEncryptionUtils.java:137) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.hostdeploy.GetEngineSSHPublicKeyQuery.executeQueryCommand(GetEngineSSHPublicKeyQuery.java:19) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:106) at org.ovirt.engine.core.dal//org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.executor.DefaultBackendQueryExecutor.execute(DefaultBackendQueryExecutor.java:14) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:520) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:489) at jdk.internal.reflect.GeneratedMethodAccessor64.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.ejb(a)23.0.2.Final //org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:92) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.interceptorChainCompleted(WeldInvocationContextImpl.java:107) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:126) at org.ovirt.engine.core.common//org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12) at jdk.internal.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.invokeNext(WeldInvocationContextImpl.java:92) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:124) at org.jboss.weld.core(a)3.1.6.Final //org.jboss.weld.bean.InterceptorImpl.intercept(InterceptorImpl.java:105) at org.jboss.as.weld.ejb(a)23.0.2.Final //org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:82) at org.jboss.as.weld.ejb(a)23.0.2.Final //org.jboss.as.weld.interceptors.EjbComponentInterceptorSupport.delegateInterception(EjbComponentInterceptorSupport.java:60) at org.jboss.as.weld.common(a)23.0.2.Final //org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:77) at org.jboss.as.weld.common(a)23.0.2.Final //org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:89) at org.jboss.as.weld.common(a)23.0.2.Final //org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:102) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) at jdk.internal.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee(a)23.0.2.Final //org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) at org.jboss.invocation(a)1.6.0.Final //org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3(a)23.0.2.Final //org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:232) ... 103 more Caused by: java.lang.ClassNotFoundException: org.apache.sshd.common.util.io.output.SecureByteArrayOutputStream from [Module "org.ovirt.engine.core.uutils" from local module loader @363a52f (finder: local module finder @60856961 (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:255) at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:410) at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398) at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116) ... 153 more However, I find the following: # ls /usr/share/ovirt-engine/modules/common/org/apache/sshd/main/ module.xml sshd-common.jar sshd-core.jar # ls /usr/share/ovirt-engine-wildfly/modules/system/layers/base/org/apache/sshd/main/ module.xml sshd-common-2.4.0.jar sshd-core-2.4.0.jar # ls /usr/share/ovirt-engine-wildfly/modules/system/layers/base/org/apache/sshd/main/ module.xml sshd-common-2.4.0.jar sshd-core-2.4.0.jar What could have gone wrong when activating Cinder?

1 0

Image upload (with ovirt-imageio) stops abruptly (logs included) - Ovirt 4.5.4, hosted-engine
by adam.puchejda＠nask.pl 15 Mar '23

15 Mar '23

Hi, I have a problem using the upload feature in Ovirt GUI (Storage/Disks -> Upload button) that maybe you could help me resolve. The problem is with the transfer that starts... and stops abruptly. What's more, logs (below) do not register any errors. I am using a hosted-engine in a brand new Ovirt 4.5.4 environment with Ovirt nodes running CentOS 8 Stream. I have uploaded the CA certificate to the browser (Chrome, Edge). Thank you and best wishes, Adam Logs: /var/log/ovirt-imageio/daemon.log 2023-03-15 08:51:17,123 INFO (Thread-25) [http] OPEN connection=25 client=local 2023-03-15 08:51:17,125 INFO (Thread-25) [tickets] [local] ADD transfer={'dirty': False, 'ops': ['write'], 'size': 160432128, 'sparse': True, 'inactivity_timeout': 60, 'transfer_id': '32a96cf6-a0d9-4e85-b80b-034a16a9214b', 'uuid': 'fc5acb59-e8a4-4cbf-bc55-d115aeb760b9', 'timeout': 300, 'url': 'nbd:unix:/run/vdsm/nbd/32a96cf6-a0d9-4e85-b80b-034a16a9214b.sock'} 2023-03-15 08:51:17,127 INFO (Thread-25) [http] CLOSE connection=25 client=local [connection 1 ops, 0.002591 s] [dispatch 1 ops, 0.001178 s] 2023-03-15 08:51:19,440 INFO (Thread-26) [http] OPEN connection=26 client=local 2023-03-15 08:51:19,442 INFO (Thread-26) [http] CLOSE connection=26 client=local [connection 1 ops, 0.001493 s] [dispatch 1 ops, 0.000457 s] (..) 2023-03-15 08:52:21,808 INFO (Thread-33) [http] OPEN connection=33 client=local 2023-03-15 08:52:21,809 INFO (Thread-33) [tickets] [local] EXTEND timeout=300 transfer=32a96cf6-a0d9-4e85-b80b-034a16a9214b 2023-03-15 08:52:21,810 INFO (Thread-33) [http] CLOSE connection=33 client=local [connection 1 ops, 0.001537 s] [dispatch 1 ops, 0.000518 s] /var/log/vdsm/vdsm.log 2023-03-15 08:51:16,810+0000 INFO (jsonrpc/5) [vdsm.api] START start_nbd_server(server_id='32a96cf6-a0d9-4e85-b80b-034a16a9214b', config={'detect_zeroes': True, 'discard': True, 'readonly': False, 'bitmap': None, 'sd_id': 'd3896a51-efde-4723-875f-bdc4c737d0d3', 'img_id': '4fbae53f-2f12-4e46-b54f-3ca09fb00755', 'vol_id': '104ea438-49d1-465e-a489-0695f100d325', 'backing_chain': True}) from=::ffff:[IPV4_NUMBER],41446, flow_id=cdd21264-4021-4ee9-aac1-aefe6f244bb1, task_id=0dea4f64-e790-49fe-bc0d-1f40e6f31610 (api:31) 2023-03-15 08:51:16,823+0000 INFO (jsonrpc/5) [storage.nbd] Starting transient service vdsm-nbd-32a96cf6-a0d9-4e85-b80b-034a16a9214b.service, serving /rhev/data-center/mnt/glusterSD/[HOSTNAME]:_ovirt-engine/d3896a51-efde-4723-875f-bdc4c737d0d3/images/4fbae53f-2f12-4e46-b54f-3ca09fb00755/104ea438-49d1-465e-a489-0695f100d325 via unix socket /run/vdsm/nbd/32a96cf6-a0d9-4e85-b80b-034a16a9214b.sock (nbd:138) 2023-03-15 08:51:16,881+0000 INFO (jsonrpc/5) [vdsm.api] FINISH start_nbd_server return={'result': 'nbd:unix:/run/vdsm/nbd/32a96cf6-a0d9-4e85-b80b-034a16a9214b.sock'} from=::ffff:[IPV4],41446, flow_id=cdd21264-4021-4ee9-aac1-aefe6f244bb1, task_id=0dea4f64-e790-49fe-bc0d-1f40e6f31610 (api:37) 2023-03-15 08:51:17,121+0000 INFO (jsonrpc/1) [vdsm.api] START add_image_ticket(ticket={'dirty': False, 'ops': ['write'], 'size': 160432128, 'sparse': True, 'inactivity_timeout': 60, 'transfer_id': '32a96cf6-a0d9-4e85-b80b-034a16a9214b', 'uuid': 'fc5acb59-e8a4-4cbf-bc55-d115aeb760b9', 'timeout': 300, 'url': 'nbd:unix:/run/vdsm/nbd/32a96cf6-a0d9-4e85-b80b-034a16a9214b.sock'}) from=::ffff:[IPV4_NUMBER],41446, flow_id=cdd21264-4021-4ee9-aac1-aefe6f244bb1, task_id=10f6ed38-2135-4c06-a948-af70af88f743 (api:31)

1 0

watchdog: BUG: soft lockup - CPU#3 stuck for XXXs! mitigations?
by Diego Ercolani 14 Mar '23

14 Mar '23

Hello, I noticed that when you have poor "storage" performances, al the VMs are frustrated with entry like the one in the subject. Searching around there is a case under redhat: https://access.redhat.com/solutions/5427 that is suggesting to address the issue (if not possible to have rocket performances from the storage) regulating the elevator scheduler in kernel. but in a virtual machine I have this default queue: root@openproject:# cat /sys/block/sda/queue/scheduler [none] mq-deadline So it seem a little bit outdated Is this solution resolutive? Kernel Guru here what suggests? The problem is also that the datetime function of local VM (also hosted engine) return also not correct date time (often in 2177 year) after these avents creating annoying problems in DaraWareHouse and stucking all the certificate clients....

1 0

RBD Mirror support
by Murilo Morais 14 Mar '23

14 Mar '23

Good evening everyone! Guys, I managed to raise the RBD through Cinder without problem. Everything works, including removing the Storage Domain (through postgres). The initial objective was to go up with RBD Mirror but I'm not succeeding, because Cinder is connecting the volume through KRBD, it doesn't support Journaling which ends up breaking the Mirror... Is there any way/configuration for Cinder to start the machine using librbd instead of KRBD? Because in my scenario we have to use Mirror. Thanks in advance.

2 4

Failed to remove MBS
by Murilo Morais 13 Mar '23

13 Mar '23

Good afternoon everybody! I have an MBD (Managed Block Storage) Storage Domain that we no longer use, we want to remove it. We are using version 4.4.10. When trying to put the Storage Domain in Maintenance, a message appears saying that it was not possible to remove it and that there is a Task being executed. I already looked for it but I didn't find it. Therefore, I cannot put the Storage Domain in Maintenance in the Datacenter, making it impossible to carry out the removal. According to a Bug Report [1] the problem has been fixed in version 4.5.0, the problem is that we cannot perform the update. In the DB I found two references to this Storage Domain, one in the `storage_domain_static` table and another in the `cinder_storage` table. Is removing these two references enough to remove this Storage Domain? Is there any other way to perform this process manually? [1] https://bugzilla.redhat.com/show_bug.cgi?id=1959385

2 3

Self Hosted Engine in unaligned state: node are
by Diego Ercolani 13 Mar '23

13 Mar '23

Hello, ovirt-release-host-node-4.5.4-1.el8.x86_64 Today I found my cluster in an unconsinstent state I have three nodes: ovirt-node2 ovirt-node3 ovirt-node4 with self hosted engine deployed using external nfs storage My first attempt was to launch hosted-engine --vm-statos on three nodes and I get three inconsinstent states: [root@ovirt-node2 ~]# hosted-engine --vm-status The hosted engine configuration has not been retrieved from shared storage yet, please ensure that ovirt-ha-agent service is running. --== Host ovirt-node3.ovirt (id: 1) status ==-- Host ID : 1 Host timestamp : 1942858 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node3.ovirt Local maintenance : False stopped : False crc32 : 37cf5256 conf_on_shared_storage : True local_conf_timestamp : 1942859 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1942858 (Sun Mar 12 01:26:20 2023) host-id=1 score=3400 vm_conf_refresh_time=1942859 (Sun Mar 12 01:26:22 2023) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False --== Host ovirt-node2.ovirt (id: 2) status ==-- Host ID : 2 Host timestamp : 4425500 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node2.ovirt Local maintenance : False stopped : False crc32 : ab944a8a conf_on_shared_storage : True local_conf_timestamp : 4425500 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=4425500 (Sun Mar 12 01:26:01 2023) host-id=2 score=3400 vm_conf_refresh_time=4425500 (Sun Mar 12 01:26:01 2023) conf_on_shared_storage=True maintenance=False state=EngineUp stopped=False [root@ovirt-node3 ~]# hosted-engine --vm-status --== Host ovirt-node4.ovirt (id: 3) status ==-- Host ID : 3 Host timestamp : 4452814 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node4.ovirt Local maintenance : False stopped : False crc32 : 95890d21 conf_on_shared_storage : True local_conf_timestamp : 4452814 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=4452814 (Sun Mar 12 01:25:55 2023) host-id=3 score=3400 vm_conf_refresh_time=4452814 (Sun Mar 12 01:25:55 2023) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False [root@ovirt-node4 ~]# hosted-engine --vm-status --== Host ovirt-node3.ovirt (id: 1) status ==-- Host ID : 1 Host timestamp : 1942848 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node3.ovirt Local maintenance : False stopped : False crc32 : 7f645fbc conf_on_shared_storage : True local_conf_timestamp : 1942848 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1942848 (Sun Mar 12 01:26:10 2023) host-id=1 score=3400 vm_conf_refresh_time=1942848 (Sun Mar 12 01:26:10 2023) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False --== Host ovirt-node2.ovirt (id: 2) status ==-- Host ID : 2 Host timestamp : 4428404 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node2.ovirt Local maintenance : False stopped : False crc32 : af938ff8 conf_on_shared_storage : True local_conf_timestamp : 4428404 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=4428404 (Sun Mar 12 02:14:45 2023) host-id=2 score=3400 vm_conf_refresh_time=4428404 (Sun Mar 12 02:14:45 2023) conf_on_shared_storage=True maintenance=False state=EngineUp stopped=False --== Host ovirt-node4.ovirt (id: 3) status ==-- Host ID : 3 Host timestamp : 4470173 Score : 3400 Engine status : unknown stale-data Hostname : ovirt-node4.ovirt Local maintenance : False stopped : False crc32 : d8fdb650 conf_on_shared_storage : True local_conf_timestamp : 4470173 Status up-to-date : False Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=4470173 (Sun Mar 12 06:15:15 2023) host-id=3 score=3400 vm_conf_refresh_time=4470173 (Sun Mar 12 06:15:15 2023) conf_on_shared_storage=True maintenance=False state=EngineStarting stopped=False Obviously there is something weird happening. Currently I put my cluster in global maintenance mode but I had to launch hosted-engine --set-maintenance --mode=global both on node3 and node4 Please give me some hint.... During this weekend I received hundreds of mail telling that hosted-engine went in inconsistent state

1 1

VM migration failed
by dobrodej88＠gmail.com 12 Mar '23

12 Mar '23

Hi, when i tried to migrate vm between hardwarehosts? i got an error like ERROR (migsrc/53accc0c) [virt.vm] (vmId='53accc0c-15c6-4917-a9c9-5237f7f358b1') Cannot access backing file '/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007' of storage file '/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/f3a72252-904c-48b1-8591-f2dabd343b8e' (as uid:107, gid:107): No such file or directory (migration:282) but file are exist PROD [root@olvm1 vdsm]# ll /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 lrwxrwxrwx. 1 vdsm kvm 78 Mar 10 14:59 /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 -> /dev/30b8a383-f390-405f-ac0c-4ef7a19207fe/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 PROD [root@olvm1 vdsm]# qemu-img check /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 No errors were found on the image. 14/1638400 = 0.00% allocated, 57.14% fragmented, 0.00% compressed clusters Image end offset: 1310720 PROD [root@olvm1 vdsm]# qemu-img info /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 image: /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007 file format: qcow2 virtual size: 100 GiB (107374182400 bytes) disk size: 0 B cluster_size: 65536 backing file: b7c03917-6fd4-4c88-98e3-e8fcdb3955bd (actual path: /rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/b7c03917-6fd4-4c88-98e3-e8fcdb3955bd) backing file format: qcow2 Format specific information: compat: 1.1 lazy refcounts: false refcount bits: 16 corrupt: false Please tell me what the reason could be, thank you

1 0