- Users - oVirt List Archives

unable to bring up gluster bricks after 4.5 upgrade
by Jayme 29 Aug '22

29 Aug '22

Hello All, I've been struggling with a few issues upgrading my 3-node HCI custer from 4.4 to 4.5. At present the self hosted engine VM is properly running oVirt 4.5 on CentOS 8x stream. First host node, I set in maintenance and installed new node-ng image. I ran into issue with rescue mode on boot which appears to have been related to LVM devices bug. I was able to work past that and get the node to boot. The node running 4.5.2 image is booting properly and gluster/lvm mounts etc all look good. I am able to activate the host and run VMs on it etc. however, oVirt cli is showing that all bricks on host are DOWN. I was unable to get the bricks back up even after doing a force start of the volumes. Here is the glusterd log from the host in question when I try force start on the engine volume (other volumes are similar: ==> glusterd.log <== The message "I [MSGID: 106568] [glusterd-svc-mgmt.c:266:glusterd_svc_stop] 0-management: bitd service is stopped" repeated 2 times between [2022-08-29 18:09:56.027147 +0000] and [2022-08-29 18:10:34.694144 +0000] [2022-08-29 18:10:34.695348 +0000] I [MSGID: 106618] [glusterd-svc-helper.c:909:glusterd_attach_svc] 0-glusterd: adding svc glustershd (volume=engine) to existing process with pid 2473 [2022-08-29 18:10:34.695669 +0000] I [MSGID: 106131] [glusterd-proc-mgmt.c:84:glusterd_proc_stop] 0-management: scrub already stopped [2022-08-29 18:10:34.695691 +0000] I [MSGID: 106568] [glusterd-svc-mgmt.c:266:glusterd_svc_stop] 0-management: scrub service is stopped [2022-08-29 18:10:34.695832 +0000] I [MSGID: 106617] [glusterd-svc-helper.c:698:glusterd_svc_attach_cbk] 0-management: svc glustershd of volume engine attached successfully to pid 2473 [2022-08-29 18:10:34.703718 +0000] E [MSGID: 106115] [glusterd-mgmt.c:119:gd_mgmt_v3_collate_errors] 0-management: Post commit failed on gluster2.xxxxx. Please check log file for details. [2022-08-29 18:10:34.703774 +0000] E [MSGID: 106115] [glusterd-mgmt.c:119:gd_mgmt_v3_collate_errors] 0-management: Post commit failed on gluster1.xxxxx. Please check log file for details. [2022-08-29 18:10:34.703797 +0000] E [MSGID: 106664] [glusterd-mgmt.c:1969:glusterd_mgmt_v3_post_commit] 0-management: Post commit failed on peers [2022-08-29 18:10:34.703800 +0000] E [MSGID: 106664] [glusterd-mgmt.c:2664:glusterd_mgmt_v3_initiate_all_phases] 0-management: Post commit Op Failed If I run start command manually on host cli: gluster volume start engine force volume start: engine: failed: Post commit failed on gluster1.xxxx. Please check log file for details. Post commit failed on gluster2.xxxx. Please check log file for details. I feel like this may be some issue with the difference in major versions of GlusterFS on the nodes but I am unsure. The other nodes are running ovirt-node-ng-4.4.6.3 At this point I am afraid to bring down any other node to attempt upgrading it without the bricks in UP status on the first host. I do not want to lose quorum and potentially disrupt running VMs. Any idea why I can't seem to start the volumes on the upgraded host? Thanks!

1 2

(no subject)
by parallax 29 Aug '22

29 Aug '22

oVirt version:4.4.4.7-1.el8 I have several servers in cluster and I got this error: Data Center is being initialized, please wait for initialization to complete. VDSM command GetStoragePoolInfoVDS failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: validity check failed the SPM role is constantly being transferred to the servers and I can't do anything in StorageDomains storages are in inactive status but virtual machines are runnig how ti fix it?

3 6

Commissioning hew host on centos9
by David Johnson 29 Aug '22

29 Aug '22

Good evening all, I am trying to commission an ovirt host on new hardware using Centos 9. I followed the pre-install instructions at https://www.ovirt.org/download/install_on_rhel.html, and eventually figured out that this line was missing from the preparation scripts: dnf install rdo-openvswitch-2.15 With that, I was able to continue installation. After completing the instructions, DNF update reports this: [root@localhost administrator]# dnf update --nobest Last metadata expiration check: 0:01:06 ago on Fri 26 Aug 2022 08:20:27 PM CDT. Dependencies resolved. Problem 1: package ovirt-openvswitch-2.15-4.el9.noarch requires openvswitch2.15, but none of the providers can be installed - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-99.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-51.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-56.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-81.el9s.x86_64 - cannot install the best update candidate for package ovirt-openvswitch-2.15-4.el9.noarch - cannot install the best update candidate for package openvswitch2.15-2.15.0-99.el9s.x86_64 Problem 2: problem with installed package ovirt-openvswitch-2.15-4.el9.noarch - package ovirt-openvswitch-2.15-4.el9.noarch requires openvswitch2.15, but none of the providers can be installed - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-99.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-51.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-56.el9s.x86_64 - package rdo-openvswitch-2:2.17-2.el9s.noarch obsoletes openvswitch2.15 < 2.17 provided by openvswitch2.15-2.15.0-81.el9s.x86_64 - cannot install the best update candidate for package rdo-openvswitch-1:2.15-2.el9s.noarch DNF info lists these [root@localhost administrator]# dnf list installed |grep openvswitch centos-release-nfv-openvswitch.noarch 1-4.el9s @c9s-extras-common network-scripts-openvswitch2.15.x86_64 2.15.0-99.el9s @centos-nfv-openvswitch openvswitch-selinux-extra-policy.noarch 1.0-31.el9s @centos-nfv-openvswitch *openvswitch2.15.x86_64 2.15.0-99.el9s @centos-nfv-openvswitch*ovirt-openvswitch.noarch 2.15-4.el9 @centos-ovirt45 python3-openvswitch2.15.x86_64 2.15.0-99.el9s @centos-nfv-openvswitch rdo-openvswitch.noarch 1:2.15-2.el9s @centos-openstack-yoga *Questions:* 1. Is this a problem? 2. If this is a problem, is there an FAQ sheet or known steps to work around/fix this? 3. Does there need to be an update to the pre-installation instructions? *David Johnson* *Director of Development, Maxis Technology* 844.696.2947 ext 702 (o) | 479.531.3590 (c) <https://www.linkedin.com/in/pojoguy/> <https://maxistechnology.com/wp-content/uploads/vcards/vcard-David_Johnson.v…> <https://maxistechnology.com/> *Follow us:* <https://www.linkedin.com/company/maxis-tech-inc/>

2 1

oVirt 4.5 self-hosted network not working
by Paul-Erik Törrönen 25 Aug '22

25 Aug '22

Specifically, the installation (ovirt-hosted-engine-setup) completes successfully, and the engine VM is up and running, but it can not be accessed from any other machine in the same subnet but the host machine. I can ssh (from the host) to the engine VM, and confirm that initiating the connection from the engine VM to any other machine, except the host, fails. The routing looks correct and stopping the firewalld on the engine VM does not make any difference. Nor does stopping the firewalld on the host either make any difference. This seems like a failure in correctly setting up the host routing for the engine VM. How do I fix this? Poltsi

1 0

Ovirt 4.5.2 problem with change CD during VM installation
by Facundo Badaracco 25 Aug '22

25 Aug '22

HI everyone i have a GlusterGS replica 3 node. All is working fine. Except when i want to install a win10 x64 test VM. The windows ISO loads fine, when it comes the time to put de virio win so the VM recongnizes the disk, the change CD feature doesnt change anything. I have tried with several ISOs, but in the windows installer it never changes the CD, always seems empty. Any ideas? thx in advance.

2 2

oVirt Engine Dashboard and information from Guest Agents
by markeczzz＠gmail.com 25 Aug '22

25 Aug '22

Hi! Recently I had a situation where single node oVirt setup was without network connection to shared storage. After shared storage got reconnected, everything got up as it was supposed to, but I can't get information from guest agents shown in ovirt Dashboard. I tried restarting ovirt-engine and then 2 vm-s started sending info from guest-agent, but rest of them not. Guest agent is running on those vm-s. I also tried restarting those vm-s. Hosted engine is up and healty, and ovirt-engine service is running and it looks ok also. I have this error in vdsm.log 2022-08-25 10:41:39,913+0200 INFO (periodic/1) [vdsm.api] FINISH repoStats return={'dff59a93-4dca-40cd-9c44-c0a74ebaa656': {'code': 0, 'lastCheck': '2.2', 'delay': '0.000840686', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}, '30c0c9e4-b634-4a05-b921-7a30b69f6dd2': {'code': 0, 'lastCheck': '3.9', 'delay': '0.000830941', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}, '6cb12d96-3a0a-4902-acb0-deb907ef945c': {'code': 0, 'lastCheck': '5.5', 'delay': '0.000857244', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}, '559569b9-c33e-4fb0-be6a-51a178a228a9': {'code': 0, 'lastCheck': '5.3', 'delay': '0.000463871', 'valid': True, 'version': 5, 'acquired': True, 'actual': True}} from=internal, task_id=8c638713-f010-4692-ba0b-1ac94052fe7c (api:54) 2022-08-25 10:41:40,778+0200 ERROR (qgapoller/2) [virt.periodic.Operation] <bound method QemuGuestAgentPoller._poller of <vdsm.virt.qemuguestagent.QemuGuestAgentPoller object at 0x7f9efc08e6d8>> operation failed (periodic:204) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/virt/periodic.py", line 202, in __call__ self._func() File "/usr/lib/python3.6/site-packages/vdsm/virt/qemuguestagent.py", line 493, in _poller vm_id, self._qga_call_get_vcpus(vm_obj)) File "/usr/lib/python3.6/site-packages/vdsm/virt/qemuguestagent.py", line 814, in _qga_call_get_vcpus if 'online' in vcpus: TypeError: argument of type 'NoneType' is not iterable 2022-08-25 10:41:41,551+0200 INFO (jsonrpc/2) [api.virt] START getStats() from=::1,50396, vmId=a6e745c4-2e4e-4672-8625-08b787832020 (api:48)

1 1

oVirt 4.5.2 new ISO uploads are not usable
by Christoph Timm 24 Aug '22

24 Aug '22

Hi list, we have uploaded new ISO files to our data domain which we are using for ISO images and found out that we cannot boot from these ISO. Older ISOs are still working but no new one. I have not really any idea what to check and where to look so any kind of help would be really appreciated. Best regards Christoph

4 6

Self-hosted engine deploy failed
by Henry Wong 24 Aug '22

24 Aug '22

Hi, I have been trying to deploy the engine from cockpit of a ovirt node 4.5.2. The system is freshly installed from the iso. The deployment failed on step 3 Prepare VM. The last error in the /var/log/ovirt-hosted-engine-setup/*log said something about "SSO authentication access_denied : Cannot authenticate user Invalid user credentials." Has anyone seen this before? Thanks ``` 2022-08-18 18:57:20,334-0500 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/he_ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "attempts": 50, "changed": false, "exception": "Traceback (most recent call last):\n File \"/tmp/ansible_ovirt_auth_payload_1t3ixb8c/ansible_ovirt_auth_payload.zip/ansible_collections/ovirt/ovirt/plugins/modules/ovirt_auth.py\", line 287, in main\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/__init__.py\", line 382, in authenticate\n self._sso_token = self._get_access_token()\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/__init__.py\", line 627, in _get_access_token\n sso_error[1]\novirtsdk4.AuthError: Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials.\n", "invocation": { "module_args": { "ca_file": null, "compress": true, "headers": null, "hostname": null, "insecure": true, "kerberos": false, "ovirt_auth": null, "password": null, "state": "present", "timeout": 0, "token": null, "url": null, "username": null } }, "msg": "Error during SSO authentication access_denied : Cannot authenticate user Invalid user credentials." }, "ansible_task": "Obtain SSO token using username/password credentials", "ansible_type": "task", "status": "FAILED", "task_duration": 537 } ``` Static hostname: xxxxxxxxx Icon name: computer-server Chassis: server Machine ID: 6090168dcd724b04be97d57b01c2a11c Boot ID: 5fba59e1914e48a1aad23fc02641bf3c Operating System: oVirt Node 4.5.2 CPE OS Name: cpe:/o:centos:centos:8 Kernel: Linux 4.18.0-408.el8.x86_64 Architecture: x86-64

3 5

Q: Node Install on Fresh CentOS Stream 8
by Andrei Verovski 23 Aug '22

23 Aug '22

Hi ! I'm going to install oVirt node software on CentOS 8 Stream (I don't use node image from Red Hat because of custom monitoring scripts). Do I need to disable any stock repos (e.g. AppStream) in order to avoid installation of anything not suitable, e.g. newer version then one in oVirt repo, for oVirt node software? Thanks in advance. Andrei

1 0

Re: Problem Upgrading DWH from 4.5.1 to 4.5.2
by Yedidyah Bar David 23 Aug '22

23 Aug '22

On Tue, Aug 23, 2022 at 8:53 AM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > > Hi, > > > > I’m keep getting this kind of error whenever try to run engine-setup to upgrade my separated DWH server : > > [ INFO ] Stage: Initializing > > [ INFO ] Stage: Environment setup > > Configuration files: /etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf, /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf > > Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20220823110720-28vs78.log > > Version: otopi-1.10.2 (otopi-1.10.2-1.el8) > > [ INFO ] Stage: Environment packages setup > > [ INFO ] Stage: Programs detection > > [ INFO ] Stage: Environment customization > > > > --== PRODUCT OPTIONS ==-- > > > > [ ERROR ] Failed to execute stage 'Environment customization': ok_to_renew_cert() missing 2 required positional arguments: 'short_life' and 'environment' > > [ INFO ] Stage: Clean up > > > > Maybe anybody here can give any idea to solve this issue ? It's a bug, would you like to report it in bugzilla? This should fix it: https://github.com/oVirt/ovirt-dwh/pull/48 Best regards, -- Didi

2 1