May 2023 - Users - oVirt List Archives

barely started - cannot import name 'Callable' from 'collections'
by lejeczek 11 May '23

11 May '23

Hi guys. I've barely started, trying to deploy my first oVirt and I get: ... Please indicate the gateway IP address [10.3.1.254]: [ INFO ] Checking available network interfaces: [ ERROR ] b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' [ ERROR ] b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' [ ERROR ] b"import name 'Callable' from 'collections'\n" [ ERROR ] b'(/usr/lib64/python3.11/collections/__init__.py)\n' [ ERROR ] b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" [ ERROR ] Failed to execute stage 'Environment customization': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ ERROR ] b'[WARNING]: Skipping plugin (/usr/share/ovirt-hosted-engine-\n' [ ERROR ] b'setup/he_ansible/callback_plugins/2_ovirt_logger.py), cannot load: cannot\n' [ ERROR ] b"import name 'Callable' from 'collections'\n" [ ERROR ] b'(/usr/lib64/python3.11/collections/__init__.py)\n' [ ERROR ] b"ERROR! Unexpected Exception, this is probably a bug: cannot import name 'Callable' from 'collections' (/usr/lib64/python3.11/collections/__init__.py)\n" [ ERROR ] Failed to execute stage 'Clean up': Failed executing ansible-playbook [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20230509193552.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20230509193544-s72umf.log centos 9 stream with ovirt-engine-setup-base-4.5.3.1-1.el9.noarch Any & every suggestion on what is braking here and how to troubleshoot/fix it are much appreciated. thanks, L.

2 1

Please help connecting to serial console - <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:897)>
by morgan cox 10 May '23

10 May '23

Hi. I have an Ovirt 4.4.10 system - its a standalone setup (not hosted engine) - ovirt-vmconsole-proxy-sshd is running on the engine. Presently I just cannot connect via port 2222. I have never been able to connect via serial console and require help connecting, pretty sure its due to not using the right key/cert .. I have tried to follow something like this -> https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/ht… i.e I created a serialconsole key - added to my user in Ovirt UI (as my user 'mcox') however if I try # ssh -t -i /home/mcox/.ssh/ -p 2222 ng2-ovirt-mgmt1 -l ovirt-vmconsole I get ovirt-vmconsole(a)10.168.69.200: Permission denied (publickey). I get in ovirt-vmconsole-proxy-sshd logs "May 10 15:54:37 ng2-ovirt-mgmt1 ovirt-vmconsole[301584]: 2023-05-10 15:54:37,221+0000 ovirt-vmconsole-list: ERROR main:265 Error: <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:897)> May 10 15:54:37 ng2-ovirt-mgmt1 ovirt-vmconsole-proxy-keys[301580]: ERROR Key list execution failed rc=1 May 10 15:54:37 ng2-ovirt-mgmt1 sshd[301578]: AuthorizedKeysCommand /usr/libexec/ovirt-vmconsole-proxy-keys ovirt-vmconsole failed, status 1 May 10 15:54:37 ng2-ovirt-mgmt1 ovirt-vmconsole[301589]: 2023-05-10 15:54:37,543+0000 ovirt-vmconsole-list: ERROR main:265 Error: <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:897)> May 10 15:54:37 ng2-ovirt-mgmt1 ovirt-vmconsole-proxy-keys[301585]: ERROR Key list execution failed rc=1 May 10 15:54:37 ng2-ovirt-mgmt1 sshd[301578]: AuthorizedKeysCommand /usr/libexec/ovirt-vmconsole-proxy-keys ovirt-vmconsole failed, status 1 May 10 15:54:37 ng2-ovirt-mgmt1 sshd[301578]: Connection closed by authenticating user ovirt-vmconsole 10.88.1.105 port 52858 [preauth]" Am I using the right key ? I have tried to troubleshoot this - if I use # /usr/libexec/ovirt-vmconsole-proxy-keys list ERROR: Internal error If it helps here is : /usr/share/ovirt-vmconsole/ovirt-vmconsole-proxy/ovirt-vmconsole-proxy-sshd/sshd_config ------------ AllowAgentForwarding no #AllowStreamLocalForwarding no AllowTcpForwarding no AllowUsers ovirt-vmconsole AuthorizedKeysCommand /usr/libexec/ovirt-vmconsole-proxy-keys AuthorizedKeysCommandUser ovirt-vmconsole ChallengeResponseAuthentication no ClientAliveCountMax 3 ClientAliveInterval 10 GSSAPIAuthentication no HostCertificate /etc/pki/ovirt-vmconsole/proxy-ssh_host_rsa-cert.pub HostKey /etc/pki/ovirt-vmconsole/proxy-ssh_host_rsa HostbasedAuthentication no KbdInteractiveAuthentication no KerberosAuthentication no PasswordAuthentication no #PermitUserRC no PidFile /dev/null Port 2222 Protocol 2 PubkeyAuthentication yes TrustedUserCAKeys /etc/pki/ovirt-vmconsole/ca.pub X11Forwarding no ------------

1 0

no snapshot function in VM portal
by Christoph Köhler 10 May '23

10 May '23

Hi! On a fresh Version 4.5.4-1.el8: in the vm portal are no snapshot operations possible - not for an user_vm_manager and not for a super_user. We have imported VMs from 4.3 with exisiting snapshots. These are listed for the users in the snapshot box but there is also no operation possible for them. Does anyone has a hint? Greetings! Chris

2 3

Ovirt node disk broken
by marcel d'heureuse 09 May '23

09 May '23

Hi all, On a single Server the node disk is broken and I have to replace it. The glusterfs configuration is also gone but the glusterfs directorys are existing on a separate available disk. Did I have a Chance to install the ovirt Node on a New disk and make the old glusterfs running and also the 7 vms included the hosted engine? I can also deploy a New hosted engine but can I than import the existing gluster disk from the old Installation? I have installed the node and also mount the gluster_bricks but to make the volumes available I have not found any command. It is an ovirt 4.3.10 Installation. Is there any chance to save some time. The data inside the vms are good to have. Br Marcel

2 1

hosted setup failed with error on 'Initialize lockspace volume'
by destfinal＠googlemail.com 09 May '23

09 May '23

Hi, I am trying to perform a self hosted ovirt cluster. All goes well and towards the end the setup fails at the task 'Initialize lockspace volume' with the following error message: { "attempts":5, "changed":true, "cmd":[ "hosted-engine", "--reinitialize-lockspace", "--force" ], "delta":"0:00:00.108243", "end":"2023-05-03 22:50:53.930482", "msg":"non-zero return code", "rc":1, "start":"2023-05-03 22:50:53.822239", "stderr":"Traceback (most recent call last):\n File \"/usr/lib64/python3.9/runpy.py\", line 197, in _run_module_as_main\n return _run_code(code, main_globals, None,\n File \"/usr/lib64/python3.9/runpy.py\", line 87, in _run_code\n exec(code, run_globals)\n File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>\n ha_cli.reset_lockspace(force)\n File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace\n stats = broker.get_stats_from_storage()\n File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 148, in get_stats_from_storage\n result = self._proxy.get_stats()\n File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1122, in __call__\n return self.__send(self.__name, args)\n File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1464, in __request\n response = self.__transport.request(\n File \"/usr/lib64/py thon3.9/xmlrpc/client.py\", line 1166, in request\n return self.single_request(host, handler, request_body, verbose)\n File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1178, in single_request\n http_conn = self.send_request(host, handler, request_body, verbose)\n File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1291, in send_request\n self.send_content(connection, request_body)\n File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1321, in send_content\n connection.endheaders(request_body)\n File \"/usr/lib64/python3.9/http/client.py\", line 1280, in endheaders\n self._send_output(message_body, encode_chunked=encode_chunked)\n File \"/usr/lib64/python3.9/http/client.py\", line 1040, in _send_output\n self.send(msg)\n File \"/usr/lib64/python3.9/http/client.py\", line 980, in send\n self.connect()\n File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 76, in connect\n self.sock.connect(base64.b16decode(self.host ))\nFileNotFoundError: [Errno 2] No such file or directory", "stderr_lines":[ "Traceback (most recent call last):", " File \"/usr/lib64/python3.9/runpy.py\", line 197, in _run_module_as_main", " return _run_code(code, main_globals, None,", " File \"/usr/lib64/python3.9/runpy.py\", line 87, in _run_code", " exec(code, run_globals)", " File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_setup/reinitialize_lockspace.py\", line 30, in <module>", " ha_cli.reset_lockspace(force)", " File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/client/client.py\", line 286, in reset_lockspace", " stats = broker.get_stats_from_storage()", " File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py\", line 148, in get_stats_from_storage", " result = self._proxy.get_stats()", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1122, in __call__", " return self.__send(self.__name, args)", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1464, in __request", " response = self.__transport.request(", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1166, in request", " return self.single_request(host, handler, request_body, verbose)", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1178, in single_request", " http_conn = self.send_request(host, handler, request_body, verbose)", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1291, in send_request", " self.send_content(connection, request_body)", " File \"/usr/lib64/python3.9/xmlrpc/client.py\", line 1321, in send_content", " connection.endheaders(request_body)", " File \"/usr/lib64/python3.9/http/client.py\", line 1280, in endheaders", " self._send_output(message_body, encode_chunked=encode_chunked)", " File \"/usr/lib64/python3.9/http/client.py\", line 1040, in _send_output", " self.send(msg)", " File \"/usr/lib64/python3.9/http/client.py\", line 980, in send", " self.connect()", " File \"/usr/lib/python3.9/site-packages/ovirt_hosted_engine_ha/lib/unixrpc.py\", line 76, in connect", " self.sock.connect(base64.b16decode(self.host))", "FileNotFoundError: [Errno 2] No such file or directory" ], "stdout":"", "stdout_lines":[ ] } The underlying storage is NFS on top of Ceph (which is not listed in the ovirt documentation). Does this ring any bell to anybody? Please let me know if you need more information in this regard or contents from any of the log files. Thanks

2 2

Unable to change the admin passsword on oVirt 4.5.2.5
by Ayansh Rocks 08 May '23

08 May '23

Hi All, Any idea hot to change password of admin user on oVirt 4.5.2.5 ? Below is not working - [root@ovirt]# ovirt-aaa-jdbc-tool user password-reset admin Picked up JAVA_TOOL_OPTIONS: -Dcom.redhat.fips=false Password: Reenter password: updating user admin... user updated successfully [root@delhi-test-ovirtm-02 ~]# Above shows successful but password not changed. Thanks

5 7

Illegal Disk after Removing Snapshot
by Nur Imam Febrianto 06 May '23

06 May '23

Hi, Using ovirt 4.5.4 with all CentOS 8 Stream Host. Having an issue, whenever we tried to delete any snapshot of any vm, it will failed. Second try will get us succeed. But if the snapshot already deleted, and we shutdown the VM, we cannot turned it on again. It showing illegal disk error. Any idea about this issue ? Thanks. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows

1 0

cannot update expired engine certificates?
by michael.d1.holt＠lmco.com 05 May '23

05 May '23

ovirt 4.4.10.x, using self signed certificates with a self hosted engine. apache certs expired, renewed manually via guides provided by RHEL and oVirt using the pki_enroll_pkcs12.sh script. Engine certs are also expired and cannot update certs via gui and no option to renew the certs when running using engine-setup --offline. The error I am getting is a VDSM certificate error on the hosted engine in the engine.log file. I have attempted to manually run the pki_enroll_pkcs12.sh script with "engine" in the name and the subject of the previous engine.cer file with no luck. I copied the p12, key and cert from that attempt into the engine.cer, engine.p12 and engine_id_rsa files, but when booting the hosted engine VM, the first error in the engine.log is "VDC cannot find the engine certificate". This also breaks my access to the web interface for oVirt administration. When the expired engine certs are restored, I have GUI access but still see the VDSM errors on the ovirt-engine. That I hav e web access with the expired engine certs indicate to me that the apache certificates are correct (but i could be wrong in that evaluation). Basically i am looking for a way to either force the enroll pki option in the engine-setup --offline script or manually generate and update the engine.cer, engine.p12 (and if needed, but i couldn't determine where it was used) the engine_id_rsa key.

2 1

Remove role AdminReadOnly from Everyone group that has made my admin readonly
by robert.r.bristow＠outlook.com 05 May '23

05 May '23

We accidently added AdminReadOnly to users and has now made admin read only. Please does some one know how we can remove that to get the system back in Ovirt engine. I found the following but with being new and links not working it does not help much. Regards Rob

1 0

Ovirt CSI driver
by Nathanaël Blanchet 03 May '23

03 May '23

Hello, According to https://docs.openshift.com/container-platform/4.11/storage/container_storag… Ovirt CSI driver doesn't support snapshots. This is annoying because we can't backup Persistent Volume. Is there a technical reason for that? Can we hope any development for this?

1 0

GlusterFS+Virt
by antony.parkin＠graidtech.com 03 May '23

03 May '23

Hi, Could somebody comment on storage options i.e Gluster or Ceph and when to use each one? Looking for an architecture which is fully redundant, both at the hypervisor level and at the storage level so needs to include data replication. thx

1 0

VDSM certs expired, manual renewal not working
by cen 02 May '23

02 May '23

Hi Our VDSM certs have expired, both hosts are unassigned and can't be put into maintenance from UI. vdsm-client is not working, times out even with --insecure flag. Does host and port need to be specified when run locally or should defaults work? Error in console events is: Get Host Capabilities Failed: PKIX path validation failed... I followed a RHV guide for this exact situation and generated new vdsm certificate using the ovirt-engine CA. The new cert seems identical to the old one, everything matches (algos, extensions, CA, CN, SAN etc) just new date. After restarting libvirtd and vdsmd on the host with new cert in place the host is still not reachable. However, error message is now slightly different: get Host Capabilities failed: Received fatal error: certificate_expired Cert was replaced in the following locations: /etc/pki/vdsm/certs/vdsmcert.pem /etc/pki/vdsm/libvirt-spice/server-cert.pem /etc/pki/libvirt/clientcert.pem Is there another location missing? What else can I try? All help appreciated in advance

3 6

ovirt 4.5.4 install failure
by Selçuk N 02 May '23

02 May '23

Hello all, I tried to install ovirt 4.5.4 on ovirt node install. *hosted-engine --deploy* After this step installation is stuck. *[ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the host to be up]* I checked the log file and details below. Apr 20 22:10:18 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85405) Apr 20 22:10:19 ovirt3 python3[51367]: ansible-ovirt_host_info Invoked with pattern=name=ovirt3.44c.net auth={'token': 'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJOTXdyenhDY284eERxZVlLaFRhWG5xblVpV0lFNDVBM2VmRzhXdndTaDVBIn0.eyJleHAiOjE2ODIwMzQzNzgsImlhdCI6MTY4MjAxNzA5OCwianRpIjoiODdjNDAwZTItNDZiMS00NmY1LTk2MWMtMWJhMDA3MDAxOGQxIiwiaXNzIjoiaHR0cHM6Ly9lbmcuNDRjLm5ldC9vdmlydC1lbmdpbmUtYXV0aC9yZWFsbXMvb3ZpcnQtaW50ZXJuYWwiLCJhdWQiOiJhY2NvdW50Iiwic3ViIjoiZmFiMDNmM2UtODVmZS00YjQ5LWE5ZWItZTExODRjOTYzYzdjIiwidHlwIjoiQmVhcmVyIiwiYXpwIjoib3ZpcnQtZW5naW5lLWludGVybmFsIiwic2Vzc2lvbl9zdGF0ZSI6IjYwOWJiMmMxLTJkNTItNDc4Zi1hYzg2LWMyMjVlNTVmYTMwNyIsImFjciI6IjEiLCJhbGxvd2VkLW9yaWdpbnMiOlsiaHR0cHM6Ly9lbmcuNDRjLm5ldCJdLCJyZWFsbV9hY2Nlc3MiOnsicm9sZXMiOlsiZGVmYXVsdC1yb2xlcy1vdmlydC1pbnRlcm5hbCIsIm9mZmxpbmVfYWNjZXNzIiwidW1hX2F1dGhvcml6YXRpb24iXX0sInJlc291cmNlX2FjY2VzcyI6eyJhY2NvdW50Ijp7InJvbGVzIjpbIm1hbmFnZS1hY2NvdW50IiwibWFuYWdlLWFjY291bnQtbGlua3MiLCJ2aWV3LXByb2ZpbGUiXX19LCJzY29wZSI6Im92aXJ0LWFwcC1hcGkgZW1haWwgb3ZpcnQtZXh0PXRva2VuLWluZm86YXV0aHotc2VhcmNoIG92aXJ0LWV4dD10b2tlbi1pbmZvOnZhbGlkYXRlIG92aXJ0LWV4dD10b2tlbi1pbmZvOnB1YmxpYy1hdXRoei1zZWFyY2ggcHJvZmlsZSBvdmlydC1leHQ9dG9rZW46cGFzc3dvcmQtYWNjZXNzIiwic2lkIjoiNjA5YmIyYzEtMmQ1Mi00NzhmLWFjODYtYzIyNWU1NWZhMzA3IiwiZW1haWxfdmVyaWZpZWQiOmZhbHNlLCJncm91cHMiOlsiL292aXJ0LWFkbWluaXN0cmF0b3IiXSwicHJlZmVycmVkX3VzZXJuYW1lIjoiYWRtaW5Ab3ZpcnQiLCJlbWFpbCI6ImFkbWluQGxvY2FsaG9zdCJ9.e47PgAtt_Sj-_4IQ8OIQynAV_AvrOfzalhwi1VJapCQB_sdQqxd0jIH7JGVM1a4TGEJb6E5ffTXBocqQabe5pBPIv4kqsgU1iadyTjjDjZ1elECnahPf6lrze-8hEO92GKFOepGLQ-iu7gRilAknvaXhoc309G1hyQvnP4Q-syffw6Eoo4RmgnLnztnPzsxBtGgkZrzAwFfTNDtdS2uj5lvzzAEIfvDPRFTjJhYwKXSx2hC1lnhXnmv1XEtCfXZZ3qqarXw8GAvOQbe10xklm5UAtu--C8NX32DE6659QtEqk-5g52SdFWIic_OlZ5-obHn3jOllo8qnsb-6mfEn_w', 'url': 'https://eng.44c.net/ovirt-engine/api', 'ca_file': None, 'insecure': True, 'timeout': 0, 'compress': True, 'kerberos': False, 'headers': None, 'hostname': None, 'username': None, 'password': None} fetch_nested=False nested_attributes=[] follow=[] all_content=False cluster_version=None *Apr 20 22:10:22 ovirt3 journal[47971]: Invalid value '-1' for 'cpu.max': Invalid argument* Apr 20 22:10:23 ovirt3 sssd_kcm[50811]: Shutting down (status = 0) Apr 20 22:10:23 ovirt3 systemd[1]: sssd-kcm.service: Deactivated successfully. Apr 20 22:10:23 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85400) Apr 20 22:10:28 ovirt3 ansible-async_wrapper.py[41856]: 41857 still running (85395) What did I did wrong? Thanks.

2 1

checking engine vm status during global maintenance
by Alexey Valkov 02 May '23

02 May '23

Hi all, I tried to check engine status (via hosted-engine --vm-status) during global maintenance in oVirt 4.5.1 and discovered that it showed me status as it was just before entering global maintenance. Is it by design? And HA agent doesn't monitor and therefore doesn't update Engine VM status? If I remember right in oVirt 4.2 hosted-engine --vm-status showed correct status of Engine VM regardless of Global maintenance. I shutted down the engine but the output of hosted-engine --vm-status was Engine status : {"vm": "up", "health": "good", "detail": "Up"} Notice !! Cluster is in GLOBAL MAINTENANCE mode !! existed in the output. Host timestamp and extra metadata was up to date. All rest info looked good. Thi is my second attempt to ask the question (first was at 24/04 and still is being moderated). -- Best regards Alexei

2 1

richiesta accesso Zanata
by Rosario Grasso 02 May '23

02 May '23

Buongiorno, la presente per richiedere l'accesso a Zanata in lingua inglese e se possibile anche in italiano. Saluti, RG

2 2

Disable SSL for ovirt-ha-broker?
by phil.gardnerjr＠gmail.com 02 May '23

02 May '23

I have a neglected oVirt 4.3 cluster that consists of two hosts with a hosted engine. Unfortunately, the host SSL certificates on both hosts are expired, and now the hosted engine is down from a power loss event. I don't see a way to get ovirt-ha-broker functioning again if the vdsm certificates are expired, since I can't get the hosted engine VM to start in order to generate new host certificates. My sledgehammer approach was to just disable SSL in the configuration for vdsm and libvirt, but I can't seem to figure out how to disable SSL for ovirt-ha-broker. Is this possible? I don't know what else to try. I figure if I can just get the hosted-engine back up, and I can maybe proceed with getting one of the hosts back up and functional in some way, and maybe getting the single VM that I am concerned about started up. If the hosted engine isn't recoverable, is it possible to get another VM up and running with just standard kvm/libvirt/virsh if I still have access to the storage?

2 1