July 2020 - Devel - oVirt List Archives

[VDSM] Trouble merging patch, related to jenkins whitelist or new RHEL CI?
by Nir Soffer 03 Aug '20

03 Aug '20

I could not merge: https://gerrit.ovirt.org/c/109402/ Although it was approved and verified, and got +1 from Continuous Integration. There is a new "RHEL-Continuous-Integration", which does not run with this change, even when I trigger the tests manually with "ci test". I tried to add +1 for "RHEL-Continuous-Integration" but this is not possible, I see: RHEL-Continuous-Integration You don't have permission to edit this label. So finally I downloaded the patch and pushed it manually. I think this patch will fix the problem: https://gerrit.ovirt.org/#/c/110576/ But I need CI experts to review this. Since we have 50 projects that need this, this probably should be fixed elsewhere, and inherited by all projects. I know that Germano was not able to trigger tests because he was missing in the jenkins whitelist, but this was fixed last week. Germano, maybe just to check that everything works for you, you can post some trivial patch? Nir

4 9

please i'm facing a with making el8
by Amit Chaudhary 30 Jul '20

30 Jul '20

ovirt.zip <https://drive.google.com/file/d/1I1Kcbnmi3IIE1taUsWEe2uQaWFWvERyE/view?usp=…> i have attached my ovirt zip. the issue im facing is that the kickstart is not generated for el8 and im not able to figure out how to use .j2 file that is being generated. i've manage to frankenstein a kickstart file that is in the zip with all the settings but its also giving error while compressing (dracut module 'livenet' cannot be found or installed) while if i search installed modules of dracut i can see livenet is installed. see see my zip it have logs of last compilation also. sir/mam it would be a great help for my college final year project project on hci and my research paper. please sir/mam please help me Amit Chaudhary +919650596355 -- *CONFIDENTIALITY NOTICE* This communication (including any attachment/s) is intended only for the use of the addressee(s) and contains information that is PRIVILEGED AND CONFIDENTIAL. Unauthorized reading, dissemination, distribution, or copying of this communication is prohibited. * DISCLAIMER* Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the University. WARNING:- This communication, including any attachments, may not be free of viruses, interceptions or interference, and may not be compatible with your systems. You should carry out your own virus checks before opening any attachment to this e-mail. The sender of this e-mail and Galgotias University shall not be liable for any damage that you may sustain as a result of viruses, incompleteness of this message, a delay in receipt of this message or computer problems experienced.

2 1

OST switching back to CirrOS
by Michal Skrivanek 30 Jul '20

30 Jul '20

Hi, FYI we’ve just switched back from CentOS to CirrOS VMs in OST basic suite, saving 900MB of data transferred all the time (and copied back and forth during test) as well as lower memory requirements (down to 128MB from 384MB, times 3 VMs). For a good measure a memory hot unplug test was added too. Let me know if you see anything unusual, other than faster run times. Thanks, michal

2 2

Error while executing action New NFS Storage Domain: Unexpected exception
by Dana Elfassy 30 Jul '20

30 Jul '20

Hi, When I'm trying to add a storage domain via the webadmin I'm getting the error message that's on the subject. in the vdsm.log I see this error: 2020-07-29 04:53:48,045-0400 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/vserver-spider.eng.lab.tlv.redhat.com:_pub_delfassy_nfs__42/17093147-8e4b-4161-9ae3-4d4606b140df/dom_md/metadata (monitor:525) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/monitor.py", line 523, in _pathChecked delay = result.delay() File "/usr/lib/python3.6/site-packages/vdsm/storage/check.py", line 391, in delay raise exception.MiscFileReadException(self.path, self.rc, self.err) vdsm.storage.exception.MiscFileReadException: Internal file read failure: ('/rhev/data-center/mnt/vserver-spider.eng.lab.tlv.redhat.com:_pub_delfassy_nfs__42/17093147-8e4b-4161-9ae3-4d4606b140df/dom_md/metadata', 1, bytearray(b"/usr/bin/dd: failed to open \'/rhev/data-center/mnt/vserver-spider.eng.lab.tlv.redhat.com:_pub_delfassy_nfs__42/17093147-8e4b-4161-9ae3-4d4606b140df/dom_md/metadata\': No such file or directory\n")) when looking at the directory I do see that metadata was created under this directory, with the following content: [delfassy@delfassy mnt]$ cd new_nfs/cddff7bb-bb0a-4fc8-8ba4-023be91d822d/dom_md/ [delfassy@delfassy dom_md]$ less metadata CLASS=Data DESCRIPTION=spider IOOPTIMEOUTSEC=10 LEASERETRIES=3 LEASETIMESEC=60 LOCKPOLICY= LOCKRENEWALINTERVALSEC=5 POOL_UUID= REMOTE_PATH=vserver-spider.eng.lab.tlv.redhat.com:/pub/delfassy/new_nfs ROLE=Regular SDUUID=cddff7bb-bb0a-4fc8-8ba4-023be91d822d TYPE=NFS VERSION=4 _SHA_CKSUM=f4953016c94f205127b00a5b10f0e7d5d9cf24f7 The permissions on the directory are: drwxrwxrwx. 3 vdsm kvm 4096 Jul 29 11:49 new_mnt Are there any other configurations I'm missing? Any idea how this issue can be resolved? Thanks, Dana

2 3

Re: Issue with ovirt 4.4 after doing some incremental backups.
by Eyal Shenitzky 29 Jul '20

29 Jul '20

According to the vdsm.log it seems that the host reports checkpoint 'ef0dfe55-c08c-4d9e-ad32-d6b6d5cbdac6' as defined checkpoint for the VM - 7-28 16:24:06,488+0200 INFO (jsonrpc/3) [api.virt] FINISH list_checkpoints return={'result': ['cd078706-84c0-4370-a6ec-654ccd6a21aa', '906fe1fd-4e81-473c-9582-de693985f462', 'd20de661-fcc1-43ff-86a3-6294a0a94e1b', '805b447e-d033-4e b1-905a-d287ca50c85a', '9ae68264-a0c9-4f75-9ffa-20c40323abe9', '8664da63-6d92-44b8-a690-04e17afb483a', 'fb6fa799-3b6f-44fa-a60e-c66ce8c76e35', 'f9f53ee7-2a8c-4dfc-a669-2dd788361eae', '7a0f37db-02bc-49c4-bfea-a03d3474f1f8', '95d8d5c7-55fc- 4c39-8a72-fc3aaec72c39', 'aa71a6e9-174b-4d8d-a2da-1a12d5e2ab2e', 'ac833f22-c8fa-4925-becc-dcf4dac81d3f', '7fc9afd1-076f-4985-b412-4ea029fd2af7', 'ae299a18-c4b0-46c4-81e1-f9583e6954f6', 'cee97ef9-6e7c-4518-91b1-dfa3b467f5c4', '51b3bf23-3cc 3-4a16-b6d9-942c6e4f7573', '0f376950-a25e-477a-93b8-d1d0ffbff716', 'ef0dfe55-c08c-4d9e-ad32-d6b6d5cbdac6'], 'status': {'code': 0, 'message': 'Done'}} from=::ffff:10.40.1.66,56474, flow_id=32ba9d9d-32c2-4652-ac01-895e92123323, vmId=116aa6e b-31a1-43db-9b1e-ad6e32fb9260 (api:54) It means as Nir said that the host assumes the corresponding bitmap is also exists in QEMU. The logs only contain a short period of time so I cannot tell if some bitmap destructive operation occurs on the VM (Live merge, cold snapshot creation etc..) Peter, is there any other log that may assist? On Wed, 29 Jul 2020 at 11:28, Łukasz Kołaciński <l.kolacinski(a)storware.eu> wrote: > Hello, > I am sending logs from vdsm, maybe they will help. I cannot find useful > libvirt logs and file libvirt.log doesn't exists. > > Best Regards, > > Łukasz Kołaciński > > Junior Java Developer > > e-mail: l.kolacinski(a)storware.eu > <m.helbert(a)storware.eu> > > > > > *[image: STORWARE]* <http://www.storware.eu/> > > > > *ul. Leszno 8/44 01-192 Warszawa www.storware.eu > <https://www.storware.eu/>* > > *[image: facebook]* <https://www.facebook.com/storware> > > *[image: twitter]* <https://twitter.com/storware> > > *[image: linkedin]* <https://www.linkedin.com/company/storware> > > *[image: Storware_Stopka_09]* > <https://www.youtube.com/channel/UCKvLitYPyAplBctXibFWrkw> > > > > *Storware Spółka z o.o. nr wpisu do ewidencji KRS dla M.St. Warszawa > 000510131* *, NIP 5213672602.** Wiadomość ta jest przeznaczona jedynie > dla osoby lub podmiotu, który jest jej adresatem i może zawierać poufne > i/lub uprzywilejowane informacje. Zakazane jest jakiekolwiek przeglądanie, > przesyłanie, rozpowszechnianie lub inne wykorzystanie tych informacji lub > podjęcie jakichkolwiek działań odnośnie tych informacji przez osoby lub > podmioty inne niż zamierzony adresat. Jeżeli Państwo otrzymali przez > pomyłkę tę informację prosimy o poinformowanie o tym nadawcy i usunięcie > tej wiadomości z wszelkich komputerów. **This message is intended only > for the person or entity to which it is addressed and may contain > confidential and/or privileged material. Any review, retransmission, > dissemination or other use of, or taking of any action in reliance upon, > this information by persons or entities other than the intended recipient > is prohibited. If you have received this message in error, please contact > the sender and remove the material from all of your computer systems.* > > ------------------------------ > *Od:* Nir Soffer <nsoffer(a)redhat.com> > *Wysłane:* środa, 29 lipca 2020 00:31 > *Do:* Łukasz Kołaciński <l.kolacinski(a)storware.eu> > *DW:* Eyal Shenitzky <eshenitz(a)redhat.com>; Mateusz Maziarz < > m.maziarz(a)storware.eu>; Marcin Kubacki <m.kubacki(a)storware.eu>; Peter > Krempa <pkrempa(a)redhat.com>; devel <devel(a)ovirt.org> > *Temat:* Re: Issue with ovirt 4.4 after doing some incremental backups. > > On Tue, Jul 28, 2020 at 4:05 PM Łukasz Kołaciński < > l.kolacinski(a)storware.eu> wrote: > > Hello, > > > Hi Łukasz > > I moved the discussion to devel(a)ovirt.org since it is more appropriate > for this issue. > > After doing a few vm backups, something breaks and I am unable to perform > any operations. I cannot do incremental backups and even full backups > doesn't work. I have this issue third time. I don't know how to fix this so > I am currently making new vms for testing purposes > > VDSM ovirt44-h2.storware.local command StartVmBackupVDS failed: Backup > Error: {'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'backup': > <vdsm.virt.backup.BackupConfig object at 0x7f42602bba20>, 'reason': "Error > starting backup: internal error: unable to execute QEMU command > 'transaction': Dirty bitmap 'ef0dfe55-c08c-4d9e-ad32-d6b6d5cbdac6' not > found"} > > This means that libvirt cannot find the dirty bitmap when starting the > backup. > > When we start a backup, we get the list of checkpoints from libvirt and we > redefine all checkpoints. We assume that all redefined checkpoints have > a bitmap in qemu at the time of the redefine. > > Peter, is this assumption correct? > > If libvirt and engine agree on the existing checkpoints, we start the > backup. > In this case one of the bitmaps was missing, so the backup failed. > > We know about some flows that may cause loss of the bitmaps: > - copying disks (bitmaps are not copied yet) > - live storage migration (it copy the disks) > - deleting snapshots > - live migration may cause this, not tested yet > - unclean shutdown of the vm > - storage is not accessible when vm is terminated > > Did you do any of these operations on the tested vm? > > Some of the issues can never be fixed, like unclean shutdown or storage > issue when qemu try to write the bitmaps to disk. So your backup > application > must be able to recover from this error. > > However oVirt does not provide a useful error that enables recovery. We > have > a special error when full backup is required, but it seem that this error > is > not returned in this case, and instead we return internal error. > > Also since you cannot do a full backup after this error, I guess that > engine > did not delete the checkpoint with the missing bitmap. This is not > surprising > since the error returned from vdsm is a generic error (BackupError), so > engine > cannot tell what is the reason for the failure. > > Did you check the backup events? What was the backup completion event? > > See this example how to get backup events: > > https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… > > https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… > > Eyal, looking at the API docs: > http://ovirt.github.io/ovirt-engine-api-model/master/#types/event > > Event code is an integer. This is not usable for detecting errors since > the value > is not part of the API. We need an enum like: > > http://ovirt.github.io/ovirt-engine-api-model/4.4/#types/image_transfer_pha… > > Peter, do we have a specific error code in libvirt about missing bitmap? > we need > this to pass useful error to engine, and engine needs this error to pass > useful > error to the user. > > The error seen here is generated by: > > flags = libvirt.VIR_DOMAIN_BACKUP_BEGIN_REUSE_EXTERNAL > try: > dom.backupBegin(backup_xml, checkpoint_xml, flags=flags) > except libvirt.libvirtError as e: > raise exception.BackupError( > reason="Error starting backup: {}".format(e), > vm_id=vm.id, > backup=backup_cfg) > > Looking in the documentation: > https://libvirt.org/html/libvirt-libvirt-domain.html#virDomainBackupBegin > > There are no specified errors so we cannot detect the reason for the > failure > and return meaningful error to our caller. > > Peter, how do you suggest to recover from internal errors? how can we > tell if this temporary error that can succeed in the next attempt, or an > error > that requires starting from full backup? > > Nir > -- Regards, Eyal Shenitzky

2 1

Re: Issue with ovirt 4.4 after doing some incremental backups.
by Eyal Shenitzky 29 Jul '20

29 Jul '20

Libvirt logs need to be activated on the host in order to collect them, please try: - systemctl stop vdsmd - systemctl stop libvirtd - Under /etc/libvirt/libvirtd.conf add: - log_filters="1:qemu 1:libvirt 4:object 4:json 4:event 1:util" - log_outputs="1:file:/var/log/libvirt/libvirtd.log" - systemctl start libvirtd - systemctl start vdsmd On Wed, 29 Jul 2020 at 11:28, Łukasz Kołaciński <l.kolacinski(a)storware.eu> wrote: > Hello, > I am sending logs from vdsm, maybe they will help. I cannot find useful > libvirt logs and file libvirt.log doesn't exists. > > Best Regards, > > Łukasz Kołaciński > > Junior Java Developer > > e-mail: l.kolacinski(a)storware.eu > <m.helbert(a)storware.eu> > > > > > *[image: STORWARE]* <http://www.storware.eu/> > > > > *ul. Leszno 8/44 01-192 Warszawa www.storware.eu > <https://www.storware.eu/>* > > *[image: facebook]* <https://www.facebook.com/storware> > > *[image: twitter]* <https://twitter.com/storware> > > *[image: linkedin]* <https://www.linkedin.com/company/storware> > > *[image: Storware_Stopka_09]* > <https://www.youtube.com/channel/UCKvLitYPyAplBctXibFWrkw> > > > > *Storware Spółka z o.o. nr wpisu do ewidencji KRS dla M.St. Warszawa > 000510131* *, NIP 5213672602.** Wiadomość ta jest przeznaczona jedynie > dla osoby lub podmiotu, który jest jej adresatem i może zawierać poufne > i/lub uprzywilejowane informacje. Zakazane jest jakiekolwiek przeglądanie, > przesyłanie, rozpowszechnianie lub inne wykorzystanie tych informacji lub > podjęcie jakichkolwiek działań odnośnie tych informacji przez osoby lub > podmioty inne niż zamierzony adresat. Jeżeli Państwo otrzymali przez > pomyłkę tę informację prosimy o poinformowanie o tym nadawcy i usunięcie > tej wiadomości z wszelkich komputerów. **This message is intended only > for the person or entity to which it is addressed and may contain > confidential and/or privileged material. Any review, retransmission, > dissemination or other use of, or taking of any action in reliance upon, > this information by persons or entities other than the intended recipient > is prohibited. If you have received this message in error, please contact > the sender and remove the material from all of your computer systems.* > > ------------------------------ > *Od:* Nir Soffer <nsoffer(a)redhat.com> > *Wysłane:* środa, 29 lipca 2020 00:31 > *Do:* Łukasz Kołaciński <l.kolacinski(a)storware.eu> > *DW:* Eyal Shenitzky <eshenitz(a)redhat.com>; Mateusz Maziarz < > m.maziarz(a)storware.eu>; Marcin Kubacki <m.kubacki(a)storware.eu>; Peter > Krempa <pkrempa(a)redhat.com>; devel <devel(a)ovirt.org> > *Temat:* Re: Issue with ovirt 4.4 after doing some incremental backups. > > On Tue, Jul 28, 2020 at 4:05 PM Łukasz Kołaciński < > l.kolacinski(a)storware.eu> wrote: > > Hello, > > > Hi Łukasz > > I moved the discussion to devel(a)ovirt.org since it is more appropriate > for this issue. > > After doing a few vm backups, something breaks and I am unable to perform > any operations. I cannot do incremental backups and even full backups > doesn't work. I have this issue third time. I don't know how to fix this so > I am currently making new vms for testing purposes > > VDSM ovirt44-h2.storware.local command StartVmBackupVDS failed: Backup > Error: {'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'backup': > <vdsm.virt.backup.BackupConfig object at 0x7f42602bba20>, 'reason': "Error > starting backup: internal error: unable to execute QEMU command > 'transaction': Dirty bitmap 'ef0dfe55-c08c-4d9e-ad32-d6b6d5cbdac6' not > found"} > > This means that libvirt cannot find the dirty bitmap when starting the > backup. > > When we start a backup, we get the list of checkpoints from libvirt and we > redefine all checkpoints. We assume that all redefined checkpoints have > a bitmap in qemu at the time of the redefine. > > Peter, is this assumption correct? > > If libvirt and engine agree on the existing checkpoints, we start the > backup. > In this case one of the bitmaps was missing, so the backup failed. > > We know about some flows that may cause loss of the bitmaps: > - copying disks (bitmaps are not copied yet) > - live storage migration (it copy the disks) > - deleting snapshots > - live migration may cause this, not tested yet > - unclean shutdown of the vm > - storage is not accessible when vm is terminated > > Did you do any of these operations on the tested vm? > > Some of the issues can never be fixed, like unclean shutdown or storage > issue when qemu try to write the bitmaps to disk. So your backup > application > must be able to recover from this error. > > However oVirt does not provide a useful error that enables recovery. We > have > a special error when full backup is required, but it seem that this error > is > not returned in this case, and instead we return internal error. > > Also since you cannot do a full backup after this error, I guess that > engine > did not delete the checkpoint with the missing bitmap. This is not > surprising > since the error returned from vdsm is a generic error (BackupError), so > engine > cannot tell what is the reason for the failure. > > Did you check the backup events? What was the backup completion event? > > See this example how to get backup events: > > https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… > > https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… > > Eyal, looking at the API docs: > http://ovirt.github.io/ovirt-engine-api-model/master/#types/event > > Event code is an integer. This is not usable for detecting errors since > the value > is not part of the API. We need an enum like: > > http://ovirt.github.io/ovirt-engine-api-model/4.4/#types/image_transfer_pha… > > Peter, do we have a specific error code in libvirt about missing bitmap? > we need > this to pass useful error to engine, and engine needs this error to pass > useful > error to the user. > > The error seen here is generated by: > > flags = libvirt.VIR_DOMAIN_BACKUP_BEGIN_REUSE_EXTERNAL > try: > dom.backupBegin(backup_xml, checkpoint_xml, flags=flags) > except libvirt.libvirtError as e: > raise exception.BackupError( > reason="Error starting backup: {}".format(e), > vm_id=vm.id, > backup=backup_cfg) > > Looking in the documentation: > https://libvirt.org/html/libvirt-libvirt-domain.html#virDomainBackupBegin > > There are no specified errors so we cannot detect the reason for the > failure > and return meaningful error to our caller. > > Peter, how do you suggest to recover from internal errors? how can we > tell if this temporary error that can succeed in the next attempt, or an > error > that requires starting from full backup? > > Nir > -- Regards, Eyal Shenitzky

2 1

Re: Issue with ovirt 4.4 after doing some incremental backups.
by Nir Soffer 29 Jul '20

29 Jul '20

On Tue, Jul 28, 2020 at 4:05 PM Łukasz Kołaciński <l.kolacinski(a)storware.eu> wrote: > Hello, > Hi Łukasz I moved the discussion to devel(a)ovirt.org since it is more appropriate for this issue. After doing a few vm backups, something breaks and I am unable to perform > any operations. I cannot do incremental backups and even full backups > doesn't work. I have this issue third time. I don't know how to fix this so > I am currently making new vms for testing purposes > > VDSM ovirt44-h2.storware.local command StartVmBackupVDS failed: Backup > Error: {'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'backup': > <vdsm.virt.backup.BackupConfig object at 0x7f42602bba20>, 'reason': "Error > starting backup: internal error: unable to execute QEMU command > 'transaction': Dirty bitmap 'ef0dfe55-c08c-4d9e-ad32-d6b6d5cbdac6' not > found"} > > This means that libvirt cannot find the dirty bitmap when starting the backup. When we start a backup, we get the list of checkpoints from libvirt and we redefine all checkpoints. We assume that all redefined checkpoints have a bitmap in qemu at the time of the redefine. Peter, is this assumption correct? If libvirt and engine agree on the existing checkpoints, we start the backup. In this case one of the bitmaps was missing, so the backup failed. We know about some flows that may cause loss of the bitmaps: - copying disks (bitmaps are not copied yet) - live storage migration (it copy the disks) - deleting snapshots - live migration may cause this, not tested yet - unclean shutdown of the vm - storage is not accessible when vm is terminated Did you do any of these operations on the tested vm? Some of the issues can never be fixed, like unclean shutdown or storage issue when qemu try to write the bitmaps to disk. So your backup application must be able to recover from this error. However oVirt does not provide a useful error that enables recovery. We have a special error when full backup is required, but it seem that this error is not returned in this case, and instead we return internal error. Also since you cannot do a full backup after this error, I guess that engine did not delete the checkpoint with the missing bitmap. This is not surprising since the error returned from vdsm is a generic error (BackupError), so engine cannot tell what is the reason for the failure. Did you check the backup events? What was the backup completion event? See this example how to get backup events: https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… https://github.com/oVirt/ovirt-engine-sdk/blob/4a143351fcd3cdb0df8c50888931… Eyal, looking at the API docs: http://ovirt.github.io/ovirt-engine-api-model/master/#types/event Event code is an integer. This is not usable for detecting errors since the value is not part of the API. We need an enum like: http://ovirt.github.io/ovirt-engine-api-model/4.4/#types/image_transfer_pha… Peter, do we have a specific error code in libvirt about missing bitmap? we need this to pass useful error to engine, and engine needs this error to pass useful error to the user. The error seen here is generated by: flags = libvirt.VIR_DOMAIN_BACKUP_BEGIN_REUSE_EXTERNAL try: dom.backupBegin(backup_xml, checkpoint_xml, flags=flags) except libvirt.libvirtError as e: raise exception.BackupError( reason="Error starting backup: {}".format(e), vm_id=vm.id, backup=backup_cfg) Looking in the documentation: https://libvirt.org/html/libvirt-libvirt-domain.html#virDomainBackupBegin There are no specified errors so we cannot detect the reason for the failure and return meaningful error to our caller. Peter, how do you suggest to recover from internal errors? how can we tell if this temporary error that can succeed in the next attempt, or an error that requires starting from full backup? Nir

3 2

ovirt-engine has been tagged (ovirt-engine-4.4.2)
by Tal Nisan 29 Jul '20

29 Jul '20

3 2

ovirt-engine has been tagged (ovirt-engine-4.3.11.3)
by Tal Nisan 28 Jul '20

28 Jul '20

1 0

Engine on Fedora 32 (help needed)
by Pavel Bar 27 Jul '20

27 Jul '20

Hi, I upgraded the OS on my laptop from Fedora 30 to Fedora 32 and now have issues with running an engine - some libraries are missing. I know that the new Fedora releases are not supported. I couldn't downgrade back to Fedora 30 and I don't want to totally reinstall the OS (either to an old Fedora 30 or to a new CentOS 8.2). Issues that I encountered: 1) Some repositories do not exist for Fedora 32. Copr repo for ovirt-katello owned by sbonazzo 383 B/s | 341 B 00:00 Errors during downloading metadata for repository '*sbonazzo-ovirt-katello* ': - Status code: 404 for https://copr-be.cloud.fedoraproject.org/results/sbonazzo/ovirt-katello/fedo… (IP: 34.227.76.72) Error: Failed to download metadata for repo 'sbonazzo-ovirt-katello': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried Copr repo for ovirt-cockpit-sso owned by mlibra 380 B/s | 341 B 00:00 Errors during downloading metadata for repository ' *mlibra-ovirt-cockpit-sso*': - Status code: 404 for https://copr-be.cloud.fedoraproject.org/results/mlibra/ovirt-cockpit-sso/fe… (IP: 34.227.76.72) Error: Failed to download metadata for repo 'mlibra-ovirt-cockpit-sso': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried Copr repo for ovsdbapp owned by mdbarroso 339 B/s | 341 B 00:01 Errors during downloading metadata for repository '*mdbarroso-ovsdbapp*': - Status code: 404 for https://copr-be.cloud.fedoraproject.org/results/mdbarroso/ovsdbapp/fedora-3… (IP: 34.227.76.72) Error: Failed to download metadata for repo 'mdbarroso-ovsdbapp': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried Ignoring repositories: *sbonazzo-ovirt-katello*, *mlibra-ovirt-cockpit-sso*, *mdbarroso-ovsdbapp* Workaround (at least stopped the errors): I updated the " /etc/yum.repos.d/ovirt-master-dependencies.repo" and changed the " $releasever" into the hardcoded "30" for the 3 repositories above. 2) Unable to install "python3-otopi" and probably some other libraries. Workaround that didn't fully work: I updated " /etc/yum.repos.d/ovirt-master-snapshot.repo" and changed the "$releasever" into the hardcoded "30" for both "ovirt-master-snapshot" & " ovirt-master-snapshot-static". Now it finds "python3-otopi", but complains about a missing "python(abi)". The latter is actually installed, but I guess there is a collision between fc30 vs. fc32 :( pbar@laptop /etc/yum.repos.d $ sudo dnf install -y python3-otopi Latest oVirt master nightly snapshot 1.8 kB/s | 3.0 kB 00:01 Latest oVirt master additional nightly snapshot 1.8 kB/s | 3.0 kB 00:01 Error: Problem: conflicting requests - nothing provides python(abi) = 3.7 needed by python3-otopi-1.9.3-0.0.master.20200607140659.git775c2c5.*fc30*.noarch (try to add '--skip-broken' to skip uninstallable packages) pbar@laptop /etc/yum.repos.d $ sudo dnf install -y "python(abi)" Last metadata expiration check: 0:00:19 ago on Mon 27 Jul 2020 03:13:34 PM IDT. Package python27-2.7.18-2.*fc32*.x86_64 is already installed. Package python3-3.8.3-2.*fc32*.x86_64 is already installed. Dependencies resolved. Nothing to do. Complete! Any suggestions that do not require a clean new OS install? Thank you in advance! Pavel

3 4