- Users - oVirt List Archives

n00b Requesting Some Advice
by matthew＠peregrineit.net 22 Apr '21

22 Apr '21

Hi All, I need some "best practice" advice. We have a Ceph Storage Cluster (Octopus moving to Pacific) which we'd like to use with our new oVirt Cluster (all on CentOS 8 boxes). What I'd like to know is what is the "best" (ie recommended / best practice) way of doing this - via iSCSI, CFS, 'raw' RBD blocks, some other way I haven't read about yet, etc? I realise 'best' is a subjective term, but what I tend to do is do 'manual' installs so that I both actually understand what is happening (ie how things fit together - I pull apart and rebuild mechanical clocks and watches for the same reason) and also so I can '"Puppet-ise" the results for future use. This means that I am *not* necessarily looking for "quick and dirty" or "quick and easy" (ie, I have no trouble using the CLI and 'vim-ing' conf files as required) but I do want a solid, "best-practice" system when I'm done. So, can some please help? And also, would you mind pointing me towards the relevant documentation for the answer(s) supplied (yes, I *always* RTFM :-) ). Thanks in advance Dulux-Oz

6 6

not able to upload disks, iso - Connection to ovirt-imageio service has failed. Ensure that ovirt-engine certificate is registered as a valid CA in the browser.
by dhanaraj.ramesh＠yahoo.com 22 Apr '21

22 Apr '21

Hi We are unning with 4.4.3.12-1.el8 version and so far working fine, but today users complained they are unable to upload new disks and upon checking found "Connection to ovirt-imageio service has failed. Ensure that ovirt-engine certificate is registered as a valid CA in the browser" during testing option. please help on this and if there is any temp solution is available share me the steps

4 7

How to update ovirt-sdk
by Miguel Garcia 22 Apr '21

22 Apr '21

We integrate jenkins to launch vms dynamically to run smoketest from our builds but now we receive the following problem: "msg": "ovirtsdk4 version 4.3.0 or higher is required for this module" I had installed following packages in CentOs7 ovirt-engine-sdk-java.noarch 3.6.10.0-1.el7 epel ovirt-engine-sdk-java-javadoc.noarch 3.6.10.0-1.el7 epel ovirt-engine-sdk-python.noarch 3.6.9.1-1.el7 epel I tired to use yum upgrade but did not report more recent version from ovirt-sdk. How can I upgrade/install ovirt-sdk to version 4.3?

4 8

[ANN] oVirt 4.4.6 Fifth Release Candidate is now available for testing
by Lev Veyde 22 Apr '21

22 Apr '21

oVirt 4.4.6 Fifth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Fifth Release Candidate for testing, as of April 22nd, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 * oVirt Node 4.4 based on CentOS Stream 8 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS Stream 8 - oVirt Node NG is already available based on CentOS Stream 8 Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

host certification is about to expire
by Bill James 22 Apr '21

22 Apr '21

I get this message from ovirt: Message:Host <hostname> certification is about to expire at 2021-05-12. Please renew the host's certification. I tried putting host in maintenance mode and running "enroll certificate". Didn't help. How do I renew the certificate? I'm running* 4.3.9.4-1.el7* *Thanks.* -- This email, its contents and attachments contain information from J2 Global, Inc. and/or its affiliates which may be privileged, confidential or otherwise protected from disclosure. The information is intended to be for the addressee(s) only. If you are not an addressee, any disclosure, copy, distribution or use of the contents of this message is prohibited. If you have received this email in error, please notify the sender by reply email and delete the original message and any copies.

2 4

Ansible ovirt.ovirt_vm nics
by Matthew.Stier＠fujitsu.com 22 Apr '21

22 Apr '21

The 'nics' section of ovirt_vm is vague and with nearly no examples. My playbook is based upon https://blogs.oracle.com/scoter/ansible-with-oracle-linux-virtualization-ma… I've made several modifications, (more default) and added a few lines, which I believe is supposed to assign vnic profiles to the primary vnic (nic1), based upon the definition of 'vm_nic1_profile' defined in an included 'ini' file. (the profile defaulting to blank if it is not defined in the ini file.) It isn't doing its job. nics: - name: "nic1" profile_name: "{{ hostvars[item]['vm_nic1_profile'] | default('') }}" The playbook runs without complaint. If I run it with option '-vvv' part of the output lists the variables, but the 'nics' variable is an empty list (nics[]) Any hints on what I'm doing wrong? I've checked the forum, but it tends to strip leading spaces, which is bad for indent sensitive code.

1 0

Re: How to Upgrade Node with Local Storage ?
by Adam Xu 22 Apr '21

22 Apr '21

在 2021/4/21 22:40, Nur Imam Febrianto 写道: > > Set global maintenance and then turn off all vm, do yum update but it > completed with failed. > > Am I missing something ? > where is your ovirt engine ? is it running in that local storage or in a standalone server? > > *From: *Adam Xu <mailto:adam_xu@adagene.com.cn> > *Sent: *20 April 2021 7:36 > *To: *users(a)ovirt.org <mailto:users@ovirt.org> > *Subject: *[ovirt-users] Re: How to Upgrade Node with Local Storage ? > > For oVirt Node that using Local Storage, I think you should shutdown > all your vms before you upgrade the Node. > > 在 2021/4/19 22:09, Nur Imam Febrianto 写道: > > Hi, > > How we can upgrade oVirt Node that using Local Storage ? Seems I > cant find any good documentation about this. > > Planning to upgrade one 4.4.4 node with local storage to 4.4.5. > > Thanks before. > > Regards, > > Nur Imam Febrianto > > > > _______________________________________________ > > Users mailing list --users(a)ovirt.org <mailto:users@ovirt.org> > > To unsubscribe send an email tousers-leave(a)ovirt.org <mailto:users-leave@ovirt.org> > > Privacy Statement:https://www.ovirt.org/privacy-policy.html <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > > oVirt Code of Conduct:https://www.ovirt.org/community/about/community-guidelines/ <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > > List Archives:https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZOCH… <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov…> > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZIWFVG73Y5CBS…

1 0

Moving templates and their thin based VMs
by Gianluca Cecchi 21 Apr '21

21 Apr '21

Hello, I had to free up and reformat a storage domain where I had some templates and many VMs. I was able to move to other existing storage domains disks of VMs created with "Clone" Storage Allocation But some of these VMs had disk with storage allocation of type "Thin" on their related template. So I was both unable to move these templates and VMs disks... I was able to export as OVA the templates and then import again them (with another name "_Copy") on to another storage domain.... then remove VMs and templates and rename templates' names... Are there any chances to better solve these kind of problems if one has to decommission a storage domain? Only export of all VMs and related templates? Is there a way to "consolidate" the disks of an existing "Thin" based storage allocation to Clone? Possibly I can clone the VM? Thanks in advance, Gianluca

2 3

Re: FreeBSD 13 and virtio
by thomas＠hoberg.net 21 Apr '21

21 Apr '21

I am attaching both working configs here. Von: Nur Imam Febrianto <nur_imam(a)outlook.com> Gesendet: Dienstag, 20. April 2021 14:14 An: Thomas Hoberg <thomas(a)hoberg.net>; users(a)ovirt.org Betreff: [ovirt-users] Re: FreeBSD 13 and virtio Seems strange. I want to use q35, but whenever I try even to start the installation (vm disk using virtio-scsi/virtio, net adapter using virtio) it always shows me the installer doesn't detect any disk. I have an existing VM too that recently upgraded from 12.2 to 13. It uses i440FX with virtio-scsi disk and virtio network. If I try to change the machine into q35, it keeps stuck at boot after "promiscuous mode enabled". Don't know what's wrong. Using oVirt 4.4.5. Can you share your VM Config ? From: Thomas Hoberg <mailto:thomas@hoberg.net> Sent: 20 April 2021 17:27 To: users(a)ovirt.org <mailto:users@ovirt.org> Subject: [ovirt-users] Re: FreeBSD 13 and virtio q35 with BIOS as that is the cluster default with >4.3. Running the dmesg messages through my mind as I remember them, the vio hardware may be all PCIe based, which would explain why this won't work on a virtual FX 440FX system, because those didn't have PCIe support AFAIK. Any special reason why you'd want them based on 440FX? And I also tested with GhostBSD, which is still 12.* based, and that doesn't seem to have vio support, at least I could not see a hard disk there, which confirms your observation there. _______________________________________________ Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org> Privacy Statement: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt .org%2Fprivacy-policy.html <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir t.org%2Fprivacy-policy.html&data=04%7C01%7C%7C71e5972978224d31def708d903 e6f09b%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnk nown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXV CI6Mn0%3D%7C1000&sdata=effZxEik3q1lfTBn%2BBi4DXIQM6wVJfgiQ7%2Fqr0W1dLM%3 D&reserved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= effZxEik3q1lfTBn%2BBi4DXIQM6wVJfgiQ7%2Fqr0W1dLM%3D&reserved=0 oVirt Code of Conduct: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt .org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir t.org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7C%7C71 e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C 637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM zIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=rvQ12IpSElU9D23G7HJvPz%2F vqqZ0OaUhJ3wI%2BRslIQY%3D&reserved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= rvQ12IpSElU9D23G7HJvPz%2FvqqZ0OaUhJ3wI%2BRslIQY%3D&reserved=0 List Archives: https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovi rt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2F7ZWDRPXM6G25H4VRE3O UAH25UIY4JVI3%2F <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov irt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2F7ZWDRPXM6G25H4VRE3 OUAH25UIY4JVI3%2F&data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C8 4df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWF pbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D% 7C1000&sdata=qDf%2BRNi1PXI2cf%2F4XFc6qHCTY6lqOX9lE5Qvyhg4Xls%3D&rese rved=0> &data=04%7C01%7C%7C71e5972978224d31def708d903e6f09b%7C84df9e7fe9f640afb4 35aaaaaaaaaaaa%7C1%7C0%7C637545112683975628%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata= qDf%2BRNi1PXI2cf%2F4XFc6qHCTY6lqOX9lE5Qvyhg4Xls%3D&reserved=0

2 1

Re: How to Upgrade Node with Local Storage ?
by Adam Xu 21 Apr '21

21 Apr '21

For oVirt Node that using Local Storage, I think you should shutdown all your vms before you upgrade the Node. 在 2021/4/19 22:09, Nur Imam Febrianto 写道: > > Hi, > > How we can upgrade oVirt Node that using Local Storage ? Seems I cant > find any good documentation about this. > > Planning to upgrade one 4.4.4 node with local storage to 4.4.5. > > Thanks before. > > Regards, > > Nur Imam Febrianto > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZOCHCAJPXO4LT…

2 1

oVirt Node's Future Regarding CentOS Stream
by eshwayri＠gmail.com 21 Apr '21

21 Apr '21

So I just finished migrating my 4.3 engine to 4.4 on a brand new RHvEL8 install; next step is to upgrade the hosts. When I first started with oVirt I used my own CentOS installs, but quickly decided that it made no sense for my use case. Now I am looking at upgrading from 4.3 to 4.4 and asking myself the same question. Up to now oVirt node has been using the same exact OS I would have used +/- a few extra packages, but with the traditional CentOS going away it really depends on what the new oVirt nodes are going to be based on. I have a feeling the answer to that question is CentOS Stream, which I don't feel comfortable with for this task. While I am sure the developers will test the combination before releasing a new node, they are still only testing whatever specific hardware combination they have. There could be numerous weird bugs that will only show up in certain situations. If Stream was as stable as an EL release, there wouldn't be EL releases. I also appreciate the fa ct that oVirt is itself a work in progress, but the stable branch is considerably more like an EL release than a stream. Anyway, back to the point. Just want to confirm the future for node is stream before I go wasting time building my own EL8 hosts.

3 3

Re: FreeBSD 13 and virtio
by Thomas Hoberg 20 Apr '21

20 Apr '21

q35 with BIOS as that is the cluster default with >4.3. Running the dmesg messages through my mind as I remember them, the vio hardware may be all PCIe based, which would explain why this won't work on a virtual FX 440FX system, because those didn't have PCIe support AFAIK. Any special reason why you'd want them based on 440FX? And I also tested with GhostBSD, which is still 12.* based, and that doesn't seem to have vio support, at least I could not see a hard disk there, which confirms your observation there.

2 3

Re: FreeBSD 13 and virtio
by Sandro Bonazzola 20 Apr '21

20 Apr '21

Maybe you can have a look at https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=236922 "Bug 236922 - Virtio fails as QEMU-KVM guest with Q35 chipset on Ubuntu 18.04.2 LTS" it's from ~20 days ago and the bug is still open Il giorno mar 20 apr 2021 alle ore 14:16 Nur Imam Febrianto < nur_imam(a)outlook.com> ha scritto: > Seems strange. I want to use q35, but whenever I try even to start the > installation (vm disk using virtio-scsi/virtio, net adapter using virtio) > it always shows me the installer doesn’t detect any disk. I have an > existing VM too that recently upgraded from 12.2 to 13. It uses i440FX with > virtio-scsi disk and virtio network. If I try to change the machine into > q35, it keeps stuck at boot after “promiscuous mode enabled”. > > Don’t know what’s wrong. Using oVirt 4.4.5. Can you share your VM Config ? > > > > *From: *Thomas Hoberg <thomas(a)hoberg.net> > *Sent: *20 April 2021 17:27 > *To: *users(a)ovirt.org > *Subject: *[ovirt-users] Re: FreeBSD 13 and virtio > > > > q35 with BIOS as that is the cluster default with >4.3. > > Running the dmesg messages through my mind as I remember them, the vio > hardware may be all PCIe based, which would explain why this won't work on > a virtual FX 440FX system, because those didn't have PCIe support AFAIK. > > Any special reason why you'd want them based on 440FX? > > And I also tested with GhostBSD, which is still 12.* based, and that > doesn't seem to have vio support, at least I could not see a hard disk > there, which confirms your observation there. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir… > oVirt Code of Conduct: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir… > List Archives: > https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov… > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/KFTCXCLC6Q5LV… > -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

1 0

oVirt Node
by KSNull Zero 20 Apr '21

20 Apr '21

Hello! We want to switch OS based oVirt instalation to oVirt-Node based. Is it safe to have OS based hosts and oVirt-Node hosts in the same cluster (with FC shared storage) during transition ? Thank you.

2 1

rhv-log-collector-analyzer available missing?
by Juhani Rautiainen 20 Apr '21

20 Apr '21

Hi! I'm trying to upgrade SHE from 4.3->4.4. Instructions from https://www.ovirt.org/documentation/upgrade_guide/#SHE_Upgrading_from_4-3 has step "4.2 Analyzing the Environment". My installation doesn't bring the tool rhv-log-collector-analyzer although wiki has a notice that it has been available since v4.2.5? [root@ovirtmgr ~]# yum install rhv-log-collector-analyzer Loaded plugins: fastestmirror, versionlock Determining fastest mirrors ovirt-4.3-epel/x86_64/metalink | 34 kB 00:00:00 * base: mirror.hosthink.net * extras: mirror.hosthink.net * ovirt-4.3: resources.ovirt.org * ovirt-4.3-epel: mirrors.nxthost.com * updates: mirror.hosthink.net base | 3.6 kB 00:00:00 centos-sclo-rh-release | 3.0 kB 00:00:00 extras | 2.9 kB 00:00:00 ovirt-4.3 | 3.0 kB 00:00:00 ovirt-4.3-centos-gluster6 | 3.0 kB 00:00:00 ovirt-4.3-centos-opstools | 2.9 kB 00:00:00 ovirt-4.3-centos-ovirt-common | 3.0 kB 00:00:00 ovirt-4.3-centos-ovirt43 | 2.9 kB 00:00:00 ovirt-4.3-centos-qemu-ev | 3.0 kB 00:00:00 ovirt-4.3-epel | 4.7 kB 00:00:00 ovirt-4.3-virtio-win-latest | 3.0 kB 00:00:00 sac-gluster-ansible | 3.3 kB 00:00:00 updates | 2.9 kB 00:00:00 (1/9): extras/7/x86_64/primary_db | 232 kB 00:00:00 (2/9): ovirt-4.3-centos-gluster6/x86_64/primary_db | 120 kB 00:00:00 (3/9): ovirt-4.3-epel/x86_64/group_gz | 96 kB 00:00:00 (4/9): base/7/x86_64/primary_db | 6.1 MB 00:00:00 (5/9): ovirt-4.3-epel/x86_64/updateinfo | 1.0 MB 00:00:00 (6/9): ovirt-4.3-epel/x86_64/primary_db | 6.9 MB 00:00:00 (7/9): centos-sclo-rh-release/x86_64/primary_db | 2.9 MB 00:00:00 (8/9): sac-gluster-ansible/x86_64/primary_db | 12 kB 00:00:00 (9/9): updates/7/x86_64/primary_db | 7.1 MB 00:00:00 No package rhv-log-collector-analyzer available. Error: Nothing to do Are we missing a repo or is this just copy/paste error from RHV docs and this step shouldn't even be in the oVirt docs? Thanks, Juhani -- Juhani Rautiainen jrauti(a)iki.fi

3 3

Re: FreeBSD 13 and virtio
by Thomas Hoberg 20 Apr '21

20 Apr '21

I've just given it a try: works just fine with me. But I did notice, that I chose virtio-scsi when I created the disk, don't now if that makes any difference, but as an old-timer, I still got "SCSI" ingrained as "better than ATA". Chose FreeBSD 9.2 x64 as OS type while creating the VM (nothing closer appears in the selection box), again don't know if there are better choices. iperf3 shows slightly lower performance than a typical Linux guest, still rather close to 10Gbit/s on my network from the FreeBSD13 guest to a host "next-door", around 40Gbit/s VM to host. Verfied usage of vtnet0/VirtIO NIC and vtscsi0/VirtIO SCSI via dmesg.

2 1

Is it possible to upgrade 3 node HCI from 4.3 to 4.4?
by Jayme 20 Apr '21

20 Apr '21

I have a fairly stock three node HCI setup running oVirt 4.3.9. The hosts are oVirt node. I'm using GlusterFS storage for the self hosted engine and for some VMs. I also have some other VMs running from an external NFS storage domain. Is it possible for me to upgrade this environment to 4.4 while keeping some of the VMs on GlusterFS storage domains running? Does the upgrade require an additional physical host? I'm reading through the upgrade guide and it's not very clear to me how the engine is reinstalled on CentOS8. Do you need a 4th host, or do you take one of the three existing hosts down, wipe it and install ovirt node 4.4? Would it be easier for me to just move all VMs to my NFS storage domain, wipe all hosts and deploy a brand new 4.4 HCI cluster then import the NFS storage domain? Will the 4.3 VMs on the NFS storage domain import/run properly into the new 4.4 deployment or are there any other considerations?

3 4

intel_iommu=on kvm-intel.nested=1 deactivates rp_filter kernel option
by Nathanaël Blanchet 20 Apr '21

20 Apr '21

Hello, I have two kind of hosts: * some with default ovirt node 4.4 kernel settings * some with custom kernel settings including intel_iommu=on kvm-intel.nested=1 I can't open vm console from the second category host when binding from a different vlan because the host is unreacheable But if I set sysctl -w net.ipv4.conf.all.rp_filter=2, I can bind the host and open a vm console. I didn't test if this behaviour is because of Hostdev Passthrough & SR-IOV or Nested Virtualization. Is it an expected behaviour or a bug? -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

Two selfhosted engines
by wilrikvdvliert＠hotmail.com 20 Apr '21

20 Apr '21

Dear forum, If I understand correctly, I need shared storage for the self-hosted engine to make it highly available. But is it possible to create 2 self-hosted engines on 2 hosts and make it high available this way? Kind regard

3 2

ova import
by eevans＠digitaldatatechs.com 20 Apr '21

20 Apr '21

I am running Ovirt 4.3 and exported machines as ova which includes disks. When I re import them. the disks are thin provisioned and the vm will not boot. Any idea how to get the import to preallocate disks? I have vms that will not boot. It states no bootable disk is available. It seems the virt2vm isn't working correctly. ANy help would be appreciated. Eric

4 5

[Help] The engine is not stable on HostedEngine with GlusterFS Herperverged deployment
by mengz.you＠outlook.com 20 Apr '21

20 Apr '21

Hi, I deployed a oVirt (4.3.10) cluster with HostedEngine and GlusterFS volumes (engine, vmstore, data), the glusterfs cluster on node1/node2/node3, and the engine vm can be running on those 3 nodes. Then I added a 4th nodes into cluster. But, when I operates on Eninge Web Portal, it's always reports 503 error, then I checked `hsoted-engine --vm-status`, see below: ``` [root@vhost1 ~]# hosted-engine –vm-status –== Host vhost1.yhmk.lan (id: 1) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost1.<span style=”background-color: rgb(255, 255, 255); color: rgb(51, 51, 51);”>alatest</span>.lan Host ID : 1 Engine status : {“reason”: “bad vm status”, “health”: “bad”, “vm”: “down_unexpected”, “detail”: “Down”} Score : 0 stopped : False Local maintenance : False crc32 : 1f25baff local_conf_timestamp : 1253650 Host timestamp : 1253649 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1253649 (Thu Apr 8 08:05:48 2021) host-id=1 score=0 vm_conf_refresh_time=1253650 (Thu Apr 8 08:05:48 2021) conf_on_shared_storage=True maintenance=False state=EngineUnexpectedlyDown stopped=False timeout=Thu Jan 15 20:23:29 1970 –== Host vhost2.yhmk.lan (id: 2) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost2.<span style=”background-color: rgb(255, 255, 255); color: rgb(51, 51, 51);”>alatest</span>.lan Host ID : 2 Engine status : {“reason”: “vm not running on this host”, “health”: “bad”, “vm”: “down_unexpected”, “detail”: “unknown”} Score : 3400 stopped : False Local maintenance : False crc32 : 539fc30c local_conf_timestamp : 1253343 Host timestamp : 1253343 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1253343 (Thu Apr 8 08:05:46 2021) host-id=2 score=3400 vm_conf_refresh_time=1253343 (Thu Apr 8 08:05:46 2021) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False –== Host vhost3.yhmk.lan (id: 3) status ==– conf_on_shared_storage : True Status up-to-date : True Hostname : vhost3.alatest.lan Host ID : 3 Engine status : {“reason”: “bad vm status”, “health”: “bad”, “vm”: “up”, “detail”: “Powering up”} Score : 3400 stopped : False Local maintenance : False crc32 : 4072e0b8 local_conf_timestamp : 1252345 Host timestamp : 1252345 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1252345 (Thu Apr 8 08:05:42 2021) host-id=3 score=3400 vm_conf_refresh_time=1252345 (Thu Apr 8 08:05:42 2021) conf_on_shared_storage=True maintenance=False state=EngineStarting stopped=False ``` Then, wait a moment, can access web portal again, and check the hosts status, alway reports one or more hosts with label `unavaiable as HA score`, but it will dispear later. And I found, sometimes the engine vm will migrated to another nodes whill this problem occur. So, seems the HostedEngine is not stable, always occur this problem, could you please help me with this ? Thanks!

3 8

Re: ovirt-hosted-engine-cleanup
by Thomas Hoberg 20 Apr '21

20 Apr '21

ovirt-hosted-engine-cleanup will only operate on the host you run it on. In a cluster that might have side-effects, but as a rule it will try to undo all configuration settings that had a Linux host become an HCI member or just a host under oVirt management. While the GUI will try to do the same with Ansible only, the script seems to do a little more and be more thorough. My guess is that it's somewhat of a leftover from the older 'all scripts' legacy of oVirt, before they re-engineered much of it to fit Ansible. It's not perfect, however. I have come across things that it would not undo, and that were extremely difficult to find (a really clean re-install would then help). There was an issue around keys and certificates for KVM that I only remember as a nightmare and more recently I had an issue with it's ansible scripts inserting an LVM device filter specific for a UID that the HCI setup wizard had created, which then precluded it ever working again after running the *cleanup scripts. All I got was "device excluded by a filter" and only much later I found the added line in /etc/lvm.conf not undone, which caused this nail-biter. But generally that message "Is hosted engine setup finished?" mostly indicates that the four major daemons for HCI still have issues. It all starts with glusterd: If you just added a host in HCI with storage, that would like to be properly healed. AFAIK that doesn't actually preclude already using the machine to host VMs, but in the interest of keeping your head clear, I'd suggest concentrating on getting the storage all clean, with gluster happily showing connectivity all around (gluster volume status all etc.) and 'gluster volume heal <volume> [info]' giving good results. Then you need to check on the services ovirt-ha-broker and ovirt-ha-agent as well as vdsmd via 'servicectl status <servicename>' to see what they are complaining about. I typically restart them in this order to iron out the bumps. As long as you give them a bit of time, restarting them periodically doesn't seem to do any harm, but helps them recover from hangs. And then you simply need patience: Things don't happen immediately in oVirt, because few commands ever intervene into anything directly. Instead they set flags here and there which then a myriad of interlocking state machine gears will pick up and respond to, to do things in the proper order and by avoiding the race conditions manual intervention can so easily cause. Even the fastest systems won't give results in seconds. So have a coffee, better yet, some herbal tea, and then look again. There is a good chance oVirt will eventually sort it out (but restarting those daemons really can help things along, as will looking at those error messages and their potential cause).

1 0

Introduction & general question about oVirt
by Nicolas Kovacs 20 Apr '21

20 Apr '21

Hi, I'm a 53-year old Austrian living in Montpezat, a small village in South France. I'm an IT professional with a focus on Linux and free software, and I've been a Linux user since Slackware 7.1. I'm doing web & mail hosting for myself and several small structures like our local school and a handful of local companies. Up until recently these hostings have happened on "bare metal" root servers using CentOS 7. One main server is hosting most of the stuff: WordPress sites, one OwnCloud instance, Dolibarr management software, GEPI learning platform, Postfix/Dovecot mail server, Roundcube webmail, etc. This setup has become increasingly problematic to manage, since applications have more and more specific requirements, like different versions of PHP and corresponding modules. So I decided to split everything up nicely into a series of virtual machines, each one with a nicely tailored setup. I have a couple of sandbox servers, one public and one local, running Oracle Linux 7 (a RHEL clone like CentOS). I played around with it, and KVM-based virtualization already works quite nicely. While looking for documentation, I stumbled over oVirt, which I didn't even know existed until last week. Before I dive head first into it, I'd be curious to know a few general things. 1. Would it be overkill for a small structure like mine? 2. Will I be able to do HA on a series of modest KVM-capable root servers even if they are located in different datacenters across different countries? 3. One problem I couldn't resolve using a bone-headed keep-it-simple KVM setup is backup. For my bare-metal servers I've been using incremental backups using Rsnapshot for years. Here's a blog article I wrote on the subject: https://blog.microlinux.fr/rsnapshot-centos-7/ Unfortunately I can't use this approach with huge QCOW images, at least not without jumping through burning loops. Is there an easy way to perform remote incremental backups with oVirt? BTW, I took a peek at Proxmox and Ceph, but I admit I'm a die-hard RHEL-clone user. Cheers from the sunny South of France, Niki -- Microlinux - Solutions informatiques durables 7, place de l'église - 30730 Montpezat Site : https://www.microlinux.fr Blog : https://blog.microlinux.fr Mail : info(a)microlinux.fr Tél. : 04 66 63 10 32 Mob. : 06 51 80 12 12

4 3

Upgrading single host ovirt "clusters" to v4.5 via command line?
by Gilboa Davara 19 Apr '21

19 Apr '21

Hello all, As the title suggests I have a couple of single-host hyper converged setups, mostly used for testing. As I cannot use the GUI cluster upgrade method on a single host (it requires me to reboot the host, which will require me to shutdown the hosted engine), is there any method to upgrade the cluster / data-center via command line in maintenance=global mode? Beyond that, can I use the same method on my production setups? (multi-node, gluster based setups). Thanks, Gilboa

1 0

Re: FreeBSD 13 and virtio
by Nir Soffer 19 Apr '21

19 Apr '21

On Mon, Apr 19, 2021 at 5:11 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > I’m having an issue, if I’m using q35 and using virtio disk + virtio > network adapter, the guest OS wont detect any disk. I440fx work fine. This > issue happened on FBSD 12.2 too. On FBSD 13 release note, it was said q35 > should working okay now, a lot of people using pc-q35-4.2 machine type > confirm it works now on vanilla KVM. But seems it still doesn’t work on > oVirt. > It will help if you can file a bug about this, and attach a vm xml that works outside of ovirt (e.g using virt-manger, or virsh), so we can compare to our vm xml. Nir > > > *From: *Sandro Bonazzola <sbonazzo(a)redhat.com> > *Sent: *19 April 2021 19:35 > *To: *Nur Imam Febrianto <nur_imam(a)outlook.com> > *Cc: *oVirt Users <users(a)ovirt.org> > *Subject: *Re: [ovirt-users] FreeBSD 13 and virtio > > > > Hi, can you please provide some more details on the issues you're seeing? > > > > Il giorno sab 17 apr 2021 alle ore 06:35 Nur Imam Febrianto < > nur_imam(a)outlook.com> ha scritto: > > Hi, > > > > Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? > > I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it > was the q35 spec issue with the kernel. Lot of people now it works nicely > on FBSD 13, but I cant get it working on oVirt. > > > > Thanks before. > > > > Regards, > > Nur Imam Febrianto > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovir…> > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/FCPJBK3AV4BSB… > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ov…> > > > > > -- > > *Sandro Bonazzola* > > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > > Red Hat EMEA > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redh…> > > sbonazzo(a)redhat.com > > > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redh…> > > > *Red Hat respects your work life balance. Therefore there is no need to > answer this email out of your office hours. > <https://apac01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmojo.red…>* > > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/ADIC2ERITKAMC… >

1 0

How to Upgrade Node with Local Storage ?
by Nur Imam Febrianto 19 Apr '21

19 Apr '21

Hi, How we can upgrade oVirt Node that using Local Storage ? Seems I cant find any good documentation about this. Planning to upgrade one 4.4.4 node with local storage to 4.4.5. Thanks before. Regards, Nur Imam Febrianto

1 0

Re: FreeBSD 13 and virtio
by Sandro Bonazzola 19 Apr '21

19 Apr '21

Hi, can you please provide some more details on the issues you're seeing? Il giorno sab 17 apr 2021 alle ore 06:35 Nur Imam Febrianto < nur_imam(a)outlook.com> ha scritto: > Hi, > > > > Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? > > I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it > was the q35 spec issue with the kernel. Lot of people now it works nicely > on FBSD 13, but I cant get it working on oVirt. > > > > Thanks before. > > > > Regards, > > Nur Imam Febrianto > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/FCPJBK3AV4BSB… > -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

2 1

Why and when does oVirt make a compute host part of the HCI Gluster?
by Thomas Hoberg 19 Apr '21

19 Apr '21

My understanding is that in a HCI environment, the storage nodes should be rather static, but that the pure compute nodes, can be much more dynamic or opportunistic: actually those should/could even be switched off and restarted as part of oVirt's resource optimization. The 'pure compute' nodes fall into two major categories, a) those who can run the management engine, b) those who can't. What I don't quite understand is why both types seem to be made 'gluster peers', when they don't contribute storage bricks: shouldn't they just be able to mount Gluster volumes? The reason for my concern is that I actually want to manage these computing hosts with much more freedom. I may have them join and take on workloads, or not and I may want to shut them down. To my irritation I sometimes even see these 'missing' hosts being considered for quorum decisions or being listed e.g. when I do a 'gluster volume engine status'. I find hosts there, that definitely are not contributing bricks to 'engine' (or any other volume). Then I'm not even sure I have consistent behavior when I remove hosts from oVirt: I'd swear that quite a few remain as Gluster peers, even if they are completely invisible from the oVirt GUI (while hosted-engine --vm-status will still list them). So what's the theory here and would it be a bug if removed hosts remain gluster members?

2 3

Expand gluster volumes
by David White 19 Apr '21

19 Apr '21

Is it possible to expand an existing gluster volume? I have a hyperconverged environment, and have enough space right now, but I'm going to have to significantly over-provision my environment. The vast majority of our customers are using a small fraction of the amount of space that they are technically allocated, but we still need to make that space available to them. As a result, I'd like to plan ahead, and go ahead and have a plan to add storage later down the road. I'd like to plan to shut down each server in the cluster (individually, not at once), add storage, and then bring them back online. Once all 3 are back online with the additional storage, I'd like to expand the gluster volume to use the additional space. Is that possible? How? Sent with ProtonMail Secure Email.

3 3

After upgrade to 4.4.5: cockpit login error
by ovirt＠r5d.de 18 Apr '21

18 Apr '21

Hello, 1. Installation ovirt node iso 4.4.4 2. dnf upgrade -> 4.4.5 -> error login cockpit: Message: pr 18 13:02:53 h2 systemd[1]: cockpit-wsinstance-https-factory(a)2-7789-995.service: Succeeded. Apr 18 13:02:53 h2 cockpit-ws[7796]: cockpit-ws: Failed to open certificate file /run/cockpit/tls/e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855: No such file or directory Apr 18 13:02:55 h2 cockpit-ws[7796]: cockpit-session: open(/var/log/btmp) failed: Permission denied What is todo? Thx.

1 0

Ovirt and gluster 9 volume
by eevans＠digitaldatatechs.com 17 Apr '21

17 Apr '21

My setup is 3 Centos 7 servers hyper-converged with a 4th stand alone engine server. My issue is Ovirt is reading the cluster disk as 49GiB instead of 5.5 TB is should be. One server has a 928 GB raid 5 volume, the second has a 7,7 TB raid 10 volume and the third has a 5.5 TB raid 10 volume. How is Ovirt translating this to 49 GiB?? Here is a link to the screen shots for verification. https://1drv.ms/u/s!AvgvEzKKSZHbhLIrRBvQRLmoZOeEyw?e=rO83vw Logs look good unless I missed something. Any help is appreciated. Eric

2 2

Intel Optane DC Persistent Memory - Ovirt / RHEV
by jorgevisentini＠gmail.com 17 Apr '21

17 Apr '21

What is the usage experience of the Intel Optane DC Persistent Memory with oVirt? It's compatible? Have any document for configuration?

3 3

Remote VNC
by David White 17 Apr '21

17 Apr '21

I'm running into the issue described in this thread: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KT3B6N3UZ3DS3… In short, I have ssh to the datacenter. I can ssh to a public IP address with the "-D 8080" option to forward local port 8080 act as a SOCKS proxy. I then edit my local computer's proxy settings and set the SOCKS host to 8080. So this is a system-wide change. I'm not setting the SOCKS proxy in the browser preferences. After I do all that, I'm able to use my browser to get to the engine web UI, and I'm able to login. However, the console for each VM isn't working. In the thread I linked to above, Alan says to do this: 2. SSH to the hypervisor tunneling a local port to that remote console port. 3. Click on the console link in the Engine and locally save the vv file.4. Edit the vv file; change host to localhost and port to whichever port you configured for the local side of the tunnel. Question: I'm confused why I need to tunnel a local port to the remote console port, if I'm already tunneling port 8080 to the host. Question: I don't have much experience with ssh port forwarding. If I already have the SOCKS proxy working, how, exactly, would I accomplish step #2? With the 8080 socks proxy working, I've now tried to run this command: ssh -L 5902:127.0.0.1:5901 username@ovirt-host-ip And in this case, I'm "assuming" that 5902 is going to listen on my local computer, and that I need to edit the vv file to connect to 127.0.0.1, port 5902. That's not working. Maybe I don't understand how SOCKS proxies work, but I was hoping / under the impression that all of my network traffic would go through the ssh tunnel on port 8080, and that vnc would work at that point. Sent with ProtonMail Secure Email.

1 1

FreeBSD 13 and virtio
by Nur Imam Febrianto 17 Apr '21

17 Apr '21

Hi, Any body already try FBSD 13 sing q35 + virtio disk + virtio net ? I cant get it working, it should be fine in FBSD 13, lastly on FBSD 12 it was the q35 spec issue with the kernel. Lot of people now it works nicely on FBSD 13, but I cant get it working on oVirt. Thanks before. Regards, Nur Imam Febrianto

1 0

Re: Strange Issue with imageio
by Nir Soffer 17 Apr '21

17 Apr '21

On Fri, Apr 16, 2021 at 7:22 PM Nur Imam Febrianto <nur_imam(a)outlook.com> wrote: > After upgrading to 4.4.5 from 4.4.4, I’m having a strange issue. Whenever I try to upload something (image or iso) to Storage Domain without clicking Test Connection, upload process wont start. It will shows the file area already uploaded but no upload process. When I try to open the log, seems if I don’t click test connection, it wont open any session in imageio. Upload process will going normally, if I click Test connection first and proceed to upload. Please file ovirt-engine bug, testing the connection should not be required for upload. > Any idea why this is happening ? Don’t have this issue before in 4.4.4. Rebooting the engine doesn’t help either. This is most likely a bug introduced in engine 4.4.5. Nir

2 1

Odd question: changing network MTU
by Chris Adams 16 Apr '21

16 Apr '21

I have an oVirt 4.3 cluster, running in one location. I have to move it to another location. I've got a couple of 1G links between the sites, and that's enough bandwidth for this (at least temporarily), but... I have my iSCSI networks defined with a MTU of 9000, and it turns out the site-to-site links only allow 1500 (and these links are going away after this is done, so I don't think either carrier would be interested in changing things to support larger). Because of that, the storage won't connect up. I tried going "under the hood" and setting a firewalld rule to force the MSS to a smaller value, but that didn't seem to get it. What happens if I change the MTU of an active iSCSI network in oVirt? I could just go manually change it on each node's iSCSI interfaces, but I'm not sure if oVirt might change it back. Also, I'm not sure what would happen to open iSCSI TCP connections (would they reduce gracefully). Any other suggestions/tips/etc.? I'd like to make this as transparent as possible, so was hoping to live-migrate VMs and storage. -- Chris Adams <cma(a)cmadams.net>

3 5

Strange Issue with imageio
by Nur Imam Febrianto 16 Apr '21

16 Apr '21

Hi, After upgrading to 4.4.5 from 4.4.4, I’m having a strange issue. Whenever I try to upload something (image or iso) to Storage Domain without clicking Test Connection, upload process wont start. It will shows the file area already uploaded but no upload process. When I try to open the log, seems if I don’t click test connection, it wont open any session in imageio. Upload process will going normally, if I click Test connection first and proceed to upload. Any idea why this is happening ? Don’t have this issue before in 4.4.4. Rebooting the engine doesn’t help either. Regards, Nur Imam Febrianto

1 0

Re: Expand gluster volumes
by David White 16 Apr '21

16 Apr '21

Sorry, I meant to reply-all, to Strahil's most recent message. So I'm doing so now. In addition to my comments below, this StackOverflow thread summarizes what I have in mind: https://stackoverflow.com/questions/43756405/extend-glusterfs-on-top-of-lvm Sent with ProtonMail Secure Email. ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Friday, April 16, 2021 5:33 AM, David White <dmwhite823(a)protonmail.com> wrote: > I don't think I would have the capability to take on the expense of adding two more servers to my environment, on top of the 4th server I already have, right now. > > I realize the following isn't recommended, but would it be possible to, instead, intentionally degrade the gluster cluster by shutting 1 of the hosts down (put it in maintenance mode), add storage, and bring it back online? > > Perhaps that would be a better approach, rather than try to shift things around with a 4th server. > > Sent with ProtonMail Secure Email. > > ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ > On Thursday, April 15, 2021 7:36 PM, Strahil Nikolov hunter86_bg(a)yahoo.com wrote: > > > Gluster allows converting from replicted to distributed-replicated (so called expansion) of the volume. > > Of course you need to add the same amount of bricks as the replica count (which should be either 'replica 3' or 'replica 3 arbiter 1'). > > The Gluster documentation on the topic is quite extensive , but it's worth mentioning that you need to 'rebalance' your cluster after the expansion or you risk filling the old bricks - while having free space on the new bricks. > > That is expected ,as each file/dir's name is hashed and each subvolume (new vs old bricks) will have it's own range of hashes. When you expand the volume, some of the files/dirs on the old bricks have hashes that match to the new "triplet". > > Also , if you do not rebalance - that will have some performance impact as gluster will search the new bricks (for the files' whose hash matches the new subvolume) before searching the old bricks. > > P.S: I think that the Engine's web interface fully supports that operation, although I'm used to the cli. > > Best Regards, > > Strahil Nikolov > > В четвъртък, 15 април 2021 г., 20:05:50 ч. Гринуич+3, David White via Users users(a)ovirt.org написа: > > Is it possible to expand an existing gluster volume? > > I have a hyperconverged environment, and have enough space right now, but I'm going to have to significantly over-provision my environment. The vast majority of our customers are using a small fraction of the amount of space that they are technically allocated, but we still need to make that space available to them. > > As a result, I'd like to plan ahead, and go ahead and have a plan to add storage later down the road. > > I'd like to plan to shut down each server in the cluster (individually, not at once), add storage, and then bring them back online. Once all 3 are back online with the additional storage, I'd like to expand the gluster volume to use the additional space. Is that possible? How? > > Sent with ProtonMail Secure Email. > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/A7C3X2PW4D42G…

2 5

glance repo in 4.3
by Christoph Köhler 16 Apr '21

16 Apr '21

I use ovirt 4.3.10 and need to get access to a glance repo for vm images/templates. The buld-in external provider 'Public Glance repository for oVirt' (glance.ovirt.org) does not work, it seems not to be maintained. Does someone knows what to do? Greetings from Christoph

2 1

ovirt-hosted-engine-cleanup
by Marko Vrgotic 16 Apr '21

16 Apr '21

Dear oVirt, I have three HE Hosts. Upon upgrade from 4.3.5 to 4.3.10 the Hosted Engine did not start anymore on Host2, but working just fine on Host1 and Host3. I tried to Undeploy – Deploy on Host2 but I noticed that hosted-engine.conf contains only ca path and host id. It looks like either Undeploy properly or Deploy is failing due to reason I am unable to find in the logs. When checking the hosted-engine –vm-status, even though undeployed, the output was still containing Host2 in the list. Than I cleaned metadata on the Host1 and 3 for Host2 and at that point it was forgotten. After that I tried adding the Host2 back to HE pool, first installed the Host2 with fresh OS and than added it to Hosts pool with HostedEngine DEPLOY option. Result was the same. The VDSM on the Host2 was showing ERROR: “2021-04-16 06:47:30,422+0000 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA score '[Errno 2] No such file or directory'Is the Hosted Engine setup finished? (api:196)” The broker is showing the error: “MainThread::WARNING::2021-04-16 06:47:27,514::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Atm, I am thinking of executing the /usr/sbin/ovirt-hosted-engine-cleanup but its effect is not clear to me. Is it going to cleanup any HE deploy remains from the Host its executed on, or its going to cleanup the other two Hosts, rendering my platfrom offline? I have been reading through https://www.ovirt.org/images/Hosted-Engine-4.3-deep-dive.pdf but its effect is not clear. I would have tested it already but this issue is on our production platform, so I need some experts input before taking further action. Please advise. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

1 0

Need to change switch... ovirt kvm concerns?
by jpedrolima＠gmail.com 16 Apr '21

16 Apr '21

Hi I need to migrate the switch (equipment change and VLAN implementation) so I ask you to tell me what to do about the ovirt KVM cluster. What procedures and concerns I must have ? best regards, PL

2 4

Moving hosted engine storage
by Chris Adams 16 Apr '21

16 Apr '21

I'm moving a 4.3 cluster to new storage, and I'm down to the hosted engine. I am reading the following: https://www.ovirt.org/documentation/migrating_from_a_standalone_manager_to_… https://www.ovirt.org/develop/developer-guide/engine/migrate-to-hosted-engi… https://lists.ovirt.org/pipermail/users/2017-January/078739.html The last mentions a couple of options added to engine-backup to filter out the old hosted engine parts, but where do I use them? It looks like they only apply during restore, but from the last time I rebuilt the engine (mvoing from CentOS 6 to CentOS 7), I thought I just provided the backup file to hosted-engine --deploy and it handled the restore. Is there a way to pass those options to hosted-engine --deploy, or should I do like the example and just deploy a brand new engine, then log in and manually apply the backup (and filter options) then? Just trying to make sure I understand current (well, current for 4.3) best practice for replacing the hosted engine's storage array (iSCSI in this case, if that matters). -- Chris Adams <cma(a)cmadams.net>

1 1

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Adding screenshot representing the state: [Graphical user interface, text Description automatically generated] ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 23:00 To: users(a)ovirt.org <users(a)ovirt.org> Cc: Yedidyah Bar David <didi(a)redhat.com> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Looking further onto storage part, checking the host which I am unable to re-add to HE Host pool: [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# ls -la total 8 drwxr-xr-x. 3 nobody nobody 4096 Apr 15 20:47 . drwxr-xr-x. 3 vdsm kvm 42 Apr 15 14:30 .. drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 054c43fc-1924-4106-9f80-0f2ac62b9886 -rwxr-xr-x. 1 nobody nobody 0 Feb 18 2020 __DIRECT_IO_TEST__ [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# cd 054c43fc-1924-4106-9f80-0f2ac62b9886/ [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# ls dom_md ha_agent images master [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# cd ha_agent/ [root@ovirt-sj-02 ha_agent]# ls hosted-engine.lockspace hosted-engine.metadata [root@ovirt-sj-02 ha_agent]# cat hosted-engine.lockspace cat: hosted-engine.lockspace: No such file or directory [root@ovirt-sj-02 ha_agent]# ls -la total 16 drwxr-xr-x. 2 nobody nobody 4096 Mar 31 10:30 . drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 .. lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.lockspace -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.metadata -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/16b3e5ac-e70b-46e3-bf81-322954fe0b44/b6326e48-a7d2-4cba-af91-441db9f353c2 [root@ovirt-sj-02 ha_agent]# cat ^C [root@ovirt-sj-02 ha_agent]# cat /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 cat: /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108: No such file or directory It looks like there is still lockspace and metalinks which point to location thatno longer exists – the links are marked with red. The broker.log is showing the following: Main Thread WARNING storage_broker ovirt_hosted_engine_ha.broker.storage_broker.Storage Broker Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' I am starting to think that I need to run the lockspace reinitialization: 1. on each HE host systemctl stop ovirt-ha-agent ovirt-ha-brokersanlock client shutdown -f 1 # carefully, it could trigger the watchdog and reboot 2. on a single hosthosted-engine --reinitialize-lockspace 3. on each HE hostsystemctl start ovirt-ha-agent ovirt-ha-broker Is action 2 required to be executed only on Host with an issue or the action itself is gonna reinitialize lockspace on all HE Hosts? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 16:57 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Looking further onto storage part, checking the host which I am unable to re-add to HE Host pool: [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# ls -la total 8 drwxr-xr-x. 3 nobody nobody 4096 Apr 15 20:47 . drwxr-xr-x. 3 vdsm kvm 42 Apr 15 14:30 .. drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 054c43fc-1924-4106-9f80-0f2ac62b9886 -rwxr-xr-x. 1 nobody nobody 0 Feb 18 2020 __DIRECT_IO_TEST__ [root@ovirt-sj-02 10.210.13.64:_hosted__engine]# cd 054c43fc-1924-4106-9f80-0f2ac62b9886/ [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# ls dom_md ha_agent images master [root@ovirt-sj-02 054c43fc-1924-4106-9f80-0f2ac62b9886]# cd ha_agent/ [root@ovirt-sj-02 ha_agent]# ls hosted-engine.lockspace hosted-engine.metadata [root@ovirt-sj-02 ha_agent]# cat hosted-engine.lockspace cat: hosted-engine.lockspace: No such file or directory [root@ovirt-sj-02 ha_agent]# ls -la total 16 drwxr-xr-x. 2 nobody nobody 4096 Mar 31 10:30 . drwxr-xr-x. 6 nobody nobody 4096 Aug 20 2019 .. lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.lockspace -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 lrwxrwxrwx. 1 nobody nobody 132 Mar 31 10:30 hosted-engine.metadata -> /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/16b3e5ac-e70b-46e3-bf81-322954fe0b44/b6326e48-a7d2-4cba-af91-441db9f353c2 [root@ovirt-sj-02 ha_agent]# cat ^C [root@ovirt-sj-02 ha_agent]# cat /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108 cat: /var/run/vdsm/storage/054c43fc-1924-4106-9f80-0f2ac62b9886/e08188be-f733-4d5c-9222-a4b4e2228955/081f81c5-b2b2-46d5-9f82-9d9041ccc108: No such file or directory It looks like there is still lockspace and metalinks which point to location thatno longer exists – the links are marked with red. The broker.log is showing the following: Main Thread WARNING storage_broker ovirt_hosted_engine_ha.broker.storage_broker.Storage Broker Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' I am starting to think that I need to run the lockspace reinitialization: 1. on each HE host systemctl stop ovirt-ha-agent ovirt-ha-brokersanlock client shutdown -f 1 # carefully, it could trigger the watchdog and reboot 2. on a single hosthosted-engine --reinitialize-lockspace 3. on each HE hostsystemctl start ovirt-ha-agent ovirt-ha-broker Is action 2 required to be executed only on Host with an issue or the action itself is gonna reinitialize lockspace on all HE Hosts? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Thursday, 15 April 2021 at 16:57 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

[ANN] oVirt 4.4.6 Fourth Release Candidate is now available for testing
by Sandro Bonazzola 15 Apr '21

15 Apr '21

oVirt 4.4.6 Fourth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Fourth Release Candidate for testing, as of April 15th, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. Rebase on CentOS Stream Starting with oVirt 4.4.6 RC4 both oVirt Node and oVirt Engine Appliance are based on CentOS Stream. You can still install oVirt 4.4.6 on Red Hat Enterprise Linux, CentOS Linux or equivalent. Please note that when 4.4.6 will be released as generally available, existing oVirt Nodes updating to 4.4.6 will automatically be based on CentOS Stream. Help testing this release candidate will help ensuring a smooth experience for your main installation. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Known issues: - Bug 1946095 <https://bugzilla.redhat.com/show_bug.cgi?id=1946095> - "No valid network interface has been found" when starting HE deployment via cockpit - For testing purposes you can use the command line <https://ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine_us…> Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS 8 Stream * CentOS Linux (or similar) 8.3 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS 8 Stream * CentOS Linux (or similar) 8.3 or newer * oVirt Node 4.4 based on CentOS 8 Stream (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS 8 Stream - oVirt Node NG is already available based on CentOS 8 Stream Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue
by Marko Vrgotic 15 Apr '21

15 Apr '21

Hi Didi, I compared the hosted-engine.conf on all three machines and indeed, host 1 and 3 have identical ones , except hosted. Hosted-engine.conf on host2 that I am trying to add back contains only hostid and ca path: ca_cert=/etc/pki/vdsm/libvirt-spice/ca-cert.pem host_id=2 Can someone help me how to check if there is DB or Storage corruption? Would it be dectructive or risky to try to populate the hosted-engine.conf of host 2 with missing values? Any advices? ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Date: Wednesday, 14 April 2021 at 16:16 To: Yedidyah Bar David <didi(a)redhat.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue Hi Didi, It looks like the issue was with Hosted-engine Undeploy, being incomplete – the other HE Hosts still had the entries of the Host I was trying to remove, so any following HE Deploy on that Host was failing. I was able to get the other hosts to forget about this one, by running hosted-engine –clean-metadate –host-id=2 Now I would like to try to add the host back to HE pool, but I have a question: “Is there a time I should wait, between cleaning metadata and re-adding the host?” Kindly awaiting your reply. ----- kind regards/met vriendelijke groeten Marko Vrgotic Sr. System Engineer @ System Administration ActiveVideo o: +31 (35) 6774131 m: +31 (65) 5734174 e: m.vrgotic(a)activevideo.com<mailto:m.vrgotic@activevideo.com> w: www.activevideo.com<http://www.activevideo.com> ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. From: Yedidyah Bar David <didi(a)redhat.com> Date: Thursday, 18 March 2021 at 15:09 To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> Cc: users(a)ovirt.org <users(a)ovirt.org> Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** Hi, On Mon, Mar 8, 2021 at 4:55 PM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > The broker log, these lines are pretty much repeating: > > > > MainThread::WARNING::2021-03-03 09:19:12,086::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' Please compare the content of /etc/ovirt-hosted-engine/hosted-engine.conf between all your hosts. host id should be unique per host, but otherwise they should be identical. If they are not, most likely there is some corruption somewhere - in the engine db or shared storage. You might want to skim this for a general rather-low-level overview: https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt… Do you see no errors on your other hosts? In -ha logs? Please also note that 4.3 is EOL. The deploy process was completely rewritten in 4.4 (in ansible, previous was python), although should in principle behave similarly - so if your data is corrupted, upgrade to 4.4 probably won't fix it. Good luck and best regards, > > MainThread::INFO::2021-03-03 09:19:12,829::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/sub > > monitors > > MainThread::INFO::2021-03-03 09:19:12,829::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,832::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:12,834::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge > > MainThread::INFO::2021-03-03 09:19:12,835::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain > > MainThread::INFO::2021-03-03 09:19:12,836::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors > > MainThread::WARNING::2021-03-03 09:19:12,836::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be 'None' > > MainThread::INFO::2021-03-03 09:19:13,574::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors > > MainThread::INFO::2021-03-03 09:19:13,575::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load > > MainThread::INFO::2021-03-03 09:19:13,577::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine > > MainThread::INFO::2021-03-03 09:19:13,578::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health > > > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Date: Monday, 8 March 2021 at 15:34 > To: Yedidyah Bar David <didi(a)redhat.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > Hi Didi, > > > > Please find the attached logs from Host and Engine. > > > > Host ovirt-sj-02 HE Undeploy 2021-03-08 14:15:52 till 2021-03-08 14:18:24 > > > > > > Host ovirt-sj-02 HE Deploy 2021-03-08 14:20:51 till 2021-03-08 14:23:22 > > > > I do see errors in the agent and broker and vdsm, but I do not see why it happened. > > > > Thank you for helping, let me know if any additional files are needed. > > > > > > ----- > > kind regards/met vriendelijke groeten > > > > Marko Vrgotic > Sr. System Engineer @ System Administration > > > ActiveVideo > > o: +31 (35) 6774131 > > m: +31 (65) 5734174 > > e: m.vrgotic(a)activevideo.com > w: https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.active… > > > > ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message. > > > > > > > > From: Yedidyah Bar David <didi(a)redhat.com> > Date: Monday, 8 March 2021 at 09:25 > To: Marko Vrgotic <M.Vrgotic(a)activevideo.com> > Cc: users(a)ovirt.org <users(a)ovirt.org> > Subject: Re: [ovirt-users] Re: Upgrade from 4.3.5 to 4.3.10 HE Host issue > > ***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!*** > > Hi, > > On Mon, Mar 8, 2021 at 10:13 AM Marko Vrgotic <M.Vrgotic(a)activevideo.com> wrote: > > > > I cannot find the reason why the re-Deployment on this Hosts fails, as it was already deployed on it before. > > > > No errors, found int the deployment, but it seems half done, based on messages I sent in previous email. > > Please check/share all relevant logs. Thanks. Can be all of /var/log > from engine and hosts, and at least: > > /var/log/ovirt-engine/engine.log > > /var/log/vdsm/* > > /var/log/ovirt-hosted-engine-ha/* > > Best regards, > -- > Didi -- Didi

1 0

Failed certificate expiration
by Fabrice Bacchella 15 Apr '21

15 Apr '21

I missed the certificate expiration for the oVirt PKI. So the engine is now totally unable to talk to the hosts. Is there any documentation for this kind of failure recovery ?

1 0

hosted-engine volume removed 3 bricks (replica 3) out of 12 bricks, now I cant start hosted-engine vm
by adrianquintero＠gmail.com 15 Apr '21

15 Apr '21

Hi, I tried removing a replica 3 brick from a distributed replicated volume which holds the ovirt hosted-engine VM. As soon as I hit commit the VM went into pause, I tried to recover the volume ID "daa292aa-be5c-426e-b124-64263bf8a3ee" from the remvoed bricks and now I am able to do a "hosted-engine --vm-status Error I see in the logs: --------------------------------- MainThread::WARNING::2021-04-14 17:26:12,348::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: Command Image.prepare with args {'imageID': '9feffcfa-6af2-4de3-b7d8-e57b84d56003', 'storagepoolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'daa292aa-be5c-426e-b124-64263bf8a3ee', 'storagedomainID': '8db17b28-ecbb-4853-8a90-6ed2f69301eb'} failed: (code=201, message=Volume does not exist: (u'daa292aa-be5c-426e-b124-64263bf8a3ee',)) --------------------------------- on the following mount I see the volumeID twice: ------------------------ [root@vmm10 images]# find /rhev/data-center/mnt/glusterSD/192.168.0.4\:_engine/ -name "daa292aa-be5c-426e-b124-64263bf8a3ee" /rhev/data-center/mnt/glusterSD/192.168.0.4:_engine/8db17b28-ecbb-4853-8a90-6ed2f69301eb/images/9feffcfa-6af2-4de3-b7d8-e57b84d56003/daa292aa-be5c-426e-b124-64263bf8a3ee /rhev/data-center/mnt/glusterSD/192.168.0.4:_engine/8db17b28-ecbb-4853-8a90-6ed2f69301eb/images/9feffcfa-6af2-4de3-b7d8-e57b84d56003/daa292aa-be5c-426e-b124-64263bf8a3ee [root@vmm10 9feffcfa-6af2-4de3-b7d8-e57b84d56003]# ls -lh total 131M -rw-rw----. 1 vdsm kvm 64M Apr 14 19:40 daa292aa-be5c-426e-b124-64263bf8a3ee -rw-rw----. 1 vdsm kvm 64M Apr 14 19:40 daa292aa-be5c-426e-b124-64263bf8a3ee -rw-rw----. 1 vdsm kvm 1.0M Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.lease -rw-rw----. 1 vdsm kvm 1.0M Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.lease -rw-r--r--. 1 vdsm kvm 329 Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.meta -rw-r--r--. 1 vdsm kvm 329 Jul 1 2020 daa292aa-be5c-426e-b124-64263bf8a3ee.meta Any ideas on how to recover ?

1 0

Can't Create VM from Template in VM portal
by Andrey Rusakov 14 Apr '21

14 Apr '21

We are trying to orginize self manage VM portal for our customers. And there is VM portal in oVirt. What did we do - Create user, Crate group, create quota, create Vm template. All permissions by default + VmCreator (to allow user create disks from template). Problem Can't Create VM from Template - we got "No Disks Defined" on "Storage" page (create new VM) Posible solution - Grant "Disk Operator" Role, But in this case, All users can see All VMs. Is it posible to limit users to see VMs in a users group and permissions to create new VMs from template?

1 0

Ovirt node - 4.4.4 -> 4.4.5 upgrade failed - do i need a reinstall ? tried removing /dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 to reinstall rpm..
by morgan cox 14 Apr '21

14 Apr '21

Hi. I have a 2 node cluster (both installed from the Ovirt-node iso) , 1 server is 100% fine, but one server I tried to update when there were issues with the ovirtmgmt network (I wasn't aware of at the time) - as a result the server update failed, and was still on ovirt-node 4.4.4 after - I could see the LVM layer for 4.4.5 though. The network is fine now (hence the other server being ok) - I tried reinstalling the package ovirt-node-ng-image-update-4.4.5.1-1.el8.noarch.rpm but it failed due to LVM lv for 4.4.5 already existing ... So I tried removing the LV - i.e # lvremove /dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 however now I'm sure I have less 4.4.4 lvs .. i.e ------ [root@ng2-ovirt-kvm3 mcox]# lvs LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert home onn Vwi-aotz-- 1.00g pool00 10.05 ovirt-node-ng-4.4.4.1-0.20210208.0+1 onn Vwi-aotz-- 191.00g pool00 2.27 pool00 onn twi-aotz-- 218.00g 2.48 1.92 swap onn -wi-ao---- 4.00g tmp onn Vwi-aotz-- 1.00g pool00 2.24 var onn Vwi-aotz-- 15.00g pool00 2.80 var_crash onn Vwi-aotz-- 10.00g pool00 0.21 var_log onn Vwi-aotz-- 8.00g pool00 5.97 var_log_audit onn Vwi-aotz-- 2.00g pool00 1.14 ---- Where as on the working server I have these Ovirt Node LVs ovirt-node-ng-4.4.4.1-0.20210208.0 onn Vwi---tz-k 191.00g pool00 root ovirt-node-ng-4.4.4.1-0.20210208.0+1 onn Vwi-a-tz-- 191.00g pool00 ovirt-node-ng-4.4.4.1-0.20210208.0 1.86 ovirt-node-ng-4.4.5.1-0.20210323.0 onn Vri---tz-k 191.00g pool00 ovirt-node-ng-4.4.5.1-0.20210323.0+1 onn Vwi-aotz-- 191.00g pool00 ovirt-node-ng-4.4.5.1-0.20210323.0 1.58 Anyway I tried to reinstall the ovirt-node-ng-image-update-4.4.5.1-1.el8.noarch.rpm package after removal of lv and files in /boot But install still fails .. Is there anything I can do to update this node - or should I bite the bullet and reinstall ? this is from /var/log/imgbased.log -> -------------------------------------- 2021-04-14 16:05:56,634 [INFO] (MainThread) Adding a new layer after <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [INFO] (MainThread) Adding a new layer after <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Basing new layer on previous: <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Finding next layer based on <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] /> 2021-04-14 16:05:56,634 [DEBUG] (MainThread) Suggesting for layer for base ovirt-node-ng-4.4.5.1-0.20210323.0 2021-04-14 16:05:56,635 [DEBUG] (MainThread) ... without layers 2021-04-14 16:05:56,635 [INFO] (MainThread) New layer will be: <Layer ovirt-node-ng-4.4.5.1-0.20210323.0+1 /> 2021-04-14 16:05:56,635 [DEBUG] (MainThread) Calling: (['vgs', '--noheadings', '--ignoreskippedcluster', '--select', 'vg_tags = imgbased:vg', '-o', 'vg_name'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,697 [DEBUG] (MainThread) Returned: b'onn' 2021-04-14 16:05:56,698 [DEBUG] (MainThread) Calling: (['vgs', '--noheadings', '--ignoreskippedcluster', '@imgbased:pool', '-o', 'lv_full_name'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,757 [DEBUG] (MainThread) Returned: b'onn/pool00' 2021-04-14 16:05:56,758 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '--nosuffix', '--units', 'm', '-o', 'metadata_percent,lv_metadata_size', 'onn/pool00'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,829 [DEBUG] (MainThread) Returned: b'2.05 1024.00' 2021-04-14 16:05:56,830 [DEBUG] (MainThread) Pool: onn/pool00, metadata size=1024.0M (2.05%) 2021-04-14 16:05:56,830 [DEBUG] (MainThread) Calling: (['lvchange', '--activate', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0', '--ignoreactivationskip'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:56,953 [DEBUG] (MainThread) Calling: (['lvcreate', '--snapshot', '--name', 'ovirt-node-ng-4.4.5.1-0.20210323.0+1', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,111 [DEBUG] (MainThread) Returned: b'WARNING: Sum of all thin volume sizes (610.00 GiB) exceeds the size of thin pool onn/pool00 and the size of whole volume group (<277.78 GiB).\n Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0+1" created.' 2021-04-14 16:05:57,112 [DEBUG] (MainThread) Calling: (['lvchange', '--activate', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1', '--ignoreactivationskip'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,231 [DEBUG] (MainThread) Calling: (['lvchange', '--addtag', 'imgbased:layer', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,310 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 changed.' 2021-04-14 16:05:57,311 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:57,383 [DEBUG] (MainThread) Returned: b'/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' 2021-04-14 16:05:57,400 [DEBUG] (MainThread) Calling: (['mktemp', '-d', '--tmpdir', 'mnt.XXXXX'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,404 [DEBUG] (MainThread) Returned: b'/tmp/mnt.aGJ3A' 2021-04-14 16:05:57,404 [DEBUG] (MainThread) Calling: (['mount', '-onouuid', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,537 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,561 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.aGJ3A'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:57,565 [DEBUG] (MainThread) Running: ['xfs_admin', '-U', 'generate', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:05:57,566 [DEBUG] (MainThread) Calling: (['xfs_admin', '-U', 'generate', '/dev/onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': -2, 'close_fds': True} 2021-04-14 16:05:57,957 [DEBUG] (MainThread) Calling: (['lvchange', '--setactivationskip', 'n', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:58,040 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1 changed.' 2021-04-14 16:05:58,041 [DEBUG] (MainThread) Calling: (['lvchange', '--setactivationskip', 'y', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:05:58,116 [DEBUG] (MainThread) Returned: b'Logical volume onn/ovirt-node-ng-4.4.5.1-0.20210323.0 changed.' 2021-04-14 16:05:58,117 [DEBUG] (MainThread) Got: <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' /> and <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' /> 2021-04-14 16:05:58,117 [DEBUG] (MainThread) Calling: (['mount', '--make-rprivate', '/var'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:58,122 [DEBUG] (MainThread) Calling: (['systemctl', 'is-active', 'vdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:05:58,141 [DEBUG] (MainThread) Returned: b'active' 2021-04-14 16:05:58,141 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'vdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:08,940 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'supervdsmd'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,072 [DEBUG] (MainThread) Calling: (['systemctl', 'stop', 'vdsm-network'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,090 [DEBUG] (MainThread) Calling: (['vgchange', '-ay', '--select', 'vg_tags = imgbased:vg'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,167 [DEBUG] (MainThread) Returned: b'11 logical volume(s) in volume group "onn" now active' 2021-04-14 16:06:09,168 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-o', 'lv_full_name', '--select', 'lv_tags = imgbased:base || lv_tags = imgbased:layer'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,229 [DEBUG] (MainThread) Returned: b'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1\n onn/ovirt-node-ng-4.4.5.1-0.20210323.0 \n onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' 2021-04-14 16:06:09,230 [DEBUG] (MainThread) All LV names: ['onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:06:09,230 [DEBUG] (MainThread) All LVS: [<LV 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' />] 2021-04-14 16:06:09,230 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,293 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,294 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,357 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,358 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,417 [DEBUG] (MainThread) Returned: b'imgbased:base' 2021-04-14 16:06:09,418 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,490 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,491 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_tags', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,557 [DEBUG] (MainThread) Returned: b'imgbased:layer' 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Our LVS: [<LV 'onn/ovirt-node-ng-4.4.4.1-0.20210208.0+1' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0' />, <LV 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1' />] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Names: ['ovirt-node-ng-4.4.4.1-0.20210208.0+1', 'ovirt-node-ng-4.4.5.1-0.20210323.0', 'ovirt-node-ng-4.4.5.1-0.20210323.0+1'] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Images: [<Layer ovirt-node-ng-4.4.4.1-0.20210208.0+1 />, <Base ovirt-node-ng-4.4.5.1-0.20210323.0 [] />, <Layer ovirt-node-ng-4.4.5.1-0.20210323.0+1 />] 2021-04-14 16:06:09,558 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.o5bFp'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,579 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.o5bFp'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,583 [DEBUG] (MainThread) Calling: (['umount', '-l', '/tmp/mnt.CcHrE'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,601 [DEBUG] (MainThread) Calling: (['rmdir', '/tmp/mnt.CcHrE'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,605 [ERROR] (MainThread) Update failed, resetting registered LVs 2021-04-14 16:06:09,606 [DEBUG] (MainThread) Calling: (['sync'],) {'close_fds': True, 'stderr': -2} 2021-04-14 16:06:09,615 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_dm_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,683 [DEBUG] (MainThread) Returned: b'/dev/mapper/onn-ovirt--node--ng--4.4.5.1--0.20210323.0' 2021-04-14 16:06:09,684 [DEBUG] (MainThread) Calling: (['lvremove', '-ff', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,820 [DEBUG] (MainThread) Returned: b'Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0" successfully removed' 2021-04-14 16:06:09,821 [DEBUG] (MainThread) Calling: (['lvs', '--noheadings', '--ignoreskippedcluster', '-olv_dm_path', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:09,886 [DEBUG] (MainThread) Returned: b'/dev/mapper/onn-ovirt--node--ng--4.4.5.1--0.20210323.0+1' 2021-04-14 16:06:09,887 [DEBUG] (MainThread) Calling: (['lvremove', '-ff', 'onn/ovirt-node-ng-4.4.5.1-0.20210323.0+1'],) {'stderr': <_io.TextIOWrapper name='/dev/null' mode='w' encoding='UTF-8'>, 'close_fds': True} 2021-04-14 16:06:10,207 [DEBUG] (MainThread) Returned: b'Logical volume "ovirt-node-ng-4.4.5.1-0.20210323.0+1" successfully removed' Traceback (most recent call last): File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code exec(code, run_globals) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/__main__.py", line 53, in <module> CliApplication() File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/__init__.py", line 82, in CliApplication app.hooks.emit("post-arg-parse", args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/hooks.py", line 120, in emit cb(self.context, *args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 75, in post_argparse six.reraise(*exc_info) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/six.py", line 703, in reraise raise value File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 66, in post_argparse base, _ = LiveimgExtractor(app.imgbase).extract(args.FILENAME) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 148, in extract "%s" % size, nvr) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/update.py", line 128, in add_base_with_tree new_layer_lv = self.imgbase.add_layer(new_base) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/imgbase.py", line 213, in add_layer self.hooks.emit("new-layer-added", prev_lv, new_lv) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/hooks.py", line 120, in emit cb(self.context, *args) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/osupdater.py", line 88, in on_new_layer previous_layer_lv = get_prev_layer_lv(imgbase, new_lv) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/plugins/osupdater.py", line 143, in get_prev_layer_lv layer_before = imgbase.naming.layer_before(new_layer) File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 74, in layer_before layers = self.layers() File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 58, in layers for b in self.tree(): File "/tmp/tmp.cyXrOTxRgb/usr/lib/python3.6/site-packages/imgbased/naming.py", line 226, in tree bases[img.base.nvr].layers.append(img) KeyError: <NVR ovirt-node-ng-4.4.4.1-0.20210208.0 /> --------------------

1 0