- Users - oVirt List Archives

VMs shutdown mysteriously
by Bobby 01 Jul '20

01 Jul '20

Hello, All 4 VMs on one of my oVirt cluster node shutdown for an unknown reason almost simultaneously. Please help me to find the root cause. Thanks. Please note the host seems doing fine and never crash or hangs and I can migrate VMs back to it later. Here is the exact timeline of all the related events combined from the host and the VM(s): On oVirt host: /var/log/vdsm/vdsm.log: 2020-06-25 15:25:16,944-0500 WARN (qgapoller/3) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7f4ed2f9f5f0> on ['e0257b06-28fd-4d41-83a9-adf1904d3622'] (periodic:289) 2020-06-25 15:25:19,203-0500 WARN (libvirt/events) [root] File: /var/lib/libvirt/qemu/channels/e0257b06-28fd-4d41-83a9-adf1904d3622.ovirt-guest-agent.0 already removed (fileutils:54) 2020-06-25 15:25:19,203-0500 WARN (libvirt/events) [root] File: /var/lib/libvirt/qemu/channels/e0257b06-28fd-4d41-83a9-adf1904d3622.org.qemu.guest_agent.0 already removed (fileutils:54) [root@athos log]# journalctl -u NetworkManager --since=today -- Logs begin at Wed 2020-05-20 22:07:33 CDT, end at Thu 2020-06-25 16:36:05 CDT. -- Jun 25 15:25:18 athos NetworkManager[1600]: <info> [1593116718.1136] device (vnet0): state change: disconnected -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Jun 25 15:25:18 athos NetworkManager[1600]: <info> [1593116718.1146] device (vnet0): released from master device SRV-VL /var/log/messages: Jun 25 15:25:18 athos kernel: SRV-VL: port 2(vnet0) entered disabled state Jun 25 15:25:18 athos NetworkManager[1600]: <info> [1593116718.1136] device (vnet0): state change: disconnected -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Jun 25 15:25:18 athos NetworkManager[1600]: <info> [1593116718.1146] device (vnet0): released from master device SRV-VL Jun 25 15:25:18 athos libvirtd: 2020-06-25 20:25:18.122+0000: 2713: error : qemuMonitorIO:718 : internal error: End of file from qemu monitor /var/log/libvirt/qemu/aries.log: 2020-06-25T20:25:28.353975Z qemu-kvm: terminating on signal 15 from pid 2713 (/usr/sbin/libvirtd) 2020-06-25 20:25:28.584+0000: shutting down, reason=shutdown ============================================================================================= On the first VM effected (same thing on others): /var/log/ovirt-guest-agent/ovirt-guest-agent.log: MainThread::INFO::2020-06-25 15:25:20,270::ovirt-guest-agent::104::root::Stopping oVirt guest agent CredServer::INFO::2020-06-25 15:25:20,626::CredServer::262::root::CredServer has stopped. MainThread::INFO::2020-06-25 15:25:21,150::ovirt-guest-agent::78::root::oVirt guest agent is down. ============================================================================================= Packages version installated: Host OS version: CentOS 7.7.1908: ovirt-hosted-engine-ha-2.3.5-1.el7.noarch ovirt-provider-ovn-driver-1.2.22-1.el7.noarch ovirt-release43-4.3.6-1.el7.noarch ovirt-imageio-daemon-1.5.2-0.el7.noarch ovirt-vmconsole-1.0.7-2.el7.noarch ovirt-imageio-common-1.5.2-0.el7.x86_64 ovirt-engine-sdk-python-3.6.9.1-1.el7.noarch ovirt-vmconsole-host-1.0.7-2.el7.noarch ovirt-host-4.3.4-1.el7.x86_64 libvirt-4.5.0-23.el7_7.1.x86_64 libvirt-daemon-4.5.0-23.el7_7.1.x86_6 qemu-kvm-ev-2.12.0-33.1.el7.x86_64 qemu-kvm-common-ev-2.12.0-33.1.el7.x86_64 On guest VM: ovirt-guest-agent-1.0.13-1.el6.noarch qemu-guest-agent-0.12.1.2-2.491.el6_8.3.x86_64

4 4

Re: Some nodes periodically display as Non Responsive
by Martin Perina 01 Jul '20

01 Jul '20

Hi Anton, to diagnose the issue we would need to have logs from both engine and affected host. Regards, Martin On Wed, Jul 1, 2020 at 6:51 AM Anton Louw via Users <users(a)ovirt.org> wrote: > > > Hi Everybody, > > > > I am got some strange things happening. I have got two data centers, DC1 > and DC2, in DC1, some of my nodes (Not all the time and not all the nodes) > go into a “not responding” state. I can still ping the hosts, and I can > still access the VMs on the hosts. My Engine sits in DC2, and this does not > happen to any of the hosts in DC2. > > > > It seems like the Engine loses connectivity to the hosts in DC1, and then > cannot re-establish the connection. > > > > Is there anywhere I can check to get more insight into what is actually > happening? > > > > Thanks > > > > *Anton Louw* > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > [image: F] <https://www.facebook.com/voxtelecomZA> > [image: T] <https://www.twitter.com/voxtelecom> > [image: I] <https://www.instagram.com/voxtelecomza/> > [image: L] <https://www.linkedin.com/company/voxtelecom> > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > [image: #VoxBrand] > <https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> > *Disclaimer* > > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal > nature, they are subject to copyright in favour of the holding company of > the Vox group of companies. Any recipient who receives this email in error > should immediately report the error to the sender and permanently delete > this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by *Mimecast Ltd*, an innovator in Software as a > Service (SaaS) for business. Providing a *safer* and *more useful* place > for your human generated data. Specializing in; Security, archiving and > compliance. To find out more Click Here > <https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>. > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/TRMWV4Q6AFHG5… > -- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

1 0

Some nodes periodically display as Non Responsive
by Anton Louw 01 Jul '20

01 Jul '20

Hi Everybody, I am got some strange things happening. I have got two data centers, DC1 and DC2, in DC1, some of my nodes (Not all the time and not all the nodes) go into a "not responding" state. I can still ping the hosts, and I can still access the VMs on the hosts. My Engine sits in DC2, and this does not happen to any of the hosts in DC2. It seems like the Engine loses connectivity to the hosts in DC1, and then cannot re-establish the connection. Is there anywhere I can check to get more insight into what is actually happening? Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

status of oVirt 4.4.x and CentOS 8.2
by Gianluca Cecchi 01 Jul '20

01 Jul '20

Hello, what is the current status both if using plain CentOS based nodes and ovirt-node-ng? Do the release of CentOS 8.2 impact new installation for 4.4.0 and/or 4.4.1rc? Thanks, Gianluca

5 8

Localdisk hook not working
by tim-nospam＠bordemann.com 30 Jun '20

30 Jun '20

Hi, I'd like to use the localdisk hook of vdsm and have configured everything according to the readme: https://github.com/oVirt/vdsm/tree/master/vdsm_hooks/localdisk After installing the hook, configuring the ovirt-engine, creating the volume group, adding the custom property 'localdisk' to the virtual machine and fixing a small bug in the localdisk-helper, vdsm creates the logical volume on the 'ovirt-local' volume group after starting the virtual machine. Unfortunately nothing more seems to happen then. There is no activity on the NAS which would indicate that the disk image is pulled to the host. I can also see no errors on the host. Is anyone currently running ovirt 4.4 with the localdisk hook? What else can I do to find out why the image is not being copied to my host? Thanks, Tim

2 2

Re: VDSM not binding on IPv4 after ovirt-engine restart
by Dominik Holler 30 Jun '20

30 Jun '20

On Tue, Jun 30, 2020 at 6:13 PM Erez Zarum <erezz(a)nanosek.com> wrote: > While troubleshooting a fresh installation of (after a failed one) that > caused all the hosts but the one running the hosted-engine to become in > “Unassigned” state I noticed that the ovirt-engine complains about not > being able to contact the VDSM. > I noticed that VDSM has stopped listening on IPv4. > > Thanks for sharing the details. > I didn’t disable any IPv6 as it states not to disable it on hosts that are > capable running the hosted-engine and it seems that the reason behind it > is that the hosted-engine talks to the host it runs on through “localhost”, > this also explains why the host which the hosted-engine runs on is “OK”. > > Below is from a host that does not run the hosted-engine: > # ss -atn | grep 543 > LISTEN 0 5 *:54322 *:* > ESTAB 0 0 127.0.0.1:54792 127.0.0.1:54321 > ESTAB 0 0 127.0.0.1:54798 127.0.0.1:54321 > LISTEN 0 5 [::]:54321 [::]:* > ESTAB 0 0 [::ffff:127.0.0.1]:54321 > [::ffff:127.0.0.1]:54798 > ESTAB 0 0 [::ffff:127.0.0.1]:54321 > [::ffff:127.0.0.1]:54792 > ESTAB 0 0 [::1]:54321 [::1]:50238 > ESTAB 0 0 [::1]:50238 [::1]:54321 > > Below is from a host that runs the hosted-engine at the moment: > # ss -atn | grep 543 > LISTEN 0 5 *:54322 *:* > LISTEN 0 5 [::]:54321 [::]:* > ESTAB 0 0 [::1]:51230 [::1]:54321 > ESTAB 0 0 [::1]:54321 [::1]:51242 > ESTAB 0 0 [::ffff:10.46.20.23]:54321 > [::ffff:10.46.20.20]:45706 > ESTAB 0 0 [::ffff:10.46.20.23]:54321 > [::ffff:10.46.20.20]:45746 > ESTAB 0 0 [::1]:51240 [::1]:54321 > ESTAB 0 0 [::1]:54321 [::1]:51230 > ESTAB 0 0 [::1]:51242 [::1]:54321 > ESTAB 0 0 [::1]:54321 [::1]:51240 > > The hosted-engine IP is 10.46.20.20 and the host is 10.46.20.23. > > Why do you think the host does not listen to IPv4 anymore? Can you please share the output of "nc -vz 10.46.20.23 54321" executed on engine VM or another host? > /etc/hosts on all hosts: > 127.0.0.1 localhost localhost.localdomain localhost4 > localhost4.localdomain4 > ::1 localhost localhost.localdomain localhost6 > localhost6.localdomain6 > > Perhaps this is relevant but all hosts are enrolled into IDM (FreeIPA) and > as an outcome they all have a DNS record and a PTR record as well as the > ovirt-engine VM. > > # cat /etc/vdsm/vdsm.conf > [vars] > ssl = true > ssl_ciphers = HIGH:!aNULL > ssl_excludes = OP_NO_TLSv1,OP_NO_TLSv1_1 > > [addresses] > management_port = 54321 > > I have tried adding “management_ip = 0.0.0.0” but then it only binds to > IPv4 and yet, the host still shows as Unassigned, sometimes it switches to > “NonResponsive” and trying to “Reinstall” the host fails, the ovirt-engine > complains it can't contact/reach the VDSM, while using netcat from the > ovirt-engine it works. > > I have KSM and Memory Ballooning enabled on the Cluster as well. > > oVirt 4.3.10 installed on CentOS 7.8.2003 > The self-hosted Engine runs on an external GlusterFS, before reinstalling > everything (fresh start of OS, etc..) I tried iSCSI as well. > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/NCTWZLS2VPIAB… >

2 1

VDSM not binding on IPv4 after ovirt-engine restart
by Erez Zarum 30 Jun '20

30 Jun '20

While troubleshooting a fresh installation of (after a failed one) that caused all the hosts but the one running the hosted-engine to become in “Unassigned” state I noticed that the ovirt-engine complains about not being able to contact the VDSM. I noticed that VDSM has stopped listening on IPv4. I didn’t disable any IPv6 as it states not to disable it on hosts that are capable running the hosted-engine and it seems that the reason behind it is that the hosted-engine talks to the host it runs on through “localhost”, this also explains why the host which the hosted-engine runs on is “OK”. Below is from a host that does not run the hosted-engine: # ss -atn | grep 543 LISTEN 0 5 *:54322 *:* ESTAB 0 0 127.0.0.1:54792 127.0.0.1:54321 ESTAB 0 0 127.0.0.1:54798 127.0.0.1:54321 LISTEN 0 5 [::]:54321 [::]:* ESTAB 0 0 [::ffff:127.0.0.1]:54321 [::ffff:127.0.0.1]:54798 ESTAB 0 0 [::ffff:127.0.0.1]:54321 [::ffff:127.0.0.1]:54792 ESTAB 0 0 [::1]:54321 [::1]:50238 ESTAB 0 0 [::1]:50238 [::1]:54321 Below is from a host that runs the hosted-engine at the moment: # ss -atn | grep 543 LISTEN 0 5 *:54322 *:* LISTEN 0 5 [::]:54321 [::]:* ESTAB 0 0 [::1]:51230 [::1]:54321 ESTAB 0 0 [::1]:54321 [::1]:51242 ESTAB 0 0 [::ffff:10.46.20.23]:54321 [::ffff:10.46.20.20]:45706 ESTAB 0 0 [::ffff:10.46.20.23]:54321 [::ffff:10.46.20.20]:45746 ESTAB 0 0 [::1]:51240 [::1]:54321 ESTAB 0 0 [::1]:54321 [::1]:51230 ESTAB 0 0 [::1]:51242 [::1]:54321 ESTAB 0 0 [::1]:54321 [::1]:51240 The hosted-engine IP is 10.46.20.20 and the host is 10.46.20.23. /etc/hosts on all hosts: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 Perhaps this is relevant but all hosts are enrolled into IDM (FreeIPA) and as an outcome they all have a DNS record and a PTR record as well as the ovirt-engine VM. # cat /etc/vdsm/vdsm.conf [vars] ssl = true ssl_ciphers = HIGH:!aNULL ssl_excludes = OP_NO_TLSv1,OP_NO_TLSv1_1 [addresses] management_port = 54321 I have tried adding “management_ip = 0.0.0.0” but then it only binds to IPv4 and yet, the host still shows as Unassigned, sometimes it switches to “NonResponsive” and trying to “Reinstall” the host fails, the ovirt-engine complains it can't contact/reach the VDSM, while using netcat from the ovirt-engine it works. I have KSM and Memory Ballooning enabled on the Cluster as well. oVirt 4.3.10 installed on CentOS 7.8.2003 The self-hosted Engine runs on an external GlusterFS, before reinstalling everything (fresh start of OS, etc..) I tried iSCSI as well.

1 0

4.4.1-rc5: Looking for correct way to configure machine=q35 instead of machine=pc for arch=x86_64
by Glenn Marcy 30 Jun '20

30 Jun '20

Hello, I am hoping for some insight from folks with more hosted engine install experience. When I try to install the hosted engine using the RC5 dist I get the following error during the startup of the HostedEngine VM: XML error: The PCI controller with index='0' must be model='pci-root' for this machine type, but model='pcie-root' was found instead This is due to the HE Domain XML description using machine="pc-i440fx-rhel7.6.0". I've tried to override the default of 'pc' from ovirt-ansible-hosted-engine-setup/defaults/main.yml: he_emulated_machine: pc by passing to the ovirt-hosted-engine-setup script a --config-append=file parameter where file contains: [environment:default] OVEHOSTED_VM/emulatedMachine=str:q35 When the "Create ovirt-hosted-engine-ha run directory" step finishes the vm.conf file contains: cpuType=IvyBridge,+pcid,+spec-ctrl,+ssbd,+md-clear emulatedMachine=q35 At the "Start ovirt-ha-broker service on the host" step that file is removed. When that file appears again during the "Check engine VM health" step it now contains: cpuType=IvyBridge,+pcid,+spec-ctrl,+ssbd,+md-clear emulatedMachine=pc-i440fx-rhel7.6.0 After that the install fails with the metadata from "virsh dumpxml HostedEngine" containing: <ovirt-vm:exitCode type="int">1</ovirt-vm:exitCode> <ovirt-vm:exitMessage>XML error: The PCI controller with index='0' must be model='pci-root' for this machine type, but model='pcie-root' was found instead</ovirt-vm:exitMessage> Interestingly enough, the HostedEngineLocal VM that is running the appliance image has the value I need: <type arch='x86_64' machine='pc-q35-rhel8.2.0'>hvm</type> Does anyone on the list have any experience with where this needs to be overridden? Somewhere in the hosted engine setup or do I need to do something at a deeper level like vdsm or libvirt? Help much appreciated ! Thanks, Glenn

2 3

vdsm error every hour
by eevans＠digitaldatatechs.com 29 Jun '20

29 Jun '20

In the web ui I get an error about every hour: VDSM command SetVolumeDescriptionVDS failed: Volume does not exist: (u'e3f79840-8355-45b0-ad2b-440c877be637',) I looked in storage and disks and this disk does not exist. Its more of an annoyance than a problem but if there is way to get rid of this error I would like to know. My research says I can install vdsm-tools and vdsm-cli but vdsm-cli is not available and I really don;t want to install anything until I know it's what I need. Is there a vdsm command to purge a missing disk so this error won't show up? Thanks in advance. Eric

2 1

Error with Imported VM Run
by Ian Easter 29 Jun '20

29 Jun '20

I imported an orphaned Storage Domain into a new oVirt instance (4.4) and imported the VMs that were found in that storage domain. The SD was previously attached to, 4.2/4.3 instance of oVirt and I did not see any errors about the imports. However, when I attempt to run these VMs, I see this error in the engine.log: ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-51848) [d56a3ce0-7139-4173-bcdb-d5bd4d9378fa] EVENT_ID: USER_FAILED_RUN_VM(54), Failed to run VM mtl-portal-01 (User: admin@internal-authz). As best as I can tell, this is a vdsm version issue... So what are my options to resolve this? Should I go through the steps to build out an older oVirt release and then attach the SD to that instance and work through the migration? Can I manually update the VM to work with the newer vdsm version? *Thank you,* *Ian Easter*

2 2

NVMe-oF
by Daniel Menzel 29 Jun '20

29 Jun '20

Hi all, does anybody know whether NVMe-over-Fabrics support is somehow scheduled in oVirt? As, from a logical point of view, it is like iSCSI on steroids, I guess it shouldn't be too hard to implement it. Yep, I know, bold statement from someone who isn't a programmer. ;-) Nonetheless: Are there plans to implement NVMe-oF as storage backend for oVirt in the near future? If so: Is there a way to help (i.e. with hardware ressources)? Kind regards, Daniel -- Daniel Menzel Geschäftsführer Menzel IT GmbH Charlottenburger Str. 33a 13086 Berlin +49 (0) 30 / 5130 444 - 00 daniel.menzel(a)menzel-it.net https://menzel-it.net Geschäftsführer: Daniel Menzel, Josefin Menzel Unternehmenssitz: Berlin Handelsregister: Amtsgericht Charlottenburg Handelsregister-Nummer: HRB 149835 B USt-ID: DE 309 226 751

2 2

oVirt 2020 online conference
by Sandro Bonazzola 29 Jun '20

29 Jun '20

It is our pleasure to invite you to oVirt 2020 online conference. The conference,organized by oVirt community, will take place online on Monday, September 7th 2020! oVirt 2020 is a free conference for oVirt community project users and contributors coming to a web browser near you! There is no admission or ticket charge for this event. However, you will be required to complete a free registration. Watch https://blogs.ovirt.org/ovirt-2020-online-conference/ for updates about registration. Talks, presentations and workshops will all be in English. We encourage students and new graduates as well as professionals to submit proposals to oVirt conferences. We will be looking for talks and discussions across virtualization, and how oVirt 4.4 can effectively solve user issues around: - Upgrade flows - New features - Integration with other projects - User stories The deadline to submit abstracts is July 26th 2020. To submit your abstract, please click on the following link: submission form <https://forms.gle/1RDUwPGKobJfKhaYA> More information are available at https://blogs.ovirt.org/ovirt-2020-online-conference/ Thanks, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*

1 0

Re: VDSM can't see StoragePool
by Strahil Nikolov 28 Jun '20

28 Jun '20

Can you set one of the Hypervisours into maintenance and use the "reinstall" option from the UI ? Best Regards, Strahil Nikolov На 25 юни 2020 г. 13:24:26 GMT+03:00, Erez Zarum <erezz(a)nanosek.com> написа: >I have a Self-hosted Engine running on iSCSI as well as couple of >Storage domains using iSCSI, both the SE and those Storage Domains uses >the same target portals (two). >I can see the iSCSI sessions and multipath working well from the Host >point of view. >Yesterday after doing a restart for the “ovirt-engine” all the hosts >besides the one that runs the SE and the SPM went into “Unassigned” >mode with an error stating the ovirt-engine can’t communicate with the >hosts. >Network wise, everything is good, I can reach all the ports, all the >network is well configured, so I ruled this. >Looking at the VDSM logs on those “Unassigned” hosts it looks like the >VDSM can’t find the Storage Pool. > >(vmrecovery) [vdsm.api] START >getConnectedStoragePoolsList(options=None) from=internal, >task_id=217ec32b-591c-4376-8dc0-8d62200557ee (api:48) >(vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList >return={'poollist': []} from=internal, >task_id=217ec32b-591c-4376-8dc0-8d62200557ee (api:54) >(vmrecovery) [vds] recovery: waiting for storage pool to go up >(clientIF:723) > >If I look at the VDSM logs on the host where the SE and SPM is running, >no issues there and the node appears up (green) in the ovirt-engine UI. > >I managed to set the hosted-engine to maintenance, shut it down and >then start it again on another Host, when it starts on that Host, the >host goes “green” and if the SPM stays on the previous host, I have two >hosts working and the rest remains “Unassigned”. > >All the “ovirt-ha-agent”/”ovirt-ha-broker” services seems ok, I >restarted them, I also tried to restart the VDSM on the hosts with no >luck. >I have the VMs still running, I did shutdown one host (even used the >“SSH restart” from the WebUI) to see if that helps, it came back and >still went into “Unassigned”. > >It seems like the hosts can’t see the Storage pool. > >Where should I start to troubleshoot this? > >Thanks

1 0

Re: Migration of self Hosted Engine from iSCSI to Gluster/NFS
by Strahil Nikolov 28 Jun '20

28 Jun '20

As you will migrate from block-based storage to file-based storage, I think that you should use the backup & restore procedure. Best Regards, Strahil Nikolov На 25 юни 2020 г. 7:31:55 GMT+03:00, Erez Zarum <erezz(a)nanosek.com> написа: >I was looking for a “complete” best practice to migrate a self-hosted >engine running currently on an iSCSI LUN to a Gluster of NFS storage >domain >oVirt version 4.3.10 > >Thanks!

1 0

update and engine-setup
by eevans＠digitaldatatechs.com 28 Jun '20

28 Jun '20

I do not have a self hosted engine and did yum update whech update these files: Updated: microcode_ctl.x86_64 2:2.1-61.10.el7_8 ovirt-engine-appliance.x86_64 0:4.3-20200625.1.el7 ovirt-engine-extensions-api-impl.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-extensions-api-impl-javadoc.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-health-check-bundler.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-base.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-plugin-cinderlib.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-plugin-ovirt-engine.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-plugin-ovirt-engine-common.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-plugin-vmconsole-proxy-helper.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-setup-plugin-websocket-proxy.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-ui-extensions.noarch 0:1.0.13-1.20200303git3b594b8.el7 ovirt-engine-vmconsole-proxy-helper.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-engine-websocket-proxy.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 ovirt-node-ng-image-update.noarch 0:4.3.11-0.1.rc1.20200625025312.git243a031.el7 ovirt-release43.noarch 0:4.3.11-0.1.rc1.20200626025335.git243a031.el7 ovirt-release43-snapshot.noarch 0:4.3.11-0.1.rc1.20200626025335.git243a031.el7 ovirt-release43-tested.noarch 0:4.3.11-0.1.rc1.20200626025335.git243a031.el7 python2-ovirt-engine-lib.noarch 0:4.3.11.1-0.0.master.20200625131236.git33fd414.el7 python2-tracer.noarch 0:0.7.4-1.el7 tracer-common.noarch 0:0.7.4-1.el7 It statedI needed to run engine-setup but is failed with these messages: engine-setup [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup Configuration files: ['/etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf', '/etc/ovirt-engine-setup.conf.d/10-packaging.conf', '/etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf'] Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20200626111946-5y1tda.log Version: otopi-1.8.5_master (otopi-1.8.5-0.0.master.20191017094324.git500b7f5.el7) [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== PRODUCT OPTIONS ==-- [ INFO ] ovirt-provider-ovn already installed, skipping. --== PACKAGES ==-- [ INFO ] Checking for product updates... [ ERROR ] Yum ['ovirt-engine conflicts with ovirt-engine-ui-extensions-1.0.13-1.20200303git3b594b8.el7.noarch'] [ INFO ] Yum Performing yum transaction rollback [ ERROR ] Failed to execute stage 'Environment customization': ['ovirt-engine conflicts with ovirt-engine-ui-extensions-1.0.13-1.20200303git3b594b8.el7.noarch'] [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20200626111946-5y1tda.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20200626112010-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed I ran engine-setup --offline and it completed successfully. I'm not sure what the issue is with the UI extensions but it's been an issue for a while failing migrations, etc. Each time I update, I have to downgrade the UI-extensions as stated in a previous post. I thought the developers should know about this so it can be addressed.

3 2

engine failure
by eevans＠digitaldatatechs.com 28 Jun '20

28 Jun '20

The last update for 4.3 has caused my engine server to fail. I cannot find the original repos for the 4.3 install that work with out missing dependencies. I am using Centos 7 that is up to date. Can someone forward the URL for 4.3.10.1 repo installs or info so I can reinstall and hopefully restore my stand alone engine? My vm's are still running but I cannot manage anything . Please help and it is appreciated.

3 3

Does a slow Web proxy (can't run the update-check) ruin HA scores? (Solved, ...but really?)
by thomas＠hoberg.net 27 Jun '20

27 Jun '20

Running a couple of oVirt clusters on left-over hardware in an R&D niche of the data center. Lots of switches/proxies still at 100Mbit and just checking for updates via 'yum update' can take awhile, even time out 2 times of out 3. The network between the nodes is 10Gbit though, faster than any other part of the hardware, including some SSDs and RAIDs: Cluster communication should be excellent, even if everything goes through a single port. After moving some servers to a new IP range, where there are even more hops to the proxy, I am shocked to see the three HCI nodes in one cluster almost permanently report bad HA scores, which of course becomes a real issue, when it hits all three. The entire cluster really starts to 'wobble'.... Trying to find the reason for that bad score and there is nothing obvious: Machines have been running just fine, very light loads, no downtimes, reboots etc. But looking at the events recorded on hosts, something like "Failed to check for available updates on host <name> with message 'Failed to run check-update of host '<host>'. Error: null'." does come up pretty often. Moreover, when I then have all three servers run the update check on the GUI, I can find myself locked-out of the oVirt GUI and once I get back in, all non-active HostedEngine hosts are suddenly back in the 'low HS score' state. So I have this inkling impression, that the ability (or not) to run the update check is counting into the HA score, which ... IMHO would be quite mad. It would have production clusters go haywire, just because an external internet connection is interrupted... Any feedback on this? P.S. Only minutes later, after noticing the ha-scores reported by hosted-engine --vm-status were really in the low 2000s range overall, I did a quick Google and found this: ovirt-ha-agent - host score penaltieshttps://github.com/oVirt/ovirt-hosted-engine-ha/blob/master/ovirt_… NOTE: These values must be the same for all hosts in the HA cluster!base-score=3400 gateway-score-penalty=1600 not-uptodate-config-penalty=1000 //not 'knowing if there are updates' is not the same as 'knowing it missing critical patches' mgmt-bridge-score-penalty=600 free-memory-score-penalty=400 cpu-load-score-penalty=1000 engine-retry-score-penalty=50 cpu-load-penalty-min=0.4 cpu-load-penalty-max=0.9 So now I know how to fix it for me, but I'd consider this pretty much a bug: When the update check fails, that implies really only that the update check could not go through. It doesn't mean the cluster is fundamentally unhealthy. Now I understand how that negative feedback is next to impossible inside RedHat's network, where update servers are local. But having a cluster HA score being based on something 'just now happening' on the other far edges of the Internet... seems a very bad design decision. Please comment and/or tell me how and where I should file this as a bug.

2 2

NFS import storage domain permissions error
by Joop 27 Jun '20

27 Jun '20

Hi All, I've got an error when I try to import a storage domain from a Synology NAS that used to be a 4.3.10 oVirt installation but no matter what I try I can't get it to import. I keep getting a permission denied error while with the same settings it worked for the previous version oVirt. This is the log: 2020-06-27 19:39:38,113+0200 INFO (jsonrpc/0) [vdsm.api] START connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'password': '********', 'protocol_version': 'auto', 'port': '', 'iqn': '', 'conn ection': 'pakhuis:/volume1/nfs/data', 'ipv6_enabled': 'false', 'id': '00000000-0000-0000-0000-000000000000', 'user': '', 'tpgt': '1'}], options=None) from=::ffff:192.168.11.14,53948, flow_id=c753ebc5-20a3-4e1c-bcd8-794ddde3ec69, task _id=2a9ef4e7-e2c0-43d6-b03a-7f0d62f08e50 (api:48) 2020-06-27 19:39:38,113+0200 DEBUG (jsonrpc/0) [storage.Server.NFS] Using local locks for NFSv3 locks (storageServer:442) 2020-06-27 19:39:38,114+0200 INFO (jsonrpc/0) [storage.StorageServer.MountConnection] Creating directory '/rhev/data-center/mnt/pakhuis:_volume1_nfs_data' (storageServer:167) 2020-06-27 19:39:38,114+0200 INFO (jsonrpc/0) [storage.fileUtils] Creating directory: /rhev/data-center/mnt/pakhuis:_volume1_nfs_data mode: None (fileUtils:198) 2020-06-27 19:39:38,114+0200 INFO (jsonrpc/0) [storage.Mount] mounting pakhuis:/volume1/nfs/data at /rhev/data-center/mnt/pakhuis:_volume1_nfs_data (mount:207) 2020-06-27 19:39:38,360+0200 DEBUG (jsonrpc/0) [storage.Mount] /rhev/data-center/mnt/pakhuis:_volume1_nfs_data mounted: 0.25 seconds (utils:390) 2020-06-27 19:39:38,380+0200 DEBUG (jsonrpc/0) [storage.Mount] Waiting for udev mount events: 0.02 seconds (utils:390) 2020-06-27 19:39:38,381+0200 DEBUG (jsonrpc/0) [storage.oop] Creating ioprocess Global (outOfProcess:89) 2020-06-27 19:39:38,382+0200 INFO (jsonrpc/0) [IOProcessClient] (Global) Starting client (__init__:308) 2020-06-27 19:39:38,394+0200 INFO (ioprocess/10476) [IOProcess] (Global) Starting ioprocess (__init__:434) 2020-06-27 19:39:38,394+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) Closing unrelated FDs... (__init__:432) 2020-06-27 19:39:38,394+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) Opening communication channels... (__init__:432) 2020-06-27 19:39:38,394+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) Queuing request (slotsLeft=20) (__init__:432) 2020-06-27 19:39:38,394+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) (1) Start request for method 'access' (waitTime=49) (__init__:432) 2020-06-27 19:39:38,395+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) (1) Finished request for method 'access' (runTime=421) (__init__:432) 2020-06-27 19:39:38,395+0200 DEBUG (ioprocess/10476) [IOProcess] (Global) (1) Dequeuing request (slotsLeft=21) (__init__:432) 2020-06-27 19:39:38,396+0200 WARN (jsonrpc/0) [storage.oop] Permission denied for directory: /rhev/data-center/mnt/pakhuis:_volume1_nfs_data with permissions:7 (outOfProcess:193) 2020-06-27 19:39:38,396+0200 INFO (jsonrpc/0) [storage.Mount] unmounting /rhev/data-center/mnt/pakhuis:_volume1_nfs_data (mount:215) 2020-06-27 19:39:38,435+0200 DEBUG (jsonrpc/0) [storage.Mount] /rhev/data-center/mnt/pakhuis:_volume1_nfs_data unmounted: 0.04 seconds (utils:390) 2020-06-27 19:39:38,453+0200 DEBUG (jsonrpc/0) [storage.Mount] Waiting for udev mount events: 0.02 seconds (utils:390) 2020-06-27 19:39:38,453+0200 ERROR (jsonrpc/0) [storage.HSM] Could not connect to storageServer (hsm:2421) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/fileSD.py", line 80, in validateDirAccess getProcPool().fileUtils.validateAccess(dirPath) File "/usr/lib/python3.6/site-packages/vdsm/storage/outOfProcess.py", line 194, in validateAccess raise OSError(errno.EACCES, os.strerror(errno.EACCES)) PermissionError: [Errno 13] Permission denied During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 2418, in connectStorageServer conObj.connect() File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 449, in connect return self._mountCon.connect() File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 190, in connect six.reraise(t, v, tb) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/vdsm/storage/storageServer.py", line 183, in connect self.getMountObj().getRecord().fs_file) File "/usr/lib/python3.6/site-packages/vdsm/storage/fileSD.py", line 91, in validateDirAccess raise se.StorageServerAccessPermissionError(dirPath) vdsm.storage.exception.StorageServerAccessPermissionError: Permission settings on the specified path do not allow access to the storage. Verify permission settings on the specified storage path.: 'path = /rhev/data-center/mnt/pakhuis :_volume1_nfs_data' 2020-06-27 19:39:38,453+0200 DEBUG (jsonrpc/0) [storage.HSM] knownSDs: {a2691633-e3c9-454e-9ee4-a6f50f4e00fa: vdsm.storage.glusterSD.findDomain} (hsm:2470) 202 If I make a mistake in the path I get the mount command in the logs and correcting for the mistake let me mount it at /mnt and then I'm able to create files and folders using the vdsm and qemu accounts so I don't know where that error is coming from. Had a look at the source of vdsm/storage/* but I'm not a python programmer. A couple of other 4.4 oVirt installs don't have this problem and I used the same usb stick with Centos-8.2 for those as for this one. Followed the same install instructions, same versions of packages as far as I can see. Beats me I'm tempted to reinstall Centos7 and oVirt4.3.10 just to see what happens, but I'm hoping someone can point me to something that I must have overlooked. Regards, Joop

1 1

Re: ETL service aggregation error
by Ayansh Rocks 27 Jun '20

27 Jun '20

Thanks Paul. On Sat, Jun 27, 2020, 1:19 PM Staniforth, Paul < P.Staniforth(a)leedsbeckett.ac.uk> wrote: > Hi Ayansh, > as it's only changing the history database there isn't > a high risk and you can run it while your system is being used, > For piece of mind you can do a full backup before, or just backup the Data > Warehouse. > > > https://www.ovirt.org/documentation/administration_guide/#chap-Backups_and_… > > Regards, > Paul S. > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 27 June 2020 06:42 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk> > *Cc:* users <users(a)ovirt.org>; devel(a)ovirt.org <devel(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Hi Paul, > > Thanks, is it safe to run this update command. I am getting this issue on > my production environment. > > On Sat, Jun 27, 2020, 12:51 AM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Ayansh, > It looks like the lastHourAgg is wrong is should > be 2 hours before the runTime but is 1:30 hours before runtime. > > Try > > systemctl stop ovirt-engine-dwhd > > in ovirt_engine_history database > > UPDATE history_configuration set var_datetime = var_datetime - interval '24 hour' WHERE var_name = 'lastHourAggr'; > > UPDATE history_configuration set var_datetime = var_datetime - interval '1 day' WHERE var_name = 'lastDayAggr'; > > systemctl stop ovirt-engine-dwhd > > > see https://www.mail-archive.com/users@ovirt.org/msg53055.html > <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.mail-…> > > > Regards, > > Paul Staniforth > > School of Built Environment Engineering and Computing. > > Leeds Beckett University > > Networked Systems Analyst, Research and Engineering Support. > Technical Lead Architect IMS and oVirt Virtualization > > tel: +44 (0)113 28123754 > email: p.staniforth(a)leedsbeckett.ac.uk > > > <https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gofun…> > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 26 June 2020 17:10 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org>; devel(a)ovirt.org <devel(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Can we fix this any how guys. > > On Thu, Jun 25, 2020 at 5:53 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Is it a bug ? > > > On Thu, Jun 25, 2020 at 4:11 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > See below as well if it helps - > > [root@iondelvm149 ~]# date > Thu Jun 25 16:09:45 IST 2020 > [root@iondelvm149 ~]# psql -h localhost -U ovirt_engine_history -d > ovirt_engine_history > Password for user ovirt_engine_history: > psql (9.2.24, server 10.6) > WARNING: psql version 9.2, server version 10.0. > Some psql features might not work. > Type "help" for help. > > ovirt_engine_history=> select * from history_configuration; > var_name | var_value | var_datetime > -------------------+-----------+------------------------ > default_language | en_US | > firstSync | false | 2018-03-23 12:27:00-04 > lastHourAggr | | 2020-06-25 05:00:00-04 > HourlyAggFailed | false | > lastDayAggr | | 2020-06-24 01:00:00-04 > MinimalETLVersion | 4.3.0 | > (6 rows) > > ovirt_engine_history=> > > On Thu, Jun 25, 2020 at 4:06 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > is it on the hour? it sounds like it got a > problem aggregating the samples to create the hourly samples. > > I had to update the java memory usage as it was running out of heap memory. > > The defaults are > > DWH_HEAP_MIN=1g > DWH_HEAP_MAX=1g > > see > > /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf > > for settings. > > Regards, > Paul S. > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 25 June 2020 10:40 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Hi Paul, > > Yes i am able to connect to the database from ovirt engine machine. > > port is already open. what could be issue, i am getting this error in > every hour. > > Thanks > > On Wed, Jun 24, 2020 at 6:30 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > it looks like it's had a problem for over 2 > years, is the Data Warehouse database local or remote? is there a firewall > port open? > > Can you connect to the database from the engine machine? > > The credentials should be in > /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/10-setup-database.conf > > as your using 4.3 the version of postgresql is 10 and using scl > > scl enable rh-postgresql10 "psql -h localhost -U ovirt_engine_history > -d ovirt_engine_history" > > if it's using the standard user, database and is local. > > > Regards, > Paul S. > . > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 24 June 2020 12:47 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Please find the attached error logs. > > On Thu, Jun 4, 2020 at 8:17 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > I can't see any of your images and also it > would be better to have the log file as text. > > Regards, > Paul S. > > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 04 June 2020 15:16 > *To:* users <users(a)ovirt.org> > *Subject:* [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Any update on this ? > > On Tue, May 26, 2020 at 1:41 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Hi, > > I am using 4.3.7 self hosted engine. From Few days i am getting regular > below error messages :- > [image: image.png] > > Logs in /var/log/ovirt-engine-dwh/ovirt-engine-dwhd.log > [image: image.png] > > What could be the reason for this? > > Thanks > Shashank > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > >

1 0

Re: ETL service aggregation error
by Ayansh Rocks 27 Jun '20

27 Jun '20

Hi Paul, Thanks, is it safe to run this update command. I am getting this issue on my production environment. On Sat, Jun 27, 2020, 12:51 AM Staniforth, Paul < P.Staniforth(a)leedsbeckett.ac.uk> wrote: > Hello Ayansh, > It looks like the lastHourAgg is wrong is should > be 2 hours before the runTime but is 1:30 hours before runtime. > > Try > > systemctl stop ovirt-engine-dwhd > > in ovirt_engine_history database > > UPDATE history_configuration set var_datetime = var_datetime - interval '24 hour' WHERE var_name = 'lastHourAggr'; > > UPDATE history_configuration set var_datetime = var_datetime - interval '1 day' WHERE var_name = 'lastDayAggr'; > > systemctl stop ovirt-engine-dwhd > > > see https://www.mail-archive.com/users@ovirt.org/msg53055.html > > > Regards, > > Paul Staniforth > > School of Built Environment Engineering and Computing. > > Leeds Beckett University > > Networked Systems Analyst, Research and Engineering Support. > Technical Lead Architect IMS and oVirt Virtualization > > tel: +44 (0)113 28123754 > email: p.staniforth(a)leedsbeckett.ac.uk > > <https://www.gofundme.com/f/bytes-for-heroes> > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 26 June 2020 17:10 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org>; devel(a)ovirt.org <devel(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Can we fix this any how guys. > > On Thu, Jun 25, 2020 at 5:53 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Is it a bug ? > > > On Thu, Jun 25, 2020 at 4:11 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > See below as well if it helps - > > [root@iondelvm149 ~]# date > Thu Jun 25 16:09:45 IST 2020 > [root@iondelvm149 ~]# psql -h localhost -U ovirt_engine_history -d > ovirt_engine_history > Password for user ovirt_engine_history: > psql (9.2.24, server 10.6) > WARNING: psql version 9.2, server version 10.0. > Some psql features might not work. > Type "help" for help. > > ovirt_engine_history=> select * from history_configuration; > var_name | var_value | var_datetime > -------------------+-----------+------------------------ > default_language | en_US | > firstSync | false | 2018-03-23 12:27:00-04 > lastHourAggr | | 2020-06-25 05:00:00-04 > HourlyAggFailed | false | > lastDayAggr | | 2020-06-24 01:00:00-04 > MinimalETLVersion | 4.3.0 | > (6 rows) > > ovirt_engine_history=> > > On Thu, Jun 25, 2020 at 4:06 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > is it on the hour? it sounds like it got a > problem aggregating the samples to create the hourly samples. > > I had to update the java memory usage as it was running out of heap memory. > > The defaults are > > DWH_HEAP_MIN=1g > DWH_HEAP_MAX=1g > > see > > /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf > > for settings. > > Regards, > Paul S. > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 25 June 2020 10:40 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Hi Paul, > > Yes i am able to connect to the database from ovirt engine machine. > > port is already open. what could be issue, i am getting this error in > every hour. > > Thanks > > On Wed, Jun 24, 2020 at 6:30 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > it looks like it's had a problem for over 2 > years, is the Data Warehouse database local or remote? is there a firewall > port open? > > Can you connect to the database from the engine machine? > > The credentials should be in > /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/10-setup-database.conf > > as your using 4.3 the version of postgresql is 10 and using scl > > scl enable rh-postgresql10 "psql -h localhost -U ovirt_engine_history > -d ovirt_engine_history" > > if it's using the standard user, database and is local. > > > Regards, > Paul S. > . > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 24 June 2020 12:47 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < > users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Please find the attached error logs. > > On Thu, Jun 4, 2020 at 8:17 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > > Hello Shashank, > I can't see any of your images and also it > would be better to have the log file as text. > > Regards, > Paul S. > > > > ------------------------------ > *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> > *Sent:* 04 June 2020 15:16 > *To:* users <users(a)ovirt.org> > *Subject:* [ovirt-users] Re: ETL service aggregation error > > > *Caution External Mail:* Do not click any links or open any attachments > unless you trust the sender and know that the content is safe. > Any update on this ? > > On Tue, May 26, 2020 at 1:41 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> > wrote: > > Hi, > > I am using 4.3.7 self hosted engine. From Few days i am getting regular > below error messages :- > [image: image.png] > > Logs in /var/log/ovirt-engine-dwh/ovirt-engine-dwhd.log > [image: image.png] > > What could be the reason for this? > > Thanks > Shashank > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ > >

2 1

How to suspend a stateless VM
by pascal＠butterflyit.com 27 Jun '20

27 Jun '20

Currently from the ovirt web interface it is not possible to suspend a stateless VM. However I have a need for it for example when I want to free idle VM (or migrate them to a different cluster) and still not lose the current status of the VM. Thanks

2 1

How to change the hosted engine configuration manually?
by Ricardo Alonso 26 Jun '20

26 Jun '20

After an update in the cluster configuration, the hosted engine ended up with an invalid configuration (bios x machine type) and it's not coming up. I need to return the bios to legacy mode, but I'm not finding a way to correct the xml generated to turn the machine back on. The storage domain is iSCSI. Any help would be appreciate. (reinstall isn't an option).

2 2

Re: ETL service aggregation error
by Ayansh Rocks 26 Jun '20

26 Jun '20

Is it a bug ? On Thu, Jun 25, 2020 at 4:11 PM Ayansh Rocks <shashank123rastogi(a)gmail.com> wrote: > See below as well if it helps - > > [root@iondelvm149 ~]# date > Thu Jun 25 16:09:45 IST 2020 > [root@iondelvm149 ~]# psql -h localhost -U ovirt_engine_history -d > ovirt_engine_history > Password for user ovirt_engine_history: > psql (9.2.24, server 10.6) > WARNING: psql version 9.2, server version 10.0. > Some psql features might not work. > Type "help" for help. > > ovirt_engine_history=> select * from history_configuration; > var_name | var_value | var_datetime > -------------------+-----------+------------------------ > default_language | en_US | > firstSync | false | 2018-03-23 12:27:00-04 > lastHourAggr | | 2020-06-25 05:00:00-04 > HourlyAggFailed | false | > lastDayAggr | | 2020-06-24 01:00:00-04 > MinimalETLVersion | 4.3.0 | > (6 rows) > > ovirt_engine_history=> > > On Thu, Jun 25, 2020 at 4:06 PM Staniforth, Paul < > P.Staniforth(a)leedsbeckett.ac.uk> wrote: > >> Hello Shashank, >> is it on the hour? it sounds like it got a >> problem aggregating the samples to create the hourly samples. >> >> I had to update the java memory usage as it was running out of heap >> memory. >> >> The defaults are >> >> DWH_HEAP_MIN=1g >> DWH_HEAP_MAX=1g >> >> see >> >> /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf >> >> for settings. >> >> Regards, >> Paul S. >> >> >> ------------------------------ >> *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> >> *Sent:* 25 June 2020 10:40 >> *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < >> users(a)ovirt.org> >> *Subject:* Re: [ovirt-users] Re: ETL service aggregation error >> >> >> *Caution External Mail:* Do not click any links or open any attachments >> unless you trust the sender and know that the content is safe. >> Hi Paul, >> >> Yes i am able to connect to the database from ovirt engine machine. >> >> port is already open. what could be issue, i am getting this error in >> every hour. >> >> Thanks >> >> On Wed, Jun 24, 2020 at 6:30 PM Staniforth, Paul < >> P.Staniforth(a)leedsbeckett.ac.uk> wrote: >> >> Hello Shashank, >> it looks like it's had a problem for over >> 2 years, is the Data Warehouse database local or remote? is there a >> firewall port open? >> >> Can you connect to the database from the engine machine? >> >> The credentials should be in >> /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/10-setup-database.conf >> >> as your using 4.3 the version of postgresql is 10 and using scl >> >> scl enable rh-postgresql10 "psql -h localhost -U ovirt_engine_history >> -d ovirt_engine_history" >> >> if it's using the standard user, database and is local. >> >> >> Regards, >> Paul S. >> . >> >> ------------------------------ >> *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> >> *Sent:* 24 June 2020 12:47 >> *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; users < >> users(a)ovirt.org> >> *Subject:* Re: [ovirt-users] Re: ETL service aggregation error >> >> >> *Caution External Mail:* Do not click any links or open any attachments >> unless you trust the sender and know that the content is safe. >> Please find the attached error logs. >> >> On Thu, Jun 4, 2020 at 8:17 PM Staniforth, Paul < >> P.Staniforth(a)leedsbeckett.ac.uk> wrote: >> >> Hello Shashank, >> I can't see any of your images and also >> it would be better to have the log file as text. >> >> Regards, >> Paul S. >> >> >> >> ------------------------------ >> *From:* Ayansh Rocks <shashank123rastogi(a)gmail.com> >> *Sent:* 04 June 2020 15:16 >> *To:* users <users(a)ovirt.org> >> *Subject:* [ovirt-users] Re: ETL service aggregation error >> >> >> *Caution External Mail:* Do not click any links or open any attachments >> unless you trust the sender and know that the content is safe. >> Any update on this ? >> >> On Tue, May 26, 2020 at 1:41 PM Ayansh Rocks < >> shashank123rastogi(a)gmail.com> wrote: >> >> Hi, >> >> I am using 4.3.7 self hosted engine. From Few days i am getting regular >> below error messages :- >> [image: image.png] >> >> Logs in /var/log/ovirt-engine-dwh/ovirt-engine-dwhd.log >> [image: image.png] >> >> What could be the reason for this? >> >> Thanks >> Shashank >> >> To view the terms under which this email is distributed, please go to:- >> http://leedsbeckett.ac.uk/disclaimer/email/ >> <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> >> >> To view the terms under which this email is distributed, please go to:- >> http://leedsbeckett.ac.uk/disclaimer/email/ >> <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fleedsbecke…> >> >> To view the terms under which this email is distributed, please go to:- >> http://leedsbeckett.ac.uk/disclaimer/email/ >> >>

2 2

ovirt-provider-ovn syncrhonisation
by chris＠chrislaw.me 26 Jun '20

26 Jun '20

Hi - during the last reboot all my ovn networks appeared in oVirt but weren't reflected on the physical host, no VMs would boot that had an OVN network attached. I was looking at my logs and I can see the following - Failed to synchronize networks of Provider ovirt-provider-ovn. Networks of Provider ovirt-provider-ovn were successfully synchronized. There was an issue with this host/engine where they lost connection which explains the Failed to Sync. The problem is it's since all been rebooted and it doesn't look like the ovirt-provider-ovn has tried to sync since, as I understand it, it should sync every 5 minutes? Is it just a case that successful syncs aren't always report in the events log? I've checked my timing properties for sync of external providers and all seems correct. So now I'm worried another reboot will result in losing all the ovn networks I've created through oVirt again! Also worth noting AutoSync is turned on for the provider.

2 1

Clean old mount points in hosts VDSM
by Vinícius Ferrão 25 Jun '20

25 Jun '20

Hello, For reasons unknown one of my hosts is trying to mount an old storage point that’s been removed some time ago. /var/log/vdsm/vdsm.log:2020-06-24 19:57:35,958-0300 INFO (tmap-65016/0) [IOProcessClient] (/192.168.10.6:_mnt_pool0_ovirt_he) Starting client (__init__:308) /var/log/vdsm/vdsm.log:2020-06-24 19:57:35,968-0300 INFO (ioprocess/12115) [IOProcess] (/192.168.10.6:_mnt_pool0_ovirt_he) Starting ioprocess (__init__:434) /var/log/vdsm/vdsm.log:2020-06-24 19:57:42,167-0300 INFO (jsonrpc/6) [vdsm.api] START connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'protocol_version': u'auto', u'connection': u'192.168.10.6:/mnt/pool0/ovirt/he', u'user': u'kvm', u'id': u'e29cf818-5ee5-46e1-85c1-8aeefa33e95d'}], options=None) from=::1,59090, task_id=5ea81925-ec92-4031-aa36-bb6f436321d5 (api:48) /var/log/vdsm/vdsm.log:2020-06-24 19:57:42,169-0300 INFO (jsonrpc/6) [storage.StorageServer.MountConnection] Creating directory u'/rhev/data-center/mnt/192.168.10.6:_mnt_pool0_ovirt_he' (storageServer:168) /var/log/vdsm/vdsm.log:2020-06-24 19:57:42,169-0300 INFO (jsonrpc/6) [storage.fileUtils] Creating directory: /rhev/data-center/mnt/192.168.10.6:_mnt_pool0ovirt_he mode: None (fileUtils:199) /var/log/vdsm/vdsm.log:2020-06-24 19:57:42,169-0300 INFO (jsonrpc/6) [storage.Mount] mounting 192.168.10.6:/mnt/pool0/ovirt/he at /rhev/data-center/mnt/192.168.10.6:_mnt_pool0_ovirt_he (mount:204) /var/log/vdsm/vdsm.log:MountError: (32, ';mount.nfs: mounting 192.168.10.6:/mnt/pool0/ovirt/he failed, reason given by server: No such file or directory\n') /var/log/vdsm/vdsm.log:2020-06-24 19:57:43,683-0300 INFO (jsonrpc/5) [vdsm.api] START connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'protocol_version': u'auto', u'connection': u'192.168.10.6:/mnt/pool0/ovirt/he', u'user': u'kvm', u'id': u'e29cf818-5ee5-46e1-85c1-8aeefa33e95d'}], options=None) from=::1,59094, task_id=9ce61858-dea1-4059-b942-a52c8c82afdc (api:48) /var/log/vdsm/vdsm.log:2020-06-24 19:57:43,685-0300 INFO (jsonrpc/5) [storage.StorageServer.MountConnection] Creating directory u'/rhev/data-center/mnt/192.168.10.6:_mnt_pool0_ovirt_he' (storageServer:168) /var/log/vdsm/vdsm.log:2020-06-24 19:57:43,685-0300 INFO (jsonrpc/5) [storage.fileUtils] Creating directory: /rhev/data-center/mnt/192.168.10.6:_mnt_pool0ovirt_he mode: None (fileUtils:199) /var/log/vdsm/vdsm.log:2020-06-24 19:57:43,685-0300 INFO (jsonrpc/5) [storage.Mount] mounting 192.168.10.6:/mnt/pool0/ovirt/he at /rhev/data-center/mnt/192.168.10.6:_mnt_pool0_ovirt_he (mount:204) /var/log/vdsm/vdsm.log:MountError: (32, ';mount.nfs: mounting 192.168.10.6:/mnt/pool0/ovirt/he failed, reason given by server: No such file or directory\n’) This only happens in one host and it’s spamming /var/log/vdsm/vdsm.log. Any ideia on how to debug this and remove the entry? Thanks,

2 3