- Users - oVirt List Archives

Re: Issues post-upgrade from 4.2.8 to 4.3.2
by Vrgotic, Marko 23 Apr '19

23 Apr '19

Hey Shani, Thank you for the reply. This morning I have tried to re-provision HA Hosts. Managed successfully with HA host 2 and 3, about to do it with HA Host 1. If that goes well, I will repeat the exercises with Migration and Hosts updates to see if the issue is gone or still present. Upon those, I intend to provide full step-by-step of the Upgrade Procedure and after with what was done. Thank you for the patience. Marko Vrgotic From: Shani Leviim <sleviim(a)redhat.com> Date: Sunday, 21 April 2019 at 09:44 To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com> Subject: Re: [ovirt-users] Issues post-upgrade from 4.2.8 to 4.3.2 Hi Marko, I've noticed that the timestamp of the error from your engine.log is one hour delayed of the one from your ui log. Is this one intentioned? Also, can you please attach a screenshot? Thanks Regards, Shani Leviim On Sun, Apr 21, 2019 at 10:12 AM Vrgotic, Marko <M.Vrgotic(a)activevideo.com<mailto:M.Vrgotic@activevideo.com>> wrote: Dear oVirt team, We have 3 Hosts HA Cluster with SHE engine. Storage is NetApp. Recently we have executed an upgrade from 4.2.8 to 4.3.2. Since then we are seeing strange behavior when trying to put Hosts to Maintenance or manually Migrate VMs between Hosts. The most repeated WARN/ERROR I am observing is following: The UI is constantly throwing an exception when trying to put HA host to maintenance or increase the SPM level. The repeated log line from engine.log I see, with regards or failing to migrate all hosts is: 2019-04-18 13:05:30,760Z WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-83) [63d33dd1] Validation of action 'MigrateVm' failed for user SYSTEM. Reasons: VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL But there is more than enough. Also from UI.log: 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Permutation name: 0D2DB7A91B469CC36C64386E5632FAC5 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Uncaught exception: com.google.gwt.event.shared.Umbrell aException: Exception caught: (TypeError) : oab(...) is null at java.lang.Throwable.Throwable(Throwable.java:70) [rt.jar:1.8.0_201] at java.lang.RuntimeException.RuntimeException(RuntimeException.java:32) [rt.jar:1.8.0_201] at com.google.web.bindery.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:64) [gwt-servlet.jar:] at com.google.gwt.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:25) [gwt-servlet.jar:] at com.google.gwt.event.shared.HandlerManager.$fireEvent(HandlerManager.java:117) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.event.dom.client.DomEvent.fireNativeEvent(DomEvent.java:110) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.DOM.dispatchEvent(DOM.java:1415) [gwt-servlet.jar:] at com.google.gwt.user.client.impl.DOMImplStandard.dispatchEvent(DOMImplStandard.java:312) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Su/<(https://ovirt-staging-engine.avinity.tv/ovirt-engine/webadmin/?locale=en_US… line 9 > scriptElement) at Unknown.anonymous(Unknown) Caused by: com.google.gwt.core.client.JavaScriptException: (TypeError) : oab(...) is null at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.$onAddHost(ClusterGuideModel.java:533) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.executeCommand(ClusterGuideModel.java:617) at org.ovirt.engine.ui.uicommonweb.UICommand.$execute(UICommand.java:163) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget.$lambda$4(AbstractModelBoundPopupPresenterWidget.java:306) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget$lambda$4$Type.onClick(AbstractModelBoundPopupPresenterWidget.java:306) at com.google.gwt.event.dom.client.ClickEvent.dispatch(ClickEvent.java:55) [gwt-servlet.jar:] at com.google.gwt.event.shared.GwtEvent.dispatch(GwtEvent.java:76) [gwt-servlet.jar:] at com.google.web.bindery.event.shared.SimpleEventBus.$doFire(SimpleEventBus.java:173) [gwt-servlet.jar:] ... 12 more Can you give me some advice on how to proceed? This started happening since upgrade. Kindly awaiting your reply, Marko Vrgotic _______________________________________________ Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7SVM3XWFREH3W…

1 0

Re: Migrate HE between ISCSI storages
by Strahil 23 Apr '19

23 Apr '19

Hi, I think you can go to the disk section in UI and migrate the disk from 1 storage domain to another. Best Regards, Strahil Nikolov

3 2

Is there a way to tell whether a permission set for a VM is inherited using REST API?
by Anton E 23 Apr '19

23 Apr '19

Hi everyone! My question is in the subject for the most part. I'm trying to backup a vm parameters, including the linked attributes, namely the permissions. But I don't want the inherited permissions to be included into the backup, I only need the attributes specific to the vm. It looks like there is no difference between the inherited and the vm-specific permissions in the output from /ovirt-engine/api/vms/<vm-id>/permissions service. What is the best way to distinguish the specific permissions from the inherited ones? It seems I can follow the link to the particular permission and see whether the vm attribute is set on it and it points to the VM I need, but that would require numerous REST requests to be done. Is there a more elegant way? Maybe I can somehow filter the output of /ovirt-engine/api/vms/<vm-id>/permissions to only include the required info? Thanks in advance. Best regards, Anton.

4 5

oVirt 4.3.3 gluster option cluster.choose-local added to 'Optimize for Virt Store'
by Strahil Nikolov 22 Apr '19

22 Apr '19

Hello Community, can someone tell me why the option cluster.choose-local was added to "Optimize for Virt Store" ?Testing my cluster after the patching showed reduced performance , due to relying constantly on network instead of using local NVME brick.I have checked my older volumes and they did not have that option. Is there any benefit to not use the local brick ?Any issues to reset that option and use local brick for reading ? Best Regards,Strahil Nikolov

1 0

Re: Is there a way to tell whether a permission set for a VM is inherited using REST API?
by Tentaclius 22 Apr '19

22 Apr '19

Hi Shani, I'm aware of this attribute, but my understanding is it only applies for a vm to template or template to vm operations. I don't see how it can be used in order to get the list of vm-specific permissions for an existing VM. Could you please provide an example of that? Thanks and regards, Anton. On Mon, Apr 22, 2019 at 2:22 PM Shani Leviim <sleviim(a)redhat.com> wrote: > Hi Anton, > In that case, how about using this one: > http://ovirt.github.io/ovirt-engine-api-model/master/#services/vms/methods/… > > > *Regards,* > > *Shani Leviim* > > > On Mon, Apr 22, 2019 at 1:35 PM Tentaclius <tentaclius(a)gmail.com> wrote: > >> Hi Shani, >> >> thanks for your reply. >> >> My question is not about assigning permissions, but rather about querying >> permissions assigned to a given VM. >> I need to get a list of permissions, assigned to the VM without the >> permissions this VM inherits from parent objects. Unluckily for me the >> /ovirt-engine/api/vms/<vm-id>/permissions service returns the list >> containing both VM-specific and inherited permissions, which cannot be >> distinguished. >> >> Thanks and regards, >> Anton. >> >> On Mon, Apr 22, 2019 at 1:29 PM Shani Leviim <sleviim(a)redhat.com> wrote: >> >>> Hi Anton, >>> You can assign permissions to the VM by using the following syntax: >>> >>> POST /ovirt-engine/api/vms/ yyy/permissions >>> >>> <permission> >>> <role> >>> <name> username</name> >>> </role> >>> <user id=" xxx"/> >>> </permission> >>> >>> For further information, you can visit here: >>> http://ovirt.github.io/ovirt-engine-api-model/master/#services/assigned_per… >>> >>> Hope it helps! >>> >>> >>> *Regards,* >>> >>> *Shani Leviim* >>> >>> >>> On Mon, Apr 22, 2019 at 1:04 PM Anton E <tentaclius(a)gmail.com> wrote: >>> >>>> Hi everyone! >>>> >>>> My question is in the subject for the most part. >>>> I'm trying to backup a vm parameters, including the linked attributes, >>>> namely the permissions. But I don't want the inherited permissions to be >>>> included into the backup, I only need the attributes specific to the vm. It >>>> looks like there is no difference between the inherited and the vm-specific >>>> permissions in the output from /ovirt-engine/api/vms/<vm-id>/permissions >>>> service. >>>> >>>> What is the best way to distinguish the specific permissions from the >>>> inherited ones? It seems I can follow the link to the particular permission >>>> and see whether the vm attribute is set on it and it points to the VM I >>>> need, but that would require numerous REST requests to be done. Is there a >>>> more elegant way? Maybe I can somehow filter the output of >>>> /ovirt-engine/api/vms/<vm-id>/permissions to only include the required info? >>>> >>>> Thanks in advance. >>>> >>>> Best regards, >>>> Anton. >>>> _______________________________________________ >>>> Users mailing list -- users(a)ovirt.org >>>> To unsubscribe send an email to users-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct: >>>> https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives: >>>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/AVHAC4SSJWVYY… >>>> >>>

1 0

Import of VMs failing - 0% progress on qemu-img
by Callum Smith 22 Apr '19

22 Apr '19

Dear All, We've exported some VMs from our old oVirt infrastructure and want to import them into the new one, but qemu-img appears to be failing. We have mounted an export domain populated from the old oVirt in the new hosted engine and are using the GUI to import the VM. Manually running the command sits at 16% CPU, 0% network usage and no progress. It appears to lock the NFS mount and ls and lsof both hang. sudo -u vdsm /usr/bin/qemu-img convert -p -t none -T none -f raw <path to source> -O raw <path to dest> Conversely a simple cp will work (ruling out file permissions errors): sudo -u vddm cp <path to source> <path to test> What might we be doing wrong? Regards, Callum -- Callum Smith Research Computing Core Wellcome Trust Centre for Human Genetics University of Oxford e. callum(a)well.ox.ac.uk<mailto:callum@well.ox.ac.uk>

2 12

Can't create pool after update to 4.3.3
by kiv＠intercom.pro 22 Apr '19

22 Apr '19

Hi all. After update my oVirt to 4.3.3 i can't create new pool. I make new template and trying to create new pool - but can't select any template, selection field is empty. I have this error: Uncaught exception occurred. Please try reloading the page. Details: Exception caught: undefined Please have your administrator check the UI logs

3 4

4.3.x upgrade and issues with OVN
by Charles Weber 22 Apr '19

22 Apr '19

Hi everyone, We have had a pair of Ovirt clusters at work, starting with the 3.x. I replaced last year with 4.x cluster on new machines. 4.2 worked great, but when I upgraded to 4.3.2 and now .3 I immediately ran into host networking issues resulting in hung or unable totally to migrate VMs. Configuration notes: 1. I use commercial star.x.x.x SSL cert on engine installed per Ovirt.org instructions 2. I have 2 untagged NICs assigned to ovirtmgmt and Public, both on the same IP range network. I also have another set of VLANs tagged on various NICs. 1 cluster uses HP blades with lots of NICs, the other uses supermicro 1Us with only 2 NICs. 3. I upgraded both engines and hosts to 4.3.2 from 4.2.8. I started seeing hung migrations cleared by restarting vdsm. 4. All computers involved run current CentOS 7.6 5. Both clusters use iscsi on dedicated tagged storage VLAN, seems fine. 6. I upgraded 1 engine and 1 host to 4.3.3 and things got worse. I have not updated any hosts or the second engine since. 7. The 4 hosts on the 4.3.3 engine now have out of sync error that refuses to clear for my Public network. 8. 2 OV 4.3.2 nodes had the following errors with 2 ovn ports. Here is example, perhaps related to the genev_sys_6081 error. ovn-d6eaa1-0: attempting to add tunnel port with same config as port 'ovn-f0f789-0' (::->137.187.160.13 ovn-877214-0: attempting to add tunnel port with same config as port 'ovn-483528-0' 9. I deleted and uninstalled all ovirt related rpms on one node, then did clean node install using latest 4.3 release. Same errors. 10. I downloaded latest node iso, installed on same host, upgraded to to 4.3.3.1 node and joined cluster. The node installation has no errors and can migrate to my other hosts. All networks are in sync. The migration hangs. Restarting VDSMD clears the hung migration. 11. None of the other hosts can migrate VMs to the new node. Here are excerpts from 3.2 node on 3.3 engine log file. Apr 17, 2019, 2:43:04 PM Check for available updates on host BRCVN3 was completed successfully with message 'ovirt-host, cockpit-ovirt-dashboard, vdsm-client, ovirt-release43, ovirt-host, ovirt-hosted-engine-setup, vdsm-api, vdsm-jsonrpc, ovirt-ansible-hosted-engine-setup, ovirt-host-dependencies and 12 others. To see all packages check engine.log.'. oVirt Apr 17, 2019, 2:43:04 PM Host BRCVN3 has available updates: ovirt-host, cockpit-ovirt-dashboard, vdsm-client, ovirt-release43, ovirt-host, ovirt-hosted-engine-setup, vdsm-api, vdsm-jsonrpc, ovirt-ansible-hosted-engine-setup, ovirt-host-dependencies and 12 others. To see all packages check engine.log.. oVirt Apr 17, 2019, 2:27:39 PM Host BRCVN3's following network(s) are not synchronized with their Logical Network configuration: Public. oVirt Apr 16, 2019, 5:53:05 PM Failed to sync all host BRCVN3 networks c1ba631c-7be5-4be0-abbb-a37b6bb7d26d oVirt Apr 16, 2019, 5:53:05 PM (1/1): Failed to apply changes on host BRCVN3. (User: admin@internal-authz) 455a260f oVirt Apr 16, 2019, 5:53:05 PM VDSM BRCVN3 command HostSetupNetworksVDS failed: Bridge Public has interfaces set([u'vnet19', u'vnet12', u'vnet10', u'vnet11', u'vnet16', u'vnet17', u'vnet14', u'vnet15', u'vnet0', u'vnet2', u'vnet3', u'vnet4', u'vnet7', u'vnet8', u'vnet9']) connected oVirt Apr 16, 2019, 5:52:59 PM (1/1): Applying network's changes on host BRCVN3. (User: admin@internal-authz) 455a260f oVirt Apr 16, 2019, 5:32:07 PM Check for available updates on host BRCVN3 was completed successfully with message 'no updates found.'. oVirt Apr 16, 2019, 5:16:40 PM Host BRCVN3's following network(s) are not synchronized with their Logical Network configuration: Public. oVirt Apr 16, 2019, 3:33:36 PM Migration failed (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4). bd21f294-0170-47d1-845e-c64c52abbab4 oVirt Apr 16, 2019, 3:33:36 PM Migration started (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4, User: admin@internal-authz). bd21f294-0170-47d1-845e-c64c52abbab4 oVirt Apr 16, 2019, 2:49:36 PM Migration failed (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4). 7c04f7a6-8f88-4c64-99f9-e621724fc7ff oVirt Apr 16, 2019, 2:49:36 PM Migration started (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4, User: admin@internal-authz). 7c04f7a6-8f88-4c64-99f9-e621724fc7ff oVirt Apr 16, 2019, 2:22:03 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:11:02 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:10:02 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:05:46 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:03:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:02:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:00:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:59:01 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:57:31 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:57:05 PM

2 1

Re: Help with 4.3.3 re-setup
by Strahil 21 Apr '19

21 Apr '19

Hi Michael, I know how you feel abiut VDO. I wass in the same boat until I starrted using systemd's mount units.Since then I do not have any issues. For now try the following: Boot 1 host via rescue dvd , chroot into the system and install the vdo and kvdo packages (maybe reinstall is more correct) . Once then, try to run the vdo service (still in chroot) and try to make it work. Then, just rebuild the initramfs (dracut -f -k kernel-version) and reboot. Check if your VDO, bricks and Gluster are operational again. If yes, do the other nodes. Once done - run 'gluster volume heal my-volume full' (replace my-volume with actual name). This will force gluster to sync all bricks. P.S.: Now, I'm using gluster snapshot for recovery between engine upgrades (HostedEngine is stopped while makking the snapahot). Best Regards, Strahil NikolovOn Apr 21, 2019 20:44, michael(a)wanderingmad.com wrote: > > I updated my ovirt from 4.3.2 to 4.3.3 and everything went bad, my gluster volumes were constantly dropping out and getting unsynced and everything was just running slower than molasses. So I thought I would reload the hosts from ovirt node to Centos and re-do the storage, thinking that may help. I tried using centos, but I was never able to add centos hosts back to the ovirt engine due to a gluster error in the logs, so I went and downloaded ovirt node 4.3.3, and now after spending an hour reloading all the servers with ovirt node, One of the nodes I can't access the cockpit on, and the other two have broken VDO modules, the modules are installed but don't exist in the kernel, and when I removed the module, I lost all network configuration, and when I re-installed it, I get a scriptlet error on compilation and there is still a missing VDO module. This is now the 3rd time i've hit this VDO issue and i'm really frustrated right now, should I just go back to 4.3.2? I just redownloa > ded the latest 4.3.3 ISO today. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QA2SMYRZCXQYR…

1 0

Help with 4.3.3 re-setup
by michael＠wanderingmad.com 21 Apr '19

21 Apr '19

I updated my ovirt from 4.3.2 to 4.3.3 and everything went bad, my gluster volumes were constantly dropping out and getting unsynced and everything was just running slower than molasses. So I thought I would reload the hosts from ovirt node to Centos and re-do the storage, thinking that may help. I tried using centos, but I was never able to add centos hosts back to the ovirt engine due to a gluster error in the logs, so I went and downloaded ovirt node 4.3.3, and now after spending an hour reloading all the servers with ovirt node, One of the nodes I can't access the cockpit on, and the other two have broken VDO modules, the modules are installed but don't exist in the kernel, and when I removed the module, I lost all network configuration, and when I re-installed it, I get a scriptlet error on compilation and there is still a missing VDO module. This is now the 3rd time i've hit this VDO issue and i'm really frustrated right now, should I just go back to 4.3.2? I just redownloa ded the latest 4.3.3 ISO today.

1 0