April 2019 - Users - oVirt List Archives

Gluster and few iSCSI Datastores in one Data Center
by toslavik＠yandex.ru 23 Apr '19

23 Apr '19

I decided to add another cluster to the existing data center (Enable Virt Service + Enable Gluster Service). Three nodes. But after installing the nodes (without errors) Ovirt Engine loses them cyclically. From the logs you can see that this happens when you try to interrogate the connected block devices. These block devices are LVM for VM. I use several Datastores submitted via iSCSI. About 2000 virtual machines and more than 2300 LVMs. All in the neighbor cluster (one data center). Logs in https://drive.google.com/open?id=1ja7Usxx5YCFDgjD2X51z9tzn_ycPoC2g Why is this happening and what can be done in this case?

2 2

ovirt with kvm stand alone
by igalvarez＠gmail.com 23 Apr '19

23 Apr '19

I have 3 KVM stand alone servers with no external storage. My question is, can I add these 3 KVM servers to ovirt without impact on VMs already running on KVM side? Thanks.

3 3

Re: 4.3.x upgrade and issues with OVN
by Weber, Charles (NIH/NIA/IRP) [E] 23 Apr '19

23 Apr '19

Configuration with versions Next email will have log files. 2 sites First site: Bayview 4 nodes BL460 gen9 with 4 x 10G nics Node 1-3 have not been changed since 4.3.2 upgrade. These nodes have the network sync issue and cannot migrate VMs. OS Version: RHEL - 7 - 6.1810.2.el7.centos OS Description: CentOS Linux 7 (Core) Kernel Version: 3.10.0 - 957.10.1.el7.x86_64 KVM Version: 2.12.0 - 18.el7_6.3.1 LIBVIRT Version: libvirt-4.5.0-10.el7_6.6 VDSM Version: vdsm-4.30.11-1.el7 SPICE Version: 0.14.0 - 6.el7_6.1 CEPH Version: librbd1-10.2.5-4.el7 Open vSwitch Version: openvswitch-2.10.1-3.el7 Kernel Features: PTI: 1, IBRS: 0, RETP: 1 VNC Encryption: Disabled I evacuated node 4 and did update to 4.3.3, still had issues so tried ISO OVNode install. It does not have network sync issue. However I cannot upgrade all the nodes without scheduling cluster downtime. OS Version: RHEL - 7 - 6.1810.2.el7.centos OS Description: oVirt Node 4.3.3.1 Kernel Version: 3.10.0 - 957.10.1.el7.x86_64 KVM Version: 2.12.0 - 18.el7_6.3.1 LIBVIRT Version: libvirt-4.5.0-10.el7_6.6 VDSM Version: vdsm-4.30.13-1.el7 SPICE Version: 0.14.0 - 6.el7_6.1 CEPH Version: librbd1-10.2.5-4.el7 Open vSwitch Version: openvswitch-2.10.1-3.el7 Kernel Features: PTI: 1, IBRS: 0, RETP: 1, SSBD: 3 VNC Encryption: Disabled 1 engine, DL360g10. 4.3.3.5-1.el7 CentOS 7 patched up to today Storage: Dell Unity ISCSI What I see in the engine is that the first 3 nodes all have the public network listed as out of sync with the DC. I can migrate form node 4 to the other 3 nodes but cannot migrate off the other 3 nodes. I also cannot sync the network on the other three nodes. There have been no recent network changes. After the 4.3.3 upgrade I initially found some curious OVN errors in the logfile on nodes 3 and 4. Nodes 1 and 2 do not have these errors. However the engine did have 2 extra OVN ports defined. ovs-vsctl show be10cd3d-85fe-4985-9635-f447bfbc5e25 Bridge br-int fail_mode: secure Port "ovn-877214-0" Interface "ovn-877214-0" type: geneve options: {csum="true", key=flow, remote_ip="137.187.160.14"} error: "could not add network device ovn-877214-0 to ofproto (File exists)" Port "ovn-48e040-0" Interface "ovn-48e040-0" type: geneve options: {csum="true", key=flow, remote_ip="137.187.160.18"} Port "ovn-d6eaa1-0" Interface "ovn-d6eaa1-0" type: geneve options: {csum="true", key=flow, remote_ip="137.187.160.13"} error: "could not add network device ovn-d6eaa1-0 to ofproto (File exists)" Port br-int Interface br-int type: internal Port "ovn-f0f789-0" Interface "ovn-f0f789-0" type: geneve options: {csum="true", key=flow, remote_ip="137.187.160.13"} Second site:Harbor I upgraded to 4.3.2 and stopped any upgrades until I could deal with the migration and restarting VDSMD issues. Nodes are 3 supermicro 1U with 2x10G nics All 3 nodes are the same and from the 4.3.2 update. OS Version: RHEL - 7 - 6.1810.2.el7.centos OS Description: CentOS Linux 7 (Core) Kernel Version: 3.10.0 - 957.10.1.el7.x86_64 KVM Version: 2.12.0 - 18.el7_6.3.1 LIBVIRT Version: libvirt-4.5.0-10.el7_6.6 VDSM Version: vdsm-4.30.11-1.el7 SPICE Version: 0.14.0 - 6.el7_6.1 GlusterFS Version: [N/A] CEPH Version: librbd1-10.2.5-4.el7 Open vSwitch Version: openvswitch-2.10.1-3.el7 Kernel Features: PTI: 1, IBRS: 0, RETP: 1 VNC Encryption: Disabled 1 engine DL360 g10 with 2x10G nics running 4.3.2.1-1.el7 Storage: Dell Unity ISCSI The only issue with Harbor site while running 4.3.2 is that when I migrate a node it never finishes in the engine until I restart VDSMD on the original host. It did not exhibit this issue with 4.2.x

1 0

Undeploy oVirt Metrics Store
by toslavik＠yandex.ru 23 Apr '19

23 Apr '19

Deployed MetricStore on the engine and hosts as per the instructions. But using some time I realized that for me the functionality is redundant, enough data collected by DWH. https://www.ovirt.org/develop/release-management/features/metrics/metrics-s… Is there an instruction on how undeploy oVirt MetricStore?

2 4

Re: Issues post-upgrade from 4.2.8 to 4.3.2
by Vrgotic, Marko 23 Apr '19

23 Apr '19

Hey Shani, Thank you for the reply. This morning I have tried to re-provision HA Hosts. Managed successfully with HA host 2 and 3, about to do it with HA Host 1. If that goes well, I will repeat the exercises with Migration and Hosts updates to see if the issue is gone or still present. Upon those, I intend to provide full step-by-step of the Upgrade Procedure and after with what was done. Thank you for the patience. Marko Vrgotic From: Shani Leviim <sleviim(a)redhat.com> Date: Sunday, 21 April 2019 at 09:44 To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com> Subject: Re: [ovirt-users] Issues post-upgrade from 4.2.8 to 4.3.2 Hi Marko, I've noticed that the timestamp of the error from your engine.log is one hour delayed of the one from your ui log. Is this one intentioned? Also, can you please attach a screenshot? Thanks Regards, Shani Leviim On Sun, Apr 21, 2019 at 10:12 AM Vrgotic, Marko <M.Vrgotic(a)activevideo.com<mailto:M.Vrgotic@activevideo.com>> wrote: Dear oVirt team, We have 3 Hosts HA Cluster with SHE engine. Storage is NetApp. Recently we have executed an upgrade from 4.2.8 to 4.3.2. Since then we are seeing strange behavior when trying to put Hosts to Maintenance or manually Migrate VMs between Hosts. The most repeated WARN/ERROR I am observing is following: The UI is constantly throwing an exception when trying to put HA host to maintenance or increase the SPM level. The repeated log line from engine.log I see, with regards or failing to migrate all hosts is: 2019-04-18 13:05:30,760Z WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-83) [63d33dd1] Validation of action 'MigrateVm' failed for user SYSTEM. Reasons: VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL But there is more than enough. Also from UI.log: 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Permutation name: 0D2DB7A91B469CC36C64386E5632FAC5 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Uncaught exception: com.google.gwt.event.shared.Umbrell aException: Exception caught: (TypeError) : oab(...) is null at java.lang.Throwable.Throwable(Throwable.java:70) [rt.jar:1.8.0_201] at java.lang.RuntimeException.RuntimeException(RuntimeException.java:32) [rt.jar:1.8.0_201] at com.google.web.bindery.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:64) [gwt-servlet.jar:] at com.google.gwt.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:25) [gwt-servlet.jar:] at com.google.gwt.event.shared.HandlerManager.$fireEvent(HandlerManager.java:117) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.event.dom.client.DomEvent.fireNativeEvent(DomEvent.java:110) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.DOM.dispatchEvent(DOM.java:1415) [gwt-servlet.jar:] at com.google.gwt.user.client.impl.DOMImplStandard.dispatchEvent(DOMImplStandard.java:312) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Su/<(https://ovirt-staging-engine.avinity.tv/ovirt-engine/webadmin/?locale=en_US… line 9 > scriptElement) at Unknown.anonymous(Unknown) Caused by: com.google.gwt.core.client.JavaScriptException: (TypeError) : oab(...) is null at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.$onAddHost(ClusterGuideModel.java:533) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.executeCommand(ClusterGuideModel.java:617) at org.ovirt.engine.ui.uicommonweb.UICommand.$execute(UICommand.java:163) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget.$lambda$4(AbstractModelBoundPopupPresenterWidget.java:306) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget$lambda$4$Type.onClick(AbstractModelBoundPopupPresenterWidget.java:306) at com.google.gwt.event.dom.client.ClickEvent.dispatch(ClickEvent.java:55) [gwt-servlet.jar:] at com.google.gwt.event.shared.GwtEvent.dispatch(GwtEvent.java:76) [gwt-servlet.jar:] at com.google.web.bindery.event.shared.SimpleEventBus.$doFire(SimpleEventBus.java:173) [gwt-servlet.jar:] ... 12 more Can you give me some advice on how to proceed? This started happening since upgrade. Kindly awaiting your reply, Marko Vrgotic _______________________________________________ Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7SVM3XWFREH3W…

1 0

Re: Migrate HE between ISCSI storages
by Strahil 23 Apr '19

23 Apr '19

Hi, I think you can go to the disk section in UI and migrate the disk from 1 storage domain to another. Best Regards, Strahil Nikolov

3 2

Is there a way to tell whether a permission set for a VM is inherited using REST API?
by Anton E 23 Apr '19

23 Apr '19

Hi everyone! My question is in the subject for the most part. I'm trying to backup a vm parameters, including the linked attributes, namely the permissions. But I don't want the inherited permissions to be included into the backup, I only need the attributes specific to the vm. It looks like there is no difference between the inherited and the vm-specific permissions in the output from /ovirt-engine/api/vms/<vm-id>/permissions service. What is the best way to distinguish the specific permissions from the inherited ones? It seems I can follow the link to the particular permission and see whether the vm attribute is set on it and it points to the VM I need, but that would require numerous REST requests to be done. Is there a more elegant way? Maybe I can somehow filter the output of /ovirt-engine/api/vms/<vm-id>/permissions to only include the required info? Thanks in advance. Best regards, Anton.

4 5

oVirt 4.3.3 gluster option cluster.choose-local added to 'Optimize for Virt Store'
by Strahil Nikolov 22 Apr '19

22 Apr '19

Hello Community, can someone tell me why the option cluster.choose-local was added to "Optimize for Virt Store" ?Testing my cluster after the patching showed reduced performance , due to relying constantly on network instead of using local NVME brick.I have checked my older volumes and they did not have that option. Is there any benefit to not use the local brick ?Any issues to reset that option and use local brick for reading ? Best Regards,Strahil Nikolov

1 0

Re: Is there a way to tell whether a permission set for a VM is inherited using REST API?
by Tentaclius 22 Apr '19

22 Apr '19

Hi Shani, I'm aware of this attribute, but my understanding is it only applies for a vm to template or template to vm operations. I don't see how it can be used in order to get the list of vm-specific permissions for an existing VM. Could you please provide an example of that? Thanks and regards, Anton. On Mon, Apr 22, 2019 at 2:22 PM Shani Leviim <sleviim(a)redhat.com> wrote: > Hi Anton, > In that case, how about using this one: > http://ovirt.github.io/ovirt-engine-api-model/master/#services/vms/methods/… > > > *Regards,* > > *Shani Leviim* > > > On Mon, Apr 22, 2019 at 1:35 PM Tentaclius <tentaclius(a)gmail.com> wrote: > >> Hi Shani, >> >> thanks for your reply. >> >> My question is not about assigning permissions, but rather about querying >> permissions assigned to a given VM. >> I need to get a list of permissions, assigned to the VM without the >> permissions this VM inherits from parent objects. Unluckily for me the >> /ovirt-engine/api/vms/<vm-id>/permissions service returns the list >> containing both VM-specific and inherited permissions, which cannot be >> distinguished. >> >> Thanks and regards, >> Anton. >> >> On Mon, Apr 22, 2019 at 1:29 PM Shani Leviim <sleviim(a)redhat.com> wrote: >> >>> Hi Anton, >>> You can assign permissions to the VM by using the following syntax: >>> >>> POST /ovirt-engine/api/vms/ yyy/permissions >>> >>> <permission> >>> <role> >>> <name> username</name> >>> </role> >>> <user id=" xxx"/> >>> </permission> >>> >>> For further information, you can visit here: >>> http://ovirt.github.io/ovirt-engine-api-model/master/#services/assigned_per… >>> >>> Hope it helps! >>> >>> >>> *Regards,* >>> >>> *Shani Leviim* >>> >>> >>> On Mon, Apr 22, 2019 at 1:04 PM Anton E <tentaclius(a)gmail.com> wrote: >>> >>>> Hi everyone! >>>> >>>> My question is in the subject for the most part. >>>> I'm trying to backup a vm parameters, including the linked attributes, >>>> namely the permissions. But I don't want the inherited permissions to be >>>> included into the backup, I only need the attributes specific to the vm. It >>>> looks like there is no difference between the inherited and the vm-specific >>>> permissions in the output from /ovirt-engine/api/vms/<vm-id>/permissions >>>> service. >>>> >>>> What is the best way to distinguish the specific permissions from the >>>> inherited ones? It seems I can follow the link to the particular permission >>>> and see whether the vm attribute is set on it and it points to the VM I >>>> need, but that would require numerous REST requests to be done. Is there a >>>> more elegant way? Maybe I can somehow filter the output of >>>> /ovirt-engine/api/vms/<vm-id>/permissions to only include the required info? >>>> >>>> Thanks in advance. >>>> >>>> Best regards, >>>> Anton. >>>> _______________________________________________ >>>> Users mailing list -- users(a)ovirt.org >>>> To unsubscribe send an email to users-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct: >>>> https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives: >>>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/AVHAC4SSJWVYY… >>>> >>>

1 0

Import of VMs failing - 0% progress on qemu-img
by Callum Smith 22 Apr '19

22 Apr '19

Dear All, We've exported some VMs from our old oVirt infrastructure and want to import them into the new one, but qemu-img appears to be failing. We have mounted an export domain populated from the old oVirt in the new hosted engine and are using the GUI to import the VM. Manually running the command sits at 16% CPU, 0% network usage and no progress. It appears to lock the NFS mount and ls and lsof both hang. sudo -u vdsm /usr/bin/qemu-img convert -p -t none -T none -f raw <path to source> -O raw <path to dest> Conversely a simple cp will work (ruling out file permissions errors): sudo -u vddm cp <path to source> <path to test> What might we be doing wrong? Regards, Callum -- Callum Smith Research Computing Core Wellcome Trust Centre for Human Genetics University of Oxford e. callum(a)well.ox.ac.uk<mailto:callum@well.ox.ac.uk>

2 12

Can't create pool after update to 4.3.3
by kiv＠intercom.pro 22 Apr '19

22 Apr '19

Hi all. After update my oVirt to 4.3.3 i can't create new pool. I make new template and trying to create new pool - but can't select any template, selection field is empty. I have this error: Uncaught exception occurred. Please try reloading the page. Details: Exception caught: undefined Please have your administrator check the UI logs

3 4

4.3.x upgrade and issues with OVN
by Charles Weber 22 Apr '19

22 Apr '19

Hi everyone, We have had a pair of Ovirt clusters at work, starting with the 3.x. I replaced last year with 4.x cluster on new machines. 4.2 worked great, but when I upgraded to 4.3.2 and now .3 I immediately ran into host networking issues resulting in hung or unable totally to migrate VMs. Configuration notes: 1. I use commercial star.x.x.x SSL cert on engine installed per Ovirt.org instructions 2. I have 2 untagged NICs assigned to ovirtmgmt and Public, both on the same IP range network. I also have another set of VLANs tagged on various NICs. 1 cluster uses HP blades with lots of NICs, the other uses supermicro 1Us with only 2 NICs. 3. I upgraded both engines and hosts to 4.3.2 from 4.2.8. I started seeing hung migrations cleared by restarting vdsm. 4. All computers involved run current CentOS 7.6 5. Both clusters use iscsi on dedicated tagged storage VLAN, seems fine. 6. I upgraded 1 engine and 1 host to 4.3.3 and things got worse. I have not updated any hosts or the second engine since. 7. The 4 hosts on the 4.3.3 engine now have out of sync error that refuses to clear for my Public network. 8. 2 OV 4.3.2 nodes had the following errors with 2 ovn ports. Here is example, perhaps related to the genev_sys_6081 error. ovn-d6eaa1-0: attempting to add tunnel port with same config as port 'ovn-f0f789-0' (::->137.187.160.13 ovn-877214-0: attempting to add tunnel port with same config as port 'ovn-483528-0' 9. I deleted and uninstalled all ovirt related rpms on one node, then did clean node install using latest 4.3 release. Same errors. 10. I downloaded latest node iso, installed on same host, upgraded to to 4.3.3.1 node and joined cluster. The node installation has no errors and can migrate to my other hosts. All networks are in sync. The migration hangs. Restarting VDSMD clears the hung migration. 11. None of the other hosts can migrate VMs to the new node. Here are excerpts from 3.2 node on 3.3 engine log file. Apr 17, 2019, 2:43:04 PM Check for available updates on host BRCVN3 was completed successfully with message 'ovirt-host, cockpit-ovirt-dashboard, vdsm-client, ovirt-release43, ovirt-host, ovirt-hosted-engine-setup, vdsm-api, vdsm-jsonrpc, ovirt-ansible-hosted-engine-setup, ovirt-host-dependencies and 12 others. To see all packages check engine.log.'. oVirt Apr 17, 2019, 2:43:04 PM Host BRCVN3 has available updates: ovirt-host, cockpit-ovirt-dashboard, vdsm-client, ovirt-release43, ovirt-host, ovirt-hosted-engine-setup, vdsm-api, vdsm-jsonrpc, ovirt-ansible-hosted-engine-setup, ovirt-host-dependencies and 12 others. To see all packages check engine.log.. oVirt Apr 17, 2019, 2:27:39 PM Host BRCVN3's following network(s) are not synchronized with their Logical Network configuration: Public. oVirt Apr 16, 2019, 5:53:05 PM Failed to sync all host BRCVN3 networks c1ba631c-7be5-4be0-abbb-a37b6bb7d26d oVirt Apr 16, 2019, 5:53:05 PM (1/1): Failed to apply changes on host BRCVN3. (User: admin@internal-authz) 455a260f oVirt Apr 16, 2019, 5:53:05 PM VDSM BRCVN3 command HostSetupNetworksVDS failed: Bridge Public has interfaces set([u'vnet19', u'vnet12', u'vnet10', u'vnet11', u'vnet16', u'vnet17', u'vnet14', u'vnet15', u'vnet0', u'vnet2', u'vnet3', u'vnet4', u'vnet7', u'vnet8', u'vnet9']) connected oVirt Apr 16, 2019, 5:52:59 PM (1/1): Applying network's changes on host BRCVN3. (User: admin@internal-authz) 455a260f oVirt Apr 16, 2019, 5:32:07 PM Check for available updates on host BRCVN3 was completed successfully with message 'no updates found.'. oVirt Apr 16, 2019, 5:16:40 PM Host BRCVN3's following network(s) are not synchronized with their Logical Network configuration: Public. oVirt Apr 16, 2019, 3:33:36 PM Migration failed (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4). bd21f294-0170-47d1-845e-c64c52abbab4 oVirt Apr 16, 2019, 3:33:36 PM Migration started (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4, User: admin@internal-authz). bd21f294-0170-47d1-845e-c64c52abbab4 oVirt Apr 16, 2019, 2:49:36 PM Migration failed (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4). 7c04f7a6-8f88-4c64-99f9-e621724fc7ff oVirt Apr 16, 2019, 2:49:36 PM Migration started (VM: Hwebdev, Source: BRCVN3, Destination: BRCVN4, User: admin@internal-authz). 7c04f7a6-8f88-4c64-99f9-e621724fc7ff oVirt Apr 16, 2019, 2:22:03 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:11:02 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:10:02 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:05:46 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:03:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:02:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 2:00:16 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:59:01 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:57:31 PM VDSM BRCVN3 command Get Host Statistics failed: Internal JSON-RPC error: {'reason': '[Errno 19] genev_sys_6081 is not present in the system'} oVirt Apr 16, 2019, 1:57:05 PM

2 1

Re: Help with 4.3.3 re-setup
by Strahil 21 Apr '19

21 Apr '19

Hi Michael, I know how you feel abiut VDO. I wass in the same boat until I starrted using systemd's mount units.Since then I do not have any issues. For now try the following: Boot 1 host via rescue dvd , chroot into the system and install the vdo and kvdo packages (maybe reinstall is more correct) . Once then, try to run the vdo service (still in chroot) and try to make it work. Then, just rebuild the initramfs (dracut -f -k kernel-version) and reboot. Check if your VDO, bricks and Gluster are operational again. If yes, do the other nodes. Once done - run 'gluster volume heal my-volume full' (replace my-volume with actual name). This will force gluster to sync all bricks. P.S.: Now, I'm using gluster snapshot for recovery between engine upgrades (HostedEngine is stopped while makking the snapahot). Best Regards, Strahil NikolovOn Apr 21, 2019 20:44, michael(a)wanderingmad.com wrote: > > I updated my ovirt from 4.3.2 to 4.3.3 and everything went bad, my gluster volumes were constantly dropping out and getting unsynced and everything was just running slower than molasses. So I thought I would reload the hosts from ovirt node to Centos and re-do the storage, thinking that may help. I tried using centos, but I was never able to add centos hosts back to the ovirt engine due to a gluster error in the logs, so I went and downloaded ovirt node 4.3.3, and now after spending an hour reloading all the servers with ovirt node, One of the nodes I can't access the cockpit on, and the other two have broken VDO modules, the modules are installed but don't exist in the kernel, and when I removed the module, I lost all network configuration, and when I re-installed it, I get a scriptlet error on compilation and there is still a missing VDO module. This is now the 3rd time i've hit this VDO issue and i'm really frustrated right now, should I just go back to 4.3.2? I just redownloa > ded the latest 4.3.3 ISO today. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QA2SMYRZCXQYR…

1 0

Help with 4.3.3 re-setup
by michael＠wanderingmad.com 21 Apr '19

21 Apr '19

I updated my ovirt from 4.3.2 to 4.3.3 and everything went bad, my gluster volumes were constantly dropping out and getting unsynced and everything was just running slower than molasses. So I thought I would reload the hosts from ovirt node to Centos and re-do the storage, thinking that may help. I tried using centos, but I was never able to add centos hosts back to the ovirt engine due to a gluster error in the logs, so I went and downloaded ovirt node 4.3.3, and now after spending an hour reloading all the servers with ovirt node, One of the nodes I can't access the cockpit on, and the other two have broken VDO modules, the modules are installed but don't exist in the kernel, and when I removed the module, I lost all network configuration, and when I re-installed it, I get a scriptlet error on compilation and there is still a missing VDO module. This is now the 3rd time i've hit this VDO issue and i'm really frustrated right now, should I just go back to 4.3.2? I just redownloa ded the latest 4.3.3 ISO today.

1 0

Issues post-upgrade from 4.2.8 to 4.3.2
by Vrgotic, Marko 21 Apr '19

21 Apr '19

Dear oVirt team, We have 3 Hosts HA Cluster with SHE engine. Storage is NetApp. Recently we have executed an upgrade from 4.2.8 to 4.3.2. Since then we are seeing strange behavior when trying to put Hosts to Maintenance or manually Migrate VMs between Hosts. The most repeated WARN/ERROR I am observing is following: The UI is constantly throwing an exception when trying to put HA host to maintenance or increase the SPM level. The repeated log line from engine.log I see, with regards or failing to migrate all hosts is: 2019-04-18 13:05:30,760Z WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-83) [63d33dd1] Validation of action 'MigrateVm' failed for user SYSTEM. Reasons: VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 3824,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL But there is more than enough. Also from UI.log: 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Permutation name: 0D2DB7A91B469CC36C64386E5632FAC5 2019-04-18 14:05:09,007Z ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-114) [] Uncaught exception: com.google.gwt.event.shared.Umbrell aException: Exception caught: (TypeError) : oab(...) is null at java.lang.Throwable.Throwable(Throwable.java:70) [rt.jar:1.8.0_201] at java.lang.RuntimeException.RuntimeException(RuntimeException.java:32) [rt.jar:1.8.0_201] at com.google.web.bindery.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:64) [gwt-servlet.jar:] at com.google.gwt.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:25) [gwt-servlet.jar:] at com.google.gwt.event.shared.HandlerManager.$fireEvent(HandlerManager.java:117) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.event.dom.client.DomEvent.fireNativeEvent(DomEvent.java:110) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.DOM.dispatchEvent(DOM.java:1415) [gwt-servlet.jar:] at com.google.gwt.user.client.impl.DOMImplStandard.dispatchEvent(DOMImplStandard.java:312) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Su/<(https://ovirt-staging-engine.avinity.tv/ovirt-engine/webadmin/?locale=en_US… line 9 > scriptElement) at Unknown.anonymous(Unknown) Caused by: com.google.gwt.core.client.JavaScriptException: (TypeError) : oab(...) is null at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.$onAddHost(ClusterGuideModel.java:533) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterGuideModel.executeCommand(ClusterGuideModel.java:617) at org.ovirt.engine.ui.uicommonweb.UICommand.$execute(UICommand.java:163) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget.$lambda$4(AbstractModelBoundPopupPresenterWidget.java:306) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget$lambda$4$Type.onClick(AbstractModelBoundPopupPresenterWidget.java:306) at com.google.gwt.event.dom.client.ClickEvent.dispatch(ClickEvent.java:55) [gwt-servlet.jar:] at com.google.gwt.event.shared.GwtEvent.dispatch(GwtEvent.java:76) [gwt-servlet.jar:] at com.google.web.bindery.event.shared.SimpleEventBus.$doFire(SimpleEventBus.java:173) [gwt-servlet.jar:] ... 12 more Can you give me some advice on how to proceed? This started happening since upgrade. Kindly awaiting your reply, Marko Vrgotic

1 0

VM Snapshots not erasable and not bootable
by Jonathan Baecker 21 Apr '19

21 Apr '19

Hello, I make automatically backups of my VMs and last night there was making some new one. But somehow ovirt could not delete the snapshots anymore, in the log it show that it tried the hole day to delete them but they had to wait until the merge command was done. In the evening the host was totally crashed and started again. Now I can not delete the snapshots manually and I can also not start the VMs anymore. In the web interface I get the message: VM timetrack is down with error. Exit message: Bad volume specification {'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'serial': 'fd3b80fd-49ad-44ac-9efd-1328300582cd', 'index': 0, 'iface': 'scsi', 'apparentsize': '1572864', 'specParams': {}, 'cache': 'none', 'imageID': 'fd3b80fd-49ad-44ac-9efd-1328300582cd', 'truesize': '229888', 'type': 'disk', 'domainID': '9c3f06cf-7475-448e-819b-f4f52fa7d782', 'reqsize': '0', 'format': 'cow', 'poolID': '59ef3a18-002f-02d1-0220-000000000124', 'device': 'disk', 'path': '/rhev/data-center/59ef3a18-002f-02d1-0220-000000000124/9c3f06cf-7475-448e-819b-f4f52fa7d782/images/fd3b80fd-49ad-44ac-9efd-1328300582cd/47c0f42e-8bda-4e3f-8337-870899238788', 'propagateErrors': 'off', 'name': 'sda', 'bootOrder': '1', 'volumeID': '47c0f42e-8bda-4e3f-8337-870899238788', 'diskType': 'file', 'alias': 'ua-fd3b80fd-49ad-44ac-9efd-1328300582cd', 'discard': False}. When I check the path permission is correct and there are also files in it. Is there any ways to fix that? Or to prevent this issue in the future? In the attachment I send also the engine.log Regards Jonathan

2 10

Re: Ovirt gluster arbiter within hosted VM
by Strahil 20 Apr '19

20 Apr '19

With GlusterD2 , you can use thin arbiter - which can be deployed in the cloud. Do not try to setup regular arbiter far away from the data bicks or yoir performance will be awful. Best Regards, Strahil NikolovOn Apr 19, 2019 13:28, Alex K <rightkicktech(a)gmail.com> wrote: > > > > On Fri, Apr 19, 2019 at 1:14 PM Scott Worthington <scott.c.worthington(a)gmail.com> wrote: >> >> And where, magically, is that node's storage going to live? > > In the disk of the VM. Let me know if I need to clarify further. >> >> >> You can't fake a proper setup of gluster. > > Not trying to fake it. Trying to find a solution with the available options. >> >> >> On Fri, Apr 19, 2019, 5:00 AM Alex K <rightkicktech(a)gmail.com> wrote: >>> >>> Hi all, >>> >>> I have a two node hyper-converged setup which are causing me split-brains when network issues are encountered. Since I cannot add a third hardware node, I was thinking to add a dedicated guest VM hosted in same hyper-converged cluster which would do the arbiter for the volumes. >>> >>> What do you think about this setup in regards to stability and performance? >>> I am running ovirt 4.2. >>> >>> Thanx, >>> Alex >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/LTDOAMBKVE5BP…

2 1

Re: Ovirt gluster arbiter within hosted VM
by Strahil 20 Apr '19

20 Apr '19

As long as the VM is not hosted by those 2 hyperconverged nodes - there should be no problem. Another option is a small machine with a single SSD. I'm using Lenovo Tiny M-series as an arbiter. Best Regards, Strahil NikolovOn Apr 19, 2019 12:59, Alex K <rightkicktech(a)gmail.com> wrote: > > Hi all, > > I have a two node hyper-converged setup which are causing me split-brains when network issues are encountered. Since I cannot add a third hardware node, I was thinking to add a dedicated guest VM hosted in same hyper-converged cluster which would do the arbiter for the volumes. > > What do you think about this setup in regards to stability and performance? > I am running ovirt 4.2. > > Thanx, > Alex

1 0

Replica 3 distribute-replicated - data placement and fault tolerance
by Leo David 19 Apr '19

19 Apr '19

Hello Everyone, I did some fio performance tests on a particular vm and I have noticed things that I do not understand regarding how data is placed along the bricks. I am sure this is a lack of knowledge, but I would really appreciate any help in understanding this, I did a bit of research on the internet, but just could't find something relevant. I have one replica 3 distributed-replicated arbitrated volume, across 18 bricks ( 9 nodes, 2 jbods per node ). The volume was created as: node1 - brick1, node-2, brick1,.....node9-brick1, node1 - brick2, node-2, brick2,.....node9-brick2 As far as i've understood, under the hood there are sets of 3 times replicated data ( subvolumes ) which are assigned to the first 3 bricks, next set of replicated data to the next set of 3 bricks, and so on.. Now, I have this testing vm runign one node one. When I've started the fio test, i've noticed incresed gluster traffic from node 1 to node2,4 and 5 So I assumed that the vm disk is data resides on a subvolume allocated to bricks from these hosts. Then I have migrated the vm on node 2, and did the same test. Now the increased treffic is generated from node2 to node1, 4, and 5.. What I do not understand is: - why gluster client ( ovirt host ) is sending data to 3 bricks if the volume is arbitrated - shouldn't it send only to 2 of them ? - why are there 4 brick implicated in this subvolume - what would it be the fault tolerance level in this setup ,ie: how many hosts can I take down and still having the volume serving IO requests; can they be random ? I am sorry for my lack of knowledge, I am just trying to understand what is happening so I can deploy a decent proper setup of an hci environment. Thank you, Leo -- Best regards, Leo David

1 0

Re: Ovirt gluster arbiter within hosted VM
by Alex K 19 Apr '19

19 Apr '19

On Fri, Apr 19, 2019 at 1:14 PM Scott Worthington < scott.c.worthington(a)gmail.com> wrote: > And where, magically, is that node's storage going to live? > In the disk of the VM. Let me know if I need to clarify further. > > You can't fake a proper setup of gluster. > Not trying to fake it. Trying to find a solution with the available options. > > On Fri, Apr 19, 2019, 5:00 AM Alex K <rightkicktech(a)gmail.com> wrote: > >> Hi all, >> >> I have a two node hyper-converged setup which are causing me split-brains >> when network issues are encountered. Since I cannot add a third hardware >> node, I was thinking to add a dedicated guest VM hosted in same >> hyper-converged cluster which would do the arbiter for the volumes. >> >> What do you think about this setup in regards to stability and >> performance? >> I am running ovirt 4.2. >> >> Thanx, >> Alex >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/users@ovirt.org/message/LTDOAMBKVE5BP… >> >

1 0

Ovirt gluster arbiter within hosted VM
by Alex K 19 Apr '19

19 Apr '19

Hi all, I have a two node hyper-converged setup which are causing me split-brains when network issues are encountered. Since I cannot add a third hardware node, I was thinking to add a dedicated guest VM hosted in same hyper-converged cluster which would do the arbiter for the volumes. What do you think about this setup in regards to stability and performance? I am running ovirt 4.2. Thanx, Alex

1 0

Ovirt-engine self hostd
by Dennis Perfors 19 Apr '19

19 Apr '19

Hi, We have build Ovirt-engine self hosted. We have created 2 vlans 1 services and 1 student. This works good. Services vlan 192.168.60.0/24 gateway ip 192.168.60.1 on this card Student vlan 192.168.10.0/24 gateway ip 192.168.10.1 on this network card Everything seems to be oke, but the probem is on the vlan. On the node 192.168.60.3, there is no internet connection when we do yum update -y But there is no internet connection on the host. I cant do yum update -y or do anything else. Here more information: ^Chttp://mirror.cj2.nl/centos/7.6.1810/extras/x86_64/repodata/repomd.xml: [Errno 14] curl#56 - "Callback aborted" Trying other mirror. ^Chttp://mirror.sitbv.nl/centos/7.6.1810/extras/x86_64/repodata/repomd.xml: [Errno 14] curl#56 - "Callback aborted" Trying other mirror. http://mirror.serverius.net/centos/7.6.1810/extras/x86_64/repodata/repomd.x…: [Errno 14] curl#7 - "Failed to connect to 2a03:3f40:1::15: Network is unreachable" [root@bastion ~]# ping nu.nl PING nu.nl (52.85.140.48) 56(84) bytes of data. 64 bytes from server-52-85-140-48.man50.r.cloudfront.net (52.85.140.48): icmp_seq=1 ttl=241 time=12.8 ms ^C [root@bastion ~]# ping alibabia.com PING alibabia.com (137.175.26.243) 56(84) bytes of data. 64 bytes from 137.175.26.243 (137.175.26.243): icmp_seq=1 ttl=115 time=144 ms 64 bytes from 137.175.26.243 (137.175.26.243): icmp_seq=2 ttl=115 time=144 ms ^C ipv4.method: manual ipv4.dns: 1.1.1.1 ipv4.dns-search: -- ipv4.dns-options: "" ipv4.dns-priority: 0 ipv4.addresses: 192.168.60.3/24 ipv4.gateway: 192.168.60.1 ipv4.routes: -- ipv4.route-metric: -1 ipv4.route-table: 0 (unspec) ipv4.ignore-auto-routes: no ipv4.ignore-auto-dns: no public (active) target: default icmp-block-inversion: no interfaces: ovirtmgmt sources: services: ssh dhcpv6-client ovirt-postgres ovirt-https ovn-central-firewall-service ovirt-fence-kdump-listener ovirt-imageio-proxy ovirt-websocket-proxy ovirt-http ovirt-vmconsole-proxy ovirt-provider-ovn https http cockpit libvirt-tls snmp vdsm ovirt-imageio ovirt-vmconsole ports: 9986/tcp 22/tcp 6081/udp 6100/tcp protocols: masquerade: yes forward-ports: port=1337:proto=tcp:toport=22:toaddr=192.168.60.3 port=80:proto=tcp:toport=80:toaddr=192.168.60.5 source-ports: icmp-blocks: rich rules: rule family="ipv4" source address="0.0.0.0/24" accept [root@athena ~]# Portfowarding also works to the host 192.168.60.3. so that is no poiint. But only traffic from the insidehost to outside is not working. Thanks

1 0

Rebrandind Problems
by siovelrm＠gmail.com 19 Apr '19

19 Apr '19

hello I made a rebranding of my ovirt 4.3.2, but something went wrong and I saved it from the original incorrectly without realizing it. Please I need the original "ovirt.brand" and "ovirt" directories when ovirt 4.3.2 is installed. Where can I get them to be able to restore them? Greetings

2 1

Re: Expand existing gluster storage in ovirt 4.2/4.3
by Strahil 18 Apr '19

18 Apr '19

Recently , it was discussed in the mailing lists and dev mentioned that distributed replicated volumes are not officially supported, but some users use them. Even if not supported, it still should work without issues.If you think not to go this way, you can create a new 3 node cluster which will be fully suppported. Otherwise, if you go towards replicated distributed volumes , you just need to provide another set of 3 bricks and once added you can rebalance in order to distribute the files accross the sets. Here is an old thread that describes it for replica 2 volume types: https://lists.gluster.org/pipermail/gluster-users/2011-February/006599.html I guess I have confused you with my last e-mail, but that was not intentionable. Best Regards, Strahil NikolovOn Apr 17, 2019 17:13, adrianquintero(a)gmail.com wrote: > > Hi Strahil, > I had a 3 node Hyperconverged setup and added 3 new nodes to the cluster for a total of 6 servers. I am now taking advantage of more compute power, however the gluster storage part is what gets me. > > Current Hyperconverged setup: > - host1.mydomain.com > Bricks: > engine > data1 > vmstore1 > - host2.mydomain.com > Bricks: > engine > data1 > vmstore1 > - host3.mydomain.com > Bricks: > engine > data1 > vmstore1 > > - host4.mydomain.com > Bricks: > > - host5.mydomain.com > Bricks: > > - host6.mydomain.com > Bricks: > > > As you can see from the above, the original first 3 servers are the only ones that contain the gluster storage bricks, so storage redundancy is not set across all 6 nodes. I think it is a lack of understanding from my end on how ovirt and gluster integrate with one another so have a few questions: > > How would I go about achieving storage redundancy across all nodes? > Do I need to configure gluster volumes manually through the OS CLI? > If I configure the fail storage scenario manually will oVirt know about it? > > Again I know that the bricks must be added in sets of 3 and per the first 3 nodes my gluster setup looks like this (all done by hyperconverged seup in ovirt): > engine volume: host1:brick1, host2:brick1, host3:brick1 > data1 volume: host1:brick2, host2:brick2, host3:brick2 > vmstore1 volume: host1:brick3, host2:brick3, host3:brick3 > > So after adding the 3 new servers I dont know if I need to do something similar to the example in https://medium.com/@tumballi/scale-your-gluster-cluster-1-node-at-a-time-62…, if I do a similar change will oVirt know about it? will it be able to handle it as hyperconverged? > > As I mentioned before I normally see 3 node hyperconverged setup examples with gluster but have not found one for 6, 9 or 12 node cluster. > > Thanks again. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/U5T7TCSP4HFB2…

1 0

Ovirt Host Replacement/Rebuild
by Jim Kusznir 18 Apr '19

18 Apr '19

Hi all: I had an unplanned power outage (generator failed to start, power failure lasted 3 min longer than UPS batteries). One node didn't survive the unplanned power outage. By that, I mean it kernel panic's on boot, and I haven't been able to capture the KP or the first part of it (just the end), and so I don't truely know what the root cause is. I have validated the hardware is just fine, so its got to be an OS corruption. Based on this, I was thinking that perhaps the easiest way to recover would simply be to delete the host from the cluster, reformat and reinstall this host, and then add it back to the cluster as a new host. Is this in fact a good idea? Are there any references to how to do this (the detailed steps so I don't mess it up)? My cluster is (was) a 3 node hyperconverged cluster with gluster used for the management node. I also have a gluster share for VMs, but I use an NFS share from a NAS for that (which I will ask about in another post). Thanks for the help! --Jim

2 1

Importing existing GlusterFS
by Zryty ADHD 18 Apr '19

18 Apr '19

Hi, I have a questiion about that. I Install Ovirt 4.3.3 on Rhel 7.6 and want to import my existing GlusterFs cluster to it but i can't find option to do that. Can anyone explain me how to do that or its not possible in this version ?

3 5

oVirt and NetApp NFS storage
by klaasdemter＠gmail.com 18 Apr '19

18 Apr '19

Hi, I got a question regarding oVirt and the support of NetApp NFS storage. We have a MetroCluster for our virtual machine disks but a HA-Failover of that (active IP gets assigned to another node) seems to produce outages too long for sanlock to handle - that affects all VMs that have storage leases. NetApp says a "worst case" takeover time is 120 seconds. That would mean sanlock has already killed all VMs. Is anyone familiar with how we could setup oVirt to allow such storage outages? Do I need to use another type of storage for my oVirt VMs because that NFS implementation is unsuitable for oVirt? Greetings Klaas

2 4

what is the best solution for gluster?
by Edoardo Mazza 18 Apr '19

18 Apr '19

Hi all, I have 4 nodes with ovirt and gluster and I must create a new gluster volume, but I would know which is the best solution to have a high avaibility, best performance without wasting much space in the disk. Thanks for suggestions Edoardo

1 0

Changing from thin provisioned to preallocated?
by Wesley Stewart 18 Apr '19

18 Apr '19

I am currently running a ZFS server (Running RaidZ2) and I have been experimenting with NFS and shares to host my guests. I am currently running oVirt 4.2.8 and using a RaidZ2 NFS mount for the guests. ZFS definitely is definitely pretty awful (At least in my experience so far) for hosting VMs. I believe this is due to the synchronous writes being performed. However, I think running an iSCSI target with Synchronization disabled over a 10Gb connection might do the trick. (I have a couple of mirroed SSD drives for performance if I need it, but the RaidZ2 crawls for disk speed). When I tried to migrate a thin provisioned guest to iSCSI, I keep getting an "Out of disk space error" which I am pretty sure is due to the block style storage on the iSCSI target. Is there a way to switch from Thin to Preallocated? Or is my best bet to try and take a snapshot and clone this into a pre-allocated disk?

3 3

[ANN] ovirt 4.3.3 async update is now available
by Sandro Bonazzola 17 Apr '19

17 Apr '19

The oVirt Team has just released a new version of the following packages: - cockpit-ovirt-0.12.8 - ovirt-release43-4.3.3.1 - oVirt Node The async release addresses the following bugs: Bug 1697965 <https://bugzilla.redhat.com/show_bug.cgi?id=1697965> - [gluster-ansible] Order of the hosts are not preserved, when creating the volume This fix is relevant only on new deployments. -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

Re: Expand existing gluster storage in ovirt 4.2/4.3
by Strahil 17 Apr '19

17 Apr '19

You can have hyperconverged setup, but the number of bricks should be multiplied by 3. Best Regards, Strahil NikolovOn Apr 11, 2019 14:52, adrianquintero(a)gmail.com wrote: > > Thank you for the explanation, so from my understanding we can't have a hyperconverged setup if more that 3 nodes are required? or is it possible if gluster is setup separate of the oVirt node installs? > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/77URQGHY7LBF4…

2 1

Problem trying to detach ISO datastore
by Eduardo Mayoral 17 Apr '19

17 Apr '19

Hi. When trying to detach an ISO datastore I get the following error. Also fails if I try to switch the datastore from maintenance to active. 2019-04-17 10:07:23,100+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.01 seconds (__init__:312) 2019-04-17 10:07:23,104+0000 INFO (jsonrpc/4) [vdsm.api] START detachStorageDomain(sdUUID=u'2722942e-0887-439c-81f0-70b60d860060', spUUID=u'6901a281-c414-42c6-8b41-3cf6e6bcd788', msdUUID=u'00000000-0000-0000-0000-000000000000', masterVersion=14, options=None) from=::fff f:10.5.72.63,58618, flow_id=0420c8d0-fb37-4b22-9fea-9ee8bac7d41d, task_id=9301405a-eaf6-4f1c-a1b6-6537740e2daf (api:48) 2019-04-17 10:07:23,105+0000 INFO (jsonrpc/4) [storage.StoragePool] sdUUID=2722942e-0887-439c-81f0-70b60d860060 spUUID=6901a281-c414-42c6-8b41-3cf6e6bcd788 (sp:1048) 2019-04-17 10:07:23,316+0000 INFO (itmap/0) [IOProcessClient] (/pre1-svm-templates.por-ngcs.lan:_ds__pre1__templates__iso01_ovirt3) Starting client (__init__:308) 2019-04-17 10:07:23,324+0000 INFO (itmap/1) [IOProcessClient] (/pre1-svm-templates.por-ngcs.lan:_ds__pre1__templates__iso01_ovirt) Starting client (__init__:308) 2019-04-17 10:07:23,327+0000 INFO (ioprocess/74639) [IOProcess] (/pre1-svm-templates.por-ngcs.lan:_ds__pre1__templates__iso01_ovirt3) Starting ioprocess (__init__:434) 2019-04-17 10:07:23,333+0000 INFO (ioprocess/74645) [IOProcess] (/pre1-svm-templates.por-ngcs.lan:_ds__pre1__templates__iso01_ovirt) Starting ioprocess (__init__:434) 2019-04-17 10:07:23,335+0000 INFO (jsonrpc/4) [IOProcessClient] (2722942e-0887-439c-81f0-70b60d860060) Starting client (__init__:308) 2019-04-17 10:07:23,344+0000 INFO (ioprocess/74653) [IOProcess] (2722942e-0887-439c-81f0-70b60d860060) Starting ioprocess (__init__:434) 2019-04-17 10:07:23,350+0000 INFO (jsonrpc/4) [storage.StorageDomain] Removing remnants of deleted images [] (fileSD:740) 2019-04-17 10:07:23,352+0000 INFO (jsonrpc/4) [vdsm.api] FINISH detachStorageDomain error=Storage domain not in pool: u'domain=2722942e-0887-439c-81f0-70b60d860060, pool=6901a281-c414-42c6-8b41-3cf6e6bcd788' from=::ffff:10.5.72.63,58618, flow_id=0420c8d0-fb37-4b22-9fea- 9ee8bac7d41d, task_id=9301405a-eaf6-4f1c-a1b6-6537740e2daf (api:52) 2019-04-17 10:07:23,352+0000 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='9301405a-eaf6-4f1c-a1b6-6537740e2daf') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in detachStorageDomain File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 891, in detachStorageDomain pool.detachSD(sdUUID) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 1053, in detachSD self.validateAttachedDomain(dom) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 551, in validateAttachedDomain raise se.StorageDomainNotInPool(self.spUUID, dom.sdUUID) StorageDomainNotInPool: Storage domain not in pool: u'domain=2722942e-0887-439c-81f0-70b60d860060, pool=6901a281-c414-42c6-8b41-3cf6e6bcd788' 2019-04-17 10:07:23,352+0000 INFO (jsonrpc/4) [storage.TaskManager.Task] (Task='9301405a-eaf6-4f1c-a1b6-6537740e2daf') aborting: Task is aborted: "Storage domain not in pool: u'domain=2722942e-0887-439c-81f0-70b60d860060, pool=6901a281-c414-42c6-8b41-3cf6e6bcd788'" - co de 353 (task:1181) 2019-04-17 10:07:23,353+0000 ERROR (jsonrpc/4) [storage.Dispatcher] FINISH detachStorageDomain error=Storage domain not in pool: u'domain=2722942e-0887-439c-81f0-70b60d860060, pool=6901a281-c414-42c6-8b41-3cf6e6bcd788' (dispatcher:83) 2019-04-17 10:07:23,353+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StorageDomain.detach failed (error 353) in 0.25 seconds (__init__:312) 2019-04-17 10:07:26,275+0000 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::ffff:10.5.72.63,58604 (api:48) 2019-04-17 10:07:26,275+0000 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::ffff:10.5.72.63,58604 (api:54) 2019-04-17 10:07:26,275+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:312) 2019-04-17 10:07:29,675+0000 INFO (jsonrpc/7) [api.host] START getStats() from=::ffff:10.5.72.63,58604 (api:48) 2019-04-17 10:07:29,739+0000 INFO (jsonrpc/7) [vdsm.api] START repoStats(domains=()) from=::ffff:10.5.72.63,58604, task_id=3ec94f9f-7c98-4c49-8710-ffbfd9910ff2 (api:48) 2019-04-17 10:07:29,739+0000 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={u'a97bbda5-33e4-4e78-890c-f7d2a572179e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000505524', 'lastCheck': '3.6', 'valid': True}, u'4121f681-45c3-413a-9c6e-6 9d154710ace': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000790301', 'lastCheck': '2.7', 'valid': True}} from=::ffff:10.5.72.63,58604, task_id=3ec94f9f-7c98-4c49-8710-ffbfd9910ff2 (api:54) 2019-04-17 10:07:29,740+0000 INFO (jsonrpc/7) [vdsm.api] START multipath_health() from=::ffff:10.5.72.63,58604, task_id=f567e03a-8cf4-49dd-84eb-628acb10e1d3 (api:48) 2019-04-17 10:07:29,740+0000 INFO (jsonrpc/7) [vdsm.api] FINISH multipath_health return={} from=::ffff:10.5.72.63,58604, task_id=f567e03a-8cf4-49dd-84eb-628acb10e1d3 (api:54) Interestingly, I have 2 datacenters, I can attach, detach, set to maintenance or activate this same datastore on the second datacenter, but not on this one. So far I have tried updating OVF, setting master datastore and hosts to maintenance and re-activating them. Started happening on 4.3.2, updating to 4.3.3 makes no difference. This is what I see on the database. Looks OK to me: engine=# select * from storage_pool; id | name | description | storage_pool_type | storage_pool_format_type | status | master_domain_version | spm_vds_id | compatibility_version | _create_date | _update_date | quota_enforcement_type | free_text_comment | is_local --------------------------------------+-------------------+-------------+-------------------+--------------------------+--------+-----------------------+--------------------------------------+-----------------------+-------------------------------+----------------------- --------+------------------------+-------------------+---------- 039aef77-77c8-4f04-8d17-22f4b655df28 | dc-pre1-vc03-cl02 | | | 4 | 1 | 1 | 42c969f3-a2a6-4784-8506-e6fbc731da9d | 4.3 | 2019-03-14 12:13:24.411468+00 | 2019-04-17 08:38:05.53 8042+00 | 0 | | f 6901a281-c414-42c6-8b41-3cf6e6bcd788 | dc-pre1-vc03-cl01 | | | 4 | 1 | 15 | 089cdde4-ecbf-4054-82f9-c106b046d73a | 4.3 | 2019-03-14 12:13:24.365529+00 | 2019-04-17 11:10:46.42 2305+00 | 0 | | f (2 rows) engine=# select * from storage_pool_iso_map ; storage_id | storage_pool_id | status --------------------------------------+--------------------------------------+-------- 2722942e-0887-439c-81f0-70b60d860060 | 039aef77-77c8-4f04-8d17-22f4b655df28 | 6 2722942e-0887-439c-81f0-70b60d860060 | 6901a281-c414-42c6-8b41-3cf6e6bcd788 | 6 5d390949-24ec-45e2-bb6d-43b3f30bd286 | 039aef77-77c8-4f04-8d17-22f4b655df28 | 3 94cb1a4f-a267-479c-88e7-ea9c32e3fd24 | 039aef77-77c8-4f04-8d17-22f4b655df28 | 3 4121f681-45c3-413a-9c6e-69d154710ace | 6901a281-c414-42c6-8b41-3cf6e6bcd788 | 3 a97bbda5-33e4-4e78-890c-f7d2a572179e | 6901a281-c414-42c6-8b41-3cf6e6bcd788 | 3 (6 rows) Apart from root cause. I would be interested in recovering from the error, detaching the ISO storage, even if it is manually. This datacenter is not in production yet, so I have options on the things I can try. -- Eduardo Mayoral Jimeno Systems engineer, platform department. Arsys Internet. emayoral(a)arsys.es - +34 941 620 105 - ext 2153

1 1

Re: restore from dump
by Yedidyah Bar David 17 Apr '19

17 Apr '19

On Tue, Apr 16, 2019 at 10:10 PM Florian Rädler <Florian.Raedler(a)deutschebahn.com> wrote: > > Hi, > > > > is it possible to restore an engine from dump file? Define "restore an engine" and "dump file". Assuming "restore an engine" means "Install a fresh OS+engine and make it behave like an old one", and "dump file" being a pg_dump dump file, the answer is "not easily, and not fully". You will have to do something like: 1. Install OS+engine 2. Manually provision PG (init, create user/db, etc) 3. Restore your dump (pg_restore or psql, depending on format). Use the user you created, not postgres, for restoring - this will have much better chances to get permissions right 4. Run engine-setup and provide it the credentials of the database you restored It should mostly work, and I heard about people doing that, although didn't try this myself. Notably, you will have to reinstall all your hosts (move to maintenance, reinstall). If you have also a backup of /etc, that's a different case. Then, you can selectively restore files there before engine-setup. To see a list of the files you should restore, check the source of the engine-backup script - it has an internal variable called 'BACKUP_PATHS'. Good luck and best regards, -- Didi

2 1

VM migrations failing after upgrade 4.3.2 -> 4.3.3
by Eduardo Mayoral 17 Apr '19

17 Apr '19

Hi, After upgrade to 4.3.3 from 4.3.2, VM migrations are failing with "No available host to migrate VMs to" Interestingly, this happens in one of our clusters, not on the other. Both on the same datacenter, both in 4.3 compatibility version. This are the relevant lines from /var/log/ovirt-engine/engine.log 2019-04-17 08:58:41,816Z ERROR [org.ovirt.engine.core.bll.GetValidHostsForVmsQuery] (default task-7) [51191ffb-0ae1-4414-8916-9e5012d86289] Query 'GetValidHostsForVmsQuery' failed: null 2019-04-17 08:58:41,816Z ERROR [org.ovirt.engine.core.bll.GetValidHostsForVmsQuery] (default task-7) [51191ffb-0ae1-4414-8916-9e5012d86289] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.scheduling.SchedulingManager.subtractRunningVmResources(SchedulingManager.java:923) [bll.jar:] at org.ovirt.engine.core.bll.scheduling.SchedulingManager.canSchedule(SchedulingManager.java:616) [bll.jar:] at org.ovirt.engine.core.bll.GetValidHostsForVmsQuery.lambda$getValidHosts$0(GetValidHostsForVmsQuery.java:56) [bll.jar:] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_201] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_201] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_201] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_201] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_201] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_201] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_201] at org.ovirt.engine.core.bll.GetValidHostsForVmsQuery.getValidHosts(GetValidHostsForVmsQuery.java:59) [bll.jar:] at org.ovirt.engine.core.bll.GetValidHostsForVmsQuery.executeQueryCommand(GetValidHostsForVmsQuery.java:36) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:106) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendQueryExecutor.execute(DefaultBackendQueryExecutor.java:14) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:521) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:490) [bll.jar:] at sun.reflect.GeneratedMethodAccessor168.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:92) [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.interceptorChainCompleted(WeldInvocationContextImpl.java:107) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:126) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12) [common.jar:] at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.invokeNext(WeldInvocationContextImpl.java:92) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:124) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.bean.InterceptorImpl.intercept(InterceptorImpl.java:105) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:82) [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final] at org.jboss.as.weld.interceptors.EjbComponentInterceptorSupport.delegateInterception(EjbComponentInterceptorSupport.java:60) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:77) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:89) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:102) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor167.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:216) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:418) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:148) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.module.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:81) [weld-ejb-3.0.5.Final.jar:3.0.5.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:618) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view2.runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.api.restapi.resource.BackendResource.runQuery(BackendResource.java:82) at org.ovirt.engine.api.restapi.resource.BackendResource.getBackendCollection(BackendResource.java:152) at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.getBackendCollection(AbstractBackendCollectionResource.java:68) at org.ovirt.engine.api.restapi.resource.BackendHostsResource.listAll(BackendHostsResource.java:83) at org.ovirt.engine.api.restapi.resource.BackendHostsResource.list(BackendHostsResource.java:54) at org.ovirt.engine.api.resource.HostsResource.doList(HostsResource.java:130) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_201] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:137) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:100) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:791) [jboss-servlet-api_4.0_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209) at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:223) at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:149) at io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111) at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:178) at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117) at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111) at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:283) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:360) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:830) at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378) at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] 2019-04-17 08:58:41,831Z ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-7) [] Operation Failed: 2019-04-17 08:58:41,831Z ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-7) [] Exception: org.ovirt.engine.api.restapi.resource.BaseBackendResource$BackendFailureException: at org.ovirt.engine.api.restapi.resource.BackendResource.backendFailure(BackendResource.java:412) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.resource.BackendResource.getBackendCollection(BackendResource.java:155) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.getBackendCollection(AbstractBackendCollectionResource.java:68) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.resource.BackendHostsResource.listAll(BackendHostsResource.java:83) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.resource.BackendHostsResource.list(BackendHostsResource.java:54) [restapi-jaxrs.jar:] at org.ovirt.engine.api.resource.HostsResource.doList(HostsResource.java:130) [restapi-definition.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_201] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:137) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:100) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:791) [jboss-servlet-api_4.0_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:223) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:149) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:178) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35) [aaa.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111) [restapi-jaxrs.jar:] at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102) [restapi-jaxrs.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:283) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) [undertow-servlet-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.Connectors.executeRootHandler(Connectors.java:360) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:830) [undertow-core-2.0.15.Final.jar:2.0.15.Final] at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378) at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] -- Eduardo Mayoral Jimeno Systems engineer, platform department. Arsys Internet. emayoral(a)arsys.es - +34 941 620 105 - ext 2153

2 2

Inconsistencies beteween WebUI, API read verbs and API write verbs
by Baptiste Agasse 17 Apr '19

17 Apr '19

Hi All, As I stated in a previous thread, we use instances types and wanted to automate some parts to manage it [1]. Thansk to ovirt-orb/lago and pointers given in the last thread, I'm working on ansible an module to manage ovirt instance types, but I'm facing some troubles for some of instance type attributes. From the API, I don't have access to all fields provided via WebUI (eg: Custom Emulated Machine), and it seems that some fields can be added/updated via the API but are not part of the response when you read an instance type (eg: VirtIO-SCSI Enabled). Provided examples are not exhaustive. I tried to find my way in the oVirt engine code-base to see if the fix will be easy for a non java developer like me. I find, I think, that it seems to be some API definitions for instance type [2] that define, if I understand it well, all verbs that can be applied to each resource and what field can be put when adding an instance type, but nothing about fields to be included when you read a resource (and I'm not sure if its related to v4 API). I find also some java code [3] [4] that seems related to this but As I'm not a java developer, its a little bit difficult for me to find my path in it. For me this inconsistencies are a bug, but as you stated that instance types are in deep maintenance mode, do you think that bug will get some attention ? My objective is to have a ansible module that manage the hardware/bios related stuff (memory, boot sequence, scsi controller, bios type, almost all the things) and HA for instance type. Have a nice day. Cheers. [1]: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TJAXYBMSIAAAY… [2]: https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/r… [3]: https://github.com/oVirt/ovirt-engine/blob/ede62008318d924556bc9dfc5710d90e… [4]: https://github.com/oVirt/ovirt-engine/blob/ede62008318d924556bc9dfc5710d90e… [5]: https://ovirt.github.io/ovirt-engine-sdk/4.1/types.m.html#ovirtsdk4.types.I… -- Baptiste

2 2

oVirt nVidia vGPU driver questions
by femi adegoke 17 Apr '19

17 Apr '19

I'm on oVirt 4.2.6. 1) If I have a Tesla P4 (Pascal) GPU (non-GRID), do I use nVidia vGPU driver for RHEL KVM 6.2 or the Linux KVM vGPU 6.2 driver? 2) If I have a Grid K1 or K2, I assume the correct driver would be GRID 4.7? 3) Must the vGPU driver be installed on the host & in the vm? 4) Must the vGPU driver be installed first before I can run "yum -y install vdsm-hook-vfio-mdev”

5 6

oVirt 4.3 IPv6 only networking - some basic flows demonstration
by Eitan Raviv 16 Apr '19

16 Apr '19

Hi, I posted a video [1] with a short demo about flows that since 4.3 support IPv6 only networking. Enjoy... Thanks [1] https://youtu.be/h45dY4LA0CI

1 0

restore from dump
by Florian Rädler 16 Apr '19

16 Apr '19

Hi, is it possible to restore an engine from dump file? Thanks for your help. ________________________________ Pflichtangaben anzeigen<http://www.deutschebahn.com/pflichtangaben/20190408> Nähere Informationen zur Datenverarbeitung im DB-Konzern finden Sie hier: http://www.deutschebahn.com/de/konzern/datenschutz

1 0

Cant install oVirt hosted engine 4.3
by dskryminskiy＠devexperts.com 16 Apr '19

16 Apr '19

I do a fresh install oVirt 4.3 on CentOS 7.6.1810, but in the end of playbook it falls down: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The system may not be provisioned according to the playbook results: please check the logs for the issue, fix accordingly or re-deploy from scratch.\n"} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources [ INFO ] TASK [ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch logs from the engine VM] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set destination directory path] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Create destination directory] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Find the local appliance image] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Set local_vm_disk_path] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Give the vm time to flush dirty buffers] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Copy engine logs] [ INFO ] TASK [ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove local vm dir] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary entry in /etc/hosts for the local VM] [ INFO ] ok: [localhost] [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20190415123351.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: please check the logs for the issue, fix accordingly or re-deploy from scratch. Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20190415122114-rk9ve5.log Log files can be found here: https://ufile.io/kylza1g2

3 9

oVirtNode 4.3.3 - Missing os-brick
by Stefano Danzi 16 Apr '19

16 Apr '19

Hello, I've just upgrade one node host to v. 4.3.3 and I can see this entry in logs every 10 seconds: ==> /var/log/vdsm/vdsm.log <== 2019-04-16 18:03:06,417+0200 INFO (jsonrpc/5) [root] managedvolume not supported: Managed Volume Not Supported. Missing package os-brick.: ('Cannot import os_brick',) (caps:150)

4 4

Gluster suggestions
by Magnus Isaksson 16 Apr '19

16 Apr '19

Hello I would like some suggestions on what type of solution with Gluster i should use. I have 4 hosts with 3 disks each, i want to user as much space as possible but also some redundancy, like raid5 or 6 The 4 hosts are running oVirt on CentOS 7 I have 2 clusters due to some licensing issues, so i cant use ovirts setup of gluster Today i have set it up as follows Type: Disperse Number of Bricks: 1 x (8 + 4) = 12 So i have 3 bricks per host (one brick per disk) But this setup is not working very well, as soon as i get some traffic on the volume this start to fail on the ovirt nodes, loosing connection etc. All hosts are connected via 10G interface So any suggestions on how i would set this up as best is much appreciated. Regards Magnus Isaksson

1 0

[ANN] oVirt 4.3.3 is now generally available
by Sandro Bonazzola 16 Apr '19

16 Apr '19

The oVirt Project is pleased to announce the general availability of oVirt 4.3.3 as of April 16th, 2019. This update is the third in a series of stabilization updates to the 4.3 series. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later * oVirt Node 4.3 (available for x86_64 only) Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] oVirt Node has been updated including: - oVirt 4.3.3: http://www.ovirt.org/release/4.3.3/ - ansible-2.7.10: https://github.com/ansible/ansible/blob/stable-2.7/changelogs/CHANGELOG-v2.… - glusterfs-5.5: https://docs.gluster.org/en/latest/release-notes/5.5/ - Latest CentOS updates including: - CESA-2019:0679 Important CentOS 7 libssh2 Security Update <https://lists.centos.org/pipermail/centos-announce/2019-April/023259.html> - CESA-2019:0710 Important CentOS 7 python Security Update <https://lists.centos.org/pipermail/centos-announce/2019-April/023268.html> - CEEA-2019:0507 CentOS 7 shadow-utils Enhancement Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023228.html> - CEBA-2019:0519 CentOS 7 NetworkManager BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023242.html> - CEBA-2019:0509 CentOS 7 dbus BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023245.html> - CEBA-2019:0515 CentOS 7 fcoe-utils BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023246.html> - CEBA-2019:0728 CentOS 7 glibc BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-April/023269.html> - CEBA-2019:0518 CentOS 7 gnutls BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023233.html> - CEBA-2019:0508 CentOS 7 ipa BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023241.html> - CEBA-2019:0513 CentOS 7 libguestfs BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023232.html> - CEBA-2019:0521 CentOS 7 libvirt BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023239.html> - CEBA-2019:0500 CentOS 7 nss-pem BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023240.html> - CEBA-2019:0503 CentOS 7 sos BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023231.html> - CEBA-2019:0496 CentOS 7 tuned BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023230.html> - CEBA-2019:0689 CentOS 7 tzdata BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-April/023260.html> - CEBA-2019:0504 CentOS 7 util-linux BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023226.html> - CEBA-2019:0516 CentOS 7 xfsprogs BugFix Update <https://lists.centos.org/pipermail/centos-announce/2019-March/023227.html> Additional Resources: * Read more about the oVirt 4.3.3 release highlights: http://www.ovirt.org/release/4.3.3/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.3/ [2] http://resources.ovirt.org/pub/ovirt-4.3/iso/ -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

active directory: how to replace user@corp.mydomain.com with user@mydomain.com
by Jarosław Prokopowski 16 Apr '19

16 Apr '19

I configured active directory authentication but the problem is I need to replace user(a)corp.mydomain.com with user(a)mydomain.com to be able to authenticate. ovirt-engine-extension-aaa-misc has been installed and I configured it as shown below but still it is not working. Do you have any idea what is wrong and how to fix it? /etc/ovirt-engine/aaa/corp.mydomain.com.properties: -------------------------------------------------- include = <ad.properties> vars.domain = corp.mydomain.com vars.user = CN=user,DC=xxx,DC=corp,DC=mydomain,DC=com vars.password = password pool.default.auth.simple.bindDN = ${global:vars.user} pool.default.auth.simple.password = ${global:vars.password} pool.default.serverset.type = srvrecord pool.default.serverset.srvrecord.domain = ${global:vars.domain} /etc/ovirt-engine/extensions.d/mapping.properties: ------------------------------------------------- ovirt.engine.extension.name = mapping ovirt.engine.extension.bindings.method = jbossmodule ovirt.engine.extension.binding.jbossmodule.module = org.ovirt.engine-extensions.aaa.misc ovirt.engine.extension.binding.jbossmodule.class = org.ovirt.engineextensions.aaa.misc.mapping.MappingExtension ovirt.engine.extension.provides = org.ovirt.engine.api.extensions.aaa.Mapping config.mapUser.type = regex config.mapUser.regex.pattern = ^(?<user>[^@]*)$ config.mapUser.regex.replacement = ${user}(a)mydomain.com config.mapUser.regex.mustMatch = false ovirt.engine.aaa.authn.mapping.plugin = mapping In the engine logs I see mapping loaded: ------------------- 2019-04-16 10:35:40,406+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Loading extension 'mapping' 2019-04-16 10:35:40,420+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Extension 'mapping' loaded 2019-04-16 10:35:40,424+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Initializing extension 'internal-authn' 2019-04-16 10:35:40,475+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Extension 'internal-authn' initialized 2019-04-16 10:35:40,476+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Initializing extension 'mapping' 2019-04-16 10:35:40,476+02 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 44) [] Extension 'mapping' initialized But still in the logs I see the {user}(a)corp.mydomain.com is not replaced with {user}(a)mydomain.com: ------------------------------------------------------------------------------------------------- 2019-04-16 10:36:27,988+02 WARN [org.ovirt.engineextensions.aaa.ldap.Framework] (default task-3) [] Authentication exception 2019-04-16 10:36:28,231+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-4) [] EVENT_ID: USER_VDC_LOGIN_FAILED(114), User a_user(a)corp.mydomain.com connecting from '192.168.1.11' failed to log in : 'Unable to log in. Verify your login information or contact the system administrator.'. 2019-04-16 10:36:28,235+02 ERROR [org.ovirt.engine.core.sso.servlets.InteractiveAuthServlet] (default task-3) [] Cannot authenticate user 'a_user(a)corp.mydomain.com' connecting from '192.168.1.11': Unable to log in. Verify your login information or contact the system administrator. 2019-04-16 10:40:48,062+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [e479270] Lock Acquired to object 'EngineLock:{exclusiveLocks='[fd6141fe-6a69-49c8-807d-39313cae0756=PROVIDER]', sharedLocks=''}' 2019-04-16 10:40:48,084+02 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [e479270] Running command: SyncNetworkProviderCommand internal: true. 2019-04-16 10:40:48,270+02 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-3) [] (house keeping) deleting failed logins prior to 2019-04-09 08:40:48Z. 2019-04-16 10:40:48,323+02 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-3) [] (house keeping) deleting failed logins prior to 2019-04-09 08:40:48Z. Thanks Jarek

1 2

Gluster arbiter volume storage domain - change
by Leo David 16 Apr '19

16 Apr '19

Hi Everyone, I have wrongly configured the main gluster volume ( 12 identical 1tb ssd disks, replica 3 distributed-replicated, across 6 nodes - 2 per node ) with arbiter one. Oviously I am wasting storage space in this scenario with the arbiter bricks, and I would like to convert the volume to non-arbitrated one, so having all the data evenly spreaded across all the disks. Considering the the storage is being used by about 40 vms in production, what would it be the steps, or is there any chance to change the volume type to non-arbitrated on the fly and then rebalance ? Thank you very much !

3 4

Re: Gluster suggestions
by Sahina Bose 16 Apr '19

16 Apr '19

On Tue, Apr 16, 2019 at 2:39 PM Magnus Isaksson <magnus(a)vmar.se> wrote: > > I have 2 hosts per cluster, and i have 2 clusters, 4 hosts (its an Huawei x6000) > > I know oVirt don't support disperse, that's why i run gluster outside of oVirt. > And doing that i get a bit more freedom with setting up gluster. > So what would be an good setup to be able to use as much space as possible and some redundancy with the 4 hosts i have? Even if you run gluster outside of oVirt, you are using the disperse volume as storage domain? For a supported config, you can create a distributed-replica+arbiter gluster volume. Since you have 12 disks, you can use a 5 x 3 (arbiter) setup, where a disk is partitioned to multiple arbiter bricks, something like this (c11,c12, a31, a32 are arbiter bricks) : a1 b1 c11 a2 b2 c12 b3 c13 d1 a31 c2 d2 a32 c3 d3 > > //Magnus > > > ________________________________ > From: Sahina Bose <sabose(a)redhat.com> > Sent: 16 April 2019 10:55 > To: Magnus Isaksson > Cc: users > Subject: Re: [ovirt-users] Gluster suggestions > > On Tue, Apr 16, 2019 at 1:42 PM <magnus(a)vmar.se> wrote: > > > > Hello > > > > I would like some suggestions on what type of solution with Gluster i should use. > > > > I have 4 hosts with 3 disks each, i want to user as much space as possible but also some redundancy, like raid5 or 6 > > The 4 hosts are running oVirt on CentOS 7 > > I have 2 clusters due to some licensing issues, so i cant use ovirts setup of gluster > > I did not quite get this - are you saying you can have only 2 nodes in > one cluster? > > > > > Today i have set it up as follows > > Type: Disperse > > Number of Bricks: 1 x (8 + 4) = 12 > > Disperse volumes are not supported with oVirt. It's either replica 3 > or replica 2 + arbiter. > > > > > So i have 3 bricks per host (one brick per disk) > > > > But this setup is not working very well, as soon as i get some traffic on the volume this start to fail on the ovirt nodes, loosing connection etc. > > > > All hosts are connected via 10G interface > > > > So any suggestions on how i would set this up as best is much appreciated. > > > > Regards > > Magnus Isaksson > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AIEPMRANHFB7J…

2 1

sysprep properties file
by Florian Rädler 16 Apr '19

16 Apr '19

How can i overwrite the credentials in the sysprep.w10x64 file. I have created a file /etc/ovirt-engine/osinfo.conf.d/10-domainjoin.properties Which contains the following: os.windows_10x64.identification.credentials.domain.value = logondomain os.windows_10x64.identification.credentials.password.value = xxxxxxxx os.windows_10x64.identification.credentials.username.value = username os.windows_10x64.joindomain.value = joindomain If I change the credentials section in /usr/share/ovirt-engine/conf/sysprep/sysprep.w10x64 the domainjoin works. What did I wrong? Thanks for your help. BR Florian ________________________________ Pflichtangaben anzeigen<http://www.deutschebahn.com/pflichtangaben/20190408> Nähere Informationen zur Datenverarbeitung im DB-Konzern finden Sie hier: http://www.deutschebahn.com/de/konzern/datenschutz

1 0

Re: hosted engine does not start
by Sahina Bose 16 Apr '19

16 Apr '19

Can you check if there are any errors in the engine volume's mount logs (/var/logs/glusterfs/rrhev-data-center-mnt-glusterSD-<engine volume>.log) On Tue, Apr 16, 2019 at 2:33 PM Stefan Wolf <shb256(a)gmail.com> wrote: > > Sorry i forgot to wrote, > > > > This is everything I got. > > > > No keyboard input > > > > I ve read to mount the harddrive with losetup and use fsck > > > > [root@kvm360 /]# fdisk -lu /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc > > > > Disk /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc: 53.7 GB, 53687091200 bytes, 104857600 sectors > > Units = Sektoren of 1 * 512 = 512 bytes > > Sector size (logical/physical): 512 bytes / 512 bytes > > I/O size (minimum/optimal): 512 bytes / 512 bytes > > Disk label type: dos > > Disk identifier: 0x000aff89 > > > > Gerät boot. Anfang Ende Blöcke Id System > > /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc1 * 2048 2099199 1048576 83 Linux > > /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc2 2099200 92012543 44956672 8e Linux LVM > > /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc3 92012544 104855551 6421504 83 Linux > > [root@kvm360 /]# losetup -o 2099200 /dev/loop0 /mnt/36663740-576a-4498-b28e-0a402628c6a7/images/50d59094-7f24-4fed-9c4e-d3bb6b42eb6a/38252d8a-49fd-474e-a449-d40b3ef4b7dc > > [root@kvm360 /]# mount /dev/loop0 /test/ > > mount: /dev/loop0 is write-protected, mounting read-only > > mount: wrong fs type, bad option, bad superblock on /dev/loop0, > > missing codepage or helper program, or other error > > > > In some cases useful info is found in syslog - try > > dmesg | tail or so. > > [root@kvm360 /]# > > > > But I suck on mounting partition > > > > -----Ursprüngliche Nachricht----- > Von: Sahina Bose <sabose(a)redhat.com> > Gesendet: Dienstag, 16. April 2019 10:57 > An: Stefan Wolf <shb256(a)gmail.com> > Cc: users <users(a)ovirt.org> > Betreff: Re: [ovirt-users] hosted engine does not start > > > > On Tue, Apr 16, 2019 at 1:07 AM Stefan Wolf <shb256(a)gmail.com> wrote: > > > > > > Hello all, > > > > > > > > > > > > after a powerloss the hosted engine won’t start up anymore. > > > > > > I ‘ve the current ovirt installed. > > > > > > Storage is glusterfs und it is up and running > > > > > > > > > > > > It is trying to start up hosted engine but it does not work, but I can’t see where the problem is. > > > > > > > > > > > > [root@kvm320 ~]# hosted-engine --vm-status > > > > > > > > > > > > > > > > > > --== Host 1 status ==-- > > > > > > > > > > > > conf_on_shared_storage : True > > > > > > Status up-to-date : True > > > > > > Hostname : kvm380.durchhalten.intern > > > > > > Host ID : 1 > > > > > > Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"} > > > > > > Score : 1800 > > > > > > stopped : False > > > > > > Local maintenance : False > > > > > > crc32 : 3ad6d0bd > > > > > > local_conf_timestamp : 14594 > > > > > > Host timestamp : 14594 > > > > > > Extra metadata (valid at timestamp): > > > > > > metadata_parse_version=1 > > > > > > metadata_feature_version=1 > > > > > > timestamp=14594 (Mon Apr 15 21:25:12 2019) > > > > > > host-id=1 > > > > > > score=1800 > > > > > > vm_conf_refresh_time=14594 (Mon Apr 15 21:25:12 2019) > > > > > > conf_on_shared_storage=True > > > > > > maintenance=False > > > > > > state=GlobalMaintenance > > > > > > stopped=False > > > > > > > > > > > > > > > > > > --== Host 2 status ==-- > > > > > > > > > > > > conf_on_shared_storage : True > > > > > > Status up-to-date : True > > > > > > Hostname : kvm320.durchhalten.intern > > > > > > Host ID : 2 > > > > > > Engine status : {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"} > > > > > > Score : 0 > > > > > > stopped : False > > > > > > Local maintenance : False > > > > > > crc32 : e7d4840d > > > > > > local_conf_timestamp : 21500 > > > > > > Host timestamp : 21500 > > > > > > Extra metadata (valid at timestamp): > > > > > > metadata_parse_version=1 > > > > > > metadata_feature_version=1 > > > > > > timestamp=21500 (Mon Apr 15 21:25:22 2019) > > > > > > host-id=2 > > > > > > score=0 > > > > > > vm_conf_refresh_time=21500 (Mon Apr 15 21:25:22 2019) > > > > > > conf_on_shared_storage=True > > > > > > maintenance=False > > > > > > state=ReinitializeFSM > > > > > > stopped=False > > > > > > > > > > > > > > > > > > --== Host 3 status ==-- > > > > > > > > > > > > conf_on_shared_storage : True > > > > > > Status up-to-date : True > > > > > > Hostname : kvm360.durchhalten.intern > > > > > > Host ID : 3 > > > > > > Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} > > > > > > Score : 1800 > > > > > > stopped : False > > > > > > Local maintenance : False > > > > > > crc32 : cf9221cb > > > > > > local_conf_timestamp : 22121 > > > > > > Host timestamp : 22120 > > > > > > Extra metadata (valid at timestamp): > > > > > > metadata_parse_version=1 > > > > > > metadata_feature_version=1 > > > > > > timestamp=22120 (Mon Apr 15 21:25:18 2019) > > > > > > host-id=3 > > > > > > score=1800 > > > > > > vm_conf_refresh_time=22121 (Mon Apr 15 21:25:18 2019) > > > > > > conf_on_shared_storage=True > > > > > > maintenance=False > > > > > > state=GlobalMaintenance > > > > > > stopped=False > > > > > > > > > > > > [root@kvm320 ~]# virsh -r list > > > > > > Id Name Status > > > > > > ---------------------------------------------------- > > > > > > 6 HostedEngine laufend > > > > > > > > > > > > [root@kvm320 ~]# hosted-engine --console > > > > > > The engine VM is running on this host > > > > > > Verbunden mit der Domain: HostedEngine > > > > > > Escape-Zeichen ist ^] > > > > > > Fehler: Interner Fehler: Zeichengerät <null> kann nicht gefunden > > > warden > > > > > > > > > > > > In engish it should be this > > > > > > > > > > > > [root@mgmt~]# hosted-engine --console > > > The engine VM is running on this host > > > Connected to domain HostedEngine > > > Escape character is ^] > > > error: internal error: cannot find character device > > > > > > > > > > > > This is in the log > > > > > > > > > > > > [root@kvm320 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log > > > > > > MainThread::INFO::2019-04-15 > > > 21:28:33,032::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > MainThread::INFO::2019-04-15 21:28:43,050::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) VM is powering up.. > > > > > > MainThread::INFO::2019-04-15 > > > 21:28:43,165::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > MainThread::INFO::2019-04-15 21:28:53,183::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) VM is powering up.. > > > > > > MainThread::INFO::2019-04-15 > > > 21:28:53,300::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > MainThread::INFO::2019-04-15 21:29:03,317::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) VM is powering up.. > > > > > > MainThread::INFO::2019-04-15 > > > 21:29:03,434::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > MainThread::INFO::2019-04-15 21:29:13,453::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) VM is powering up.. > > > > > > MainThread::INFO::2019-04-15 > > > 21:29:13,571::states::136::ovirt_hosted_engine_ha.agent.hosted_engine. > > > HostedEngine::(score) Penalizing score by 1600 due to gateway status > > > > > > MainThread::INFO::2019-04-15 > > > 21:29:13,571::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > MainThread::INFO::2019-04-15 21:29:22,589::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) VM is powering up.. > > > > > > MainThread::INFO::2019-04-15 > > > 21:29:22,712::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_ > > > engine.HostedEngine::(_monitoring_loop) Current state EngineStarting > > > (score: 1800) > > > > > > > > > > > > But it is not reachable over the network > > > > > > > > > > > > [root@kvm320 ~]# ping 192.168.200.211 > > > > > > PING 192.168.200.211 (192.168.200.211) 56(84) bytes of data. > > > > > > From 192.168.200.231 icmp_seq=1 Destination Host Unreachable > > > > > > From 192.168.200.231 icmp_seq=2 Destination Host Unreachable > > > > > > From 192.168.200.231 icmp_seq=3 Destination Host Unreachable > > > > > > From 192.168.200.231 icmp_seq=4 Destination Host Unreachable > > > > > > > > > > > > I tried to stop and start the vm again, but it didn’t helped > > > > > > > > > > > > Maybe someone can give me some advice how to get the hosted engine > > > running again > > > > Can you access the VNC console of the Hosted Engine VM and check? > > > > > > > > > > > > > > Thx by stefan > > > > > > _______________________________________________ > > > Users mailing list -- users(a)ovirt.org > > > To unsubscribe send an email to users-leave(a)ovirt.org Privacy > > > Statement: https://www.ovirt.org/site/privacy-policy/ > > > oVirt Code of Conduct: > > > https://www.ovirt.org/community/about/community-guidelines/ > > > List Archives: > > > https://lists.ovirt.org/archives/list/users@ovirt.org/message/7PNLN5C4 > > > X6GRVZZ22KJYBHTLOBLUWS27/

1 0

Gluster suggestions
by magnus＠vmar.se 16 Apr '19

16 Apr '19

Hello I would like some suggestions on what type of solution with Gluster i should use. I have 4 hosts with 3 disks each, i want to user as much space as possible but also some redundancy, like raid5 or 6 The 4 hosts are running oVirt on CentOS 7 I have 2 clusters due to some licensing issues, so i cant use ovirts setup of gluster Today i have set it up as follows Type: Disperse Number of Bricks: 1 x (8 + 4) = 12 So i have 3 bricks per host (one brick per disk) But this setup is not working very well, as soon as i get some traffic on the volume this start to fail on the ovirt nodes, loosing connection etc. All hosts are connected via 10G interface So any suggestions on how i would set this up as best is much appreciated. Regards Magnus Isaksson

3 3

hosted engine does not start
by Stefan Wolf 16 Apr '19

16 Apr '19

Hello all, after a powerloss the hosted engine wont start up anymore. I ve the current ovirt installed. Storage is glusterfs und it is up and running It is trying to start up hosted engine but it does not work, but I cant see where the problem is. [root@kvm320 ~]# hosted-engine --vm-status --== Host 1 status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : kvm380.durchhalten.intern Host ID : 1 Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"} Score : 1800 stopped : False Local maintenance : False crc32 : 3ad6d0bd local_conf_timestamp : 14594 Host timestamp : 14594 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=14594 (Mon Apr 15 21:25:12 2019) host-id=1 score=1800 vm_conf_refresh_time=14594 (Mon Apr 15 21:25:12 2019) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False --== Host 2 status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : kvm320.durchhalten.intern Host ID : 2 Engine status : {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"} Score : 0 stopped : False Local maintenance : False crc32 : e7d4840d local_conf_timestamp : 21500 Host timestamp : 21500 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=21500 (Mon Apr 15 21:25:22 2019) host-id=2 score=0 vm_conf_refresh_time=21500 (Mon Apr 15 21:25:22 2019) conf_on_shared_storage=True maintenance=False state=ReinitializeFSM stopped=False --== Host 3 status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : kvm360.durchhalten.intern Host ID : 3 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 1800 stopped : False Local maintenance : False crc32 : cf9221cb local_conf_timestamp : 22121 Host timestamp : 22120 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=22120 (Mon Apr 15 21:25:18 2019) host-id=3 score=1800 vm_conf_refresh_time=22121 (Mon Apr 15 21:25:18 2019) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False [root@kvm320 ~]# virsh -r list Id Name Status ---------------------------------------------------- 6 HostedEngine laufend [root@kvm320 ~]# hosted-engine --console The engine VM is running on this host Verbunden mit der Domain: HostedEngine Escape-Zeichen ist ^] Fehler: Interner Fehler: Zeichengerät <null> kann nicht gefunden warden In engish it should be this [root@mgmt~]# hosted-engine --console The engine VM is running on this host Connected to domain HostedEngine Escape character is ^] error: internal error: cannot find character device This is in the log [root@kvm320 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log MainThread::INFO::2019-04-15 21:28:33,032::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) MainThread::INFO::2019-04-15 21:28:43,050::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(consume) VM is powering up.. MainThread::INFO::2019-04-15 21:28:43,165::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) MainThread::INFO::2019-04-15 21:28:53,183::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(consume) VM is powering up.. MainThread::INFO::2019-04-15 21:28:53,300::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) MainThread::INFO::2019-04-15 21:29:03,317::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(consume) VM is powering up.. MainThread::INFO::2019-04-15 21:29:03,434::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) MainThread::INFO::2019-04-15 21:29:13,453::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(consume) VM is powering up.. MainThread::INFO::2019-04-15 21:29:13,571::states::136::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(score) Penalizing score by 1600 due to gateway status MainThread::INFO::2019-04-15 21:29:13,571::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) MainThread::INFO::2019-04-15 21:29:22,589::states::779::ovirt_hosted_engine_ha.agent.hosted_engine.Hosted Engine::(consume) VM is powering up.. MainThread::INFO::2019-04-15 21:29:22,712::hosted_engine::491::ovirt_hosted_engine_ha.agent.hosted_engine .HostedEngine::(_monitoring_loop) Current state EngineStarting (score: 1800) But it is not reachable over the network [root@kvm320 ~]# ping 192.168.200.211 PING 192.168.200.211 (192.168.200.211) 56(84) bytes of data. From 192.168.200.231 icmp_seq=1 Destination Host Unreachable From 192.168.200.231 icmp_seq=2 Destination Host Unreachable From 192.168.200.231 icmp_seq=3 Destination Host Unreachable From 192.168.200.231 icmp_seq=4 Destination Host Unreachable I tried to stop and start the vm again, but it didnt helped Maybe someone can give me some advice how to get the hosted engine running again Thx by stefan

2 1

Re: Gluster arbiter volume storage domain - change
by Strahil 16 Apr '19

16 Apr '19

Just a thought, Have you considered network bandwidth increase, as your traffic will increase by 50%. About getting rid of the arbiter, you may check the following: https://lists.ovirt.org/pipermail/users/2017-July/083022.html Best Regards, Strahil NikolovOn Apr 16, 2019 11:02, Leo David <leoalex(a)gmail.com> wrote: > > Hi Everyone, > I have wrongly configured the main gluster volume ( 12 identical 1tb ssd disks, replica 3 distributed-replicated, across 6 nodes - 2 per node ) with arbiter one. > Oviously I am wasting storage space in this scenario with the arbiter bricks, and I would like to convert the volume to non-arbitrated one, so having all the data evenly spreaded across all the disks. > Considering the the storage is being used by about 40 vms in production, what would it be the steps, or is there any chance to change the volume type to non-arbitrated on the fly and then rebalance ? > Thank you very much !

1 0