November 2017 - Users - oVirt List Archives

Cannot remove snapshot
by Nicolas Ecarnot 21 Nov '17

21 Nov '17

Hello, oVirt 3.6.7.5-1 I'm trying to remove a snapshot in a cold way (VM shut down). It is failing, and VDSM is telling : 4f1588f3-ae2d-4702-b7e1-4ef53b5b5a1d::DEBUG::2017-11-17 13:04:11,448::lvm::290::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 4f1588f3-ae2d-4702-b7e1-4ef53b5b5a1d::DEBUG::2017-11-17 13:04:11,456::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded 4f1588f3-ae2d-4702-b7e1-4ef53b5b5a1d::DEBUG::2017-11-17 13:04:11,456::lvm::462::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex 4f1588f3-ae2d-4702-b7e1-4ef53b5b5a1d::ERROR::2017-11-17 13:04:11,457::image::1302::Storage.Image::(merge) Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/image.py", line 1293, in merge sdDom, srcVolParams, volParams, reqSize, chain) File "/usr/share/vdsm/storage/image.py", line 1039, in _baseCowVolumeMerge unsafe=False, rollback=True) File "/usr/share/vdsm/storage/volume.py", line 278, in rebase raise se.MergeSnapshotsError(self.volUUID) MergeSnapshotsError: Error merging snapshots: ('4a8c17aa-5882-45a1-8a6e-40db39ed06ca',) I read this : https://bugzilla.redhat.com/show_bug.cgi?id=1069610 , hoping I could find some workaround. But I couldn't. If there is no abvious workaround, would there be other ways like : - find the bare logical volume, shut down the VM, and play with low level qemu-img commands. I think I knwn how to do that, but I'm worried the oVirt database won't be in sync once I've removed the snapshot or - export the VM then re-import, if this is related to some LV space missing. Then removing the snapshot the usual way. Any advice (apart the obvious upgrade-to-4.X-sir)? -- Nicolas ECARNOT

1 1

Host Non Operational - Filed to configure management network on host Vollansicht Vollansicht
by jean.hort＠web.de 21 Nov '17

21 Nov '17

1 0

Host Non Operational - Filed to configure management network on host Vollansicht
by jean.hort＠web.de 21 Nov '17

21 Nov '17

1 0

oVirt 4.1.7: Duplicate MAC addresses had to be introduced into mac pool violating no duplicates setting.
by nicolas＠devels.es 20 Nov '17

20 Nov '17

Hi, We just upgraded from 4.1.6 to 4.1.7 and just after the engine was brought back the following event showed up: Duplicate MAC addresses had to be introduced into mac pool violating no duplicates setting. Can someone explain why is that? Thanks. Nicolás

2 2

Re: [ovirt-users] Some tests results: lustrefs over nfs on VM
by Arman Khalatyan 19 Nov '17

19 Nov '17

hi Yaniv, yes for sure I hit some cache in between but not the vm cache, it has a 4GB ram, with oflag=direct I get about 120MB/s for the data analysis the cache is our friend:) The backend is a lustrefs 2.10.x. yes we have dedicated 10G on the hosts, where we can limit the vm interface to 10Gbit? Am 19.11.2017 8:33 nachm. schrieb "Yaniv Kaul" <ykaul(a)redhat.com>: On Sun, Nov 19, 2017 at 7:08 PM, Arman Khalatyan <arm2arm(a)gmail.com> wrote: > Hi, in our environment we got pretty good io performance on VM, with > following configuration: > lustrebox: /lust mounted on "GATEWAY" over IB > GATEWAY: export /lust as nfs4 on 10G interface > VM(test.vm): import as NFS over 10G interface > > [root(a)test.vm <root(a)gans.vm> ~]# dd if=/dev/zero bs=128K count=100000 > Without oflag=direct, you are hitting (somewhat) the cache. > > of=/test/tmp/test.tmp > 100000+0 records in > 100000+0 records out > 13107200000 <(310)%20720-0000> bytes (13 GB) copied, 20.8402 s, 629 MB/s > looks promising for the future deployments. > Very - what's the backend storage? > > only one problem remains that on heavy io I get some wornings that the vm > network is saturated, are there way to configure the bandwidth limits to > 10G for the VM Interface?? > Yes, but you really need a dedicated storage interface, no? Y. > > > thank you beforehand, > Arman. > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > >

1 0

Some tests results: lustrefs over nfs on VM
by Arman Khalatyan 19 Nov '17

19 Nov '17

Hi, in our environment we got pretty good io performance on VM, with following configuration: lustrebox: /lust mounted on "GATEWAY" over IB GATEWAY: export /lust as nfs4 on 10G interface VM(test.vm): import as NFS over 10G interface [root(a)test.vm <root(a)gans.vm> ~]# dd if=/dev/zero bs=128K count=100000 of=/test/tmp/test.tmp 100000+0 records in 100000+0 records out 13107200000 bytes (13 GB) copied, 20.8402 s, 629 MB/s looks promising for the future deployments. only one problem remains that on heavy io I get some wornings that the vm network is saturated, are there way to configure the bandwidth limits to 10G for the VM Interface?? thank you beforehand, Arman.

2 1

VDSM command GetVmsInfoVDS failed: Missing OVF file from VM
by Алексей Максимов 19 Nov '17

19 Nov '17

2 1

NIC Bonding
by magnus.isaksson＠ilw.se 19 Nov '17

19 Nov '17

----=_RainLoop_715_686258566.1509963308 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello!=0AI'm new(-ish) to oVirt and have a question regarding network. = =0A=0A I currently use vmware, the hosts have 4 nic each and connected to= two switches in stack(extreme), i have two vSwitch with two nic each set= up in active/standby, with this i don't have to do anything with the phys= ical switch. =0A So how do i do this setup on oVirt so i don't need to co= nfigure the switches?=0AI know how to bond the cards, but i am afraid of = a switchloop, so i just want to make sure that does not happen.=0A=0ARega= rds=0AMagnus Isaksson ----=_RainLoop_715_686258566.1509963308 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable <!DOCTYPE html><html><head><meta http-equiv=3D"Content-Type" content=3D"t= ext/html; charset=3Dutf-8" /></head><body><div data-html-editor-font-wrap= per=3D"true" style=3D"font-family: arial, sans-serif; font-size: 13px;"> = <signature><signature><p><span display=3D"inline">Hello!<br>I'm new(-ish)= to oVirt and have a question regarding network.</span></p> <p><span disp= lay=3D"inline">I currently use vmware, the hosts have 4 nic each and conn= ected to two switches in stack(extreme), i have two vSwitch with two nic = each setup in active/standby, with this i don't have to do anything with = the physical switch.</span></p> <div><p><span display=3D"inline">So how d= o i do this setup on oVirt so i don't need to configure the switches?<br>= I know how to bond the cards, but i am afraid of a switchloop, so i just = want to make sure that does not happen.</span><br><br>Regards<br>Magnus I= saksson</p></div></signature></signature><br> </div></body></html> ----=_RainLoop_715_686258566.1509963308--

5 6

using oVirt with newer librbd1
by Matthias Leopold 18 Nov '17

18 Nov '17

Hi, we want to use a Ceph cluster as the main storage for our oVirt 4.1.x datacenter. We successfully tested using librbd1-12.2.1-0.el7 package from Ceph repos instead of the standard librbd1-0.94.5-2.el7 from CentOS 7 in an oVirt virtualization node. Are there any caveats when doing so? Will this work in oVirt 4.2? thx matthias

2 7

Snapshot or not?
by Demeter Tibor 17 Nov '17

17 Nov '17

--=_356f090b-8288-4845-8f3a-5ab9dcf0b36a Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Dear Users, I have a disk of a vm, that is have a snapshot. It is very interesting, because there are two other disk of that VM, but there are no snapshots of them. I found this while I've try to migrate a storage-domain between two datacenter. Because, I didn't import that vm from the storage domain, I did an another similar VM with exactly same sized thin-provisioned disks. I have renamed, copied to here my originals. The VM started successfully, but the disk that contain a snapshot did not recognized by the os. I can see the whole disk as raw. (disk id, format in ovirt, filenames of images, etc) . I think ovirt don't know that is a snapshotted image and use as raw. Is it possible? I don't see any snapshot in snapshots. Also I have try to list snapshots with qemu-img info and qemu-img snapshot -l , but it does not see any snapshots in the image. Really, I don't know how is possible this. [root@storage1 8d815282-6957-41c0-bb3e-6c8f4a23a64b]# qemu-img info 5974fd33-af4c-4e3b-aadb-bece6054eb6b image: 5974fd33-af4c-4e3b-aadb-bece6054eb6b file format: qcow2 virtual size: 13T (13958643712000 bytes) disk size: 12T cluster_size: 65536 backing file: ../8d815282-6957-41c0-bb3e-6c8f4a23a64b/723ad5aa-02f6-4067-ac75-0ce0a761627f backing file format: raw Format specific information: compat: 0.10 [root@storage1 8d815282-6957-41c0-bb3e-6c8f4a23a64b]# qemu-img info 723ad5aa-02f6-4067-ac75-0ce0a761627f image: 723ad5aa-02f6-4067-ac75-0ce0a761627f file format: raw virtual size: 2.0T (2147483648000 bytes) disk size: 244G [root@storage1 8d815282-6957-41c0-bb3e-6c8f4a23a64b]# ll total 13096987560 -rw-rw----. 1 36 36 13149448896512 Nov 13 13:42 5974fd33-af4c-4e3b-aadb-bece6054eb6b -rw-rw----. 1 36 36 1048576 Nov 13 19:34 5974fd33-af4c-4e3b-aadb-bece6054eb6b.lease -rw-r--r--. 1 36 36 262 Nov 13 19:54 5974fd33-af4c-4e3b-aadb-bece6054eb6b.meta -rw-rw----. 1 36 36 2147483648000 Jul 8 2016 723ad5aa-02f6-4067-ac75-0ce0a761627f -rw-rw----. 1 36 36 1048576 Jul 7 2016 723ad5aa-02f6-4067-ac75-0ce0a761627f.lease -rw-r--r--. 1 36 36 335 Nov 13 19:52 723ad5aa-02f6-4067-ac75-0ce0a761627f.meta qemu-img snapshot -l 5974fd33-af4c-4e3b-aadb-bece6054eb6b (nothing) Because it is a very big (13 TB) disk I can't migrate to an another image, because I don't have enough free space. So I just would like to use it in ovirt like in the past. I have a very old ovirt (3.5) How can I use this disk? Thanks in advance, Regards, Tibor --=_356f090b-8288-4845-8f3a-5ab9dcf0b36a Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: arial, helvetica, sans-serif; font-s= ize: 12pt; color: #000000"><div>Dear Users,</div><div><br data-mce-bogus=3D= "1"></div><div>I have a disk of a vm, that is have a snapshot. It is very i= nteresting, because there are two other disk of that VM, but there are no s= napshots of them.</div><div>I found this while I've try to migrate a storag= e-domain between two datacenter. </div><div>Because, I didn't import t= hat vm from the storage domain, I did an another similar VM with exactly sa= me sized thin-provisioned disks. I have renamed, copied to here my original= s. </div><div><br data-mce-bogus=3D"1"></div><div>The VM started succe= ssfully, but the disk that contain a snapshot did not recognized by the os.= I can see the whole disk as raw. (disk id, format in ovirt, filenames of i= mages, etc) . I think ovirt don't know that is a snapshotted image and use = as raw. Is it possible?</div><div>I don't see any snapshot in snapshots. Al= so I have try to list snapshots with qemu-img info and qemu-img snapshot -l= , but it does not see any snapshots in the image.</div><div><br data-mce-b= ogus=3D"1"></div><div>Really, I don't know how is possible this.</div><div>= <br data-mce-bogus=3D"1"></div><div><div>[root@storage1 8d815282-6957-41c0-= bb3e-6c8f4a23a64b]# qemu-img info 5974fd33-af4c-4e3b-aadb-bece6054eb6b</div= ><div>image: 5974fd33-af4c-4e3b-aadb-bece6054eb6b</div><div>file format: qc= ow2</div><div>virtual size: 13T (13958643712000 bytes)</div><div>disk size:= 12T</div><div>cluster_size: 65536</div><div>backing file: ../8d815282-6957= -41c0-bb3e-6c8f4a23a64b/723ad5aa-02f6-4067-ac75-0ce0a761627f</div><div>back= ing file format: raw</div><div>Format specific information:</div><div>&nbsp= ;   compat: 0.10</div></div><div><div><div><br data-mce-bogus=3D"1"></= div><div>[root@storage1 8d815282-6957-41c0-bb3e-6c8f4a23a64b]# qemu-img inf= o 723ad5aa-02f6-4067-ac75-0ce0a761627f</div><div>image: 723ad5aa-02f6-4067-= ac75-0ce0a761627f</div><div>file format: raw</div><div>virtual size: 2.0T (= 2147483648000 bytes)</div><div>disk size: 244G</div></div><div><br></div><d= iv>[root@storage1 8d815282-6957-41c0-bb3e-6c8f4a23a64b]# ll</div><div>total= 13096987560</div><div>-rw-rw----. 1 36 36 13149448896512 Nov 13 13:42 5974= fd33-af4c-4e3b-aadb-bece6054eb6b</div><div>-rw-rw----. 1 36 36   =     1048576 Nov 13 19:34 5974fd33-af4c-4e3b-aadb-bece6054eb6b.le= ase</div><div>-rw-r--r--. 1 36 36            = 262 Nov 13 19:54 5974fd33-af4c-4e3b-aadb-bece6054eb6b.meta</div><div>-rw-rw= ----. 1 36 36  2147483648000 Jul  8  2016 723ad5aa-02f6-4067= -ac75-0ce0a761627f</div><div>-rw-rw----. 1 36 36       = 1048576 Jul  7  2016 723ad5aa-02f6-4067-ac75-0ce0a761627f.lease<= /div><div>-rw-r--r--. 1 36 36            335 = Nov 13 19:52 723ad5aa-02f6-4067-ac75-0ce0a761627f.meta</div><div><br data-m= ce-bogus=3D"1"></div><div>qemu-img snapshot -l 5974fd33-af4c-4e3b-aadb-bece= 6054eb6b<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div>= <div>(nothing)</div><div><br data-mce-bogus=3D"1"></div><div>Because it is = a very big (13 TB) disk I can't migrate to an another image, because I don'= t have enough free space. So I just would like to use it in ovirt like in t= he past. </div><div><br data-mce-bogus=3D"1"></div><div>I have a very = old ovirt (3.5)</div><div><br data-mce-bogus=3D"1"></div><div>How can I use= this disk?</div><div><br data-mce-bogus=3D"1"></div><div>Thanks in advance= ,</div><div><br data-mce-bogus=3D"1"></div><div>Regards,</div></div><div><b= r></div><div data-marker=3D"__SIG_PRE__"><p style=3D"font-family: 'Times Ne= w Roman'; font-size: medium; margin: 0px;" data-mce-style=3D"font-family: '= Times New Roman'; font-size: medium; margin: 0px;"><strong><span style=3D"f= ont-size: medium;" data-mce-style=3D"font-size: medium;"><span style=3D"col= or: #2d67b0;" data-mce-style=3D"color: #2d67b0;"></span></span></strong></p= >Tibor<p></p></div></div></body></html> --=_356f090b-8288-4845-8f3a-5ab9dcf0b36a--

4 9

Enabling libgfapi disk access with oVirt 4.2
by Alessandro De Salvo 17 Nov '17

17 Nov '17

Hi, I'm using the latest 4.2 beta release and want to try the gfapi access, but I'm currently failing to use it. My test setup has an external glusterfs cluster v3.12, not managed by oVirt. The compatibility flag is correctly showing gfapi should be enabled with 4.2: # engine-config -g LibgfApiSupported LibgfApiSupported: false version: 3.6 LibgfApiSupported: false version: 4.0 LibgfApiSupported: false version: 4.1 LibgfApiSupported: true version: 4.2 The data center and cluster have the 4.2 compatibility flags as well. However, when starting a VM with a disk on gluster I can still see the disk is mounted via fuse. Any clue of what I'm still missing? Thanks, Alessandro

7 14

[ANN] oVirt 4.1.8 First Release Candidate is now available
by Lev Veyde 16 Nov '17

16 Nov '17

The oVirt Project is pleased to announce the availability of the First Release Candidate of oVirt 4.1.8, as of November 16th, 2017 This update is the eighth in a series of stabilization updates to the 4.1 series. Starting from 4.1.5 oVirt supports libgfapi [5]. Using libgfapi provides a real performance boost for ovirt when using GlusterFS . Due to a known issue [6], using this will break live storage migration. This is expected to be fixed soon. If you do not use live storage migration you can give it a try. Use [7] for more details on how to enable it. This release is available now for: * Red Hat Enterprise Linux 7.4 or later * CentOS Linux (or similar) 7.4 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.4 or later * CentOS Linux (or similar) 7.4 or later * oVirt Node 4.1 See the release notes draft [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Live is already available[4] - oVirt Node is already available[4] Additional Resources: * Read more about the oVirt 4.1.8 release highlights: http://www.ovirt.org/release/4.1. <http://www.ovirt.org/release/4.1.8/>8 <http://www.ovirt.org/release/4.1.8/>/ <http://www.ovirt.org/release/4.1.8/> * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.1. <http://www.ovirt.org/release/4.1.8/>8 <http://www.ovirt.org/release/4.1.8/>/ <http://www.ovirt.org/release/4.1.8/> [4] http://resources.ovirt.org/pub/ovirt-4.1-pre/iso/ [5] http://staged-gluster-docs.readthedocs.io/en/release3.7.0beta1/Features/lib… [6] https://bugzilla.redhat.com/show_bug.cgi?id=1306562 [7] http://www.ovirt.org/develop/release-management/features/storage/glusterfs-… -- Lev Veyde Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

Are the external leases helping on MasterDomain failure?
by Arman Khalatyan 16 Nov '17

16 Nov '17

Hi, Is this document still valid? https://www.ovirt.org/develop/release-management/features/storage/vm-leases/ If yes, I have a n question concerning the local SSD leases: If the HA leases are going to the local host ssd storage, then due to the Master Domain failure the HA will continue to run? Or in which scenario external leases are helping to keep HA VM up and running? thanks, Arman.

1 0

Migration from Redhat Virtualization Manager 2.2 to Ovirt 4.1
by Julio Cesar Bustamante 16 Nov '17

16 Nov '17

Hi there, I have to migrate from Red Hat Virtualization Manager 2.2 to Ovirt 4.1. But I have a question, is it possible configure a Ovirt manager and a Ovirt Host with and a 2Tb sata disk and virtualize two o more virtual machine on this Ovirt host ? What do you recommed ? -- Julio Cesar Bustamante.

2 1

Unable to attach ISO images
by Rudi Ahlers 16 Nov '17

16 Nov '17

Hi, I have setup oVirt Engine Version: 4.1.7.6-1.el7.centos with Hosted-engine, with a node Gluster cluster. When attempting to upload ISO images, the "Attach ISO" button is greyd out. How do I fix this? [image: Inline image 1] -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

3 3

Hosted engine not starting up after system reboot
by Rudi Ahlers 16 Nov '17

16 Nov '17

Hi, I wonder if someone can help. After a system reboot, the Hosted-Agent isn't running. This is on a fresh installaion CentOS Linux release 7.4.1708 running ovirt-release41-4.1.7-1.el7.centos.noarch. Gluster is setup on 3 nodes, but hosted-engine is only setup on the 1st node for now. [root@virt1 ~]# hosted-engine --console Virtual machine does not exist The engine VM is not on this host [root@virt1 ~]# hosted-engine --vm-status The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. [root@virt1 ~]# ps ax | grep ovirt-ha-agent 41309 ? Rsl 0:14 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent --no-daemon 42818 pts/0 S+ 0:00 grep --color=auto ovirt-ha-agent [root@virt1 ~]# mount | grep engine /dev/mapper/storage-engine on /storage/engine type xfs (rw,relatime,seclabel,attr2,inode64,sunit=1024,swidth=2048,noquota) virt1:/engine on /mnt/engine type fuse.glusterfs (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072) virt1:/engine on /rhev/data-center/mnt/glusterSD/virt1:_engine type fuse.glusterfs (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072) And then I see this error: [root@virt1 ~]# systemctl status ovirt-ha-agent -l ● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2017-11-16 07:44:43 SAST; 4min 23s ago Main PID: 41309 (ovirt-ha-agent) CGroup: /system.slice/ovirt-ha-agent.service └─41309 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent --no-daemon Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 191, in _run_agent return action(he) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 64, in action_proper return he.start_monitoring() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 423, in start_monitoring for old_state, state, delay in self.fsm: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 127, in next new_data = self.refresh(self._state.data) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 123, in refresh ] = self.hosted_engine.min_memory_threshold File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 183, in min_memory_threshold return int(self._config.get(config.VM, config.MEM_SIZE)) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py", line 226, in get key KeyError: 'Configuration value not found: file=/var/run/ovirt-hosted-engine-ha/vm.conf, key=memSize' Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Trying to restart agent Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored All the nodes resolve fine, and has been added to /etc/hosts: [root@virt1 ~]# systemctl status ovirt-ha-agent -l ● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2017-11-16 07:44:43 SAST; 4min 23s ago Main PID: 41309 (ovirt-ha-agent) CGroup: /system.slice/ovirt-ha-agent.service └─41309 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent --no-daemon Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:30 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:39 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored in the HE configuration image Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 191, in _run_agent return action(he) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 64, in action_proper return he.start_monitoring() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 423, in start_monitoring for old_state, state, delay in self.fsm: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 127, in next new_data = self.refresh(self._state.data) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 123, in refresh ] = self.hosted_engine.min_memory_threshold File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 183, in min_memory_threshold return int(self._config.get(config.VM, config.MEM_SIZE)) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/env/config.py", line 226, in get key KeyError: 'Configuration value not found: file=/var/run/ovirt-hosted-engine-ha/vm.conf, key=memSize' Nov 16 07:48:41 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Trying to restart agent Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs Nov 16 07:49:01 virt ovirt-ha-agent[41309]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config ERROR 'version' is not stored -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

2 2

where to change vnc password?
by Rudi Ahlers 16 Nov '17

16 Nov '17

Hi, I installed hosted-engine on a VM but failed to see the VNC password due to power failure. The hosted-engine VM is running now, but I don't know where to see or change the VNC password. Can someone please tell me where to change it? -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

2 1

cannot remove gluster brick
by Rudi Ahlers 15 Nov '17

15 Nov '17

Hi, I am trying to remove a brick, from a server which is no longer part of the gluster pool, but I keep running into errors for which I cannot find answers on google. [root@virt2 ~]# gluster peer status Number of Peers: 3 Hostname: srv1 Uuid: 2bed7e51-430f-49f5-afbc-06f8cec9baeb State: Peer in Cluster (Disconnected) Hostname: srv3 Uuid: 0e78793c-deca-4e3b-a36f-2333c8f91825 State: Peer in Cluster (Connected) Hostname: srv4 Uuid: 1a6eedc6-59eb-4329-b091-2b9bc6f0834f State: Peer in Cluster (Connected) [root@virt2 ~]# [root@virt2 ~]# gluster volume info data Volume Name: data Type: Replicate Volume ID: d09e4534-8bc0-4b30-be89-bc1ec2b439c7 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: srv1:/gluster/data/brick1 Brick2: srv2:/gluster/data/brick1 Brick3: srv3:/gluster/data/brick1 Options Reconfigured: nfs.disable: on transport.address-family: inet performance.quick-read: off performance.read-ahead: off performance.io-cache: off performance.low-prio-threads: 32 network.remote-dio: enable cluster.eager-lock: enable cluster.quorum-type: auto cluster.server-quorum-type: server cluster.data-self-heal-algorithm: full cluster.locking-scheme: granular cluster.shd-max-threads: 8 cluster.shd-wait-qlength: 10000 features.shard: on user.cifs: off storage.owner-uid: 36 storage.owner-gid: 36 features.shard-block-size: 512MB [root@virt2 ~]# gluster volume remove-brick data replica 2 srv1:/gluster/data/brick1 start volume remove-brick start: failed: Migration of data is not needed when reducing replica count. Use the 'force' option [root@virt2 ~]# gluster volume remove-brick data replica 2 srv1:/gluster/data/brick1 commit Removing brick(s) can result in data loss. Do you want to Continue? (y/n) y volume remove-brick commit: failed: Brick srv1:/gluster/data/brick1 is not decommissioned. Use start or force option The server virt1 is not part of the cluster anymore. -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

2 1

Could not retrieve LUNs, please check your storage.
by luminal＠interfree.it 15 Nov '17

15 Nov '17

Hi, I'm trying to connect a new oVirt Engine Version: 4.1.2.2-1.el7.centos to a Dell MD3200i SAN. I can discover the SAN from the storage new domain window but when I login, instead of seeing the + symbol I get the "Could not retrieve LUNs, please check your storage" error message. I tried with both a raw LUN and with a partitioned LUN but still no luck. Any idea what could cause the problem? Here some commands and logs [root@ov1 vdsm]# multipath -ll 36d4ae52000662da400006cbd59f95a20 dm-3 DELL ,MD32xxi size=20G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw `-+- policy='round-robin 0' prio=11 status=active |- 66:0:0:0 sdb 8:16 active ready running `- 67:0:0:0 sdc 8:32 active ready running [root@ov1 vdsm]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 136.1G 0 disk ├─sda1 8:1 0 1G 0 part /boot └─sda2 8:2 0 135.1G 0 part ├─rhel_ov1-root 253:0 0 50G 0 lvm / ├─rhel_ov1-swap 253:1 0 4G 0 lvm [SWAP] └─rhel_ov1-home 253:2 0 81.1G 0 lvm /home sdb 8:16 0 20G 0 disk └─36d4ae52000662da400006cbd59f95a20 253:3 0 20G 0 mpath sdc 8:32 0 20G 0 disk └─36d4ae52000662da400006cbd59f95a20 253:3 0 20G 0 mpath [root@ov1 vdsm]# dmsetup ls rhel_ov1-home (253:2) rhel_ov1-swap (253:1) rhel_ov1-root (253:0) 36d4ae52000662da400006cbd59f95a20 (253:3) [root@ov1 vdsm]# dmsetup table rhel_ov1-home: 0 170123264 linear 8:2 8390656 rhel_ov1-swap: 0 8388608 linear 8:2 2048 rhel_ov1-root: 0 104857600 linear 8:2 178513920 36d4ae52000662da400006cbd59f95a20: 0 41943040 multipath 3 queue_if_no_path pg_init_retries 50 1 rdac 1 1 round-robin 0 2 1 8:16 1 8:32 1 engine.log 2017-11-15 11:22:32,243Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (default task-70) [e7e6c1fb-27f3-46a5-9863-e454bdcd1898] START, DiscoverSendTargetsVDSCommand(HostName = ov1.foo.bar.org, DiscoverSendTargetsVDSCommandParameters:{runAsync='true', hostId='f1e4fdad-1cf1-473a-97cb-79e2641c2c86', connection='StorageServerConnections:{id='null', connection='10.1.8.200', iqn='null', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}'}), log id: 19df6841 2017-11-15 11:22:33,436Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (default task-70) [e7e6c1fb-27f3-46a5-9863-e454bdcd1898] FINISH, DiscoverSendTargetsVDSCommand, return: [StorageServerConnections:{id='null', connection='10.1.8.200', iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.1.8.201', iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.1.8.202', iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.1.8.203', iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}], log id: 19df6841 2017-11-15 11:22:46,654Z INFO [org.ovirt.engine.core.bll.storage.connection.ConnectStorageToVdsCommand] (default task-78) [bc8ed6d7-264a-43bf-a076-b15f05ef34b8] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-11-15 11:22:46,657Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-78) [bc8ed6d7-264a-43bf-a076-b15f05ef34b8] START, ConnectStorageServerVDSCommand(HostName = ov1.foo.bar.org, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='f1e4fdad-1cf1-473a-97cb-79e2641c2c86', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='ISCSI', connectionList='[StorageServerConnections:{id='null', connection='10.1.8.200', iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 252cf708 2017-11-15 11:22:47,861Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (default task-78) [bc8ed6d7-264a-43bf-a076-b15f05ef34b8] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 252cf708 2017-11-15 11:22:48,028Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] START, GetDeviceListVDSCommand(HostName = ov1.foo.bar.org, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='f1e4fdad-1cf1-473a-97cb-79e2641c2c86', storageType='ISCSI', checkStatus='false', lunIds='null'}), log id: 23ff3186 2017-11-15 11:22:49,198Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand' return value ' LUNListReturn:{status='Status [code=0, message=Done]'} status = unknown vendorID = DELL capacity = 21474836480 fwrev = 0820 discard_zeroes_data = 0 vgUUID = pvsize = pathlist: [{initiatorname=default, connection=10.1.8.201, iqn=iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44, portal=1, user=null, password=dEk4n49Sa3og, port=3260}, {initiatorname=default, connection=10.1.8.200, iqn=iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44, portal=1, user=null, password=dEk4n49Sa3og, port=3260}] logicalblocksize = 512 discard_max_bytes = 0 pathstatus: [{type=iSCSI, physdev=sdb, capacity=21474836480, state=active, lun=0}, {type=iSCSI, physdev=sdc, capacity=21474836480, state=active, lun=0}] devtype = iSCSI physicalblocksize = 512 pvUUID = serial = SDELL_MD32xxi_358001G GUID = 36d4ae52000662da400006cbd59f95a20 productID = MD32xxi ' 2017-11-15 11:22:49,198Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] HostName = ov1.foo.bar.org 2017-11-15 11:22:49,198Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] Failed in 'GetDeviceListVDS' method, for vds: 'ov1.foo.bar.org'; host: '10.0.2.161': null 2017-11-15 11:22:49,198Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] Command 'GetDeviceListVDSCommand(HostName = ov1.foo.bar.org, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='f1e4fdad-1cf1-473a-97cb-79e2641c2c86', storageType='ISCSI', checkStatus='false', lunIds='null'})' execution failed: null 2017-11-15 11:22:49,199Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] FINISH, GetDeviceListVDSCommand, log id: 23ff3186 2017-11-15 11:22:49,199Z ERROR [org.ovirt.engine.core.bll.storage.disk.lun.GetDeviceListQuery] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] Query 'GetDeviceListQuery' failed: EngineException: java.lang.NullPointerException (Failed with error ENGINE and code 5001) 2017-11-15 11:22:49,199Z ERROR [org.ovirt.engine.core.bll.storage.disk.lun.GetDeviceListQuery] (default task-90) [8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2] Exception: org.ovirt.engine.core.common.errors.EngineException: EngineException: java.lang.NullPointerException (Failed with error ENGINE and code 5001) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:118) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.runVdsCommand(QueriesCommandBase.java:242) [bll.jar:] at org.ovirt.engine.core.bll.storage.disk.lun.GetDeviceListQuery.executeQueryCommand(GetDeviceListQuery.java:34) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:110) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendQueryExecutor.execute(DefaultBackendQueryExecutor.java:14) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:582) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:550) [bll.jar:] at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source) [:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_151] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:80) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor77.invoke(Unknown Source) [:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_151] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:89) at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runMultipleQueries(GenericApiGWTServiceImpl.java:123) at sun.reflect.GeneratedMethodAccessor93.invoke(Unknown Source) [:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_151] at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:561) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:265) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processPost(RemoteServiceServlet.java:305) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.service(GenericApiGWTServiceImpl.java:77) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) [branding.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:66) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_151] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_151] Caused by: java.lang.NullPointerException at org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand.parseConnection(GetDeviceListVDSCommand.java:211) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand.parseLun(GetDeviceListVDSCommand.java:139) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand.parseLUNList(GetDeviceListVDSCommand.java:63) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand.executeVdsBrokerCommand(GetDeviceListVDSCommand.java:57) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:73) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:407) [vdsbroker.jar:] ... 139 more vdsm.log 2017-11-15 11:22:32,245+0000 INFO (jsonrpc/6) [vdsm.api] START discoverSendTargets(con={'ipv6_enabled': False, 'connection': u'10.1.8.200', 'password': '', 'port': u'3260', 'user': ''}, options=None) from=::ffff:10.0.2.161,43392, flow_id=e7e6c1fb-27f3-46a5-9863-e454bdcd1898, task_id=b770efcc-fb83-487a-8344-84c376f01ae3 (api:46) 2017-11-15 11:22:32,433+0000 INFO (jsonrpc/6) [vdsm.api] FINISH discoverSendTargets return={'fullTargets': ['10.1.8.200:3260,1 iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', '10.1.8.201:3260,1 iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', '10.1.8.202:3260,2 iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', '10.1.8.203:3260,2 iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44'], 'targets': ['iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44']} from=::ffff:10.0.2.161,43392, flow_id=e7e6c1fb-27f3-46a5-9863-e454bdcd1898, task_id=b770efcc-fb83-487a-8344-84c376f01ae3 (api:52) 2017-11-15 11:22:32,434+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call ISCSIConnection.discoverSendTargets succeeded in 0.19 seconds (__init__:539) 2017-11-15 11:22:36,183+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:22:40,606+0000 INFO (jsonrpc/7) [vdsm.api] START repoStats(options=None) from=::ffff:10.0.2.161,43392, task_id=c79b71ef-1bbe-4d46-be48-d739565938d6 (api:46) 2017-11-15 11:22:40,606+0000 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={} from=::ffff:10.0.2.161,43392, task_id=c79b71ef-1bbe-4d46-be48-d739565938d6 (api:52) 2017-11-15 11:22:40,611+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539) 2017-11-15 11:22:41,571+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:22:44,078+0000 INFO (periodic/3) [vdsm.api] START repoStats(options=None) from=internal, task_id=8704275f-ccd1-4203-ade7-3db3727b17e1 (api:46) 2017-11-15 11:22:44,078+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats return={} from=internal, task_id=8704275f-ccd1-4203-ade7-3db3727b17e1 (api:52) 2017-11-15 11:22:46,659+0000 INFO (jsonrpc/2) [vdsm.api] START connectStorageServer(domType=3, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'id': u'00000000-0000-0000-0000-000000000000', u'connection': u'10.1.8.200', u'iqn': u'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', u'user': u'', u'tpgt': u'1', u'password': '********', u'port': u'3260'}], options=None) from=::ffff:10.0.2.161,43392, flow_id=bc8ed6d7-264a-43bf-a076-b15f05ef34b8, task_id=784fea0b-c972-4226-8071-f9f5eca657b5 (api:46) 2017-11-15 11:22:46,689+0000 INFO (jsonrpc/2) [storage.ISCSI] iSCSI iface.net_ifacename not provided. Skipping. (iscsi:590) 2017-11-15 11:22:46,858+0000 INFO (jsonrpc/2) [vdsm.api] FINISH connectStorageServer return={'statuslist': [{'status': 0, 'id': u'00000000-0000-0000-0000-000000000000'}]} from=::ffff:10.0.2.161,43392, flow_id=bc8ed6d7-264a-43bf-a076-b15f05ef34b8, task_id=784fea0b-c972-4226-8071-f9f5eca657b5 (api:52) 2017-11-15 11:22:46,858+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.20 seconds (__init__:539) 2017-11-15 11:22:48,030+0000 INFO (jsonrpc/3) [vdsm.api] START getDeviceList(storageType=3, guids=(), checkStatus=False, options={}) from=::ffff:10.0.2.161,43392, flow_id=8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2, task_id=12ce2e46-7552-443a-b531-9817a601e814 (api:46) 2017-11-15 11:22:48,195+0000 INFO (jsonrpc/3) [vdsm.api] FINISH getDeviceList return={'devList': [{'status': 'unknown', 'vendorID': 'DELL', 'capacity': '21474836480', 'fwrev': '0820', 'discard_zeroes_data': 0, 'vgUUID': '', 'pvsize': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.1.8.201', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', 'portal': '1', 'user': None, 'password': '********', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.1.8.200', 'iqn': 'iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44', 'portal': '1', 'user': None, 'password': '********', 'port': '3260'}], 'logicalblocksize': '512', 'discard_max_bytes': 0, 'pathstatus': [{'type': 'iSCSI', 'physdev': 'sdb', 'capacity': '21474836480', 'state': 'active', 'lun': '0'}, {'type': 'iSCSI', 'physdev': 'sdc', 'capacity': '21474836480', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': '', 'serial': 'SDELL_MD32xxi_358001G', 'GUID': '36d4ae52000662da400006cbd59f95a20', 'productID': 'MD32xxi'}]} from=::ffff:10.0.2.161,43392, flow_id=8c71fc65-afed-4de9-b62e-cbfb8fcc5ea2, task_id=12ce2e46-7552-443a-b531-9817a601e814 (api:52) 2017-11-15 11:22:48,195+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getDeviceList succeeded in 0.16 seconds (__init__:539) 2017-11-15 11:22:51,197+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:22:56,610+0000 INFO (jsonrpc/5) [vdsm.api] START repoStats(options=None) from=::ffff:10.0.2.161,43392, task_id=a35d1845-956f-4d63-9b83-ae3b074336df (api:46) 2017-11-15 11:22:56,610+0000 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={} from=::ffff:10.0.2.161,43392, task_id=a35d1845-956f-4d63-9b83-ae3b074336df (api:52) 2017-11-15 11:22:56,615+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:22:57,576+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:22:59,094+0000 INFO (periodic/2) [vdsm.api] START repoStats(options=None) from=internal, task_id=48877af7-0645-4c21-bbb2-ebeca4e6353a (api:46) 2017-11-15 11:22:59,095+0000 INFO (periodic/2) [vdsm.api] FINISH repoStats return={} from=internal, task_id=48877af7-0645-4c21-bbb2-ebeca4e6353a (api:52) 2017-11-15 11:23:06,210+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:12,611+0000 INFO (jsonrpc/7) [vdsm.api] START repoStats(options=None) from=::ffff:10.0.2.161,43392, task_id=425d52ca-43ca-4e25-ac87-e19bf1faf96c (api:46) 2017-11-15 11:23:12,612+0000 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={} from=::ffff:10.0.2.161,43392, task_id=425d52ca-43ca-4e25-ac87-e19bf1faf96c (api:52) 2017-11-15 11:23:12,616+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:13,580+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:14,110+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None) from=internal, task_id=9ee18ca7-bb48-4abd-ac29-dd901d389162 (api:46) 2017-11-15 11:23:14,110+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats return={} from=internal, task_id=9ee18ca7-bb48-4abd-ac29-dd901d389162 (api:52) 2017-11-15 11:23:21,222+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:28,613+0000 INFO (jsonrpc/3) [vdsm.api] START repoStats(options=None) from=::ffff:10.0.2.161,43392, task_id=0fec4f25-e4c6-4d9c-b3da-66c508a06d1c (api:46) 2017-11-15 11:23:28,613+0000 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={} from=::ffff:10.0.2.161,43392, task_id=0fec4f25-e4c6-4d9c-b3da-66c508a06d1c (api:52) 2017-11-15 11:23:28,618+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539) 2017-11-15 11:23:29,125+0000 INFO (periodic/1) [vdsm.api] START repoStats(options=None) from=internal, task_id=e753422c-6b63-4fa2-9878-afe9b47ca1c1 (api:46) 2017-11-15 11:23:29,125+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={} from=internal, task_id=e753422c-6b63-4fa2-9878-afe9b47ca1c1 (api:52) 2017-11-15 11:23:29,585+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:36,236+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:44,142+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None) from=internal, task_id=fbfaae38-6998-41f3-9979-3660ddb7b7c1 (api:46) 2017-11-15 11:23:44,142+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats return={} from=internal, task_id=fbfaae38-6998-41f3-9979-3660ddb7b7c1 (api:52) 2017-11-15 11:23:44,621+0000 INFO (jsonrpc/6) [vdsm.api] START repoStats(options=None) from=::ffff:10.0.2.161,43392, task_id=5bd875c9-b457-4b7c-97c1-874b406e688e (api:46) 2017-11-15 11:23:44,622+0000 INFO (jsonrpc/6) [vdsm.api] FINISH repoStats return={} from=::ffff:10.0.2.161,43392, task_id=5bd875c9-b457-4b7c-97c1-874b406e688e (api:52) 2017-11-15 11:23:44,626+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:45,589+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-11-15 11:23:51,241+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) supervdsm.log MainProcess|jsonrpc/2::DEBUG::2017-11-15 11:22:46,771::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call hbaRescan with () {} MainProcess|jsonrpc/2::DEBUG::2017-11-15 11:22:46,772::commands::69::storage.HBA::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/libexec/vdsm/fc-scan (cwd None) MainProcess|jsonrpc/2::DEBUG::2017-11-15 11:22:46,823::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return hbaRescan with None MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,077::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call hbaRescan with () {} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,077::commands::69::storage.HBA::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/libexec/vdsm/fc-scan (cwd None) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,129::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return hbaRescan with None MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,164::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call getPathsStatus with () {} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,164::commands::69::storage.Misc.excCmd::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/sbin/dmsetup status (cwd None) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,168::commands::93::storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0 MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,169::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return getPathsStatus with {'sdb': 'active', 'sdc': 'active'} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,169::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call getScsiSerial with ('dm-3',) {} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,169::commands::69::storage.Misc.excCmd::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/lib/udev/scsi_id --page=0x80 --whitelisted --export --replace-whitespace --device=/dev/dm-3 (cwd None) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,172::commands::93::storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0 MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,173::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return getScsiSerial with SDELL_MD32xxi_358001G MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,174::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call readSessionInfo with (56,) {} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,175::commands::69::storage.Misc.excCmd::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/sbin/iscsiadm -m iface -I default (cwd None) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,183::commands::93::storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0 MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,174::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return readSessionInfo with IscsiSession(id=56, iface=<IscsiInterface name='default' transport='tcp' netIfaceName='None'>, target=IscsiTarget(portal=IscsiPortal(hostname='10.1.8.201', port=3260), tpgt=1, iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44'), credentials=<vdsm.storage.iscsi.ChapCredentials object at 0x7f4818169cd0>) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,185::supervdsmServer::90::SuperVdsm.ServerCallback::(wrapper) call readSessionInfo with (57,) {} MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,185::commands::69::storage.Misc.excCmd::(execCmd) /usr/bin/taskset --cpu-list 0-7 /usr/sbin/iscsiadm -m iface -I default (cwd None) MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,194::commands::93::storage.Misc.excCmd::(execCmd) SUCCESS: <err> = ''; <rc> = 0 MainProcess|jsonrpc/3::DEBUG::2017-11-15 11:22:48,185::supervdsmServer::97::SuperVdsm.ServerCallback::(wrapper) return readSessionInfo with IscsiSession(id=57, iface=<IscsiInterface name='default' transport='tcp' netIfaceName='None'>, target=IscsiTarget(portal=IscsiPortal(hostname='10.1.8.200', port=3260), tpgt=1, iqn='iqn.1984-05.com.dell:powervault.md3200i.6d4ae5200063fd45000000004f0c6e44'), credentials=<vdsm.storage.iscsi.ChapCredentials object at 0x7f48181699d0>) Thanks, Alberto.

2 2

Trouble Connecting ISCSI Storage to Hosted Engine
by Kyle Conti 15 Nov '17

15 Nov '17

------=_Part_2596671_1320190900.1510668774590 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hello, I'm brand new to Ovirt and trying to get my Hosted Engine setup configured with ISCSI storage. I have ~8TB usable storage available on an LVM partition. This storage is on the same server that is hosting the ovirt engine virtual machine. After I use the discovery/sendtargets command via Centos 7 engine vm, it shows the correct IQN. When I use ovirt's storage discovery in GUI, I can see the storage IQN just fine as well, but when I try to connect to it, I get the following: "Error while executing action: Failed to login to iSCSI node due to authorization failure" Is NFS recommended instead when trying to connect the storage from server host to Ovirt Engine VM? There is nothing in this storage domain yet. This is a brand new setup. One other thing to note...I have iscsi storage working with a NAS for my ISO storage domain. I don't want to use the NAS for the virtual machine storage domain. What's so different about the Ovirt Engine vm? Any help would be much appreciated. Please let me know If I'm taking the wrong approach here, or I'm trying to do something that this system is not meant to do. Regards, KC ------=_Part_2596671_1320190900.1510668774590 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: Arial; font-size: 10pt; color: #0000= 00"><div>Hello,<br></div><div><br data-mce-bogus=3D"1"></div><div>I'm brand= new to Ovirt and trying to get my Hosted Engine setup configured with ISCS= I storage.  I have ~8TB usable storage available on an LVM partition.&= nbsp; This storage is on the same server that is hosting the ovirt engine v= irtual machine.  After I use the discovery/sendtargets command via Cen= tos 7 engine vm, it shows the correct IQN.  When I use ovirt's storage= discovery in GUI, I can see the storage IQN just fine as well, but when I = try to connect to it, I get the following:</div><div><br data-mce-bogus=3D"= 1"></div><div>"Error while executing action: Failed to login to iSCSI node = due to authorization failure"</div><div><br></div><div>Is NFS recommended i= nstead when trying to connect the storage from server host to Ovirt Engine = VM?  There is nothing in this storage domain yet.  This is a bran= d new setup.<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></= div><div>One other thing to note...I have iscsi storage working with a NAS = for my ISO storage domain.  I don't want to use the NAS for the virtua= l machine storage domain.  What's so different about the Ovirt Engine = vm?<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>= Any help would be much appreciated.  Please let me know If I'm taking = the wrong approach here, or I'm trying to do something that this system is = not meant to do.<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1= "></div><div data-marker=3D"__SIG_PRE__"><div><span style=3D"font-family: v= erdana; font-size: 10pt;" size=3D"2" face=3D"verdana" data-mce-style=3D"fon= t-family: verdana; font-size: 10pt;">Regards,</span></div><div><span style= =3D"font-family: verdana; font-size: 10pt;" size=3D"2" face=3D"verdana" dat= a-mce-style=3D"font-family: verdana; font-size: 10pt;"></span><br></div><di= v><span style=3D"font-family: verdana; font-size: 10pt;" size=3D"2" face=3D= "verdana" data-mce-style=3D"font-family: verdana; font-size: 10pt;"><b>KC<b= r></b></span></div></div></div></body></html> ------=_Part_2596671_1320190900.1510668774590--

2 2

Host nic up and down + sanlock errors
by Jayme Fall 15 Nov '17

15 Nov '17

I’ve been handed an ovirt setup from a previous admin that has resigned from the company. It was setup more as a test bed and not a final solution. Storage is being mounted over NFS from local drives contained on one of the hosts. I’ve been seeing alerts about one particular host’s nic going up and down frequently and now I’m seeing some sanlock errors around the same time (I’m assuming probably related to the interface being up and down). Wondering how concerning this is and what might be causing it. Nov 15 03:26:52 kernel: ixgbe 0000:0c:00.0 enp12s0: NIC Link is Down Nov 15 03:26:52 kernel: ovirtmgmt: port 1(enp12s0) entered disabled state Nov 15 03:26:56 kernel: ixgbe 0000:0c:00.0 enp12s0: NIC Link is Up 10 Gbps, Flow Control: None Nov 15 03:26:56 kernel: ovirtmgmt: port 1(enp12s0) entered forwarding state Nov 15 03:27:03 sanlock[627]: 2017-11-15 03:27:03-0400 11464708 [9013]: s13 delta_renew read timeout 10 sec offset 0 /rhev/data-center/mnt/HOSTNAME:_exports_hosted__engine/248f46f0-d793-4581-9810-c9d965e2f286/dom_md/ids Nov 15 03:27:03 sanlock[627]: 2017-11-15 03:27:03-0400 11464708 [9013]: s13 renewal error -202 delta_length 10 last_success 11464677 Thanks!

1 0

[OT] how to analyze/avoid dropped rx packets
by Gianluca Cecchi 15 Nov '17

15 Nov '17

Hello, on some Oracle Linux 7 VMs I see that dropped RX packets continue to increase. The eth0 interface is virtio for all of them. When running tcpdump on eth0 the counter stop increasing and so it means tcpdump does capture them I found some references about these kind of rx dropped frames with CentOS 7 too and other distros with new kernels. eg: https://www.netiq.com/support/kb/doc.php?id=7007165 and *https://serverfault.com/questions/528290/ifconfig-eth0-rx-dropped-packets <https://serverfault.com/questions/528290/ifconfig-eth0-rx-dropped-packets>* In my case it doesn't seem that the nature of the dropped packages is STP, but IP6 On my VMs I have disabled ipv6 I see that in about 100 seconds I have 180 dropped frames occured, and when running tcpdump for the same amount of time I have in it about 180 DHCPv6 packets, so I presume it is it the responsible Any way to avoid this, at VM or hypervisor level? Thanks in advance, Gianluca

2 1

how to move network bridge?
by Rudi Ahlers 15 Nov '17

15 Nov '17

Hi, Can someone please help me "move" the network bridge to another port? I have tried a couple times but it doesn't seem to work. Our internal LAN IP range is 192.168.102.0/24 and the storage area network is 10.10.10.0/24 When I installed hosted-engine, I accidently told it to use the 10.10.10.81 interface and a bridge was created accordingly. But I cannot access the 10.10.10.0/24 IP range via our VPN (for security reasons) so I can't access the hosted-engine I tried to remove the bridge interface with brctl but it didn't work as expected. root@virt1 ~]# brctl show bridge name bridge id STP enabled interfaces ;vdsmdummy; 8000.000000000000 no ovirtmgmt 8000.0cc47aeaffd8 no ens2f0 Even though I tried to remove ens2f0 and added ens2f3, it never worked. The bridge / network would stop working and I wold need to login to the server's IPMI card and remove ens2f0. Can someone please guide me in moving the bridge to the 192.168.102.0/24 network? -- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za

2 4

VLAN trunk
by Magnus Isaksson 15 Nov '17

15 Nov '17

Hello, In VMware you create a vlan and for tag you choose "all" or 4095. What is the equivalent in oVirt? I am setting up a pfSense firewall and i dont want to create a new NIC for every VLAN i want in the firewall, so in VMware im creating 3 nics, WAN, VGT and HA Sync, with that i can add as many internal VLAN i want. Cheers Magnus

2 1

LDAP sources
by Magnus Isaksson 15 Nov '17

15 Nov '17

Hello, I have tried googling and searching in the documentation, but i can't seem to find any instructions on how to remove a authentication source. The background is that i did set up an FreeIPA server for auth, worked perfectly, but i ran into some problems using that to auth other systems, so i had to setup a new FreeIPA server and added that to oVirt, but now i want to remove the old one, but can not seem to find how. Anyone sitting on that info? And while on the subject, how do i set the FreeIPA auth as default auth source in oVirt? Regards Magnus

2 1