<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""><div><blockquote type="cite" class=""><div class="">On 9 Apr 2017, at 09:16, Yaniv Kaul &lt;<a href="mailto:ykaul@redhat.com" class="">ykaul@redhat.com</a>&gt; wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="gmail_extra"><br class="Apple-interchange-newline"><br class=""><div class="gmail_quote">On Fri, Apr 7, 2017 at 5:29 PM, Bill James<span class="Apple-converted-space">&nbsp;</span><span dir="ltr" class="">&lt;<a href="mailto:bill.james@j2.com" target="_blank" class="">bill.james@j2.com</a>&gt;</span><span class="Apple-converted-space">&nbsp;</span>wrote:<br class=""><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;"><div bgcolor="#FFFFFF" text="#000000" class=""><div class=""><div class="h5"><br class=""><br class=""><div class="m_-7375313093972664498moz-cite-prefix">On 4/7/17 12:52 AM, Nir Soffer wrote:<br class=""></div><blockquote type="cite" class=""><div dir="ltr" class=""><div class="gmail_quote"><div dir="ltr" class="">On Fri, Apr 7, 2017 at 2:40 AM Bill James &lt;<a href="mailto:bill.james@j2.com" target="_blank" class="">bill.james@j2.com</a>&gt; wrote:<br class=""></div><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;">We are trying to convert our qa environment from local nfs to gluster.<br class="m_-7375313093972664498gmail_msg">When I move a disk with a VM that is running on same server as the<br class="m_-7375313093972664498gmail_msg">storage it fails.<br class="m_-7375313093972664498gmail_msg">When I move a disk with VM running on a different system it works.<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">VM running on same system as disk:<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">2017-04-06 13:31:00,588 ERROR (jsonrpc/6) [virt.vm]<br class="m_-7375313093972664498gmail_msg">(vmId='e598485a-dc74-43f7-<wbr class="">8447-e00ac44dae21') Unable to start<br class="m_-7375313093972664498gmail_msg">replication for vda to {u'domainID':<br class="m_-7375313093972664498gmail_msg">u'6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9', 'volumeInfo': {'domainID':<br class="m_-7375313093972664498gmail_msg">u'6affd8c3-2c<br class="m_-7375313093972664498gmail_msg">51-4cd1-8300-bfbbb14edbe9', 'volType': 'path', 'leaseOffset': 0, 'path':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/30fd46c9-c738-<wbr class="">4b13-aeca-3dc9ffc677f5',<br class="m_-7375313093972664498gmail_msg">'volumeID': u'30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5', 'leasePath':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/30fd46c9-c738-<wbr class="">4b13-aeca-3dc9ffc677f5.lease',<br class="m_-7375313093972664498gmail_msg">'imageID': u'7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753'}, 'diskType': 'file',<br class="m_-7375313093972664498gmail_msg">'format': 'cow', 'cache': 'none', u'volumeID':<br class="m_-7375313093972664498gmail_msg">u'30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5', u'imageID':<br class="m_-7375313093972664498gmail_msg">u'7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753', u'poolID':<br class="m_-7375313093972664498gmail_msg">u'8b6303b3-79c6-4633-ae21-<wbr class="">71b15ed00675', u'device': 'disk', 'path':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/8b6303b3-<wbr class="">79c6-4633-ae21-71b15ed00675/<wbr class="">6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9/images/7ae9b3f7-<wbr class="">3507-4469-a080-d0944d0ab753/<wbr class="">30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5',<br class="m_-7375313093972664498gmail_msg">'propagateErrors': u'off', 'volumeChain': [{'domainID':<br class="m_-7375313093972664498gmail_msg">u'6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9', 'volType': 'path',<br class="m_-7375313093972664498gmail_msg">'leaseOffset': 0, 'path':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/6756eb05-6803-<wbr class="">42a7-a3a2-10233bf2ca8d',<br class="m_-7375313093972664498gmail_msg">'volumeID': u'6756eb05-6803-42a7-a3a2-<wbr class="">10233bf2ca8d', 'leasePath':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/6756eb05-6803-<wbr class="">42a7-a3a2-10233bf2ca8d.lease',<br class="m_-7375313093972664498gmail_msg">'imageID': u'7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753'}, {'domainID':<br class="m_-7375313093972664498gmail_msg">u'6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9', 'volType': 'path',<br class="m_-7375313093972664498gmail_msg">'leaseOffset': 0, 'path':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/30fd46c9-c738-<wbr class="">4b13-aeca-3dc9ffc677f5',<br class="m_-7375313093972664498gmail_msg">'volumeID': u'30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5', 'leasePath':<br class="m_-7375313093972664498gmail_msg">u'/rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753/30fd46c9-c738-<wbr class="">4b13-aeca-3dc9ffc677f5.lease',<br class="m_-7375313093972664498gmail_msg">'imageID': u'7ae9b3f7-3507-4469-a080-<wbr class="">d0944d0ab753'}]} (vm:3594)<br class="m_-7375313093972664498gmail_msg">Traceback (most recent call last):<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/share/vdsm/virt/vm.py", line 3588, in diskReplicateStart<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;self._startDriveReplication(<wbr class="">drive)<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/share/vdsm/virt/vm.py", line 3713, in _startDriveReplication<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;self._dom.blockCopy(<a href="http://drive.name/" rel="noreferrer" class="m_-7375313093972664498gmail_msg" target="_blank">drive.<wbr class="">name</a>, destxml, flags=flags)<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/lib/python2.7/site-<wbr class="">packages/vdsm/virt/virdomain.<wbr class="">py", line<br class="m_-7375313093972664498gmail_msg">69, in f<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;ret = attr(*args, **kwargs)<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/lib/python2.7/site-<wbr class="">packages/vdsm/<wbr class="">libvirtconnection.py",<br class="m_-7375313093972664498gmail_msg">line 123, in wrapper<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;ret = f(*args, **kwargs)<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/lib/python2.7/site-<wbr class="">packages/vdsm/utils.py", line 941, in<br class="m_-7375313093972664498gmail_msg">wrapper<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;return func(inst, *args, **kwargs)<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp;File "/usr/lib64/python2.7/site-<wbr class="">packages/libvirt.py", line 684, in<br class="m_-7375313093972664498gmail_msg">blockCopy<br class="m_-7375313093972664498gmail_msg">&nbsp; &nbsp; &nbsp;if ret == -1: raise libvirtError ('virDomainBlockCopy() failed',<br class="m_-7375313093972664498gmail_msg">dom=self)<br class="m_-7375313093972664498gmail_msg">libvirtError: internal error: unable to execute QEMU command<br class="m_-7375313093972664498gmail_msg">'drive-mirror': Could not open<br class="m_-7375313093972664498gmail_msg">'/rhev/data-center/8b6303b3-<wbr class="">79c6-4633-ae21-71b15ed00675/<wbr class="">6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9/images/7ae9b3f7-<wbr class="">3507-4469-a080-d0944d0ab753/<wbr class="">30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5':<br class="m_-7375313093972664498gmail_msg">Permission denied<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">[root@ovirt1 test vdsm]# ls -l<br class="m_-7375313093972664498gmail_msg">/rhev/data-center/8b6303b3-<wbr class="">79c6-4633-ae21-71b15ed00675/<wbr class="">6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9/images/7ae9b3f7-<wbr class="">3507-4469-a080-d0944d0ab753/<wbr class="">30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5<br class="m_-7375313093972664498gmail_msg">-rw-rw---- 2 vdsm kvm 197120 Apr&nbsp; 6 13:29<br class="m_-7375313093972664498gmail_msg">/rhev/data-center/8b6303b3-<wbr class="">79c6-4633-ae21-71b15ed00675/<wbr class="">6affd8c3-2c51-4cd1-8300-<wbr class="">bfbbb14edbe9/images/7ae9b3f7-<wbr class="">3507-4469-a080-d0944d0ab753/<wbr class="">30fd46c9-c738-4b13-aeca-<wbr class="">3dc9ffc677f5<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">Then if I try and rerun it it says, even though move failed:<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">2017-04-06 13:49:27,197 INFO&nbsp; (jsonrpc/1) [dispatcher] Run and protect:<br class="m_-7375313093972664498gmail_msg">getAllTasksStatuses, Return response: {'allT<br class="m_-7375313093972664498gmail_msg">asksStatus': {'078d962c-e682-40f9-a177-<wbr class="">2a8b479a7d8b': {'code': 212,<br class="m_-7375313093972664498gmail_msg">'message': 'Volume already exists', 'taskState':<br class="m_-7375313093972664498gmail_msg">&nbsp;<span class="Apple-converted-space">&nbsp;</span>'finished', 'taskResult': 'cleanSuccess', 'taskID':<br class="m_-7375313093972664498gmail_msg">'078d962c-e682-40f9-a177-<wbr class="">2a8b479a7d8b'}}} (logUtils:52)<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">So now I have to clean up the disks that it failed to move so I can<br class="m_-7375313093972664498gmail_msg">migrate the VM and then move the disk again.<br class="m_-7375313093972664498gmail_msg">Or so it seems.<br class="m_-7375313093972664498gmail_msg">Failed move disks do exist in new location, even though it "failed".<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">vdsm.log attached.<br class="m_-7375313093972664498gmail_msg"><br class="m_-7375313093972664498gmail_msg">ovirt-engine-tools-4.1.0.4-1.<wbr class="">el7.centos.noarch<br class="m_-7375313093972664498gmail_msg">vdsm-4.19.4-1.el7.centos.x86_<wbr class="">64<br class="m_-7375313093972664498gmail_msg"></blockquote><div class=""><br class=""></div><div class="">Hi Bill,</div><div class=""><br class=""></div><div class="">Does it work after setting selinux to permissive? (setenforce 0)</div><div class=""><br class=""></div><div class="">Can you share output of:</div><div class=""><br class=""></div><div class="">ps -efZ | grep vm-name<br class=""></div><div class="">(filter the specific vm)&nbsp;<br class=""></div><div class=""><br class=""></div><div class="">ls -lhZ /rhev/data-center/mnt</div><div class=""><br class=""></div><div class="">ls -lhZ /rhev/data-center/mnt/gluster-<wbr class="">server:_path/sd_id/images/img_<wbr class="">id/vol_id</div><div class="">(assuming the volume was not deleted after the operation).</div><div class=""><br class=""></div><div class="">If the volume is not deleted after the failed move disk operation, this is likely</div><div class="">a bug, please file a bug for this.</div><div class=""><br class=""></div><div class="">The actual failure may be gluster configuration issue, or selinux related bug.</div><div class=""><br class=""></div><div class="">Nir</div><div class="">&nbsp;<br class=""></div></div></div></blockquote><br class=""></div></div>SELinux status:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; disabled<br class=""></div></blockquote><div class=""><br class=""></div><div class="">This is a less tested configuration. We usually run with selinux enabled.</div></div></div></div></div></blockquote><div><br class=""></div>Disabled specifically is untested. And doesn’t work.</div><div>If you for whatever reason don’t want it, set it to Permissive, but don’t disable it</div><div><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="gmail_extra"><div class="gmail_quote"><div class="">Y.</div><div class="">&nbsp;</div><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;"><div bgcolor="#FFFFFF" text="#000000" class=""><br class="">[root@ovirt1 test images]# ps -efZ | grep darmaster<br class="">-&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;<span class="Apple-converted-space">&nbsp;</span>root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5272&nbsp;&nbsp;&nbsp;&nbsp; 1&nbsp; 6 Mar17 ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1-09:08:58 /usr/libexec/qemu-kvm -name guest=<a href="http://darmaster1.test.j2noc.com/" target="_blank" class="">darmaster1.test.j2noc.<wbr class="">com</a>,debug-threads=on -S -object secret,id=masterKey0,format=<wbr class="">raw,file=/var/lib/libvirt/<wbr class="">qemu/domain-13-darmaster1.<wbr class="">test.j2no/master-key.aes -machine pc-i440fx-rhel7.3.0,accel=kvm,<wbr class="">usb=off -cpu Nehalem -m size=1048576k,slots=16,maxmem=<wbr class="">4194304k -realtime mlock=off -smp 1,maxcpus=16,sockets=16,cores=<wbr class="">1,threads=1 -numa node,nodeid=0,cpus=0,mem=1024 -uuid 73368460-92e1-4c9e-a162-<wbr class="">399304f1c462 -smbios type=1,manufacturer=oVirt,<wbr class="">product=oVirt Node,version=7-3.1611.el7.<wbr class="">centos,serial=30343536-3138-<wbr class="">584D-5134-343430313833,uuid=<wbr class="">73368460-92e1-4c9e-a162-<wbr class="">399304f1c462 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/<wbr class="">var/lib/libvirt/qemu/domain-<wbr class="">13-darmaster1.test.j2no/<wbr class="">monitor.sock,server,nowait -mon chardev=charmonitor,id=<wbr class="">monitor,mode=control -rtc base=2017-03-17T23:57:54,<wbr class="">driftfix=slew -global kvm-pit.lost_tick_policy=<wbr class="">discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.<wbr class="">0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=<wbr class="">pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-<wbr class="">serial0,max_ports=16,bus=pci.<wbr class="">0,addr=0x5 -drive if=none,id=drive-ide0-1-0,<wbr class="">readonly=on -device ide-cd,bus=ide.1,unit=0,drive=<wbr class="">drive-ide0-1-0,id=ide0-1-0 -drive file=/rhev/data-center/<wbr class="">8b6303b3-79c6-4633-ae21-<wbr class="">71b15ed00675/7e566f55-e060-<wbr class="">47b7-bfa4-ac3c48d70dda/images/<wbr class="">33db5688-dafe-40ab-9dd0-<wbr class="">a826a90c3793/38de110d-464c-<wbr class="">4735-97ba-3d623ee1a1b6,format=<wbr class="">raw,if=none,id=drive-virtio-<wbr class="">disk0,serial=33db5688-dafe-<wbr class="">40ab-9dd0-a826a90c3793,cache=<wbr class="">none,werror=stop,rerror=stop,<wbr class="">aio=threads -device virtio-blk-pci,scsi=off,bus=<wbr class="">pci.0,addr=0x6,drive=drive-<wbr class="">virtio-disk0,id=virtio-disk0,<wbr class="">bootindex=1 -netdev tap,fd=38,id=hostnet0,vhost=<wbr class="">on,vhostfd=40 -device virtio-net-pci,netdev=<wbr class="">hostnet0,id=net0,mac=00:1a:4a:<wbr class="">16:01:69,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/<wbr class="">var/lib/libvirt/qemu/channels/<wbr class="">73368460-92e1-4c9e-a162-<wbr class="">399304f1c462.com.redhat.rhevm.<wbr class="">vdsm,server,nowait -device virtserialport,bus=virtio-<wbr class="">serial0.0,nr=1,chardev=<wbr class="">charchannel0,id=channel0,name=<wbr class="">com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/<wbr class="">var/lib/libvirt/qemu/channels/<wbr class="">73368460-92e1-4c9e-a162-<wbr class="">399304f1c462.org.qemu.guest_<wbr class="">agent.0,server,nowait -device virtserialport,bus=virtio-<wbr class="">serial0.0,nr=2,chardev=<wbr class="">charchannel1,id=channel1,name=<wbr class="">org.qemu.guest_agent.0 -device usb-tablet,id=input0,bus=usb.<wbr class="">0,port=1 -vnc<span class="Apple-converted-space">&nbsp;</span><a href="http://10.176.30.96:6/" target="_blank" class="">10.176.30.96:6</a>,password -k en-us -device VGA,id=video0,vgamem_mb=16,<wbr class="">bus=pci.0,addr=0x2 -msg timestamp=on<br class=""><br class="">[root@ovirt1 test ~]# ls -lhZ /rhev/data-center/mnt<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>glusterSD<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>netappqa3:_vol_cloud__images_<wbr class="">ovirt__QA__ISOs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>netappqa3:_vol_cloud__<wbr class="">storage1_ovirt__qa__inside<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt1-ks.test.j2noc.com" class="">ovirt1-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs1<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt2-ks.test.j2noc.com" class="">ovirt2-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs2<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt2-ks.test.j2noc.com" class="">ovirt2-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs-2<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt3-ks.test.j2noc.com" class="">ovirt3-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt4-ks.test.j2noc.com" class="">ovirt4-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt5-ks.test.j2noc.com" class="">ovirt5-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt6-ks.test.j2noc.com" class="">ovirt6-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span><a href="http://ovirt7-ks.test.j2noc.com" class="">ovirt7-ks.test.j2noc.com</a>:_<wbr class="">ovirt-store_nfs<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>qagenfil1-nfs1:_ovirt__inside_<wbr class="">Export<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>qagenfil1-nfs1:_ovirt__inside_<wbr class="">images<br class=""><br class=""><br class="">[root@ovirt1 test images]# ls -lhZa /rhev/data-center/mnt/<wbr class="">glusterSD/ovirt1-ks.test.<wbr class=""><a href="http://j2noc.com" class="">j2noc.com</a>:_gv2/6affd8c3-2c51-<wbr class="">4cd1-8300-bfbbb14edbe9/images/<wbr class="">33db5688-dafe-40ab-9dd0-<wbr class="">a826a90c3793<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>.<br class="">drwxr-xr-x vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>..<br class="">-rw-rw---- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>33c04305-efbe-418a-b42c-<wbr class="">07f5f76214f2<br class="">-rw-rw---- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>33c04305-efbe-418a-b42c-<wbr class="">07f5f76214f2.lease<br class="">-rw-r--r-- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>33c04305-efbe-418a-b42c-<wbr class="">07f5f76214f2.meta<br class="">-rw-rw---- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>38de110d-464c-4735-97ba-<wbr class="">3d623ee1a1b6<br class="">-rw-rw---- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>38de110d-464c-4735-97ba-<wbr class="">3d623ee1a1b6.lease<br class="">-rw-r--r-- vdsm kvm ?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<wbr class="">&nbsp;&nbsp;<span class="Apple-converted-space">&nbsp;</span>38de110d-464c-4735-97ba-<wbr class="">3d623ee1a1b6.meta<br class=""><br class=""><br class="">bug submitted:&nbsp;<span class="Apple-converted-space">&nbsp;</span><a class="m_-7375313093972664498moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=1440198" target="_blank">https://bugzilla.redhat.com/<wbr class="">show_bug.cgi?id=1440198</a><br class=""><br class=""><br class="">Thank you!<br class=""></div><br class="">______________________________<wbr class="">_________________<br class="">Users mailing list<br class=""><a href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class=""><a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank" class="">http://lists.ovirt.org/<wbr class="">mailman/listinfo/users</a><br class=""><br class=""></blockquote></div><br class=""></div></div><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Users mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="mailto:Users@ovirt.org" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">Users@ovirt.org</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="http://lists.ovirt.org/mailman/listinfo/users" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://lists.ovirt.org/mailman/listinfo/users</a></div></blockquote></div><br class=""></body></html>