This is a multi-part message in MIME format. --------------020803060003090906080202 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 01/28/2015 03:10 AM, Mikola Rose wrote:
Hi there,
I seem to have run into a problem. my hosted engine vm is failing to start;
vdsm.log;
Thread-20::DEBUG::2015-01-27 16:53:37,999::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.32:_Volumes_Raid1/443b4931-667f-441f-98d8-51384e67a0af Thread-20::ERROR::2015-01-27 16:53:38,000::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 443b4931-667f-441f-98d8-51384e67a0af monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain self.domain = sdCache.produce(self.sdUUID) File "/usr/share/vdsm/storage/sdc.py", line 98, in produce domain.getRealDomain() File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain return self._cache._realProduce(self._sdUUID) File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce domain = self._findDomain(sdUUID) File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain dom = findMethod(sdUUID) File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomain return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID)) File "/usr/share/vdsm/storage/fileSD.py", line 159, in __init__ validateFileSystemFeatures(sdUUID, self.mountpoint) File "/usr/share/vdsm/storage/fileSD.py", line 88, in validateFileSystemFeatures oop.getProcessPool(sdUUID).directTouch(testFilePath) File "/usr/share/vdsm/storage/outOfProcess.py", line 320, in directTouch ioproc.touch(path, flags, mode) File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 507, in touch self.timeout) File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 391, in _sendCommand raise OSError(errcode, errstr) OSError: [Errno 13] Permission denied
I assume this is an nfs issue so I checked to see if I could create a file in the mounts from the host machine, which I could.
My test bed is usign an old OS X NFS via xraid adn the export is ; /Volumes/Raid1 -maproot=root:wheel -network 192.168.1.0 -mask 255.255.255.0
drwxr-xr-x 6 vdsm kvm 204 Jan 27 16:30 443b4931-667f-441f-98d8-51384e67a0af drwxr-xr-x 4 vdsm kvm 136 Jan 27 12:32 data drwxr-xr-x 4 vdsm kvm 136 Jan 27 00:18 iso drwxr-xr-x 3 vdsm kvm 102 Jan 26 09:43 vm
the host machine seems to mount the shares fine....
drwxr-xr-x 5 vdsm kvm 4096 Jan 27 12:28 . drwxr-xr-x 3 vdsm kvm 4096 Jan 27 10:04 .. drwxr-xr-x 13 vdsm kvm 544 Jan 27 00:12 192.168.1.32:_Volumes_Raid1 drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:12 192.168.1.32:_Volumes_Raid1_data drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:24 192.168.1.32:_Volumes_Raid1_iso
and as I said above I can create files in any one of those mounts
Is there a place I can look at to find the offending file? If that is the issue... Oddly enough everything worked until i rebooted, so I must have either changed something or something is buggered.
please echo the output of find /Volumes/Raid1 -name "__DIRECT_IO_TEST__" | xargs ls -la the failure is to create this file.
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------020803060003090906080202 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 01/28/2015 03:10 AM, Mikola Rose wrote:<br> </div> <blockquote cite="mid:DDFE403B-9608-4E3C-A029-EFC39908A6C9@power-soft.com" type="cite"> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> Hi there, <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">I seem to have run into a problem. my hosted engine vm is failing to start;</div> <div class=""><br class=""> </div> <div class="">vdsm.log;</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class=""> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Thread-20::DEBUG::2015-01-27 16:53:37,999::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.32:_Volumes_Raid1/443b4931-667f-441f-98d8-51384e67a0af</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Thread-20::ERROR::2015-01-27 16:53:38,000::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 443b4931-667f-441f-98d8-51384e67a0af monitoring information</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Traceback (most recent call last):</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> self.domain = sdCache.produce(self.sdUUID)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/sdc.py", line 98, in produce</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> domain.getRealDomain()</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> return self._cache._realProduce(self._sdUUID)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> domain = self._findDomain(sdUUID)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> dom = findMethod(sdUUID)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomain</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/fileSD.py", line 159, in __init__</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> validateFileSystemFeatures(sdUUID, self.mountpoint)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/fileSD.py", line 88, in validateFileSystemFeatures</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> oop.getProcessPool(sdUUID).directTouch(testFilePath)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/share/vdsm/storage/outOfProcess.py", line 320, in directTouch</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> ioproc.touch(path, flags, mode)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 507, in touch</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> self.timeout)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 391, in _sendCommand</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> raise OSError(errcode, errstr)</div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">OSError: [Errno 13] Permission denied</div> </div> <div class=""><br class=""> </div> <div class="">I assume this is an nfs issue so I checked to see if I could create a file in the mounts from the host machine, which I could.</div> <div class=""><br class=""> </div> <div class="">My test bed is usign an old OS X NFS via xraid adn the export is ;</div> <div class=""> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">/Volumes/Raid1 -maproot=root:wheel -network 192.168.1.0 -mask 255.255.255.0</div> </div> <div class=""><br class=""> </div> <div class=""> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">drwxr-xr-x 6 vdsm kvm 204 Jan 27 16:30 443b4931-667f-441f-98d8-51384e67a0af</div> </div> <div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""> <div style="margin: 0px;" class="">drwxr-xr-x 4 vdsm kvm 136 Jan 27 12:32 data</div> <div style="margin: 0px;" class=""> <div style="margin: 0px;" class="">drwxr-xr-x 4 vdsm kvm 136 Jan 27 00:18 iso</div> <div style="margin: 0px;" class=""> <div style="margin: 0px;" class="">drwxr-xr-x 3 vdsm kvm 102 Jan 26 09:43 vm</div> <div style="margin: 0px;" class=""><br class=""> </div> <div style="margin: 0px;" class="">the host machine seems to mount the shares fine....</div> <div style="margin: 0px;" class=""><br class=""> </div> <div style="margin: 0px;" class=""> <div style="margin: 0px;" class="">drwxr-xr-x 5 vdsm kvm 4096 Jan 27 12:28 <span style="font-variant-ligatures: no-common-ligatures; color: #4c7aff" class=""> .</span></div> <div style="margin: 0px;" class="">drwxr-xr-x 3 vdsm kvm 4096 Jan 27 10:04 <span style="font-variant-ligatures: no-common-ligatures; color: #4c7aff" class=""> ..</span></div> <div style="margin: 0px;" class="">drwxr-xr-x 13 vdsm kvm 544 Jan 27 00:12 <span style="font-variant-ligatures: no-common-ligatures; color: #4c7aff" class=""> 192.168.1.32:_Volumes_Raid1</span></div> <div style="margin: 0px;" class="">drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:12 <span style="font-variant-ligatures: no-common-ligatures; color: #4c7aff" class=""> 192.168.1.32:_Volumes_Raid1_data</span></div> <div style="margin: 0px;" class="">drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:24 <span style="font-variant-ligatures: no-common-ligatures; color: #4c7aff" class=""> 192.168.1.32:_Volumes_Raid1_iso</span></div> </div> <div style="margin: 0px;" class=""><br class=""> </div> </div> </div> </div> <div class="">and as I said above I can create files in any one of those mounts</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">Is there a place I can look at to find the offending file? If that is the issue... Oddly enough everything worked until i rebooted, so I must have either changed something or something is buggered.</div> <div class=""><br class=""> </div> </blockquote> <br> please echo the output of <br> <br> <meta http-equiv="content-type" content="text/html; charset=windows-1252"> <meta http-equiv="content-type" content="text/html; charset=windows-1252"> find /Volumes/Raid1 -name "__DIRECT_IO_TEST__" | xargs ls -la<br> <br> the failure is to create this file. <br> <br> <blockquote cite="mid:DDFE403B-9608-4E3C-A029-EFC39908A6C9@power-soft.com" type="cite"> <div class=""> </div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------020803060003090906080202--