<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">-rwxr-xr-x &nbsp; 1 vdsm&nbsp; kvm&nbsp; 0 Jan 28 00:59 /Volumes/Raid1/__DIRECT_IO_TEST__</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">-rwxr-xr-x &nbsp; 1 vdsm&nbsp; kvm&nbsp; 0 Jan 28 00:55 /Volumes/Raid1/data/__DIRECT_IO_TEST__</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">-rwxrwxrwx &nbsp; 1 vdsm&nbsp; kvm&nbsp; 0 Jan 28 00:55 /Volumes/Raid1/iso/__DIRECT_IO_TEST__</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">-rwxr-xr-x &nbsp; 1 vdsm&nbsp; kvm&nbsp; 0 Jan 26 09:43 /Volumes/Raid1/vm/__DIRECT_IO_TEST__</div>
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Note, &nbsp;since removing the file the hosted_engine1 is starting up and everything seems fine but then all of a sudden it restarts.</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Also may be related...</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">
<div style="margin: 0px;" class="">root@powerhost1 ~]# engine-iso-uploader --ssh-user=36 upload -i iso rhel-server-6.6-x86_64-dvd.iso</div>
<div style="margin: 0px;" class="">Please provide the REST API password for the admin@internal oVirt Engine user (CTRL&#43;D to abort):&nbsp;</div>
<div style="margin: 0px;" class="">Uploading, please wait...</div>
<div style="margin: 0px;" class="">INFO: Start uploading rhel-server-6.6-x86_64-dvd.iso&nbsp;</div>
<div style="margin: 0px;" class="">ERROR: Unable to copy rhel-server-6.6-x86_64-dvd.iso to ISO storage domain on iso.</div>
<div style="margin: 0px;" class="">ERROR: Error message is &quot;unable to test the available space on /Volumes/Raid1/iso&quot;</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""><br class="">
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class=""><br class="">
</div>
<div class=""><br class="">
</div>
<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Jan 28, 2015, at 12:53 AM, Roy Golan &lt;<a href="mailto:rgolan@redhat.com" class="">rgolan@redhat.com</a>&gt; wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div bgcolor="#FFFFFF" text="#000000" class="">
<div class="moz-cite-prefix">On 01/28/2015 03:10 AM, Mikola Rose wrote:<br class="">
</div>
<blockquote cite="mid:DDFE403B-9608-4E3C-A029-EFC39908A6C9@power-soft.com" type="cite" class="">
Hi there,
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">I seem to have run into a problem. &nbsp;my hosted engine vm is failing to start;</div>
<div class=""><br class="">
</div>
<div class="">vdsm.log;</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Thread-20::DEBUG::2015-01-27 16:53:37,999::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.32:_Volumes_Raid1/443b4931-667f-441f-98d8-51384e67a0af</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Thread-20::ERROR::2015-01-27 16:53:38,000::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 443b4931-667f-441f-98d8-51384e67a0af monitoring
 information</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">Traceback (most recent call last):</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/domainMonitor.py&quot;, line 221, in _monitorDomain</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; self.domain = sdCache.produce(self.sdUUID)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/sdc.py&quot;, line 98, in produce</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; domain.getRealDomain()</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/sdc.py&quot;, line 52, in getRealDomain</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; return self._cache._realProduce(self._sdUUID)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/sdc.py&quot;, line 122, in _realProduce</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; domain = self._findDomain(sdUUID)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/sdc.py&quot;, line 141, in _findDomain</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; dom = findMethod(sdUUID)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/nfsSD.py&quot;, line 122, in findDomain</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/fileSD.py&quot;, line 159, in __init__</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; validateFileSystemFeatures(sdUUID, self.mountpoint)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/fileSD.py&quot;, line 88, in validateFileSystemFeatures</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; oop.getProcessPool(sdUUID).directTouch(testFilePath)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/share/vdsm/storage/outOfProcess.py&quot;, line 320, in directTouch</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; ioproc.touch(path, flags, mode)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/lib/python2.6/site-packages/ioprocess/__init__.py&quot;, line 507, in touch</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; self.timeout)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; File &quot;/usr/lib/python2.6/site-packages/ioprocess/__init__.py&quot;, line 391, in _sendCommand</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">&nbsp; &nbsp; raise OSError(errcode, errstr)</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">OSError: [Errno 13] Permission denied</div>
</div>
<div class=""><br class="">
</div>
<div class="">I assume this is an nfs issue so I checked to see if I could create a file in the mounts from the host machine, &nbsp;which I could.</div>
<div class=""><br class="">
</div>
<div class="">My test bed is usign an old OS X NFS via xraid adn the export is ;</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">/Volumes/Raid1 -maproot=root:wheel -network 192.168.1.0 -mask 255.255.255.0</div>
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">drwxr-xr-x&nbsp; &nbsp; 6 vdsm &nbsp; kvm&nbsp; &nbsp; &nbsp; 204 Jan 27 16:30 443b4931-667f-441f-98d8-51384e67a0af</div>
</div>
<div style="margin: 0px; font-size: 11px; font-family: Menlo;" class="">
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; &nbsp; 4 vdsm &nbsp; kvm&nbsp; &nbsp; &nbsp; 136 Jan 27 12:32 data</div>
<div style="margin: 0px;" class="">
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; &nbsp; 4 vdsm &nbsp; kvm&nbsp; &nbsp; &nbsp; 136 Jan 27 00:18 iso</div>
<div style="margin: 0px;" class="">
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; &nbsp; 3 vdsm &nbsp; kvm&nbsp; &nbsp; &nbsp; 102 Jan 26 09:43 vm</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">the host machine seems to mount the shares fine....</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; 5 vdsm kvm 4096 Jan 27 12:28 <span style="font-variant-ligatures:
                  no-common-ligatures; color: #4c7aff" class="">
.</span></div>
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; 3 vdsm kvm 4096 Jan 27 10:04 <span style="font-variant-ligatures:
                  no-common-ligatures; color: #4c7aff" class="">
..</span></div>
<div style="margin: 0px;" class="">drwxr-xr-x 13 vdsm kvm&nbsp; 544 Jan 27 00:12 <span style="font-variant-ligatures:
                  no-common-ligatures; color: #4c7aff" class="">
192.168.1.32:_Volumes_Raid1</span></div>
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; 2 vdsm kvm 4096 Jan 27 00:12 <span style="font-variant-ligatures:
                  no-common-ligatures; color: #4c7aff" class="">
192.168.1.32:_Volumes_Raid1_data</span></div>
<div style="margin: 0px;" class="">drwxr-xr-x&nbsp; 2 vdsm kvm 4096 Jan 27 00:24 <span style="font-variant-ligatures:
                  no-common-ligatures; color: #4c7aff" class="">
192.168.1.32:_Volumes_Raid1_iso</span></div>
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
</div>
</div>
</div>
<div class="">and as I said above I can create files in any one of those mounts</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">Is there a place I can look at to find the offending file? &nbsp;If that is the issue... &nbsp;Oddly enough everything worked until i rebooted, so I must have either changed something or something is buggered.</div>
<div class=""><br class="">
</div>
</blockquote>
<br class="">
please echo the output of <br class="">
<br class="">
find&nbsp; /Volumes/Raid1 -name &quot;__DIRECT_IO_TEST__&quot; | xargs ls -la<br class="">
<br class="">
the failure is to create this file. <br class="">
<br class="">
<blockquote cite="mid:DDFE403B-9608-4E3C-A029-EFC39908A6C9@power-soft.com" type="cite" class="">
<div class=""></div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<br class="">
<fieldset class="mimeAttachmentHeader"></fieldset> <br class="">
<pre wrap="" class="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
<div class="">
<div class="">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="margin-left: 1.65pt; border-collapse: collapse;">
<tbody class="">
<tr style="height: 26.25pt;" class="">
<td width="421" valign="top" style="orphans: 2; text-align: -webkit-auto; widows: 2; width: 315.75pt; padding: 0in 5.4pt; height: 26.25pt;" class="">
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 9pt; font-family: Helvetica, sans-serif; color: rgb(31, 73, 125);" class="">Mik Rose | Manager, IT - Support Services |&nbsp;</span><b class=""><span lang="EN-CA" style="font-size: 9pt; font-family: Arial, sans-serif; color: rgb(0, 102, 0);" class="">PowerSoft
 Development Corp<o:p class=""></o:p></span></b></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 8pt; font-family: Helvetica, sans-serif; color: rgb(31, 73, 125);" class="">1 (250) 642-0295 x23&nbsp;&nbsp;&nbsp;<a href="http://www.power-soft.com/" style="color: purple;" class=""><span style="color: black;" class="">http://www.power-soft.com</span></a>&nbsp;&nbsp;&nbsp;<a href="https://secure.logmeinrescue.com/Customer/Download.aspx?EntryID=15095831" target="_blank" style="color: purple;" class=""><span style="color: black;" class="">Live
 Support</span></a></span><span style="font-size: 9pt; font-family: Helvetica, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""></o:p></span></div>
<div style="margin: 0in 0in 0.0001pt 3.75pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 9pt; font-family: Helvetica, sans-serif; color: rgb(31, 73, 125);" class="">&nbsp;</span></div>
<div style="margin: 0in 0in 0.0001pt 3.75pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<div style="font-size: 11pt; margin: 0in 0in 0.0001pt;" class=""><span style="font-size: 7pt; font-family: Arial, sans-serif; color: rgb(31, 73, 125);" class="">This e-mail may be privileged and/or confidential, and the sender does not waive<o:p class=""></o:p></span></div>
<div style="font-size: 11pt; margin: 0in 0in 0.0001pt;" class=""><span style="font-size: 7pt; font-family: Arial, sans-serif; color: rgb(31, 73, 125);" class="">any related rights and obligations. Any distribution, use or copying of this e-mail or the information<o:p class=""></o:p></span></div>
<div style="font-size: 11pt; margin: 0in 0in 0.0001pt;" class=""><span style="font-size: 7pt; font-family: Arial, sans-serif; color: rgb(31, 73, 125);" class="">it contains by other than an intended recipient is unauthorized.<o:p class=""></o:p></span></div>
<div style="font-size: 11pt; margin: 0in 0in 0.0001pt;" class=""><span style="font-size: 7pt; font-family: Arial, sans-serif; color: rgb(31, 73, 125);" class="">If you received this e-mail in error, please advise me (by return e-mail or otherwise) immediately.</span></div>
</div>
</td>
<td width="69" valign="top" style="orphans: 2; text-align: -webkit-auto; widows: 2; width: 51.75pt; padding: 0in 5.4pt; height: 26.25pt;" class="">
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="color: rgb(31, 73, 125);" class=""><br class="Apple-interchange-newline" style="text-align: -webkit-auto;">
</span></div>
</td>
</tr>
</tbody>
</table>
<div class=""><br class="">
</div>
</div>
<div class=""><br class="">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="">
</body>
</html>