Just so you know I have solved the issue. So it is file permissions on the openfiler server. This is openfiler 2.3. For some reason on the openfiler server "node" the file permissions where still ofguest:ofguest. When ovirt connects to a data node that is NFS is it suppose to change the permissions on that server automatically? If it is it might be a bug. This again is a NFS Domain datacenter. Using hardware based Openfiler nodes. I will try adding another openfiler node to see if the same thing happens. Also has anyone else experienced this also?<div>
<br></div><div>Let me know if you have any thoughts,</div><div><br></div><div>Dominic</div><div><br><div class="gmail_quote">On Tue, Mar 13, 2012 at 5:35 AM, Moran Goldboim <span dir="ltr"><<a href="mailto:mgoldboi@redhat.com">mgoldboi@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u>
<div text="#000000" bgcolor="#ffffff"><div class="im">
<br>
On 03/12/2012 07:47 PM, Dominic Kaiser wrote:
<blockquote type="cite">I noticed permisions on files in the that folder are
saying group # 96 what is the 96 group and should it be kvm? On
the /mnt folder should the files read owner:vdsm group:kvm on all
files?
<div><br>
</div>
</blockquote>
<br></div>
Yes, user and group should be vdsm:kvm (36:36) on all "/rhev" tree.<span class="HOEnZb"><font color="#888888"><br>
Moran.</font></span><div><div class="h5"><br>
<br>
<blockquote type="cite">
<div>Dominic<br>
<br>
<div class="gmail_quote">On Mon, Mar 12, 2012 at 10:49 AM,
Dominic Kaiser <span dir="ltr"><<a href="mailto:dominic@bostonvineyard.org" target="_blank">dominic@bostonvineyard.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Hello Moran,
<div><br>
</div>
<div>Thanks for responding. </div>
<div><br>
</div>
<div>Here is output you asked for and I have selinux
disabled on this host:</div>
<div><br>
</div>
<div>
<div>ls -lZh c10c25e0-526a-11e1-a5e4-87fa674ffb5d/</div>
<div>lrwxrwxrwx vdsm kvm ?
095fcd9d-6203-496f-b254-7a9eafaa8ac2 ->
/rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_ISO/095fcd9d-6203-496f-b254-7a9eafaa8ac2</div>
<div>lrwxrwxrwx vdsm kvm ?
14308dd8-1fd1-452c-a288-2f975ef31de1 ->
/rhev/data-center/mnt/_var_lib_vdsm_storage/14308dd8-1fd1-452c-a288-2f975ef31de1</div>
<div>lrwxrwxrwx vdsm kvm ?
340dad49-2ec7-475e-b6c6-668504bdb5b1 ->
/rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_MS/340dad49-2ec7-475e-b6c6-668504bdb5b1</div>
<div><font color="#ff0000">lrwxrwxrwx vdsm kvm ?
651cb693-3ffa-43b6-ab49-43cfb03d179b ->
/rhev/data-center/mnt/ruth.bostonvineyard.org:_mnt_ruthstorage1_mainstorage_data/651cb693-3ffa-43b6-ab49-43cfb03d179b</font></div>
<div>lrwxrwxrwx vdsm kvm ?
bcc2d564-2daa-45ae-990b-0d27a17e47e0 ->
/rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_Export/bcc2d564-2daa-45ae-990b-0d27a17e47e0</div>
<div>lrwxrwxrwx vdsm kvm ?
mastersd ->
/rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_MS/340dad49-2ec7-475e-b6c6-668504bdb5b1</div>
<div><br>
</div>
The one I am having the problem with is the one in red.
It is an openfiler server called ruth. I can add it just
fine create disks but cannot start a VM. It is weird.
Again it is a NFS datacenter this is a data domain not
master data domain.</div>
<div><br>
</div>
<div>Thanks,</div>
<div><br>
</div>
<div>Dominic</div>
<div>
<div>
<div><br>
</div>
<div><br>
<div class="gmail_quote">On Sun, Mar 11, 2012 at 4:20
AM, Moran Goldboim <span dir="ltr"><<a href="mailto:mgoldboi@redhat.com" target="_blank">mgoldboi@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div text="#000000" bgcolor="#ffffff">
<div>
<div> On 03/10/2012 01:26 AM, Dominic Kaiser
wrote: </div>
</div>
<blockquote type="cite">
<div>
<div> Here is the error I am getting:<br>
<br>
<div title="VM fs1 is down. Exit message
internal error process exited while
connecting to monitor: qemu-kvm: -drive
file=/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09,if=none,id=drive-virtio-disk0,format=raw,serial=81-9f1f-f78c88b2f96e,cache=none,werror=stop,rerror=stop,aio=threads:
could not open disk image
/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09:
Permission denied .">
<div>VM fs1 is down. Exit message
internal error process exited while
connecting to monitor: qemu-kvm:
-drive
file=/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09,if=none,id=drive-virtio-disk0,format=raw,serial=81-9f1f-f78c88b2f96e,cache=none,werror=stop,rerror=stop,aio=threads:
could not open disk image
/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09:
Permission denied .</div>
</div>
<br>
I can add the domain fine. it is not the
master domain and it is another node. I
can create virtual disks but cannot start
vm's. I saw a post on google that
mentions nfs=0 not nfs=1 i think it was in
/usr/sbin/senforce maybe? Does anyone
recollect this problem and can help me?
Again this is on a separate node and is a
standard data domain not master.<br>
<br>
Thanks,<br>
<br>
-- <br>
Dominic Kaiser<br>
Greater Boston Vineyard<br>
Director of Operations<br>
<br>
cell: <a href="tel:617-230-1412" value="+16172301412" target="_blank">617-230-1412</a><br>
fax: <a href="tel:617-252-0238" value="+16172520238" target="_blank">617-252-0238</a><br>
email: <a href="mailto:dominic@bostonvineyard.org" target="_blank">dominic@bostonvineyard.org</a><br>
<br>
<br>
</div>
</div>
<pre><fieldset></fieldset>
_______________________________________________
Users mailing list
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
</blockquote>
Dominic, sounds like you have some permission
problem with the image, can you try with selinux
in permissive mode - "/usr/sbin/setenforce 0"<br>
can you please add the output of "ls -lZh
/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09"<span><font color="#888888"><br>
<br>
Moran.<br>
</font></span></div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
Dominic Kaiser<br>
Greater Boston Vineyard<br>
Director of Operations<br>
<br>
cell: <a href="tel:617-230-1412" value="+16172301412" target="_blank">617-230-1412</a><br>
fax: <a href="tel:617-252-0238" value="+16172520238" target="_blank">617-252-0238</a><br>
email: <a href="mailto:dominic@bostonvineyard.org" target="_blank">dominic@bostonvineyard.org</a><br>
<br>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
Dominic Kaiser<br>
Greater Boston Vineyard<br>
Director of Operations<br>
<br>
cell: <a href="tel:617-230-1412" value="+16172301412" target="_blank">617-230-1412</a><br>
fax: <a href="tel:617-252-0238" value="+16172520238" target="_blank">617-252-0238</a><br>
email: <a href="mailto:dominic@bostonvineyard.org" target="_blank">dominic@bostonvineyard.org</a><br>
<br>
<br>
</div>
</blockquote>
<br>
</div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Dominic Kaiser<br>Greater Boston Vineyard<br>Director of Operations<br><br>cell: 617-230-1412<br>fax: 617-252-0238<br>email: <a href="mailto:dominic@bostonvineyard.org">dominic@bostonvineyard.org</a><br>
<br><br>
</div>