[Users] (potential bug) After I create a virtual disk I am unable to start a VM - Permissions issue ? The node seems to have no write access to the directory on the NFS server...
Hi. Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk. However as soon as I add a virtual disk the VM no longer starts example error message ------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied . ------------------------------------------------------------------------------------------------------------------- I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server. I am using a separate NFS server for storage. Is this a bug ? Does anyone know how to fix this ? shall I report it ? Many regards !
Hi, I am facing the same issue too.. Regards, Arumon On Mon, Mar 26, 2012 at 5:28 PM, Morgan Cox <morgancoxuk@gmail.com> wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
This is a multi-part message in MIME format. --------------030706010606040202010705 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied . -------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------030706010606040202010705 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> </head> <body text="#000000" bgcolor="#ffffff"> On 03/26/2012 05:28 PM, Morgan Cox wrote: <blockquote cite="mid:CAGfHYAT10d2LMQ_YyPMVTEESHn0ed1r8EhZNya3F4pJKLfahQA@mail.gmail.com" type="cite">Hi. <div><br> </div> <div>Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.</div> <div><br> </div> <div>However as soon as I add a virtual disk the VM no longer starts</div> <div> <br> </div> </blockquote> <br> Go thru this and see if it helps...<br> <a class="moz-txt-link-freetext" href="http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues">http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues</a><br> <br> <br> <blockquote cite="mid:CAGfHYAT10d2LMQ_YyPMVTEESHn0ed1r8EhZNya3F4pJKLfahQA@mail.gmail.com" type="cite"> <div>example error message</div> <div><br> </div> <div>-------------------------------------------------------------------------------------------------------------------</div> <div>VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .</div> <div>-------------------------------------------------------------------------------------------------------------------</div> <div><br> </div> <div>I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.</div> <div><br> </div> <div>I am using a separate NFS server for storage.</div> <div><br> </div> <div>Is this a bug ?</div> <div><br> </div> <div>Does anyone know how to fix this ?</div> <div><br> </div> <div>shall I report it ?</div> <div> <br> </div> <div>Many regards !</div> <div><br> </div> <pre wrap=""> <fieldset class="mimeAttachmentHeader"></fieldset> _______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------030706010606040202010705--
Hi http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues - This seems to refer to setup on a redhat based system The fies it refers to do not exist on Debian - i.e /etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist... Do you know the equivalent on Debian ? Regards On 27 March 2012 07:07, Deepak C Shetty <deepakcs@linux.vnet.ibm.com> wrote:
** On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users
This is a multi-part message in MIME format. --------------000803040003040607050904 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian. Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty <deepakcs@linux.vnet.ibm.com <mailto:deepakcs@linux.vnet.ibm.com>> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied . -------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users
--------------000803040003040607050904 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> <title></title> </head> <body text="#000000" bgcolor="#ffffff"> On 03/27/2012 04:08 PM, Morgan Cox wrote: <blockquote cite="mid:CAGfHYAReOXdpuHZMtm-LYP_1uqdfxuC4G-LH0OfXa2DVYAg_Vg@mail.gmail.com" type="cite">Hi <div><br> </div> <div><a moz-do-not-send="true" href="http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues" target="_blank">http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues</a> </div> <div><br> </div> <div>- This seems to refer to setup on a redhat based system</div> <div><br> </div> <div>The fies it refers to do not exist on Debian - i.e </div> <div><br> </div> <div><span style="line-height: 19px; font-size: 13px; font-family: sans-serif;">/etc/sysconfig/nfs </span><span style="line-height: 19px; font-size: 13px; font-family: sans-serif;">and</span><span style="line-height: 19px; font-size: 13px; font-family: sans-serif;">/etc/nfsmount.conf - they do not exist...</span></div> <div><br> </div> <div>Do you know the equivalent on Debian ?</div> <div><br> </div> </blockquote> <br> Sorry, i use fedora, and I dont know the equivalent of Debain.<br> Maybe asking the big brain(google) might help. There should be an <br> equivalent way of doing the same on debian.<br> <br> Also in my case v4 was not a issue, as much as the perms and uid:gid <br> were, so look further to see perms and selinux booleans are<br> set correctly in your setup.<br> <br> <blockquote cite="mid:CAGfHYAReOXdpuHZMtm-LYP_1uqdfxuC4G-LH0OfXa2DVYAg_Vg@mail.gmail.com" type="cite"> <div>Regards</div> <div><br> <br> <div class="gmail_quote">On 27 March 2012 07:07, Deepak C Shetty <span dir="ltr"><<a moz-do-not-send="true" href="mailto:deepakcs@linux.vnet.ibm.com" target="_blank">deepakcs@linux.vnet.ibm.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"> <div text="#000000" bgcolor="#ffffff"> <div> On 03/26/2012 05:28 PM, Morgan Cox wrote: <blockquote type="cite">Hi. <div><br> </div> <div>Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.</div> <div><br> </div> <div>However as soon as I add a virtual disk the VM no longer starts</div> <div> <br> </div> </blockquote> <br> </div> Go thru this and see if it helps...<br> <a moz-do-not-send="true" href="http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues" target="_blank">http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues</a><br> <br> <br> <blockquote type="cite"> <div> <div>example error message</div> <div><br> </div> <div>-------------------------------------------------------------------------------------------------------------------</div> <div>VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .</div> <div>-------------------------------------------------------------------------------------------------------------------</div> <div><br> </div> <div>I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.</div> <div><br> </div> <div>I am using a separate NFS server for storage.</div> <div><br> </div> <div>Is this a bug ?</div> <div><br> </div> <div>Does anyone know how to fix this ?</div> <div><br> </div> <div>shall I report it ?</div> <div> <br> </div> <div>Many regards !</div> <div><br> </div> </div> <pre><fieldset></fieldset> _______________________________________________ Users mailing list <a moz-do-not-send="true" href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <a moz-do-not-send="true" href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </div> </blockquote> </div> <br> </div> </blockquote> <br> </body> </html> --------------000803040003040607050904--
Hi. My setup is 3 servers 1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la /tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190) - note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190) - looks like nfs4 on the node........ Any ideas anyone ? Cheers On 28 March 2012 06:45, Deepak C Shetty <deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty <deepakcs@linux.vnet.ibm.com> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On 03/28/2012 09:30 AM, Morgan Cox wrote:
Hi.
My setup is 3 servers
1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la /tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
Morgan, Look at the UID/GID here. They are definitely not 36:36; hence, the user VDSM *might* have an issue with R/W privileged from the node. Can the user VDSM R/W anything in the mounted directory from the node? Also, if you don't want to create a UID/GID combination on the NFS server of 36:36 try pinning it... $ cat /etc/exports /virt/iso 192.168.122.11(rw,sync,all_squash,anonuid=107,anongid=107) <-- I'm pinning to 107 because I don't want 36:36 on my NFS server.
Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190)
- note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190)
- looks like nfs4 on the node........
Any ideas anyone ?
Cheers
On 28 March 2012 06:45, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Morgan, I did some googling and it looks like that ID, i.e. 4294967294, is the nfsnobody ID. There are various posts on the debian forums related to it. One suspicion I have is that your debian server is running NFSv4. Try turning it off [1] as oVirt doesn't currently support it [2]. [1] "RPCMOUNTDOPTS=--no-nfs-version 4": http://lists.debian.org/debian-user/2011/11/msg01892.html [2] http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues Cheers, Keith On 03/28/2012 09:51 AM, Keith Robertson wrote:
On 03/28/2012 09:30 AM, Morgan Cox wrote:
Hi.
My setup is 3 servers
1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la /tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/
total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/
total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
Morgan, Look at the UID/GID here. They are definitely not 36:36; hence, the user VDSM *might* have an issue with R/W privileged from the node.
Can the user VDSM R/W anything in the mounted directory from the node? Also, if you don't want to create a UID/GID combination on the NFS server of 36:36 try pinning it... $ cat /etc/exports /virt/iso 192.168.122.11(rw,sync,all_squash,anonuid=107,anongid=107) <-- I'm pinning to 107 because I don't want 36:36 on my NFS server.
Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190)
- note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190)
- looks like nfs4 on the node........
Any ideas anyone ?
Cheers
On 28 March 2012 06:45, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
-------------------------------------------------------------------------------------------------------------------
VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads:
could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf:
Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Just to update this. On the NFS server I created vdsm:kvm user/group Also on my debian NFS server I have in /etc/default/nfs-kernel-server RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4" But the node always mounted in nfs4 (according to the mount command)
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache to nfs_mount_options = soft,nosharecache,vers=3 - then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta It still doesn't work... Cheers On 28 March 2012 16:26, Keith Robertson <kroberts@redhat.com> wrote:
Morgan,
I did some googling and it looks like that ID, i.e. 4294967294, is the nfsnobody ID. There are various posts on the debian forums related to it.
One suspicion I have is that your debian server is running NFSv4. Try turning it off [1] as oVirt doesn't currently support it [2].
[1] "RPCMOUNTDOPTS=--no-nfs-version 4": http://lists.debian.org/debian-user/2011/11/msg01892.html [2] http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
Cheers, Keith
On 03/28/2012 09:51 AM, Keith Robertson wrote:
On 03/28/2012 09:30 AM, Morgan Cox wrote:
Hi.
My setup is 3 servers
1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la
/tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la
/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
Morgan, Look at the UID/GID here. They are definitely not 36:36; hence, the user VDSM *might* have an issue with R/W privileged from the node.
Can the user VDSM R/W anything in the mounted directory from the node? Also, if you don't want to create a UID/GID combination on the NFS server of 36:36 try pinning it... $ cat /etc/exports /virt/iso 192.168.122.11(rw,sync,all_squash,anonuid=107,anongid=107) <-- I'm pinning to 107 because I don't want 36:36 on my NFS server.
Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs
(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190)
- note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190)
- looks like nfs4 on the node........
Any ideas anyone ?
Cheers
On 28 March 2012 06:45, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive
file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image
/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Sorry my last email cut off... Hi Just to update this. On the NFS server I created vdsm:kvm user/group Also on my debian NFS server I have in /etc/default/nfs-kernel-server RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4" But the node always mounted in nfs4 (according to the mount command)
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache to nfs_mount_options = soft,nosharecache,vers=3 - then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta It still doesn't work... Cheers On 28 March 2012 16:52, Morgan Cox <morgancoxuk@gmail.com> wrote:
Hi
Just to update this.
On the NFS server I created vdsm:kvm user/group
Also on my debian NFS server I have in /etc/default/nfs-kernel-server
RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4"
But the node always mounted in nfs4 (according to the mount command)
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache
to
nfs_mount_options = soft,nosharecache,vers=3
- then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e
ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta
It still doesn't work...
Cheers
On 28 March 2012 16:26, Keith Robertson <kroberts@redhat.com> wrote:
Morgan,
I did some googling and it looks like that ID, i.e. 4294967294, is the nfsnobody ID. There are various posts on the debian forums related to it.
One suspicion I have is that your debian server is running NFSv4. Try turning it off [1] as oVirt doesn't currently support it [2].
[1] "RPCMOUNTDOPTS=--no-nfs-version 4": http://lists.debian.org/debian-user/2011/11/msg01892.html [2] http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
Cheers, Keith
On 03/28/2012 09:51 AM, Keith Robertson wrote:
On 03/28/2012 09:30 AM, Morgan Cox wrote:
Hi.
My setup is 3 servers
1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la
/tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la
/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
Morgan, Look at the UID/GID here. They are definitely not 36:36; hence, the user VDSM *might* have an issue with R/W privileged from the node.
Can the user VDSM R/W anything in the mounted directory from the node? Also, if you don't want to create a UID/GID combination on the NFS server of 36:36 try pinning it... $ cat /etc/exports /virt/iso 192.168.122.11(rw,sync,all_squash,anonuid=107,anongid=107) <-- I'm pinning to 107 because I don't want 36:36 on my NFS server.
Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs
(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190)
- note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190)
- looks like nfs4 on the node........
Any ideas anyone ?
Cheers
On 28 March 2012 06:45, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/26/2012 05:28 PM, Morgan Cox wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
Go thru this and see if it helps... http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive
file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image
/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Again it got cut off ??? I've never really understood how to get a mailing list thread to follow a reply correctly either...
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache to nfs_mount_options = soft,nosharecache,vers=3 - then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta It still doesn't work... Cheers On 29 March 2012 10:17, Morgan Cox <morgancoxuk@gmail.com> wrote:
Sorry my last email cut off...
Hi
Just to update this.
On the NFS server I created vdsm:kvm user/group
Also on my debian NFS server I have in /etc/default/nfs-kernel-server
RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4"
But the node always mounted in nfs4 (according to the mount command)
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache
to
nfs_mount_options = soft,nosharecache,vers=3
- then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e
ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta
It still doesn't work...
Cheers
On 28 March 2012 16:52, Morgan Cox <morgancoxuk@gmail.com> wrote:
Hi
Just to update this.
On the NFS server I created vdsm:kvm user/group
Also on my debian NFS server I have in /etc/default/nfs-kernel-server
RPCMOUNTDOPTS="--manage-gids --no-nfs-version 4"
But the node always mounted in nfs4 (according to the mount command)
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache
to
nfs_mount_options = soft,nosharecache,vers=3
- then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e
ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta
It still doesn't work...
Cheers
On 28 March 2012 16:26, Keith Robertson <kroberts@redhat.com> wrote:
Morgan,
I did some googling and it looks like that ID, i.e. 4294967294, is the nfsnobody ID. There are various posts on the debian forums related to it.
One suspicion I have is that your debian server is running NFSv4. Try turning it off [1] as oVirt doesn't currently support it [2].
[1] "RPCMOUNTDOPTS=--no-nfs-version 4": http://lists.debian.org/debian-user/2011/11/msg01892.html [2] http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
Cheers, Keith
On 03/28/2012 09:51 AM, Keith Robertson wrote:
On 03/28/2012 09:30 AM, Morgan Cox wrote:
Hi.
My setup is 3 servers
1. Frontend (engine). 2 Ovirt node 3. Nfs server (debian)
From the Frontend (engine) :-
-bash-4.2$ ls -la
/tmp/test/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 2012 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 2012 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 vdsm kvm 317 Mar 28 2012 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
I have (now) write access with vdsm user from here
From the node (look at ownership....) :-
-bash-4.2$ ls -la
/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/d1fcc1ae-dcf5-426e-a99f-3a48e84c5ae3/ total 2097168 drwxr-xr-x. 2 4294967294 4294967294 4096 Mar 28 13:21 . drwxr-xr-x. 3 4294967294 4294967294 4096 Mar 28 13:05 .. -rw-rw----. 1 4294967294 4294967294 2147483648 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd -rw-r--r--. 1 4294967294 4294967294 317 Mar 28 13:05 9fe193c9-7139-4a6c-933a-c6f31d5e96bd.meta
Morgan, Look at the UID/GID here. They are definitely not 36:36; hence, the user VDSM *might* have an issue with R/W privileged from the node.
Can the user VDSM R/W anything in the mounted directory from the node? Also, if you don't want to create a UID/GID combination on the NFS server of 36:36 try pinning it... $ cat /etc/exports /virt/iso 192.168.122.11(rw,sync,all_squash,anonuid=107,anongid=107) <-- I'm pinning to 107 because I don't want 36:36 on my NFS server.
Also
From the engine - mount command:-
10.0.0.190:/storage1/ on /tmp/test type nfs
(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.0.190,mountvers=3,mountport=35065,mountproto=udp,local_lock=none,addr=10.0.0.190)
- note that the NFS share wasn't mounted until I mounted it...
From the node - mount command
10.0.0.190:/storage1/ on /rhev/data-center/mnt/10.0.0.190:_storage1 type nfs4 (rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,port=0,timeo=600,retrans=6,sec=sys,clientaddr=10.0.0.101,minorversion=0,local_lock=none,addr=10.0.0.190)
- looks like nfs4 on the node........
Any ideas anyone ?
Cheers
On 28 March 2012 06:45, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote:
On 03/27/2012 04:08 PM, Morgan Cox wrote:
Hi
http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues
- This seems to refer to setup on a redhat based system
The fies it refers to do not exist on Debian - i.e
/etc/sysconfig/nfs and/etc/nfsmount.conf - they do not exist...
Do you know the equivalent on Debian ?
Sorry, i use fedora, and I dont know the equivalent of Debain. Maybe asking the big brain(google) might help. There should be an equivalent way of doing the same on debian.
Also in my case v4 was not a issue, as much as the perms and uid:gid were, so look further to see perms and selinux booleans are set correctly in your setup.
Regards
On 27 March 2012 07:07, Deepak C Shetty<deepakcs@linux.vnet.ibm.com> wrote: > > On 03/26/2012 05:28 PM, Morgan Cox wrote: > > Hi. > > Still not actually managed to test a vm... I can start a VM (and use > spice) without a virtual disk. > > However as soon as I add a virtual disk the VM no longer starts > > > Go thru this and see if it helps... > http://www.ovirt.org/wiki/Troubleshooting_NFS_Storage_Issues > > > example error message > > > > ------------------------------------------------------------------------------------------------------------------- > VM ddf is down. Exit message internal error process exited while > connecting to monitor: qemu-kvm: -drive > > file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: > could not open disk image > > /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: > Permission denied . > > > ------------------------------------------------------------------------------------------------------------------- > > I have noticed that the > directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is > not > writable via the ovirt node server. > > I am using a separate NFS server for storage. > > Is this a bug ? > > Does anyone know how to fix this ? > > shall I report it ? > > Many regards ! > > > _______________________________________________ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > >
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hello Morgan, On 03/29/2012 05:54 AM, Morgan Cox wrote:
Again it got cut off ???
I've never really understood how to get a mailing list thread to follow a reply correctly either...
From advise in IRC I changed
# nfs_mount_options = soft,nosharecache
to
nfs_mount_options = soft,nosharecache,vers=3
- then re attached the node - it now shows as nfs3 using the mount command and has the correct UID/GID i.e
ls -al /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/7e2f025e-5676-4592-84fd-7c9661f5ee2e/ total 2097168 drwxr-xr-x. 2 vdsm kvm 4096 Mar 28 15:23 . drwxr-xr-x. 3 vdsm kvm 4096 Mar 28 15:23 .. -rw-rw----. 1 vdsm kvm 2147483648 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b -rw-r--r--. 1 vdsm kvm 320 Mar 28 15:23 e4aa8bf8-0cb8-4f1c-84cf-b83909f7206b.meta
It still doesn't work...
I have installed debian squezee to test and make it work, here my steps: # groupadd kvm -g 36 # useradd vdsm -u 36 -g kvm # mkdir /storage # chmod 0755 /storage # chown 36:36 /storage/ # cat /etc/exports /storage *(rw,sync,no_subtree_check,all_squash,anonuid=36,anongid=36) # /etc/init.d/nfs-kernel-server restart Please, let me know if it resolves your case. Thanks -- Cheers Douglas
I had the same problem a month ago on a openfiler(fedora) system not a debian system. It was a file permissions error there was one folder that permissions where not applied to correctly. It took me awhile I could not determine if it was an ovirt error. I use all nfs at the moment and have installed two more nodes for data with no issue. One of them is a debian system called mediavault. The folder that had a problem did not have vdsm permissions it was another user I believe. I had to manually edit as root. Dominic On Mon, Mar 26, 2012 at 7:58 AM, Morgan Cox <morgancoxuk@gmail.com> wrote:
Hi.
Still not actually managed to test a vm... I can start a VM (and use spice) without a virtual disk.
However as soon as I add a virtual disk the VM no longer starts
example error message
------------------------------------------------------------------------------------------------------------------- VM ddf is down. Exit message internal error process exited while connecting to monitor: qemu-kvm: -drive file=/rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf,if=none,id=drive-virtio-disk0,format=raw,serial=c507a2bc-38c5-498e-88c0-7cce8169cf67,cache=none,werror=stop,rerror=stop,aio=threads: could not open disk image /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/2f7ee7bc-09b3-42ba-af91-40d79293e360/images/c507a2bc-38c5-498e-88c0-7cce8169cf67/6c36c8e4-6618-42f3-9cc4-06d2bccdc9cf: Permission denied .
-------------------------------------------------------------------------------------------------------------------
I have noticed that the directory /rhev/data-center/b2b2e054-66b2-11e1-bda3-1728f784de9e/ is not writable via the ovirt node server.
I am using a separate NFS server for storage.
Is this a bug ?
Does anyone know how to fix this ?
shall I report it ?
Many regards !
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Dominic Kaiser Greater Boston Vineyard Director of Operations cell: 617-230-1412 fax: 617-252-0238 email: dominic@bostonvineyard.org
participants (6)
-
aru mon -
Deepak C Shetty -
Dominic Kaiser -
Douglas Landgraf -
Keith Robertson -
Morgan Cox