Hello Moran,<div><br></div><div>Thanks for responding.  </div><div><br></div><div>Here is output you asked for and I have selinux disabled on this host:</div><div><br></div><div><div>ls -lZh c10c25e0-526a-11e1-a5e4-87fa674ffb5d/</div>
<div>lrwxrwxrwx vdsm kvm ?                                095fcd9d-6203-496f-b254-7a9eafaa8ac2 -&gt; /rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_ISO/095fcd9d-6203-496f-b254-7a9eafaa8ac2</div>
<div>lrwxrwxrwx vdsm kvm ?                                14308dd8-1fd1-452c-a288-2f975ef31de1 -&gt; /rhev/data-center/mnt/_var_lib_vdsm_storage/14308dd8-1fd1-452c-a288-2f975ef31de1</div><div>lrwxrwxrwx vdsm kvm ?                                340dad49-2ec7-475e-b6c6-668504bdb5b1 -&gt; /rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_MS/340dad49-2ec7-475e-b6c6-668504bdb5b1</div>
<div><font color="#ff0000">lrwxrwxrwx vdsm kvm ?                                651cb693-3ffa-43b6-ab49-43cfb03d179b -&gt; /rhev/data-center/mnt/ruth.bostonvineyard.org:_mnt_ruthstorage1_mainstorage_data/651cb693-3ffa-43b6-ab49-43cfb03d179b</font></div>
<div>lrwxrwxrwx vdsm kvm ?                                bcc2d564-2daa-45ae-990b-0d27a17e47e0 -&gt; /rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_Export/bcc2d564-2daa-45ae-990b-0d27a17e47e0</div>
<div>lrwxrwxrwx vdsm kvm ?                                mastersd -&gt; /rhev/data-center/mnt/10.3.0.248:_mnt_mainstorage_mainstorage_MainStorage_MS/340dad49-2ec7-475e-b6c6-668504bdb5b1</div><div><br></div>The one I am having the problem with is the one in red.  It is an openfiler server called ruth.  I can add it just fine create disks but cannot start a VM.  It is weird.  Again it is a NFS datacenter this is a data domain not master data domain.</div>
<div><br></div><div>Thanks,</div><div><br></div><div>Dominic</div><div><br></div><div><br><div class="gmail_quote">On Sun, Mar 11, 2012 at 4:20 AM, Moran Goldboim <span dir="ltr">&lt;<a href="mailto:mgoldboi@redhat.com">mgoldboi@redhat.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u>

  
    
  
  <div text="#000000" bgcolor="#ffffff"><div><div class="h5">
    On 03/10/2012 01:26 AM, Dominic Kaiser wrote:
    </div></div><blockquote type="cite"><div><div class="h5">
      
      Here is the error I am getting:<br>
      <br>
      <div title="VM fs1 is down. Exit message internal error process
        exited while connecting to monitor: qemu-kvm: -drive
        file=/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09,if=none,id=drive-virtio-disk0,format=raw,serial=81-9f1f-f78c88b2f96e,cache=none,werror=stop,rerror=stop,aio=threads:
        could not open disk image
        /rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09:
        Permission denied
        .">
        <div>VM fs1 is down. Exit message internal error process exited
          while connecting to monitor: qemu-kvm: -drive
          file=/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09,if=none,id=drive-virtio-disk0,format=raw,serial=81-9f1f-f78c88b2f96e,cache=none,werror=stop,rerror=stop,aio=threads:

          could not open disk image
          /rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09:

          Permission denied
          .</div>
      </div>
      <br>
      I can add the domain fine.  it is not the master domain and it is
      another node. I can create virtual disks but cannot start vm&#39;s.  I
      saw a post on google that mentions nfs=0 not nfs=1 i think it was
      in /usr/sbin/senforce maybe?  Does anyone recollect this problem
      and can help me?  Again this is on a separate node and is a
      standard data domain  not master.<br>
      <br>
      Thanks,<br>
      <br>
      -- <br>
      Dominic Kaiser<br>
      Greater Boston Vineyard<br>
      Director of Operations<br>
      <br>
      cell: <a href="tel:617-230-1412" value="+16172301412" target="_blank">617-230-1412</a><br>
      fax: <a href="tel:617-252-0238" value="+16172520238" target="_blank">617-252-0238</a><br>
      email: <a href="mailto:dominic@bostonvineyard.org" target="_blank">dominic@bostonvineyard.org</a><br>
      <br>
      <br>
      </div></div><pre><fieldset></fieldset>
_______________________________________________
Users mailing list
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
    </blockquote>
    Dominic, sounds like you have some permission problem with the
    image, can you try with selinux in permissive mode -
    &quot;/usr/sbin/setenforce 0&quot;<br>
    can you please add the output of &quot;ls -lZh
/rhev/data-center/c10c25e0-526a-11e1-a5e4-87fa674ffb5d/651cb693-3ffa-43b6-ab49-43cfb03d179b/images/7fa8a2e7-214e-4081-9f1f-f78c88b2f96e/49c199b6-cbda-4aa0-9b50-e3dc28341e09&quot;<span class="HOEnZb"><font color="#888888"><br>

    <br>
    Moran.<br>
  </font></span></div>

</blockquote></div><br><br clear="all"><div><br></div>-- <br>Dominic Kaiser<br>Greater Boston Vineyard<br>Director of Operations<br><br>cell: 617-230-1412<br>fax: 617-252-0238<br>email: <a href="mailto:dominic@bostonvineyard.org">dominic@bostonvineyard.org</a><br>
<br><br>
</div>