<div dir="ltr">Hi Nir,<div><br></div><div>Do you need any more info from me? I missed the 'sanlock client host_status -D' request, info below:</div><div><br></div><div><div>[root@ovirt002 ~]# sanlock client host_status -D</div>
<div>lockspace a52938f7-2cf4-4771-acb2-0c78d14999e5</div><div>1 timestamp 0</div><div> last_check=176740</div><div> last_live=205</div><div> last_req=0</div><div> owner_id=1</div><div> owner_generation=5</div>
<div> timestamp=0</div><div> io_timeout=10</div><div>2 timestamp 176719</div><div> last_check=176740</div><div> last_live=176740</div><div> last_req=0</div><div> owner_id=2</div><div> owner_generation=7</div>
<div> timestamp=176719</div><div> io_timeout=10</div><div>250 timestamp 0</div><div> last_check=176740</div><div> last_live=205</div><div> last_req=0</div><div> owner_id=250</div><div> owner_generation=1</div>
<div> timestamp=0</div><div> io_timeout=10</div></div><div><br></div><div><div>[root@ovirt001 ~]# sanlock client host_status -D</div><div>[root@ovirt001 ~]# </div></div><div><br></div></div><div class="gmail_extra">
<br clear="all"><div><div dir="ltr"><span style="font-family:arial,sans-serif;font-size:16px"><strong>Steve Dainard </strong></span><span style="font-size:12px"></span><br>
<span style="font-family:arial,sans-serif;font-size:12px">IT Infrastructure Manager<br>
<a href="http://miovision.com/" target="_blank">Miovision</a> | <em>Rethink Traffic</em><br>
519-513-2407 ex.250<br>
877-646-8476 (toll-free)<br>
<br>
<strong style="font-family:arial,sans-serif;font-size:13px;color:#999999"><a href="http://miovision.com/blog" target="_blank">Blog</a> | </strong><font color="#999999" style="font-family:arial,sans-serif;font-size:13px"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_blank">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_blank">Facebook</a></strong></font> </span>
<hr style="font-family:arial,sans-serif;font-size:13px;color:#333333;clear:both">
<div style="color:#999999;font-family:arial,sans-serif;font-size:13px;padding-top:5px">
        <span style="font-family:arial,sans-serif;font-size:12px">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br>
        <span style="font-family:arial,sans-serif;font-size:12px">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div>
</div></div>
<br><br><div class="gmail_quote">On Wed, Feb 5, 2014 at 1:39 PM, Steve Dainard <span dir="ltr"><<a href="mailto:sdainard@miovision.com" target="_blank">sdainard@miovision.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><br><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><div class="im"><span style="font-family:arial,sans-serif;font-size:16px"><strong>Steve Dainard </strong></span><span style="font-size:12px"></span><br>
<span style="font-family:arial,sans-serif;font-size:12px">IT Infrastructure Manager<br>
<a href="http://miovision.com/" target="_blank">Miovision</a> | <em>Rethink Traffic</em><br>
<a href="tel:519-513-2407" value="+15195132407" target="_blank">519-513-2407</a> ex.250<br>
<a href="tel:877-646-8476" value="+18776468476" target="_blank">877-646-8476</a> (toll-free)<br>
<br>
<strong style="font-family:arial,sans-serif;font-size:13px;color:#999999"><a href="http://miovision.com/blog" target="_blank">Blog</a> | </strong><font color="#999999" style="font-family:arial,sans-serif;font-size:13px"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_blank">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_blank">Facebook</a></strong></font> </span>
</div><hr style="font-family:arial,sans-serif;font-size:13px;color:#333333;clear:both"><div class="im">
<div style="color:#999999;font-family:arial,sans-serif;font-size:13px;padding-top:5px">
        <span style="font-family:arial,sans-serif;font-size:12px">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br>
        <span style="font-family:arial,sans-serif;font-size:12px">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div>
</div></div></div>
<br><br><div class="gmail_quote"><div class="im">On Wed, Feb 5, 2014 at 10:50 AM, Steve Dainard <span dir="ltr"><<a href="mailto:sdainard@miovision.com" target="_blank">sdainard@miovision.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div>On Tue, Feb 4, 2014 at 6:23 PM, Nir Soffer <span dir="ltr"><<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>></span> wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><div>----- Original Message -----<br>
> From: "Steve Dainard" <<a href="mailto:sdainard@miovision.com" target="_blank">sdainard@miovision.com</a>><br>
</div></div><div><div>> To: "Nir Soffer" <<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>><br>
> Cc: "Elad Ben Aharon" <<a href="mailto:ebenahar@redhat.com" target="_blank">ebenahar@redhat.com</a>>, "users" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>>, "Aharon Canan" <<a href="mailto:acanan@redhat.com" target="_blank">acanan@redhat.com</a>><br>
> Sent: Tuesday, February 4, 2014 10:50:02 PM<br>
> Subject: Re: [Users] Ovirt 3.3.2 Cannot attach POSIX (gluster) storage domain<br>
><br>
</div><div>> Happens every time I try to add a POSIX SD type glusterfs.<br>
><br>
> Logs attached.<br>
<br>
</div>Hi Steve,<br>
<br>
I'm afraid we need more history in the logs. I want to see the logs from the time the machine started,<br>
until the time of the first error.<br></div></blockquote><div><br></div><div>No problem. I've rebooted both hosts (manager is installed on host ovirt001). And I've attached all the logs. Note that I put the wrong DNS name 'gluster-rr:/rep2' the first time I created the domain, hence the errors. The POSIX domain created is against 'gluster-store-vip:/rep2'</div>
<div><br></div><div>Note only host ovirt002 is in the POSIX SD cluster.</div></div></div></div></blockquote><div><br></div></div><div>Sorry this is wrong, it should be ovirt001 is the only host in the POSIX SD cluster.</div>
<div class="im"><div>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br></div><div>I've also included the glusterfs log for rep2, with these errors:</div>
<div><br></div><div><div>[2014-02-05 15:36:28.246203] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-0: remote operation failed: Invalid argument</div>
<div>[2014-02-05 15:36:28.246418] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-1: remote operation failed: Invalid argument</div><div>[2014-02-05 15:36:28.246450] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 163: WRITE => -1 (Invalid argument)</div>
</div><div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
We suspect that acquireHostId fails because someone else has aquired the same id. We may see evidence<br>
in the logs.<br>
<br>
Also can you send the output of this command on the host that fails, and if you have other hosts using the<br>
same storage, also on some of these hosts.<br>
<br>
sanlock client host_status -D<br>
<br>
And finally, can you attach also /var/log/sanlock.log?<br>
<br>
Thanks,<br>
Nir<br>
<div><div><br></div></div></blockquote><div><br></div><div>Thanks,</div><div>Steve </div></div></div></div></div>
</blockquote></div></div><br></div></div>
</blockquote></div><br></div>