<html><body><div style="font-family: trebuchet ms,sans-serif; font-size: 12pt; color: #000000"><div>thanks for the detailed answer.</div><div>I will take a further look and update you when I will have news</div><div><br></div><div><span name="x"></span><div><br></div><div><br></div><div><br>Thanks in advance,<br>Raz Tamir<br>ratamir@redhat.com<br>RedHat Israel</div><div>RHEV-M QE Storage team<br></div><span name="x"></span><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Stephen Repetski" <srepetsk@srepetsk.net><br><b>To: </b>"Raz Tamir" <ratamir@redhat.com><br><b>Cc: </b>"users" <users@ovirt.org><br><b>Sent: </b>Friday, July 24, 2015 12:23:07 AM<br><b>Subject: </b>Re: [ovirt-users] oVirt not starting primary storage domain<br><div><br></div><div dir="ltr">That is correct. The volume was 9 servers w/ 3x replication, and I wanted to move all data off of one of the sets of 3 servers, and those were which I removed w/ remove-brick start and commit. Per the RH documentation (<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.0/html/Administration_Guide/sect-User_Guide-Managing_Volumes-Shrinking.html" target="_blank">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.0/html/Administration_Guide/sect-User_Guide-Managing_Volumes-Shrinking.html</a>), this should not be an issue assuming the remove-brick process completes before committing it.<div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><b style="color:rgb(102,102,102)">Stephen Repetski</b><br></div></div></div>
<br><div class="gmail_quote">On Thu, Jul 23, 2015 at 5:17 PM, Raz Tamir <span dir="ltr"><<a href="mailto:ratamir@redhat.com" target="_blank">ratamir@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:trebuchet ms,sans-serif;font-size:12pt;color:#000000"><div>As far as I can see from the logs you removed 3 bricks. Can you confirm?<br></div><span class=""><div><br></div><div><span></span><div><br></div><div><br></div><div><br>Thanks in advance,<br>Raz Tamir<br><a href="mailto:ratamir@redhat.com" target="_blank">ratamir@redhat.com</a><br>RedHat Israel</div><div>RHEV-M QE Storage team<br></div><span></span><br></div><hr></span><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><span class=""><b>From: </b>"Stephen Repetski" <<a href="mailto:srepetsk@srepetsk.net" target="_blank">srepetsk@srepetsk.net</a>><br></span><b>To: </b>"Raz Tamir" <<a href="mailto:ratamir@redhat.com" target="_blank">ratamir@redhat.com</a>><br><b>Cc: </b>"users" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br><b>Sent: </b>Friday, July 24, 2015 12:01:16 AM<br><b>Subject: </b>Re: [ovirt-users] oVirt not starting primary storage domain<div><div class="h5"><br><div><br></div><div dir="ltr">Hi Raz:<div><br></div><div>I'm using vdsm-4.16.14-0.el6.x86_64 with glusterfs-3.6.2-1.el6.x86_64 on oVirt 3.5.2.</div><div><br></div><div>I removed the brick with: gluster remove-brick store1 replica 3 $1 $2 $3 start; gluster remove-brick store1 replica 3 $1 $2 $3 commit. Between the two commands I used the 'status' option to verify that all nodes were marked as 'completed' before running the 'commit' one.</div><div><br></div><div>Also, the two log files you requested are available here:</div><div><a href="http://srepetsk.net/files/engine.log.20150723" target="_blank">http://srepetsk.net/files/engine.log.20150723</a> && <a href="http://srepetsk.net/files/etc-glusterfs-glusterd.vol.log.20150723" target="_blank">http://srepetsk.net/files/etc-glusterfs-glusterd.vol.log.20150723</a><br></div><div>The gluster log file is from one of the servers from a different brick in the primary (aka "store1") datacenter/gluster volume, so it was and still is in the volume.</div><div><br></div><div><br></div><div>Thanks,</div><div>Stephen</div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div><div dir="ltr"><b style="color:rgb(102,102,102)">Stephen Repetski</b><br style="color:rgb(102,102,102)"><span style="color:rgb(102,102,102)">Rochester Institute of Technology '13 | </span><a style="color:rgb(102,102,102)" href="http://srepetsk.net" target="_blank">http://srepetsk.net</a><br></div></div></div>
<br><div class="gmail_quote">On Thu, Jul 23, 2015 at 4:28 PM, Raz Tamir <span dir="ltr"><<a href="mailto:ratamir@redhat.com" target="_blank">ratamir@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:trebuchet ms,sans-serif;font-size:12pt;color:#000000"><div>Hi <span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px">Stephen,</span><br></div><div><span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px">1) Can you please provide the vdsm and gluster versions?</span></div><div><span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px">2) How you removed the brick?</span></div><div><span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px">3) Can you please attach the glusterfs log located under /var/log ?</span></div><div><span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px"><br></span></div><div><span style="font-family:Helvetica,Arial,sans-serif;font-size:16.3636360168457px">* Just for info - there is no support for gluster if the volume is not a 3-way replica</span></div><div><br></div><div><span></span><div><br></div><div><br></div><div><br>Thanks in advance,<br>Raz Tamir<br><a href="mailto:ratamir@redhat.com" target="_blank">ratamir@redhat.com</a><br>RedHat Israel</div><div>RHEV-M QE Storage team<br></div><span></span><br></div><hr><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From: </b>"Stephen Repetski" <<a href="mailto:srepetsk@srepetsk.net" target="_blank">srepetsk@srepetsk.net</a>><br><b>To: </b>"users" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br><b>Sent: </b>Thursday, July 23, 2015 11:08:57 PM<br><b>Subject: </b>[ovirt-users] oVirt not starting primary storage domain<div><div><br><div><br></div><div dir="ltr">Hi all,<div><br></div><div>I recently made a change with the gluster volume backing my primary storage domain (removed 1 of the 3 bricks, each w/ 3x replication), and now oVirt fails to activate the primary storage domain. After attempting to start the domain the engine goes through and does its various commications with VDSM, but then fails out with a "Sanlock resource read failure" - <a href="https://gist.githubusercontent.com/srepetsk/83ef13ddcf1e690a398e/raw/ada362ac43ae71984a90979a676f2738648ac4ac/gistfile1.txt" target="_blank">https://gist.githubusercontent.com/srepetsk/83ef13ddcf1e690a398e/raw/ada362ac43ae71984a90979a676f2738648ac4ac/gistfile1.txt</a></div><div><br></div><div>Is there a way to figure out more on what this SpmStatusVDS error is and what might be causing it?</div><div><br></div><div>Thanks,</div><div>Stephen</div><div><br clear="all"><div><div><div dir="ltr"><b style="color:rgb(102,102,102)">Stephen Repetski</b><br></div></div></div>
</div></div>
<br></div></div>_______________________________________________<br>Users mailing list<br><a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br><a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br></div><div><br></div></div></div></blockquote></div><br></div>
</div></div></div><div><br></div></div></div></blockquote></div><br></div></div>
</div><div><br></div></div></body></html>