This is a multi-part message in MIME format. --------------F665B3500A76C389CE232BB1 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit On 04/24/2017 05:36 PM, Sven Achtelik wrote:
Hi Kasturi,
Ill try that. Will this be persistent over a reboot of a host or even stopping of the complete cluster ?
Thank you
Hi Sven, This is a volume set option ((has nothing to do with reboot)and it will be present on the volume until you reset it manually using 'gluster volume reset' command . You just need to execute 'gluster volume heal <volname> granular-entry-heal enable' and this will do the right thing for you. Thanks kasturi.
*Von:*knarra [mailto:knarra@redhat.com] *Gesendet:* Montag, 24. April 2017 13:44 *An:* Sven Achtelik <Sven.Achtelik@eps.aero>; users@ovirt.org *Betreff:* Re: [ovirt-users] Hyperconverged Setup and Gluster healing
On 04/24/2017 05:03 PM, Sven Achtelik wrote:
Hi All,
my oVirt-Setup is 3 Hosts with gluster and reaplica 3. I always try to stay on the current version and Im applying updates/upgrade if there are any. For this I put a host in maintenance and also use the Stop Gluster Service checkbox. After its done updating Ill set it back to active and wait until the engine sees all bricks again and then Ill go for the next host.
This worked fine for me the last month and now that I have more and more VMs running the changes that are written to the gluster volume while a host is in maintenance become a lot more and it takes pretty long for the healing to complete. What I dont understand is that I dont really see a lot of network usage in the GUI during that time and it feels quiet slow. The Network for the gluster is a 10G and Im quiet happy with the performance of it, its just the healing that takes long. I noticed that because I couldnt update the third host because of unsynced gluster volumes.
Is there any limiting variable that slows down traffic during healing that needs to be configured ? Or should I maybe change my updating process somehow to avoid having so many changes in queue?
Thank you,
Sven
_______________________________________________
Users mailing list
Users@ovirt.org <mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
Hi Sven,
Do you have granular entry heal enabled on the volume? If no, there is a feature called granular entry self-heal which should be enabled with sharded volumes to get the benefits. So when a brick goes down and say only 1 in those million entries is created/deleted. Self-heal would be done for only that file it won't crawl the entire directory.
You can run|gluster volume set|/VOLNAME/|cluster.granular-entry-heal enable / disable|command only if the volume is in|Created|state. If the volume is in any other state other than|Created|, for example,|Started|,|Stopped|, and so on, execute|gluster volume heal VOLNAME granular-entry-heal||enable / disable|command to enable or disable granular-entry-heal option.
Thanks
kasturi
--------------F665B3500A76C389CE232BB1 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 04/24/2017 05:36 PM, Sven Achtelik wrote:<br> </div> <blockquote cite="mid:BFAB40933B3367488CE6299BAF8592D1014E52CC4356@SOCRATES.asl.local" type="cite"> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} @font-face {font-family:Consolas; panose-1:2 11 6 9 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif; color:black; mso-fareast-language:EN-US;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} p {mso-style-priority:99; mso-margin-top-alt:auto; margin-right:0cm; mso-margin-bottom-alt:auto; margin-left:0cm; font-size:12.0pt; font-family:"Times New Roman",serif; color:black;} code {mso-style-priority:99; font-family:"Courier New";} pre {mso-style-priority:99; mso-style-link:"HTML Vorformatiert Zchn"; margin:0cm; margin-bottom:.0001pt; font-size:10.0pt; font-family:"Courier New"; color:black;} span.HTMLVorformatiertZchn {mso-style-name:"HTML Vorformatiert Zchn"; mso-style-priority:99; mso-style-link:"HTML Vorformatiert"; font-family:Consolas; color:black; mso-fareast-language:EN-US;} span.E-MailFormatvorlage21 {mso-style-type:personal; font-family:"Calibri",sans-serif; color:windowtext;} span.apple-converted-space {mso-style-name:apple-converted-space;} span.E-MailFormatvorlage23 {mso-style-type:personal-reply; font-family:"Calibri",sans-serif; color:#1F497D;} .MsoChpDefault {mso-style-type:export-only; font-size:10.0pt;} @page WordSection1 {size:612.0pt 792.0pt; margin:70.85pt 70.85pt 2.0cm 70.85pt;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext="edit" spidmax="1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext="edit"> <o:idmap v:ext="edit" data="1" /> </o:shapelayout></xml><![endif]--> <div class="WordSection1"> <p class="MsoNormal"><span style="color:#1F497D">Hi Kasturi,<o:p></o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Ill try that. Will this be persistent over a reboot of a host or even stopping of the complete cluster ? <o:p></o:p></span></p> <p class="MsoNormal"><a moz-do-not-send="true" name="_MailEndCompose"></a><span style="color:#1F497D" lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D" lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D" lang="EN-US">Thank you</span></p> </div> </blockquote> Hi Sven,<br> <br> This is a volume set option ((has nothing to do with reboot)and it will be present on the volume until you reset it manually using 'gluster volume reset' command . You just need to execute 'gluster volume heal <volname> granular-entry-heal enable' and this will do the right thing for you. <br> <br> Thanks<br> kasturi.<br> <blockquote cite="mid:BFAB40933B3367488CE6299BAF8592D1014E52CC4356@SOCRATES.asl.local" type="cite"> <div class="WordSection1"> <p class="MsoNormal"><span style="color:#1F497D" lang="EN-US"><o:p></o:p></span></p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p class="MsoNormal"><b><span style="color:windowtext;mso-fareast-language:DE">Von:</span></b><span style="color:windowtext;mso-fareast-language:DE"> knarra [<a class="moz-txt-link-freetext" href="mailto:knarra@redhat.com">mailto:knarra@redhat.com</a>] <br> <b>Gesendet:</b> Montag, 24. April 2017 13:44<br> <b>An:</b> Sven Achtelik <a class="moz-txt-link-rfc2396E" href="mailto:Sven.Achtelik@eps.aero"><Sven.Achtelik@eps.aero></a>; <a class="moz-txt-link-abbreviated" href="mailto:users@ovirt.org">users@ovirt.org</a><br> <b>Betreff:</b> Re: [ovirt-users] Hyperconverged Setup and Gluster healing<o:p></o:p></span></p> </div> </div> <p class="MsoNormal"><o:p> </o:p></p> <div> <p class="MsoNormal">On 04/24/2017 05:03 PM, Sven Achtelik wrote:<span style="font-size:12.0pt;mso-fareast-language:DE"><o:p></o:p></span></p> </div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> <p class="MsoNormal">Hi All, <o:p></o:p></p> <p class="MsoNormal"> <o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US">my oVirt-Setup is 3 Hosts with gluster and reaplica 3. I always try to stay on the current version and Im applying updates/upgrade if there are any. For this I put a host in maintenance and also use the Stop Gluster Service checkbox. After its done updating Ill set it back to active and wait until the engine sees all bricks again and then Ill go for the next host. </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US">This worked fine for me the last month and now that I have more and more VMs running the changes that are written to the gluster volume while a host is in maintenance become a lot more and it takes pretty long for the healing to complete. What I dont understand is that I dont really see a lot of network usage in the GUI during that time and it feels quiet slow. The Network for the gluster is a 10G and Im quiet happy with the performance of it, its just the healing that takes long. I noticed that because I couldnt update the third host because of unsynced gluster volumes.</span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US">Is there any limiting variable that slows down traffic during healing that needs to be configured ? Or should I maybe change my updating process somehow to avoid having so many changes in queue? </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US">Thank you, </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p> <p class="MsoNormal"><span lang="EN-US">Sven</span><o:p></o:p></p> <p class="MsoNormal"> <o:p></o:p></p> <p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;mso-fareast-language:DE"><br> <br> <o:p></o:p></span></p> <pre>_______________________________________________<o:p></o:p></pre> <pre>Users mailing list<o:p></o:p></pre> <pre><a moz-do-not-send="true" href="mailto:Users@ovirt.org">Users@ovirt.org</a><o:p></o:p></pre> <pre><a moz-do-not-send="true" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><o:p></o:p></pre> </blockquote> <p>Hi Sven,<o:p></o:p></p> <p> Do you have granular entry heal enabled on the volume? If no, there is a feature called granular entry self-heal which should be enabled with sharded volumes to get the benefits. So when a brick goes down and say only 1 in those million entries is created/deleted. Self-heal would be done for only that file it won't crawl the entire directory.<o:p></o:p></p> <p> <span style="color:#333333;background:white">You can run<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">gluster volume set</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><em><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white">VOLNAME</span></em><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">cluster.granular-entry-heal enable / disable</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><span style="color:#333333;background:white">command only if the volume is in<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">Created</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><span style="color:#333333;background:white">state. If the volume is in any other state other than<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">Created</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><span style="color:#333333;background:white">, for example,<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">Started</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><span style="color:#333333;background:white">,<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">Stopped</span></code><span style="color:#333333;background:white">, and so on, execute<span class="apple-converted-space"> </span></span><code><span style="font-size:11.0pt;color:#333333;background:white">gluster volume heal VOLNAME granular-entry-heal</span></code><span class="apple-converted-space"><span style="font-size:11.0pt;font-family:"Courier New";color:#333333;background:white"> </span></span><code><span style="font-size:9.5pt;color:#333333">enable / disable</span></code><span class="apple-converted-space"><span style="color:#333333;background:white"> </span></span><span style="color:#333333;background:white">command to enable or disable granular-entry-heal option.</span><o:p></o:p></p> <p>Thanks<o:p></o:p></p> <p>kasturi<o:p></o:p></p> </div> </blockquote> <p><br> </p> </body> </html> --------------F665B3500A76C389CE232BB1--