This is a multi-part message in MIME format. --------------941CA42C94052919F4693A27 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit On 04/24/2017 05:03 PM, Sven Achtelik wrote:
Hi All,
my oVirt-Setup is 3 Hosts with gluster and reaplica 3. I always try to stay on the current version and Im applying updates/upgrade if there are any. For this I put a host in maintenance and also use the Stop Gluster Service checkbox. After its done updating Ill set it back to active and wait until the engine sees all bricks again and then Ill go for the next host.
This worked fine for me the last month and now that I have more and more VMs running the changes that are written to the gluster volume while a host is in maintenance become a lot more and it takes pretty long for the healing to complete. What I dont understand is that I dont really see a lot of network usage in the GUI during that time and it feels quiet slow. The Network for the gluster is a 10G and Im quiet happy with the performance of it, its just the healing that takes long. I noticed that because I couldnt update the third host because of unsynced gluster volumes.
Is there any limiting variable that slows down traffic during healing that needs to be configured ? Or should I maybe change my updating process somehow to avoid having so many changes in queue?
Thank you,
Sven
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Sven, Do you have granular entry heal enabled on the volume? If no, there is a feature called granular entry self-heal which should be enabled with sharded volumes to get the benefits. So when a brick goes down and say only 1 in those million entries is created/deleted. Self-heal would be done for only that file it won't crawl the entire directory. You can run|gluster volume set/VOLNAME/cluster.granular-entry-heal enable / disable|command only if the volume is in|Created|state. If the volume is in any other state other than|Created|, for example,|Started|,|Stopped|, and so on, execute|gluster volume heal VOLNAME granular-entry-heal|enable / disable||command to enable or disable granular-entry-heal option. Thanks kasturi --------------941CA42C94052919F4693A27 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 04/24/2017 05:03 PM, Sven Achtelik wrote:<br> </div> <blockquote cite="mid:BFAB40933B3367488CE6299BAF8592D1014E52CC4354@SOCRATES.asl.local" type="cite"> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} span.E-MailFormatvorlage17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} @page WordSection1 {size:612.0pt 792.0pt; margin:70.85pt 70.85pt 2.0cm 70.85pt;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext="edit" spidmax="1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext="edit"> <o:idmap v:ext="edit" data="1" /> </o:shapelayout></xml><![endif]--> <div class="WordSection1"> <p class="MsoNormal">Hi All, <o:p></o:p></p> <p class="MsoNormal"><o:p> </o:p></p> <p class="MsoNormal"><span lang="EN-US">my oVirt-Setup is 3 Hosts with gluster and reaplica 3. I always try to stay on the current version and Im applying updates/upgrade if there are any. For this I put a host in maintenance and also use the Stop Gluster Service checkbox. After its done updating Ill set it back to active and wait until the engine sees all bricks again and then Ill go for the next host. <o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US">This worked fine for me the last month and now that I have more and more VMs running the changes that are written to the gluster volume while a host is in maintenance become a lot more and it takes pretty long for the healing to complete. What I dont understand is that I dont really see a lot of network usage in the GUI during that time and it feels quiet slow. The Network for the gluster is a 10G and Im quiet happy with the performance of it, its just the healing that takes long. I noticed that because I couldnt update the third host because of unsynced gluster volumes.<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US">Is there any limiting variable that slows down traffic during healing that needs to be configured ? Or should I maybe change my updating process somehow to avoid having so many changes in queue? <o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US">Thank you, <o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US">Sven<o:p></o:p></span></p> <p class="MsoNormal"><o:p> </o:p></p> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <p>Hi Sven,</p> <p> Do you have granular entry heal enabled on the volume? If no, there is a feature called granular entry self-heal which should be enabled with sharded volumes to get the benefits. So when a brick goes down and say only 1 in those million entries is created/deleted. Self-heal would be done for only that file it won't crawl the entire directory.</p> <p> <meta http-equiv="content-type" content="text/html; charset=windows-1252"> <span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">You can run<span class="Apple-converted-space"> </span></span><code class="command" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">gluster volume set<span class="Apple-converted-space"> </span><em class="replaceable" style="box-sizing: border-box;">VOLNAME</em><span class="Apple-converted-space"> </span>cluster.granular-entry-heal enable / disable<span class="Apple-converted-space"> </span></code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">command only if the volume is in<span class="Apple-converted-space"> </span></span><code class="literal" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">Created<span class="Apple-converted-space"> </span></code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">state. If the volume is in any other state other than<span class="Apple-converted-space"> </span></span><code class="literal" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">Created<span class="Apple-converted-space"> </span></code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">, for example,<span class="Apple-converted-space"> </span></span><code class="literal" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">Started<span class="Apple-converted-space"> </span></code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">,<span class="Apple-converted-space"> </span></span><code class="literal" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">Stopped</code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;">, and so on, execute<span class="Apple-converted-space"> </span></span><code class="command" style="box-sizing: border-box; font-size: 14.4px; padding: 2px 4px; color: rgb(51, 51, 51); background-color: rgb(255, 255, 255); border-radius: 0px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">gluster volume heal VOLNAME granular-entry-heal<span class="Apple-converted-space"> </span><code class="option" style="box-sizing: border-box; font-size: 12.96px; padding: 2px 4px; color: inherit; background-color: transparent; border-radius: 0px;">enable / disable</code></code><span style="color: rgb(51, 51, 51); font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: rgb(255, 255, 255); display: inline ! important; float: none;"><span class="Apple-converted-space"> </span>command to enable or disable granular-entry-heal option.</span></p> <p>Thanks</p> <p>kasturi<br> </p> </body> </html> --------------941CA42C94052919F4693A27--