Have a question in regards to storage performance. I have a gluster replica 3 volume that we are testing for performance. In my current configuration is 1 server has 16X1.2TB( 10K 2.5 Inch) drives configured in Raid 10 with a 256k stripe. My 2nd server is configured with 4X6TB (3.5 Inch Drives) configured Raid 10 with a 256k stripe. Each server is configured with 802.3 Bond (4X1GB) network links. Each server is configured with write-back on the raid controller. I am seeing a lot of network usage (solid 3 Gbps) when i perform file copies on the vm attached to that gluster volume, But i see spikes on the disk io when watching the dashboard through the cockpit interface. I spikes are up to 1.5 Gbps, but i would say the average through put is maybe 256 Mbps. Is this to be expected, or should it be a solid activity in the graphs for disk IO. Is it better to use a 256K stripe or a 512 strip on the hardware raid configuration? Eventually i plan on having the hardware match up for better performance. Thanks Bryan
Hi, can you check IOPS? and state # of VM's ? do : iostat -x 1 for a while =) Isnt RAID discouraged ? AFAIK gluster likes JBOD, am I wrong? regards, JP 2017-10-25 12:05 GMT-03:00 Bryan Sockel <Bryan.Sockel@altn.com>:
Have a question in regards to storage performance. I have a gluster replica 3 volume that we are testing for performance. In my current configuration is 1 server has 16X1.2TB( 10K 2.5 Inch) drives configured in Raid 10 with a 256k stripe. My 2nd server is configured with 4X6TB (3.5 Inch Drives) configured Raid 10 with a 256k stripe. Each server is configured with 802.3 Bond (4X1GB) network links. Each server is configured with write-back on the raid controller.
I am seeing a lot of network usage (solid 3 Gbps) when i perform file copies on the vm attached to that gluster volume, But i see spikes on the disk io when watching the dashboard through the cockpit interface. I spikes are up to 1.5 Gbps, but i would say the average through put is maybe 256 Mbps.
Is this to be expected, or should it be a solid activity in the graphs for disk IO. Is it better to use a 256K stripe or a 512 strip on the hardware raid configuration?
Eventually i plan on having the hardware match up for better performance.
Thanks
Bryan
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
This is a multi-part message in MIME format. --------------B0133BDD10E3DF2F78D4A545 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit That was my impression too, but unfortunately someone told in this mail list recently that Gluster isn't that clever to work without RAID Controllers and when disks fail it imposes some difficulties for replacement. Perhaps someone with more knowledge could clarify this point which certainly is beneficial to people. Fernando On 26/10/2017 10:59, Juan Pablo wrote:
Hi, can you check IOPS? and state # of VM's ? do : iostat -x 1 for a while =)
Isnt RAID discouraged ? AFAIK gluster likes JBOD, am I wrong?
regards, JP
2017-10-25 12:05 GMT-03:00 Bryan Sockel <Bryan.Sockel@altn.com <mailto:Bryan.Sockel@altn.com>>:
Have a question in regards to storage performance. I have a gluster replica 3 volume that we are testing for performance. In my current configuration is 1 server has 16X1.2TB( 10K 2.5 Inch) drives configured in Raid 10 with a 256k stripe. My 2nd server is configured with 4X6TB (3.5 Inch Drives) configured Raid 10 with a 256k stripe. Each server is configured with 802.3 Bond (4X1GB) network links. Each server is configured with write-back on the raid controller. I am seeing a lot of network usage (solid 3 Gbps) when i perform file copies on the vm attached to that gluster volume, But i see spikes on the disk io when watching the dashboard through the cockpit interface. I spikes are up to 1.5 Gbps, but i would say the average through put is maybe 256 Mbps. Is this to be expected, or should it be a solid activity in the graphs for disk IO. Is it better to use a 256K stripe or a 512 strip on the hardware raid configuration? Eventually i plan on having the hardware match up for better performance. Thanks Bryan
_______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------B0133BDD10E3DF2F78D4A545 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>That was my impression too, but unfortunately someone told in this mail list recently that Gluster isn't that clever to work without RAID Controllers and when disks fail it imposes some difficulties for replacement. Perhaps someone with more knowledge could clarify this point which certainly is beneficial to people.</p> <p>Fernando<br> </p> <br> <div class="moz-cite-prefix">On 26/10/2017 10:59, Juan Pablo wrote:<br> </div> <blockquote type="cite" cite="mid:CALJLebV1NaTUJ3S4LrUCk=BQOznO_1KVofCuBw=BhSZdVhMS3g@mail.gmail.com"> <div dir="ltr"> <div class="gmail_default" style="font-family:monospace,monospace">Hi, can you check IOPS? and state # of VM's ? do : iostat -x 1 for a while =) <br> <br> </div> <div class="gmail_default" style="font-family:monospace,monospace">Isnt RAID discouraged ? AFAIK gluster likes JBOD, am I wrong?<br> <br> <br> </div> <div class="gmail_default" style="font-family:monospace,monospace">regards, <br> </div> <div class="gmail_default" style="font-family:monospace,monospace">JP<br> </div> </div> <div class="gmail_extra"><br> <div class="gmail_quote">2017-10-25 12:05 GMT-03:00 Bryan Sockel <span dir="ltr"><<a href="mailto:Bryan.Sockel@altn.com" target="_blank" moz-do-not-send="true">Bryan.Sockel@altn.com</a>></span>:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)">Have a question in regards to storage performance. I have a gluster replica 3 volume that we are testing for performance. In my current configuration is 1 server has 16X1.2TB( 10K 2.5 Inch) drives configured in Raid 10 with a 256k stripe. My 2nd server is configured with 4X6TB (3.5 Inch Drives) configured Raid 10 with a 256k stripe. Each server is configured with 802.3 Bond (4X1GB) network links. Each server is configured with write-back on the raid controller.</div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)">I am seeing a lot of network usage (solid 3 Gbps) when i perform file copies on the vm attached to that gluster volume, But i see spikes on the disk io when watching the dashboard through the cockpit interface. I spikes are up to 1.5 Gbps, but i would say the average through put is maybe 256 Mbps.</div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)">Is this to be expected, or should it be a solid activity in the graphs for disk IO. Is it better to use a 256K stripe or a 512 strip on the hardware raid configuration?</div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)">Eventually i plan on having the hardware match up for better performance.</div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)">Thanks</div> <span class="HOEnZb"><font color="#888888"> <div style="font-size:13.3333px;font-family:Tahoma;color:rgb(0,0,0);font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> </div> <div id="m_2239789973379271889signature" style="font-family:Tahoma;color:rgb(0,0,0);font-size:13.3333px;font-weight:400;font-style:normal;background:none 0% 0%/auto repeat scroll padding-box border-box rgba(0,0,0,0)"> <div> <div> <div>Bryan</div> </div> </div> </div> </font></span></div> <br> ______________________________<wbr>_________________<br> Users mailing list<br> <a href="mailto:Users@ovirt.org" moz-do-not-send="true">Users@ovirt.org</a><br> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br> <br> </blockquote> </div> <br> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------B0133BDD10E3DF2F78D4A545--
participants (3)
-
Bryan Sockel -
FERNANDO FREDIANI -
Juan Pablo