This is a multi-part message in MIME format. --------------714A7C973919A95EE2A8FDD0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Helli Rudi Nice specs. I wouldn't use GlusterFS for this setup with the third server in a different location. Just have this server as an Standalone and replicate the VMs there. You won't have real time replication, but much less hassle and probably to have constant failures, specially knowing you have a wireless link. For the SSDs I have been using bcache with success. Relatively simple to setup and pretty good performance. For your specs as you have 4 mechanical disks I would recommend you to have a RAID 5 between them (4 disks is my limit for RAID 5) and a RAID 0 made of SSDs for the bcache device. If the RAID 0 fails for any reason it will fall back directly to the mechanical disks and you can do maintenance on the Node doing live migration in order to replace the failed disks. However as you have you have 2 remaining server to create your cluster you may need to consider GlusterFS on the top of this RAID to have the replication and Highavaibility. Hope it helps. Fernando On 13/11/2017 08:03, Rudi Ahlers wrote:
Hi,
Can someone please give me some pointers, what would be the best setup for performance and reliability?
We have the following hardware setup:
3x Supermicro server with following features per server: 128GB RAM 4x 8TB SATA HDD 2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710) 2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz Quad port 10Gbe Inter NIC 2x 10GB Cisco switches (to isolate storage network from LAN)
One of the servers will be in another office, with a 600Mb wireless link for Disaster Recovery.
What is recommended for the best setup in terms of redundancy and speed?
I am guessing GlusterFS with a Distributed Striped Replicated Volume across 3 of the servers.
For added performance I want to use the SSD drives, perhaps with dm-cache?
Should I combine the 4x HDD's using LVM on each host node? What about RAID 6?
Virtual Machines will then reside on the oVirt Cluster and any one of the 3 host nodes can fail, or any single HDD can fail and all should still work, right/?
-- Kind Regards Rudi Ahlers Website: http://www.rudiahlers.co.za
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------714A7C973919A95EE2A8FDD0 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>Helli Rudi</p> <p>Nice specs.</p> <p>I wouldn't use GlusterFS for this setup with the third server in a different location. Just have this server as an Standalone and replicate the VMs there. You won't have real time replication, but much less hassle and probably to have constant failures, specially knowing you have a wireless link.</p> <p>For the SSDs I have been using bcache with success. Relatively simple to setup and pretty good performance.</p> <p>For your specs as you have 4 mechanical disks I would recommend you to have a RAID 5 between them (4 disks is my limit for RAID 5) and a RAID 0 made of SSDs for the bcache device. If the RAID 0 fails for any reason it will fall back directly to the mechanical disks and you can do maintenance on the Node doing live migration in order to replace the failed disks.</p> <p>However as you have you have 2 remaining server to create your cluster you may need to consider GlusterFS on the top of this RAID to have the replication and Highavaibility.</p> <p>Hope it helps.</p> <p>Fernando<br> </p> <br> <div class="moz-cite-prefix">On 13/11/2017 08:03, Rudi Ahlers wrote:<br> </div> <blockquote type="cite" cite="mid:CAAj3DjmsZOkkzTZ_wYz-B7_xV9YoKgknyD0r=RJu5=sa0i7=wg@mail.gmail.com"> <div dir="ltr">Hi, <div><br> </div> <div>Can someone please give me some pointers, what would be the best setup for performance and reliability?</div> <div><br> </div> <div>We have the following hardware setup:</div> <div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px"><br> </span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">3x Supermicro server with following features per server:</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">128GB RAM</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">4x 8TB SATA HDD</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710)</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">Quad port 10Gbe Inter NIC</span></font></div> <div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">2x 10GB Cisco switches (to isolate storage network from LAN)</span></font></div> </div> <div><br> </div> <div> <div>One of the servers will be in another office, with a 600Mb wireless link for Disaster Recovery. </div> <div><br> </div> <div>What is recommended for the best setup in terms of redundancy and speed?</div> <div><br> </div> <div>I am guessing GlusterFS with a Distributed Striped Replicated Volume across 3 of the servers. </div> <div><br> </div> <div>For added performance I want to use the SSD drives, perhaps with dm-cache?</div> <div><br> </div> <div>Should I combine the 4x HDD's using LVM on each host node?</div> <div>What about RAID 6?</div> <div><br> </div> <div><br> </div> <div><br> </div> <div> <div>Virtual Machines will then reside on the oVirt Cluster and any one of the 3 host nodes can fail, or any single HDD can fail and all should still work, right/? </div> </div> <div><br> </div> <div><br> </div> <div><br> </div> <div><br> </div> -- <br> <div class="gmail_signature">Kind Regards<br> Rudi Ahlers<br> Website: <a href="http://www.rudiahlers.co.za" target="_blank" moz-do-not-send="true">http://www.rudiahlers.co.za</a><br> </div> </div> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------714A7C973919A95EE2A8FDD0--