<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 13, 2017 at 3:33 PM, Rudi Ahlers <span dir="ltr"><<a target="_blank" href="mailto:rudiahlers@gmail.com">rudiahlers@gmail.com</a>></span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr">Hi, <div><br></div><div>Can someone please give me some pointers, what would be the best setup for performance and reliability?</div><div><br></div><div>We have the following hardware setup:</div><div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px"><br></span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">3x Supermicro server with following features per server:</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">128GB RAM</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">4x 8TB SATA HDD</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710)</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">Quad port 10Gbe Inter NIC</span></font></div><div><font face="Open Sans, Helvetica, Arial, sans-serif" color="#2c2c2c"><span style="font-size:14.6667px">2x 10GB Cisco switches (to isolate storage network from LAN)</span></font></div></div><div><br></div><div><div>One of the servers will be in another office, with a 600Mb wireless link for Disaster Recovery. </div></div></div></blockquote><div><br></div><div>All 3 servers need to be on the same network with low latency between servers. Gluster volume is used in replica 3 configuration in oVirt, and data will be written to all 3 servers synchronously. If you have one of the 3 servers in a remote location, your writes will be slow and the storage will seem to be unavailable to oVirt.<br><br></div><div>For Disaster recovery, you can use gluster's geo-replication feature. This does need an additional server in the remote location. See <a href="https://www.ovirt.org/develop/release-management/features/gluster/gluster-dr/">https://www.ovirt.org/develop/release-management/features/gluster/gluster-dr/</a><br> <br></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><div><br></div><div>What is recommended for the best setup in terms of redundancy and speed?</div><div><br></div><div>I am guessing GlusterFS with a Distributed Striped Replicated Volume across 3 of the servers. </div></div></div></blockquote><div><br><br></div><div>Replica 3 gluster volume with sharding turned on for the gluster volume. If you use the deployment via Cockpit option, the volume is created with all recommended options.<br><br>You can also manually set this by enabling the virt profile, like this<br></div><div># gluster volume set <volumename> group virt<br> <br></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><div><br></div><div>For added performance I want to use the SSD drives, perhaps with dm-cache?<br> <br></div></div></div></blockquote><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><div><br></div><div>Should I combine the 4x HDD's using LVM on each host node?</div><div>What about RAID 6?</div></div></div></blockquote><div><br></div><div>Gluster can work with either RAID or JBOD ( with replica 3, JBOD can be used, as gluster has the redundancy built in on the other nodes). Users often choose RAID to aggregate capacity from multiple disks as single brick, and also as the brick rebuilt time is offloaded to RAID layer in case of any of the hard disk failures. The answer is it depends on your needs and the hardware you have.<br><br> <br></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><div><br></div><div><br></div><div><br></div><div><div>Virtual Machines will then reside on the oVirt Cluster and any one of the 3 host nodes can fail, or any single HDD can fail and all should still work, right/? </div></div><span class="gmail-HOEnZb"><font color="#888888"><div><br></div></font></span></div></div></blockquote><div><br></div><div>That's correct. With a replica 3 approach, the oVirt environment is available even when one of the 3 hosts fail. <br><br></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><div><span class="gmail-HOEnZb"><font color="#888888"><div></div><div><br></div><div><br></div><div><br></div>-- <br><div class="gmail-m_-4077077633578865261gmail_signature">Kind Regards<br>Rudi Ahlers<br>Website: <a target="_blank" href="http://www.rudiahlers.co.za">http://www.rudiahlers.co.za</a><br></div>
</font></span></div></div>
<br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a target="_blank" rel="noreferrer" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>