6:47 a.m.
This is a multi-part message in MIME format.
--------------714A7C973919A95EE2A8FDD0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Helli Rudi
Nice specs.
I wouldn't use GlusterFS for this setup with the third server in a
different location. Just have this server as an Standalone and replicate
the VMs there. You won't have real time replication, but much less
hassle and probably to have constant failures, specially knowing you
have a wireless link.
For the SSDs I have been using bcache with success. Relatively simple to
setup and pretty good performance.
For your specs as you have 4 mechanical disks I would recommend you to
have a RAID 5 between them (4 disks is my limit for RAID 5) and a RAID 0
made of SSDs for the bcache device. If the RAID 0 fails for any reason
it will fall back directly to the mechanical disks and you can do
maintenance on the Node doing live migration in order to replace the
failed disks.
However as you have you have 2 remaining server to create your cluster
you may need to consider GlusterFS on the top of this RAID to have the
replication and Highavaibility.
Hope it helps.
Fernando
On 13/11/2017 08:03, Rudi Ahlers wrote:
Hi,
Can someone please give me some pointers, what would be the best setup
for performance and reliability?
We have the following hardware setup:
3x Supermicro server with following features per server:
128GB RAM
4x 8TB SATA HDD
2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710)
2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
Quad port 10Gbe Inter NIC
2x 10GB Cisco switches (to isolate storage network from LAN)
One of the servers will be in another office, with a 600Mb wireless
link for Disaster Recovery.
What is recommended for the best setup in terms of redundancy and speed?
I am guessing GlusterFS with a Distributed Striped Replicated Volume
across 3 of the servers.
For added performance I want to use the SSD drives, perhaps with dm-cache?
Should I combine the 4x HDD's using LVM on each host node?
What about RAID 6?
Virtual Machines will then reside on the oVirt Cluster and any one of
the 3 host nodes can fail, or any single HDD can fail and all should
still work, right/?
--
Kind Regards
Rudi Ahlers
Website: http://www.rudiahlers.co.za
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------714A7C973919A95EE2A8FDD0
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Helli Rudi</p>
<p>Nice specs.</p>
<p>I wouldn't use GlusterFS for this setup with the third server in
a different location. Just have this server as an Standalone and
replicate the VMs there. You won't have real time replication, but
much less hassle and probably to have constant failures, specially
knowing you have a wireless link.</p>
<p>For the SSDs I have been using bcache with success. Relatively
simple to setup and pretty good performance.</p>
<p>For your specs as you have 4 mechanical disks I would recommend
you to have a RAID 5 between them (4 disks is my limit for RAID 5)
and a RAID 0 made of SSDs for the bcache device. If the RAID 0
fails for any reason it will fall back directly to the mechanical
disks and you can do maintenance on the Node doing live migration
in order to replace the failed disks.</p>
<p>However as you have you have 2 remaining server to create your
cluster you may need to consider GlusterFS on the top of this RAID
to have the replication and Highavaibility.</p>
<p>Hope it helps.</p>
<p>Fernando<br>
</p>
<br>
<div class="moz-cite-prefix">On 13/11/2017 08:03, Rudi Ahlers
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAAj3DjmsZOkkzTZ_wYz-B7_xV9YoKgknyD0r=RJu5=sa0i7=wg@mail.gmail.com">
<div dir="ltr">Hi,
<div><br>
</div>
<div>Can someone please give me some pointers, what would be the
best setup for performance and reliability?</div>
<div><br>
</div>
<div>We have the following hardware setup:</div>
<div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span
style="font-size:14.6667px"><br>
</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">3x
Supermicro server with following features per
server:</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">128GB
RAM</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">4x 8TB
SATA
HDD</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">2x
SSD
drives (intel_ssdsc2ba400g4 - 400GB DC
S3710)</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">2x 12
core
CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @
2.20GHz</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">Quad
port
10Gbe Inter NIC</span></font></div>
<div><font color="#2c2c2c" face="Open Sans, Helvetica,
Arial,
sans-serif"><span style="font-size:14.6667px">2x
10GB
Cisco switches (to isolate storage network from
LAN)</span></font></div>
</div>
<div><br>
</div>
<div>
<div>One of the servers will be in another office, with a
600Mb wireless link for Disaster Recovery. </div>
<div><br>
</div>
<div>What is recommended for the best setup in terms of
redundancy and speed?</div>
<div><br>
</div>
<div>I am guessing GlusterFS with a Distributed Striped
Replicated Volume across 3 of the servers. </div>
<div><br>
</div>
<div>For added performance I want to use the SSD drives,
perhaps with dm-cache?</div>
<div><br>
</div>
<div>Should I combine the 4x HDD's using LVM on each host
node?</div>
<div>What about RAID 6?</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>Virtual Machines will then reside on the oVirt Cluster
and any one of the 3 host nodes can fail, or any single
HDD can fail and all should still work, right/? </div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
-- <br>
<div class="gmail_signature">Kind Regards<br>
Rudi Ahlers<br>
Website: <a href="http://www.rudiahlers.co.za"
target="_blank"
moz-do-not-send="true">http://www.rudiahlers.co.za</a><br>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<br>
</body>
</html>
--------------714A7C973919A95EE2A8FDD0--