[ovirt-users] Hardware critique

Fri Apr 6 14:02:56 UTC 2018

It's likely possibile you will get more performance from a NFS server
compared to Gluster. Specially if on your NFS server you have something
like ZFS + SSD for L2ARC or ext4 + Bcache, but you get not redundancy. If
you NFS server dies everything stops working, which is not the case with
Distributed Storage.

Fernando

2018-04-06 10:45 GMT-03:00 Jayme <jaymef at gmail.com>:

> Yaniv,
>
> I appreciate your input, thanks!
>
> I understand that everyone's use case is different, but I was hoping to
> hear from some users that are using oVirt hyper-converged setup and get
> some input on the performance.  When I research GlusterFS I hear a lot
> about how it can be slow especially when dealing with small files.  I'm
> starting to wonder if a straight up NFS server with a few SSDs would be
> less hassle and perhaps offer better VM performance than glusterFS can
> currently.
>
> I want to get the best oVirt performance I can get (on somewhat of a
> budget) with a fairly small amount of required disk space (under 2TB).  I'm
> not sure if hyper-converged setup w/GlusterFS is the answer or not.  I'd
> like to avoid spending 15k only to find out that it's too slow.
>
> On Fri, Apr 6, 2018 at 6:05 AM, Yaniv Kaul <ykaul at redhat.com> wrote:
>
>>
>>
>> On Thu, Apr 5, 2018, 11:39 PM Vincent Royer <vincent at epicenergy.ca>
>> wrote:
>>
>>> Jayme,
>>>
>>> I'm doing a very similar build, the only difference really is I am using
>>> SSDs instead of HDDs.   I have similar questions as you regarding expected
>>> performance. Have you considered JBOD + NFS?   Putting a Gluster Replica 3
>>> on top of RAID 10 arrays sounds very safe, but my gosh the capacity takes a
>>> massive hit.  Am I correct in saying you will only get 4TB total usable
>>> capacity out of 24TB worth of disks?  The cost per TB in that sort of
>>> scenario is immense.
>>>
>>> My plan is two 2TB SSDs per server in JBOD with a caching raid card,
>>> with replica 3.  I would end up with the same 4TB total capacity using 12TB
>>> of SSDs.
>>>
>>
>> I'm not sure I see the value in RAID card if you don't use RAID and I'm
>> not sure you really need caching on the card.
>> Y.
>>
>>
>>> I think Replica 3 is safe enough that you could forgo the RAID 10. But
>>> I'm talking from zero experience...  Would love others to chime in with
>>> their opinions on both these setups.
>>>
>>> *Vincent Royer*
>>> *778-825-1057*
>>>
>>>
>>> <http://www.epicenergy.ca/>
>>> *SUSTAINABLE MOBILE ENERGY SOLUTIONS*
>>>
>>>
>>>
>>>
>>> On Thu, Apr 5, 2018 at 12:22 PM, Jayme <jaymef at gmail.com> wrote:
>>>
>>>> Thanks for your feedback.  Any other opinions on this proposed setup?
>>>> I'm very torn over using GlusterFS and what the expected performance may
>>>> be, there seems to be little information out there.  Would love to hear any
>>>> feedback specifically from ovirt users on hyperconverged configurations.
>>>>
>>>> On Thu, Apr 5, 2018 at 2:56 AM, Alex K <rightkicktech at gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> You should be ok with the setup.
>>>>> I am running around 20 vms (linux and windows, small and medium size)
>>>>> with the half of your specs. With 10G network replica 3 is ok.
>>>>>
>>>>> Alex
>>>>>
>>>>> On Wed, Apr 4, 2018, 16:13 Jayme <jaymef at gmail.com> wrote:
>>>>>
>>>>>> I'm spec'ing hardware for a 3-node oVirt build (on somewhat of a
>>>>>> budget).  I plan to do 20-30 Linux VMs most of them very light weight + a
>>>>>> couple of heavier hitting web and DB servers with frequent rsync backups.
>>>>>> Some have a lot of small files from large github repos etc.
>>>>>>
>>>>>> 3X of the following:
>>>>>>
>>>>>> Dell PowerEdge R720
>>>>>> 2x 2.9 GHz 8 Core E5-2690 (SR0L0)
>>>>>> 256GB RAM
>>>>>> PERC H710
>>>>>> 2x10GB Nic
>>>>>>
>>>>>> Boot/OS will likely be two cheaper small sata/ssd in raid 1.
>>>>>>
>>>>>> Gluster bricks comprised of 4x2TB WD Gold 7200RPM SATA HDDs in RAID
>>>>>> 10 per server.  Using a replica 3 setup (and I'm thinking right now with no
>>>>>> arbiter for extra redundancy, although I'm not sure what the performance
>>>>>> hit may be as a result).  Will this allow for two host failure or just one?
>>>>>>
>>>>>> I've been really struggling with storage choices, it seems very
>>>>>> difficult to predict the performance of glusterFS due to the variance in
>>>>>> hardware (everyone is using something different).  I'm not sure if the
>>>>>> performance will be adequate enough for my needs.
>>>>>>
>>>>>> I will be using an all ready existing Netgear XS716T 10GB switch for
>>>>>> Gluster storage network.
>>>>>>
>>>>>> In addition I plan to build another simple glusterFS storage server
>>>>>> that I can use to georeplicate the gluster volume to for DR purposes and
>>>>>> use existing hardware to build an independent standby oVirt host that is
>>>>>> able to start up a few high priority VMs from the georeplicated glusterFS
>>>>>> volume if for some reason the primary oVirt cluster/glusterFS volume ever
>>>>>> failed.
>>>>>>
>>>>>> I would love to hear any advice or critiques on this plan.
>>>>>>
>>>>>> Thanks!
>>>>>> _______________________________________________
>>>>>> Users mailing list
>>>>>> Users at ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20180406/8a7b38ea/attachment.html>