9:42 a.m.
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o
Content-Type: multipart/mixed; boundary="7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F";
protected-headers="v1"
From: Richard Neuboeck <hawk(a)tbi.univie.ac.at>
To: users(a)ovirt.org
Message-ID: <b71bed12-f9b6-bbda-64f2-e99b47160e30(a)tbi.univie.ac.at>
Subject: Re: [ovirt-users] Which hardware are you using for oVirt
References: <815987B5-31DA-4316-809D-A03363A1E3C3(a)gmail.com>
<cdca9ccd-8c15-1cdb-ead6-84567f226ea4(a)starlett.lv>
<1701ED12-9ED4-46B9-96E5-1FD3E32419DD(a)gmail.com>
<CABMULtKPvZRDRkByH3WyXbZQHuSZY4o7=hNwNqvRDsV=+6yjtg(a)mail.gmail.com>
<545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E(a)gmail.com>
In-Reply-To: <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E(a)gmail.com>
--7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: quoted-printable
Hi Andy,
we have 3 hosts for virtualization. Each 40 Cores, 512GB RAM, RAID 1 for
the system, 4 bonded (onboard) 1Gbit NICs for client access (to the VMs)
and a 10GBit NIC for the storage network.
The storage is built of 3 hosts, 10Gbit NIC, RAID 6 (5TB HDDs and SSDs
for caching) and gluster in replica 3 mode.
Cheers
Richard
On 25.03.18 09:36, Andy Michielsen wrote:
Hello Alex,
=20
Thanks for sharing. Much appriciated.
=20
I believe my setup would need 96 Gb off RAM in each host, and would nee=
d
about at least 3 Tb of storage. Probably 4 Tb would be beter if I
want
to work with snapshots. (Will be running mostly windows 2016 servers or=
windows 10 desktops with 6Gb off RAM and 100 Gb of disks)
=20
I agree that a 10 Gb network for storage would be very beneficial.
=20
Now If I can figure out how to set up a glusterfs on a 3 node cluster i=
n
oVirt 4.2 just for the data storage. I =E2=80=98m golden to get
started=
=2E :-)
=20
Kind regards.
=20
On 24 Mar 2018, at 20:08, Alex K <rightkicktech(a)gmail.com
<mailto:rightkicktech@gmail.com>> wrote:
=20
> I have 2 or 3 node clusters with following hardware (all with
> self-hosted engine) :
>
> 2 node cluster:
> RAM: 64 GB per host
> CPU: 8 cores per host
> Storage: 4x 1TB SAS in RAID10
> NIC: 2x Gbit
> VMs: 20
>
> The above, although I would like to have had a third NIC for gluster
> storage redundancy, it is running smoothly for quite some time and
> without performance issues.
> The VMs it is running are not high on IO (mostly small Linux servers).=
>
> 3 node clusters:
> RAM: 32 GB per host
> CPU: 16 cores per host
> Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage
> space without purchasing extra disks)
> NIC: 6x Gbit
> VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 1=
0)
>
> For your setup (30 VMs) I would rather go with RAID10 SAS disks and at=
> least a dual 10Gbit NIC dedicated to the gluster traffic only.
>
> Alex
>
>
> On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen
> <andy.michielsen(a)gmail.com <mailto:andy.michielsen@gmail.com>> wrote:
>
> Hello Andrei,
>
> Thank you very much for sharing info on your hardware setup. Very
> informative.
>
> At this moment I have my ovirt engine on our vmware environment
> which is fine for good backup and restore.
>
> I have 4 nodes running now all different in make and model with
> local storage and it works but lacks performance a bit.
>
> But I can get my hands on some old dell=E2=80=99s R415 with 96 Gb =
of ram
> and 2 quadcores and 6 x 1 Gb nic=E2=80=99s. They all come
with 2 x=
146 Gb
> 15000 rpm=E2=80=99s harddisks. This isn=E2=80=99t bad but I
will a=
dd more RAM for
> starters. Also I would like to have some good redundant
storage
> for this too and the servers have limited space to add that.
>
> Hopefully others will also share there setups and expirience like
> you did.
>
> Kind regards.
>
> On 24 Mar 2018, at 10:35, Andrei Verovski <andreil1(a)starlett.lv
> <mailto:andreil1@starlett.lv>> wrote:
>
>> Hi,
>>
>> HL ProLiant DL380, dual Xeon
>> 120 GB RAID L1 for system
>> 2 TB RAID L10 for VM disks
>> 5 VMs, 3 Linux, 2 Windows
>> Total CPU load most of the time is=C2=A0 low, high level of activ=
ity
>> related to disk.
>> Host engine under KVM appliance on SuSE, can be easily moved,
>> backed up, copied, experimented with, etc.
>>
>> You'll have to use servers with more RAM and storage than main.
>> More then one NIC required if some of your VMs are on different
>> subnets, e.g. 1 in internal zone and 2nd on DMZ.
>> For your setup 10 GB NICs + L3 Switch for ovirtmgmt.
>>
>> BTW, I would suggest to have several separate hardware RAIDs
>> unless you have SSD, otherwise limit of the disk system I/O will
>> be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.=
>>
>> *Please note many cheap SSDs do NOT work reliably with SAS
>> controllers even in SATA mode*.
>>
>> For example, I supposed to use 2 x WD Green SSD configures as
>> RAID L1 for OS.
>> It was possible to install system, yet under heavy load simulated=
>> with iozone disk system freeze, rendering OS unbootable.
>> Same crash was experienced with 512GB KingFast SSD connected to
>> broadcom/AMCC SAS RAID Card.
>>
>>
>> On 03/24/2018 10:33 AM, Andy Michielsen wrote:
>>> Hi all,
>>>
>>> Not sure if this is the place to be asking this but I was wonder=
ing which hardware you all are using and why in order for me to see what =
I would be needing.
>>>
>>> I would like to set up a HA cluster consisting off 3 hosts to be=
able to run 30 vm=E2=80=99s.
>>> The engine, I can run on an other server. The hosts
can be fitte=
d with the storage and share the space through glusterfs. I would
think I=
will be needing at least 3 nic=E2=80=99s but would be able to install ov=
n. (Are 1gb nic=E2=80=99s sufficient ?)
>>>
>>> Any input you guys would like to share would be greatly appricia=
ted.
>>>
>>> Thanks,
>>> _______________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org <mailto:Users@ovirt.org>
>>> http://lists.ovirt.org/mailman/listinfo/users
>>> <http://lists.ovirt.org/mailman/listinfo/users>
>>
>>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org <mailto:Users@ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/users
> <http://lists.ovirt.org/mailman/listinfo/users>
>
>
=20
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
=20
--7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F--
--Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
iHQEARECADQWIQQH3Gy5jXqjdPfp3qKcaiGA6s70YQUCWrikgRYcaGF3a0B0Ymku
dW5pdmllLmFjLmF0AAoJEJxqIYDqzvRh7oUAoPhxFVG6Rq/9n12MqHFjD/VAIHPI
AKDJjxGOtzvHcCRN/H+h8UgEFBNmfQ==
=e9ez
-----END PGP SIGNATURE-----
--Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o--