This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o Content-Type: multipart/mixed; boundary="7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F"; protected-headers="v1" From: Richard Neuboeck <hawk@tbi.univie.ac.at> To: users@ovirt.org Message-ID: <b71bed12-f9b6-bbda-64f2-e99b47160e30@tbi.univie.ac.at> Subject: Re: [ovirt-users] Which hardware are you using for oVirt References: <815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com> <cdca9ccd-8c15-1cdb-ead6-84567f226ea4@starlett.lv> <1701ED12-9ED4-46B9-96E5-1FD3E32419DD@gmail.com> <CABMULtKPvZRDRkByH3WyXbZQHuSZY4o7=hNwNqvRDsV=+6yjtg@mail.gmail.com> <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E@gmail.com> In-Reply-To: <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E@gmail.com> --7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Hi Andy, we have 3 hosts for virtualization. Each 40 Cores, 512GB RAM, RAID 1 for the system, 4 bonded (onboard) 1Gbit NICs for client access (to the VMs) and a 10GBit NIC for the storage network. The storage is built of 3 hosts, 10Gbit NIC, RAID 6 (5TB HDDs and SSDs for caching) and gluster in replica 3 mode. Cheers Richard On 25.03.18 09:36, Andy Michielsen wrote:
Hello Alex, =20 Thanks for sharing. Much appriciated. =20 I believe my setup would need 96 Gb off RAM in each host, and would nee= d about at least 3 Tb of storage. Probably 4 Tb would be beter if I want to work with snapshots. (Will be running mostly windows 2016 servers or=
windows 10 desktops with 6Gb off RAM and 100 Gb of disks) =20 I agree that a 10 Gb network for storage would be very beneficial. =20 Now If I can figure out how to set up a glusterfs on a 3 node cluster i= n oVirt 4.2 just for the data storage. I =E2=80=98m golden to get started= =2E :-) =20 Kind regards. =20 On 24 Mar 2018, at 20:08, Alex K <rightkicktech@gmail.com <mailto:rightkicktech@gmail.com>> wrote: =20
I have 2 or 3 node clusters with following hardware (all with self-hosted engine) :
2 node cluster: RAM: 64 GB per host CPU: 8 cores per host Storage: 4x 1TB SAS in RAID10 NIC: 2x Gbit VMs: 20
The above, although I would like to have had a third NIC for gluster storage redundancy, it is running smoothly for quite some time and without performance issues. The VMs it is running are not high on IO (mostly small Linux servers).=
For your setup (30 VMs) I would rather go with RAID10 SAS disks and at=
3 node clusters: RAM: 32 GB per host CPU: 16 cores per host Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage space without purchasing extra disks) NIC: 6x Gbit VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 1=
least a dual 10Gbit NIC dedicated to the gluster traffic only.
Alex
On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen <andy.michielsen@gmail.com <mailto:andy.michielsen@gmail.com>> wrote:
Hello Andrei,
Thank you very much for sharing info on your hardware setup. Very informative.
At this moment I have my ovirt engine on our vmware environment which is fine for good backup and restore.
I have 4 nodes running now all different in make and model with local storage and it works but lacks performance a bit.
But I can get my hands on some old dell=E2=80=99s R415 with 96 Gb = of ram and 2 quadcores and 6 x 1 Gb nic=E2=80=99s. They all come with 2 x= 146 Gb 15000 rpm=E2=80=99s harddisks. This isn=E2=80=99t bad but I will a= dd more RAM for starters. Also I would like to have some good redundant storage for this too and the servers have limited space to add that.
Hopefully others will also share there setups and expirience like you did.
Kind regards.
On 24 Mar 2018, at 10:35, Andrei Verovski <andreil1@starlett.lv <mailto:andreil1@starlett.lv>> wrote:
Hi,
HL ProLiant DL380, dual Xeon 120 GB RAID L1 for system 2 TB RAID L10 for VM disks 5 VMs, 3 Linux, 2 Windows Total CPU load most of the time is=C2=A0 low, high level of activ=
ity
related to disk. Host engine under KVM appliance on SuSE, can be easily moved, backed up, copied, experimented with, etc.
You'll have to use servers with more RAM and storage than main. More then one NIC required if some of your VMs are on different subnets, e.g. 1 in internal zone and 2nd on DMZ. For your setup 10 GB NICs + L3 Switch for ovirtmgmt.
BTW, I would suggest to have several separate hardware RAIDs unless you have SSD, otherwise limit of the disk system I/O will be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.=
*Please note many cheap SSDs do NOT work reliably with SAS controllers even in SATA mode*.
For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for OS. It was possible to install system, yet under heavy load simulated=
with iozone disk system freeze, rendering OS unbootable. Same crash was experienced with 512GB KingFast SSD connected to broadcom/AMCC SAS RAID Card.
On 03/24/2018 10:33 AM, Andy Michielsen wrote:
Hi all,
Not sure if this is the place to be asking this but I was wonder=
ing which hardware you all are using and why in order for me to see what = I would be needing.
I would like to set up a HA cluster consisting off 3 hosts to be=
able to run 30 vm=E2=80=99s.
The engine, I can run on an other server. The hosts can be fitte=
d with the storage and share the space through glusterfs. I would think I= will be needing at least 3 nic=E2=80=99s but would be able to install ov= n. (Are 1gb nic=E2=80=99s sufficient ?)
Any input you guys would like to share would be greatly appricia=
ted.
Thanks, _______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
_______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
=20 =20 _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users =20
--7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F-- --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHQEARECADQWIQQH3Gy5jXqjdPfp3qKcaiGA6s70YQUCWrikgRYcaGF3a0B0Ymku dW5pdmllLmFjLmF0AAoJEJxqIYDqzvRh7oUAoPhxFVG6Rq/9n12MqHFjD/VAIHPI AKDJjxGOtzvHcCRN/H+h8UgEFBNmfQ== =e9ez -----END PGP SIGNATURE----- --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o--