From andy.michielsen at gmail.com Sat Mar 24 08:33:58 2018 Content-Type: multipart/mixed; boundary="===============4682101617421001921==" MIME-Version: 1.0 From: Andy Michielsen To: users at ovirt.org Subject: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 24 Mar 2018 09:33:53 +0100 Message-ID: <815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com> --===============4682101617421001921== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi all, Not sure if this is the place to be asking this but I was wondering which h= ardware you all are using and why in order for me to see what I would be ne= eding. I would like to set up a HA cluster consisting off 3 hosts to be able to ru= n 30 vm=E2=80=99s. The engine, I can run on an other server. The hosts can be fitted with the = storage and share the space through glusterfs. I would think I will be need= ing at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb nic= =E2=80=99s sufficient ?) Any input you guys would like to share would be greatly appriciated. Thanks, --===============4682101617421001921==-- From andreil1 at starlett.lv Sat Mar 24 09:35:38 2018 Content-Type: multipart/mixed; boundary="===============7103587305009139131==" MIME-Version: 1.0 From: Andrei Verovski To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 24 Mar 2018 11:35:38 +0200 Message-ID: In-Reply-To: 815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com --===============7103587305009139131== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------D22D740E8090EF46CB19D891 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hi, HL ProLiant DL380, dual Xeon 120 GB RAID L1 for system 2 TB RAID L10 for VM disks 5 VMs, 3 Linux, 2 Windows Total CPU load most of the time is=3DC2=3DA0 low, high level of activity re= la=3D ted to disk. Host engine under KVM appliance on SuSE, can be easily moved, backed up, copied, experimented with, etc. You'll have to use servers with more RAM and storage than main. More then one NIC required if some of your VMs are on different subnets, e.g. 1 in internal zone and 2nd on DMZ. For your setup 10 GB NICs + L3 Switch for ovirtmgmt. BTW, I would suggest to have several separate hardware RAIDs unless you have SSD, otherwise limit of the disk system I/O will be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases. *Please note many cheap SSDs do NOT work reliably with SAS controllers even in SATA mode*. For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for OS. It was possible to install system, yet under heavy load simulated with iozone disk system freeze, rendering OS unbootable. Same crash was experienced with 512GB KingFast SSD connected to broadcom/AMCC SAS RAID Card. On 03/24/2018 10:33 AM, Andy Michielsen wrote: > Hi all, > > Not sure if this is the place to be asking this but I was wondering whi= =3D ch hardware you all are using and why in order for me to see what I would= =3D be needing. > > I would like to set up a HA cluster consisting off 3 hosts to be able t= =3D o run 30 vm=3DE2=3D80=3D99s. > The engine, I can run on an other server. The hosts can be fitted with = =3D the storage and share the space through glusterfs. I would think I will b= =3D e needing at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. = (Are=3D 1gb nic=3DE2=3D80=3D99s sufficient ?) > > Any input you guys would like to share would be greatly appriciated. > > Thanks, > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------D22D740E8090EF46CB19D891 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hi,

HL ProLiant DL380, dual Xeon
120 GB RAID L1 for system
2 TB RAID L10 for VM disks
5 VMs, 3 Linux, 2 Windows
Total CPU load most of the time is=3DC2=3DA0 low, high level of activ= it=3D y related to disk.
Host engine under KVM appliance on SuSE, can be easily moved, backed up, copied, experimented with, etc.

You'll have to use servers with more RAM and storage than main.
More then one NIC required if some of your VMs are on different subnets, e.g. 1 in internal zone and 2nd on DMZ.
For your setup 10 GB NICs + L3 Switch for ovirtmgmt.

BTW, I would suggest to have several separate hardware RAIDs unless you have SSD, otherwise limit of the disk system I/O will be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.
Please note many cheap SSDs do NOT work reliably with SAS controllers even in SATA mode.

For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for OS.
It was possible to install system, yet under heavy load simulated with iozone disk system freeze, rendering OS unbootable.
Same crash was experienced with 512GB KingFast SSD connected to broadcom/AMCC SAS RAID Card.


On 03/24/2018 10:33 AM, Andy Michielsen wrote:
Hi all,

Not sure if this is the place to be asking this but I was wondering which=
=3D
 hardware you all are using and why in order for me to see what I would b=
=3D
e needing.

I would like to set up a HA cluster consisting off 3 hosts to be able to =
=3D
run 30 vm=3DE2=3D80=3D99s.
The engine, I can run on an other server. The hosts can be fitted with th=
=3D
e storage and share the space through glusterfs. I would think I will be =
=3D
needing at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. (A=
re 1=3D
gb nic=3DE2=3D80=3D99s sufficient ?)

Any input you guys would like to share would be greatly appriciated.

Thanks,
_______________________________________________
Users mailing list
Use=3D
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


--------------D22D740E8090EF46CB19D891-- --===============7103587305009139131== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS1EMjJENzQwRTgwOTBFRjQ2Q0IxOUQ4OTEKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCkhp LAoKSEwgUHJvTGlhbnQgREwzODAsIGR1YWwgWGVvbgoxMjAgR0IgUkFJRCBMMSBmb3Igc3lzdGVt CjIgVEIgUkFJRCBMMTAgZm9yIFZNIGRpc2tzCjUgVk1zLCAzIExpbnV4LCAyIFdpbmRvd3MKVG90 YWwgQ1BVIGxvYWQgbW9zdCBvZiB0aGUgdGltZSBpcz1DMj1BMCBsb3csIGhpZ2ggbGV2ZWwgb2Yg YWN0aXZpdHkgcmVsYT0KdGVkCnRvIGRpc2suCkhvc3QgZW5naW5lIHVuZGVyIEtWTSBhcHBsaWFu Y2Ugb24gU3VTRSwgY2FuIGJlIGVhc2lseSBtb3ZlZCwgYmFja2VkIHVwLApjb3BpZWQsIGV4cGVy aW1lbnRlZCB3aXRoLCBldGMuCgpZb3UnbGwgaGF2ZSB0byB1c2Ugc2VydmVycyB3aXRoIG1vcmUg UkFNIGFuZCBzdG9yYWdlIHRoYW4gbWFpbi4KTW9yZSB0aGVuIG9uZSBOSUMgcmVxdWlyZWQgaWYg c29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlmZmVyZW50IHN1Ym5ldHMsCmUuZy4gMSBpbiBpbnRl cm5hbCB6b25lIGFuZCAybmQgb24gRE1aLgpGb3IgeW91ciBzZXR1cCAxMCBHQiBOSUNzICsgTDMg U3dpdGNoIGZvciBvdmlydG1nbXQuCgpCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBoYXZlIHNldmVy YWwgc2VwYXJhdGUgaGFyZHdhcmUgUkFJRHMgdW5sZXNzIHlvdQpoYXZlIFNTRCwgb3RoZXJ3aXNl IGxpbWl0IG9mIHRoZSBkaXNrIHN5c3RlbSBJL08gd2lsbCBiZSBhIGJvdHRsZW5lY2suCkNvbnNp ZGVyIFNTRCBMMSBSQUlEIGZvciBoZWF2eS1sb2FkZWQgZGF0YWJhc2VzLgoKKlBsZWFzZSBub3Rl IG1hbnkgY2hlYXAgU1NEcyBkbyBOT1Qgd29yayByZWxpYWJseSB3aXRoIFNBUyBjb250cm9sbGVy cwpldmVuIGluIFNBVEEgbW9kZSouCgpGb3IgZXhhbXBsZSwgSSBzdXBwb3NlZCB0byB1c2UgMiB4 IFdEIEdyZWVuIFNTRCBjb25maWd1cmVzIGFzIFJBSUQgTDEKZm9yIE9TLgpJdCB3YXMgcG9zc2li bGUgdG8gaW5zdGFsbCBzeXN0ZW0sIHlldCB1bmRlciBoZWF2eSBsb2FkIHNpbXVsYXRlZCB3aXRo Cmlvem9uZSBkaXNrIHN5c3RlbSBmcmVlemUsIHJlbmRlcmluZyBPUyB1bmJvb3RhYmxlLgpTYW1l IGNyYXNoIHdhcyBleHBlcmllbmNlZCB3aXRoIDUxMkdCIEtpbmdGYXN0IFNTRCBjb25uZWN0ZWQg dG8KYnJvYWRjb20vQU1DQyBTQVMgUkFJRCBDYXJkLgoKCk9uIDAzLzI0LzIwMTggMTA6MzMgQU0s IEFuZHkgTWljaGllbHNlbiB3cm90ZToKPiBIaSBhbGwsCj4KPiBOb3Qgc3VyZSBpZiB0aGlzIGlz IHRoZSBwbGFjZSB0byBiZSBhc2tpbmcgdGhpcyBidXQgSSB3YXMgd29uZGVyaW5nIHdoaT0KY2gg aGFyZHdhcmUgeW91IGFsbCBhcmUgdXNpbmcgYW5kIHdoeSBpbiBvcmRlciBmb3IgbWUgdG8gc2Vl IHdoYXQgSSB3b3VsZD0KIGJlIG5lZWRpbmcuCj4KPiBJIHdvdWxkIGxpa2UgdG8gc2V0IHVwIGEg SEEgY2x1c3RlciBjb25zaXN0aW5nIG9mZiAzIGhvc3RzIHRvIGJlIGFibGUgdD0KbyBydW4gMzAg dm09RTI9ODA9OTlzLgo+IFRoZSBlbmdpbmUsIEkgY2FuIHJ1biBvbiBhbiBvdGhlciBzZXJ2ZXIu IFRoZSBob3N0cyBjYW4gYmUgZml0dGVkIHdpdGggPQp0aGUgc3RvcmFnZSBhbmQgc2hhcmUgdGhl IHNwYWNlIHRocm91Z2ggZ2x1c3RlcmZzLiBJIHdvdWxkIHRoaW5rIEkgd2lsbCBiPQplIG5lZWRp bmcgYXQgbGVhc3QgMyBuaWM9RTI9ODA9OTlzIGJ1dCB3b3VsZCBiZSBhYmxlIHRvIGluc3RhbGwg b3ZuLiAoQXJlPQogMWdiIG5pYz1FMj04MD05OXMgc3VmZmljaWVudCA/KQo+Cj4gQW55IGlucHV0 IHlvdSBndXlzIHdvdWxkIGxpa2UgdG8gc2hhcmUgd291bGQgYmUgZ3JlYXRseSBhcHByaWNpYXRl ZC4KPgo+IFRoYW5rcywKPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fXwo+IFVzZXJzIG1haWxpbmcgbGlzdAo+IFVzZXJzQG92aXJ0Lm9yZwo+IGh0dHA6Ly9s aXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycwoKCgotLS0tLS0tLS0tLS0tLUQy MkQ3NDBFODA5MEVGNDZDQjE5RDg5MQpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11 dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD4K ICA8aGVhZD4KICAgIDxtZXRhIGh0dHAtZXF1aXY9M0QiQ29udGVudC1UeXBlIiBjb250ZW50PTNE InRleHQvaHRtbDsgY2hhcnNldD0zRHV0Zj0KLTgiPgogIDwvaGVhZD4KICA8Ym9keSBiZ2NvbG9y PTNEIiNGRkZGRkYiIHRleHQ9M0QiIzAwMDAwMCI+CiAgICA8ZGl2IGNsYXNzPTNEIm1vei1jaXRl LXByZWZpeCI+SGksPGJyPgogICAgICA8YnI+CiAgICAgIEhMIFByb0xpYW50IERMMzgwLCBkdWFs IFhlb248YnI+CiAgICAgIDEyMCBHQiBSQUlEIEwxIGZvciBzeXN0ZW08YnI+CiAgICAgIDIgVEIg UkFJRCBMMTAgZm9yIFZNIGRpc2tzPGJyPgogICAgICA1IFZNcywgMyBMaW51eCwgMiBXaW5kb3dz PGJyPgogICAgICBUb3RhbCBDUFUgbG9hZCBtb3N0IG9mIHRoZSB0aW1lIGlzPUMyPUEwIGxvdywg aGlnaCBsZXZlbCBvZiBhY3Rpdml0PQp5CiAgICAgIHJlbGF0ZWQgdG8gZGlzay48YnI+CiAgICAg IEhvc3QgZW5naW5lIHVuZGVyIEtWTSBhcHBsaWFuY2Ugb24gU3VTRSwgY2FuIGJlIGVhc2lseSBt b3ZlZCwKICAgICAgYmFja2VkIHVwLCBjb3BpZWQsIGV4cGVyaW1lbnRlZCB3aXRoLCBldGMuPGJy PgogICAgICA8YnI+CiAgICAgIFlvdSdsbCBoYXZlIHRvIHVzZSBzZXJ2ZXJzIHdpdGggbW9yZSBS QU0gYW5kIHN0b3JhZ2UgdGhhbiBtYWluLjxicj4KICAgICAgTW9yZSB0aGVuIG9uZSBOSUMgcmVx dWlyZWQgaWYgc29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlmZmVyZW50CiAgICAgIHN1Ym5ldHMs IGUuZy4gMSBpbiBpbnRlcm5hbCB6b25lIGFuZCAybmQgb24gRE1aLjxicj4KICAgICAgRm9yIHlv dXIgc2V0dXAgMTAgR0IgTklDcyArIEwzIFN3aXRjaCBmb3Igb3ZpcnRtZ210Ljxicj4KICAgICAg PGJyPgogICAgICBCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBoYXZlIHNldmVyYWwgc2VwYXJhdGUg aGFyZHdhcmUgUkFJRHMKICAgICAgdW5sZXNzIHlvdSBoYXZlIFNTRCwgb3RoZXJ3aXNlIGxpbWl0 IG9mIHRoZSBkaXNrIHN5c3RlbSBJL08gd2lsbAogICAgICBiZSBhIGJvdHRsZW5lY2suIENvbnNp ZGVyIFNTRCBMMSBSQUlEIGZvciBoZWF2eS1sb2FkZWQgZGF0YWJhc2VzLjxiPQpyPgogICAgICA8 YnI+CiAgICAgIDxmb250IGNvbG9yPTNEIiM5OTAwMDAiPjxiPlBsZWFzZSBub3RlIG1hbnkgY2hl YXAgU1NEcyBkbyBOT1Qgd29yawogICAgICAgICAgcmVsaWFibHkgd2l0aCBTQVMgY29udHJvbGxl cnMgZXZlbiBpbiBTQVRBIG1vZGU8L2I+LjwvZm9udD48YnI+CiAgICAgIDxicj4KICAgICAgRm9y IGV4YW1wbGUsIEkgc3VwcG9zZWQgdG8gdXNlIDIgeCBXRCBHcmVlbiBTU0QgY29uZmlndXJlcyBh cyBSQUlECiAgICAgIEwxIGZvciBPUy4gPGJyPgogICAgICBJdCB3YXMgcG9zc2libGUgdG8gaW5z dGFsbCBzeXN0ZW0sIHlldCB1bmRlciBoZWF2eSBsb2FkIHNpbXVsYXRlZAogICAgICB3aXRoIGlv em9uZSBkaXNrIHN5c3RlbSBmcmVlemUsIHJlbmRlcmluZyBPUyB1bmJvb3RhYmxlLjxicj4KICAg ICAgU2FtZSBjcmFzaCB3YXMgZXhwZXJpZW5jZWQgd2l0aCA1MTJHQiBLaW5nRmFzdCBTU0QgY29u bmVjdGVkIHRvCiAgICAgIGJyb2FkY29tL0FNQ0MgU0FTIFJBSUQgQ2FyZC48YnI+CiAgICAgIDxi cj4KICAgICAgPGJyPgogICAgICBPbiAwMy8yNC8yMDE4IDEwOjMzIEFNLCBBbmR5IE1pY2hpZWxz ZW4gd3JvdGU6PGJyPgogICAgPC9kaXY+CiAgICA8YmxvY2txdW90ZSB0eXBlPTNEImNpdGUiCiAg ICAgIGNpdGU9M0QibWlkOjgxNTk4N0I1LTMxREEtNDMxNi04MDlELUEwMzM2M0ExRTNDM0BnbWFp bC5jb20iPgogICAgICA8cHJlIHdyYXA9M0QiIj5IaSBhbGwsCgpOb3Qgc3VyZSBpZiB0aGlzIGlz IHRoZSBwbGFjZSB0byBiZSBhc2tpbmcgdGhpcyBidXQgSSB3YXMgd29uZGVyaW5nIHdoaWNoPQog aGFyZHdhcmUgeW91IGFsbCBhcmUgdXNpbmcgYW5kIHdoeSBpbiBvcmRlciBmb3IgbWUgdG8gc2Vl IHdoYXQgSSB3b3VsZCBiPQplIG5lZWRpbmcuCgpJIHdvdWxkIGxpa2UgdG8gc2V0IHVwIGEgSEEg Y2x1c3RlciBjb25zaXN0aW5nIG9mZiAzIGhvc3RzIHRvIGJlIGFibGUgdG8gPQpydW4gMzAgdm09 RTI9ODA9OTlzLgpUaGUgZW5naW5lLCBJIGNhbiBydW4gb24gYW4gb3RoZXIgc2VydmVyLiBUaGUg aG9zdHMgY2FuIGJlIGZpdHRlZCB3aXRoIHRoPQplIHN0b3JhZ2UgYW5kIHNoYXJlIHRoZSBzcGFj ZSB0aHJvdWdoIGdsdXN0ZXJmcy4gSSB3b3VsZCB0aGluayBJIHdpbGwgYmUgPQpuZWVkaW5nIGF0 IGxlYXN0IDMgbmljPUUyPTgwPTk5cyBidXQgd291bGQgYmUgYWJsZSB0byBpbnN0YWxsIG92bi4g KEFyZSAxPQpnYiBuaWM9RTI9ODA9OTlzIHN1ZmZpY2llbnQgPykKCkFueSBpbnB1dCB5b3UgZ3V5 cyB3b3VsZCBsaWtlIHRvIHNoYXJlIHdvdWxkIGJlIGdyZWF0bHkgYXBwcmljaWF0ZWQuCgpUaGFu a3MsCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVzZXJz IG1haWxpbmcgbGlzdAo8YSBjbGFzcz0zRCJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9 M0QibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlPQpyc0BvdmlydC5vcmc8L2E+CjxhIGNsYXNz PTNEIm1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0zRCJodHRwOi8vbGlzdHMub3ZpcnQub3Jn L21haWxtYW49Ci9saXN0aW5mby91c2VycyI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFu L2xpc3RpbmZvL3VzZXJzPC9hPgo8L3ByZT4KICAgIDwvYmxvY2txdW90ZT4KICAgIDxwPjxicj4K ICAgIDwvcD4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0tRDIyRDc0MEU4MDkwRUY0 NkNCMTlEODkxLS0K --===============7103587305009139131==-- From andy.michielsen at gmail.com Sat Mar 24 11:24:36 2018 Content-Type: multipart/mixed; boundary="===============2854678982993873336==" MIME-Version: 1.0 From: Andy Michielsen To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 24 Mar 2018 12:24:32 +0100 Message-ID: <1701ED12-9ED4-46B9-96E5-1FD3E32419DD@gmail.com> In-Reply-To: cdca9ccd-8c15-1cdb-ead6-84567f226ea4@starlett.lv --===============2854678982993873336== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --Apple-Mail-FF4BAD67-2D6B-4D37-B4DF-9283D336B1AF Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hello Andrei, Thank you very much for sharing info on your hardware setup. Very informati= v=3D e. At this moment I have my ovirt engine on our vmware environment which is fi= n=3D e for good backup and restore. I have 4 nodes running now all different in make and model with local stora= g=3D e and it works but lacks performance a bit. But I can get my hands on some old dell=3DE2=3D80=3D99s R415 with 96 Gb of = ram and=3D 2 quadcores and 6 x 1 Gb nic=3DE2=3D80=3D99s. They all come with 2 x 146 G= b 15000=3D rpm=3DE2=3D80=3D99s harddisks. This isn=3DE2=3D80=3D99t bad but I will add= more RAM for=3D starters. Also I would like to have some good redundant storage for this t= o=3D o and the servers have limited space to add that. Hopefully others will also share there setups and expirience like you did. Kind regards. > On 24 Mar 2018, at 10:35, Andrei Verovski wrote: >=3D20 > Hi, >=3D20 > HL ProLiant DL380, dual Xeon > 120 GB RAID L1 for system > 2 TB RAID L10 for VM disks > 5 VMs, 3 Linux, 2 Windows > Total CPU load most of the time is low, high level of activity related t= o=3D disk. > Host engine under KVM appliance on SuSE, can be easily moved, backed up, = c=3D opied, experimented with, etc. >=3D20 > You'll have to use servers with more RAM and storage than main. > More then one NIC required if some of your VMs are on different subnets, = e=3D .g. 1 in internal zone and 2nd on DMZ. > For your setup 10 GB NICs + L3 Switch for ovirtmgmt. >=3D20 > BTW, I would suggest to have several separate hardware RAIDs unless you h= a=3D ve SSD, otherwise limit of the disk system I/O will be a bottleneck. Consid= e=3D r SSD L1 RAID for heavy-loaded databases. >=3D20 > Please note many cheap SSDs do NOT work reliably with SAS controllers eve= n=3D in SATA mode. >=3D20 > For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for= O=3D S.=3D20 > It was possible to install system, yet under heavy load simulated with io= z=3D one disk system freeze, rendering OS unbootable. > Same crash was experienced with 512GB KingFast SSD connected to broadcom/= A=3D MCC SAS RAID Card. >=3D20 >=3D20 >> On 03/24/2018 10:33 AM, Andy Michielsen wrote: >> Hi all, >>=3D20 >> Not sure if this is the place to be asking this but I was wondering whic= h=3D hardware you all are using and why in order for me to see what I would be = n=3D eeding. >>=3D20 >> I would like to set up a HA cluster consisting off 3 hosts to be able to= r=3D un 30 vm=3DE2=3D80=3D99s. >> The engine, I can run on an other server. The hosts can be fitted with t= h=3D e storage and share the space through glusterfs. I would think I will be ne= e=3D ding at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. (Are = 1gb nic=3D =3DE2=3D80=3D99s sufficient ?) >>=3D20 >> Any input you guys would like to share would be greatly appriciated. >>=3D20 >> Thanks, >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >=3D20 --Apple-Mail-FF4BAD67-2D6B-4D37-B4DF-9283D336B1AF Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hello Andrei,
=
Thank you very much for sharing info on your hardware setup. Ve= r=3D y informative.

At this moment I have my ovirt engi= n=3D e on our vmware environment which is fine for good backup and restore.=3D

I have 4 nodes running now all different in make and mo= d=3D el with local storage and it works but lacks performance a bit.
<= b=3D r>
But I can get my hands on some old dell=3DE2=3D80=3D99s R415 w= ith 96 G=3D b of ram and 2 quadcores and 6 x 1 Gb nic=3DE2=3D80=3D99s. They all come wi= th 2 x 1=3D 46 Gb 15000 rpm=3DE2=3D80=3D99s harddisks. This isn=3DE2=3D80=3D99t bad but= I will add m=3D ore RAM for starters. Also I would like to have some good redundant storage= f=3D or this too and the servers have limited space to add that.

<= /=3D div>
Hopefully others will also share there setups and expirience like = y=3D ou did.

Kind regards.

On 24 Mar 2018= ,=3D at 10:35, Andrei Verovski <= andre=3D il1(a)starlett.lv> wrote:

<= div> =3D20 =3D20 =3D20
Hi,

HL ProLiant DL380, dual Xeon
120 GB RAID L1 for system
2 TB RAID L10 for VM disks
5 VMs, 3 Linux, 2 Windows
Total CPU load most of the time is  low, high level of activity related to disk.
Host engine under KVM appliance on SuSE, can be easily moved, backed up, copied, experimented with, etc.

You'll have to use servers with more RAM and storage than main.
More then one NIC required if some of your VMs are on different subnets, e.g. 1 in internal zone and 2nd on DMZ.
For your setup 10 GB NICs + L3 Switch for ovirtmgmt.

BTW, I would suggest to have several separate hardware RAIDs unless you have SSD, otherwise limit of the disk system I/O will be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.

Please note many cheap SSDs do NOT work reliably with SAS controllers even in SATA mode.

For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for OS.
It was possible to install system, yet under heavy load simulated with iozone disk system freeze, rendering OS unbootable.
Same crash was experienced with 512GB KingFast SSD connected to broadcom/AMCC SAS RAID Card.


On 03/24/2018 10:33 AM, Andy Michielsen wrote:
Hi all,

Not sure if this is the place to be asking this but I was wondering which h=
a=3D
rdware you all are using and why in order for me to see what I would be nee=
d=3D
ing.

I would like to set up a HA cluster consisting off 3 hosts to be able to ru=
n=3D
 30 vm=3DE2=3D80=3D99s.
The engine, I can run on an other server. The hosts can be fitted with the =
s=3D
torage and share the space through glusterfs. I would think I will be needi=
n=3D
g at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. (Are 1gb=
 nic=3DE2=3D
=3D80=3D99s sufficient ?)

Any input you guys would like to share would be greatly appriciated.

Thanks,
_______________________________________________
Users mailing list
Users@=3D
ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


=3D20
=3D --Apple-Mail-FF4BAD67-2D6B-4D37-B4DF-9283D336B1AF-- --===============2854678982993873336== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" Ci0tQXBwbGUtTWFpbC1GRjRCQUQ2Ny0yRDZCLTREMzctQjRERi05MjgzRDMzNkIxQUYKQ29udGVu dC1UeXBlOiB0ZXh0L3BsYWluOwoJY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29k aW5nOiBxdW90ZWQtcHJpbnRhYmxlCgpIZWxsbyBBbmRyZWksCgpUaGFuayB5b3UgdmVyeSBtdWNo IGZvciBzaGFyaW5nIGluZm8gb24geW91ciBoYXJkd2FyZSBzZXR1cC4gVmVyeSBpbmZvcm1hdGl2 PQplLgoKQXQgdGhpcyBtb21lbnQgSSBoYXZlIG15IG92aXJ0IGVuZ2luZSBvbiBvdXIgdm13YXJl IGVudmlyb25tZW50IHdoaWNoIGlzIGZpbj0KZSBmb3IgZ29vZCBiYWNrdXAgYW5kIHJlc3RvcmUu CgpJIGhhdmUgNCBub2RlcyBydW5uaW5nIG5vdyBhbGwgZGlmZmVyZW50IGluIG1ha2UgYW5kIG1v ZGVsIHdpdGggbG9jYWwgc3RvcmFnPQplIGFuZCBpdCB3b3JrcyBidXQgbGFja3MgcGVyZm9ybWFu Y2UgYSBiaXQuCgpCdXQgSSBjYW4gZ2V0IG15IGhhbmRzIG9uIHNvbWUgb2xkIGRlbGw9RTI9ODA9 OTlzIFI0MTUgd2l0aCA5NiBHYiBvZiByYW0gYW5kPQogMiBxdWFkY29yZXMgYW5kIDYgeCAxIEdi IG5pYz1FMj04MD05OXMuIFRoZXkgYWxsIGNvbWUgd2l0aCAyIHggMTQ2IEdiIDE1MDAwPQogcnBt PUUyPTgwPTk5cyBoYXJkZGlza3MuIFRoaXMgaXNuPUUyPTgwPTk5dCBiYWQgYnV0IEkgd2lsbCBh ZGQgbW9yZSBSQU0gZm9yPQogc3RhcnRlcnMuIEFsc28gSSB3b3VsZCBsaWtlIHRvIGhhdmUgc29t ZSBnb29kIHJlZHVuZGFudCBzdG9yYWdlIGZvciB0aGlzIHRvPQpvIGFuZCB0aGUgc2VydmVycyBo YXZlIGxpbWl0ZWQgc3BhY2UgdG8gYWRkIHRoYXQuCgpIb3BlZnVsbHkgb3RoZXJzIHdpbGwgYWxz byBzaGFyZSB0aGVyZSBzZXR1cHMgYW5kIGV4cGlyaWVuY2UgbGlrZSB5b3UgZGlkLgoKS2luZCBy ZWdhcmRzLgoKPiBPbiAyNCBNYXIgMjAxOCwgYXQgMTA6MzUsIEFuZHJlaSBWZXJvdnNraSA8YW5k cmVpbDFAc3RhcmxldHQubHY+IHdyb3RlOgo+PTIwCj4gSGksCj49MjAKPiBITCBQcm9MaWFudCBE TDM4MCwgZHVhbCBYZW9uCj4gMTIwIEdCIFJBSUQgTDEgZm9yIHN5c3RlbQo+IDIgVEIgUkFJRCBM MTAgZm9yIFZNIGRpc2tzCj4gNSBWTXMsIDMgTGludXgsIDIgV2luZG93cwo+IFRvdGFsIENQVSBs b2FkIG1vc3Qgb2YgdGhlIHRpbWUgaXMgIGxvdywgaGlnaCBsZXZlbCBvZiBhY3Rpdml0eSByZWxh dGVkIHRvPQogZGlzay4KPiBIb3N0IGVuZ2luZSB1bmRlciBLVk0gYXBwbGlhbmNlIG9uIFN1U0Us IGNhbiBiZSBlYXNpbHkgbW92ZWQsIGJhY2tlZCB1cCwgYz0Kb3BpZWQsIGV4cGVyaW1lbnRlZCB3 aXRoLCBldGMuCj49MjAKPiBZb3UnbGwgaGF2ZSB0byB1c2Ugc2VydmVycyB3aXRoIG1vcmUgUkFN IGFuZCBzdG9yYWdlIHRoYW4gbWFpbi4KPiBNb3JlIHRoZW4gb25lIE5JQyByZXF1aXJlZCBpZiBz b21lIG9mIHlvdXIgVk1zIGFyZSBvbiBkaWZmZXJlbnQgc3VibmV0cywgZT0KLmcuIDEgaW4gaW50 ZXJuYWwgem9uZSBhbmQgMm5kIG9uIERNWi4KPiBGb3IgeW91ciBzZXR1cCAxMCBHQiBOSUNzICsg TDMgU3dpdGNoIGZvciBvdmlydG1nbXQuCj49MjAKPiBCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBo YXZlIHNldmVyYWwgc2VwYXJhdGUgaGFyZHdhcmUgUkFJRHMgdW5sZXNzIHlvdSBoYT0KdmUgU1NE LCBvdGhlcndpc2UgbGltaXQgb2YgdGhlIGRpc2sgc3lzdGVtIEkvTyB3aWxsIGJlIGEgYm90dGxl bmVjay4gQ29uc2lkZT0KciBTU0QgTDEgUkFJRCBmb3IgaGVhdnktbG9hZGVkIGRhdGFiYXNlcy4K Pj0yMAo+IFBsZWFzZSBub3RlIG1hbnkgY2hlYXAgU1NEcyBkbyBOT1Qgd29yayByZWxpYWJseSB3 aXRoIFNBUyBjb250cm9sbGVycyBldmVuPQogaW4gU0FUQSBtb2RlLgo+PTIwCj4gRm9yIGV4YW1w bGUsIEkgc3VwcG9zZWQgdG8gdXNlIDIgeCBXRCBHcmVlbiBTU0QgY29uZmlndXJlcyBhcyBSQUlE IEwxIGZvciBPPQpTLj0yMAo+IEl0IHdhcyBwb3NzaWJsZSB0byBpbnN0YWxsIHN5c3RlbSwgeWV0 IHVuZGVyIGhlYXZ5IGxvYWQgc2ltdWxhdGVkIHdpdGggaW96PQpvbmUgZGlzayBzeXN0ZW0gZnJl ZXplLCByZW5kZXJpbmcgT1MgdW5ib290YWJsZS4KPiBTYW1lIGNyYXNoIHdhcyBleHBlcmllbmNl ZCB3aXRoIDUxMkdCIEtpbmdGYXN0IFNTRCBjb25uZWN0ZWQgdG8gYnJvYWRjb20vQT0KTUNDIFNB UyBSQUlEIENhcmQuCj49MjAKPj0yMAo+PiBPbiAwMy8yNC8yMDE4IDEwOjMzIEFNLCBBbmR5IE1p Y2hpZWxzZW4gd3JvdGU6Cj4+IEhpIGFsbCwKPj49MjAKPj4gTm90IHN1cmUgaWYgdGhpcyBpcyB0 aGUgcGxhY2UgdG8gYmUgYXNraW5nIHRoaXMgYnV0IEkgd2FzIHdvbmRlcmluZyB3aGljaD0KIGhh cmR3YXJlIHlvdSBhbGwgYXJlIHVzaW5nIGFuZCB3aHkgaW4gb3JkZXIgZm9yIG1lIHRvIHNlZSB3 aGF0IEkgd291bGQgYmUgbj0KZWVkaW5nLgo+Pj0yMAo+PiBJIHdvdWxkIGxpa2UgdG8gc2V0IHVw IGEgSEEgY2x1c3RlciBjb25zaXN0aW5nIG9mZiAzIGhvc3RzIHRvIGJlIGFibGUgdG8gcj0KdW4g MzAgdm09RTI9ODA9OTlzLgo+PiBUaGUgZW5naW5lLCBJIGNhbiBydW4gb24gYW4gb3RoZXIgc2Vy dmVyLiBUaGUgaG9zdHMgY2FuIGJlIGZpdHRlZCB3aXRoIHRoPQplIHN0b3JhZ2UgYW5kIHNoYXJl IHRoZSBzcGFjZSB0aHJvdWdoIGdsdXN0ZXJmcy4gSSB3b3VsZCB0aGluayBJIHdpbGwgYmUgbmVl PQpkaW5nIGF0IGxlYXN0IDMgbmljPUUyPTgwPTk5cyBidXQgd291bGQgYmUgYWJsZSB0byBpbnN0 YWxsIG92bi4gKEFyZSAxZ2IgbmljPQo9RTI9ODA9OTlzIHN1ZmZpY2llbnQgPykKPj49MjAKPj4g QW55IGlucHV0IHlvdSBndXlzIHdvdWxkIGxpa2UgdG8gc2hhcmUgd291bGQgYmUgZ3JlYXRseSBh cHByaWNpYXRlZC4KPj49MjAKPj4gVGhhbmtzLAo+PiBfX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwo+PiBVc2VycyBtYWlsaW5nIGxpc3QKPj4gVXNlcnNAb3Zp cnQub3JnCj4+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+ PTIwCgotLUFwcGxlLU1haWwtRkY0QkFENjctMkQ2Qi00RDM3LUI0REYtOTI4M0QzMzZCMUFGCkNv bnRlbnQtVHlwZTogdGV4dC9odG1sOwoJY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVu Y29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48aGVhZD48bWV0YSBodHRwLWVxdWl2PTNE ImNvbnRlbnQtdHlwZSIgY29udGVudD0zRCJ0ZXh0L2h0bWw7IGNoYXJzZXQ9M0Q9CnV0Zi04Ij48 L2hlYWQ+PGJvZHkgZGlyPTNEImF1dG8iPjxkaXY+PC9kaXY+PGRpdj5IZWxsbyBBbmRyZWksPC9k aXY+PGRpdj48YnI9Cj48L2Rpdj48ZGl2PlRoYW5rIHlvdSB2ZXJ5IG11Y2ggZm9yIHNoYXJpbmcg aW5mbyBvbiB5b3VyIGhhcmR3YXJlIHNldHVwLiBWZXI9CnkgaW5mb3JtYXRpdmUuPC9kaXY+PGRp dj48YnI+PC9kaXY+PGRpdj5BdCB0aGlzIG1vbWVudCBJIGhhdmUgbXkgb3ZpcnQgZW5naW49CmUg b24gb3VyIHZtd2FyZSBlbnZpcm9ubWVudCB3aGljaCBpcyBmaW5lIGZvciBnb29kIGJhY2t1cCBh bmQgcmVzdG9yZS48L2Rpdj49CjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBoYXZlIDQgbm9kZXMgcnVu bmluZyBub3cgYWxsIGRpZmZlcmVudCBpbiBtYWtlIGFuZCBtb2Q9CmVsIHdpdGggbG9jYWwgc3Rv cmFnZSBhbmQgaXQgd29ya3MgYnV0IGxhY2tzIHBlcmZvcm1hbmNlIGEgYml0LjwvZGl2PjxkaXY+ PGI9CnI+PC9kaXY+PGRpdj5CdXQgSSBjYW4gZ2V0IG15IGhhbmRzIG9uIHNvbWUgb2xkIGRlbGw9 RTI9ODA9OTlzIFI0MTUgd2l0aCA5NiBHPQpiIG9mIHJhbSBhbmQgMiBxdWFkY29yZXMgYW5kIDYg eCAxIEdiIG5pYz1FMj04MD05OXMuIFRoZXkgYWxsIGNvbWUgd2l0aCAyIHggMT0KNDYgR2IgMTUw MDAgcnBtPUUyPTgwPTk5cyBoYXJkZGlza3MuIFRoaXMgaXNuPUUyPTgwPTk5dCBiYWQgYnV0IEkg d2lsbCBhZGQgbT0Kb3JlIFJBTSBmb3Igc3RhcnRlcnMuIEFsc28gSSB3b3VsZCBsaWtlIHRvIGhh dmUgc29tZSBnb29kIHJlZHVuZGFudCBzdG9yYWdlIGY9Cm9yIHRoaXMgdG9vIGFuZCB0aGUgc2Vy dmVycyBoYXZlIGxpbWl0ZWQgc3BhY2UgdG8gYWRkIHRoYXQuPC9kaXY+PGRpdj48YnI+PC89CmRp dj48ZGl2PkhvcGVmdWxseSBvdGhlcnMgd2lsbCBhbHNvIHNoYXJlIHRoZXJlIHNldHVwcyBhbmQg ZXhwaXJpZW5jZSBsaWtlIHk9Cm91IGRpZC48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PktpbmQg cmVnYXJkcy48L2Rpdj48ZGl2Pjxicj5PbiAyNCBNYXIgMjAxOCw9CiBhdCAxMDozNSwgQW5kcmVp IFZlcm92c2tpICZsdDs8YSBocmVmPTNEIm1haWx0bzphbmRyZWlsMUBzdGFybGV0dC5sdiI+YW5k cmU9CmlsMUBzdGFybGV0dC5sdjwvYT4mZ3Q7IHdyb3RlOjxicj48YnI+PC9kaXY+PGJsb2NrcXVv dGUgdHlwZT0zRCJjaXRlIj48ZGl2PgogPTIwCiAgICA8bWV0YSBodHRwLWVxdWl2PTNEIkNvbnRl bnQtVHlwZSIgY29udGVudD0zRCJ0ZXh0L2h0bWw7IGNoYXJzZXQ9M0R1dGYtOCI9Cj4KID0yMAog PTIwCiAgICA8ZGl2IGNsYXNzPTNEIm1vei1jaXRlLXByZWZpeCI+SGksPGJyPgogICAgICA8YnI+ CiAgICAgIEhMIFByb0xpYW50IERMMzgwLCBkdWFsIFhlb248YnI+CiAgICAgIDEyMCBHQiBSQUlE IEwxIGZvciBzeXN0ZW08YnI+CiAgICAgIDIgVEIgUkFJRCBMMTAgZm9yIFZNIGRpc2tzPGJyPgog ICAgICA1IFZNcywgMyBMaW51eCwgMiBXaW5kb3dzPGJyPgogICAgICBUb3RhbCBDUFUgbG9hZCBt b3N0IG9mIHRoZSB0aW1lIGlzJm5ic3A7IGxvdywgaGlnaCBsZXZlbCBvZiBhY3Rpdml0eQogICAg ICByZWxhdGVkIHRvIGRpc2suPGJyPgogICAgICBIb3N0IGVuZ2luZSB1bmRlciBLVk0gYXBwbGlh bmNlIG9uIFN1U0UsIGNhbiBiZSBlYXNpbHkgbW92ZWQsCiAgICAgIGJhY2tlZCB1cCwgY29waWVk LCBleHBlcmltZW50ZWQgd2l0aCwgZXRjLjxicj4KICAgICAgPGJyPgogICAgICBZb3UnbGwgaGF2 ZSB0byB1c2Ugc2VydmVycyB3aXRoIG1vcmUgUkFNIGFuZCBzdG9yYWdlIHRoYW4gbWFpbi48YnI+ CiAgICAgIE1vcmUgdGhlbiBvbmUgTklDIHJlcXVpcmVkIGlmIHNvbWUgb2YgeW91ciBWTXMgYXJl IG9uIGRpZmZlcmVudAogICAgICBzdWJuZXRzLCBlLmcuIDEgaW4gaW50ZXJuYWwgem9uZSBhbmQg Mm5kIG9uIERNWi48YnI+CiAgICAgIEZvciB5b3VyIHNldHVwIDEwIEdCIE5JQ3MgKyBMMyBTd2l0 Y2ggZm9yIG92aXJ0bWdtdC48YnI+CiAgICAgIDxicj4KICAgICAgQlRXLCBJIHdvdWxkIHN1Z2dl c3QgdG8gaGF2ZSBzZXZlcmFsIHNlcGFyYXRlIGhhcmR3YXJlIFJBSURzCiAgICAgIHVubGVzcyB5 b3UgaGF2ZSBTU0QsIG90aGVyd2lzZSBsaW1pdCBvZiB0aGUgZGlzayBzeXN0ZW0gSS9PIHdpbGwK ICAgICAgYmUgYSBib3R0bGVuZWNrLiBDb25zaWRlciBTU0QgTDEgUkFJRCBmb3IgaGVhdnktbG9h ZGVkIGRhdGFiYXNlcy48YnI+CiAgICAgIDxicj4KICAgICAgPGZvbnQgY29sb3I9M0QiIzk5MDAw MCI+PGI+UGxlYXNlIG5vdGUgbWFueSBjaGVhcCBTU0RzIGRvIE5PVCB3b3JrCiAgICAgICAgICBy ZWxpYWJseSB3aXRoIFNBUyBjb250cm9sbGVycyBldmVuIGluIFNBVEEgbW9kZTwvYj4uPC9mb250 Pjxicj4KICAgICAgPGJyPgogICAgICBGb3IgZXhhbXBsZSwgSSBzdXBwb3NlZCB0byB1c2UgMiB4 IFdEIEdyZWVuIFNTRCBjb25maWd1cmVzIGFzIFJBSUQKICAgICAgTDEgZm9yIE9TLiA8YnI+CiAg ICAgIEl0IHdhcyBwb3NzaWJsZSB0byBpbnN0YWxsIHN5c3RlbSwgeWV0IHVuZGVyIGhlYXZ5IGxv YWQgc2ltdWxhdGVkCiAgICAgIHdpdGggaW96b25lIGRpc2sgc3lzdGVtIGZyZWV6ZSwgcmVuZGVy aW5nIE9TIHVuYm9vdGFibGUuPGJyPgogICAgICBTYW1lIGNyYXNoIHdhcyBleHBlcmllbmNlZCB3 aXRoIDUxMkdCIEtpbmdGYXN0IFNTRCBjb25uZWN0ZWQgdG8KICAgICAgYnJvYWRjb20vQU1DQyBT QVMgUkFJRCBDYXJkLjxicj4KICAgICAgPGJyPgogICAgICA8YnI+CiAgICAgIE9uIDAzLzI0LzIw MTggMTA6MzMgQU0sIEFuZHkgTWljaGllbHNlbiB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxi bG9ja3F1b3RlIHR5cGU9M0QiY2l0ZSIgY2l0ZT0zRCJtaWQ6ODE1OTg3QjUtMzFEQS00MzE2LTgw OUQtQTAzMzYzQTFFMz0KQzNAZ21haWwuY29tIj4KICAgICAgPHByZSB3cmFwPTNEIiI+SGkgYWxs LAoKTm90IHN1cmUgaWYgdGhpcyBpcyB0aGUgcGxhY2UgdG8gYmUgYXNraW5nIHRoaXMgYnV0IEkg d2FzIHdvbmRlcmluZyB3aGljaCBoYT0KcmR3YXJlIHlvdSBhbGwgYXJlIHVzaW5nIGFuZCB3aHkg aW4gb3JkZXIgZm9yIG1lIHRvIHNlZSB3aGF0IEkgd291bGQgYmUgbmVlZD0KaW5nLgoKSSB3b3Vs ZCBsaWtlIHRvIHNldCB1cCBhIEhBIGNsdXN0ZXIgY29uc2lzdGluZyBvZmYgMyBob3N0cyB0byBi ZSBhYmxlIHRvIHJ1bj0KIDMwIHZtPUUyPTgwPTk5cy4KVGhlIGVuZ2luZSwgSSBjYW4gcnVuIG9u IGFuIG90aGVyIHNlcnZlci4gVGhlIGhvc3RzIGNhbiBiZSBmaXR0ZWQgd2l0aCB0aGUgcz0KdG9y YWdlIGFuZCBzaGFyZSB0aGUgc3BhY2UgdGhyb3VnaCBnbHVzdGVyZnMuIEkgd291bGQgdGhpbmsg SSB3aWxsIGJlIG5lZWRpbj0KZyBhdCBsZWFzdCAzIG5pYz1FMj04MD05OXMgYnV0IHdvdWxkIGJl IGFibGUgdG8gaW5zdGFsbCBvdm4uIChBcmUgMWdiIG5pYz1FMj0KPTgwPTk5cyBzdWZmaWNpZW50 ID8pCgpBbnkgaW5wdXQgeW91IGd1eXMgd291bGQgbGlrZSB0byBzaGFyZSB3b3VsZCBiZSBncmVh dGx5IGFwcHJpY2lhdGVkLgoKVGhhbmtzLApfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgY2xhc3M9M0QibW96LXR4dC1s aW5rLWFiYnJldmlhdGVkIiBocmVmPTNEIm1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQD0K b3ZpcnQub3JnPC9hPgo8YSBjbGFzcz0zRCJtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9M0Qi aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpPQpzdGluZm8vdXNlcnMiPmh0dHA6Ly9s aXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT4KPC9wcmU+CiAgICA8L2Js b2NrcXVvdGU+CiAgICA8cD48YnI+CiAgICA8L3A+CiA9MjAKCjwvZGl2PjwvYmxvY2txdW90ZT48 L2JvZHk+PC9odG1sPj0KCi0tQXBwbGUtTWFpbC1GRjRCQUQ2Ny0yRDZCLTREMzctQjRERi05Mjgz RDMzNkIxQUYtLQo= --===============2854678982993873336==-- From rightkicktech at gmail.com Sat Mar 24 19:08:15 2018 Content-Type: multipart/mixed; boundary="===============3352712048651923860==" MIME-Version: 1.0 From: Alex K To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 24 Mar 2018 21:08:14 +0200 Message-ID: In-Reply-To: 1701ED12-9ED4-46B9-96E5-1FD3E32419DD@gmail.com --===============3352712048651923860== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable I have 2 or 3 node clusters with following hardware (all with self-hosted engine) : 2 node cluster: RAM: 64 GB per host CPU: 8 cores per host Storage: 4x 1TB SAS in RAID10 NIC: 2x Gbit VMs: 20 The above, although I would like to have had a third NIC for gluster storage redundancy, it is running smoothly for quite some time and without performance issues. The VMs it is running are not high on IO (mostly small Linux servers). 3 node clusters: RAM: 32 GB per host CPU: 16 cores per host Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage space without purchasing extra disks) NIC: 6x Gbit VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 10) For your setup (30 VMs) I would rather go with RAID10 SAS disks and at least a dual 10Gbit NIC dedicated to the gluster traffic only. Alex On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen wrote: > Hello Andrei, > > Thank you very much for sharing info on your hardware setup. Very > informative. > > At this moment I have my ovirt engine on our vmware environment which is > fine for good backup and restore. > > I have 4 nodes running now all different in make and model with local > storage and it works but lacks performance a bit. > > But I can get my hands on some old dell=E2=80=99s R415 with 96 Gb of ram = and 2 > quadcores and 6 x 1 Gb nic=E2=80=99s. They all come with 2 x 146 Gb 15000= rpm=E2=80=99s > harddisks. This isn=E2=80=99t bad but I will add more RAM for starters. A= lso I > would like to have some good redundant storage for this too and the serve= rs > have limited space to add that. > > Hopefully others will also share there setups and expirience like you did. > > Kind regards. > > On 24 Mar 2018, at 10:35, Andrei Verovski wrote: > > Hi, > > HL ProLiant DL380, dual Xeon > 120 GB RAID L1 for system > 2 TB RAID L10 for VM disks > 5 VMs, 3 Linux, 2 Windows > Total CPU load most of the time is low, high level of activity related to > disk. > Host engine under KVM appliance on SuSE, can be easily moved, backed up, > copied, experimented with, etc. > > You'll have to use servers with more RAM and storage than main. > More then one NIC required if some of your VMs are on different subnets, > e.g. 1 in internal zone and 2nd on DMZ. > For your setup 10 GB NICs + L3 Switch for ovirtmgmt. > > BTW, I would suggest to have several separate hardware RAIDs unless you > have SSD, otherwise limit of the disk system I/O will be a bottleneck. > Consider SSD L1 RAID for heavy-loaded databases. > > *Please note many cheap SSDs do NOT work reliably with SAS controllers > even in SATA mode*. > > For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for > OS. > It was possible to install system, yet under heavy load simulated with > iozone disk system freeze, rendering OS unbootable. > Same crash was experienced with 512GB KingFast SSD connected to > broadcom/AMCC SAS RAID Card. > > > On 03/24/2018 10:33 AM, Andy Michielsen wrote: > > Hi all, > > Not sure if this is the place to be asking this but I was wondering which= hardware you all are using and why in order for me to see what I would be = needing. > > I would like to set up a HA cluster consisting off 3 hosts to be able to = run 30 vm=E2=80=99s. > The engine, I can run on an other server. The hosts can be fitted with th= e storage and share the space through glusterfs. I would think I will be ne= eding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb n= ic=E2=80=99s sufficient ?) > > Any input you guys would like to share would be greatly appriciated. > > Thanks, > _______________________________________________ > Users mailing listUsers(a)ovirt.orghttp://lists.ovirt.org/mailman/listinf= o/users > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --===============3352712048651923860== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2PkkgaGF2ZSAyIG9yIDMgbm9kZSBjbHVzdGVycyB3aXRo IGZvbGxvd2luZyBoYXJkd2FyZSAoYWxsIHdpdGggc2VsZi1ob3N0ZWQgZW5naW5lKSA6IDxicj48 YnI+PC9kaXY+MiBub2RlIGNsdXN0ZXI6IDxicj5SQU06IDY0IEdCIHBlciBob3N0PGJyPjwvZGl2 PjxkaXY+Q1BVOiA4IGNvcmVzIHBlciBob3N0PGJyPjwvZGl2PjxkaXY+U3RvcmFnZTogNHggMVRC IFNBUyBpbiBSQUlEMTA8YnI+PC9kaXY+PGRpdj5OSUM6IDJ4IEdiaXQ8YnI+PC9kaXY+PGRpdj5W TXM6IDIwPGJyPjxicj48L2Rpdj48ZGl2PlRoZSBhYm92ZSwgYWx0aG91Z2ggSSB3b3VsZCBsaWtl IHRvIGhhdmUgaGFkIGEgdGhpcmQgTklDIGZvciBnbHVzdGVyIHN0b3JhZ2UgcmVkdW5kYW5jeSwg aXQgaXMgcnVubmluZyBzbW9vdGhseSBmb3IgcXVpdGUgc29tZSB0aW1lIGFuZCB3aXRob3V0IHBl cmZvcm1hbmNlIGlzc3Vlcy4gPGJyPjwvZGl2PjxkaXY+VGhlIFZNcyBpdCBpcyBydW5uaW5nIGFy ZSBub3QgaGlnaCBvbiBJTyAobW9zdGx5IHNtYWxsIExpbnV4IHNlcnZlcnMpLiA8YnI+PGJyPjwv ZGl2PjxkaXY+MyBub2RlIGNsdXN0ZXJzOiA8YnI+PC9kaXY+PGRpdj5SQU06IDMyIEdCIHBlciBo b3N0PGJyPjwvZGl2PjxkaXY+Q1BVOiAxNiBjb3JlcyBwZXIgaG9zdDxicj48L2Rpdj48ZGl2PlN0 b3JhZ2U6IDV4IDYwMEdCIGluIFJBSUQ1IChub3QgaWRlYWwgYnV0IEkgaGFkIHRvIGdhaW4gc29t ZSBzdG9yYWdlIHNwYWNlIHdpdGhvdXQgcHVyY2hhc2luZyBleHRyYSBkaXNrcyk8YnI+PC9kaXY+ PGRpdj5OSUM6IDZ4IEdiaXQ8YnI+PC9kaXY+PGRpdj5WTXM6IGxlc3MgdGhlbiAxMCBsYXJnZSBX aW5kb3dzIFZNcyAoV2luZG93cyAyMDE2IHNlcnZlciBhbmQgV2luZG93cyAxMCk8YnI+PGJyPjwv ZGl2PjxkaXY+Rm9yIHlvdXIgc2V0dXAgKDMwIFZNcykgSSB3b3VsZCByYXRoZXIgZ28gd2l0aCBS QUlEMTAgU0FTIGRpc2tzIGFuZCBhdCBsZWFzdCBhIGR1YWwgMTBHYml0IE5JQyBkZWRpY2F0ZWQg dG8gdGhlIGdsdXN0ZXIgdHJhZmZpYyBvbmx5LiA8YnI+PGJyPjwvZGl2PjxkaXY+QWxleDxicj48 L2Rpdj48YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj48ZGl2IGNsYXNzPSJn bWFpbF9xdW90ZSI+T24gU2F0LCBNYXIgMjQsIDIwMTggYXQgMToyNCBQTSwgQW5keSBNaWNoaWVs c2VuIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmFuZHkubWljaGllbHNlbkBn bWFpbC5jb20iIHRhcmdldD0iX2JsYW5rIj5hbmR5Lm1pY2hpZWxzZW5AZ21haWwuY29tPC9hPiZn dDs8L3NwYW4+IHdyb3RlOjxicj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxl PSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxl ZnQ6MWV4Ij48ZGl2IGRpcj0iYXV0byI+PGRpdj48L2Rpdj48ZGl2PkhlbGxvIEFuZHJlaSw8L2Rp dj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rIHlvdSB2ZXJ5IG11Y2ggZm9yIHNoYXJpbmcgaW5m byBvbiB5b3VyIGhhcmR3YXJlIHNldHVwLiBWZXJ5IGluZm9ybWF0aXZlLjwvZGl2PjxkaXY+PGJy PjwvZGl2PjxkaXY+QXQgdGhpcyBtb21lbnQgSSBoYXZlIG15IG92aXJ0IGVuZ2luZSBvbiBvdXIg dm13YXJlIGVudmlyb25tZW50IHdoaWNoIGlzIGZpbmUgZm9yIGdvb2QgYmFja3VwIGFuZCByZXN0 b3JlLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBoYXZlIDQgbm9kZXMgcnVubmluZyBub3cg YWxsIGRpZmZlcmVudCBpbiBtYWtlIGFuZCBtb2RlbCB3aXRoIGxvY2FsIHN0b3JhZ2UgYW5kIGl0 IHdvcmtzIGJ1dCBsYWNrcyBwZXJmb3JtYW5jZSBhIGJpdC48L2Rpdj48ZGl2Pjxicj48L2Rpdj48 ZGl2PkJ1dCBJIGNhbiBnZXQgbXkgaGFuZHMgb24gc29tZSBvbGQgZGVsbOKAmXMgUjQxNSB3aXRo IDk2IEdiIG9mIHJhbSBhbmQgMiBxdWFkY29yZXMgYW5kIDYgeCAxIEdiIG5pY+KAmXMuIFRoZXkg YWxsIGNvbWUgd2l0aCAyIHggMTQ2IEdiIDE1MDAwIHJwbeKAmXMgaGFyZGRpc2tzLiBUaGlzIGlz buKAmXQgYmFkIGJ1dCBJIHdpbGwgYWRkIG1vcmUgUkFNIGZvciBzdGFydGVycy4gQWxzbyBJIHdv dWxkIGxpa2UgdG8gaGF2ZSBzb21lIGdvb2QgcmVkdW5kYW50IHN0b3JhZ2UgZm9yIHRoaXMgdG9v IGFuZCB0aGUgc2VydmVycyBoYXZlIGxpbWl0ZWQgc3BhY2UgdG8gYWRkIHRoYXQuPC9kaXY+PGRp dj48YnI+PC9kaXY+PGRpdj5Ib3BlZnVsbHkgb3RoZXJzIHdpbGwgYWxzbyBzaGFyZSB0aGVyZSBz ZXR1cHMgYW5kIGV4cGlyaWVuY2UgbGlrZSB5b3UgZGlkLjwvZGl2PjxkaXY+PGJyPjwvZGl2Pjxk aXY+S2luZCByZWdhcmRzLjwvZGl2PjxkaXY+PGRpdiBjbGFzcz0iaDUiPjxkaXY+PGJyPk9uIDI0 IE1hciAyMDE4LCBhdCAxMDozNSwgQW5kcmVpIFZlcm92c2tpICZsdDs8YSBocmVmPSJtYWlsdG86 YW5kcmVpbDFAc3RhcmxldHQubHYiIHRhcmdldD0iX2JsYW5rIj5hbmRyZWlsMUBzdGFybGV0dC5s djwvYT4mZ3Q7IHdyb3RlOjxicj48YnI+PC9kaXY+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGRp dj4KICAKICAgIAogIAogIAogICAgPGRpdiBjbGFzcz0ibV8yNDkwNDcyOTc4NzIxNjk2MzQxbW96 LWNpdGUtcHJlZml4Ij5IaSw8YnI+CiAgICAgIDxicj4KICAgICAgSEwgUHJvTGlhbnQgREwzODAs IGR1YWwgWGVvbjxicj4KICAgICAgMTIwIEdCIFJBSUQgTDEgZm9yIHN5c3RlbTxicj4KICAgICAg MiBUQiBSQUlEIEwxMCBmb3IgVk0gZGlza3M8YnI+CiAgICAgIDUgVk1zLCAzIExpbnV4LCAyIFdp bmRvd3M8YnI+CiAgICAgIFRvdGFsIENQVSBsb2FkIG1vc3Qgb2YgdGhlIHRpbWUgaXPCoCBsb3cs IGhpZ2ggbGV2ZWwgb2YgYWN0aXZpdHkKICAgICAgcmVsYXRlZCB0byBkaXNrLjxicj4KICAgICAg SG9zdCBlbmdpbmUgdW5kZXIgS1ZNIGFwcGxpYW5jZSBvbiBTdVNFLCBjYW4gYmUgZWFzaWx5IG1v dmVkLAogICAgICBiYWNrZWQgdXAsIGNvcGllZCwgZXhwZXJpbWVudGVkIHdpdGgsIGV0Yy48YnI+ CiAgICAgIDxicj4KICAgICAgWW91JiMzOTtsbCBoYXZlIHRvIHVzZSBzZXJ2ZXJzIHdpdGggbW9y ZSBSQU0gYW5kIHN0b3JhZ2UgdGhhbiBtYWluLjxicj4KICAgICAgTW9yZSB0aGVuIG9uZSBOSUMg cmVxdWlyZWQgaWYgc29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlmZmVyZW50CiAgICAgIHN1Ym5l dHMsIGUuZy4gMSBpbiBpbnRlcm5hbCB6b25lIGFuZCAybmQgb24gRE1aLjxicj4KICAgICAgRm9y IHlvdXIgc2V0dXAgMTAgR0IgTklDcyArIEwzIFN3aXRjaCBmb3Igb3ZpcnRtZ210Ljxicj4KICAg ICAgPGJyPgogICAgICBCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBoYXZlIHNldmVyYWwgc2VwYXJh dGUgaGFyZHdhcmUgUkFJRHMKICAgICAgdW5sZXNzIHlvdSBoYXZlIFNTRCwgb3RoZXJ3aXNlIGxp bWl0IG9mIHRoZSBkaXNrIHN5c3RlbSBJL08gd2lsbAogICAgICBiZSBhIGJvdHRsZW5lY2suIENv bnNpZGVyIFNTRCBMMSBSQUlEIGZvciBoZWF2eS1sb2FkZWQgZGF0YWJhc2VzLjxicj4KICAgICAg PGJyPgogICAgICA8Zm9udCBjb2xvcj0iIzk5MDAwMCI+PGI+UGxlYXNlIG5vdGUgbWFueSBjaGVh cCBTU0RzIGRvIE5PVCB3b3JrCiAgICAgICAgICByZWxpYWJseSB3aXRoIFNBUyBjb250cm9sbGVy cyBldmVuIGluIFNBVEEgbW9kZTwvYj4uPC9mb250Pjxicj4KICAgICAgPGJyPgogICAgICBGb3Ig ZXhhbXBsZSwgSSBzdXBwb3NlZCB0byB1c2UgMiB4IFdEIEdyZWVuIFNTRCBjb25maWd1cmVzIGFz IFJBSUQKICAgICAgTDEgZm9yIE9TLiA8YnI+CiAgICAgIEl0IHdhcyBwb3NzaWJsZSB0byBpbnN0 YWxsIHN5c3RlbSwgeWV0IHVuZGVyIGhlYXZ5IGxvYWQgc2ltdWxhdGVkCiAgICAgIHdpdGggaW96 b25lIGRpc2sgc3lzdGVtIGZyZWV6ZSwgcmVuZGVyaW5nIE9TIHVuYm9vdGFibGUuPGJyPgogICAg ICBTYW1lIGNyYXNoIHdhcyBleHBlcmllbmNlZCB3aXRoIDUxMkdCIEtpbmdGYXN0IFNTRCBjb25u ZWN0ZWQgdG8KICAgICAgYnJvYWRjb20vQU1DQyBTQVMgUkFJRCBDYXJkLjxicj4KICAgICAgPGJy PgogICAgICA8YnI+CiAgICAgIE9uIDAzLzI0LzIwMTggMTA6MzMgQU0sIEFuZHkgTWljaGllbHNl biB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPgogICAg ICA8cHJlPkhpIGFsbCwKCk5vdCBzdXJlIGlmIHRoaXMgaXMgdGhlIHBsYWNlIHRvIGJlIGFza2lu ZyB0aGlzIGJ1dCBJIHdhcyB3b25kZXJpbmcgd2hpY2ggaGFyZHdhcmUgeW91IGFsbCBhcmUgdXNp bmcgYW5kIHdoeSBpbiBvcmRlciBmb3IgbWUgdG8gc2VlIHdoYXQgSSB3b3VsZCBiZSBuZWVkaW5n LgoKSSB3b3VsZCBsaWtlIHRvIHNldCB1cCBhIEhBIGNsdXN0ZXIgY29uc2lzdGluZyBvZmYgMyBo b3N0cyB0byBiZSBhYmxlIHRvIHJ1biAzMCB2beKAmXMuClRoZSBlbmdpbmUsIEkgY2FuIHJ1biBv biBhbiBvdGhlciBzZXJ2ZXIuIFRoZSBob3N0cyBjYW4gYmUgZml0dGVkIHdpdGggdGhlIHN0b3Jh Z2UgYW5kIHNoYXJlIHRoZSBzcGFjZSB0aHJvdWdoIGdsdXN0ZXJmcy4gSSB3b3VsZCB0aGluayBJ IHdpbGwgYmUgbmVlZGluZyBhdCBsZWFzdCAzIG5pY+KAmXMgYnV0IHdvdWxkIGJlIGFibGUgdG8g aW5zdGFsbCBvdm4uIChBcmUgMWdiIG5pY+KAmXMgc3VmZmljaWVudCA/KQoKQW55IGlucHV0IHlv dSBndXlzIHdvdWxkIGxpa2UgdG8gc2hhcmUgd291bGQgYmUgZ3JlYXRseSBhcHByaWNpYXRlZC4K ClRoYW5rcywKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19f X19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgY2xhc3M9Im1fMjQ5MDQ3Mjk3ODcyMTY5NjM0MW1v ei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFy Z2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9Im1fMjQ5MDQ3Mjk3ODcy MTY5NjM0MW1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9y Zy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92 aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9ibG9j a3F1b3RlPgogICAgPHA+PGJyPgogICAgPC9wPgogIAoKPC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2 PjwvZGl2PjwvZGl2Pjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188d2JyPl9fX19f X19fX19fX19fX19fPGJyPgpVc2VycyBtYWlsaW5nIGxpc3Q8YnI+CjxhIGhyZWY9Im1haWx0bzpV c2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+CjxhIGhyZWY9Imh0dHA6Ly9s aXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyIgcmVsPSJub3JlZmVycmVyIiB0 YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGlu Zm8vdXNlcnM8L2E+PGJyPgo8YnI+PC9ibG9ja3F1b3RlPjwvZGl2Pjxicj48L2Rpdj4K --===============3352712048651923860==-- From andy.michielsen at gmail.com Sun Mar 25 07:36:26 2018 Content-Type: multipart/mixed; boundary="===============0496491940207711674==" MIME-Version: 1.0 From: Andy Michielsen To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sun, 25 Mar 2018 09:36:22 +0200 Message-ID: <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E@gmail.com> In-Reply-To: CABMULtKPvZRDRkByH3WyXbZQHuSZY4o7=hNwNqvRDsV=+6yjtg@mail.gmail.com --===============0496491940207711674== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --Apple-Mail-B8EBE151-6DD4-4679-A889-96283D26D5BF Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hello Alex, Thanks for sharing. Much appriciated. I believe my setup would need 96 Gb off RAM in each host, and would need ab= o=3D ut at least 3 Tb of storage. Probably 4 Tb would be beter if I want to work= w=3D ith snapshots. (Will be running mostly windows 2016 servers or windows 10 d= e=3D sktops with 6Gb off RAM and 100 Gb of disks) I agree that a 10 Gb network for storage would be very beneficial. Now If I can figure out how to set up a glusterfs on a 3 node cluster in oV= i=3D rt 4.2 just for the data storage. I =3DE2=3D80=3D98m golden to get started.= :-) Kind regards. > On 24 Mar 2018, at 20:08, Alex K wrote: >=3D20 > I have 2 or 3 node clusters with following hardware (all with self-hosted= e=3D ngine) :=3D20 >=3D20 > 2 node cluster:=3D20 > RAM: 64 GB per host > CPU: 8 cores per host > Storage: 4x 1TB SAS in RAID10 > NIC: 2x Gbit > VMs: 20 >=3D20 > The above, although I would like to have had a third NIC for gluster stor= a=3D ge redundancy, it is running smoothly for quite some time and without perfo= r=3D mance issues.=3D20 > The VMs it is running are not high on IO (mostly small Linux servers).=3D= 20 >=3D20 > 3 node clusters:=3D20 > RAM: 32 GB per host > CPU: 16 cores per host > Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage spac= e=3D without purchasing extra disks) > NIC: 6x Gbit > VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 10) >=3D20 > For your setup (30 VMs) I would rather go with RAID10 SAS disks and at le= a=3D st a dual 10Gbit NIC dedicated to the gluster traffic only.=3D20 >=3D20 > Alex >=3D20 >=3D20 >> On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen wrote: >> Hello Andrei, >>=3D20 >> Thank you very much for sharing info on your hardware setup. Very inform= a=3D tive. >>=3D20 >> At this moment I have my ovirt engine on our vmware environment which is= f=3D ine for good backup and restore. >>=3D20 >> I have 4 nodes running now all different in make and model with local st= o=3D rage and it works but lacks performance a bit. >>=3D20 >> But I can get my hands on some old dell=3DE2=3D80=3D99s R415 with 96 Gb = of ram a=3D nd 2 quadcores and 6 x 1 Gb nic=3DE2=3D80=3D99s. They all come with 2 x 146= Gb 150=3D 00 rpm=3DE2=3D80=3D99s harddisks. This isn=3DE2=3D80=3D99t bad but I will a= dd more RAM f=3D or starters. Also I would like to have some good redundant storage for this= t=3D oo and the servers have limited space to add that. >>=3D20 >> Hopefully others will also share there setups and expirience like you di= d=3D . >>=3D20 >> Kind regards. >>=3D20 >>> On 24 Mar 2018, at 10:35, Andrei Verovski wrot= e: >>>=3D20 >>> Hi, >>>=3D20 >>> HL ProLiant DL380, dual Xeon >>> 120 GB RAID L1 for system >>> 2 TB RAID L10 for VM disks >>> 5 VMs, 3 Linux, 2 Windows >>> Total CPU load most of the time is low, high level of activity related= t=3D o disk. >>> Host engine under KVM appliance on SuSE, can be easily moved, backed up= ,=3D copied, experimented with, etc. >>>=3D20 >>> You'll have to use servers with more RAM and storage than main. >>> More then one NIC required if some of your VMs are on different subnets= ,=3D e.g. 1 in internal zone and 2nd on DMZ. >>> For your setup 10 GB NICs + L3 Switch for ovirtmgmt. >>>=3D20 >>> BTW, I would suggest to have several separate hardware RAIDs unless you= h=3D ave SSD, otherwise limit of the disk system I/O will be a bottleneck. Consi= d=3D er SSD L1 RAID for heavy-loaded databases. >>>=3D20 >>> Please note many cheap SSDs do NOT work reliably with SAS controllers e= v=3D en in SATA mode. >>>=3D20 >>> For example, I supposed to use 2 x WD Green SSD configures as RAID L1 f= o=3D r OS.=3D20 >>> It was possible to install system, yet under heavy load simulated with = i=3D ozone disk system freeze, rendering OS unbootable. >>> Same crash was experienced with 512GB KingFast SSD connected to broadco= m=3D /AMCC SAS RAID Card. >>>=3D20 >>>=3D20 >>>> On 03/24/2018 10:33 AM, Andy Michielsen wrote: >>>> Hi all, >>>>=3D20 >>>> Not sure if this is the place to be asking this but I was wondering wh= i=3D ch hardware you all are using and why in order for me to see what I would b= e=3D needing. >>>>=3D20 >>>> I would like to set up a HA cluster consisting off 3 hosts to be able = t=3D o run 30 vm=3DE2=3D80=3D99s. >>>> The engine, I can run on an other server. The hosts can be fitted with= t=3D he storage and share the space through glusterfs. I would think I will be n= e=3D eding at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. (Are= 1gb ni=3D c=3DE2=3D80=3D99s sufficient ?) >>>>=3D20 >>>> Any input you guys would like to share would be greatly appriciated. >>>>=3D20 >>>> Thanks, >>>> _______________________________________________ >>>> Users mailing list >>>> Users(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>=3D20 >>=3D20 >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >>=3D20 >=3D20 --Apple-Mail-B8EBE151-6DD4-4679-A889-96283D26D5BF Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hello Alex,
<=3D /div>
Thanks for sharing. Much appriciated.

I = b=3D elieve my setup would need 96 Gb off RAM in each host, and would need about= a=3D t least 3 Tb of storage. Probably 4 Tb would be beter if I want to work wit= h=3D snapshots. (Will be running mostly windows 2016 servers or windows 10 desk= t=3D ops with 6Gb off RAM and 100 Gb of disks)

I agree = t=3D hat a 10 Gb network for storage would be very beneficial.

Now If I can figure out how to set up a glusterfs on a 3 node cluste= r=3D in oVirt 4.2 just for the data storage. I =3DE2=3D80=3D98m golden to get s= tarted.=3D :-)

Kind regards.

On 24 Mar 2018, a= t=3D 20:08, Alex K <rightkick= tech@=3D gmail.com> wrote:

I have 2 or 3 node clusters with following hardware (= all=3D with self-hosted engine) :

2 node cluster:
RAM: 64 GB pe= r=3D host
CPU: 8 cores per host
Storage: 4x 1TB SAS= i=3D n RAID10
NIC: 2x Gbit
VMs: 20

=3D The above, although I would like to have had a third NIC for gluster storag= e=3D redundancy, it is running smoothly for quite some time and without perform= a=3D nce issues.
The VMs it is running are not high on IO (mostly= s=3D mall Linux servers).

3 node clusters:
RAM= :=3D 32 GB per host
CPU: 16 cores per host
Storage:= 5=3D x 600GB in RAID5 (not ideal but I had to gain some storage space without pu= r=3D chasing extra disks)
NIC: 6x Gbit
VMs: less the= n=3D 10 large Windows VMs (Windows 2016 server and Windows 10)

For your setup (30 VMs) I would rather go with RAID10 SAS disks and at lea= s=3D t a dual 10Gbit NIC dedicated to the gluster traffic only.

Alex


On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen &=3D lt;and= y.michi=3D elsen(a)gmail.com> wrote:
Hello Andrei,

Thank = you=3D very much for sharing info on your hardware setup. Very informative.
= <=3D div>
At this moment I have my ovirt engine on our vmware envi= r=3D onment which is fine for good backup and restore.

= I=3D have 4 nodes running now all different in make and model with local storag= e=3D and it works but lacks performance a bit.

But I c= a=3D n get my hands on some old dell=3DE2=3D80=3D99s R415 with 96 Gb of ram and = 2 quadc=3D ores and 6 x 1 Gb nic=3DE2=3D80=3D99s. They all come with 2 x 146 Gb 15000 = rpm=3DE2=3D80=3D =3D99s harddisks. This isn=3DE2=3D80=3D99t bad but I will add more RAM for = starters.=3D Also I would like to have some good redundant storage for this too and the= s=3D ervers have limited space to add that.

Hopefully o= t=3D hers will also share there setups and expirience like you did.
Kind regards.

On 24 Mar = 201=3D 8, at 10:35, Andrei Verovski <andreil1(a)starlett.lv> wrote:

=3D20 =3D20 =3D20 =3D20
Hi,

HL ProLiant DL380, dual Xeon
120 GB RAID L1 for system
2 TB RAID L10 for VM disks
5 VMs, 3 Linux, 2 Windows
Total CPU load most of the time is  low, high level of activity related to disk.
Host engine under KVM appliance on SuSE, can be easily moved, backed up, copied, experimented with, etc.

You'll have to use servers with more RAM and storage than main.
More then one NIC required if some of your VMs are on different subnets, e.g. 1 in internal zone and 2nd on DMZ.
For your setup 10 GB NICs + L3 Switch for ovirtmgmt.

BTW, I would suggest to have several separate hardware RAIDs unless you have SSD, otherwise limit of the disk system I/O will be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.

Please note many cheap SSDs do NOT work reliably with SAS controllers even in SATA mode.

For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for OS.
It was possible to install system, yet under heavy load simulated with iozone disk system freeze, rendering OS unbootable.
Same crash was experienced with 512GB KingFast SSD connected to broadcom/AMCC SAS RAID Card.


On 03/24/2018 10:33 AM, Andy Michielsen wrote:
Hi all,

Not sure if this is the place to be asking this but I was wondering which h=
a=3D
rdware you all are using and why in order for me to see what I would be nee=
d=3D
ing.

I would like to set up a HA cluster consisting off 3 hosts to be able to ru=
n=3D
 30 vm=3DE2=3D80=3D99s.
The engine, I can run on an other server. The hosts can be fitted with the =
s=3D
torage and share the space through glusterfs. I would think I will be needi=
n=3D
g at least 3 nic=3DE2=3D80=3D99s but would be able to install ovn. (Are 1gb=
 nic=3DE2=3D
=3D80=3D99s sufficient ?)

Any input you guys would like to share would be greatly appriciated.

Thanks,
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.o=
rg/=3D
mailman/listinfo/users


=3D20

______________________________=3D _________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users=

=3D --Apple-Mail-B8EBE151-6DD4-4679-A889-96283D26D5BF-- --===============0496491940207711674== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" Ci0tQXBwbGUtTWFpbC1COEVCRTE1MS02REQ0LTQ2NzktQTg4OS05NjI4M0QyNkQ1QkYKQ29udGVu dC1UeXBlOiB0ZXh0L3BsYWluOwoJY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29k aW5nOiBxdW90ZWQtcHJpbnRhYmxlCgpIZWxsbyBBbGV4LAoKVGhhbmtzIGZvciBzaGFyaW5nLiBN dWNoIGFwcHJpY2lhdGVkLgoKSSBiZWxpZXZlIG15IHNldHVwIHdvdWxkIG5lZWQgOTYgR2Igb2Zm IFJBTSBpbiBlYWNoIGhvc3QsIGFuZCB3b3VsZCBuZWVkIGFibz0KdXQgYXQgbGVhc3QgMyBUYiBv ZiBzdG9yYWdlLiBQcm9iYWJseSA0IFRiIHdvdWxkIGJlIGJldGVyIGlmIEkgd2FudCB0byB3b3Jr IHc9Cml0aCBzbmFwc2hvdHMuIChXaWxsIGJlIHJ1bm5pbmcgbW9zdGx5IHdpbmRvd3MgMjAxNiBz ZXJ2ZXJzIG9yIHdpbmRvd3MgMTAgZGU9CnNrdG9wcyB3aXRoIDZHYiBvZmYgUkFNIGFuZCAxMDAg R2Igb2YgZGlza3MpCgpJIGFncmVlIHRoYXQgYSAxMCBHYiBuZXR3b3JrIGZvciBzdG9yYWdlIHdv dWxkIGJlIHZlcnkgYmVuZWZpY2lhbC4KCk5vdyBJZiBJIGNhbiBmaWd1cmUgb3V0IGhvdyB0byBz ZXQgdXAgYSBnbHVzdGVyZnMgb24gYSAzIG5vZGUgY2x1c3RlciBpbiBvVmk9CnJ0IDQuMiBqdXN0 IGZvciB0aGUgZGF0YSBzdG9yYWdlLiBJID1FMj04MD05OG0gZ29sZGVuIHRvIGdldCBzdGFydGVk LiA6LSkKCktpbmQgcmVnYXJkcy4KCj4gT24gMjQgTWFyIDIwMTgsIGF0IDIwOjA4LCBBbGV4IEsg PHJpZ2h0a2lja3RlY2hAZ21haWwuY29tPiB3cm90ZToKPj0yMAo+IEkgaGF2ZSAyIG9yIDMgbm9k ZSBjbHVzdGVycyB3aXRoIGZvbGxvd2luZyBoYXJkd2FyZSAoYWxsIHdpdGggc2VsZi1ob3N0ZWQg ZT0KbmdpbmUpIDo9MjAKPj0yMAo+IDIgbm9kZSBjbHVzdGVyOj0yMAo+IFJBTTogNjQgR0IgcGVy IGhvc3QKPiBDUFU6IDggY29yZXMgcGVyIGhvc3QKPiBTdG9yYWdlOiA0eCAxVEIgU0FTIGluIFJB SUQxMAo+IE5JQzogMnggR2JpdAo+IFZNczogMjAKPj0yMAo+IFRoZSBhYm92ZSwgYWx0aG91Z2gg SSB3b3VsZCBsaWtlIHRvIGhhdmUgaGFkIGEgdGhpcmQgTklDIGZvciBnbHVzdGVyIHN0b3JhPQpn ZSByZWR1bmRhbmN5LCBpdCBpcyBydW5uaW5nIHNtb290aGx5IGZvciBxdWl0ZSBzb21lIHRpbWUg YW5kIHdpdGhvdXQgcGVyZm9yPQptYW5jZSBpc3N1ZXMuPTIwCj4gVGhlIFZNcyBpdCBpcyBydW5u aW5nIGFyZSBub3QgaGlnaCBvbiBJTyAobW9zdGx5IHNtYWxsIExpbnV4IHNlcnZlcnMpLj0yMAo+ PTIwCj4gMyBub2RlIGNsdXN0ZXJzOj0yMAo+IFJBTTogMzIgR0IgcGVyIGhvc3QKPiBDUFU6IDE2 IGNvcmVzIHBlciBob3N0Cj4gU3RvcmFnZTogNXggNjAwR0IgaW4gUkFJRDUgKG5vdCBpZGVhbCBi dXQgSSBoYWQgdG8gZ2FpbiBzb21lIHN0b3JhZ2Ugc3BhY2U9CiB3aXRob3V0IHB1cmNoYXNpbmcg ZXh0cmEgZGlza3MpCj4gTklDOiA2eCBHYml0Cj4gVk1zOiBsZXNzIHRoZW4gMTAgbGFyZ2UgV2lu ZG93cyBWTXMgKFdpbmRvd3MgMjAxNiBzZXJ2ZXIgYW5kIFdpbmRvd3MgMTApCj49MjAKPiBGb3Ig eW91ciBzZXR1cCAoMzAgVk1zKSBJIHdvdWxkIHJhdGhlciBnbyB3aXRoIFJBSUQxMCBTQVMgZGlz a3MgYW5kIGF0IGxlYT0Kc3QgYSBkdWFsIDEwR2JpdCBOSUMgZGVkaWNhdGVkIHRvIHRoZSBnbHVz dGVyIHRyYWZmaWMgb25seS49MjAKPj0yMAo+IEFsZXgKPj0yMAo+PTIwCj4+IE9uIFNhdCwgTWFy IDI0LCAyMDE4IGF0IDE6MjQgUE0sIEFuZHkgTWljaGllbHNlbiA8YW5keS5taWNoaWVsc2VuQGdt YWlsLmM9Cm9tPiB3cm90ZToKPj4gSGVsbG8gQW5kcmVpLAo+Pj0yMAo+PiBUaGFuayB5b3UgdmVy eSBtdWNoIGZvciBzaGFyaW5nIGluZm8gb24geW91ciBoYXJkd2FyZSBzZXR1cC4gVmVyeSBpbmZv cm1hPQp0aXZlLgo+Pj0yMAo+PiBBdCB0aGlzIG1vbWVudCBJIGhhdmUgbXkgb3ZpcnQgZW5naW5l IG9uIG91ciB2bXdhcmUgZW52aXJvbm1lbnQgd2hpY2ggaXMgZj0KaW5lIGZvciBnb29kIGJhY2t1 cCBhbmQgcmVzdG9yZS4KPj49MjAKPj4gSSBoYXZlIDQgbm9kZXMgcnVubmluZyBub3cgYWxsIGRp ZmZlcmVudCBpbiBtYWtlIGFuZCBtb2RlbCB3aXRoIGxvY2FsIHN0bz0KcmFnZSBhbmQgaXQgd29y a3MgYnV0IGxhY2tzIHBlcmZvcm1hbmNlIGEgYml0Lgo+Pj0yMAo+PiBCdXQgSSBjYW4gZ2V0IG15 IGhhbmRzIG9uIHNvbWUgb2xkIGRlbGw9RTI9ODA9OTlzIFI0MTUgd2l0aCA5NiBHYiBvZiByYW0g YT0KbmQgMiBxdWFkY29yZXMgYW5kIDYgeCAxIEdiIG5pYz1FMj04MD05OXMuIFRoZXkgYWxsIGNv bWUgd2l0aCAyIHggMTQ2IEdiIDE1MD0KMDAgcnBtPUUyPTgwPTk5cyBoYXJkZGlza3MuIFRoaXMg aXNuPUUyPTgwPTk5dCBiYWQgYnV0IEkgd2lsbCBhZGQgbW9yZSBSQU0gZj0Kb3Igc3RhcnRlcnMu IEFsc28gSSB3b3VsZCBsaWtlIHRvIGhhdmUgc29tZSBnb29kIHJlZHVuZGFudCBzdG9yYWdlIGZv ciB0aGlzIHQ9Cm9vIGFuZCB0aGUgc2VydmVycyBoYXZlIGxpbWl0ZWQgc3BhY2UgdG8gYWRkIHRo YXQuCj4+PTIwCj4+IEhvcGVmdWxseSBvdGhlcnMgd2lsbCBhbHNvIHNoYXJlIHRoZXJlIHNldHVw cyBhbmQgZXhwaXJpZW5jZSBsaWtlIHlvdSBkaWQ9Ci4KPj49MjAKPj4gS2luZCByZWdhcmRzLgo+ Pj0yMAo+Pj4gT24gMjQgTWFyIDIwMTgsIGF0IDEwOjM1LCBBbmRyZWkgVmVyb3Zza2kgPGFuZHJl aWwxQHN0YXJsZXR0Lmx2PiB3cm90ZToKPj4+PTIwCj4+PiBIaSwKPj4+PTIwCj4+PiBITCBQcm9M aWFudCBETDM4MCwgZHVhbCBYZW9uCj4+PiAxMjAgR0IgUkFJRCBMMSBmb3Igc3lzdGVtCj4+PiAy IFRCIFJBSUQgTDEwIGZvciBWTSBkaXNrcwo+Pj4gNSBWTXMsIDMgTGludXgsIDIgV2luZG93cwo+ Pj4gVG90YWwgQ1BVIGxvYWQgbW9zdCBvZiB0aGUgdGltZSBpcyAgbG93LCBoaWdoIGxldmVsIG9m IGFjdGl2aXR5IHJlbGF0ZWQgdD0KbyBkaXNrLgo+Pj4gSG9zdCBlbmdpbmUgdW5kZXIgS1ZNIGFw cGxpYW5jZSBvbiBTdVNFLCBjYW4gYmUgZWFzaWx5IG1vdmVkLCBiYWNrZWQgdXAsPQogY29waWVk LCBleHBlcmltZW50ZWQgd2l0aCwgZXRjLgo+Pj49MjAKPj4+IFlvdSdsbCBoYXZlIHRvIHVzZSBz ZXJ2ZXJzIHdpdGggbW9yZSBSQU0gYW5kIHN0b3JhZ2UgdGhhbiBtYWluLgo+Pj4gTW9yZSB0aGVu IG9uZSBOSUMgcmVxdWlyZWQgaWYgc29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlmZmVyZW50IHN1 Ym5ldHMsPQogZS5nLiAxIGluIGludGVybmFsIHpvbmUgYW5kIDJuZCBvbiBETVouCj4+PiBGb3Ig eW91ciBzZXR1cCAxMCBHQiBOSUNzICsgTDMgU3dpdGNoIGZvciBvdmlydG1nbXQuCj4+Pj0yMAo+ Pj4gQlRXLCBJIHdvdWxkIHN1Z2dlc3QgdG8gaGF2ZSBzZXZlcmFsIHNlcGFyYXRlIGhhcmR3YXJl IFJBSURzIHVubGVzcyB5b3UgaD0KYXZlIFNTRCwgb3RoZXJ3aXNlIGxpbWl0IG9mIHRoZSBkaXNr IHN5c3RlbSBJL08gd2lsbCBiZSBhIGJvdHRsZW5lY2suIENvbnNpZD0KZXIgU1NEIEwxIFJBSUQg Zm9yIGhlYXZ5LWxvYWRlZCBkYXRhYmFzZXMuCj4+Pj0yMAo+Pj4gUGxlYXNlIG5vdGUgbWFueSBj aGVhcCBTU0RzIGRvIE5PVCB3b3JrIHJlbGlhYmx5IHdpdGggU0FTIGNvbnRyb2xsZXJzIGV2PQpl biBpbiBTQVRBIG1vZGUuCj4+Pj0yMAo+Pj4gRm9yIGV4YW1wbGUsIEkgc3VwcG9zZWQgdG8gdXNl IDIgeCBXRCBHcmVlbiBTU0QgY29uZmlndXJlcyBhcyBSQUlEIEwxIGZvPQpyIE9TLj0yMAo+Pj4g SXQgd2FzIHBvc3NpYmxlIHRvIGluc3RhbGwgc3lzdGVtLCB5ZXQgdW5kZXIgaGVhdnkgbG9hZCBz aW11bGF0ZWQgd2l0aCBpPQpvem9uZSBkaXNrIHN5c3RlbSBmcmVlemUsIHJlbmRlcmluZyBPUyB1 bmJvb3RhYmxlLgo+Pj4gU2FtZSBjcmFzaCB3YXMgZXhwZXJpZW5jZWQgd2l0aCA1MTJHQiBLaW5n RmFzdCBTU0QgY29ubmVjdGVkIHRvIGJyb2FkY29tPQovQU1DQyBTQVMgUkFJRCBDYXJkLgo+Pj49 MjAKPj4+PTIwCj4+Pj4gT24gMDMvMjQvMjAxOCAxMDozMyBBTSwgQW5keSBNaWNoaWVsc2VuIHdy b3RlOgo+Pj4+IEhpIGFsbCwKPj4+Pj0yMAo+Pj4+IE5vdCBzdXJlIGlmIHRoaXMgaXMgdGhlIHBs YWNlIHRvIGJlIGFza2luZyB0aGlzIGJ1dCBJIHdhcyB3b25kZXJpbmcgd2hpPQpjaCBoYXJkd2Fy ZSB5b3UgYWxsIGFyZSB1c2luZyBhbmQgd2h5IGluIG9yZGVyIGZvciBtZSB0byBzZWUgd2hhdCBJ IHdvdWxkIGJlPQogbmVlZGluZy4KPj4+Pj0yMAo+Pj4+IEkgd291bGQgbGlrZSB0byBzZXQgdXAg YSBIQSBjbHVzdGVyIGNvbnNpc3Rpbmcgb2ZmIDMgaG9zdHMgdG8gYmUgYWJsZSB0PQpvIHJ1biAz MCB2bT1FMj04MD05OXMuCj4+Pj4gVGhlIGVuZ2luZSwgSSBjYW4gcnVuIG9uIGFuIG90aGVyIHNl cnZlci4gVGhlIGhvc3RzIGNhbiBiZSBmaXR0ZWQgd2l0aCB0PQpoZSBzdG9yYWdlIGFuZCBzaGFy ZSB0aGUgc3BhY2UgdGhyb3VnaCBnbHVzdGVyZnMuIEkgd291bGQgdGhpbmsgSSB3aWxsIGJlIG5l PQplZGluZyBhdCBsZWFzdCAzIG5pYz1FMj04MD05OXMgYnV0IHdvdWxkIGJlIGFibGUgdG8gaW5z dGFsbCBvdm4uIChBcmUgMWdiIG5pPQpjPUUyPTgwPTk5cyBzdWZmaWNpZW50ID8pCj4+Pj49MjAK Pj4+PiBBbnkgaW5wdXQgeW91IGd1eXMgd291bGQgbGlrZSB0byBzaGFyZSB3b3VsZCBiZSBncmVh dGx5IGFwcHJpY2lhdGVkLgo+Pj4+PTIwCj4+Pj4gVGhhbmtzLAo+Pj4+IF9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+Pj4gVXNlcnMgbWFpbGluZyBsaXN0 Cj4+Pj4gVXNlcnNAb3ZpcnQub3JnCj4+Pj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFu L2xpc3RpbmZvL3VzZXJzCj4+Pj0yMAo+Pj0yMAo+PiBfX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwo+PiBVc2VycyBtYWlsaW5nIGxpc3QKPj4gVXNlcnNAb3Zp cnQub3JnCj4+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+ Pj0yMAo+PTIwCgotLUFwcGxlLU1haWwtQjhFQkUxNTEtNkRENC00Njc5LUE4ODktOTYyODNEMjZE NUJGCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOwoJY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5z ZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48aGVhZD48bWV0YSBodHRwLWVx dWl2PTNEImNvbnRlbnQtdHlwZSIgY29udGVudD0zRCJ0ZXh0L2h0bWw7IGNoYXJzZXQ9M0Q9CnV0 Zi04Ij48L2hlYWQ+PGJvZHkgZGlyPTNEImF1dG8iPjxkaXY+PC9kaXY+PGRpdj5IZWxsbyBBbGV4 LDwvZGl2PjxkaXY+PGJyPjw9Ci9kaXY+PGRpdj5UaGFua3MgZm9yIHNoYXJpbmcuIE11Y2ggYXBw cmljaWF0ZWQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5JIGI9CmVsaWV2ZSBteSBzZXR1cCB3 b3VsZCBuZWVkIDk2IEdiIG9mZiBSQU0gaW4gZWFjaCBob3N0LCBhbmQgd291bGQgbmVlZCBhYm91 dCBhPQp0IGxlYXN0IDMgVGIgb2Ygc3RvcmFnZS4gUHJvYmFibHkgNCBUYiB3b3VsZCBiZSBiZXRl ciBpZiBJIHdhbnQgdG8gd29yayB3aXRoPQogc25hcHNob3RzLiAoV2lsbCBiZSBydW5uaW5nIG1v c3RseSB3aW5kb3dzIDIwMTYgc2VydmVycyBvciB3aW5kb3dzIDEwIGRlc2t0PQpvcHMgd2l0aCA2 R2Igb2ZmIFJBTSBhbmQgMTAwIEdiIG9mIGRpc2tzKTwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+ SSBhZ3JlZSB0PQpoYXQgYSAxMCBHYiBuZXR3b3JrIGZvciBzdG9yYWdlIHdvdWxkIGJlIHZlcnkg YmVuZWZpY2lhbC48L2Rpdj48ZGl2Pjxicj48L2RpPQp2PjxkaXY+Tm93IElmIEkgY2FuIGZpZ3Vy ZSBvdXQgaG93IHRvIHNldCB1cCBhIGdsdXN0ZXJmcyBvbiBhIDMgbm9kZSBjbHVzdGVyPQogaW4g b1ZpcnQgNC4yIGp1c3QgZm9yIHRoZSBkYXRhIHN0b3JhZ2UuIEkgPUUyPTgwPTk4bSBnb2xkZW4g dG8gZ2V0IHN0YXJ0ZWQuPQogOi0pPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5LaW5kIHJlZ2Fy ZHMuPC9kaXY+PGRpdj48YnI+T24gMjQgTWFyIDIwMTgsIGF0PQogMjA6MDgsIEFsZXggSyAmbHQ7 PGEgaHJlZj0zRCJtYWlsdG86cmlnaHRraWNrdGVjaEBnbWFpbC5jb20iPnJpZ2h0a2lja3RlY2hA PQpnbWFpbC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PGJyPjwvZGl2PjxibG9ja3F1b3RlIHR5cGU9 M0QiY2l0ZSI+PGRpdj48ZGl2IGRpPQpyPTNEImx0ciI+PGRpdj48ZGl2PkkgaGF2ZSAyIG9yIDMg bm9kZSBjbHVzdGVycyB3aXRoIGZvbGxvd2luZyBoYXJkd2FyZSAoYWxsPQogd2l0aCBzZWxmLWhv c3RlZCBlbmdpbmUpIDogPGJyPjxicj48L2Rpdj4yIG5vZGUgY2x1c3RlcjogPGJyPlJBTTogNjQg R0IgcGVyPQogaG9zdDxicj48L2Rpdj48ZGl2PkNQVTogOCBjb3JlcyBwZXIgaG9zdDxicj48L2Rp dj48ZGl2PlN0b3JhZ2U6IDR4IDFUQiBTQVMgaT0KbiBSQUlEMTA8YnI+PC9kaXY+PGRpdj5OSUM6 IDJ4IEdiaXQ8YnI+PC9kaXY+PGRpdj5WTXM6IDIwPGJyPjxicj48L2Rpdj48ZGl2Pj0KVGhlIGFi b3ZlLCBhbHRob3VnaCBJIHdvdWxkIGxpa2UgdG8gaGF2ZSBoYWQgYSB0aGlyZCBOSUMgZm9yIGds dXN0ZXIgc3RvcmFnZT0KIHJlZHVuZGFuY3ksIGl0IGlzIHJ1bm5pbmcgc21vb3RobHkgZm9yIHF1 aXRlIHNvbWUgdGltZSBhbmQgd2l0aG91dCBwZXJmb3JtYT0KbmNlIGlzc3Vlcy4gPGJyPjwvZGl2 PjxkaXY+VGhlIFZNcyBpdCBpcyBydW5uaW5nIGFyZSBub3QgaGlnaCBvbiBJTyAobW9zdGx5IHM9 Cm1hbGwgTGludXggc2VydmVycykuIDxicj48YnI+PC9kaXY+PGRpdj4zIG5vZGUgY2x1c3RlcnM6 IDxicj48L2Rpdj48ZGl2PlJBTTo9CiAzMiBHQiBwZXIgaG9zdDxicj48L2Rpdj48ZGl2PkNQVTog MTYgY29yZXMgcGVyIGhvc3Q8YnI+PC9kaXY+PGRpdj5TdG9yYWdlOiA1PQp4IDYwMEdCIGluIFJB SUQ1IChub3QgaWRlYWwgYnV0IEkgaGFkIHRvIGdhaW4gc29tZSBzdG9yYWdlIHNwYWNlIHdpdGhv dXQgcHVyPQpjaGFzaW5nIGV4dHJhIGRpc2tzKTxicj48L2Rpdj48ZGl2Pk5JQzogNnggR2JpdDxi cj48L2Rpdj48ZGl2PlZNczogbGVzcyB0aGVuPQogMTAgbGFyZ2UgV2luZG93cyBWTXMgKFdpbmRv d3MgMjAxNiBzZXJ2ZXIgYW5kIFdpbmRvd3MgMTApPGJyPjxicj48L2Rpdj48ZGl2PQo+Rm9yIHlv dXIgc2V0dXAgKDMwIFZNcykgSSB3b3VsZCByYXRoZXIgZ28gd2l0aCBSQUlEMTAgU0FTIGRpc2tz IGFuZCBhdCBsZWFzPQp0IGEgZHVhbCAxMEdiaXQgTklDIGRlZGljYXRlZCB0byB0aGUgZ2x1c3Rl ciB0cmFmZmljIG9ubHkuIDxicj48YnI+PC9kaXY+PGRpPQp2PkFsZXg8YnI+PC9kaXY+PGJyPjwv ZGl2PjxkaXYgY2xhc3M9M0QiZ21haWxfZXh0cmEiPjxicj48ZGl2IGNsYXNzPTNEImdtYWlsPQpf cXVvdGUiPk9uIFNhdCwgTWFyIDI0LCAyMDE4IGF0IDE6MjQgUE0sIEFuZHkgTWljaGllbHNlbiA8 c3BhbiBkaXI9M0QibHRyIj4mPQpsdDs8YSBocmVmPTNEIm1haWx0bzphbmR5Lm1pY2hpZWxzZW5A Z21haWwuY29tIiB0YXJnZXQ9M0QiX2JsYW5rIj5hbmR5Lm1pY2hpPQplbHNlbkBnbWFpbC5jb208 L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyPjxibG9ja3F1b3RlIGNsYXNzPTNEImdtYWlsX3F1b3Rl IiBzPQp0eWxlPTNEIm1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlk O3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgZD0KaXI9M0QiYXV0byI+PGRpdj48L2Rpdj48ZGl2Pkhl bGxvIEFuZHJlaSw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rIHlvdT0KIHZlcnkgbXVj aCBmb3Igc2hhcmluZyBpbmZvIG9uIHlvdXIgaGFyZHdhcmUgc2V0dXAuIFZlcnkgaW5mb3JtYXRp dmUuPC9kaXY+PD0KZGl2Pjxicj48L2Rpdj48ZGl2PkF0IHRoaXMgbW9tZW50IEkgaGF2ZSBteSBv dmlydCBlbmdpbmUgb24gb3VyIHZtd2FyZSBlbnZpcj0Kb25tZW50IHdoaWNoIGlzIGZpbmUgZm9y IGdvb2QgYmFja3VwIGFuZCByZXN0b3JlLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+ST0KIGhh dmUgNCBub2RlcyBydW5uaW5nIG5vdyBhbGwgZGlmZmVyZW50IGluIG1ha2UgYW5kIG1vZGVsIHdp dGggbG9jYWwgc3RvcmFnZT0KIGFuZCBpdCB3b3JrcyBidXQgbGFja3MgcGVyZm9ybWFuY2UgYSBi aXQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5CdXQgSSBjYT0KbiBnZXQgbXkgaGFuZHMgb24g c29tZSBvbGQgZGVsbD1FMj04MD05OXMgUjQxNSB3aXRoIDk2IEdiIG9mIHJhbSBhbmQgMiBxdWFk Yz0Kb3JlcyBhbmQgNiB4IDEgR2IgbmljPUUyPTgwPTk5cy4gVGhleSBhbGwgY29tZSB3aXRoIDIg eCAxNDYgR2IgMTUwMDAgcnBtPUUyPTgwPQo9OTlzIGhhcmRkaXNrcy4gVGhpcyBpc249RTI9ODA9 OTl0IGJhZCBidXQgSSB3aWxsIGFkZCBtb3JlIFJBTSBmb3Igc3RhcnRlcnMuPQogQWxzbyBJIHdv dWxkIGxpa2UgdG8gaGF2ZSBzb21lIGdvb2QgcmVkdW5kYW50IHN0b3JhZ2UgZm9yIHRoaXMgdG9v IGFuZCB0aGUgcz0KZXJ2ZXJzIGhhdmUgbGltaXRlZCBzcGFjZSB0byBhZGQgdGhhdC48L2Rpdj48 ZGl2Pjxicj48L2Rpdj48ZGl2PkhvcGVmdWxseSBvdD0KaGVycyB3aWxsIGFsc28gc2hhcmUgdGhl cmUgc2V0dXBzIGFuZCBleHBpcmllbmNlIGxpa2UgeW91IGRpZC48L2Rpdj48ZGl2Pjxicj0KPjwv ZGl2PjxkaXY+S2luZCByZWdhcmRzLjwvZGl2PjxkaXY+PGRpdiBjbGFzcz0zRCJoNSI+PGRpdj48 YnI+T24gMjQgTWFyIDIwMT0KOCwgYXQgMTA6MzUsIEFuZHJlaSBWZXJvdnNraSAmbHQ7PGEgaHJl Zj0zRCJtYWlsdG86YW5kcmVpbDFAc3RhcmxldHQubHYiIHRhcj0KZ2V0PTNEIl9ibGFuayI+YW5k cmVpbDFAc3RhcmxldHQubHY8L2E+Jmd0OyB3cm90ZTo8YnI+PGJyPjwvZGl2PjxibG9ja3F1b3Rl IHQ9CnlwZT0zRCJjaXRlIj48ZGl2PgogPTIwCiAgID0yMAogPTIwCiA9MjAKICAgIDxkaXYgY2xh c3M9M0QibV8yNDkwNDcyOTc4NzIxNjk2MzQxbW96LWNpdGUtcHJlZml4Ij5IaSw8YnI+CiAgICAg IDxicj4KICAgICAgSEwgUHJvTGlhbnQgREwzODAsIGR1YWwgWGVvbjxicj4KICAgICAgMTIwIEdC IFJBSUQgTDEgZm9yIHN5c3RlbTxicj4KICAgICAgMiBUQiBSQUlEIEwxMCBmb3IgVk0gZGlza3M8 YnI+CiAgICAgIDUgVk1zLCAzIExpbnV4LCAyIFdpbmRvd3M8YnI+CiAgICAgIFRvdGFsIENQVSBs b2FkIG1vc3Qgb2YgdGhlIHRpbWUgaXMmbmJzcDsgbG93LCBoaWdoIGxldmVsIG9mIGFjdGl2aXR5 CiAgICAgIHJlbGF0ZWQgdG8gZGlzay48YnI+CiAgICAgIEhvc3QgZW5naW5lIHVuZGVyIEtWTSBh cHBsaWFuY2Ugb24gU3VTRSwgY2FuIGJlIGVhc2lseSBtb3ZlZCwKICAgICAgYmFja2VkIHVwLCBj b3BpZWQsIGV4cGVyaW1lbnRlZCB3aXRoLCBldGMuPGJyPgogICAgICA8YnI+CiAgICAgIFlvdSds bCBoYXZlIHRvIHVzZSBzZXJ2ZXJzIHdpdGggbW9yZSBSQU0gYW5kIHN0b3JhZ2UgdGhhbiBtYWlu Ljxicj4KICAgICAgTW9yZSB0aGVuIG9uZSBOSUMgcmVxdWlyZWQgaWYgc29tZSBvZiB5b3VyIFZN cyBhcmUgb24gZGlmZmVyZW50CiAgICAgIHN1Ym5ldHMsIGUuZy4gMSBpbiBpbnRlcm5hbCB6b25l IGFuZCAybmQgb24gRE1aLjxicj4KICAgICAgRm9yIHlvdXIgc2V0dXAgMTAgR0IgTklDcyArIEwz IFN3aXRjaCBmb3Igb3ZpcnRtZ210Ljxicj4KICAgICAgPGJyPgogICAgICBCVFcsIEkgd291bGQg c3VnZ2VzdCB0byBoYXZlIHNldmVyYWwgc2VwYXJhdGUgaGFyZHdhcmUgUkFJRHMKICAgICAgdW5s ZXNzIHlvdSBoYXZlIFNTRCwgb3RoZXJ3aXNlIGxpbWl0IG9mIHRoZSBkaXNrIHN5c3RlbSBJL08g d2lsbAogICAgICBiZSBhIGJvdHRsZW5lY2suIENvbnNpZGVyIFNTRCBMMSBSQUlEIGZvciBoZWF2 eS1sb2FkZWQgZGF0YWJhc2VzLjxicj4KICAgICAgPGJyPgogICAgICA8Zm9udCBjb2xvcj0zRCIj OTkwMDAwIj48Yj5QbGVhc2Ugbm90ZSBtYW55IGNoZWFwIFNTRHMgZG8gTk9UIHdvcmsKICAgICAg ICAgIHJlbGlhYmx5IHdpdGggU0FTIGNvbnRyb2xsZXJzIGV2ZW4gaW4gU0FUQSBtb2RlPC9iPi48 L2ZvbnQ+PGJyPgogICAgICA8YnI+CiAgICAgIEZvciBleGFtcGxlLCBJIHN1cHBvc2VkIHRvIHVz ZSAyIHggV0QgR3JlZW4gU1NEIGNvbmZpZ3VyZXMgYXMgUkFJRAogICAgICBMMSBmb3IgT1MuIDxi cj4KICAgICAgSXQgd2FzIHBvc3NpYmxlIHRvIGluc3RhbGwgc3lzdGVtLCB5ZXQgdW5kZXIgaGVh dnkgbG9hZCBzaW11bGF0ZWQKICAgICAgd2l0aCBpb3pvbmUgZGlzayBzeXN0ZW0gZnJlZXplLCBy ZW5kZXJpbmcgT1MgdW5ib290YWJsZS48YnI+CiAgICAgIFNhbWUgY3Jhc2ggd2FzIGV4cGVyaWVu Y2VkIHdpdGggNTEyR0IgS2luZ0Zhc3QgU1NEIGNvbm5lY3RlZCB0bwogICAgICBicm9hZGNvbS9B TUNDIFNBUyBSQUlEIENhcmQuPGJyPgogICAgICA8YnI+CiAgICAgIDxicj4KICAgICAgT24gMDMv MjQvMjAxOCAxMDozMyBBTSwgQW5keSBNaWNoaWVsc2VuIHdyb3RlOjxicj4KICAgIDwvZGl2Pgog ICAgPGJsb2NrcXVvdGUgdHlwZT0zRCJjaXRlIj4KICAgICAgPHByZT5IaSBhbGwsCgpOb3Qgc3Vy ZSBpZiB0aGlzIGlzIHRoZSBwbGFjZSB0byBiZSBhc2tpbmcgdGhpcyBidXQgSSB3YXMgd29uZGVy aW5nIHdoaWNoIGhhPQpyZHdhcmUgeW91IGFsbCBhcmUgdXNpbmcgYW5kIHdoeSBpbiBvcmRlciBm b3IgbWUgdG8gc2VlIHdoYXQgSSB3b3VsZCBiZSBuZWVkPQppbmcuCgpJIHdvdWxkIGxpa2UgdG8g c2V0IHVwIGEgSEEgY2x1c3RlciBjb25zaXN0aW5nIG9mZiAzIGhvc3RzIHRvIGJlIGFibGUgdG8g cnVuPQogMzAgdm09RTI9ODA9OTlzLgpUaGUgZW5naW5lLCBJIGNhbiBydW4gb24gYW4gb3RoZXIg c2VydmVyLiBUaGUgaG9zdHMgY2FuIGJlIGZpdHRlZCB3aXRoIHRoZSBzPQp0b3JhZ2UgYW5kIHNo YXJlIHRoZSBzcGFjZSB0aHJvdWdoIGdsdXN0ZXJmcy4gSSB3b3VsZCB0aGluayBJIHdpbGwgYmUg bmVlZGluPQpnIGF0IGxlYXN0IDMgbmljPUUyPTgwPTk5cyBidXQgd291bGQgYmUgYWJsZSB0byBp bnN0YWxsIG92bi4gKEFyZSAxZ2IgbmljPUUyPQo9ODA9OTlzIHN1ZmZpY2llbnQgPykKCkFueSBp bnB1dCB5b3UgZ3V5cyB3b3VsZCBsaWtlIHRvIHNoYXJlIHdvdWxkIGJlIGdyZWF0bHkgYXBwcmlj aWF0ZWQuCgpUaGFua3MsCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzx3YnI+X19fX19f X19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNzPTNEIm1fMjQ5MDQ3Mjk3ODcy MTY5NjM0MW1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0zRCJtYWlsdG86VXM9CmVyc0Bv dmlydC5vcmciIHRhcmdldD0zRCJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9 M0QibV8yNDkwNDcyOTc4NzIxNjk2MzQxbW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPTNEImh0 dHA6Ly9saXN0cz0KLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiB0YXJnZXQ9M0Qi X2JsYW5rIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnLz0KPHdicj5tYWlsbWFuL2xpc3RpbmZvL3Vz ZXJzPC9hPgo8L3ByZT4KICAgIDwvYmxvY2txdW90ZT4KICAgIDxwPjxicj4KICAgIDwvcD4KID0y MAoKPC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2PjwvZGl2PjwvZGl2Pjxicj5fX19fX19fX19fX19f X19fX19fX19fX19fX19fX188d2JyPj0KX19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxp bmcgbGlzdDxicj4KPGEgaHJlZj0zRCJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0Bvdmly dC5vcmc8L2E+PGJyPgo8YSBocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9s aXN0aW5mby91c2VycyIgcmVsPTNEIm5vcmVmZXJyZXIiPQogdGFyZ2V0PTNEIl9ibGFuayI+aHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PGJyPQo+ Cjxicj48L2Jsb2NrcXVvdGU+PC9kaXY+PGJyPjwvZGl2Pgo8L2Rpdj48L2Jsb2NrcXVvdGU+PC9i b2R5PjwvaHRtbD49CgotLUFwcGxlLU1haWwtQjhFQkUxNTEtNkRENC00Njc5LUE4ODktOTYyODNE MjZENUJGLS0K --===============0496491940207711674==-- From pablo.localhost at gmail.com Sun Mar 25 19:36:01 2018 Content-Type: multipart/mixed; boundary="===============3259614788031646788==" MIME-Version: 1.0 From: Juan Pablo To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sun, 25 Mar 2018 16:35:59 -0300 Message-ID: In-Reply-To: 545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E@gmail.com --===============3259614788031646788== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Andy, Im using 2 node cluster: -2 supermicro 6017 (2 Intel 2420(12C24T each node) 384Gb ram total, 10gbe. all hosted engine via nfs storage side: 2 SC836BE16-R1K28B(192gb arc cache) with raid 10 zfs+intel slog serving iscsi at 10Gbe 80 VM's more or less. regards, 2018-03-25 4:36 GMT-03:00 Andy Michielsen : > Hello Alex, > > Thanks for sharing. Much appriciated. > > I believe my setup would need 96 Gb off RAM in each host, and would need > about at least 3 Tb of storage. Probably 4 Tb would be beter if I want to > work with snapshots. (Will be running mostly windows 2016 servers or > windows 10 desktops with 6Gb off RAM and 100 Gb of disks) > > I agree that a 10 Gb network for storage would be very beneficial. > > Now If I can figure out how to set up a glusterfs on a 3 node cluster in > oVirt 4.2 just for the data storage. I =E2=80=98m golden to get started. = :-) > > Kind regards. > > On 24 Mar 2018, at 20:08, Alex K wrote: > > I have 2 or 3 node clusters with following hardware (all with self-hosted > engine) : > > 2 node cluster: > RAM: 64 GB per host > CPU: 8 cores per host > Storage: 4x 1TB SAS in RAID10 > NIC: 2x Gbit > VMs: 20 > > The above, although I would like to have had a third NIC for gluster > storage redundancy, it is running smoothly for quite some time and without > performance issues. > The VMs it is running are not high on IO (mostly small Linux servers). > > 3 node clusters: > RAM: 32 GB per host > CPU: 16 cores per host > Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage space > without purchasing extra disks) > NIC: 6x Gbit > VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 10) > > For your setup (30 VMs) I would rather go with RAID10 SAS disks and at > least a dual 10Gbit NIC dedicated to the gluster traffic only. > > Alex > > > On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen < > andy.michielsen(a)gmail.com> wrote: > >> Hello Andrei, >> >> Thank you very much for sharing info on your hardware setup. Very >> informative. >> >> At this moment I have my ovirt engine on our vmware environment which is >> fine for good backup and restore. >> >> I have 4 nodes running now all different in make and model with local >> storage and it works but lacks performance a bit. >> >> But I can get my hands on some old dell=E2=80=99s R415 with 96 Gb of ram= and 2 >> quadcores and 6 x 1 Gb nic=E2=80=99s. They all come with 2 x 146 Gb 1500= 0 rpm=E2=80=99s >> harddisks. This isn=E2=80=99t bad but I will add more RAM for starters. = Also I >> would like to have some good redundant storage for this too and the serv= ers >> have limited space to add that. >> >> Hopefully others will also share there setups and expirience like you di= d. >> >> Kind regards. >> >> On 24 Mar 2018, at 10:35, Andrei Verovski wrote: >> >> Hi, >> >> HL ProLiant DL380, dual Xeon >> 120 GB RAID L1 for system >> 2 TB RAID L10 for VM disks >> 5 VMs, 3 Linux, 2 Windows >> Total CPU load most of the time is low, high level of activity related >> to disk. >> Host engine under KVM appliance on SuSE, can be easily moved, backed up, >> copied, experimented with, etc. >> >> You'll have to use servers with more RAM and storage than main. >> More then one NIC required if some of your VMs are on different subnets, >> e.g. 1 in internal zone and 2nd on DMZ. >> For your setup 10 GB NICs + L3 Switch for ovirtmgmt. >> >> BTW, I would suggest to have several separate hardware RAIDs unless you >> have SSD, otherwise limit of the disk system I/O will be a bottleneck. >> Consider SSD L1 RAID for heavy-loaded databases. >> >> *Please note many cheap SSDs do NOT work reliably with SAS controllers >> even in SATA mode*. >> >> For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for >> OS. >> It was possible to install system, yet under heavy load simulated with >> iozone disk system freeze, rendering OS unbootable. >> Same crash was experienced with 512GB KingFast SSD connected to >> broadcom/AMCC SAS RAID Card. >> >> >> On 03/24/2018 10:33 AM, Andy Michielsen wrote: >> >> Hi all, >> >> Not sure if this is the place to be asking this but I was wondering whic= h hardware you all are using and why in order for me to see what I would be= needing. >> >> I would like to set up a HA cluster consisting off 3 hosts to be able to= run 30 vm=E2=80=99s. >> The engine, I can run on an other server. The hosts can be fitted with t= he storage and share the space through glusterfs. I would think I will be n= eeding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb = nic=E2=80=99s sufficient ?) >> >> Any input you guys would like to share would be greatly appriciated. >> >> Thanks, >> _______________________________________________ >> Users mailing listUsers(a)ovirt.orghttp://lists.ovirt.org/mailman/listin= fo/users >> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --===============3259614788031646788== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFt aWx5Om1vbm9zcGFjZSxtb25vc3BhY2UiPkFuZHksIEltIHVzaW5nIDIgbm9kZSBjbHVzdGVyOjxi cj48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6bW9u b3NwYWNlLG1vbm9zcGFjZSI+LTIgc3VwZXJtaWNybyA2MDE3ICgyIEludGVsIDI0MjAoMTJDMjRU IGVhY2ggbm9kZSkgMzg0R2IgcmFtIHRvdGFsLCAxMGdiZS4gYWxsIGhvc3RlZCBlbmdpbmUgdmlh IG5mczxicj48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1p bHk6bW9ub3NwYWNlLG1vbm9zcGFjZSI+PGJyPnN0b3JhZ2Ugc2lkZTogMiBTQzgzNkJFMTYtUjFL MjhCKDE5MmdiIGFyYyBjYWNoZSkgd2l0aCByYWlkIDEwIHpmcytpbnRlbCBzbG9nIHNlcnZpbmcg aXNjc2kgYXQgMTBHYmU8YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9 ImZvbnQtZmFtaWx5Om1vbm9zcGFjZSxtb25vc3BhY2UiPjgwIFZNJiMzOTtzIG1vcmUgb3IgbGVz cy48YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5 Om1vbm9zcGFjZSxtb25vc3BhY2UiPjxicj5yZWdhcmRzLCA8YnI+PC9kaXY+PGRpdiBjbGFzcz0i Z21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Om1vbm9zcGFjZSxtb25vc3BhY2UiPjxi cj48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6bW9u b3NwYWNlLG1vbm9zcGFjZSI+PGJyPjwvZGl2PjwvZGl2PjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJh Ij48YnI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUiPjIwMTgtMDMtMjUgNDozNiBHTVQtMDM6MDAg QW5keSBNaWNoaWVsc2VuIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmFuZHku bWljaGllbHNlbkBnbWFpbC5jb20iIHRhcmdldD0iX2JsYW5rIj5hbmR5Lm1pY2hpZWxzZW5AZ21h aWwuY29tPC9hPiZndDs8L3NwYW4+Ojxicj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUi IHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRk aW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0iYXV0byI+PGRpdj48L2Rpdj48ZGl2PkhlbGxvIEFsZXgs PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGFua3MgZm9yIHNoYXJpbmcuIE11Y2ggYXBwcmlj aWF0ZWQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5JIGJlbGlldmUgbXkgc2V0dXAgd291bGQg bmVlZCA5NiBHYiBvZmYgUkFNIGluIGVhY2ggaG9zdCwgYW5kIHdvdWxkIG5lZWQgYWJvdXQgYXQg bGVhc3QgMyBUYiBvZiBzdG9yYWdlLiBQcm9iYWJseSA0IFRiIHdvdWxkIGJlIGJldGVyIGlmIEkg d2FudCB0byB3b3JrIHdpdGggc25hcHNob3RzLiAoV2lsbCBiZSBydW5uaW5nIG1vc3RseSB3aW5k b3dzIDIwMTYgc2VydmVycyBvciB3aW5kb3dzIDEwIGRlc2t0b3BzIHdpdGggNkdiIG9mZiBSQU0g YW5kIDEwMCBHYiBvZiBkaXNrcyk8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgYWdyZWUgdGhh dCBhIDEwIEdiIG5ldHdvcmsgZm9yIHN0b3JhZ2Ugd291bGQgYmUgdmVyeSBiZW5lZmljaWFsLjwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+Tm93IElmIEkgY2FuIGZpZ3VyZSBvdXQgaG93IHRvIHNl dCB1cCBhIGdsdXN0ZXJmcyBvbiBhIDMgbm9kZSBjbHVzdGVyIGluIG9WaXJ0IDQuMiBqdXN0IGZv ciB0aGUgZGF0YSBzdG9yYWdlLiBJIOKAmG0gZ29sZGVuIHRvIGdldCBzdGFydGVkLiA6LSk8L2Rp dj48ZGl2Pjxicj48L2Rpdj48ZGl2PktpbmQgcmVnYXJkcy48L2Rpdj48ZGl2PjxkaXYgY2xhc3M9 Img1Ij48ZGl2Pjxicj5PbiAyNCBNYXIgMjAxOCwgYXQgMjA6MDgsIEFsZXggSyAmbHQ7PGEgaHJl Zj0ibWFpbHRvOnJpZ2h0a2lja3RlY2hAZ21haWwuY29tIiB0YXJnZXQ9Il9ibGFuayI+cmlnaHRr aWNrdGVjaEBnbWFpbC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PGJyPjwvZGl2PjxibG9ja3F1b3Rl IHR5cGU9ImNpdGUiPjxkaXY+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2PkkgaGF2ZSAyIG9yIDMg bm9kZSBjbHVzdGVycyB3aXRoIGZvbGxvd2luZyBoYXJkd2FyZSAoYWxsIHdpdGggc2VsZi1ob3N0 ZWQgZW5naW5lKSA6IDxicj48YnI+PC9kaXY+MiBub2RlIGNsdXN0ZXI6IDxicj5SQU06IDY0IEdC IHBlciBob3N0PGJyPjwvZGl2PjxkaXY+Q1BVOiA4IGNvcmVzIHBlciBob3N0PGJyPjwvZGl2Pjxk aXY+U3RvcmFnZTogNHggMVRCIFNBUyBpbiBSQUlEMTA8YnI+PC9kaXY+PGRpdj5OSUM6IDJ4IEdi aXQ8YnI+PC9kaXY+PGRpdj5WTXM6IDIwPGJyPjxicj48L2Rpdj48ZGl2PlRoZSBhYm92ZSwgYWx0 aG91Z2ggSSB3b3VsZCBsaWtlIHRvIGhhdmUgaGFkIGEgdGhpcmQgTklDIGZvciBnbHVzdGVyIHN0 b3JhZ2UgcmVkdW5kYW5jeSwgaXQgaXMgcnVubmluZyBzbW9vdGhseSBmb3IgcXVpdGUgc29tZSB0 aW1lIGFuZCB3aXRob3V0IHBlcmZvcm1hbmNlIGlzc3Vlcy4gPGJyPjwvZGl2PjxkaXY+VGhlIFZN cyBpdCBpcyBydW5uaW5nIGFyZSBub3QgaGlnaCBvbiBJTyAobW9zdGx5IHNtYWxsIExpbnV4IHNl cnZlcnMpLiA8YnI+PGJyPjwvZGl2PjxkaXY+MyBub2RlIGNsdXN0ZXJzOiA8YnI+PC9kaXY+PGRp dj5SQU06IDMyIEdCIHBlciBob3N0PGJyPjwvZGl2PjxkaXY+Q1BVOiAxNiBjb3JlcyBwZXIgaG9z dDxicj48L2Rpdj48ZGl2PlN0b3JhZ2U6IDV4IDYwMEdCIGluIFJBSUQ1IChub3QgaWRlYWwgYnV0 IEkgaGFkIHRvIGdhaW4gc29tZSBzdG9yYWdlIHNwYWNlIHdpdGhvdXQgcHVyY2hhc2luZyBleHRy YSBkaXNrcyk8YnI+PC9kaXY+PGRpdj5OSUM6IDZ4IEdiaXQ8YnI+PC9kaXY+PGRpdj5WTXM6IGxl c3MgdGhlbiAxMCBsYXJnZSBXaW5kb3dzIFZNcyAoV2luZG93cyAyMDE2IHNlcnZlciBhbmQgV2lu ZG93cyAxMCk8YnI+PGJyPjwvZGl2PjxkaXY+Rm9yIHlvdXIgc2V0dXAgKDMwIFZNcykgSSB3b3Vs ZCByYXRoZXIgZ28gd2l0aCBSQUlEMTAgU0FTIGRpc2tzIGFuZCBhdCBsZWFzdCBhIGR1YWwgMTBH Yml0IE5JQyBkZWRpY2F0ZWQgdG8gdGhlIGdsdXN0ZXIgdHJhZmZpYyBvbmx5LiA8YnI+PGJyPjwv ZGl2PjxkaXY+QWxleDxicj48L2Rpdj48YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEi Pjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+T24gU2F0LCBNYXIgMjQsIDIwMTggYXQgMToy NCBQTSwgQW5keSBNaWNoaWVsc2VuIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRv OmFuZHkubWljaGllbHNlbkBnbWFpbC5jb20iIHRhcmdldD0iX2JsYW5rIj5hbmR5Lm1pY2hpZWxz ZW5AZ21haWwuY29tPC9hPiZndDs8L3NwYW4+IHdyb3RlOjxicj48YmxvY2txdW90ZSBjbGFzcz0i Z21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2Nj YyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0iYXV0byI+PGRpdj48L2Rpdj48ZGl2 PkhlbGxvIEFuZHJlaSw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rIHlvdSB2ZXJ5IG11 Y2ggZm9yIHNoYXJpbmcgaW5mbyBvbiB5b3VyIGhhcmR3YXJlIHNldHVwLiBWZXJ5IGluZm9ybWF0 aXZlLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+QXQgdGhpcyBtb21lbnQgSSBoYXZlIG15IG92 aXJ0IGVuZ2luZSBvbiBvdXIgdm13YXJlIGVudmlyb25tZW50IHdoaWNoIGlzIGZpbmUgZm9yIGdv b2QgYmFja3VwIGFuZCByZXN0b3JlLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBoYXZlIDQg bm9kZXMgcnVubmluZyBub3cgYWxsIGRpZmZlcmVudCBpbiBtYWtlIGFuZCBtb2RlbCB3aXRoIGxv Y2FsIHN0b3JhZ2UgYW5kIGl0IHdvcmtzIGJ1dCBsYWNrcyBwZXJmb3JtYW5jZSBhIGJpdC48L2Rp dj48ZGl2Pjxicj48L2Rpdj48ZGl2PkJ1dCBJIGNhbiBnZXQgbXkgaGFuZHMgb24gc29tZSBvbGQg ZGVsbOKAmXMgUjQxNSB3aXRoIDk2IEdiIG9mIHJhbSBhbmQgMiBxdWFkY29yZXMgYW5kIDYgeCAx IEdiIG5pY+KAmXMuIFRoZXkgYWxsIGNvbWUgd2l0aCAyIHggMTQ2IEdiIDE1MDAwIHJwbeKAmXMg aGFyZGRpc2tzLiBUaGlzIGlzbuKAmXQgYmFkIGJ1dCBJIHdpbGwgYWRkIG1vcmUgUkFNIGZvciBz dGFydGVycy4gQWxzbyBJIHdvdWxkIGxpa2UgdG8gaGF2ZSBzb21lIGdvb2QgcmVkdW5kYW50IHN0 b3JhZ2UgZm9yIHRoaXMgdG9vIGFuZCB0aGUgc2VydmVycyBoYXZlIGxpbWl0ZWQgc3BhY2UgdG8g YWRkIHRoYXQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5Ib3BlZnVsbHkgb3RoZXJzIHdpbGwg YWxzbyBzaGFyZSB0aGVyZSBzZXR1cHMgYW5kIGV4cGlyaWVuY2UgbGlrZSB5b3UgZGlkLjwvZGl2 PjxkaXY+PGJyPjwvZGl2PjxkaXY+S2luZCByZWdhcmRzLjwvZGl2PjxkaXY+PGRpdiBjbGFzcz0i bV8yMDk4Mjc5MTk0NDI1MTI2NDYxaDUiPjxkaXY+PGJyPk9uIDI0IE1hciAyMDE4LCBhdCAxMDoz NSwgQW5kcmVpIFZlcm92c2tpICZsdDs8YSBocmVmPSJtYWlsdG86YW5kcmVpbDFAc3RhcmxldHQu bHYiIHRhcmdldD0iX2JsYW5rIj5hbmRyZWlsMUBzdGFybGV0dC5sdjwvYT4mZ3Q7IHdyb3RlOjxi cj48YnI+PC9kaXY+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGRpdj4KICAKICAgIAogIAogIAog ICAgPGRpdiBjbGFzcz0ibV8yMDk4Mjc5MTk0NDI1MTI2NDYxbV8yNDkwNDcyOTc4NzIxNjk2MzQx bW96LWNpdGUtcHJlZml4Ij5IaSw8YnI+CiAgICAgIDxicj4KICAgICAgSEwgUHJvTGlhbnQgREwz ODAsIGR1YWwgWGVvbjxicj4KICAgICAgMTIwIEdCIFJBSUQgTDEgZm9yIHN5c3RlbTxicj4KICAg ICAgMiBUQiBSQUlEIEwxMCBmb3IgVk0gZGlza3M8YnI+CiAgICAgIDUgVk1zLCAzIExpbnV4LCAy IFdpbmRvd3M8YnI+CiAgICAgIFRvdGFsIENQVSBsb2FkIG1vc3Qgb2YgdGhlIHRpbWUgaXPCoCBs b3csIGhpZ2ggbGV2ZWwgb2YgYWN0aXZpdHkKICAgICAgcmVsYXRlZCB0byBkaXNrLjxicj4KICAg ICAgSG9zdCBlbmdpbmUgdW5kZXIgS1ZNIGFwcGxpYW5jZSBvbiBTdVNFLCBjYW4gYmUgZWFzaWx5 IG1vdmVkLAogICAgICBiYWNrZWQgdXAsIGNvcGllZCwgZXhwZXJpbWVudGVkIHdpdGgsIGV0Yy48 YnI+CiAgICAgIDxicj4KICAgICAgWW91JiMzOTtsbCBoYXZlIHRvIHVzZSBzZXJ2ZXJzIHdpdGgg bW9yZSBSQU0gYW5kIHN0b3JhZ2UgdGhhbiBtYWluLjxicj4KICAgICAgTW9yZSB0aGVuIG9uZSBO SUMgcmVxdWlyZWQgaWYgc29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlmZmVyZW50CiAgICAgIHN1 Ym5ldHMsIGUuZy4gMSBpbiBpbnRlcm5hbCB6b25lIGFuZCAybmQgb24gRE1aLjxicj4KICAgICAg Rm9yIHlvdXIgc2V0dXAgMTAgR0IgTklDcyArIEwzIFN3aXRjaCBmb3Igb3ZpcnRtZ210Ljxicj4K ICAgICAgPGJyPgogICAgICBCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBoYXZlIHNldmVyYWwgc2Vw YXJhdGUgaGFyZHdhcmUgUkFJRHMKICAgICAgdW5sZXNzIHlvdSBoYXZlIFNTRCwgb3RoZXJ3aXNl IGxpbWl0IG9mIHRoZSBkaXNrIHN5c3RlbSBJL08gd2lsbAogICAgICBiZSBhIGJvdHRsZW5lY2su IENvbnNpZGVyIFNTRCBMMSBSQUlEIGZvciBoZWF2eS1sb2FkZWQgZGF0YWJhc2VzLjxicj4KICAg ICAgPGJyPgogICAgICA8Zm9udCBjb2xvcj0iIzk5MDAwMCI+PGI+UGxlYXNlIG5vdGUgbWFueSBj aGVhcCBTU0RzIGRvIE5PVCB3b3JrCiAgICAgICAgICByZWxpYWJseSB3aXRoIFNBUyBjb250cm9s bGVycyBldmVuIGluIFNBVEEgbW9kZTwvYj4uPC9mb250Pjxicj4KICAgICAgPGJyPgogICAgICBG b3IgZXhhbXBsZSwgSSBzdXBwb3NlZCB0byB1c2UgMiB4IFdEIEdyZWVuIFNTRCBjb25maWd1cmVz IGFzIFJBSUQKICAgICAgTDEgZm9yIE9TLiA8YnI+CiAgICAgIEl0IHdhcyBwb3NzaWJsZSB0byBp bnN0YWxsIHN5c3RlbSwgeWV0IHVuZGVyIGhlYXZ5IGxvYWQgc2ltdWxhdGVkCiAgICAgIHdpdGgg aW96b25lIGRpc2sgc3lzdGVtIGZyZWV6ZSwgcmVuZGVyaW5nIE9TIHVuYm9vdGFibGUuPGJyPgog ICAgICBTYW1lIGNyYXNoIHdhcyBleHBlcmllbmNlZCB3aXRoIDUxMkdCIEtpbmdGYXN0IFNTRCBj b25uZWN0ZWQgdG8KICAgICAgYnJvYWRjb20vQU1DQyBTQVMgUkFJRCBDYXJkLjxicj4KICAgICAg PGJyPgogICAgICA8YnI+CiAgICAgIE9uIDAzLzI0LzIwMTggMTA6MzMgQU0sIEFuZHkgTWljaGll bHNlbiB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPgog ICAgICA8cHJlPkhpIGFsbCwKCk5vdCBzdXJlIGlmIHRoaXMgaXMgdGhlIHBsYWNlIHRvIGJlIGFz a2luZyB0aGlzIGJ1dCBJIHdhcyB3b25kZXJpbmcgd2hpY2ggaGFyZHdhcmUgeW91IGFsbCBhcmUg dXNpbmcgYW5kIHdoeSBpbiBvcmRlciBmb3IgbWUgdG8gc2VlIHdoYXQgSSB3b3VsZCBiZSBuZWVk aW5nLgoKSSB3b3VsZCBsaWtlIHRvIHNldCB1cCBhIEhBIGNsdXN0ZXIgY29uc2lzdGluZyBvZmYg MyBob3N0cyB0byBiZSBhYmxlIHRvIHJ1biAzMCB2beKAmXMuClRoZSBlbmdpbmUsIEkgY2FuIHJ1 biBvbiBhbiBvdGhlciBzZXJ2ZXIuIFRoZSBob3N0cyBjYW4gYmUgZml0dGVkIHdpdGggdGhlIHN0 b3JhZ2UgYW5kIHNoYXJlIHRoZSBzcGFjZSB0aHJvdWdoIGdsdXN0ZXJmcy4gSSB3b3VsZCB0aGlu ayBJIHdpbGwgYmUgbmVlZGluZyBhdCBsZWFzdCAzIG5pY+KAmXMgYnV0IHdvdWxkIGJlIGFibGUg dG8gaW5zdGFsbCBvdm4uIChBcmUgMWdiIG5pY+KAmXMgc3VmZmljaWVudCA/KQoKQW55IGlucHV0 IHlvdSBndXlzIHdvdWxkIGxpa2UgdG8gc2hhcmUgd291bGQgYmUgZ3JlYXRseSBhcHByaWNpYXRl ZC4KClRoYW5rcywKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19f X19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgY2xhc3M9Im1fMjA5ODI3OTE5NDQyNTEyNjQ2 MW1fMjQ5MDQ3Mjk3ODcyMTY5NjM0MW1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0ibWFp bHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4K PGEgY2xhc3M9Im1fMjA5ODI3OTE5NDQyNTEyNjQ2MW1fMjQ5MDQ3Mjk3ODcyMTY5NjM0MW1vei10 eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xp c3RpbmZvL3VzZXJzIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWls bWFuPHdicj4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgogICAg PHA+PGJyPgogICAgPC9wPgogIAoKPC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2PjwvZGl2PjwvZGl2 Pjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188d2JyPl9fX19fX19fX19fX19fX19f PGJyPgpVc2VycyBtYWlsaW5nIGxpc3Q8YnI+CjxhIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5v cmciIHRhcmdldD0iX2JsYW5rIj5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyPgo8YSBocmVmPSJodHRw Oi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHJlbD0ibm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbjx3YnI+L2xp c3RpbmZvL3VzZXJzPC9hPjxicj4KPGJyPjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PC9kaXY+Cjwv ZGl2PjwvYmxvY2txdW90ZT48L2Rpdj48L2Rpdj48L2Rpdj48YnI+X19fX19fX19fX19fX19fX19f X19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4KVXNlcnMgbWFpbGluZyBsaXN0 PGJyPgo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+ PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNl cnMiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5v cmcvPHdicj5tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KPGJyPjwvYmxvY2txdW90ZT48 L2Rpdj48YnI+PC9kaXY+Cg== --===============3259614788031646788==-- From lorenzetto.luca at gmail.com Mon Mar 26 07:02:05 2018 Content-Type: multipart/mixed; boundary="===============2626063073042193237==" MIME-Version: 1.0 From: Luca 'remix_tj' Lorenzetto To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Mon, 26 Mar 2018 09:02:03 +0200 Message-ID: In-Reply-To: 815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com --===============2626063073042193237== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Sat, Mar 24, 2018 at 9:33 AM, Andy Michielsen wrote: > Hi all, > > Not sure if this is the place to be asking this but I was wondering which= hardware you all are using and why in order for me to see what I would be = needing. > > I would like to set up a HA cluster consisting off 3 hosts to be able to = run 30 vm=E2=80=99s. > The engine, I can run on an other server. The hosts can be fitted with th= e storage and share the space through glusterfs. I would think I will be ne= eding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb n= ic=E2=80=99s sufficient ?) > > Any input you guys would like to share would be greatly appriciated. Hello Andy, i'm not running hyperconverged setup, but just for reference i'll describe my setup: 2 clusters (6+2) HPE BL460 G9 with 512 GB of ram each. On the cluster composed by two nodes we're running self-hosted engine. The storage backend is FC for both (EMC VNX8000 for the biggest one and EMC VPLEX with VMAX as disk backend on the smallest one). Luca -- = "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet =C3=A8 la pi=C3=B9 grande biblioteca del mondo. Ma il problema =C3=A8 che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , --===============2626063073042193237==-- From rightkicktech at gmail.com Mon Mar 26 07:19:30 2018 Content-Type: multipart/mixed; boundary="===============6688180900982251079==" MIME-Version: 1.0 From: Alex K To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Mon, 26 Mar 2018 07:19:18 +0000 Message-ID: In-Reply-To: CAKuX69rSe1OVFDrvF=uFVyRufTTWSfatY1BPC93T5nau0pjMFw@mail.gmail.com --===============6688180900982251079== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Luca, You have 2 node cluster with 512 GB each host to run engine only? How many vms are u running at the compute nodes? Alex On Mon, Mar 26, 2018, 10:02 Luca 'remix_tj' Lorenzetto < lorenzetto.luca(a)gmail.com> wrote: > On Sat, Mar 24, 2018 at 9:33 AM, Andy Michielsen > wrote: > > Hi all, > > > > Not sure if this is the place to be asking this but I was wondering > which hardware you all are using and why in order for me to see what I > would be needing. > > > > I would like to set up a HA cluster consisting off 3 hosts to be able to > run 30 vm=E2=80=99s. > > The engine, I can run on an other server. The hosts can be fitted with > the storage and share the space through glusterfs. I would think I will be > needing at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1= gb nic=E2=80=99s > sufficient ?) > > > > Any input you guys would like to share would be greatly appriciated. > > Hello Andy, > > i'm not running hyperconverged setup, but just for reference i'll > describe my setup: > > 2 clusters (6+2) HPE BL460 G9 with 512 GB of ram each. On the cluster > composed by two nodes we're running self-hosted engine. > > The storage backend is FC for both (EMC VNX8000 for the biggest one > and EMC VPLEX with VMAX as disk backend on the smallest one). > > Luca > > > -- > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare > calcoli che potrebbero essere affidati a chiunque se si usassero delle > macchine" > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) > > "Internet =C3=A8 la pi=C3=B9 grande biblioteca del mondo. > Ma il problema =C3=A8 che i libri sono tutti sparsi sul pavimento" > John Allen Paulos, Matematico (1945-vivente) > > Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , < > lorenzetto.luca(a)gmail.com> > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --===============6688180900982251079== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9ImF1dG8iPkhpIEx1Y2EsPGRpdiBkaXI9ImF1dG8iPjxicj48L2Rpdj48ZGl2IGRp cj0iYXV0byI+WW91IGhhdmUgMiBub2RlIGNsdXN0ZXIgd2l0aCA1MTIgR0IgZWFjaCBob3N0IHRv IHJ1biBlbmdpbmUgb25seT88L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJyPjwvZGl2PjxkaXYgZGly PSJhdXRvIj5Ib3cgbWFueSB2bXMgYXJlIHUgcnVubmluZyBhdCB0aGUgY29tcHV0ZSBub2Rlcz88 L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJyPjwvZGl2PjxkaXYgZGlyPSJhdXRvIj5BbGV4PC9kaXY+ PC9kaXY+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48ZGl2IGRpcj0ibHRyIj5PbiBNb24s IE1hciAyNiwgMjAxOCwgMTA6MDIgTHVjYSAmIzM5O3JlbWl4X3RqJiMzOTsgTG9yZW56ZXR0byAm bHQ7PGEgaHJlZj0ibWFpbHRvOmxvcmVuemV0dG8ubHVjYUBnbWFpbC5jb20iPmxvcmVuemV0dG8u bHVjYUBnbWFpbC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PC9kaXY+PGJsb2NrcXVvdGUgY2xhc3M9 ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNj Y2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+T24gU2F0LCBNYXIgMjQsIDIwMTggYXQgOTozMyBB TSwgQW5keSBNaWNoaWVsc2VuPGJyPgombHQ7PGEgaHJlZj0ibWFpbHRvOmFuZHkubWljaGllbHNl bkBnbWFpbC5jb20iIHRhcmdldD0iX2JsYW5rIiByZWw9Im5vcmVmZXJyZXIiPmFuZHkubWljaGll bHNlbkBnbWFpbC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+CiZndDsgSGkgYWxsLDxicj4KJmd0Ozxi cj4KJmd0OyBOb3Qgc3VyZSBpZiB0aGlzIGlzIHRoZSBwbGFjZSB0byBiZSBhc2tpbmcgdGhpcyBi dXQgSSB3YXMgd29uZGVyaW5nIHdoaWNoIGhhcmR3YXJlIHlvdSBhbGwgYXJlIHVzaW5nIGFuZCB3 aHkgaW4gb3JkZXIgZm9yIG1lIHRvIHNlZSB3aGF0IEkgd291bGQgYmUgbmVlZGluZy48YnI+CiZn dDs8YnI+CiZndDsgSSB3b3VsZCBsaWtlIHRvIHNldCB1cCBhIEhBIGNsdXN0ZXIgY29uc2lzdGlu ZyBvZmYgMyBob3N0cyB0byBiZSBhYmxlIHRvIHJ1biAzMCB2beKAmXMuPGJyPgomZ3Q7IFRoZSBl bmdpbmUsIEkgY2FuIHJ1biBvbiBhbiBvdGhlciBzZXJ2ZXIuIFRoZSBob3N0cyBjYW4gYmUgZml0 dGVkIHdpdGggdGhlIHN0b3JhZ2UgYW5kIHNoYXJlIHRoZSBzcGFjZSB0aHJvdWdoIGdsdXN0ZXJm cy4gSSB3b3VsZCB0aGluayBJIHdpbGwgYmUgbmVlZGluZyBhdCBsZWFzdCAzIG5pY+KAmXMgYnV0 IHdvdWxkIGJlIGFibGUgdG8gaW5zdGFsbCBvdm4uIChBcmUgMWdiIG5pY+KAmXMgc3VmZmljaWVu dCA/KTxicj4KJmd0Ozxicj4KJmd0OyBBbnkgaW5wdXQgeW91IGd1eXMgd291bGQgbGlrZSB0byBz aGFyZSB3b3VsZCBiZSBncmVhdGx5IGFwcHJpY2lhdGVkLjxicj4KPGJyPgpIZWxsbyBBbmR5LDxi cj4KPGJyPgppJiMzOTttIG5vdCBydW5uaW5nIGh5cGVyY29udmVyZ2VkIHNldHVwLCBidXQganVz dCBmb3IgcmVmZXJlbmNlIGkmIzM5O2xsPGJyPgpkZXNjcmliZSBteSBzZXR1cDo8YnI+Cjxicj4K MiBjbHVzdGVycyAoNisyKSBIUEUgQkw0NjAgRzkgd2l0aCA1MTIgR0Igb2YgcmFtIGVhY2guIE9u IHRoZSBjbHVzdGVyPGJyPgpjb21wb3NlZCBieSB0d28gbm9kZXMgd2UmIzM5O3JlIHJ1bm5pbmcg c2VsZi1ob3N0ZWQgZW5naW5lLjxicj4KPGJyPgpUaGUgc3RvcmFnZSBiYWNrZW5kIGlzIEZDIGZv ciBib3RoIChFTUMgVk5YODAwMCBmb3IgdGhlIGJpZ2dlc3Qgb25lPGJyPgphbmQgRU1DIFZQTEVY IHdpdGggVk1BWCBhcyBkaXNrIGJhY2tlbmQgb24gdGhlIHNtYWxsZXN0IG9uZSkuPGJyPgo8YnI+ Ckx1Y2E8YnI+Cjxicj4KPGJyPgotLTxicj4KJnF1b3Q7RSYjMzk7IGFzc3VyZG8gaW1waWVnYXJl IGdsaSB1b21pbmkgZGkgaW50ZWxsaWdlbnphIGVjY2VsbGVudGUgcGVyIGZhcmU8YnI+CmNhbGNv bGkgY2hlIHBvdHJlYmJlcm8gZXNzZXJlIGFmZmlkYXRpIGEgY2hpdW5xdWUgc2Ugc2kgdXNhc3Nl cm8gZGVsbGU8YnI+Cm1hY2NoaW5lJnF1b3Q7PGJyPgpHb3R0ZnJpZWQgV2lsaGVsbSB2b24gTGVp Ym5pdHosIEZpbG9zb2ZvIGUgTWF0ZW1hdGljbyAoMTY0Ni0xNzE2KTxicj4KPGJyPgomcXVvdDtJ bnRlcm5ldCDDqCBsYSBwacO5IGdyYW5kZSBiaWJsaW90ZWNhIGRlbCBtb25kby48YnI+Ck1hIGls IHByb2JsZW1hIMOoIGNoZSBpIGxpYnJpIHNvbm8gdHV0dGkgc3BhcnNpIHN1bCBwYXZpbWVudG8m cXVvdDs8YnI+CkpvaG4gQWxsZW4gUGF1bG9zLCBNYXRlbWF0aWNvICgxOTQ1LXZpdmVudGUpPGJy Pgo8YnI+Ckx1Y2EgJiMzOTtyZW1peF90aiYjMzk7IExvcmVuemV0dG8sIDxhIGhyZWY9Imh0dHA6 Ly93d3cucmVtaXh0ai5uZXQiIHJlbD0ibm9yZWZlcnJlciBub3JlZmVycmVyIiB0YXJnZXQ9Il9i bGFuayI+aHR0cDovL3d3dy5yZW1peHRqLm5ldDwvYT4gLCAmbHQ7PGEgaHJlZj0ibWFpbHRvOmxv cmVuemV0dG8ubHVjYUBnbWFpbC5jb20iIHRhcmdldD0iX2JsYW5rIiByZWw9Im5vcmVmZXJyZXIi PmxvcmVuemV0dG8ubHVjYUBnbWFpbC5jb208L2E+Jmd0Ozxicj4KX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxicj4K PGEgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiIHJlbD0ibm9y ZWZlcnJlciI+VXNlcnNAb3ZpcnQub3JnPC9hPjxicj4KPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92 aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiByZWw9Im5vcmVmZXJyZXIgbm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5m by91c2VyczwvYT48YnI+CjwvYmxvY2txdW90ZT48L2Rpdj4K --===============6688180900982251079==-- From lorenzetto.luca at gmail.com Mon Mar 26 07:27:30 2018 Content-Type: multipart/mixed; boundary="===============5932304200030000994==" MIME-Version: 1.0 From: Luca 'remix_tj' Lorenzetto To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Mon, 26 Mar 2018 09:27:28 +0200 Message-ID: In-Reply-To: CABMULtJi8eO9ZJXHjwJzhnXaiDD7sDUGs2OUaPgPP=CpQyWGGg@mail.gmail.com --===============5932304200030000994== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Sorry Andy, forgot to write the density. On the first cluster (6 nodes) we're running 225 VMs at the moment On the second one (2 nodes) we're running 42 VMs + the engine. This setup is running since last July. Just for completness, we've just set up another environment with the same sizing (2 sockets + 512gb ram) and distribution (6+2) but different hardware (Lenovo x240 M5 IIRC) for hosting production VMs. At the moment there are few VMs, but we're planning to migrate over 300 VMs. Same storage backend. Luca On Mon, Mar 26, 2018 at 9:19 AM, Alex K wrote: > Hi Luca, > > You have 2 node cluster with 512 GB each host to run engine only? > > How many vms are u running at the compute nodes? > > Alex > > On Mon, Mar 26, 2018, 10:02 Luca 'remix_tj' Lorenzetto > wrote: >> >> On Sat, Mar 24, 2018 at 9:33 AM, Andy Michielsen >> wrote: >> > Hi all, >> > >> > Not sure if this is the place to be asking this but I was wondering >> > which hardware you all are using and why in order for me to see what I= would >> > be needing. >> > >> > I would like to set up a HA cluster consisting off 3 hosts to be able = to >> > run 30 vm=E2=80=99s. >> > The engine, I can run on an other server. The hosts can be fitted with >> > the storage and share the space through glusterfs. I would think I wil= l be >> > needing at least 3 nic=E2=80=99s but would be able to install ovn. (Ar= e 1gb nic=E2=80=99s >> > sufficient ?) >> > >> > Any input you guys would like to share would be greatly appriciated. >> >> Hello Andy, >> >> i'm not running hyperconverged setup, but just for reference i'll >> describe my setup: >> >> 2 clusters (6+2) HPE BL460 G9 with 512 GB of ram each. On the cluster >> composed by two nodes we're running self-hosted engine. >> >> The storage backend is FC for both (EMC VNX8000 for the biggest one >> and EMC VPLEX with VMAX as disk backend on the smallest one). >> >> Luca >> >> >> -- >> "E' assurdo impiegare gli uomini di intelligenza eccellente per fare >> calcoli che potrebbero essere affidati a chiunque se si usassero delle >> macchine" >> Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) >> >> "Internet =C3=A8 la pi=C3=B9 grande biblioteca del mondo. >> Ma il problema =C3=A8 che i libri sono tutti sparsi sul pavimento" >> John Allen Paulos, Matematico (1945-vivente) >> >> Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users -- = "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet =C3=A8 la pi=C3=B9 grande biblioteca del mondo. Ma il problema =C3=A8 che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , --===============5932304200030000994==-- From hawk at tbi.univie.ac.at Mon Mar 26 08:26:32 2018 Content-Type: multipart/mixed; boundary="===============2530324020330386226==" MIME-Version: 1.0 From: Richard Neuboeck To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Mon, 26 Mar 2018 09:42:57 +0200 Message-ID: In-Reply-To: 545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E@gmail.com --===============2530324020330386226== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o Content-Type: multipart/mixed; boundary=3D"7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4= F"; protected-headers=3D"v1" From: Richard Neuboeck To: users(a)ovirt.org Message-ID: Subject: Re: [ovirt-users] Which hardware are you using for oVirt References: <815987B5-31DA-4316-809D-A03363A1E3C3(a)gmail.com> <1701ED12-9ED4-46B9-96E5-1FD3E32419DD(a)gmail.com> <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E(a)gmail.com> In-Reply-To: <545F49C7-9AFE-4BE3-B03B-3FB1DEE1F09E(a)gmail.com> --7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F Content-Type: text/plain; charset=3Dutf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Hi Andy, we have 3 hosts for virtualization. Each 40 Cores, 512GB RAM, RAID 1 for the system, 4 bonded (onboard) 1Gbit NICs for client access (to the VMs) and a 10GBit NIC for the storage network. The storage is built of 3 hosts, 10Gbit NIC, RAID 6 (5TB HDDs and SSDs for caching) and gluster in replica 3 mode. Cheers Richard On 25.03.18 09:36, Andy Michielsen wrote: > Hello Alex, >=3D20 > Thanks for sharing. Much appriciated. >=3D20 > I believe my setup would need 96 Gb off RAM in each host, and would nee= =3D d > about at least 3 Tb of storage. Probably 4 Tb would be beter if I want > to work with snapshots. (Will be running mostly windows 2016 servers or= =3D > windows 10 desktops with 6Gb off RAM and 100 Gb of disks) >=3D20 > I agree that a 10 Gb network for storage would be very beneficial. >=3D20 > Now If I can figure out how to set up a glusterfs on a 3 node cluster i= =3D n > oVirt 4.2 just for the data storage. I =3DE2=3D80=3D98m golden to get sta= rted=3D =3D2E :-) >=3D20 > Kind regards. >=3D20 > On 24 Mar 2018, at 20:08, Alex K > wrote: >=3D20 >> I have 2 or 3 node clusters with following hardware (all with >> self-hosted engine) : >> >> 2 node cluster: >> RAM: 64 GB per host >> CPU: 8 cores per host >> Storage: 4x 1TB SAS in RAID10 >> NIC: 2x Gbit >> VMs: 20 >> >> The above, although I would like to have had a third NIC for gluster >> storage redundancy, it is running smoothly for quite some time and >> without performance issues. >> The VMs it is running are not high on IO (mostly small Linux servers).= =3D >> >> 3 node clusters: >> RAM: 32 GB per host >> CPU: 16 cores per host >> Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage >> space without purchasing extra disks) >> NIC: 6x Gbit >> VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 1= =3D 0) >> >> For your setup (30 VMs) I would rather go with RAID10 SAS disks and at= =3D >> least a dual 10Gbit NIC dedicated to the gluster traffic only. >> >> Alex >> >> >> On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen >> > wrote: >> >> Hello Andrei, >> >> Thank you very much for sharing info on your hardware setup. Very >> informative. >> >> At this moment I have my ovirt engine on our vmware environment >> which is fine for good backup and restore. >> >> I have 4 nodes running now all different in make and model with >> local storage and it works but lacks performance a bit. >> >> But I can get my hands on some old dell=3DE2=3D80=3D99s R415 with 96= Gb =3D of ram >> and 2 quadcores and 6 x 1 Gb nic=3DE2=3D80=3D99s. They all come with= 2 x=3D 146 Gb >> 15000 rpm=3DE2=3D80=3D99s harddisks. This isn=3DE2=3D80=3D99t bad bu= t I will a=3D dd more RAM for >> starters. Also I would like to have some good redundant storage >> for this too and the servers have limited space to add that. >> >> Hopefully others will also share there setups and expirience like >> you did. >> >> Kind regards. >> >> On 24 Mar 2018, at 10:35, Andrei Verovski > > wrote: >> >>> Hi, >>> >>> HL ProLiant DL380, dual Xeon >>> 120 GB RAID L1 for system >>> 2 TB RAID L10 for VM disks >>> 5 VMs, 3 Linux, 2 Windows >>> Total CPU load most of the time is=3DC2=3DA0 low, high level of act= iv=3D ity >>> related to disk. >>> Host engine under KVM appliance on SuSE, can be easily moved, >>> backed up, copied, experimented with, etc. >>> >>> You'll have to use servers with more RAM and storage than main. >>> More then one NIC required if some of your VMs are on different >>> subnets, e.g. 1 in internal zone and 2nd on DMZ. >>> For your setup 10 GB NICs + L3 Switch for ovirtmgmt. >>> >>> BTW, I would suggest to have several separate hardware RAIDs >>> unless you have SSD, otherwise limit of the disk system I/O will >>> be a bottleneck. Consider SSD L1 RAID for heavy-loaded databases.= =3D >>> >>> *Please note many cheap SSDs do NOT work reliably with SAS >>> controllers even in SATA mode*. >>> >>> For example, I supposed to use 2 x WD Green SSD configures as >>> RAID L1 for OS. >>> It was possible to install system, yet under heavy load simulated= =3D >>> with iozone disk system freeze, rendering OS unbootable. >>> Same crash was experienced with 512GB KingFast SSD connected to >>> broadcom/AMCC SAS RAID Card. >>> >>> >>> On 03/24/2018 10:33 AM, Andy Michielsen wrote: >>>> Hi all, >>>> >>>> Not sure if this is the place to be asking this but I was wonder= =3D ing which hardware you all are using and why in order for me to see what = =3D I would be needing. >>>> >>>> I would like to set up a HA cluster consisting off 3 hosts to be= =3D able to run 30 vm=3DE2=3D80=3D99s. >>>> The engine, I can run on an other server. The hosts can be fitte= =3D d with the storage and share the space through glusterfs. I would think I= =3D will be needing at least 3 nic=3DE2=3D80=3D99s but would be able to instal= l ov=3D n. (Are 1gb nic=3DE2=3D80=3D99s sufficient ?) >>>> >>>> Any input you guys would like to share would be greatly appricia= =3D ted. >>>> >>>> Thanks, >>>> _______________________________________________ >>>> Users mailing list >>>> Users(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>> >>> >>> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> >> >=3D20 >=3D20 > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users >=3D20 --7NT1xWEOC6g4SNggAbskfGEZF9hpEIL4F-- --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o Content-Type: application/pgp-signature; name=3D"signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename=3D"signature.asc" -----BEGIN PGP SIGNATURE----- iHQEARECADQWIQQH3Gy5jXqjdPfp3qKcaiGA6s70YQUCWrikgRYcaGF3a0B0Ymku dW5pdmllLmFjLmF0AAoJEJxqIYDqzvRh7oUAoPhxFVG6Rq/9n12MqHFjD/VAIHPI AKDJjxGOtzvHcCRN/H+h8UgEFBNmfQ=3D=3D =3De9ez -----END PGP SIGNATURE----- --Otw9dz9x11zAjj8g4jYNmTEKPlPgL4W9o-- --===============2530324020330386226== Content-Type: multipart/signed MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhbiBPcGVuUEdQL01JTUUgc2lnbmVkIG1lc3NhZ2UgKFJGQyA0ODgwIGFuZCAzMTU2 KQotLU90dzlkejl4MTF6QWpqOGc0allObVRFS1BsUGdMNFc5bwpDb250ZW50LVR5cGU6IG11bHRp cGFydC9taXhlZDsgYm91bmRhcnk9IjdOVDF4V0VPQzZnNFNOZ2dBYnNrZkdFWkY5aHBFSUw0RiI7 CiBwcm90ZWN0ZWQtaGVhZGVycz0idjEiCkZyb206IFJpY2hhcmQgTmV1Ym9lY2sgPGhhd2tAdGJp LnVuaXZpZS5hYy5hdD4KVG86IHVzZXJzQG92aXJ0Lm9yZwpNZXNzYWdlLUlEOiA8YjcxYmVkMTIt ZjliNi1iYmRhLTY0ZjItZTk5YjQ3MTYwZTMwQHRiaS51bml2aWUuYWMuYXQ+ClN1YmplY3Q6IFJl OiBbb3ZpcnQtdXNlcnNdIFdoaWNoIGhhcmR3YXJlIGFyZSB5b3UgdXNpbmcgZm9yIG9WaXJ0ClJl ZmVyZW5jZXM6IDw4MTU5ODdCNS0zMURBLTQzMTYtODA5RC1BMDMzNjNBMUUzQzNAZ21haWwuY29t PgogPGNkY2E5Y2NkLThjMTUtMWNkYi1lYWQ2LTg0NTY3ZjIyNmVhNEBzdGFybGV0dC5sdj4KIDwx NzAxRUQxMi05RUQ0LTQ2QjktOTZFNS0xRkQzRTMyNDE5RERAZ21haWwuY29tPgogPENBQk1VTHRL UHZaUkRSa0J5SDNXeVhiWlFIdVNaWTRvNz1oTndOcXZSRHNWPSs2eWp0Z0BtYWlsLmdtYWlsLmNv bT4KIDw1NDVGNDlDNy05QUZFLTRCRTMtQjAzQi0zRkIxREVFMUYwOUVAZ21haWwuY29tPgpJbi1S ZXBseS1UbzogPDU0NUY0OUM3LTlBRkUtNEJFMy1CMDNCLTNGQjFERUUxRjA5RUBnbWFpbC5jb20+ CgotLTdOVDF4V0VPQzZnNFNOZ2dBYnNrZkdFWkY5aHBFSUw0RgpDb250ZW50LVR5cGU6IHRleHQv cGxhaW47IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1MYW5ndWFnZTogZW4tVVMKQ29udGVudC1UcmFu c2Zlci1FbmNvZGluZzogcXVvdGVkLXByaW50YWJsZQoKSGkgQW5keSwKCndlIGhhdmUgMyBob3N0 cyBmb3IgdmlydHVhbGl6YXRpb24uIEVhY2ggNDAgQ29yZXMsIDUxMkdCIFJBTSwgUkFJRCAxIGZv cgp0aGUgc3lzdGVtLCA0IGJvbmRlZCAob25ib2FyZCkgMUdiaXQgTklDcyBmb3IgY2xpZW50IGFj Y2VzcyAodG8gdGhlIFZNcykKYW5kIGEgMTBHQml0IE5JQyBmb3IgdGhlIHN0b3JhZ2UgbmV0d29y ay4KVGhlIHN0b3JhZ2UgaXMgYnVpbHQgb2YgMyBob3N0cywgMTBHYml0IE5JQywgUkFJRCA2ICg1 VEIgSEREcyBhbmQgU1NEcwpmb3IgY2FjaGluZykgYW5kIGdsdXN0ZXIgaW4gcmVwbGljYSAzIG1v ZGUuCgpDaGVlcnMKUmljaGFyZAoKT24gMjUuMDMuMTggMDk6MzYsIEFuZHkgTWljaGllbHNlbiB3 cm90ZToKPiBIZWxsbyBBbGV4LAo+PTIwCj4gVGhhbmtzIGZvciBzaGFyaW5nLiBNdWNoIGFwcHJp Y2lhdGVkLgo+PTIwCj4gSSBiZWxpZXZlIG15IHNldHVwIHdvdWxkIG5lZWQgOTYgR2Igb2ZmIFJB TSBpbiBlYWNoIGhvc3QsIGFuZCB3b3VsZCBuZWU9CmQKPiBhYm91dCBhdCBsZWFzdCAzIFRiIG9m IHN0b3JhZ2UuIFByb2JhYmx5IDQgVGIgd291bGQgYmUgYmV0ZXIgaWYgSSB3YW50Cj4gdG8gd29y ayB3aXRoIHNuYXBzaG90cy4gKFdpbGwgYmUgcnVubmluZyBtb3N0bHkgd2luZG93cyAyMDE2IHNl cnZlcnMgb3I9Cgo+IHdpbmRvd3MgMTAgZGVza3RvcHMgd2l0aCA2R2Igb2ZmIFJBTSBhbmQgMTAw IEdiIG9mIGRpc2tzKQo+PTIwCj4gSSBhZ3JlZSB0aGF0IGEgMTAgR2IgbmV0d29yayBmb3Igc3Rv cmFnZSB3b3VsZCBiZSB2ZXJ5IGJlbmVmaWNpYWwuCj49MjAKPiBOb3cgSWYgSSBjYW4gZmlndXJl IG91dCBob3cgdG8gc2V0IHVwIGEgZ2x1c3RlcmZzIG9uIGEgMyBub2RlIGNsdXN0ZXIgaT0Kbgo+ IG9WaXJ0IDQuMiBqdXN0IGZvciB0aGUgZGF0YSBzdG9yYWdlLiBJID1FMj04MD05OG0gZ29sZGVu IHRvIGdldCBzdGFydGVkPQo9MkUgOi0pCj49MjAKPiBLaW5kIHJlZ2FyZHMuCj49MjAKPiBPbiAy NCBNYXIgMjAxOCwgYXQgMjA6MDgsIEFsZXggSyA8cmlnaHRraWNrdGVjaEBnbWFpbC5jb20KPiA8 bWFpbHRvOnJpZ2h0a2lja3RlY2hAZ21haWwuY29tPj4gd3JvdGU6Cj49MjAKPj4gSSBoYXZlIDIg b3IgMyBub2RlIGNsdXN0ZXJzIHdpdGggZm9sbG93aW5nIGhhcmR3YXJlIChhbGwgd2l0aAo+PiBz ZWxmLWhvc3RlZCBlbmdpbmUpIDoKPj4KPj4gMiBub2RlIGNsdXN0ZXI6Cj4+IFJBTTogNjQgR0Ig cGVyIGhvc3QKPj4gQ1BVOiA4IGNvcmVzIHBlciBob3N0Cj4+IFN0b3JhZ2U6IDR4IDFUQiBTQVMg aW4gUkFJRDEwCj4+IE5JQzogMnggR2JpdAo+PiBWTXM6IDIwCj4+Cj4+IFRoZSBhYm92ZSwgYWx0 aG91Z2ggSSB3b3VsZCBsaWtlIHRvIGhhdmUgaGFkIGEgdGhpcmQgTklDIGZvciBnbHVzdGVyCj4+ IHN0b3JhZ2UgcmVkdW5kYW5jeSwgaXQgaXMgcnVubmluZyBzbW9vdGhseSBmb3IgcXVpdGUgc29t ZSB0aW1lIGFuZAo+PiB3aXRob3V0IHBlcmZvcm1hbmNlIGlzc3Vlcy4KPj4gVGhlIFZNcyBpdCBp cyBydW5uaW5nIGFyZSBub3QgaGlnaCBvbiBJTyAobW9zdGx5IHNtYWxsIExpbnV4IHNlcnZlcnMp Lj0KCj4+Cj4+IDMgbm9kZSBjbHVzdGVyczoKPj4gUkFNOiAzMiBHQiBwZXIgaG9zdAo+PiBDUFU6 IDE2IGNvcmVzIHBlciBob3N0Cj4+IFN0b3JhZ2U6IDV4IDYwMEdCIGluIFJBSUQ1IChub3QgaWRl YWwgYnV0IEkgaGFkIHRvIGdhaW4gc29tZSBzdG9yYWdlCj4+IHNwYWNlIHdpdGhvdXQgcHVyY2hh c2luZyBleHRyYSBkaXNrcykKPj4gTklDOiA2eCBHYml0Cj4+IFZNczogbGVzcyB0aGVuIDEwIGxh cmdlIFdpbmRvd3MgVk1zIChXaW5kb3dzIDIwMTYgc2VydmVyIGFuZCBXaW5kb3dzIDE9CjApCj4+ Cj4+IEZvciB5b3VyIHNldHVwICgzMCBWTXMpIEkgd291bGQgcmF0aGVyIGdvIHdpdGggUkFJRDEw IFNBUyBkaXNrcyBhbmQgYXQ9Cgo+PiBsZWFzdCBhIGR1YWwgMTBHYml0IE5JQyBkZWRpY2F0ZWQg dG8gdGhlIGdsdXN0ZXIgdHJhZmZpYyBvbmx5Lgo+Pgo+PiBBbGV4Cj4+Cj4+Cj4+IE9uIFNhdCwg TWFyIDI0LCAyMDE4IGF0IDE6MjQgUE0sIEFuZHkgTWljaGllbHNlbgo+PiA8YW5keS5taWNoaWVs c2VuQGdtYWlsLmNvbSA8bWFpbHRvOmFuZHkubWljaGllbHNlbkBnbWFpbC5jb20+PiB3cm90ZToK Pj4KPj4gICAgIEhlbGxvIEFuZHJlaSwKPj4KPj4gICAgIFRoYW5rIHlvdSB2ZXJ5IG11Y2ggZm9y IHNoYXJpbmcgaW5mbyBvbiB5b3VyIGhhcmR3YXJlIHNldHVwLiBWZXJ5Cj4+ICAgICBpbmZvcm1h dGl2ZS4KPj4KPj4gICAgIEF0IHRoaXMgbW9tZW50IEkgaGF2ZSBteSBvdmlydCBlbmdpbmUgb24g b3VyIHZtd2FyZSBlbnZpcm9ubWVudAo+PiAgICAgd2hpY2ggaXMgZmluZSBmb3IgZ29vZCBiYWNr dXAgYW5kIHJlc3RvcmUuCj4+Cj4+ICAgICBJIGhhdmUgNCBub2RlcyBydW5uaW5nIG5vdyBhbGwg ZGlmZmVyZW50IGluIG1ha2UgYW5kIG1vZGVsIHdpdGgKPj4gICAgIGxvY2FsIHN0b3JhZ2UgYW5k IGl0IHdvcmtzIGJ1dCBsYWNrcyBwZXJmb3JtYW5jZSBhIGJpdC4KPj4KPj4gICAgIEJ1dCBJIGNh biBnZXQgbXkgaGFuZHMgb24gc29tZSBvbGQgZGVsbD1FMj04MD05OXMgUjQxNSB3aXRoIDk2IEdi ID0Kb2YgcmFtCj4+ICAgICBhbmQgMiBxdWFkY29yZXMgYW5kIDYgeCAxIEdiIG5pYz1FMj04MD05 OXMuIFRoZXkgYWxsIGNvbWUgd2l0aCAyIHg9CiAxNDYgR2IKPj4gICAgIDE1MDAwIHJwbT1FMj04 MD05OXMgaGFyZGRpc2tzLiBUaGlzIGlzbj1FMj04MD05OXQgYmFkIGJ1dCBJIHdpbGwgYT0KZGQg bW9yZSBSQU0gZm9yCj4+ICAgICBzdGFydGVycy4gQWxzbyBJIHdvdWxkIGxpa2UgdG8gaGF2ZSBz b21lIGdvb2QgcmVkdW5kYW50IHN0b3JhZ2UKPj4gICAgIGZvciB0aGlzIHRvbyBhbmQgdGhlIHNl cnZlcnMgaGF2ZSBsaW1pdGVkIHNwYWNlIHRvIGFkZCB0aGF0Lgo+Pgo+PiAgICAgSG9wZWZ1bGx5 IG90aGVycyB3aWxsIGFsc28gc2hhcmUgdGhlcmUgc2V0dXBzIGFuZCBleHBpcmllbmNlIGxpa2UK Pj4gICAgIHlvdSBkaWQuCj4+Cj4+ICAgICBLaW5kIHJlZ2FyZHMuCj4+Cj4+ICAgICBPbiAyNCBN YXIgMjAxOCwgYXQgMTA6MzUsIEFuZHJlaSBWZXJvdnNraSA8YW5kcmVpbDFAc3RhcmxldHQubHYK Pj4gICAgIDxtYWlsdG86YW5kcmVpbDFAc3RhcmxldHQubHY+PiB3cm90ZToKPj4KPj4+ICAgICBI aSwKPj4+Cj4+PiAgICAgSEwgUHJvTGlhbnQgREwzODAsIGR1YWwgWGVvbgo+Pj4gICAgIDEyMCBH QiBSQUlEIEwxIGZvciBzeXN0ZW0KPj4+ICAgICAyIFRCIFJBSUQgTDEwIGZvciBWTSBkaXNrcwo+ Pj4gICAgIDUgVk1zLCAzIExpbnV4LCAyIFdpbmRvd3MKPj4+ICAgICBUb3RhbCBDUFUgbG9hZCBt b3N0IG9mIHRoZSB0aW1lIGlzPUMyPUEwIGxvdywgaGlnaCBsZXZlbCBvZiBhY3Rpdj0KaXR5Cj4+ PiAgICAgcmVsYXRlZCB0byBkaXNrLgo+Pj4gICAgIEhvc3QgZW5naW5lIHVuZGVyIEtWTSBhcHBs aWFuY2Ugb24gU3VTRSwgY2FuIGJlIGVhc2lseSBtb3ZlZCwKPj4+ICAgICBiYWNrZWQgdXAsIGNv cGllZCwgZXhwZXJpbWVudGVkIHdpdGgsIGV0Yy4KPj4+Cj4+PiAgICAgWW91J2xsIGhhdmUgdG8g dXNlIHNlcnZlcnMgd2l0aCBtb3JlIFJBTSBhbmQgc3RvcmFnZSB0aGFuIG1haW4uCj4+PiAgICAg TW9yZSB0aGVuIG9uZSBOSUMgcmVxdWlyZWQgaWYgc29tZSBvZiB5b3VyIFZNcyBhcmUgb24gZGlm ZmVyZW50Cj4+PiAgICAgc3VibmV0cywgZS5nLiAxIGluIGludGVybmFsIHpvbmUgYW5kIDJuZCBv biBETVouCj4+PiAgICAgRm9yIHlvdXIgc2V0dXAgMTAgR0IgTklDcyArIEwzIFN3aXRjaCBmb3Ig b3ZpcnRtZ210Lgo+Pj4KPj4+ICAgICBCVFcsIEkgd291bGQgc3VnZ2VzdCB0byBoYXZlIHNldmVy YWwgc2VwYXJhdGUgaGFyZHdhcmUgUkFJRHMKPj4+ICAgICB1bmxlc3MgeW91IGhhdmUgU1NELCBv dGhlcndpc2UgbGltaXQgb2YgdGhlIGRpc2sgc3lzdGVtIEkvTyB3aWxsCj4+PiAgICAgYmUgYSBi b3R0bGVuZWNrLiBDb25zaWRlciBTU0QgTDEgUkFJRCBmb3IgaGVhdnktbG9hZGVkIGRhdGFiYXNl cy49Cgo+Pj4KPj4+ICAgICAqUGxlYXNlIG5vdGUgbWFueSBjaGVhcCBTU0RzIGRvIE5PVCB3b3Jr IHJlbGlhYmx5IHdpdGggU0FTCj4+PiAgICAgY29udHJvbGxlcnMgZXZlbiBpbiBTQVRBIG1vZGUq Lgo+Pj4KPj4+ICAgICBGb3IgZXhhbXBsZSwgSSBzdXBwb3NlZCB0byB1c2UgMiB4IFdEIEdyZWVu IFNTRCBjb25maWd1cmVzIGFzCj4+PiAgICAgUkFJRCBMMSBmb3IgT1MuCj4+PiAgICAgSXQgd2Fz IHBvc3NpYmxlIHRvIGluc3RhbGwgc3lzdGVtLCB5ZXQgdW5kZXIgaGVhdnkgbG9hZCBzaW11bGF0 ZWQ9Cgo+Pj4gICAgIHdpdGggaW96b25lIGRpc2sgc3lzdGVtIGZyZWV6ZSwgcmVuZGVyaW5nIE9T IHVuYm9vdGFibGUuCj4+PiAgICAgU2FtZSBjcmFzaCB3YXMgZXhwZXJpZW5jZWQgd2l0aCA1MTJH QiBLaW5nRmFzdCBTU0QgY29ubmVjdGVkIHRvCj4+PiAgICAgYnJvYWRjb20vQU1DQyBTQVMgUkFJ RCBDYXJkLgo+Pj4KPj4+Cj4+PiAgICAgT24gMDMvMjQvMjAxOCAxMDozMyBBTSwgQW5keSBNaWNo aWVsc2VuIHdyb3RlOgo+Pj4+ICAgICBIaSBhbGwsCj4+Pj4KPj4+PiAgICAgTm90IHN1cmUgaWYg dGhpcyBpcyB0aGUgcGxhY2UgdG8gYmUgYXNraW5nIHRoaXMgYnV0IEkgd2FzIHdvbmRlcj0KaW5n IHdoaWNoIGhhcmR3YXJlIHlvdSBhbGwgYXJlIHVzaW5nIGFuZCB3aHkgaW4gb3JkZXIgZm9yIG1l IHRvIHNlZSB3aGF0ID0KSSB3b3VsZCBiZSBuZWVkaW5nLgo+Pj4+Cj4+Pj4gICAgIEkgd291bGQg bGlrZSB0byBzZXQgdXAgYSBIQSBjbHVzdGVyIGNvbnNpc3Rpbmcgb2ZmIDMgaG9zdHMgdG8gYmU9 CiBhYmxlIHRvIHJ1biAzMCB2bT1FMj04MD05OXMuCj4+Pj4gICAgIFRoZSBlbmdpbmUsIEkgY2Fu IHJ1biBvbiBhbiBvdGhlciBzZXJ2ZXIuIFRoZSBob3N0cyBjYW4gYmUgZml0dGU9CmQgd2l0aCB0 aGUgc3RvcmFnZSBhbmQgc2hhcmUgdGhlIHNwYWNlIHRocm91Z2ggZ2x1c3RlcmZzLiBJIHdvdWxk IHRoaW5rIEk9CiB3aWxsIGJlIG5lZWRpbmcgYXQgbGVhc3QgMyBuaWM9RTI9ODA9OTlzIGJ1dCB3 b3VsZCBiZSBhYmxlIHRvIGluc3RhbGwgb3Y9Cm4uIChBcmUgMWdiIG5pYz1FMj04MD05OXMgc3Vm ZmljaWVudCA/KQo+Pj4+Cj4+Pj4gICAgIEFueSBpbnB1dCB5b3UgZ3V5cyB3b3VsZCBsaWtlIHRv IHNoYXJlIHdvdWxkIGJlIGdyZWF0bHkgYXBwcmljaWE9CnRlZC4KPj4+Pgo+Pj4+ICAgICBUaGFu a3MsCj4+Pj4gICAgIF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fCj4+Pj4gICAgIFVzZXJzIG1haWxpbmcgbGlzdAo+Pj4+ICAgICBVc2Vyc0BvdmlydC5vcmcg PG1haWx0bzpVc2Vyc0BvdmlydC5vcmc+Cj4+Pj4gICAgIGh0dHA6Ly9saXN0cy5vdmlydC5vcmcv bWFpbG1hbi9saXN0aW5mby91c2Vycwo+Pj4+ICAgICA8aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9t YWlsbWFuL2xpc3RpbmZvL3VzZXJzPgo+Pj4KPj4+Cj4+Cj4+ICAgICBfX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+PiAgICAgVXNlcnMgbWFpbGluZyBsaXN0 Cj4+ICAgICBVc2Vyc0BvdmlydC5vcmcgPG1haWx0bzpVc2Vyc0BvdmlydC5vcmc+Cj4+ICAgICBo dHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKPj4gICAgIDxodHRw Oi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM+Cj4+Cj4+Cj49MjAKPj0y MAo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4gVXNl cnMgbWFpbGluZyBsaXN0Cj4gVXNlcnNAb3ZpcnQub3JnCj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9y Zy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCj49MjAKCgotLTdOVDF4V0VPQzZnNFNOZ2dBYnNrZkdF WkY5aHBFSUw0Ri0tCgotLU90dzlkejl4MTF6QWpqOGc0allObVRFS1BsUGdMNFc5bwpDb250ZW50 LVR5cGU6IGFwcGxpY2F0aW9uL3BncC1zaWduYXR1cmU7IG5hbWU9InNpZ25hdHVyZS5hc2MiCkNv bnRlbnQtRGVzY3JpcHRpb246IE9wZW5QR1AgZGlnaXRhbCBzaWduYXR1cmUKQ29udGVudC1EaXNw b3NpdGlvbjogYXR0YWNobWVudDsgZmlsZW5hbWU9InNpZ25hdHVyZS5hc2MiCgotLS0tLUJFR0lO IFBHUCBTSUdOQVRVUkUtLS0tLQoKaUhRRUFSRUNBRFFXSVFRSDNHeTVqWHFqZFBmcDNxS2NhaUdB NnM3MFlRVUNXcmlrZ1JZY2FHRjNhMEIwWW1rdQpkVzVwZG1sbExtRmpMbUYwQUFvSkVKeHFJWURx enZSaDdvVUFvUGh4RlZHNlJxLzluMTJNcUhGakQvVkFJSFBJCkFLREpqeEdPdHp2SGNDUk4vSCto OFVnRUZCTm1mUT09Cj1lOWV6Ci0tLS0tRU5EIFBHUCBTSUdOQVRVUkUtLS0tLQoKLS1PdHc5ZHo5 eDExekFqajhnNGpZTm1URUtQbFBnTDRXOW8tLQo= --===============2530324020330386226==-- From ccox at endlessnow.com Mon Mar 26 16:03:49 2018 Content-Type: multipart/mixed; boundary="===============3496977470676229089==" MIME-Version: 1.0 From: Christopher Cox To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Mon, 26 Mar 2018 11:03:31 -0500 Message-ID: In-Reply-To: 815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com --===============3496977470676229089== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On 03/24/2018 03:33 AM, Andy Michielsen wrote: > Hi all, > = > Not sure if this is the place to be asking this but I was wondering which= hardware you all are using and why in order for me to see what I would be = needing. > = > I would like to set up a HA cluster consisting off 3 hosts to be able to = run 30 vm=E2=80=99s. > The engine, I can run on an other server. The hosts can be fitted with th= e storage and share the space through glusterfs. I would think I will be ne= eding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb n= ic=E2=80=99s sufficient ?) Just because you asked, but not because this is helpful to you.... But first, a comment on "3 hosts to be able to run 30 VMs". The SPM = node shouldn't run a lot of VMs. There are settings (the setting slips = my mind) on the engine to give it a "virtual set" of VMs in order to = keep VMs off of it. With that said, CPU wise, it doesn't require a lot to run 30 VM's. The = costly thing is memory (in general). So while a cheap set of 3 machines = might handle the CPU requirements of 30 VM's, those cheap machines might = not be able to give you the memory you need (depends). You might be = fine. I mean, there are cheap desktop like machines that do 64G (and = sometimes more). Just something to keep in mind. Memory and storage = will be the most costly items. It's simple math. Linux hosts, of = course, don't necessarily need much memory (or storage). But Windows... 1Gbit NIC's are "ok", but again, depends on storage. Glusterfs is no = speed demon. But you might not need "fast" storage. Lastly, your setup is just for "fun", right? Otherwise, read on. Running oVirt 3.6 (this is a production setup) ovirt engine (manager): Dell PowerEdge 430, 32G ovirt cluster nodes: Dell m1000e 1.1 backplane Blade Enclosure 9 x M630 Blades (2xE5-2669v3, 384GB), 4 iSCSI paths, 4 bonded LAN, all = 10GbE, CentOS 7.2 4 x MXL 10/40GbE (2x40Gbit LAN, 2x40Gbit iSCSI SAN to the S4810's) 120 VM's, CentOS 6, CentOS 7, Windows 10 Ent., Windows Server 2012 We've run on as few as 3 nodes. Network, SAN and Storage (for ovirt Domains): 2 x S4810 (part is used for SAN, part for LAN) Equallogic dual controller (note: passive/active) PS6610S (84 x 4TB 7.2K = SAS) Equallogic dual controller (note: passive/active) PS6610X (84 x 1TB 10K SAS ISO and Export Domains are handled by: Dell PE R620, 32G, 2x10Gbit LAN, 2x10Gbit iSCSI to the SAN (above), = CentOS 7.4, NFS What I like: * Easy setup. * Relatively good network and storage. What I don't like: * 2 "effective" networks, LAN and iSCSI. All networking uses the same = effective path. Would be nice to have more physical isolation for mgmt = vs motion vs VMs. QoS is provided in oVirt, but still, would be nice to = have the full pathways. * Storage doesn't use active/active controllers, so controller failover = is VERY slow. * We have a fast storage system, and somewhat slower storage system = (matter of IOPS), neither is SSD, so there isn't a huge difference. No = real redundancy or flexibility. * vdsm can no longer respond fast enough for the amount of disks defined = (in the event of a new Storage Domain add). We have raised vdsTimeout, = but have not tested yet. I inherited the "style" above. My recommendation of where to start for = a reasonable production instance, minimum (assumes the S4810's above, = not priced here): 1 x ovirt manager/engine, approx $1500 4 x Dell R620, 2xE5-2660, 768G, 6x10GbE (LAN, Storage, Motion), approx $42K 3 x Nexsan 18P 108TB, approx $96K While significantly cheaper (by 6 figures), it provides active/active = controllers, storage reliability and flexibility and better network = pathways. Why 4 x nodes? Need at least N+1 for reliability. The extra = 4th node is merely capacity. Why 3 x storage? Need at least N+1 for = reliability. Obviously, you'll still want to back things up and test the ability to = restore components like the ovirt engine from scratch. Btw, my recommended minimum above is regardless of hypervisor cluster = choice (could be VMware). --===============3496977470676229089==-- From andy.michielsen at gmail.com Wed Mar 28 06:50:09 2018 Content-Type: multipart/mixed; boundary="===============8309238546772567389==" MIME-Version: 1.0 From: Andy Michielsen To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Wed, 28 Mar 2018 08:50:05 +0200 Message-ID: In-Reply-To: dfeafce3-af81-c78f-5f17-57140923d86a@endlessnow.com --===============8309238546772567389== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hello Chritopher, Thank you very much for sharing. It started out just for fun but now people at work are looking at me to hav= e an environment to do testing, simulate problems they have encountered, et= c. And more an more off them see the benifits off this. At work we are running= vmware but that was far to expencieve to use it for these test. But as I s= uspected that was in the beginning and I knew I had to be able to expand so= whenever an old server was decommisioned from production I converted it to= an node. I now have 4 in use and demands keep growing. So now I want to ask my boss to invest in new hardware as now people are as= king me why I do not have proper backups and even why the can not use the v= m=E2=80=99s when I perform administrative tasks or upgrades. So that=E2=80=99s why I=E2=80=99m very inerested in what others are using. Kind regards. > On 26 Mar 2018, at 18:03, Christopher Cox wrote: > = >> On 03/24/2018 03:33 AM, Andy Michielsen wrote: >> Hi all, >> Not sure if this is the place to be asking this but I was wondering whic= h hardware you all are using and why in order for me to see what I would be= needing. >> I would like to set up a HA cluster consisting off 3 hosts to be able to= run 30 vm=E2=80=99s. >> The engine, I can run on an other server. The hosts can be fitted with t= he storage and share the space through glusterfs. I would think I will be n= eeding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb = nic=E2=80=99s sufficient ?) > = > Just because you asked, but not because this is helpful to you.... > = > But first, a comment on "3 hosts to be able to run 30 VMs". The SPM node= shouldn't run a lot of VMs. There are settings (the setting slips my mind= ) on the engine to give it a "virtual set" of VMs in order to keep VMs off = of it. > = > With that said, CPU wise, it doesn't require a lot to run 30 VM's. The c= ostly thing is memory (in general). So while a cheap set of 3 machines mig= ht handle the CPU requirements of 30 VM's, those cheap machines might not b= e able to give you the memory you need (depends). You might be fine. I me= an, there are cheap desktop like machines that do 64G (and sometimes more).= Just something to keep in mind. Memory and storage will be the most cost= ly items. It's simple math. Linux hosts, of course, don't necessarily nee= d much memory (or storage). But Windows... > = > 1Gbit NIC's are "ok", but again, depends on storage. Glusterfs is no spe= ed demon. But you might not need "fast" storage. > = > Lastly, your setup is just for "fun", right? Otherwise, read on. > = > = > Running oVirt 3.6 (this is a production setup) > = > ovirt engine (manager): > Dell PowerEdge 430, 32G > = > ovirt cluster nodes: > Dell m1000e 1.1 backplane Blade Enclosure > 9 x M630 Blades (2xE5-2669v3, 384GB), 4 iSCSI paths, 4 bonded LAN, all 10= GbE, CentOS 7.2 > 4 x MXL 10/40GbE (2x40Gbit LAN, 2x40Gbit iSCSI SAN to the S4810's) > = > 120 VM's, CentOS 6, CentOS 7, Windows 10 Ent., Windows Server 2012 > We've run on as few as 3 nodes. > = > Network, SAN and Storage (for ovirt Domains): > 2 x S4810 (part is used for SAN, part for LAN) > Equallogic dual controller (note: passive/active) PS6610S (84 x 4TB 7.2K = SAS) > Equallogic dual controller (note: passive/active) PS6610X (84 x 1TB 10K S= AS > = > ISO and Export Domains are handled by: > Dell PE R620, 32G, 2x10Gbit LAN, 2x10Gbit iSCSI to the SAN (above), CentO= S 7.4, NFS > = > What I like: > * Easy setup. > * Relatively good network and storage. > = > What I don't like: > * 2 "effective" networks, LAN and iSCSI. All networking uses the same ef= fective path. Would be nice to have more physical isolation for mgmt vs mo= tion vs VMs. QoS is provided in oVirt, but still, would be nice to have th= e full pathways. > * Storage doesn't use active/active controllers, so controller failover i= s VERY slow. > * We have a fast storage system, and somewhat slower storage system (matt= er of IOPS), neither is SSD, so there isn't a huge difference. No real re= dundancy or flexibility. > * vdsm can no longer respond fast enough for the amount of disks defined = (in the event of a new Storage Domain add). We have raised vdsTimeout, but= have not tested yet. > = > I inherited the "style" above. My recommendation of where to start for a= reasonable production instance, minimum (assumes the S4810's above, not pr= iced here): > = > 1 x ovirt manager/engine, approx $1500 > 4 x Dell R620, 2xE5-2660, 768G, 6x10GbE (LAN, Storage, Motion), approx $4= 2K > 3 x Nexsan 18P 108TB, approx $96K > = > While significantly cheaper (by 6 figures), it provides active/active con= trollers, storage reliability and flexibility and better network pathways. = Why 4 x nodes? Need at least N+1 for reliability. The extra 4th node is = merely capacity. Why 3 x storage? Need at least N+1 for reliability. > = > Obviously, you'll still want to back things up and test the ability to re= store components like the ovirt engine from scratch. > = > Btw, my recommended minimum above is regardless of hypervisor cluster cho= ice (could be VMware). > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --===============8309238546772567389==-- From ykaul at redhat.com Fri Mar 30 20:42:52 2018 Content-Type: multipart/mixed; boundary="===============8961419281253683445==" MIME-Version: 1.0 From: Yaniv Kaul To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Fri, 30 Mar 2018 20:42:40 +0000 Message-ID: In-Reply-To: dfeafce3-af81-c78f-5f17-57140923d86a@endlessnow.com --===============8961419281253683445== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Mar 26, 2018, 7:04 PM Christopher Cox wrote: > On 03/24/2018 03:33 AM, Andy Michielsen wrote: > > Hi all, > > > > Not sure if this is the place to be asking this but I was wondering > which hardware you all are using and why in order for me to see what I > would be needing. > > > > I would like to set up a HA cluster consisting off 3 hosts to be able to > run 30 vm=E2=80=99s. > > The engine, I can run on an other server. The hosts can be fitted with > the storage and share the space through glusterfs. I would think I will be > needing at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1= gb nic=E2=80=99s > sufficient ?) > > Just because you asked, but not because this is helpful to you.... > > But first, a comment on "3 hosts to be able to run 30 VMs". The SPM > node shouldn't run a lot of VMs. There are settings (the setting slips > my mind) on the engine to give it a "virtual set" of VMs in order to > keep VMs off of it. > > With that said, CPU wise, it doesn't require a lot to run 30 VM's. The > costly thing is memory (in general). So while a cheap set of 3 machines > might handle the CPU requirements of 30 VM's, those cheap machines might > not be able to give you the memory you need (depends). You might be > fine. I mean, there are cheap desktop like machines that do 64G (and > sometimes more). Just something to keep in mind. Memory and storage > will be the most costly items. It's simple math. Linux hosts, of > course, don't necessarily need much memory (or storage). But Windows... > > 1Gbit NIC's are "ok", but again, depends on storage. Glusterfs is no > speed demon. But you might not need "fast" storage. > > Lastly, your setup is just for "fun", right? Otherwise, read on. > > > Running oVirt 3.6 (this is a production setup) > > ovirt engine (manager): > Dell PowerEdge 430, 32G > > ovirt cluster nodes: > Dell m1000e 1.1 backplane Blade Enclosure > 9 x M630 Blades (2xE5-2669v3, 384GB), 4 iSCSI paths, 4 bonded LAN, all > 10GbE, CentOS 7.2 > 4 x MXL 10/40GbE (2x40Gbit LAN, 2x40Gbit iSCSI SAN to the S4810's) > > 120 VM's, CentOS 6, CentOS 7, Windows 10 Ent., Windows Server 2012 > We've run on as few as 3 nodes. > > Network, SAN and Storage (for ovirt Domains): > 2 x S4810 (part is used for SAN, part for LAN) > Equallogic dual controller (note: passive/active) PS6610S (84 x 4TB 7.2K > SAS) > Equallogic dual controller (note: passive/active) PS6610X (84 x 1TB 10K S= AS > > ISO and Export Domains are handled by: > Dell PE R620, 32G, 2x10Gbit LAN, 2x10Gbit iSCSI to the SAN (above), > CentOS 7.4, NFS > > What I like: > * Easy setup. > * Relatively good network and storage. > > What I don't like: > * 2 "effective" networks, LAN and iSCSI. All networking uses the same > effective path. Would be nice to have more physical isolation for mgmt > vs motion vs VMs. QoS is provided in oVirt, but still, would be nice to > have the full pathways. > * Storage doesn't use active/active controllers, so controller failover > is VERY slow. > * We have a fast storage system, and somewhat slower storage system > (matter of IOPS), neither is SSD, so there isn't a huge difference. No > real redundancy or flexibility. > * vdsm can no longer respond fast enough for the amount of disks defined > (in the event of a new Storage Domain add). We have raised vdsTimeout, > but have not tested yet. > We have substantially changed and improved VDSM for better scale since 3.6. How many disks are defined, in how many storage domains and LUNs? (also the OS itself has improved). > I inherited the "style" above. My recommendation of where to start for > a reasonable production instance, minimum (assumes the S4810's above, > not priced here): > > 1 x ovirt manager/engine, approx $1500 > What about high availability for the engine? 4 x Dell R620, 2xE5-2660, 768G, 6x10GbE (LAN, Storage, Motion), approx $42K > 3 x Nexsan 18P 108TB, approx $96K > Alternatively, how many reasonable SSDs can you buy? Samsing 860 EVO, 4TB costs in Amazon (US) $1300. You could buy tens (70+) of those and be left with some change. Can you instead use them in a fast storage setup? https://www.backblaze.com/blog/open-source-data-storage-server/ for example is interesting. > While significantly cheaper (by 6 figures), it provides active/active > controllers, storage reliability and flexibility and better network > pathways. Why 4 x nodes? Need at least N+1 for reliability. The extra > 4th node is merely capacity. Why 3 x storage? Need at least N+1 for > reliability. > Are they running in some cluster? > Obviously, you'll still want to back things up and test the ability to > restore components like the ovirt engine from scratch. > +1. Y. > Btw, my recommended minimum above is regardless of hypervisor cluster > choice (could be VMware). > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --===============8961419281253683445== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9ImF1dG8iPjxkaXY+PGJyPjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGRp diBkaXI9Imx0ciI+T24gTW9uLCBNYXIgMjYsIDIwMTgsIDc6MDQgUE0gQ2hyaXN0b3BoZXIgQ294 ICZsdDs8YSBocmVmPSJtYWlsdG86Y2NveEBlbmRsZXNzbm93LmNvbSI+Y2NveEBlbmRsZXNzbm93 LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVv dGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtw YWRkaW5nLWxlZnQ6MWV4Ij5PbiAwMy8yNC8yMDE4IDAzOjMzIEFNLCBBbmR5IE1pY2hpZWxzZW4g d3JvdGU6PGJyPgomZ3Q7IEhpIGFsbCw8YnI+CiZndDs8YnI+CiZndDsgTm90IHN1cmUgaWYgdGhp cyBpcyB0aGUgcGxhY2UgdG8gYmUgYXNraW5nIHRoaXMgYnV0IEkgd2FzIHdvbmRlcmluZyB3aGlj aCBoYXJkd2FyZSB5b3UgYWxsIGFyZSB1c2luZyBhbmQgd2h5IGluIG9yZGVyIGZvciBtZSB0byBz ZWUgd2hhdCBJIHdvdWxkIGJlIG5lZWRpbmcuPGJyPgomZ3Q7PGJyPgomZ3Q7IEkgd291bGQgbGlr ZSB0byBzZXQgdXAgYSBIQSBjbHVzdGVyIGNvbnNpc3Rpbmcgb2ZmIDMgaG9zdHMgdG8gYmUgYWJs ZSB0byBydW4gMzAgdm3igJlzLjxicj4KJmd0OyBUaGUgZW5naW5lLCBJIGNhbiBydW4gb24gYW4g b3RoZXIgc2VydmVyLiBUaGUgaG9zdHMgY2FuIGJlIGZpdHRlZCB3aXRoIHRoZSBzdG9yYWdlIGFu ZCBzaGFyZSB0aGUgc3BhY2UgdGhyb3VnaCBnbHVzdGVyZnMuIEkgd291bGQgdGhpbmsgSSB3aWxs IGJlIG5lZWRpbmcgYXQgbGVhc3QgMyBuaWPigJlzIGJ1dCB3b3VsZCBiZSBhYmxlIHRvIGluc3Rh bGwgb3ZuLiAoQXJlIDFnYiBuaWPigJlzIHN1ZmZpY2llbnQgPyk8YnI+Cjxicj4KSnVzdCBiZWNh dXNlIHlvdSBhc2tlZCwgYnV0IG5vdCBiZWNhdXNlIHRoaXMgaXMgaGVscGZ1bCB0byB5b3UuLi4u PGJyPgo8YnI+CkJ1dCBmaXJzdCwgYSBjb21tZW50IG9uICZxdW90OzMgaG9zdHMgdG8gYmUgYWJs ZSB0byBydW4gMzAgVk1zJnF1b3Q7LsKgIFRoZSBTUE08YnI+Cm5vZGUgc2hvdWxkbiYjMzk7dCBy dW4gYSBsb3Qgb2YgVk1zLsKgIFRoZXJlIGFyZSBzZXR0aW5ncyAodGhlIHNldHRpbmcgc2xpcHM8 YnI+Cm15IG1pbmQpIG9uIHRoZSBlbmdpbmUgdG8gZ2l2ZSBpdCBhICZxdW90O3ZpcnR1YWwgc2V0 JnF1b3Q7IG9mIFZNcyBpbiBvcmRlciB0bzxicj4Ka2VlcCBWTXMgb2ZmIG9mIGl0Ljxicj4KPGJy PgpXaXRoIHRoYXQgc2FpZCwgQ1BVIHdpc2UsIGl0IGRvZXNuJiMzOTt0IHJlcXVpcmUgYSBsb3Qg dG8gcnVuIDMwIFZNJiMzOTtzLsKgIFRoZTxicj4KY29zdGx5IHRoaW5nIGlzIG1lbW9yeSAoaW4g Z2VuZXJhbCkuwqAgU28gd2hpbGUgYSBjaGVhcCBzZXQgb2YgMyBtYWNoaW5lczxicj4KbWlnaHQg aGFuZGxlIHRoZSBDUFUgcmVxdWlyZW1lbnRzIG9mIDMwIFZNJiMzOTtzLCB0aG9zZSBjaGVhcCBt YWNoaW5lcyBtaWdodDxicj4Kbm90IGJlIGFibGUgdG8gZ2l2ZSB5b3UgdGhlIG1lbW9yeSB5b3Ug bmVlZCAoZGVwZW5kcykuwqAgWW91IG1pZ2h0IGJlPGJyPgpmaW5lLsKgIEkgbWVhbiwgdGhlcmUg YXJlIGNoZWFwIGRlc2t0b3AgbGlrZSBtYWNoaW5lcyB0aGF0IGRvIDY0RyAoYW5kPGJyPgpzb21l dGltZXMgbW9yZSkuwqAgSnVzdCBzb21ldGhpbmcgdG8ga2VlcCBpbiBtaW5kLsKgIE1lbW9yeSBh bmQgc3RvcmFnZTxicj4Kd2lsbCBiZSB0aGUgbW9zdCBjb3N0bHkgaXRlbXMuwqAgSXQmIzM5O3Mg c2ltcGxlIG1hdGguwqAgTGludXggaG9zdHMsIG9mPGJyPgpjb3Vyc2UsIGRvbiYjMzk7dCBuZWNl c3NhcmlseSBuZWVkIG11Y2ggbWVtb3J5IChvciBzdG9yYWdlKS7CoCBCdXQgV2luZG93cy4uLjxi cj4KPGJyPgoxR2JpdCBOSUMmIzM5O3MgYXJlICZxdW90O29rJnF1b3Q7LCBidXQgYWdhaW4sIGRl cGVuZHMgb24gc3RvcmFnZS7CoCBHbHVzdGVyZnMgaXMgbm88YnI+CnNwZWVkIGRlbW9uLsKgIEJ1 dCB5b3UgbWlnaHQgbm90IG5lZWQgJnF1b3Q7ZmFzdCZxdW90OyBzdG9yYWdlLjxicj4KPGJyPgpM YXN0bHksIHlvdXIgc2V0dXAgaXMganVzdCBmb3IgJnF1b3Q7ZnVuJnF1b3Q7LCByaWdodD/CoCBP dGhlcndpc2UsIHJlYWQgb24uPGJyPgo8YnI+Cjxicj4KUnVubmluZyBvVmlydCAzLjYgKHRoaXMg aXMgYSBwcm9kdWN0aW9uIHNldHVwKTxicj4KPGJyPgpvdmlydCBlbmdpbmUgKG1hbmFnZXIpOjxi cj4KRGVsbCBQb3dlckVkZ2UgNDMwLCAzMkc8YnI+Cjxicj4Kb3ZpcnQgY2x1c3RlciBub2Rlczo8 YnI+CkRlbGwgbTEwMDBlIDEuMSBiYWNrcGxhbmUgQmxhZGUgRW5jbG9zdXJlPGJyPgo5IHggTTYz MCBCbGFkZXMgKDJ4RTUtMjY2OXYzLCAzODRHQiksIDQgaVNDU0kgcGF0aHMsIDQgYm9uZGVkIExB TiwgYWxsPGJyPgoxMEdiRSwgQ2VudE9TIDcuMjxicj4KNCB4IE1YTCAxMC80MEdiRSAoMng0MEdi aXQgTEFOLCAyeDQwR2JpdCBpU0NTSSBTQU4gdG8gdGhlIFM0ODEwJiMzOTtzKTxicj4KPGJyPgox MjAgVk0mIzM5O3MsIENlbnRPUyA2LCBDZW50T1MgNywgV2luZG93cyAxMCBFbnQuLCBXaW5kb3dz IFNlcnZlciAyMDEyPGJyPgpXZSYjMzk7dmUgcnVuIG9uIGFzIGZldyBhcyAzIG5vZGVzLjxicj4K PGJyPgpOZXR3b3JrLCBTQU4gYW5kIFN0b3JhZ2UgKGZvciBvdmlydCBEb21haW5zKTo8YnI+CjIg eCBTNDgxMCAocGFydCBpcyB1c2VkIGZvciBTQU4sIHBhcnQgZm9yIExBTik8YnI+CkVxdWFsbG9n aWMgZHVhbCBjb250cm9sbGVyIChub3RlOiBwYXNzaXZlL2FjdGl2ZSkgUFM2NjEwUyAoODQgeCA0 VEIgNy4ySzxicj4KU0FTKTxicj4KRXF1YWxsb2dpYyBkdWFsIGNvbnRyb2xsZXIgKG5vdGU6IHBh c3NpdmUvYWN0aXZlKSBQUzY2MTBYICg4NCB4IDFUQiAxMEsgU0FTPGJyPgo8YnI+CklTTyBhbmQg RXhwb3J0IERvbWFpbnMgYXJlIGhhbmRsZWQgYnk6PGJyPgpEZWxsIFBFIFI2MjAsIDMyRywgMngx MEdiaXQgTEFOLCAyeDEwR2JpdCBpU0NTSSB0byB0aGUgU0FOIChhYm92ZSksPGJyPgpDZW50T1Mg Ny40LCBORlM8YnI+Cjxicj4KV2hhdCBJIGxpa2U6PGJyPgoqIEVhc3kgc2V0dXAuPGJyPgoqIFJl bGF0aXZlbHkgZ29vZCBuZXR3b3JrIGFuZCBzdG9yYWdlLjxicj4KPGJyPgpXaGF0IEkgZG9uJiMz OTt0IGxpa2U6PGJyPgoqIDIgJnF1b3Q7ZWZmZWN0aXZlJnF1b3Q7IG5ldHdvcmtzLCBMQU4gYW5k IGlTQ1NJLsKgIEFsbCBuZXR3b3JraW5nIHVzZXMgdGhlIHNhbWU8YnI+CmVmZmVjdGl2ZSBwYXRo LsKgIFdvdWxkIGJlIG5pY2UgdG8gaGF2ZSBtb3JlIHBoeXNpY2FsIGlzb2xhdGlvbiBmb3IgbWdt dDxicj4KdnMgbW90aW9uIHZzIFZNcy7CoCBRb1MgaXMgcHJvdmlkZWQgaW4gb1ZpcnQsIGJ1dCBz dGlsbCwgd291bGQgYmUgbmljZSB0bzxicj4KaGF2ZSB0aGUgZnVsbCBwYXRod2F5cy48YnI+Ciog U3RvcmFnZSBkb2VzbiYjMzk7dCB1c2UgYWN0aXZlL2FjdGl2ZSBjb250cm9sbGVycywgc28gY29u dHJvbGxlciBmYWlsb3Zlcjxicj4KaXMgVkVSWSBzbG93Ljxicj4KKiBXZSBoYXZlIGEgZmFzdCBz dG9yYWdlIHN5c3RlbSwgYW5kIHNvbWV3aGF0IHNsb3dlciBzdG9yYWdlIHN5c3RlbTxicj4KKG1h dHRlciBvZiBJT1BTKSzCoCBuZWl0aGVyIGlzIFNTRCwgc28gdGhlcmUgaXNuJiMzOTt0IGEgaHVn ZSBkaWZmZXJlbmNlLsKgIE5vPGJyPgpyZWFsIHJlZHVuZGFuY3kgb3IgZmxleGliaWxpdHkuPGJy PgoqIHZkc20gY2FuIG5vIGxvbmdlciByZXNwb25kIGZhc3QgZW5vdWdoIGZvciB0aGUgYW1vdW50 IG9mIGRpc2tzIGRlZmluZWQ8YnI+CihpbiB0aGUgZXZlbnQgb2YgYSBuZXcgU3RvcmFnZSBEb21h aW4gYWRkKS7CoCBXZSBoYXZlIHJhaXNlZCB2ZHNUaW1lb3V0LDxicj4KYnV0IGhhdmUgbm90IHRl c3RlZCB5ZXQuPGJyPjwvYmxvY2txdW90ZT48L2Rpdj48L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJy PjwvZGl2PjxkaXYgZGlyPSJhdXRvIj5XZSBoYXZlIHN1YnN0YW50aWFsbHkgY2hhbmdlZCBhbmQg aW1wcm92ZWQgVkRTTSBmb3IgYmV0dGVyIHNjYWxlIHNpbmNlIDMuNi48L2Rpdj48ZGl2IGRpcj0i YXV0byI+SG93IG1hbnkgZGlza3MgYXJlIGRlZmluZWQsIGluIGhvdyBtYW55IHN0b3JhZ2UgZG9t YWlucyBhbmQgTFVOcz/CoDwvZGl2PjxkaXYgZGlyPSJhdXRvIj4oYWxzbyB0aGUgT1MgaXRzZWxm IGhhcyBpbXByb3ZlZCkuwqA8L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJyPjwvZGl2PjxkaXYgZGly PSJhdXRvIj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWls X3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29s aWQ7cGFkZGluZy1sZWZ0OjFleCI+Cjxicj4KSSBpbmhlcml0ZWQgdGhlICZxdW90O3N0eWxlJnF1 b3Q7IGFib3ZlLsKgIE15IHJlY29tbWVuZGF0aW9uIG9mIHdoZXJlIHRvIHN0YXJ0IGZvcjxicj4K YSByZWFzb25hYmxlIHByb2R1Y3Rpb24gaW5zdGFuY2UsIG1pbmltdW0gKGFzc3VtZXMgdGhlIFM0 ODEwJiMzOTtzIGFib3ZlLDxicj4Kbm90IHByaWNlZCBoZXJlKTo8YnI+Cjxicj4KMSB4IG92aXJ0 IG1hbmFnZXIvZW5naW5lLCBhcHByb3ggJDE1MDA8YnI+PC9ibG9ja3F1b3RlPjwvZGl2PjwvZGl2 PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPldoYXQgYWJvdXQgaGln aCBhdmFpbGFiaWxpdHkgZm9yIHRoZSBlbmdpbmU/wqA8L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJy PjwvZGl2PjxkaXYgZGlyPSJhdXRvIj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGJsb2NrcXVv dGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxl ZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+CjQgeCBEZWxsIFI2MjAsIDJ4RTUt MjY2MCwgNzY4RywgNngxMEdiRSAoTEFOLCBTdG9yYWdlLCBNb3Rpb24pLCBhcHByb3ggJDQySzxi cj4KMyB4IE5leHNhbiAxOFAgMTA4VEIsIGFwcHJveCAkOTZLPGJyPjwvYmxvY2txdW90ZT48L2Rp dj48L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJyPjwvZGl2PjxkaXYgZGlyPSJhdXRvIj5BbHRlcm5h dGl2ZWx5LCBob3cgbWFueSByZWFzb25hYmxlIFNTRHMgY2FuIHlvdSBidXk/IFNhbXNpbmcgODYw IEVWTywgNFRCIGNvc3RzIGluIEFtYXpvbiAoVVMpIDxzcGFuIGNsYXNzPSJtb25leSI+JDEzMDA8 L3NwYW4+LiBZb3UgY291bGQgYnV5IHRlbnMgKDcwKykgb2YgdGhvc2UgYW5kIGJlIGxlZnQgd2l0 aCBzb21lIGNoYW5nZS7CoDwvZGl2PjxkaXYgZGlyPSJhdXRvIj5DYW4geW91IGluc3RlYWQgdXNl IHRoZW0gaW4gYSBmYXN0IHN0b3JhZ2Ugc2V0dXA/wqA8YSBocmVmPSJodHRwczovL3d3dy5iYWNr YmxhemUuY29tL2Jsb2cvb3Blbi1zb3VyY2UtZGF0YS1zdG9yYWdlLXNlcnZlci8iPmh0dHBzOi8v d3d3LmJhY2tibGF6ZS5jb20vYmxvZy9vcGVuLXNvdXJjZS1kYXRhLXN0b3JhZ2Utc2VydmVyLzwv YT4gZm9yIGV4YW1wbGUgaXMgaW50ZXJlc3RpbmcuwqA8L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJy PjwvZGl2PjxkaXYgZGlyPSJhdXRvIj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGJsb2NrcXVv dGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxl ZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+Cjxicj4KV2hpbGUgc2lnbmlmaWNh bnRseSBjaGVhcGVyIChieSA2IGZpZ3VyZXMpLCBpdCBwcm92aWRlcyBhY3RpdmUvYWN0aXZlPGJy Pgpjb250cm9sbGVycywgc3RvcmFnZSByZWxpYWJpbGl0eSBhbmQgZmxleGliaWxpdHkgYW5kIGJl dHRlciBuZXR3b3JrPGJyPgpwYXRod2F5cy7CoCBXaHkgNCB4IG5vZGVzP8KgIE5lZWQgYXQgbGVh c3QgTisxIGZvciByZWxpYWJpbGl0eS7CoCBUaGUgZXh0cmE8YnI+CjR0aCBub2RlIGlzIG1lcmVs eSBjYXBhY2l0eS7CoCBXaHkgMyB4IHN0b3JhZ2U/wqAgTmVlZCBhdCBsZWFzdCBOKzEgZm9yPGJy PgpyZWxpYWJpbGl0eS48YnI+PC9ibG9ja3F1b3RlPjwvZGl2PjwvZGl2PjxkaXYgZGlyPSJhdXRv Ij48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPkFyZSB0aGV5IHJ1bm5pbmcgaW4gc29tZSBjbHVz dGVyP8KgPC9kaXY+PGRpdiBkaXI9ImF1dG8iPjxicj48L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGRp diBjbGFzcz0iZ21haWxfcXVvdGUiPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5 bGU9Im1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmct bGVmdDoxZXgiPgo8YnI+Ck9idmlvdXNseSwgeW91JiMzOTtsbCBzdGlsbCB3YW50IHRvIGJhY2sg dGhpbmdzIHVwIGFuZCB0ZXN0IHRoZSBhYmlsaXR5IHRvPGJyPgpyZXN0b3JlIGNvbXBvbmVudHMg bGlrZSB0aGUgb3ZpcnQgZW5naW5lIGZyb20gc2NyYXRjaC48YnI+PC9ibG9ja3F1b3RlPjwvZGl2 PjwvZGl2PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPisxLjwvZGl2 PjxkaXYgZGlyPSJhdXRvIj5ZLjwvZGl2PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBk aXI9ImF1dG8iPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48YmxvY2txdW90ZSBjbGFzcz0iZ21h aWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBz b2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij4KPGJyPgpCdHcsIG15IHJlY29tbWVuZGVkIG1pbmltdW0g YWJvdmUgaXMgcmVnYXJkbGVzcyBvZiBoeXBlcnZpc29yIGNsdXN0ZXI8YnI+CmNob2ljZSAoY291 bGQgYmUgVk13YXJlKS48YnI+Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fPGJyPgpVc2VycyBtYWlsaW5nIGxpc3Q8YnI+CjxhIGhyZWY9Im1haWx0bzpVc2Vy c0BvdmlydC5vcmciIHRhcmdldD0iX2JsYW5rIiByZWw9Im5vcmVmZXJyZXIiPlVzZXJzQG92aXJ0 Lm9yZzwvYT48YnI+CjxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby91c2VycyIgcmVsPSJub3JlZmVycmVyIG5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5o dHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PGJyPgo8L2Js b2NrcXVvdGU+PC9kaXY+PC9kaXY+PC9kaXY+Cg== --===============8961419281253683445==-- From wattersm at watters.ws Sat Mar 31 19:27:44 2018 Content-Type: multipart/mixed; boundary="===============0443149967059686688==" MIME-Version: 1.0 From: Michael Watters To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 31 Mar 2018 15:20:10 -0400 Message-ID: <1d867092-a97e-6e30-400a-686a46c64489@watters.ws> In-Reply-To: 815987B5-31DA-4316-809D-A03363A1E3C3@gmail.com --===============0443149967059686688== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable We run Dell Poweredge R720s and R730s with 32 GB of RAM and quad Xeon processors.=C2=A0 Storage is provided by Dell MD3800i and Promise arrays using iSCSI.=C2=A0 The network is all 10 gigabit interfaces using 802.3ad bonds.=C2=A0 We actually just upgraded from 1 gigabit NICs since there were some performance issues with storage causing high IOwait on VMs.=C2=A0 I'd recommend avoiding 1 gigabit if you can. On 3/24/18 4:33 AM, Andy Michielsen wrote: > Hi all, > > Not sure if this is the place to be asking this but I was wondering which= hardware you all are using and why in order for me to see what I would be = needing. > > I would like to set up a HA cluster consisting off 3 hosts to be able to = run 30 vm=E2=80=99s. > The engine, I can run on an other server. The hosts can be fitted with th= e storage and share the space through glusterfs. I would think I will be ne= eding at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1gb n= ic=E2=80=99s sufficient ?) > > Any input you guys would like to share would be greatly appriciated. > > Thanks, > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --===============0443149967059686688==-- From vincent at epicenergy.ca Sat Mar 31 20:10:12 2018 Content-Type: multipart/mixed; boundary="===============6983000673516309291==" MIME-Version: 1.0 From: Vincent Royer To: users at ovirt.org Subject: Re: [ovirt-users] Which hardware are you using for oVirt Date: Sat, 31 Mar 2018 20:10:00 +0000 Message-ID: In-Reply-To: 1d867092-a97e-6e30-400a-686a46c64489@watters.ws --===============6983000673516309291== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Lots of great hardware knowledge in this thread! I'm also making the move to 10Gb. I'm adding a 3rd host to my deployment and moving to Glusterfs on 3 nodes, from my current NFS share on a separate storage server. Each of the 3 nodes has dual E5-2640 V4s with128Gb ram. I have some hardware choices I would love some advice about: - Should I use Intel X520-DA2 or X710-DA2 nics for the storage network? No significant price difference. The hosts are running oVirt Node 4.2. I hope to use them in bridge mode so that I don't need a 10Gbe switch. I do have a single 10Gbe port left on my router. - the hosts have 12Gbps 520i SAS cards, should I spec 6 or 12 Gbps SSD drives? Here there is a large price difference, also large difference between Enterprise performance, Enterprise mainstream, and Enterprise entry. I'm not sure how to estimate the value of those different options in a Glusterfs deployment. The workload is pretty I/O intensive with fairly small read/write operations (under 128Kb) on windows VMs. Any obvious weak links with this plan? On Sat, Mar 31, 2018, 12:27 PM Michael Watters, wro= te: > We run Dell Poweredge R720s and R730s with 32 GB of RAM and quad Xeon > processors. Storage is provided by Dell MD3800i and Promise arrays > using iSCSI. The network is all 10 gigabit interfaces using 802.3ad > bonds. We actually just upgraded from 1 gigabit NICs since there were > some performance issues with storage causing high IOwait on VMs. I'd > recommend avoiding 1 gigabit if you can. > > > On 3/24/18 4:33 AM, Andy Michielsen wrote: > > Hi all, > > > > Not sure if this is the place to be asking this but I was wondering > which hardware you all are using and why in order for me to see what I > would be needing. > > > > I would like to set up a HA cluster consisting off 3 hosts to be able to > run 30 vm=E2=80=99s. > > The engine, I can run on an other server. The hosts can be fitted with > the storage and share the space through glusterfs. I would think I will be > needing at least 3 nic=E2=80=99s but would be able to install ovn. (Are 1= gb nic=E2=80=99s > sufficient ?) > > > > Any input you guys would like to share would be greatly appriciated. > > > > Thanks, > > _______________________________________________ > > Users mailing list > > Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --===============6983000673516309291== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9ImF1dG8iPjxkaXY+TG90cyBvZiBncmVhdCBoYXJkd2FyZSBrbm93bGVkZ2UgaW4g dGhpcyB0aHJlYWQhwqAgSSYjMzk7bSBhbHNvIG1ha2luZyB0aGUgbW92ZSB0byAxMEdiLjwvZGl2 PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPkkmIzM5O20gYWRkaW5n IGEgM3JkIGhvc3QgdG8gbXkgZGVwbG95bWVudCBhbmQgbW92aW5nIHRvIEdsdXN0ZXJmcyBvbiAz IG5vZGVzLCBmcm9tIG15IGN1cnJlbnQgTkZTIHNoYXJlIG9uIGEgc2VwYXJhdGUgc3RvcmFnZSBz ZXJ2ZXIuwqA8L2Rpdj48ZGl2IGRpcj0iYXV0byI+PGJyPjwvZGl2PjxkaXYgZGlyPSJhdXRvIj5F YWNoIG9mIHRoZSAzIG5vZGVzIGhhcyBkdWFsIEU1LTI2NDAgVjRzIHdpdGgxMjhHYiByYW0uIEkg aGF2ZSBzb21lIGhhcmR3YXJlIGNob2ljZXMgSSB3b3VsZCBsb3ZlIHNvbWUgYWR2aWNlIGFib3V0 OjwvZGl2PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPi0gU2hvdWxk IEkgdXNlIEludGVsIFg1MjAtREEyIG9yIFg3MTAtREEyIG5pY3MgZm9yIHRoZSBzdG9yYWdlIG5l dHdvcms/wqAgTm8gc2lnbmlmaWNhbnQgcHJpY2UgZGlmZmVyZW5jZS7CoCBUaGUgaG9zdHMgYXJl IHJ1bm5pbmcgb1ZpcnQgTm9kZSA0LjIuwqAgSSBob3BlIHRvIHVzZSB0aGVtIGluIGJyaWRnZSBt b2RlIHNvIHRoYXQgSSBkb24mIzM5O3QgbmVlZCBhIDEwR2JlIHN3aXRjaC7CoCBJIGRvIGhhdmUg YSBzaW5nbGUgMTBHYmUgcG9ydCBsZWZ0IG9uIG15IHJvdXRlci7CoDwvZGl2PjxkaXYgZGlyPSJh dXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPi0gdGhlIGhvc3RzIGhhdmUgMTJHYnBzIDUy MGkgU0FTIGNhcmRzLCBzaG91bGQgSSBzcGVjIDYgb3IgMTIgR2JwcyBTU0QgZHJpdmVzPyBIZXJl IHRoZXJlIGlzIGEgbGFyZ2UgcHJpY2UgZGlmZmVyZW5jZSwgYWxzbyBsYXJnZSBkaWZmZXJlbmNl IGJldHdlZW4gRW50ZXJwcmlzZSBwZXJmb3JtYW5jZSwgRW50ZXJwcmlzZSBtYWluc3RyZWFtLCBh bmQgRW50ZXJwcmlzZSBlbnRyeS7CoCBJJiMzOTttIG5vdCBzdXJlIGhvdyB0byBlc3RpbWF0ZSB0 aGUgdmFsdWUgb2YgdGhvc2UgZGlmZmVyZW50IG9wdGlvbnMgaW4gYSBHbHVzdGVyZnMgZGVwbG95 bWVudC7CoDwvZGl2PjxkaXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPlRo ZSB3b3JrbG9hZCBpcyBwcmV0dHkgSS9PIGludGVuc2l2ZSB3aXRoIGZhaXJseSBzbWFsbCByZWFk L3dyaXRlIG9wZXJhdGlvbnMgKHVuZGVyIDEyOEtiKSBvbiB3aW5kb3dzIFZNcy7CoDwvZGl2Pjxk aXYgZGlyPSJhdXRvIj48YnI+PC9kaXY+PGRpdiBkaXI9ImF1dG8iPkFueSBvYnZpb3VzIHdlYWsg bGlua3Mgd2l0aCB0aGlzIHBsYW4/PC9kaXY+PGRpdiBkaXI9ImF1dG8iPjxicj48L2Rpdj48ZGl2 IGRpcj0iYXV0byI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIiBkaXI9ImF1dG8iPjxkaXYg ZGlyPSJsdHIiPk9uIFNhdCwgTWFyIDMxLCAyMDE4LCAxMjoyNyBQTSBNaWNoYWVsIFdhdHRlcnMs ICZsdDs8YSBocmVmPSJtYWlsdG86d2F0dGVyc21Ad2F0dGVycy53cyI+d2F0dGVyc21Ad2F0dGVy cy53czwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVv dGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtw YWRkaW5nLWxlZnQ6MWV4Ij5XZSBydW4gRGVsbCBQb3dlcmVkZ2UgUjcyMHMgYW5kIFI3MzBzIHdp dGggMzIgR0Igb2YgUkFNIGFuZCBxdWFkIFhlb248YnI+CnByb2Nlc3NvcnMuwqAgU3RvcmFnZSBp cyBwcm92aWRlZCBieSBEZWxsIE1EMzgwMGkgYW5kIFByb21pc2UgYXJyYXlzPGJyPgp1c2luZyBp U0NTSS7CoCBUaGUgbmV0d29yayBpcyBhbGwgMTAgZ2lnYWJpdCBpbnRlcmZhY2VzIHVzaW5nIDgw Mi4zYWQ8YnI+CmJvbmRzLsKgIFdlIGFjdHVhbGx5IGp1c3QgdXBncmFkZWQgZnJvbSAxIGdpZ2Fi aXQgTklDcyBzaW5jZSB0aGVyZSB3ZXJlPGJyPgpzb21lIHBlcmZvcm1hbmNlIGlzc3VlcyB3aXRo IHN0b3JhZ2UgY2F1c2luZyBoaWdoIElPd2FpdCBvbiBWTXMuwqAgSSYjMzk7ZDxicj4KcmVjb21t ZW5kIGF2b2lkaW5nIDEgZ2lnYWJpdCBpZiB5b3UgY2FuLjxicj4KPGJyPgo8YnI+Ck9uIDMvMjQv MTggNDozMyBBTSwgQW5keSBNaWNoaWVsc2VuIHdyb3RlOjxicj4KJmd0OyBIaSBhbGwsPGJyPgom Z3Q7PGJyPgomZ3Q7IE5vdCBzdXJlIGlmIHRoaXMgaXMgdGhlIHBsYWNlIHRvIGJlIGFza2luZyB0 aGlzIGJ1dCBJIHdhcyB3b25kZXJpbmcgd2hpY2ggaGFyZHdhcmUgeW91IGFsbCBhcmUgdXNpbmcg YW5kIHdoeSBpbiBvcmRlciBmb3IgbWUgdG8gc2VlIHdoYXQgSSB3b3VsZCBiZSBuZWVkaW5nLjxi cj4KJmd0Ozxicj4KJmd0OyBJIHdvdWxkIGxpa2UgdG8gc2V0IHVwIGEgSEEgY2x1c3RlciBjb25z aXN0aW5nIG9mZiAzIGhvc3RzIHRvIGJlIGFibGUgdG8gcnVuIDMwIHZt4oCZcy48YnI+CiZndDsg VGhlIGVuZ2luZSwgSSBjYW4gcnVuIG9uIGFuIG90aGVyIHNlcnZlci4gVGhlIGhvc3RzIGNhbiBi ZSBmaXR0ZWQgd2l0aCB0aGUgc3RvcmFnZSBhbmQgc2hhcmUgdGhlIHNwYWNlIHRocm91Z2ggZ2x1 c3RlcmZzLiBJIHdvdWxkIHRoaW5rIEkgd2lsbCBiZSBuZWVkaW5nIGF0IGxlYXN0IDMgbmlj4oCZ cyBidXQgd291bGQgYmUgYWJsZSB0byBpbnN0YWxsIG92bi4gKEFyZSAxZ2Igbmlj4oCZcyBzdWZm aWNpZW50ID8pPGJyPgomZ3Q7PGJyPgomZ3Q7IEFueSBpbnB1dCB5b3UgZ3V5cyB3b3VsZCBsaWtl IHRvIHNoYXJlIHdvdWxkIGJlIGdyZWF0bHkgYXBwcmljaWF0ZWQuPGJyPgomZ3Q7PGJyPgomZ3Q7 IFRoYW5rcyw8YnI+CiZndDsgX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX188YnI+CiZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgomZ3Q7IDxhIGhyZWY9Im1h aWx0bzpVc2Vyc0BvdmlydC5vcmciIHRhcmdldD0iX2JsYW5rIiByZWw9Im5vcmVmZXJyZXIiPlVz ZXJzQG92aXJ0Lm9yZzwvYT48YnI+CiZndDsgPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9y Zy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiByZWw9Im5vcmVmZXJyZXIgbm9yZWZlcnJlciIgdGFy Z2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vy czwvYT48YnI+Cjxicj4KX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxicj4KPGEgaHJlZj0ibWFpbHRvOlVzZXJzQG92 aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiIHJlbD0ibm9yZWZlcnJlciI+VXNlcnNAb3ZpcnQub3Jn PC9hPjxicj4KPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZv L3VzZXJzIiByZWw9Im5vcmVmZXJyZXIgbm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6 Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+CjwvYmxvY2tx dW90ZT48L2Rpdj48L2Rpdj48L2Rpdj4K --===============6983000673516309291==--