New hosting design
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigD0093A10176C442AC60DA5D2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable This email is to kick-off the discussion about how we want to design our new hosting. Presuming the following: * 2 servers at AlterWay * 2 servers at RackSpace * Both bare metal * Each machine with 4 to 8 cores, 8 to 16 GB How do we want to layout services, interactions, backup, etc.? Ideas/points: * Migrate Mailman first - easy, crucial, gets jammed up on full Linode * On top of the base OS, how many VMs do we want? ** Does Jenkins master want to own the entire box? Figuring yes ... ** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ... *** Gerrit gets 50% of resources in one VM *** Remaining resources go to host OS and 1 to 4 VMs(?) **** Mailman goes on one of those remaining VMs * Do we need a separate database? ** Does Jenkins or Gerrit use a db? ** We could have a VM running a db on a private network ... We talked in IRC about having one or more hacking sprints to do Infra work over the coming holiday breaks: * 26th * 29th * 30th Any of those work for people? Other suggestions? Cheers - Karsten --=20 Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 --------------enigD0093A10176C442AC60DA5D2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iD8DBQFQ0hpJ2ZIOBq0ODEERAvmWAJ45tkT41YOxJeTP/PrMfpTdu1N5TwCeMIOm DMbdeVpq31FCk/vlkDr0q68= =QEAa -----END PGP SIGNATURE----- --------------enigD0093A10176C442AC60DA5D2--
Hi, On 12/19/2012 08:49 PM, Karsten 'quaid' Wade wrote:
This email is to kick-off the discussion about how we want to design our new hosting.
Presuming the following:
* 2 servers at AlterWay
For Alterway, we have one hardware server, and can request VMs. So I'm assuming that "2 servers" here means 1 hardware server, and 1 VM?
Ideas/points:
* Migrate Mailman first - easy, crucial, gets jammed up on full Linode
what services are running on linode now? I only know of Mailman, an apache for downloads. Are there other services we need to host elsewhere? Database server, perhaps?
** Does Jenkins master want to own the entire box? Figuring yes ...
That was what we requested, and that's the current plan.
** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ...
I'm not sure if we have a second dedicated host - would need to confirm that with Kévin. My understanding is that Mailman would be running in a VM, Gerrit could run in a VM, and we would potentially have a number of Jenkins slave VMs.
* Do we need a separate database? ** Does Jenkins or Gerrit use a db?
Gerrit definitely does. Where is the MediaWiki database running right now - on OpenShift? On the main www host, or on a separate gear? Thanks! Dave. -- Dave Neary - Community Action and Impact Open Source and Standards, Red Hat - http://community.redhat.com Ph: +33 9 50 71 55 62 / Cell: +33 6 77 01 92 13
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig630B61E71FD24ED587700E43 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/20/2012 03:37 AM, Dave Neary wrote:
Hi, =20 On 12/19/2012 08:49 PM, Karsten 'quaid' Wade wrote:
This email is to kick-off the discussion about how we want to design our new hosting. =20 Presuming the following: =20 * 2 servers at AlterWay =20 For Alterway, we have one hardware server, and can request VMs. So I'm assuming that "2 servers" here means 1 hardware server, and 1 VM?
OK, no worries about the final configuration, but I'm fairly sure that it was two physical hosts (and that you keep remembering it as 1 host and 1 VM.) Ultimately, we only need one bare metal server AIUI for Jenkins, and we can use several VMs.
Ideas/points: =20 * Migrate Mailman first - easy, crucial, gets jammed up on full Linode =20 what services are running on linode now? =20 I only know of Mailman, an apache for downloads. Are there other=20 services we need to host elsewhere? Database server, perhaps?
It sounds like we will need a database, and should consolidate. We ran MySQL on the Linode, but we're using OpenShift for that now. * IRC Bot * Apache redirects * Apache for resources.ovirt.org * Mailman * Backups
=20
** Does Jenkins master want to own the entire box? Figuring yes ... =20 That was what we requested, and that's the current plan. =20 ** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ... =20 I'm not sure if we have a second dedicated host - would need to confirm that with K=E9vin. =20 My understanding is that Mailman would be running in a VM, Gerrit could run in a VM, and we would potentially have a number of Jenkins slave VMs.
Yes, that's fine; and the VMs could be part of their oVirt cloud or whatever.
* Do we need a separate database? ** Does Jenkins or Gerrit use a db? =20 Gerrit definitely does. Where is the MediaWiki database running right now - on OpenShift? On the main www host, or on a separate gear?
I think a separate gear, that's how OpenShift works AIUI. I'm not sure we want to move the MediaWiki database to a different data center than where MW runs, but it sounds as if it would be a good idea to put a database on a private VLAN address for Gerrit to use. - Karsten --=20 Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 --------------enig630B61E71FD24ED587700E43 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iD8DBQFQ03b72ZIOBq0ODEERAmesAJ4rrviuQZLLwAVXGu6wVu+D9PDKEQCeJE/U P2Ylg7KCKweVPaFF7j3JN/4= =BsPb -----END PGP SIGNATURE----- --------------enig630B61E71FD24ED587700E43--
Hi, On 12/20/2012 09:37 PM, Karsten 'quaid' Wade wrote:
On 12/20/2012 03:37 AM, Dave Neary wrote:
* 2 servers at AlterWay
For Alterway, we have one hardware server, and can request VMs. So I'm assuming that "2 servers" here means 1 hardware server, and 1 VM?
OK, no worries about the final configuration, but I'm fairly sure that it was two physical hosts (and that you keep remembering it as 1 host and 1 VM.) Ultimately, we only need one bare metal server AIUI for Jenkins, and we can use several VMs.
I remembered it as 1 bare metal and N VMs (Kevin's just confirmed that you're correct, and my memory continues to play tricks on me). Thanks for the correction.
I'm not sure we want to move the MediaWiki database to a different data center than where MW runs, but it sounds as if it would be a good idea to put a database on a private VLAN address for Gerrit to use.
Makes sense to add a separate database rather than trying to shoe-horn everything into one database. Cheers, Dave. -- Dave Neary - Community Action and Impact Open Source and Standards, Red Hat - http://community.redhat.com Ph: +33 9 50 71 55 62 / Cell: +33 6 77 01 92 13
----- Original Message -----
From: "Karsten 'quaid' Wade" <kwade@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, December 19, 2012 9:49:29 PM Subject: New hosting design
This email is to kick-off the discussion about how we want to design our new hosting.
Presuming the following:
* 2 servers at AlterWay * 2 servers at RackSpace * Both bare metal * Each machine with 4 to 8 cores, 8 to 16 GB
How do we want to layout services, interactions, backup, etc.?
Ideas/points:
* Migrate Mailman first - easy, crucial, gets jammed up on full Linode * On top of the base OS, how many VMs do we want? ** Does Jenkins master want to own the entire box? Figuring yes ...
we're forgetting jenkins slaves, we'll want to create a few vms with various OS (f17,f18,rhel63,rhel64...) best practise is not to run any jobs on the master node, but i assume we can run some maven jobs on it until we'll set up more slaves. btw, are we going to use the existing amazon vms as slaves for the new jenkins master? at least for starts?
** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ... *** Gerrit gets 50% of resources in one VM *** Remaining resources go to host OS and 1 to 4 VMs(?) **** Mailman goes on one of those remaining VMs * Do we need a separate database? ** Does Jenkins or Gerrit use a db?
jenkins no - uses only local xml files gerrit - yes (git + db)
** We could have a VM running a db on a private network ...
We talked in IRC about having one or more hacking sprints to do Infra work over the coming holiday breaks:
* 26th * 29th * 30th
Any of those work for people? Other suggestions?
Cheers - Karsten -- Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
Hi I provide 2 bare metal servers, and add some VMs. Kevin 2012/12/20 Eyal Edri <eedri@redhat.com>
----- Original Message -----
From: "Karsten 'quaid' Wade" <kwade@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, December 19, 2012 9:49:29 PM Subject: New hosting design
This email is to kick-off the discussion about how we want to design our new hosting.
Presuming the following:
* 2 servers at AlterWay * 2 servers at RackSpace * Both bare metal * Each machine with 4 to 8 cores, 8 to 16 GB
How do we want to layout services, interactions, backup, etc.?
Ideas/points:
* Migrate Mailman first - easy, crucial, gets jammed up on full Linode * On top of the base OS, how many VMs do we want? ** Does Jenkins master want to own the entire box? Figuring yes ...
we're forgetting jenkins slaves, we'll want to create a few vms with various OS (f17,f18,rhel63,rhel64...)
best practise is not to run any jobs on the master node, but i assume we can run some maven jobs on it until we'll set up more slaves.
btw, are we going to use the existing amazon vms as slaves for the new jenkins master? at least for starts?
** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ... *** Gerrit gets 50% of resources in one VM *** Remaining resources go to host OS and 1 to 4 VMs(?) **** Mailman goes on one of those remaining VMs * Do we need a separate database? ** Does Jenkins or Gerrit use a db?
jenkins no - uses only local xml files gerrit - yes (git + db)
** We could have a VM running a db on a private network ...
We talked in IRC about having one or more hacking sprints to do Infra work over the coming holiday breaks:
* 26th * 29th * 30th
Any of those work for people? Other suggestions?
Cheers - Karsten -- Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- Kevin Mazière Responsable Infrastructure Alter Way – Hosting 1 rue Royal - 227 Bureaux de la Colline 92213 Saint-Cloud Cedex Tél : +33 (0)1 41 16 38 41 Mob : +33 (0)7 62 55 57 05 http://www.alterway.fr
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigE65B3D5B931A1D640EB4B022 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 12/20/2012 04:22 AM, Eyal Edri wrote:
=20 =20 ----- Original Message -----
From: "Karsten 'quaid' Wade" <kwade@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, December 19, 2012 9:49:29 PM=20 Subject: New hosting design =20 This email is to kick-off the discussion about how we want to design our new hosting. =20 Presuming the following: =20 * 2 servers at AlterWay * 2 servers at RackSpace * Both bare metal=20 * Each machine with 4 to 8 cores, 8 to 16 GB =20 How do we want to layout services, interactions, backup, etc.? =20 Ideas/points: =20 * Migrate Mailman first - easy, crucial, gets jammed up on full=20 Linode * On top of the base OS, how many VMs do we want? ** Does Jenkins master want to own the entire box? Figuring yes ... =20 we're forgetting jenkins slaves, we'll want to create a few vms with various OS (f17,f18,rhel63,rhel64...) =20 best practise is not to run any jobs on the master node, but i assume we can run some maven jobs on it until we'll set up more slaves. =20 btw, are we going to use the existing amazon vms as slaves for the new jenkins master? at least for starts?
I think we'll have to, but we'll be following up with two servers at RackSpace we can slice up in to multiple VMs & Jenkins are first in line for using those VMs. - Karsten --=20 Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 --------------enigE65B3D5B931A1D640EB4B022 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iD8DBQFQ03d92ZIOBq0ODEERAjVtAKDhizhaEVSdt1D9EzcMbf2E5i/aZACgzqpU oHtG9qe0e0V1Fl4wiuGPlXg= =TuSK -----END PGP SIGNATURE----- --------------enigE65B3D5B931A1D640EB4B022--
On 12/20/2012 02:22 PM, Eyal Edri wrote:
----- Original Message -----
From: "Karsten 'quaid' Wade" <kwade@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, December 19, 2012 9:49:29 PM Subject: New hosting design
This email is to kick-off the discussion about how we want to design our new hosting.
Presuming the following:
* 2 servers at AlterWay * 2 servers at RackSpace * Both bare metal * Each machine with 4 to 8 cores, 8 to 16 GB
How do we want to layout services, interactions, backup, etc.?
Ideas/points:
* Migrate Mailman first - easy, crucial, gets jammed up on full Linode * On top of the base OS, how many VMs do we want? ** Does Jenkins master want to own the entire box? Figuring yes ...
we're forgetting jenkins slaves, we'll want to create a few vms with various OS (f17,f18,rhel63,rhel64...)
best practise is not to run any jobs on the master node, but i assume we can run some maven jobs on it until we'll set up more slaves.
btw, are we going to use the existing amazon vms as slaves for the new jenkins master? at least for starts?
you can continue using them for now, but i'd like to shut them down. the priority should be to move jenkins of EC2. gerrit is 2nd priority - it is behaving nicely lately performance wise.
** Second host, which could be running Gerrit eventually, do we want that partitioned in to VMs? Or does Gerrit want the entire box? Figuring no ... *** Gerrit gets 50% of resources in one VM *** Remaining resources go to host OS and 1 to 4 VMs(?) **** Mailman goes on one of those remaining VMs * Do we need a separate database? ** Does Jenkins or Gerrit use a db?
jenkins no - uses only local xml files gerrit - yes (git + db)
** We could have a VM running a db on a private network ...
We talked in IRC about having one or more hacking sprints to do Infra work over the coming holiday breaks:
* 26th * 29th * 30th
Any of those work for people? Other suggestions?
Cheers - Karsten -- Karsten 'quaid' Wade, Sr. Analyst - Community Growth http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
participants (5)
-
Dave Neary -
Eyal Edri -
Itamar Heim -
Karsten 'quaid' Wade -
Kevin Maziere Aubry