Re: [Gluster-infra] Download.gluster.org 27 April 2016 postmortem
On Wed, Apr 27, 2016 at 10:24 AM, Mike Hulsman <mike@hulsman.net> wrote:
Quoting Kaushal M <kshlmster@gmail.com>:
On Wed, Apr 27, 2016 at 5:21 PM, Michael Scherer <mscherer@redhat.com>
wrote:
Le mercredi 27 avril 2016 à 14:39 +0300, Eyal Edri a écrit :
Excellent post-mortem!
Do you think its worth adding mirrors to gluster repos like oVirt is doing? [1]
[1] http://ovirt-infra-docs.readthedocs.org/en/latest/General/Mirror.html
That could be a solution.
But we have the ressources to host a mirror ourself in the DC, it just need a ip address, and a migration of servers (which is taking a awful lot of time to happen :/ ).
One issue we would have with a mirror is on the download stats.
This and the need to have a mirrorlist, not sure how that's done on dnf/yum side theses days.
Someone recently offered to mirror download.gluster.org (I need to dig archives to find out who exactly). Didn't we take up their offer?
I offered to mirror gluster to ftp.nluug.nl We already mirror Ovirt for a while, and are happy to setup a mirror for gluster. Our bandwidth is 10Gb, and we are located in Amsterdam, the netherlands. I am happy to setup a mirror.
Mike Hulsman
-- Michael Scherer Sysadmin, Community Infrastructure and Platform, OSAS
I've reached out to our metrics team to see what happens to our download metrics if we have a mirror, as being able to have accurate project metrics is pretty important. I'll let you know what solution they come up with and we'll move forward from there. - amye -- Amye Scavarda | amye@redhat.com | Gluster Community Lead
--lrvsYIebpInmECXG Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Apr 27, 2016 at 01:54:10PM -0700, Amye Scavarda wrote:
On Wed, Apr 27, 2016 at 10:24 AM, Mike Hulsman <mike@hulsman.net> wrote: =20
Quoting Kaushal M <kshlmster@gmail.com>:
On Wed, Apr 27, 2016 at 5:21 PM, Michael Scherer <mscherer@redhat.com>
wrote:
Le mercredi 27 avril 2016 =E0 14:39 +0300, Eyal Edri a =E9crit :
Excellent post-mortem!
Do you think its worth adding mirrors to gluster repos like oVirt is doing? [1]
[1] http://ovirt-infra-docs.readthedocs.org/en/latest/General/Mirror.html
That could be a solution.
But we have the ressources to host a mirror ourself in the DC, it just need a ip address, and a migration of servers (which is taking a awful lot of time to happen :/ ).
One issue we would have with a mirror is on the download stats.
This and the need to have a mirrorlist, not sure how that's done on dnf/yum side theses days.
Someone recently offered to mirror download.gluster.org (I need to dig archives to find out who exactly). Didn't we take up their offer?
I offered to mirror gluster to ftp.nluug.nl We already mirror Ovirt for a while, and are happy to setup a mirror for gluster. Our bandwidth is 10Gb, and we are located in Amsterdam, the netherlands. I am happy to setup a mirror.
Mike Hulsman
-- Michael Scherer Sysadmin, Community Infrastructure and Platform, OSAS
I've reached out to our metrics team to see what happens to our download metrics if we have a mirror, as being able to have accurate project metri= cs is pretty important. =20 I'll let you know what solution they come up with and we'll move forward from there.
We already provide Gluster RPMs in many different distributions. For all I know, we do not have access to statistics from most of them. Just to list the ones that I can think of immediately: Fedora, CentOS Storage SIG, Debian, Ubuntu LaunchPad, Arch, NetBSD port, FreeBSD port. And then there are several cloud providers with their own caching proxies and internal mirrors... How accurate could our download statistics be? Niels --lrvsYIebpInmECXG Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJXIcH8AAoJECXo5AApwsWzcNMP/jxC15xIvtpzAkZEUNxpeQWX GLC+4nABxF6qKD3Lb6R7J8hr/P94/YbmMrwhnhiMeOcVnlAaFEHmUwlblHZxjZFv zreevjaIaTE/N+Hz3K1T7iTeV01f/LaHcF/AruHI1woKPCW0RXDtc7vsQ9IEPPwg PwddvnTxkEv3WvKduV4CPwiY6BWCeA+afbxsbD3eNyI4YF7k8E7I9waKa5GqFT8j 490HLj40FESCh/Xwksvy4Zmng8bSxAqhngAuhTawqdEzqQ4mQbTuPUoik+62PuW5 c5OK/kAuymMj6JxgA1YnO3Kxhq0ksE7osZr5A70u+2neTo/EU4A5L3t1wUlMqEIK +jz5/ShoQ9+3+krqTtDjxrmtKGMDXPojeCU+jcqxJ1Zxaqcv0E+AsZKMwxGUjItg bmfjCoGfpQI0hsc1iG0a9+bJ/FXdmkB8zYd5GTg3TLO3mMqtVbiA2SfEe2yb8sXl szoMgN7/BPszqi2NH6gvJyP3ij2M94ix5c2V00a98+/yLx4SNEAD8dJoNpZ2Zj4N B/IVvtBQN27BmgB7Erc4gsfXTEkrk8RE9pwok9Hk5GYkXx/BVf3z4rZXBJT9P6n1 GiMGSNbcZHFSkf4JtiCbykI77Y7P6gnz3WeeRl0/shq248OVxSWr1dNKzdguHLYg GEyn55NQ3QAiTroamRUQ =sGwV -----END PGP SIGNATURE----- --lrvsYIebpInmECXG--
On Thu, Apr 28, 2016 at 12:55 AM, Niels de Vos <ndevos@redhat.com> wrote:
On Wed, Apr 27, 2016 at 01:54:10PM -0700, Amye Scavarda wrote:
On Wed, Apr 27, 2016 at 10:24 AM, Mike Hulsman <mike@hulsman.net> wrote:
Quoting Kaushal M <kshlmster@gmail.com>:
On Wed, Apr 27, 2016 at 5:21 PM, Michael Scherer <mscherer@redhat.com>
wrote:
Le mercredi 27 avril 2016 à 14:39 +0300, Eyal Edri a écrit :
Excellent post-mortem!
Do you think its worth adding mirrors to gluster repos like oVirt is doing? [1]
[1]
http://ovirt-infra-docs.readthedocs.org/en/latest/General/Mirror.html
That could be a solution.
But we have the ressources to host a mirror ourself in the DC, it just need a ip address, and a migration of servers (which is taking a awful lot of time to happen :/ ).
One issue we would have with a mirror is on the download stats.
This and the need to have a mirrorlist, not sure how that's done on dnf/yum side theses days.
Someone recently offered to mirror download.gluster.org (I need to dig archives to find out who exactly). Didn't we take up their offer?
I offered to mirror gluster to ftp.nluug.nl We already mirror Ovirt for a while, and are happy to setup a mirror for gluster. Our bandwidth is 10Gb, and we are located in Amsterdam, the netherlands. I am happy to setup a mirror.
Mike Hulsman
-- Michael Scherer Sysadmin, Community Infrastructure and Platform, OSAS
I've reached out to our metrics team to see what happens to our download metrics if we have a mirror, as being able to have accurate project metrics is pretty important.
I'll let you know what solution they come up with and we'll move forward from there.
We already provide Gluster RPMs in many different distributions. For all I know, we do not have access to statistics from most of them. Just to list the ones that I can think of immediately: Fedora, CentOS Storage SIG, Debian, Ubuntu LaunchPad, Arch, NetBSD port, FreeBSD port.
And then there are several cloud providers with their own caching proxies and internal mirrors...
How accurate could our download statistics be?
Niels
This isn't a question about RPMs, this is about what we're providing directly from download.gluster.org. However, if we can get apache logs from the mirror connected to Bitergia's dashboards, that will work, they don't have a problem with adding in another apache log. - amye -- Amye Scavarda | amye@redhat.com | Gluster Community Lead
participants (2)
-
Amye Scavarda -
Niels de Vos