Gerrit server

[Eyal Edri]

very nice!

any update if updating robot.txt blocked some of the bots overloading it?

Eyal.

----- Original Message -----
> From: "David Caro Estevez" <dcaroest at redhat.com>
> To: "infra" <infra at ovirt.org>
> Sent: Thursday, June 13, 2013 7:09:36 PM
> Subject: Re: Gerrit server
> 
> Some statistics made with awstats for the last 3 days (you'll miss icons and
> images). .
> 
> 
> 
> ----- Original Message -----
> > From: "David Caro Estevez" <dcaroest at redhat.com>
> > To: "infra" <infra at ovirt.org>
> > Sent: Thursday, June 13, 2013 4:56:15 PM
> > Subject: Re: Gerrit server
> > 
> > Finally some light!!
> > 
> > What happend at 14:30 is that bingbot stopped crawling!!
> > 
> > 157.56.229.138 - - [13/Jun/2013:08:32:02 -0400] "GET
> > /gitweb?p=ovirt-node.git;a=log;h=refs/changes/36/6436/1 HTTP/1.1" 200
> > 143478
> > - "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
> > 
> > 
> > That's the last entry we have, on the server for bingbot (majestic is still
> > crawling, but does a lot less requests). Right now everything seems stable
> > (load, connections, open_files), so I recommend at least modifying
> > robots.txt to avoid having the same problem again.
> > 
> > We can also add some firewall rules to automatically ban this kind of
> > behaviour, but I'm a little rusty with those.
> > 
> > Thanks Ohad!!
> > 
> > ----- Original Message -----
> > > From: "David Caro Estevez" <dcaroest at redhat.com>
> > > To: "infra" <infra at ovirt.org>
> > > Sent: Thursday, June 13, 2013 3:38:06 PM
> > > Subject: Gerrit server
> > > 
> > > Hey, did someone do something to the gerrit server today around 14:30
> > > CEST
> > > (Prague time)?
> > > 
> > > Attached is a graph for some of the metrics I'm starting to collect, it's
> > > generated with graphite.
> > > 
> > > ----
> > > David Caro
> > > 
> > > Red Hat Czech s.r.o.
> > > Continuous Integration Engineer - EMEA ENG Virtualization R&D
> > > 
> > > Tel.: +420 532 294 605
> > > Email: dcaro at redhat.com
> > > Web: www.cz.redhat.com
> > > Red Hat Czech s.r.o., Purkyňova 99/71, 612 45, Brno, Czech Republic
> > > RHT Global #: 82-62605
> > > 
> > > 
> > > 
> > > _______________________________________________
> > > Infra mailing list
> > > Infra at ovirt.org
> > > http://lists.ovirt.org/mailman/listinfo/infra
> > > 
> > _______________________________________________
> > Infra mailing list
> > Infra at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/infra
> > 
> 
> _______________________________________________
> Infra mailing list
> Infra at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>