very nice! any update if updating robot.txt blocked some of the bots overloading it? Eyal. ----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "infra" <infra@ovirt.org> Sent: Thursday, June 13, 2013 7:09:36 PM Subject: Re: Gerrit server
Some statistics made with awstats for the last 3 days (you'll miss icons and images). .
----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "infra" <infra@ovirt.org> Sent: Thursday, June 13, 2013 4:56:15 PM Subject: Re: Gerrit server
Finally some light!!
What happend at 14:30 is that bingbot stopped crawling!!
157.56.229.138 - - [13/Jun/2013:08:32:02 -0400] "GET /gitweb?p=ovirt-node.git;a=log;h=refs/changes/36/6436/1 HTTP/1.1" 200 143478 - "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
That's the last entry we have, on the server for bingbot (majestic is still crawling, but does a lot less requests). Right now everything seems stable (load, connections, open_files), so I recommend at least modifying robots.txt to avoid having the same problem again.
We can also add some firewall rules to automatically ban this kind of behaviour, but I'm a little rusty with those.
Thanks Ohad!!
----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "infra" <infra@ovirt.org> Sent: Thursday, June 13, 2013 3:38:06 PM Subject: Gerrit server
Hey, did someone do something to the gerrit server today around 14:30 CEST (Prague time)?
Attached is a graph for some of the metrics I'm starting to collect, it's generated with graphite.
---- David Caro
Red Hat Czech s.r.o. Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.cz.redhat.com Red Hat Czech s.r.o., Purkyňova 99/71, 612 45, Brno, Czech Republic RHT Global #: 82-62605
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra