
Takes quite long to get results from it when attempting to review code. Many thanks, Yair

Are we close to restoring the clone to github? that might reduce load from jenkins jobs using it. Eyal. ----- Original Message -----
From: "Yair Zaslavsky" <yzaslavs@redhat.com> To: "infra" <infra@ovirt.org> Cc: "Eyal Edri" <eedri@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:09:35 PM Subject: ovirt gerrit is extremely slow
Takes quite long to get results from it when attempting to review code.
Many thanks, Yair

we are getting crawled again by bingbot. It seems that it's not respecting the robots.txt file. Should we add firewall rules for it? it seems to be using a wide range of ips... ----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "Yair Zaslavsky" <yzaslavs@redhat.com>, "David Caro Estevez" <dcaroest@redhat.com> Cc: "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 2:22:37 PM Subject: Re: ovirt gerrit is extremely slow
Are we close to restoring the clone to github?
that might reduce load from jenkins jobs using it.
Eyal.
----- Original Message -----
From: "Yair Zaslavsky" <yzaslavs@redhat.com> To: "infra" <infra@ovirt.org> Cc: "Eyal Edri" <eedri@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:09:35 PM Subject: ovirt gerrit is extremely slow
Takes quite long to get results from it when attempting to review code.
Many thanks, Yair

can we use httpaccess rules? http://www.javascriptkit.com/howto/htaccess13.shtml http://www.thesitewizard.com/apache/block-bots-with-htaccess.shtml eyal. ----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "Eyal Edri" <eedri@redhat.com> Cc: "Yair Zaslavsky" <yzaslavs@redhat.com>, "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 4:02:58 PM Subject: Re: ovirt gerrit is extremely slow
we are getting crawled again by bingbot. It seems that it's not respecting the robots.txt file.
Should we add firewall rules for it? it seems to be using a wide range of ips...
----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "Yair Zaslavsky" <yzaslavs@redhat.com>, "David Caro Estevez" <dcaroest@redhat.com> Cc: "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 2:22:37 PM Subject: Re: ovirt gerrit is extremely slow
Are we close to restoring the clone to github?
that might reduce load from jenkins jobs using it.
Eyal.
----- Original Message -----
From: "Yair Zaslavsky" <yzaslavs@redhat.com> To: "infra" <infra@ovirt.org> Cc: "Eyal Edri" <eedri@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:09:35 PM Subject: ovirt gerrit is extremely slow
Takes quite long to get results from it when attempting to review code.
Many thanks, Yair

Gerrit is not using apache, afaik. But we might be able to set up a proxy for it. That would help too to for the robots.txt, as it's inside the war file, it gets rewritten each time the app redeploys. ----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "David Caro Estevez" <dcaroest@redhat.com> Cc: "Yair Zaslavsky" <yzaslavs@redhat.com>, "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:16:58 PM Subject: Re: ovirt gerrit is extremely slow
can we use httpaccess rules?
http://www.javascriptkit.com/howto/htaccess13.shtml http://www.thesitewizard.com/apache/block-bots-with-htaccess.shtml
eyal.
----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "Eyal Edri" <eedri@redhat.com> Cc: "Yair Zaslavsky" <yzaslavs@redhat.com>, "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 4:02:58 PM Subject: Re: ovirt gerrit is extremely slow
we are getting crawled again by bingbot. It seems that it's not respecting the robots.txt file.
Should we add firewall rules for it? it seems to be using a wide range of ips...
----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "Yair Zaslavsky" <yzaslavs@redhat.com>, "David Caro Estevez" <dcaroest@redhat.com> Cc: "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 2:22:37 PM Subject: Re: ovirt gerrit is extremely slow
Are we close to restoring the clone to github?
that might reduce load from jenkins jobs using it.
Eyal.
----- Original Message -----
From: "Yair Zaslavsky" <yzaslavs@redhat.com> To: "infra" <infra@ovirt.org> Cc: "Eyal Edri" <eedri@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:09:35 PM Subject: ovirt gerrit is extremely slow
Takes quite long to get results from it when attempting to review code.
Many thanks, Yair

btw. I was afraid that gerrit did some checksum check of the war file, but it does not (tested on my local instance) so I can change the robots inside the war file to avoid it being overwritten again, I'll do that this evening once there's not too much people working. I've seen that bingbot requested the robots a while ago and has stopeed crawling since that, maybe it was just using a cached version requested before and polling once in a while. That does not invalidate the fact that an apache proxy before gerrit can give a lot of flexibility and control. But maybe it makes it less urgent :) ----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "Eyal Edri" <eedri@redhat.com> Cc: "infra" <infra@ovirt.org> Sent: Tuesday, June 18, 2013 3:27:22 PM Subject: Re: ovirt gerrit is extremely slow
Gerrit is not using apache, afaik. But we might be able to set up a proxy for it.
That would help too to for the robots.txt, as it's inside the war file, it gets rewritten each time the app redeploys.
----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "David Caro Estevez" <dcaroest@redhat.com> Cc: "Yair Zaslavsky" <yzaslavs@redhat.com>, "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:16:58 PM Subject: Re: ovirt gerrit is extremely slow
can we use httpaccess rules?
http://www.javascriptkit.com/howto/htaccess13.shtml http://www.thesitewizard.com/apache/block-bots-with-htaccess.shtml
eyal.
----- Original Message -----
From: "David Caro Estevez" <dcaroest@redhat.com> To: "Eyal Edri" <eedri@redhat.com> Cc: "Yair Zaslavsky" <yzaslavs@redhat.com>, "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 4:02:58 PM Subject: Re: ovirt gerrit is extremely slow
we are getting crawled again by bingbot. It seems that it's not respecting the robots.txt file.
Should we add firewall rules for it? it seems to be using a wide range of ips...
----- Original Message -----
From: "Eyal Edri" <eedri@redhat.com> To: "Yair Zaslavsky" <yzaslavs@redhat.com>, "David Caro Estevez" <dcaroest@redhat.com> Cc: "infra" <infra@ovirt.org>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 2:22:37 PM Subject: Re: ovirt gerrit is extremely slow
Are we close to restoring the clone to github?
that might reduce load from jenkins jobs using it.
Eyal.
----- Original Message -----
From: "Yair Zaslavsky" <yzaslavs@redhat.com> To: "infra" <infra@ovirt.org> Cc: "Eyal Edri" <eedri@redhat.com>, "Itamar Heim" <iheim@redhat.com> Sent: Tuesday, June 18, 2013 3:09:35 PM Subject: ovirt gerrit is extremely slow
Takes quite long to get results from it when attempting to review code.
Many thanks, Yair
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
participants (3)
-
David Caro Estevez
-
Eyal Edri
-
Yair Zaslavsky