Outage Update - www.ovirt.org and gerrit.ovirt.org

[Mike Burns]

On Tue, 2012-03-20 at 11:22 -0400, Eyal Edri wrote:
> If jenkins.ovirt.org will have access to the other servers, 
> we might be able to add system jobs that deleted old files and such,
> 
> i do it downstream to delete old files from multiple dirs on jenkins slaves.
> 
> running a cmd like: 'sudo find . -type f -mtime +${days_to_keep} |grep -v ^\.$| sudo xargs rm -rf'

I think a command like this works well.  I have something similar setup
on similar backup area.  I don't think we need jenkins to run this
though.  A simple cron job with output mails going to root (which get
sent to infra list admins already) should be sufficient.

Mike

> 
> where days_to_keep is a param we can change. 
> of course, we'll have to make sure jenkins has write/delete permission to the monitored dirs.
> 
> ----- Original Message -----
> > From: "Ofer Schreiber" <oschreib at redhat.com>
> > To: "users" <users at ovirt.org>, arch at ovirt.org, infra at ovirt.org
> > Sent: Tuesday, March 20, 2012 4:18:57 PM
> > Subject: Outage Update - www.ovirt.org and gerrit.ovirt.org
> > 
> > www.ovirt.org and gerrit.ovirt.org are now up and running.
> > 
> > We experienced two issues:
> >  1. DB corruption on www.ovirt.org, caused by a full file system.
> >  2. Faulty gerrit service, probably caused by #1.
> > 
> > Both issues were handled by oVirt infra team (mburns, quaid and
> > myself)
> > 
> > Thank you for your patience.
> > 
> > Ofer Schreiber
> > oVirt infra team
> > _______________________________________________
> > Arch mailing list
> > Arch at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/arch
> > 
> _______________________________________________
> Arch mailing list
> Arch at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/arch