Full disk on resources.ovirt.org

[Eyal Edri]

i just loaded the relevant existing scripts to review on gerrit: http://gerrit.ovirt.org/#/c/14665/

i'm sure they can be changed/improved to better handle this.

i propose we'll fix them and reploy them on linode so we can put this behind us.

Eyal.

----- Original Message -----
> From: "Karsten 'quaid' Wade" <kwade at redhat.com>
> To: "Alexander Rydekull" <rydekull at gmail.com>
> Cc: "infra" <infra at ovirt.org>
> Sent: Saturday, May 11, 2013 8:04:43 AM
> Subject: Re: Full disk on resources.ovirt.org
> 
> On 05/08/2013 01:44 AM, Alexander Rydekull wrote:
> > Okay, so I'm quite sick of these "full disk on linode01" issues.
> > 
> > So, I propose the following solution:
> > 
> > - A maintainer of jenkins publish-rpms-nightly disable the copy of several
> > versions of the each RPM (preferably only the latest, do we really need
> > more, its a nightly build afterall)
> > - A maintainer of jenkins publish-rpms-nightly TRY to make a link to the
> > files instead of copying them.
> > 
> > - Until this is done, we can clear some disk (3 GB+) by doing something
> > like the following:
> 
> ... and I just did that after it filled up again. But I suspect it's
> going to just reupload all those RPMs or something. I'm confused because
> there was suddenly 8+ GB of stuff in /var that wasn't there the other
> day. The /home/jenkins clean-up worked, in that it was 8 GB less in that
> folder tonight. I'm confused. But the below script got us back 11 GB.
> 
> - Karsten
> 
> > # cd /var/www/html/releases/nightly
> > # for yfile in $(for xfile in $(for file in $(find . -type f -name "*.rpm")
> > ; do echo $file | cut -d"." -f 1-2 ; done | sort -u) ; do ls ${xfile}* |
> > sort -n | head -n-2 ; done) ; do echo rm $yfile ; done
> > 
> > This will effectively remove every RPM except the last two revisions of
> > each package. (Well, obviously you need to remove that very last "echo" in
> > the line, just putting it there not to ruins someones afternoon).
> > 
> > - What I propose other then this is just putting the backups somewhere
> > else.
> > We should have sufficient space for this on another host.
> > If not, give ma thumbs up and I'll host the backups somewhere else for us
> > until we've gotten it in order.
> > 
> > Any thoughts?
> > 
> > 
> > 
> > On Wed, May 8, 2013 at 7:18 AM, Karsten 'quaid' Wade
> > <kwade at redhat.com>wrote:
> > 
> >> On 05/01/2013 11:51 PM, Eyal Edri wrote:
> >>
> >>>>
> >>>> What does /jenkins do? I find lots of RPMs in sub-directories that are
> >>>> apparently dailies for the last month. Can we sweep them out to get some
> >>>> breathing room?
> >>>
> >>> this is a temp place for publishing nightlies, but i think it may not be
> >> deleted probperly.
> >>> i added a remove function to the move cron script 'move_jenkins_nightly'
> >> to delete all content after it's published.
> >>> (deleting current data released 13GB).
> >>
> >> Looks like we have the same problem again - that directory structure is
> >> filled with many versions of similar files, and the disk is full again.
> >> I freed up enough space to keep Mailman running for now.
> >>
> >> --
> >> Karsten 'quaid' Wade
> >> http://TheOpenSourceWay.org  .^\  http://community.redhat.com
> >> @quaid (identi.ca/twitter/IRC)  \v'  gpg: AD0E0C41
> >>
> >>
> >> _______________________________________________
> >> Infra mailing list
> >> Infra at ovirt.org
> >> http://lists.ovirt.org/mailman/listinfo/infra
> >>
> >>
> > 
> > 
> 
> 
> --
> Karsten 'quaid' Wade
> http://TheOpenSourceWay.org  .^\  http://community.redhat.com
> @quaid (identi.ca/twitter/IRC)  \v'  gpg: AD0E0C41
> 
> 
> _______________________________________________
> Infra mailing list
> Infra at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>