Re: Full disk on resources.ovirt.org

From: "Karsten 'quaid' Wade" <kwade(a)redhat.com&gt; To: "Alexander Rydekull" <rydekull(a)gmail.com&gt; Cc: "infra" <infra(a)ovirt.org&gt; Sent: Saturday, May 11, 2013 8:04:43 AM Subject: Re: Full disk on resources.ovirt.org On 05/08/2013 01:44 AM, Alexander Rydekull wrote: > Okay, so I'm quite sick of these "full disk on linode01" issues. > > So, I propose the following solution: > > - A maintainer of jenkins publish-rpms-nightly disable the copy of several > versions of the each RPM (preferably only the latest, do we really need > more, its a nightly build afterall) > - A maintainer of jenkins publish-rpms-nightly TRY to make a link to the > files instead of copying them. > > - Until this is done, we can clear some disk (3 GB+) by doing something > like the following: ... and I just did that after it filled up again. But I suspect it's going to just reupload all those RPMs or something. I'm confused because there was suddenly 8+ GB of stuff in /var that wasn't there the other day. The /home/jenkins clean-up worked, in that it was 8 GB less in that folder tonight. I'm confused. But the below script got us back 11 GB. - Karsten > # cd /var/www/html/releases/nightly > # for yfile in $(for xfile in $(for file in $(find . -type f -name "*.rpm") > ; do echo $file | cut -d"." -f 1-2 ; done | sort -u) ; do ls ${xfile}* | > sort -n | head -n-2 ; done) ; do echo rm $yfile ; done > > This will effectively remove every RPM except the last two revisions of > each package. (Well, obviously you need to remove that very last "echo" in > the line, just putting it there not to ruins someones afternoon). > > - What I propose other then this is just putting the backups somewhere > else. > We should have sufficient space for this on another host. > If not, give ma thumbs up and I'll host the backups somewhere else for us > until we've gotten it in order. > > Any thoughts? > > > > On Wed, May 8, 2013 at 7:18 AM, Karsten 'quaid' Wade > <kwade(a)redhat.com&gt;wrote: > >> On 05/01/2013 11:51 PM, Eyal Edri wrote: >> >>>> >>>> What does /jenkins do? I find lots of RPMs in sub-directories that are >>>> apparently dailies for the last month. Can we sweep them out to get some >>>> breathing room? >>> >>> this is a temp place for publishing nightlies, but i think it may not be >> deleted probperly. >>> i added a remove function to the move cron script 'move_jenkins_nightly' >> to delete all content after it's published. >>> (deleting current data released 13GB). >> >> Looks like we have the same problem again - that directory structure is >> filled with many versions of similar files, and the disk is full again. >> I freed up enough space to keep Mailman running for now. >> >> -- >> Karsten 'quaid' Wade >> http://TheOpenSourceWay.org .^\ http://community.redhat.com >> @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 >> >> >> _______________________________________________ >> Infra mailing list >> Infra(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/infra >> >> > > -- Karsten 'quaid' Wade http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 _______________________________________________ Infra mailing list Infra(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/infra