<div dir="ltr">Hrm, all your "<a href="http://pastebin.test.redhat.com">pastebin.test.redhat.com</a>" is inaccessible by me.<br><br><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, May 8, 2013 at 12:04 PM, Eyal Edri <span dir="ltr"><<a href="mailto:eedri@redhat.com" target="_blank">eedri@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">----- Original Message -----<br>
> From: "Alexander Rydekull" <<a href="mailto:rydekull@gmail.com">rydekull@gmail.com</a>><br>
> To: "Karsten 'quaid' Wade" <<a href="mailto:kwade@redhat.com">kwade@redhat.com</a>><br>
> Cc: "infra" <<a href="mailto:infra@ovirt.org">infra@ovirt.org</a>><br>
> Sent: Wednesday, May 8, 2013 11:44:31 AM<br>
> Subject: Re: Full disk on <a href="http://resources.ovirt.org" target="_blank">resources.ovirt.org</a><br>
><br>
> Okay, so I'm quite sick of these "full disk on linode01" issues.<br>
><br>
> So, I propose the following solution:<br>
><br>
> - A maintainer of jenkins publish-rpms-nightly disable the copy of several<br>
> versions of the each RPM (preferably only the latest, do we really need<br>
> more, its a nightly build afterall)<br>
> - A maintainer of jenkins publish-rpms-nightly TRY to make a link to the<br>
> files instead of copying them.<br>
><br>
> - Until this is done, we can clear some disk (3 GB+) by doing something like<br>
> the following:<br>
> # cd /var/www/html/releases/nightly<br>
> # for yfile in $(for xfile in $(for file in $(find . -type f -name "*.rpm") ;<br>
> do echo $file | cut -d"." -f 1-2 ; done | sort -u) ; do ls ${xfile}* | sort<br>
> -n | head -n-2 ; done) ; do echo rm $yfile ; done<br>
><br>
> This will effectively remove every RPM except the last two revisions of each<br>
> package. (Well, obviously you need to remove that very last "echo" in the<br>
> line, just putting it there not to ruins someones afternoon).<br>
><br>
> - What I propose other then this is just putting the backups somewhere else.<br>
> We should have sufficient space for this on another host.<br>
> If not, give ma thumbs up and I'll host the backups somewhere else for us<br>
> until we've gotten it in order.<br>
><br>
> Any thoughts?<br>
<br>
</div></div>1. Anyone with access to <a href="http://resources.ovirt.org" target="_blank">resources.ovirt.org</a> can login and review the current scripts that handle the history (found at /etc/cron.d),<br>
no need to wait for a specific maintainer to be free to handle it.<br>
<br>
2. since this is becoming a recurrent issue i put here the cleaner script (which i didn't wrote, so not sure if it's working properly)<br>
<br>
[1] <a href="http://pastebin.test.redhat.com/140876" target="_blank">http://pastebin.test.redhat.com/140876</a><br>
<br>
you're welcome to review it/fix it/change it.<br>
<br>
3. as for the cleanup [2] of temp dir @ /home/jenkins/ovirt-nightly/*<br>
which didn't delete the temp dir, it's fixed now.<br>
<br>
[2] <a href="http://pastebin.test.redhat.com/140879" target="_blank">http://pastebin.test.redhat.com/140879</a><br>
<br>
i believe there was a bug in the 'move script' ,the output - it has an error on .tar.gz - <a href="http://pastebin.test.redhat.com/140881" target="_blank">http://pastebin.test.redhat.com/140881</a><br>
<br>
<br>
I propose the following:<br>
<br>
1. upload these scripts to review on gerrit upstream - <a href="http://gerrit.ovirt.org/jenkins" target="_blank">gerrit.ovirt.org/jenkins</a> (or another git infra repo ?)<br>
2. i would move these scripts to run from jenkins rather than cron to increase visibility and prompt errors<br>
(since we won't allow root login from jenkins to resources, we'll need to run it with jenkins user and sudo).<br>
3. move all backups from that vm to another phsical host we have (currently we only have alterway01/02).<br>
<div class="im"><br>
<br>
<br>
<br>
><br>
><br>
><br>
> On Wed, May 8, 2013 at 7:18 AM, Karsten 'quaid' Wade < <a href="mailto:kwade@redhat.com">kwade@redhat.com</a> ><br>
> wrote:<br>
><br>
><br>
><br>
> On 05/01/2013 11:51 PM, Eyal Edri wrote:<br>
><br>
> >><br>
> >> What does /jenkins do? I find lots of RPMs in sub-directories that are<br>
> >> apparently dailies for the last month. Can we sweep them out to get some<br>
> >> breathing room?<br>
> ><br>
> > this is a temp place for publishing nightlies, but i think it may not be<br>
> > deleted probperly.<br>
> > i added a remove function to the move cron script 'move_jenkins_nightly' to<br>
> > delete all content after it's published.<br>
> > (deleting current data released 13GB).<br>
><br>
> Looks like we have the same problem again - that directory structure is<br>
> filled with many versions of similar files, and the disk is full again.<br>
> I freed up enough space to keep Mailman running for now.<br>
><br>
> --<br>
> Karsten 'quaid' Wade<br>
> <a href="http://TheOpenSourceWay.org" target="_blank">http://TheOpenSourceWay.org</a> .^\ <a href="http://community.redhat.com" target="_blank">http://community.redhat.com</a><br>
</div>> @quaid ( <a href="http://identi.ca/twitter/IRC" target="_blank">identi.ca/twitter/IRC</a> ) \v' gpg: AD0E0C41<br>
<div class="HOEnZb"><div class="h5">><br>
><br>
> _______________________________________________<br>
> Infra mailing list<br>
> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/infra" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
><br>
><br>
><br>
><br>
> --<br>
> /Alexander Rydekull<br>
><br>
> _______________________________________________<br>
> Infra mailing list<br>
> <a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/infra" target="_blank">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>/Alexander Rydekull
</div>