We've seen some SPOFs (Single Point Of Failure) on people. We all know
this is a bad thing, but how do we fix it?
Let's start by listing the services. Please correct/add info if you have
* website / wiki
* Rydekull (SSH only)
* ewoud (SSH only)
* quaid (full admin)
* mailing lists
* gerrit backups
* jenkins master
* ewoud (jenkins account broken due to openid plugin)
* ovirt host to be, waiting for IP space to install guests
* jenkins slaves (not installed yet)
Jenkins slaves, incomplete list I'm sure
Runs Fedora 17, sponsored by my employer Oxilion.
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
Content-Type: text/plain; charset=ISO-8859-1
There was an unplanned outage of lists.ovirt.org/resources.ovirt.org for
=3D=3D Details =3D=3D
We began receiving disk full alerts from Postfix on linode01.ovirt.org,
that houses lists.ovirt.org and resources.ovirt.org.
I looked around the server to find more disk space, but there was
nothing obvious that I could drop. Regardless, it's clear from existing
needs that more disk space was needed.
I shutdown the server, added 12 GB more to the drive image, and
restarted the host.
=3D=3D Affected services =3D=3D
* Mailman (lists.ovirt.org)
* Package repo (resources.ovirt.org)
=3D=3D=3D Not-affected services =3D=3D
=3D=3D Future plans =3D=3D
Migrate the entire host to a set of VMs running in one of the new
hosting environments. ASAP.
Karsten 'quaid' Wade, Sr. Analyst - Community Growth
http://TheOpenSourceWay.org .^\ http://community.redhat.com
@quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.13 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
-----END PGP SIGNATURE-----
I'm trying to build the nighlty for vdsm, and it seems that we are out
of space again.
Eyal proposed to delete some old nightly builds, I'll do that if noone
replies in 30 min.
Also changing the cleanup cron to keep less history on
And of course expanding the disk size.
Anyone with other/better proposals?
Red Hat Czech s.r.o.
Continuous Integration Engineer - EMEA ENG Virtualization R&D
Tel.: +420 532 294 605
Red Hat Czech s.r.o., Purkyňova 99/71, 612 45, Brno, Czech Republic
RHT Global #: 82-62605