oVirt Infra Weekly Update :: 2015-02-05

--6b3yLyRKT1M6kiA0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi everyone! =3D=3D Hosting * Last week we finally retired all the rackspace hosts, there's a backup available for a few weeks in case we need to restore anything. * Major infra outage: Starting on monday evening we had a series of issues that made the infra unstable throughout all monday evening and tuesday. The causes were an unexpected cluster degradation on the storage servers = when changing the netmask, and failures derived from the unfinished upgrade to= 3.5 on the ovirt setup. All the servers are now back to stable, and we also took the opportunity = to upgrade all the hosts to fc20 and 3.5, so now we have a more robust setup than we had before the outage. We have now nested available for any VM on the jenkins or production clusters. Also the ip range available for the jenkins slaves has been duplicated, passing from /26 to /25 =3D=3D Jenkins * A lot of jobs failed due to the outage, we are still stabilizing the jobs, any new failure you see please ping me or send an email to infra, but if = it was during the outage there's no need to communicate it, we already know. * Proxy setup in phoenix lab almost finished, doing the final tests =3D=3D Team * There's a new team member apprentice, Vishnu, that has already taken one = of the tickets :), Welcome!! --=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro(a)redhat.com Web: www.redhat.com RHT Global #: 82-62605 --6b3yLyRKT1M6kiA0 Content-Type: application/pgp-signature --6b3yLyRKT1M6kiA0--