10:07 a.m.
--=-cLaelN2dV7AgGqf5GLNT
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Le mercredi 10 d=C3=A9cembre 2014 =C3=A0 10:41 +0100, Michael Scherer a =C3=
=A9crit :
Le mardi 09 d=C3=A9cembre 2014 =C3=A0 18:00 -0500, Brian Proffitt a
=C3=
=A9crit :
>=20
> ----- Original Message -----
> > From: "Michael Scherer" <mscherer(a)redhat.com>
> > To: infra(a)ovirt.org
> > Sent: Monday, December 8, 2014 8:07:33 AM
> > Subject: Re: [OUTAGE] ovirt.org wiki outage report [07/12/14]
> >=20
> > Le lundi 08 d=C3=A9cembre 2014 =C3=A0 13:28 +0100, Michael Scherer a =
=C3=A9crit :
> > > Le lundi 08 d=C3=A9cembre 2014 =C3=A0 06:23 -0500,
Eyal Edri a =C3=
=A9crit :
> > > >=20
> > > > ----- Original Message -----
> > > > > From: "Michael Scherer" <mscherer(a)redhat.com>
> > > > > To: infra(a)ovirt.org
> > > > > Sent: Monday, December 8, 2014 1:03:01 PM
> > > > > Subject: Re: [OUTAGE] ovirt.org wiki outage report [07/12/14]
> > > > >=20
> > > > > Le dimanche 07 d=C3=A9cembre 2014 =C3=A0 03:25 -0500, Eyal Edri=
a =C3=A9crit :
> > > > > > fyi,
> > > > > >=20
> > > > > > ovirt.org wiki page was down today from 01:33:07 IST till
10:=
22 IST.
> > > > > >=20
> > > > > > REASON:
> > > > > > =3D=3D=3D=3D=3D=3D=3D
> > > > > > after logging into the openshift gear, seems like there was
9=
9.9%
> > > > > > space
> > > > > > taken.
> > > > > >=20
> > > > > >=20
> > > > > > RESOLUTION:
> > > > > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> > > > > > deleted some logs from $OPENSHIFT_MYSQL_DB_LOG_DIR, and
resta=
rted
> > > > > > mysql
> > > > > > using 'ctl_app restart'.
> > > > > > space is still not great - at 84%, so we'll need to
think soo=
n how to
> > > > > > resolve this.
> > > > > >=20
> > > > > >=20
> > > > > >=20
> > > > > > wiki is up now and seems to working well.
> > > > > > infra - we should look into migrating to a new gear maybe?
or=
extend
> > > > > > again
> > > > > > the existing one.
> > > > >=20
> > > > > Happened again today.
> > > > >=20
> > > > > I still maintain that we should move to a dedicated hosting on =
the phx2
> > > > > cluster :)
> > > > > ( or request quota extensions ).
> > > >=20
> > > > whether if we'll migrate or not, that will take time and
won't ha=
ppen
> > > > until the ILO issue will be resolved.
> > > > for now we need to extend our volume there ASAP, cause it will ha=
ppen
> > > > again soon, not too many log files
> > > > are there to delete/gzip.
> > >=20
> > > Agreed. We did request already a quota extension, IIRC, so I guess =
that
> > > was not sufficient ?
> >=20
> > Filled the form to get more, will tell you when I have a response.
> > --
> > Michael Scherer
> > Open Source and Standards, Sysadmin
> >=20
> > _______________________________________________
> > Infra mailing list
> > Infra(a)ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/infra
> >=20
>=20
>=20
> Went out again this afternoon (12/9), but managed to squeeze out a litt=
le
more disk space running rhc app tidy. (Thanks to Jason and Justin for th=
e assist!)
>=20
> If there is any way I can help expedite more disk quota, please let me =
know!
=20
It take a few days. Last time we did ask, it was request =3D> go to
marketing for approval =3D> go to the sysadmins team for action.=20
=20
As long as this in the marketing side, I have no visibility ( but can
ask ). On the openshift sysadmin side, I know where to ping :)
So, today it was full again, and openshift people did contact me. We
increased the quota, and while on it, I did the dump/restore needed to
clean the ever increasing ibdata1 file
( http://www.percona.com/blog/2013/08/20/why-is-the-ibdata1-file-continuous=
ly-growing-in-mysql/ ).
It took a few hours to process, and since things would not be fun
without it, my internet connexion started to behave badly.
But now, we are down to 6G out of 10G, so wait and see.
--=20
Michael Scherer
Open Source and Standards, Sysadmin
--=-cLaelN2dV7AgGqf5GLNT
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part
Content-Transfer-Encoding: 7bit
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)
iQIcBAABAgAGBQJUicFOAAoJEE89Wa+PrSK9kuYP/j6YuUHq47zIdwY2lyHZlV6U
6XY8pibh6R/RrhJG7ZcRPyZIzwduNMof2UnRt0HHH/iLvQuqAt4MzPWjm5pMEja0
EufHaxsBOJZdBL5IW0S5vSuGZLSelPPPAwkoBYovg74iSHRRKMFyvmo4/o+sGadw
teVwVPRO5cNMuSL1u7w4EbJN3aSZpFBdnUyd9ICldycSdWRw88qOZLIYFYmNO0ES
ZzlnPm/4YnvW39Ch2G1KIAmmJv0DJwFRYRq4PNKaCTR4MZYne22u+8MqjDI7nLDE
9lTmLd57aduVj/cHOCT/GUKmFQOmo5L93/BvSOWtpb9v/vkljbpfQ7WjaAkkYt/L
TTk12PjDnZHq/b9/zNeJhorqMIakJfYvZ3KS3sInJLtTimdWP3zXi80mFt1FYrbq
iPD66thS3t6yp0qBktX4tv+XtmbE15Bc3HpfOkb8sqHwBok6PRAJQA4mIZUpFyVS
NK+E010qUxmzBwxjeon7ja2GSBEMJOfEtlDKKaLX96IoaL3bxOGaIInWEELKshwA
X7XpOb+nizMBQO8EYE80dvtV8sSFPsBNVc5G+l+8taeoeOp7iytNa2j5ub0Z1Ad/
1CVsCcNTPt43MTP6staQC2R21TMVW8jLYg1XMrIlucheulzrzum51pWJOjqEBxTQ
E4N+eFkrDVoF09aU2vll
=FxDo
-----END PGP SIGNATURE-----
--=-cLaelN2dV7AgGqf5GLNT--