This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2CMDTUDGFKRXQWMDIBOAL Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else. Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net. --=20 Karsten 'quaid' Wade http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 ------enig2CMDTUDGFKRXQWMDIBOAL Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iD8DBQFRj5q42ZIOBq0ODEERAhWwAKDjMW6uFpSunHd3NBwC6h8cr/IXIgCbBAx4 ivCqozbzC9PW88sXNDOUzHc= =JBka -----END PGP SIGNATURE----- ------enig2CMDTUDGFKRXQWMDIBOAL--
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB) We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them?
Down again? ----- Original Message -----
From: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> To: "Karsten 'quaid' Wade" <kwade@redhat.com> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 6:41:35 PM Subject: Re: www.ovirt.org down?
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB)
We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them? _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
works for me, though a bit slow. Can we add to linode (or a new vm on alterway02) README files for handing such openshift outage? (since the wiki is down there is not point in hosting it there.) stuff like contacts, steps to recovery, etc... e. ----- Original Message -----
From: "Alon Bar-Lev" <alonbl@redhat.com> To: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 11:09:51 PM Subject: Re: www.ovirt.org down?
Down again?
----- Original Message -----
From: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> To: "Karsten 'quaid' Wade" <kwade@redhat.com> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 6:41:35 PM Subject: Re: www.ovirt.org down?
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB)
We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them? _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
Again? --- Sorry! This site is experiencing technical difficulties. Try waiting a few minutes and reloading. (Can't contact the database server: Lost connection to MySQL server at 'reading initial communication packet', system error: 111 (127.7.52.129)) --- ----- Original Message -----
From: "Alon Bar-Lev" <alonbl@redhat.com> To: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 11:09:51 PM Subject: Re: www.ovirt.org down?
Down again?
----- Original Message -----
From: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> To: "Karsten 'quaid' Wade" <kwade@redhat.com> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 6:41:35 PM Subject: Re: www.ovirt.org down?
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB)
We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them? _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
Working now. OpenShift had to do a kernel upgrade for a security issue, and it caused some issues. I believe that they restarted the service manually after being notified that it was down earlier. Regards, Dave. On 05/15/2013 01:24 AM, Alon Bar-Lev wrote:
Again? --- Sorry! This site is experiencing technical difficulties.
Try waiting a few minutes and reloading.
(Can't contact the database server: Lost connection to MySQL server at 'reading initial communication packet', system error: 111 (127.7.52.129)) ---
----- Original Message -----
From: "Alon Bar-Lev" <alonbl@redhat.com> To: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 11:09:51 PM Subject: Re: www.ovirt.org down?
Down again?
----- Original Message -----
From: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> To: "Karsten 'quaid' Wade" <kwade@redhat.com> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 6:41:35 PM Subject: Re: www.ovirt.org down?
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB)
We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them? _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- Dave Neary - Community Action and Impact Open Source and Standards, Red Hat - http://community.redhat.com Ph: +33 9 50 71 55 62 / Cell: +33 6 77 01 92 13
Can we have a readme file on linode (where passwords are located), with troubleshooting and contacts for future outages? personally i tried contacting someone on #openshift, no one answered. and when trying to ssh to www.ovirt.org my public key was defined, so i'd be happy to know for next time what are the steps to resolve these kind of failures. e. ----- Original Message -----
From: "Dave Neary" <dneary@redhat.com> To: "Alon Bar-Lev" <alonbl@redhat.com> Cc: infra@ovirt.org Sent: Wednesday, May 15, 2013 4:03:44 PM Subject: Re: www.ovirt.org down?
Working now. OpenShift had to do a kernel upgrade for a security issue, and it caused some issues. I believe that they restarted the service manually after being notified that it was down earlier.
Regards, Dave.
On 05/15/2013 01:24 AM, Alon Bar-Lev wrote:
Again? --- Sorry! This site is experiencing technical difficulties.
Try waiting a few minutes and reloading.
(Can't contact the database server: Lost connection to MySQL server at 'reading initial communication packet', system error: 111 (127.7.52.129)) ---
----- Original Message -----
From: "Alon Bar-Lev" <alonbl@redhat.com> To: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 11:09:51 PM Subject: Re: www.ovirt.org down?
Down again?
----- Original Message -----
From: "Ewoud Kohl van Wijngaarden" <ewoud+ovirt@kohlvanwijngaarden.nl> To: "Karsten 'quaid' Wade" <kwade@redhat.com> Cc: infra@ovirt.org Sent: Sunday, May 12, 2013 6:41:35 PM Subject: Re: www.ovirt.org down?
On Sun, May 12, 2013 at 06:35:52AM -0700, Karsten 'quaid' Wade wrote:
I issued 'rhc app restart' but am not getting any good result. I'm about to leave for a flight, so I have to pass the troubleshooting to someone else.
Anyone with OpenShift CLI privileges should be able to handle the app. If you cannot get things to work, try #openshift on irc.freenode.net.
I asked on #openshift because I couldn't log in. Turns out the disk was full. strace helped me by compressing the apache logs and there's some space free now. (logs were 2.8GB, compressed 115MB)
We should look into reducing the number of errors. Maybe if we can't fix the templates, we can tune the PHP error level to not log them? _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
-- Dave Neary - Community Action and Impact Open Source and Standards, Red Hat - http://community.redhat.com Ph: +33 9 50 71 55 62 / Cell: +33 6 77 01 92 13 _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2ACOMOEWRIENCPREPFWRL Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 05/15/2013 09:08 AM, Eyal Edri wrote:
Can we have a readme file on linode (where passwords are located), with troubleshooting and contacts for future outages?
Yeah, and I'd like us to duplicate a few of those files from /root to another few hosts. I know it's not optimal, but as a backup to whatever is out there any of the maintainers can find a machine to ssh to that has passwords and contact/info for fixing various services. Maybe it can be a copy-paste from a wiki page, too.
personally i tried contacting someone on #openshift, no one answered. and when trying to ssh to www.ovirt.org my public key was defined,
I responded separately to Eyal with the details on how to use OpenShift. For others here, OpenShift uses the sshkey for git access (to push changes), and the 'rhc' command that lets you control the app remotely. One rarely shells directly to the running instance, as any changes made there are blown away from changes pushed to git (some exceptions.)
so i'd be happy to know for next time what are the steps to resolve these kind of failures.
I'm running in to the problem of no time to work on this, even though it's helpful. Is Dave available? Anyone else with OpenShift experience? It's all rather straightforward and on their website/forum. When I want to know how to do something, I search for the desire and the answer usually pops up. The one exception is that each of you needs to keep track of the unique ID and URL that we use git/ssh with. - Karsten --=20 Karsten 'quaid' Wade http://TheOpenSourceWay.org .^\ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 ------enig2ACOMOEWRIENCPREPFWRL Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iD8DBQFRlUco2ZIOBq0ODEERAuiKAJ9YAh5PK3jfB0Ccsk30NRTo8JPLmgCfQTJ3 +MVAXI031MD3zKWPoxLnNqU= =P4SX -----END PGP SIGNATURE----- ------enig2ACOMOEWRIENCPREPFWRL--
participants (5)
-
Alon Bar-Lev -
Dave Neary -
Ewoud Kohl van Wijngaarden -
Eyal Edri -
Karsten 'quaid' Wade