Major outage

David Caro dcaroest at redhat.com
Tue Feb 3 19:35:58 UTC 2015


New update,

Host srv01 is up and running, but 02 and 03 have issues, they can't start up
any vms.

The error is in libvirt:

libvirtError: Child quit during startup handshake: Input/output error


Looking around I saw a thread in the users lists that fixed it with_

  /usr/lib/systemd/systemd-vdsmd reconfigure force

That worked on srv01, but the others did not. So I'm trying to upgrade to fc20
one of them, the srv02, hoping the newer libvirt version will not have that
issue.

Those two hosts are the ones that are in the production data center, and it
has the foreman vm, so none of the slaves is working properly until that is solved.


Will update in ~one hour or when the problem is solved.

Being so late, if I get the production vms running in one host, I'll leave the
rest for tomorrow.


D

On 02/03, David Caro wrote:
> 
> Ok, update:
> 
> 
> Not all the servers have been restored, most of the slave vms are up, and all
> but one host are up.
> 
> Engine - Ok
> storage -Ok
> storage01 - Ok
> storage02 - Ok
> srv01 - DOWN
> srv02 - OUT OF THE POOL (will add when 01 is up)
> srv03 - OK
> srv04 - OK
> srv05 - OK
> srv06 - OK
> srv07 - OK
> srv08 - OK
> 
> 
> If you need any specific vm I can try to get it up on one of the running hosts,
> but I'd wait until the last host is up to start all of them.
> 
> 
> Will update again when finished or in one hour.
> 
> 
> On 02/03, David Caro wrote:
> > 
> > We are having a major outage on phoenix lab, don't expect any vms/slaves to be
> > properly working yet.
> > 
> > Will update when solved or in an hour with the status.
> > 
> > 
> > -- 
> > David Caro
> > 
> > Red Hat S.L.
> > Continuous Integration Engineer - EMEA ENG Virtualization R&D
> > 
> > Tel.: +420 532 294 605
> > Email: dcaro at redhat.com
> > Web: www.redhat.com
> > RHT Global #: 82-62605
> 
> 
> 
> > _______________________________________________
> > Infra mailing list
> > Infra at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/infra
> 
> 
> -- 
> David Caro
> 
> Red Hat S.L.
> Continuous Integration Engineer - EMEA ENG Virtualization R&D
> 
> Tel.: +420 532 294 605
> Email: dcaro at redhat.com
> Web: www.redhat.com
> RHT Global #: 82-62605



> _______________________________________________
> Infra mailing list
> Infra at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra


-- 
David Caro

Red Hat S.L.
Continuous Integration Engineer - EMEA ENG Virtualization R&D

Tel.: +420 532 294 605
Email: dcaro at redhat.com
Web: www.redhat.com
RHT Global #: 82-62605
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 473 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/infra/attachments/20150203/43e931ed/attachment.sig>


More information about the Infra mailing list