[Users] Host offline due to storage error

Thu Dec 12 11:24:59 UTC 2013

Hi Ian,

I can't see any activity in the vdsm log around the time you cited from the engine log.
Are you sure the vdsmd libvirtd deamons are running?

Please run 
> service vdsmd status
> service libvirtd status

on the node.

If they are indeed running, please check the BRIDGE settings on said node, they should be as follows:
http://www.ovirt.org/Installing_VDSM_from_rpm#Configuring_the_bridge_Interface

Please let me know the outcome of the above.

Regards,
Vered

----- Original Message -----
> From: "Vered Volansky" <vered at redhat.com>
> To: "Ian Mordey" <ian.mordey at wandisco.com>
> Cc: "users" <users at ovirt.org>
> Sent: Wednesday, December 11, 2013 2:19:02 PM
> Subject: Re: [Users] Host offline due to storage error
> 
> Adding the list, my bad.
> 
> ----- Original Message -----
> > From: "Ian Mordey" <ian.mordey at wandisco.com>
> > To: "Vered Volansky" <vered at redhat.com>
> > Sent: Wednesday, December 11, 2013 2:11:46 PM
> > Subject: Re: [Users] Host offline due to storage error
> > 
> > I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one
> > of the nodes. This is a CentOS6 manager box and F19 nodes.
> > 
> > Please let me know if you need more info.
> > 
> > Thanks!
> > Ian
> > 
> > 
> > On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky <vered at redhat.com> wrote:
> > 
> > > Hi Ian,
> > >
> > > Would you please send full logs?
> > > Also - Is there a point in time during this process when the Storage
> > > Domain is active?
> > >
> > > Regards,
> > > vered
> > >
> > > ----- Original Message -----
> > > > From: "Ian Mordey" <ian.mordey at wandisco.com>
> > > > To: users at ovirt.org
> > > > Sent: Tuesday, December 10, 2013 10:48:11 PM
> > > > Subject: [Users] Host offline due to storage error
> > > >
> > > > Hi there
> > > > I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI
> > > > SAN
> > > > array. My nodes keep going offline with these errors:
> > > > Host reports about one of the Active Storage Domains as Problematic.
> > > > Host cannot access one of the Storage Domains attached to the Data
> > > > Center
> > > > <DC> Setting Host state to Non-Operational
> > > >
> > > > The host is then fenced, reboots and comes back up normally.
> > > >
> > > > I see some of these errors prior to the event:
> > > > 2013-12-10 13:36:49,442 ERROR
> > > > [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand]
> > > > (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed.
> > > > Exception: VDSNetworkException: java.net.ConnectException: Connection
> > > > refused
> > > > 2013-12-10 13:36:49,448 WARN
> > >  [org.ovirt.engine.core.vdsbroker.VdsManager]
> > > > (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds =
> > > > 7f74b28a-149a-4f87-9689-b23db6d435f7 : <hostname> , VDS Network Error,
> > > > continuing.
> > > > 2013-12-10 13:36:52,490 ERROR
> > > > [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
> > > > (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution
> > > > failed. Exception: VDSNetworkException: java.net.ConnectException:
> > > > Connection refused
> > > >
> > > > Any ideas where to look? I can't see any errors on the switches or
> > > > SAN..
> > > >
> > > > Thanks
> > > > Ian
> > > >
> > > > --
> > > > Listed on the London Stock Exchange:
> > > > WAND<http://www.bloomberg.com/quote/WAND:LN>
> > > >
> > > > THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY
> > > BE
> > > > PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
> > > > subsidiaries, ("WANdisco") does not waive any confidentiality or
> > > privilege.
> > > >  If you are not the intended recipient, please notify us immediately
> > > >  and
> > > > destroy the message without disclosing its contents to anyone.  Any
> > > > distribution, use or copying of this e-mail or the information it
> > > contains
> > > > by other than an intended recipient is unauthorized.  The views and
> > > > opinions expressed in this e-mail message are the author's own and may
> > > not
> > > > reflect the views and opinions of WANdisco, unless the author is
> > > authorized
> > > > by WANdisco to express such views or opinions on its behalf.  All email
> > > > sent to or from this address is subject to electronic storage and
> > > > review
> > > by
> > > > WANdisco.  Although WANdisco operates anti-virus programs, it does not
> > > > accept responsibility for any damage whatsoever caused by viruses being
> > > > passed.
> > > >
> > > >
> > > > _______________________________________________
> > > > Users mailing list
> > > > Users at ovirt.org
> > > > http://lists.ovirt.org/mailman/listinfo/users
> > > >
> > >
> > 
> > --
> > Listed on the London Stock Exchange:
> > WAND<http://www.bloomberg.com/quote/WAND:LN>
> > 
> > THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE
> > PRIVILEGED.  If this message was misdirected, WANdisco, Inc. and its
> > subsidiaries, ("WANdisco") does not waive any confidentiality or privilege.
> >  If you are not the intended recipient, please notify us immediately and
> > destroy the message without disclosing its contents to anyone.  Any
> > distribution, use or copying of this e-mail or the information it contains
> > by other than an intended recipient is unauthorized.  The views and
> > opinions expressed in this e-mail message are the author's own and may not
> > reflect the views and opinions of WANdisco, unless the author is authorized
> > by WANdisco to express such views or opinions on its behalf.  All email
> > sent to or from this address is subject to electronic storage and review by
> > WANdisco.  Although WANdisco operates anti-virus programs, it does not
> > accept responsibility for any damage whatsoever caused by viruses being
> > passed.
> > 
> > 
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
> 