Re: [Users] Host offline due to storage error

Adding the list, my bad. ----- Original Message -----
From: "Ian Mordey" <ian.mordey@wandisco.com> To: "Vered Volansky" <vered@redhat.com> Sent: Wednesday, December 11, 2013 2:11:46 PM Subject: Re: [Users] Host offline due to storage error
I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one of the nodes. This is a CentOS6 manager box and F19 nodes.
Please let me know if you need more info.
Thanks! Ian
On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky <vered@redhat.com> wrote:
Hi Ian,
Would you please send full logs? Also - Is there a point in time during this process when the Storage Domain is active?
Regards, vered
From: "Ian Mordey" <ian.mordey@wandisco.com> To: users@ovirt.org Sent: Tuesday, December 10, 2013 10:48:11 PM Subject: [Users] Host offline due to storage error
Hi there I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN array. My nodes keep going offline with these errors: Host reports about one of the Active Storage Domains as Problematic. Host cannot access one of the Storage Domains attached to the Data Center <DC> Setting Host state to Non-Operational
The host is then fenced, reboots and comes back up normally.
I see some of these errors prior to the event: 2013-12-10 13:36:49,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2013-12-10 13:36:49,448 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds = 7f74b28a-149a-4f87-9689-b23db6d435f7 : <hostname> , VDS Network Error, continuing. 2013-12-10 13:36:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
Any ideas where to look? I can't see any errors on the switches or SAN..
Thanks Ian
-- Listed on the London Stock Exchange: WAND<http://www.bloomberg.com/quote/WAND:LN>
THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or
----- Original Message ----- privilege.
If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Listed on the London Stock Exchange: WAND<http://www.bloomberg.com/quote/WAND:LN>
THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.

Hi Ian, I can't see any activity in the vdsm log around the time you cited from the engine log. Are you sure the vdsmd libvirtd deamons are running? Please run
service vdsmd status service libvirtd status
on the node. If they are indeed running, please check the BRIDGE settings on said node, they should be as follows: http://www.ovirt.org/Installing_VDSM_from_rpm#Configuring_the_bridge_Interfa... Please let me know the outcome of the above. Regards, Vered ----- Original Message -----
From: "Vered Volansky" <vered@redhat.com> To: "Ian Mordey" <ian.mordey@wandisco.com> Cc: "users" <users@ovirt.org> Sent: Wednesday, December 11, 2013 2:19:02 PM Subject: Re: [Users] Host offline due to storage error
Adding the list, my bad.
----- Original Message -----
From: "Ian Mordey" <ian.mordey@wandisco.com> To: "Vered Volansky" <vered@redhat.com> Sent: Wednesday, December 11, 2013 2:11:46 PM Subject: Re: [Users] Host offline due to storage error
I've attached the whole of /var/log/ovirt-engine and the vdsm.log from one of the nodes. This is a CentOS6 manager box and F19 nodes.
Please let me know if you need more info.
Thanks! Ian
On Wed, Dec 11, 2013 at 12:00 PM, Vered Volansky <vered@redhat.com> wrote:
Hi Ian,
Would you please send full logs? Also - Is there a point in time during this process when the Storage Domain is active?
Regards, vered
From: "Ian Mordey" <ian.mordey@wandisco.com> To: users@ovirt.org Sent: Tuesday, December 10, 2013 10:48:11 PM Subject: [Users] Host offline due to storage error
Hi there I've got a 3 node oVirt 3.3.1 setup connecting to an Equallogic iSCSI SAN array. My nodes keep going offline with these errors: Host reports about one of the Active Storage Domains as Problematic. Host cannot access one of the Storage Domains attached to the Data Center <DC> Setting Host state to Non-Operational
The host is then fenced, reboots and comes back up normally.
I see some of these errors prior to the event: 2013-12-10 13:36:49,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2013-12-10 13:36:49,448 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Failed to refresh VDS , vds = 7f74b28a-149a-4f87-9689-b23db6d435f7 : <hostname> , VDS Network Error, continuing. 2013-12-10 13:36:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
Any ideas where to look? I can't see any errors on the switches or SAN..
Thanks Ian
-- Listed on the London Stock Exchange: WAND<http://www.bloomberg.com/quote/WAND:LN>
THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or
----- Original Message ----- privilege.
If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Listed on the London Stock Exchange: WAND<http://www.bloomberg.com/quote/WAND:LN>
THIS MESSAGE AND ANY ATTACHMENTS ARE CONFIDENTIAL, PROPRIETARY, AND MAY BE PRIVILEGED. If this message was misdirected, WANdisco, Inc. and its subsidiaries, ("WANdisco") does not waive any confidentiality or privilege. If you are not the intended recipient, please notify us immediately and destroy the message without disclosing its contents to anyone. Any distribution, use or copying of this e-mail or the information it contains by other than an intended recipient is unauthorized. The views and opinions expressed in this e-mail message are the author's own and may not reflect the views and opinions of WANdisco, unless the author is authorized by WANdisco to express such views or opinions on its behalf. All email sent to or from this address is subject to electronic storage and review by WANdisco. Although WANdisco operates anti-virus programs, it does not accept responsibility for any damage whatsoever caused by viruses being passed.
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (1)
-
Vered Volansky