7:19 a.m.
Hi all,
I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
cluster is used to host several VMs.
I have observed that when gateway is lost (say the gateway device is down)
the ovirt cluster goes down.
It seems a bit extreme behavior especially when one does not care if the
hosted VMs have connectivity to Internet or not.
Can this behavior be disabled?
Thanx,
Alex
2:36 a.m.
Hi Alex,
Please provide Engine logs from when this is occurring and mention the
date/time we should focus at.
Thanks,
Edy.
On Mon, Feb 5, 2018 at 2:19 PM, Alex K <rightkicktech(a)gmail.com> wrote:
Hi all,
I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
cluster is used to host several VMs.
I have observed that when gateway is lost (say the gateway device is down)
the ovirt cluster goes down.
It seems a bit extreme behavior especially when one does not care if the
hosted VMs have connectivity to Internet or not.
Can this behavior be disabled?
Thanx,
Alex
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
3:20 a.m.
Hi Edward,
So this is not an expected behavior?
I will collect logs as soon as I reproduce it.
Thanx,
Alex
On Tue, Feb 6, 2018 at 9:36 AM, Edward Haas <ehaas(a)redhat.com> wrote:
Hi Alex,
Please provide Engine logs from when this is occurring and mention the
date/time we should focus at.
Thanks,
Edy.
On Mon, Feb 5, 2018 at 2:19 PM, Alex K <rightkicktech(a)gmail.com> wrote:
> Hi all,
>
> I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
> cluster is used to host several VMs.
> I have observed that when gateway is lost (say the gateway device is
> down) the ovirt cluster goes down.
>
> It seems a bit extreme behavior especially when one does not care if the
> hosted VMs have connectivity to Internet or not.
>
> Can this behavior be disabled?
>
> Thanx,
> Alex
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
3:40 a.m.
On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com> wrote:
Hi all,
I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
cluster is used to host several VMs.
I have observed that when gateway is lost (say the gateway device is down)
the ovirt cluster goes down.
Is the cluster down, or just the self-hosted engine?
It seems a bit extreme behavior especially when one does not care if the
hosted VMs have connectivity to Internet or not.
Are the VMs down?
The hosts?
Y.
Can this behavior be disabled?
Thanx,
Alex
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
10:06 a.m.
--Apple-Mail=_9545B43A-6071-46DF-A6C0-EC3F1563FEE9
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
I=E2=80=99ve seen this sort of happen on my systems, the gateway ip goes =
down for some reason, and the engine restarts repeatedly, rending it =
unusable, even though it=E2=80=99s on the same ip subnet as all the host =
boxes and can still talk to the VDSMs. In my case, it doesn=E2=80=99t =
hurt the cluster or DC, but it=E2=80=99s annoying and unnecessary in my =
environment where the gateway isn=E2=80=99t important for cluster =
communications..
I can understand why using the ip of the gateway became a test as a =
proxy for network connectivity, but it seems like it=E2=80=99s something =
that isn=E2=80=99t always valid and maybe the local admin should have a =
choice of how it=E2=80=99s used. Something like the current fencing =
option for =E2=80=9C50% hosts down=E2=80=9D as a double check, if you =
can still reach the vdsm hosts, don=E2=80=99t restart the engine vm.
-Darrell
From: Yaniv Kaul <ykaul(a)redhat.com>
Subject: Re: [ovirt-users] ovirt and gateway behavior
Date: February 6, 2018 at 2:40:14 AM CST
To: Alex
Cc: Ovirt Users
=20
=20
=20
On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com =
<mailto:rightkicktech@gmail.com>> wrote:
Hi all,=20
=20
I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. =
The cluster
is used to host several VMs.=20
I have observed that when gateway is lost (say the gateway device is
=
down) the ovirt cluster goes down.=20
=20
Is the cluster down, or just the self-hosted engine?=20
=20
=20
It seems a bit extreme behavior especially when one does not care if =
the hosted
VMs have connectivity to Internet or not.=20
=20
Are the VMs down?=20
The hosts?=20
Y.=20
=20
=20
Can this behavior be disabled?
=20
Thanx,=20
Alex
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org <mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users =
<http://lists.ovirt.org/mailman/listinfo/users>
=20
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_9545B43A-6071-46DF-A6C0-EC3F1563FEE9
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;" =
class=3D"">I=E2=80=99ve seen this sort of happen on my systems, the =
gateway ip goes down for some reason, and the engine restarts =
repeatedly, rending it unusable, even though it=E2=80=99s on the same ip =
subnet as all the host boxes and can still talk to the VDSMs. In my =
case, it doesn=E2=80=99t hurt the cluster or DC, but it=E2=80=99s =
annoying and unnecessary in my environment where the gateway isn=E2=80=99t=
important for cluster communications..<div class=3D""><br =
class=3D""></div><div class=3D"">I can understand why
using the ip of =
the gateway became a test as a proxy for network connectivity, but it =
seems like it=E2=80=99s something that isn=E2=80=99t always valid and =
maybe the local admin should have a choice of how it=E2=80=99s used. =
Something like the current fencing option for =E2=80=9C50% hosts down=E2=80=
=9D as a double check, if you can still reach the vdsm hosts, don=E2=80=99=
t restart the engine vm.</div><div class=3D""><br
class=3D""></div><div =
class=3D""> -Darrell<br
class=3D""><div><blockquote type=3D"cite" =
class=3D""><hr style=3D"border:none;border-top:solid #B5C4DF =
1.0pt;padding:0 0 0 0;margin:10px 0 5px 0;" class=3D""><span =
style=3D"margin: -1.3px 0.0px 0.0px 0.0px" id=3D"RwhHeaderAttributes"
=
class=3D""><font face=3D"Helvetica" size=3D"4"
color=3D"#000000" =
style=3D"font: 13.0px Helvetica; color: #000000" class=3D""><b
=
class=3D"">From:</b> Yaniv Kaul <<a
href=3D"mailto:ykaul@redhat.com" =
class=3D"">ykaul(a)redhat.com</a>&gt;</font></span><br
class=3D"">
<span style=3D"margin: -1.3px 0.0px 0.0px 0.0px"
class=3D""><font =
face=3D"Helvetica" size=3D"4" color=3D"#000000"
style=3D"font: 13.0px =
Helvetica; color: #000000" class=3D""><b
class=3D"">Subject:</b> Re: =
[ovirt-users] ovirt and gateway behavior</font></span><br
class=3D"">
<span style=3D"margin: -1.3px 0.0px 0.0px 0.0px"
class=3D""><font =
face=3D"Helvetica" size=3D"4" color=3D"#000000"
style=3D"font: 13.0px =
Helvetica; color: #000000" class=3D""><b
class=3D"">Date:</b> February =
6, 2018 at 2:40:14 AM CST</font></span><br class=3D"">
<span style=3D"margin: -1.3px 0.0px 0.0px 0.0px"
class=3D""><font =
face=3D"Helvetica" size=3D"4" color=3D"#000000"
style=3D"font: 13.0px =
Helvetica; color: #000000" class=3D""><b
class=3D"">To:</b> =
Alex</font></span><br class=3D"">
<span style=3D"margin: -1.3px 0.0px 0.0px 0.0px"
class=3D""><font =
face=3D"Helvetica" size=3D"4" color=3D"#000000"
style=3D"font: 13.0px =
Helvetica; color: #000000" class=3D""><b
class=3D"">Cc:</b> Ovirt =
Users</font></span><br class=3D"">
<br class=3D"Apple-interchange-newline"><div
class=3D""><div dir=3D"auto" =
class=3D""><div class=3D""><br
class=3D""><div class=3D"gmail_extra"><br =
class=3D""><div class=3D"gmail_quote">On Feb 5, 2018 2:21 PM,
"Alex K" =
<<a href=3D"mailto:rightkicktech@gmail.com" =
class=3D"">rightkicktech(a)gmail.com</a>&gt; wrote:<br
type=3D"attribution" =
class=3D""><blockquote class=3D"quote" style=3D"margin:0 0
0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr" =
class=3D""><div class=3D""><div
class=3D""><div class=3D"">Hi all, <br =
class=3D""><br class=3D""></div><div
class=3D"">I have a 3 nodes ovirt =
4.1 cluster, self hosted on top of glusterfs. The cluster is used to =
host several VMs. <br class=3D""></div>I have observed that when
gateway =
is lost (say the gateway device is down) the ovirt cluster goes down. =
<br
class=3D""></div></div></div></blockquote></div></div></div><div
=
dir=3D"auto" class=3D""><br
class=3D""></div><div dir=3D"auto" =
class=3D"">Is the cluster down, or just the self-hosted =
engine? </div><div dir=3D"auto" class=3D""><br
class=3D""></div><div =
dir=3D"auto" class=3D""><div
class=3D"gmail_extra"><div =
class=3D"gmail_quote"><blockquote class=3D"quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr" =
class=3D""><div class=3D""><div
class=3D""><br class=3D""></div>It seems =
a bit extreme behavior especially when one does not care if the hosted =
VMs have connectivity to Internet or not. <br =
class=3D""></div></div></blockquote></div></div></div><div
dir=3D"auto" =
class=3D""><br class=3D""></div><div
dir=3D"auto" class=3D"">Are the VMs =
down? </div><div dir=3D"auto" class=3D"">The
hosts? </div><div =
dir=3D"auto" class=3D"">Y. </div><div
dir=3D"auto" class=3D""><br =
class=3D""></div><div dir=3D"auto"
class=3D""><div =
class=3D"gmail_extra"><div
class=3D"gmail_quote"><blockquote =
class=3D"quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc =
solid;padding-left:1ex"><div dir=3D"ltr"
class=3D""><div class=3D""><br =
class=3D""></div><div class=3D"">Can this behavior be
disabled?<br =
class=3D""><br class=3D""></div><div
class=3D"">Thanx, <br =
class=3D""></div><div class=3D"">Alex<br
class=3D""></div></div>
<br class=3D"">______________________________<wbr =
class=3D"">_________________<br class=3D"">
Users mailing list<br class=3D"">
<a href=3D"mailto:Users@ovirt.org"
class=3D"">Users(a)ovirt.org</a><br =
class=3D"">
<a href=3D"http://lists.ovirt.org/mailman/listinfo/users" =
rel=3D"noreferrer" target=3D"_blank" =
class=3D"">http://lists.ovirt.org/<wbr =
class=3D"">mailman/listinfo/users</a><br class=3D"">
<br class=3D""></blockquote></div><br
class=3D""></div></div></div>
_______________________________________________<br class=3D"">Users =
mailing list<br class=3D""><a href=3D"mailto:Users@ovirt.org"
=
class=3D"">Users(a)ovirt.org</a><br =
class=3D"">http://lists.ovirt.org/mailman/listinfo/users<br =
class=3D""></div></blockquote></div><br
class=3D""></div></body></html>=
--Apple-Mail=_9545B43A-6071-46DF-A6C0-EC3F1563FEE9--
10:27 a.m.
Hi,
I have seen hosts rendered unresponsive when gateway is lost.
I will be able to provide more info once I prepare an environment and test
this further.
Thanx,
Alex
On Tue, Feb 6, 2018 at 10:40 AM, Yaniv Kaul <ykaul(a)redhat.com> wrote:
On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com> wrote:
Hi all,
I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
cluster is used to host several VMs.
I have observed that when gateway is lost (say the gateway device is down)
the ovirt cluster goes down.
Is the cluster down, or just the self-hosted engine?
It seems a bit extreme behavior especially when one does not care if the
hosted VMs have connectivity to Internet or not.
Are the VMs down?
The hosts?
Y.
Can this behavior be disabled?
Thanx,
Alex
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
10:32 a.m.
This is expected behaviour, even if it’s not very bright. It’s being used
as a way to detect network is operating correctly.
I got this trying to install on a network with out a gateway.
It is insane as there are so many ways it breaks. My network admin turns
off ICMP responses and death to network.
On Tue 6. Feb 2018 at 16:27, Alex K <rightkicktech(a)gmail.com> wrote:
Hi,
I have seen hosts rendered unresponsive when gateway is lost.
I will be able to provide more info once I prepare an environment and test
this further.
Thanx,
Alex
On Tue, Feb 6, 2018 at 10:40 AM, Yaniv Kaul <ykaul(a)redhat.com> wrote:
>
>
> On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com> wrote:
>
> Hi all,
>
> I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
> cluster is used to host several VMs.
> I have observed that when gateway is lost (say the gateway device is
> down) the ovirt cluster goes down.
>
>
> Is the cluster down, or just the self-hosted engine?
>
>
> It seems a bit extreme behavior especially when one does not care if the
> hosted VMs have connectivity to Internet or not.
>
>
> Are the VMs down?
> The hosts?
> Y.
>
>
> Can this behavior be disabled?
>
> Thanx,
> Alex
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
10:45 a.m.
This is expected behaviour, even if it’s not very bright. It’s being
used as
a way to detect network is operating correctly.
Correct, it is used to check whether users can reach the host and the
VM that runs on it. There aren't that many options to check that. All
require data exchange of some kind (ICMP req/res, TCP SYN/ACK, some
UDP echo..).
It is insane as there are so many ways it breaks. My network admin
turns
off ICMP responses and death to network.
ICMP is an important signaling mechanism.. seriously, it is usually a
bad idea to block it.
I got this trying to install on a network with out a gateway.
How were your users accessing the VMs? Was this some kind of super
secure deployment with no outside connectivity?
Best regards
Martin Sivak
On Tue, Feb 6, 2018 at 4:32 PM, Ben De Luca <bdeluca(a)gmail.com> wrote:
This is expected behaviour, even if it’s not very bright. It’s being
used as
a way to detect network is operating correctly.
>
I got this trying to install on a network with out a gateway.
>
It is insane as there are so many ways it breaks. My network admin
turns
off ICMP responses and death to network.
>
> On Tue 6. Feb 2018 at 16:27, Alex K <rightkicktech(a)gmail.com> wrote:
>>
>> Hi,
>>
>> I have seen hosts rendered unresponsive when gateway is lost.
>> I will be able to provide more info once I prepare an environment and test
>> this further.
>>
>> Thanx,
>> Alex
>>
>> On Tue, Feb 6, 2018 at 10:40 AM, Yaniv Kaul <ykaul(a)redhat.com> wrote:
>>>
>>>
>>>
>>> On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com>
wrote:
>>>
>>> Hi all,
>>>
>>> I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
>>> cluster is used to host several VMs.
>>> I have observed that when gateway is lost (say the gateway device is
>>> down) the ovirt cluster goes down.
>>>
>>>
>>> Is the cluster down, or just the self-hosted engine?
>>>
>>>
>>> It seems a bit extreme behavior especially when one does not care if the
>>> hosted VMs have connectivity to Internet or not.
>>>
>>>
>>> Are the VMs down?
>>> The hosts?
>>> Y.
>>>
>>>
>>> Can this behavior be disabled?
>>>
>>> Thanx,
>>> Alex
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>>
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
10:39 a.m.
Hi,
ee use the ping check to see whether the host running hosted engine
has connectivity with the rest of the cluster and users. We kill the
VM in a hope that some other host will make the engine available to
users again.
We use the gateway by default as it is pretty common to have separate
network for data center, but you can change the address if your
topology is different.
Best regards
Martin Sivak
On Tue, Feb 6, 2018 at 4:27 PM, Alex K <rightkicktech(a)gmail.com> wrote:
Hi,
I have seen hosts rendered unresponsive when gateway is lost.
I will be able to provide more info once I prepare an environment and test
this further.
Thanx,
Alex
On Tue, Feb 6, 2018 at 10:40 AM, Yaniv Kaul <ykaul(a)redhat.com> wrote:
>
>
>
> On Feb 5, 2018 2:21 PM, "Alex K" <rightkicktech(a)gmail.com> wrote:
>
> Hi all,
>
> I have a 3 nodes ovirt 4.1 cluster, self hosted on top of glusterfs. The
> cluster is used to host several VMs.
> I have observed that when gateway is lost (say the gateway device is down)
> the ovirt cluster goes down.
>
>
> Is the cluster down, or just the self-hosted engine?
>
>
> It seems a bit extreme behavior especially when one does not care if the
> hosted VMs have connectivity to Internet or not.
>
>
> Are the VMs down?
> The hosts?
> Y.
>
>
> Can this behavior be disabled?
>
> Thanx,
> Alex
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
2517
days inactive
2518
days old
8 comments
6 participants
participants (6)
-
Alex K -
Ben De Luca -
Darrell Budic -
Edward Haas -
Martin Sivak -
Yaniv Kaul