From jon at rosslug.org.uk Tue Dec 29 13:48:07 2015 Content-Type: multipart/mixed; boundary="===============6000154540406137036==" MIME-Version: 1.0 From: Jon Archer To: users at ovirt.org Subject: Re: [ovirt-users] Network instability after upgrade 3.6.0 -> 3.6.1 Date: Tue, 29 Dec 2015 18:26:39 +0000 Message-ID: <51B8993C-55C1-4776-873A-EC9AC70CF148@rosslug.org.uk> In-Reply-To: 5672F636.7000408@hawai.it --===============6000154540406137036== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------7Z885JONKSCPB0YGXE6YXOAPP71NJL Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=3DUTF-8 Stefano, I am currently experiencing the same issue. 2x nic lacp config at switch, m= ode 4 bond at server with no connectivity. Interestingly I am able to ping = the switch itself. I haven't had time to investigate thoroughly but my first thought is an upd= ate somewhere. Did you ever resolve and get back to mode=3D4? Jon On 17 December 2015 17:51:50 GMT+00:00, Stefano Danzi = wrote: >I partially solve the problem. > >My host machine has 2 network interfaces with a bond. The bond was = >configured with mode=3D4 (802.3ad) and switch was configured in the same >way. >If I remove one network cable the network become stable. With both = >cables attached the network is instable. > >I removed the link aggregation configuration from switch and change the > >bond in mode=3D2 (balance-xor). Now the network are stable. >The strange thing is that previous configuration worked fine for one = >year... since the last upgrade. > >Now ha-agent don't reboot the hosted-engine anymore, but I receive two = >emails from brocker evere 2/5 minutes. >First a mail with "ovirt-hosted-engine state transition = >StartState-ReinitializeFSM" and after "ovirt-hosted-engine state = >transition ReinitializeFSM-EngineStarting" > > >Il 17/12/2015 10.51, Stefano Danzi ha scritto: >> Hello, >> I have one testing host (only one host) with self hosted engine and 2 > >> VM (one linux and one windows). >> >> After upgrade ovirt from 3.6.0 to 3.6.1 the network connection works = >> discontinuously. >> Every 10 minutes HA agent restart hosted engine VM because result = >> down. But the machine is UP, >> only the network stop to work for some minutes. >> I activate global maintenace mode to prevent engine reboot. If I ssh = >> to the hosted engine sometimes >> the connection work and sometimes no. Using VNC connection to engine > >> I see that sometime VM reach external network >> and sometimes no. >> If I do a tcpdump on phisical ethernet interface I don't see any = >> packet when network on vm don't work. >> >> Same thing happens fo others two VM. >> >> Before the upgrade I never had network problems. >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > >_______________________________________________ >Users mailing list >Users(a)ovirt.org >http://lists.ovirt.org/mailman/listinfo/users -- = Sent from my Android device with K-9 Mail. Please excuse my brevity. ------7Z885JONKSCPB0YGXE6YXOAPP71NJL Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit Stefano,

I am currently experiencing the same issue. 2x nic lacp config at switch, m= ode 4 bond at server with no connectivity. Interestingly I am able to ping = the switch itself.

I haven't had time to investigate thoroughly but my first thought is an= update somewhere.

Did you ever resolve and get back to mode=3D4?

Jon

On 17 December 2015 17:51:50 GMT+00:0= 0, Stefano Danzi <s.danzi(a)hawai.it> wrote:
I partially solve the problem.

My host mac= hine has 2 network interfaces with a bond. The bond was
configured wi= th mode=3D4 (802.3ad) and switch was configured in the same way.
If I= remove one network cable the network become stable. With both
cables= attached the network is instable.

I removed the link aggregatio= n configuration from switch and change the
bond in mode=3D2 (balance-= xor). Now the network are stable.
The strange thing is that previous c= onfiguration worked fine for one
year... since the last upgrade.

Now ha-agent don't reboot the hosted-engine anymore, but I receive t= wo
emails from brocker evere 2/5 minutes.
First a mail with "ovi= rt-hosted-engine state transition
StartState-ReinitializeFSM" and aft= er "ovirt-hosted-engine state
transition ReinitializeFSM-EngineStarti= ng"


Il 17/12/2015 10.51, Stefano Danzi ha scritto:
Hello,
I have one testing host (o= nly one host) with self hosted engine and 2
VM (one linux and one wi= ndows).

After upgrade ovirt from 3.6.0 to 3.6.1 the network con= nection works
discontinuously.
Every 10 minutes HA agent resta= rt hosted engine VM because result
down. But the machine is UP,
only the network stop to work for some minutes.
I activate global m= aintenace mode to prevent engine reboot. If I ssh
to the hosted engi= ne sometimes
the connection work and sometimes no. Using VNC connect= ion to engine
I see that sometime VM reach external network
an= d sometimes no.
If I do a tcpdump on phisical ethernet interface I do= n't see any
packet when network on vm don't work.

Same t= hing happens fo others two VM.

Before the upgrade I never had n= etwork problems.


Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/lis= tinfo/users




Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.= ------7Z885JONKSCPB0YGXE6YXOAPP71NJL-- --===============6000154540406137036== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tN1o4ODVKT05LU0NQQjBZR1hFNllYT0FQUDcxTkpMCkNvbnRlbnQtVHJhbnNmZXItRW5j b2Rpbmc6IDhiaXQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOwogY2hhcnNldD1VVEYtOAoKU3Rl ZmFubywKCkkgYW0gY3VycmVudGx5IGV4cGVyaWVuY2luZyB0aGUgc2FtZSBpc3N1ZS4gMnggbmlj IGxhY3AgY29uZmlnIGF0IHN3aXRjaCwgbW9kZSA0IGJvbmQgYXQgc2VydmVyIHdpdGggbm8gY29u bmVjdGl2aXR5LiBJbnRlcmVzdGluZ2x5IEkgYW0gYWJsZSB0byBwaW5nIHRoZSBzd2l0Y2ggaXRz ZWxmLgoKSSBoYXZlbid0IGhhZCB0aW1lIHRvIGludmVzdGlnYXRlIHRob3JvdWdobHkgYnV0IG15 IGZpcnN0IHRob3VnaHQgaXMgYW4gdXBkYXRlIHNvbWV3aGVyZS4KCkRpZCB5b3UgZXZlciByZXNv bHZlIGFuZCBnZXQgYmFjayB0byBtb2RlPTQ/CgpKb24KCk9uIDE3IERlY2VtYmVyIDIwMTUgMTc6 NTE6NTAgR01UKzAwOjAwLCBTdGVmYW5vIERhbnppIDxzLmRhbnppQGhhd2FpLml0PiB3cm90ZToK PkkgcGFydGlhbGx5IHNvbHZlIHRoZSBwcm9ibGVtLgo+Cj5NeSBob3N0IG1hY2hpbmUgaGFzIDIg bmV0d29yayBpbnRlcmZhY2VzIHdpdGggYSBib25kLiBUaGUgYm9uZCB3YXMgCj5jb25maWd1cmVk IHdpdGggIG1vZGU9NCAoODAyLjNhZCkgYW5kIHN3aXRjaCB3YXMgY29uZmlndXJlZCBpbiB0aGUg c2FtZQo+d2F5Lgo+SWYgSSByZW1vdmUgb25lIG5ldHdvcmsgY2FibGUgdGhlIG5ldHdvcmsgYmVj b21lIHN0YWJsZS4gV2l0aCBib3RoIAo+Y2FibGVzIGF0dGFjaGVkIHRoZSBuZXR3b3JrIGlzIGlu c3RhYmxlLgo+Cj5JIHJlbW92ZWQgdGhlIGxpbmsgYWdncmVnYXRpb24gY29uZmlndXJhdGlvbiBm cm9tIHN3aXRjaCBhbmQgY2hhbmdlIHRoZQo+Cj5ib25kIGluIG1vZGU9MiAoYmFsYW5jZS14b3Ip LiBOb3cgdGhlIG5ldHdvcmsgYXJlIHN0YWJsZS4KPlRoZSBzdHJhbmdlIHRoaW5nIGlzIHRoYXQg cHJldmlvdXMgY29uZmlndXJhdGlvbiB3b3JrZWQgZmluZSBmb3Igb25lIAo+eWVhci4uLiBzaW5j ZSB0aGUgbGFzdCB1cGdyYWRlLgo+Cj5Ob3cgaGEtYWdlbnQgZG9uJ3QgcmVib290IHRoZSBob3N0 ZWQtZW5naW5lIGFueW1vcmUsIGJ1dCBJIHJlY2VpdmUgdHdvIAo+ZW1haWxzIGZyb20gYnJvY2tl ciBldmVyZSAyLzUgbWludXRlcy4KPkZpcnN0IGEgbWFpbCB3aXRoICJvdmlydC1ob3N0ZWQtZW5n aW5lIHN0YXRlIHRyYW5zaXRpb24gCj5TdGFydFN0YXRlLVJlaW5pdGlhbGl6ZUZTTSIgYW5kIGFm dGVyICJvdmlydC1ob3N0ZWQtZW5naW5lIHN0YXRlIAo+dHJhbnNpdGlvbiBSZWluaXRpYWxpemVG U00tRW5naW5lU3RhcnRpbmciCj4KPgo+SWwgMTcvMTIvMjAxNSAxMC41MSwgU3RlZmFubyBEYW56 aSBoYSBzY3JpdHRvOgo+PiBIZWxsbywKPj4gSSBoYXZlIG9uZSB0ZXN0aW5nIGhvc3QgKG9ubHkg b25lIGhvc3QpIHdpdGggc2VsZiBob3N0ZWQgZW5naW5lIGFuZCAyCj4KPj4gVk0gKG9uZSBsaW51 eCBhbmQgb25lIHdpbmRvd3MpLgo+Pgo+PiBBZnRlciB1cGdyYWRlIG92aXJ0IGZyb20gMy42LjAg dG8gMy42LjEgdGhlIG5ldHdvcmsgY29ubmVjdGlvbiB3b3JrcyAKPj4gZGlzY29udGludW91c2x5 Lgo+PiBFdmVyeSAxMCBtaW51dGVzIEhBIGFnZW50IHJlc3RhcnQgaG9zdGVkIGVuZ2luZSBWTSBi ZWNhdXNlIHJlc3VsdCAKPj4gZG93bi4gQnV0IHRoZSBtYWNoaW5lIGlzIFVQLAo+PiBvbmx5IHRo ZSBuZXR3b3JrIHN0b3AgdG8gd29yayBmb3Igc29tZSBtaW51dGVzLgo+PiBJIGFjdGl2YXRlIGds b2JhbCBtYWludGVuYWNlIG1vZGUgdG8gcHJldmVudCBlbmdpbmUgcmVib290LiBJZiBJIHNzaCAK Pj4gdG8gdGhlIGhvc3RlZCBlbmdpbmUgc29tZXRpbWVzCj4+IHRoZSBjb25uZWN0aW9uIHdvcmsg YW5kIHNvbWV0aW1lcyBuby4gIFVzaW5nIFZOQyBjb25uZWN0aW9uIHRvIGVuZ2luZQo+Cj4+IEkg c2VlIHRoYXQgc29tZXRpbWUgVk0gcmVhY2ggZXh0ZXJuYWwgbmV0d29yawo+PiBhbmQgc29tZXRp bWVzIG5vLgo+PiBJZiBJIGRvIGEgdGNwZHVtcCBvbiBwaGlzaWNhbCBldGhlcm5ldCBpbnRlcmZh Y2UgSSBkb24ndCBzZWUgYW55IAo+PiBwYWNrZXQgd2hlbiBuZXR3b3JrIG9uIHZtIGRvbid0IHdv cmsuCj4+Cj4+IFNhbWUgdGhpbmcgaGFwcGVucyBmbyBvdGhlcnMgdHdvIFZNLgo+Pgo+PiBCZWZv cmUgdGhlIHVwZ3JhZGUgSSBuZXZlciBoYWQgbmV0d29yayBwcm9ibGVtcy4KPj4gX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPj4gVXNlcnMgbWFpbGluZyBs aXN0Cj4+IFVzZXJzQG92aXJ0Lm9yZwo+PiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4v bGlzdGluZm8vdXNlcnMKPj4KPgo+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX18KPlVzZXJzIG1haWxpbmcgbGlzdAo+VXNlcnNAb3ZpcnQub3JnCj5odHRwOi8v bGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKCi0tIApTZW50IGZyb20gbXkg QW5kcm9pZCBkZXZpY2Ugd2l0aCBLLTkgTWFpbC4gUGxlYXNlIGV4Y3VzZSBteSBicmV2aXR5Lgot LS0tLS03Wjg4NUpPTktTQ1BCMFlHWEU2WVhPQVBQNzFOSkwKQ29udGVudC1UeXBlOiB0ZXh0L2h0 bWw7CiBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQKCjxodG1s PjxoZWFkPjwvaGVhZD48Ym9keT5TdGVmYW5vLDxicj4KPGJyPgpJIGFtIGN1cnJlbnRseSBleHBl cmllbmNpbmcgdGhlIHNhbWUgaXNzdWUuIDJ4IG5pYyBsYWNwIGNvbmZpZyBhdCBzd2l0Y2gsIG1v ZGUgNCBib25kIGF0IHNlcnZlciB3aXRoIG5vIGNvbm5lY3Rpdml0eS4gSW50ZXJlc3RpbmdseSBJ IGFtIGFibGUgdG8gcGluZyB0aGUgc3dpdGNoIGl0c2VsZi48YnI+Cjxicj4KSSBoYXZlbiYjMzk7 dCBoYWQgdGltZSB0byBpbnZlc3RpZ2F0ZSB0aG9yb3VnaGx5IGJ1dCBteSBmaXJzdCB0aG91Z2h0 IGlzIGFuIHVwZGF0ZSBzb21ld2hlcmUuPGJyPgo8YnI+CkRpZCB5b3UgZXZlciByZXNvbHZlIGFu ZCBnZXQgYmFjayB0byBtb2RlPTQ/PGJyPgo8YnI+Ckpvbjxicj48YnI+PGRpdiBjbGFzcz0iZ21h aWxfcXVvdGUiPk9uIDE3IERlY2VtYmVyIDIwMTUgMTc6NTE6NTAgR01UKzAwOjAwLCBTdGVmYW5v IERhbnppICZsdDtzLmRhbnppQGhhd2FpLml0Jmd0OyB3cm90ZTo8YmxvY2txdW90ZSBjbGFzcz0i Z21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46IDBwdCAwcHQgMHB0IDAuOGV4OyBib3JkZXItbGVm dDogMXB4IHNvbGlkIHJnYigyMDQsIDIwNCwgMjA0KTsgcGFkZGluZy1sZWZ0OiAxZXg7Ij4KPHBy ZSBjbGFzcz0iazltYWlsIj5JIHBhcnRpYWxseSBzb2x2ZSB0aGUgcHJvYmxlbS48YnIgLz48YnIg Lz5NeSBob3N0IG1hY2hpbmUgaGFzIDIgbmV0d29yayBpbnRlcmZhY2VzIHdpdGggYSBib25kLiBU aGUgYm9uZCB3YXMgPGJyIC8+Y29uZmlndXJlZCB3aXRoICBtb2RlPTQgKDgwMi4zYWQpIGFuZCBz d2l0Y2ggd2FzIGNvbmZpZ3VyZWQgaW4gdGhlIHNhbWUgd2F5LjxiciAvPklmIEkgcmVtb3ZlIG9u ZSBuZXR3b3JrIGNhYmxlIHRoZSBuZXR3b3JrIGJlY29tZSBzdGFibGUuIFdpdGggYm90aCA8YnIg Lz5jYWJsZXMgYXR0YWNoZWQgdGhlIG5ldHdvcmsgaXMgaW5zdGFibGUuPGJyIC8+PGJyIC8+SSBy ZW1vdmVkIHRoZSBsaW5rIGFnZ3JlZ2F0aW9uIGNvbmZpZ3VyYXRpb24gZnJvbSBzd2l0Y2ggYW5k IGNoYW5nZSB0aGUgPGJyIC8+Ym9uZCBpbiBtb2RlPTIgKGJhbGFuY2UteG9yKS4gTm93IHRoZSBu ZXR3b3JrIGFyZSBzdGFibGUuPGJyIC8+VGhlIHN0cmFuZ2UgdGhpbmcgaXMgdGhhdCBwcmV2aW91 cyBjb25maWd1cmF0aW9uIHdvcmtlZCBmaW5lIGZvciBvbmUgPGJyIC8+eWVhci4uLiBzaW5jZSB0 aGUgbGFzdCB1cGdyYWRlLjxiciAvPjxiciAvPk5vdyBoYS1hZ2VudCBkb24ndCByZWJvb3QgdGhl IGhvc3RlZC1lbmdpbmUgYW55bW9yZSwgYnV0IEkgcmVjZWl2ZSB0d28gPGJyIC8+ZW1haWxzIGZy b20gYnJvY2tlciBldmVyZSAyLzUgbWludXRlcy48YnIgLz5GaXJzdCBhIG1haWwgd2l0aCAib3Zp cnQtaG9zdGVkLWVuZ2luZSBzdGF0ZSB0cmFuc2l0aW9uIDxiciAvPlN0YXJ0U3RhdGUtUmVpbml0 aWFsaXplRlNNIiBhbmQgYWZ0ZXIgIm92aXJ0LWhvc3RlZC1lbmdpbmUgc3RhdGUgPGJyIC8+dHJh bnNpdGlvbiBSZWluaXRpYWxpemVGU00tRW5naW5lU3RhcnRpbmciPGJyIC8+PGJyIC8+PGJyIC8+ SWwgMTcvMTIvMjAxNSAxMC41MSwgU3RlZmFubyBEYW56aSBoYSBzY3JpdHRvOjxiciAvPjxibG9j a3F1b3RlCmNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjogMHB0IDBwdCAxZXggMC44 ZXg7IGJvcmRlci1sZWZ0OiAxcHggc29saWQgIzcyOWZjZjsgcGFkZGluZy1sZWZ0OiAxZXg7Ij4g SGVsbG8sPGJyIC8+IEkgaGF2ZSBvbmUgdGVzdGluZyBob3N0IChvbmx5IG9uZSBob3N0KSB3aXRo IHNlbGYgaG9zdGVkIGVuZ2luZSBhbmQgMiA8YnIgLz4gVk0gKG9uZSBsaW51eCBhbmQgb25lIHdp bmRvd3MpLjxiciAvPjxiciAvPiBBZnRlciB1cGdyYWRlIG92aXJ0IGZyb20gMy42LjAgdG8gMy42 LjEgdGhlIG5ldHdvcmsgY29ubmVjdGlvbiB3b3JrcyA8YnIgLz4gZGlzY29udGludW91c2x5Ljxi ciAvPiBFdmVyeSAxMCBtaW51dGVzIEhBIGFnZW50IHJlc3RhcnQgaG9zdGVkIGVuZ2luZSBWTSBi ZWNhdXNlIHJlc3VsdCA8YnIgLz4gZG93bi4gQnV0IHRoZSBtYWNoaW5lIGlzIFVQLDxiciAvPiBv bmx5IHRoZSBuZXR3b3JrIHN0b3AgdG8gd29yayBmb3Igc29tZSBtaW51dGVzLjxiciAvPiBJIGFj dGl2YXRlIGdsb2JhbCBtYWludGVuYWNlIG1vZGUgdG8gcHJldmVudCBlbmdpbmUgcmVib290LiBJ ZiBJIHNzaCA8YnIgLz4gdG8gdGhlIGhvc3RlZCBlbmdpbmUgc29tZXRpbWVzPGJyIC8+IHRoZSBj b25uZWN0aW9uIHdvcmsgYW5kIHNvbWV0aW1lcyBuby4gIFVzaW5nIFZOQyBjb25uZWN0aW9uIHRv IGVuZ2luZSA8YnIgLz4gSSBzZWUgdGhhdCBzb21ldGltZSBWTSByZWFjaCBleHRlcm5hbCBuZXR3 b3JrPGJyIC8+IGFuZCBzb21ldGltZXMgbm8uPGJyIC8+IElmIEkgZG8gYSB0Y3BkdW1wIG9uIHBo aXNpY2FsIGV0aGVybmV0IGludGVyZmFjZSBJIGRvbid0IHNlZSBhbnkgPGJyIC8+IHBhY2tldCB3 aGVuIG5ldHdvcmsgb24gdm0gZG9uJ3Qgd29yay48YnIgLz48YnIgLz4gU2FtZSB0aGluZyBoYXBw ZW5zIGZvIG90aGVycyB0d28gVk0uPGJyIC8+PGJyIC8+IEJlZm9yZSB0aGUgdXBncmFkZSBJIG5l dmVyIGhhZCBuZXR3b3JrIHByb2JsZW1zLjxicgogIC8+PGhyCi8+PGJyIC8+IFVzZXJzIG1haWxp bmcgbGlzdDxiciAvPiBVc2Vyc0BvdmlydC5vcmc8YnIgLz4gPGEgaHJlZj0iaHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3Jn L21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PC9ibG9ja3F1b3RlPjxiciAvPjxiciAvPjxociAv PjxiciAvPlVzZXJzIG1haWxpbmcgbGlzdDxiciAvPlVzZXJzQG92aXJ0Lm9yZzxiciAvPjxhIGhy ZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0cDov L2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxiciAvPjwvcHJlPjwv YmxvY2txdW90ZT48L2Rpdj48YnI+Ci0tIDxicj4KU2VudCBmcm9tIG15IEFuZHJvaWQgZGV2aWNl IHdpdGggSy05IE1haWwuIFBsZWFzZSBleGN1c2UgbXkgYnJldml0eS48L2JvZHk+PC9odG1sPgot LS0tLS03Wjg4NUpPTktTQ1BCMFlHWEU2WVhPQVBQNzFOSkwtLQoK --===============6000154540406137036==--