From Bryan.Sockel at altn.com Fri Apr 21 00:58:12 2017 Content-Type: multipart/mixed; boundary="===============7739342046375388316==" MIME-Version: 1.0 From: Bryan Sockel To: users at ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue Date: Thu, 20 Apr 2017 19:58:07 -0500 Message-ID: --===============7739342046375388316== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. ----_com.samsung.android.email_7576755804572660 Content-Type: text/plain; charset=3D"utf-8" Content-Transfer-Encoding: 7bit We checked the port groups, and servers are cabled correctly. After server is rebooted, em1 is the only interface passing traffic. Other 3 nics sitting idle. We can down each port on the switch and confirm it is down on the server. I am pretty sure it is related to the bridge that was created to pass vm-host-altn traffic when the appliance was first installed. -------- Original message -------- From: Chris Adams = Date: 4/20/17 5:40 PM (GMT-06:00) = To: users(a)ovirt.org = Subject: Re: [ovirt-users] LACP Bonding issue = _____ = >From : Chris Adams [cma(a)cmadams.net] To : users(a)ovirt.org [users(a)ovirt.org] Date : Thursday, April 20 2017 17:40:25 Once upon a time, Bryan Sockel said: > It seems that is some disconnect between my network bridge, the bond and my = > interfaces. I would like to some how get my bond to use all 4 interfaces. = > On reboot, it always seems to reset consistently to EM1. Are you sure the switch side is all the same LACP group? Sounds like one port may accidentally be in a separate group, and that happens to be em1. You might try swapping wires between em1 and another port and reboot and see which ports come up - if all but the port with the wire formerly in em1 come up, it points to the switch config. -- = Chris Adams = _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users ----_com.samsung.android.email_7576755804572660 Content-Type: text/html; charset=3D"utf-8" Content-Transfer-Encoding: quoted-printable
We checked the port groups, and =3D servers are cabled correctly.

After server is =3D rebooted, em1 is the only interface passing traffic. Other 3 nics =3D sitting idle.  We can down each port on the switch and confirm it =3D is down on the server.


I am =3D pretty sure it is related to the bridge that was created to pass =3D vm-host-altn traffic when the appliance was first installed.



-------- Original message =3D --------
From: Chris Adams <cma(a)cmadams.net> =3D
Date: 4/20/17 5:40 PM (GMT-06:00)
To: =3D users(a)ovirt.org
Subject: Re: [ovirt-users] LACP Bonding issue = =3D

From : Chris Adams =3D [cma(a)cmadams.net]
To = : =3D users(a)ovirt.org [users(a)ovirt.org]
Date : Thursday, April 20 2017 17:40:25
=3D0A=3D 
Once upon a time, Bryan Sockel  said:
> It seems that is some disconnect between my network bridge, the bond =3D
and my=3D20
> interfaces.  I would like to some how get my bond to use all 4 =3D
interfaces. =3D20
> On reboot, it always seems to reset consistently to EM1.

Are you sure the switch side is all the same LACP group?  Sounds like
one port may accidentally be in a separate group, and that happens to be
em1.

You might try swapping wires between em1 and another port and reboot and
see which ports come up - if all but the port with the wire formerly in
em1 come up, it points to the switch config.

--=3D20
Chris Adams 
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
----_com.samsung.android.email_7576755804572660-- --===============7739342046375388316== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KCi0tLS1fY29tLnNh bXN1bmcuYW5kcm9pZC5lbWFpbF83NTc2NzU1ODA0NTcyNjYwCkNvbnRlbnQtVHlwZTogdGV4dC9w bGFpbjsKCWNoYXJzZXQ9InV0Zi04IgpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0CgpX ZSBjaGVja2VkIHRoZSBwb3J0IGdyb3VwcywgYW5kIHNlcnZlcnMgYXJlIGNhYmxlZCBjb3JyZWN0 bHkuCgpBZnRlciBzZXJ2ZXIgaXMgcmVib290ZWQsIGVtMSBpcyB0aGUgb25seSBpbnRlcmZhY2Ug cGFzc2luZyB0cmFmZmljLgpPdGhlciAzIG5pY3Mgc2l0dGluZyBpZGxlLiAgV2UgY2FuIGRvd24g ZWFjaCBwb3J0IG9uIHRoZSBzd2l0Y2ggYW5kCmNvbmZpcm0gaXQgaXMgZG93biBvbiB0aGUgc2Vy dmVyLgoKCkkgYW0gcHJldHR5IHN1cmUgaXQgaXMgcmVsYXRlZCB0byB0aGUgYnJpZGdlIHRoYXQg d2FzIGNyZWF0ZWQgdG8gcGFzcwp2bS1ob3N0LWFsdG4gdHJhZmZpYyB3aGVuIHRoZSBhcHBsaWFu Y2Ugd2FzIGZpcnN0IGluc3RhbGxlZC4KCgoKLS0tLS0tLS0gT3JpZ2luYWwgbWVzc2FnZSAtLS0t LS0tLQpGcm9tOiBDaHJpcyBBZGFtcyA8Y21hQGNtYWRhbXMubmV0PiAKRGF0ZTogNC8yMC8xNyA1 OjQwIFBNIChHTVQtMDY6MDApIApUbzogdXNlcnNAb3ZpcnQub3JnIApTdWJqZWN0OiBSZTogW292 aXJ0LXVzZXJzXSBMQUNQIEJvbmRpbmcgaXNzdWUgCgogIF9fX19fICAKCj5Gcm9tIDogQ2hyaXMg QWRhbXMgW2NtYUBjbWFkYW1zLm5ldF0KVG8gOiB1c2Vyc0BvdmlydC5vcmcgW3VzZXJzQG92aXJ0 Lm9yZ10KRGF0ZSA6IFRodXJzZGF5LCBBcHJpbCAyMCAyMDE3IDE3OjQwOjI1Ck9uY2UgdXBvbiBh IHRpbWUsIEJyeWFuIFNvY2tlbCAgc2FpZDoKPiBJdCBzZWVtcyB0aGF0IGlzIHNvbWUgZGlzY29u bmVjdCBiZXR3ZWVuIG15IG5ldHdvcmsgYnJpZGdlLCB0aGUgYm9uZAphbmQgbXkgCj4gaW50ZXJm YWNlcy4gIEkgd291bGQgbGlrZSB0byBzb21lIGhvdyBnZXQgbXkgYm9uZCB0byB1c2UgYWxsIDQK aW50ZXJmYWNlcy4gIAo+IE9uIHJlYm9vdCwgaXQgYWx3YXlzIHNlZW1zIHRvIHJlc2V0IGNvbnNp c3RlbnRseSB0byBFTTEuCgpBcmUgeW91IHN1cmUgdGhlIHN3aXRjaCBzaWRlIGlzIGFsbCB0aGUg c2FtZSBMQUNQIGdyb3VwPyAgU291bmRzIGxpa2UKb25lIHBvcnQgbWF5IGFjY2lkZW50YWxseSBi ZSBpbiBhIHNlcGFyYXRlIGdyb3VwLCBhbmQgdGhhdCBoYXBwZW5zIHRvIGJlCmVtMS4KCllvdSBt aWdodCB0cnkgc3dhcHBpbmcgd2lyZXMgYmV0d2VlbiBlbTEgYW5kIGFub3RoZXIgcG9ydCBhbmQg cmVib290IGFuZApzZWUgd2hpY2ggcG9ydHMgY29tZSB1cCAtIGlmIGFsbCBidXQgdGhlIHBvcnQg d2l0aCB0aGUgd2lyZSBmb3JtZXJseSBpbgplbTEgY29tZSB1cCwgaXQgcG9pbnRzIHRvIHRoZSBz d2l0Y2ggY29uZmlnLgoKLS0gCkNocmlzIEFkYW1zIApfX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKVXNlcnNAb3ZpcnQub3Jn Cmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycwoKLS0tLV9jb20u c2Ftc3VuZy5hbmRyb2lkLmVtYWlsXzc1NzY3NTU4MDQ1NzI2NjAKQ29udGVudC1UeXBlOiB0ZXh0 L2h0bWw7CgljaGFyc2V0PSJ1dGYtOCIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVvdGVk LXByaW50YWJsZQoKPGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0zRCJDb250ZW50LVR5cGUi IGNvbnRlbnQ9M0QidGV4dC9odG1sOyA9CmNoYXJzZXQ9M0RVVEYtOCI+PC9oZWFkPjxib2R5Pjxk aXY+V2UgY2hlY2tlZCB0aGUgcG9ydCBncm91cHMsIGFuZCA9CnNlcnZlcnMgYXJlIGNhYmxlZCBj b3JyZWN0bHkuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5BZnRlciBzZXJ2ZXIgaXMgPQpyZWJv b3RlZCwgZW0xIGlzIHRoZSBvbmx5IGludGVyZmFjZSBwYXNzaW5nIHRyYWZmaWMuIE90aGVyIDMg bmljcyA9CnNpdHRpbmcgaWRsZS4gJm5ic3A7V2UgY2FuIGRvd24gZWFjaCBwb3J0IG9uIHRoZSBz d2l0Y2ggYW5kIGNvbmZpcm0gaXQgPQppcyBkb3duIG9uIHRoZSBzZXJ2ZXIuPC9kaXY+PGRpdj48 YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5JIGFtID0KcHJldHR5IHN1cmUgaXQgaXMgcmVs YXRlZCB0byB0aGUgYnJpZGdlIHRoYXQgd2FzIGNyZWF0ZWQgdG8gcGFzcyA9CnZtLWhvc3QtYWx0 biB0cmFmZmljIHdoZW4gdGhlIGFwcGxpYW5jZSB3YXMgZmlyc3QgaW5zdGFsbGVkLjwvZGl2Pjxk aXYgPQppZD0zRCJjb21wb3Nlcl9zaWduYXR1cmUiPjxkaXYgc3R5bGU9M0QiZm9udC1zaXplOjg1 JTtjb2xvcjojNTc1NzU3IiA9CmRpcj0zRCJhdXRvIj48YnI+PC9kaXY+PC9kaXY+PGRpdj48YnI+ PC9kaXY+PGRpdj48YnI+PC9kaXY+PCEtLSA9Cm9yaWdpbmFsTWVzc2FnZSAtLT48ZGl2Pi0tLS0t LS0tIE9yaWdpbmFsIG1lc3NhZ2UgPQotLS0tLS0tLTwvZGl2PjxkaXY+RnJvbTogQ2hyaXMgQWRh bXMgJmx0O2NtYUBjbWFkYW1zLm5ldCZndDsgPQo8L2Rpdj48ZGl2PkRhdGU6IDQvMjAvMTcgIDU6 NDAgUE0gIChHTVQtMDY6MDApIDwvZGl2PjxkaXY+VG86ID0KdXNlcnNAb3ZpcnQub3JnIDwvZGl2 PjxkaXY+U3ViamVjdDogUmU6IFtvdmlydC11c2Vyc10gTEFDUCBCb25kaW5nIGlzc3VlID0KPC9k aXY+PGRpdj48YnI+PC9kaXY+PGRpdiA9CnN0eWxlPTNEIm1hcmdpbi1sZWZ0OjJweDtwYWRkaW5n LWxlZnQ6MnB4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCA9CiMyMDIwMjA7Ij48ZGl2IHN0eWxlPTNE ImZvbnQtc2l6ZTogMTBwdDsgYmFja2dyb3VuZC1jb2xvcjogI2ZmZmZmZjsgPQpjb2xvcjogIzAw MDAwMDsgZm9udC13ZWlnaHQ6IDQwMDsgZm9udC1mYW1pbHk6ID0KVGFob21hLEFyaWFsLFZlcmRh bmEsc2Fucy1zZXJpZjsiID48aHIgLz48ZGl2PjxzcGFuID0Kc3R5bGU9M0QiZm9udC13ZWlnaHQ6 IDcwMCI+RnJvbTwvc3Bhbj4gOiBDaHJpcyBBZGFtcyA9CltjbWFAY21hZGFtcy5uZXRdPC9kaXY+ PGRpdj48c3BhbiBzdHlsZT0zRCJmb250LXdlaWdodDogNzAwIj5Ubzwvc3Bhbj4gOiA9CnVzZXJz QG92aXJ0Lm9yZyBbdXNlcnNAb3ZpcnQub3JnXTwvZGl2PjxkaXY+PHNwYW4gc3R5bGU9M0QiZm9u dC13ZWlnaHQ6ID0KNzAwIj5EYXRlPC9zcGFuPiA6IFRodXJzZGF5LCBBcHJpbCAyMCAyMDE3IDE3 OjQwOjI1PC9kaXY+PC9kaXY+PTBBPQo8cHJlPk9uY2UgdXBvbiBhIHRpbWUsIEJyeWFuIFNvY2tl bCA8QnJ5YW4uU29ja2VsQGFsdG4uY29tPiBzYWlkOgo+IEl0IHNlZW1zIHRoYXQgaXMgc29tZSBk aXNjb25uZWN0IGJldHdlZW4gbXkgbmV0d29yayBicmlkZ2UsIHRoZSBib25kID0KYW5kIG15PTIw Cj4gaW50ZXJmYWNlcy4gIEkgd291bGQgbGlrZSB0byBzb21lIGhvdyBnZXQgbXkgYm9uZCB0byB1 c2UgYWxsIDQgPQppbnRlcmZhY2VzLiA9MjAKPiBPbiByZWJvb3QsIGl0IGFsd2F5cyBzZWVtcyB0 byByZXNldCBjb25zaXN0ZW50bHkgdG8gRU0xLgoKQXJlIHlvdSBzdXJlIHRoZSBzd2l0Y2ggc2lk ZSBpcyBhbGwgdGhlIHNhbWUgTEFDUCBncm91cD8gIFNvdW5kcyBsaWtlCm9uZSBwb3J0IG1heSBh Y2NpZGVudGFsbHkgYmUgaW4gYSBzZXBhcmF0ZSBncm91cCwgYW5kIHRoYXQgaGFwcGVucyB0byBi ZQplbTEuCgpZb3UgbWlnaHQgdHJ5IHN3YXBwaW5nIHdpcmVzIGJldHdlZW4gZW0xIGFuZCBhbm90 aGVyIHBvcnQgYW5kIHJlYm9vdCBhbmQKc2VlIHdoaWNoIHBvcnRzIGNvbWUgdXAgLSBpZiBhbGwg YnV0IHRoZSBwb3J0IHdpdGggdGhlIHdpcmUgZm9ybWVybHkgaW4KZW0xIGNvbWUgdXAsIGl0IHBv aW50cyB0byB0aGUgc3dpdGNoIGNvbmZpZy4KCi0tPTIwCkNocmlzIEFkYW1zIDxjbWFAY21hZGFt cy5uZXQ+Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVz ZXJzIG1haWxpbmcgbGlzdApVc2Vyc0BvdmlydC5vcmcKaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9t YWlsbWFuL2xpc3RpbmZvL3VzZXJzCjwvcHJlPjwvZGl2PjwvYm9keT48L2h0bWw+CgotLS0tX2Nv bS5zYW1zdW5nLmFuZHJvaWQuZW1haWxfNzU3Njc1NTgwNDU3MjY2MC0tCgo= --===============7739342046375388316==-- From cma at cmadams.net Fri Apr 21 01:02:14 2017 Content-Type: multipart/mixed; boundary="===============7494077641258028608==" MIME-Version: 1.0 From: Chris Adams To: users at ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue Date: Thu, 20 Apr 2017 20:02:12 -0500 Message-ID: <20170421010212.GB29860@cmadams.net> In-Reply-To: m7a1baxmt52dkrr7jyxmlabg.1492736287411@email.android.com --===============7494077641258028608== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Once upon a time, Bryan Sockel said: > We checked the port groups, and servers are cabled correctly. > = > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > = > = > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. > = > = > = > -------- Original message -------- > From: Chris Adams = > Date: 4/20/17 5:40 PM (GMT-06:00) = > To: users(a)ovirt.org = > Subject: Re: [ovirt-users] LACP Bonding issue = > = > _____ = > = > >From : Chris Adams [cma(a)cmadams.net] > To : users(a)ovirt.org [users(a)ovirt.org] > Date : Thursday, April 20 2017 17:40:25 > Once upon a time, Bryan Sockel said: > > It seems that is some disconnect between my network bridge, the bond > and my = > > interfaces. I would like to some how get my bond to use all 4 > interfaces. = > > On reboot, it always seems to reset consistently to EM1. > = > Are you sure the switch side is all the same LACP group? Sounds like > one port may accidentally be in a separate group, and that happens to be > em1. > = > You might try swapping wires between em1 and another port and reboot and > see which ports come up - if all but the port with the wire formerly in > em1 come up, it points to the switch config. > = > -- = > Chris Adams = > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users -- = Chris Adams --===============7494077641258028608==-- From cma at cmadams.net Fri Apr 21 01:14:27 2017 Content-Type: multipart/mixed; boundary="===============6948714681374485926==" MIME-Version: 1.0 From: Chris Adams To: users at ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue Date: Thu, 20 Apr 2017 20:14:25 -0500 Message-ID: <20170421011425.GC29860@cmadams.net> In-Reply-To: m7a1baxmt52dkrr7jyxmlabg.1492736287411@email.android.com --===============6948714681374485926== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Sorry about the message with nothing new... Once upon a time, Bryan Sockel said: > We checked the port groups, and servers are cabled correctly. > = > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > = > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. Well, I don't have any problem with that setup on multiple oVirt clusters (including a bunch of R610 servers), so I don't think that's it. I configure oVirt for "custom" bonding options; I use: mode=3D802.3ad lacp_rate=3D1 xmit_hash_policy=3Dlayer2+3 Is it possible to move the wires around temporarily, so different server ports are connected to different switch ports? It would be interested to see if the "solo" behavior stayed with the port or the wire. -- = Chris Adams --===============6948714681374485926==-- From derek at ihtfp.com Fri Apr 21 01:22:04 2017 Content-Type: multipart/mixed; boundary="===============9189755890076206998==" MIME-Version: 1.0 From: Derek Atkins To: users at ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue Date: Thu, 20 Apr 2017 21:11:46 -0400 Message-ID: In-Reply-To: m7a1baxmt52dkrr7jyxmlabg.1492736287411@email.android.com --===============9189755890076206998== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable For what it's worth I set up my bond0 manually on CentOS before installing ovirt hosted engine and the ovirtmgmt bridge "took over" from bond0.. But it appears to still be working. At least I've not noticed links being down, and "ifconfig" shows decent amount of traffic on both eno1 and eno2. Maybe wipe, re-install, configure it manually, and then install ovirt? -derek On Thu, April 20, 2017 8:58 pm, Bryan Sockel wrote: > We checked the port groups, and servers are cabled correctly. > > After server is rebooted, em1 is the only interface passing traffic. > Other 3 nics sitting idle. We can down each port on the switch and > confirm it is down on the server. > > > I am pretty sure it is related to the bridge that was created to pass > vm-host-altn traffic when the appliance was first installed. > > > > -------- Original message -------- > From: Chris Adams > Date: 4/20/17 5:40 PM (GMT-06:00) > To: users(a)ovirt.org > Subject: Re: [ovirt-users] LACP Bonding issue > > _____ > > From : Chris Adams [cma(a)cmadams.net] > To : users(a)ovirt.org [users(a)ovirt.org] > Date : Thursday, April 20 2017 17:40:25 > Once upon a time, Bryan Sockel said: >> It seems that is some disconnect between my network bridge, the bond > and my >> interfaces. I would like to some how get my bond to use all 4 > interfaces. >> On reboot, it always seems to reset consistently to EM1. > > Are you sure the switch side is all the same LACP group? Sounds like > one port may accidentally be in a separate group, and that happens to be > em1. > > You might try swapping wires between em1 and another port and reboot and > see which ports come up - if all but the port with the wire formerly in > em1 come up, it points to the switch config. > > -- > Chris Adams > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > -- = Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant --===============9189755890076206998==--