From k0ste at k0ste.ru Thu Apr 20 16:43:18 2017 Content-Type: multipart/mixed; boundary="===============8801494013874480865==" MIME-Version: 1.0 From: Konstantin Shalygin To: users at ovirt.org Subject: Re: [ovirt-users] LACP Bonding issue Date: Thu, 20 Apr 2017 23:43:15 +0700 Message-ID: <75358a73-5851-715a-a1f6-102df8f085df@k0ste.ru> In-Reply-To: WC20170420155828.270037@altn.com --===============8801494013874480865== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------494E824023E277922AF19933 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 7bit You should configure your LAG with this options (custom mode on oVirt): mode=3D4 miimon=3D100 xmit_hash_policy=3D2 lacp_rate=3D1 An tell to your network admin configure switch: "Give me lacp timeout short with channel-group mode active. Also set = port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)". You also need to understand that LACP balancing works 'per flow'. You = can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d", and on one phy interface you should see 1Gb RX, and on another phy = interface 1Gb TX. > Hi, > > I discovered an issue with my LACP configuration and i am having trouble > figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. > I am trying to bond them together, however only one of the nics goes acti= ve > no mater how much traffic i push across the links. > > I have spoken to my network admin, and says that the switch ports are > configured and can only see one active link on the switch. > > Thanks > Bryan --------------494E824023E277922AF19933 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit You should configure your LAG with this options (custom mode on oVirt):

mode=3D4 miimon=3D100 xmit_hash_policy=3D2 lacp_rate=3D1

An tell to your network admin configure switch:
"Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)".

You also need to understa= nd that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d",
and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX.

Hi,

I discovered an issue with my LACP configuration and i am having trouble =

figuring it out.  I am running 2 Dell Powered 610's with 4 broadcomm nics.  =

I am trying to bond them together, however only one of the nics goes active =

no mater how much traffic i push across the links.

I have spoken to my network admin, and says that the switch ports are =

configured and can only see one active link on the switch.

Thanks
Bryan

--------------494E824023E277922AF19933-- --===============8801494013874480865== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS00OTRFODI0MDIzRTI3NzkyMkFGMTk5MzMKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK CllvdSBzaG91bGQgY29uZmlndXJlIHlvdXIgTEFHIHdpdGggdGhpcyBvcHRpb25zIChjdXN0b20g bW9kZSBvbiBvVmlydCk6Cgptb2RlPTQgbWlpbW9uPTEwMCB4bWl0X2hhc2hfcG9saWN5PTIgbGFj cF9yYXRlPTEKCkFuIHRlbGwgdG8geW91ciBuZXR3b3JrIGFkbWluIGNvbmZpZ3VyZSBzd2l0Y2g6 CiJHaXZlIG1lIGxhY3AgdGltZW91dCBzaG9ydCB3aXRoIGNoYW5uZWwtZ3JvdXAgbW9kZSBhY3Rp dmUuIEFsc28gc2V0IApwb3J0LWNoYW5uZWwgbG9hZC1iYWxhbmNlIHNyYy1kc3QtbWFjLWlwIChv ciBzcmMtZHN0LWlwXHNyYy1kc3QtbWFjKSIuCgpZb3UgYWxzbyBuZWVkIHRvIHVuZGVyc3RhbmQg dGhhdCBMQUNQIGJhbGFuY2luZyB3b3JrcyAncGVyIGZsb3cnLiBZb3UgCmNhbiB0YWtlIDIgaG9z dHMgYW5kIHJ1biAiaXBlcmYgLWMgeHh4Lnh4eC54eHgueHh4IC1pIDAuMSAtZCIsCmFuZCBvbiBv bmUgcGh5IGludGVyZmFjZSB5b3Ugc2hvdWxkIHNlZSAxR2IgUlgsIGFuZCBvbiBhbm90aGVyIHBo eSAKaW50ZXJmYWNlIDFHYiBUWC4KCj4gSGksCj4KPiBJIGRpc2NvdmVyZWQgYW4gaXNzdWUgd2l0 aCBteSBMQUNQIGNvbmZpZ3VyYXRpb24gYW5kIGkgYW0gaGF2aW5nIHRyb3VibGUKPiBmaWd1cmlu ZyBpdCBvdXQuICBJIGFtIHJ1bm5pbmcgMiBEZWxsIFBvd2VyZWQgNjEwJ3Mgd2l0aCA0IGJyb2Fk Y29tbSBuaWNzLgo+IEkgYW0gdHJ5aW5nIHRvIGJvbmQgdGhlbSB0b2dldGhlciwgaG93ZXZlciBv bmx5IG9uZSBvZiB0aGUgbmljcyBnb2VzIGFjdGl2ZQo+IG5vIG1hdGVyIGhvdyBtdWNoIHRyYWZm aWMgaSBwdXNoIGFjcm9zcyB0aGUgbGlua3MuCj4KPiBJIGhhdmUgc3Bva2VuIHRvIG15IG5ldHdv cmsgYWRtaW4sIGFuZCBzYXlzIHRoYXQgdGhlIHN3aXRjaCBwb3J0cyBhcmUKPiBjb25maWd1cmVk IGFuZCBjYW4gb25seSBzZWUgb25lIGFjdGl2ZSBsaW5rIG9uIHRoZSBzd2l0Y2guCj4KPiBUaGFu a3MKPiBCcnlhbgoKCi0tLS0tLS0tLS0tLS0tNDk0RTgyNDAyM0UyNzc5MjJBRjE5OTMzCkNvbnRl bnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rp bmc6IDdiaXQKCjxodG1sPgogIDxoZWFkPgoKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQt dHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4KICA8L2hlYWQ+CiAgPGJv ZHkgdGV4dD0iIzAwMDAwMCIgYmdjb2xvcj0iI0ZGRkZGRiI+CiAgICBZb3Ugc2hvdWxkIGNvbmZp Z3VyZSB5b3VyIExBRyB3aXRoIHRoaXMgb3B0aW9ucyAoY3VzdG9tIG1vZGUgb24KICAgIG9WaXJ0 KTo8YnI+CiAgICA8YnI+CiAgICBtb2RlPTQgbWlpbW9uPTEwMCB4bWl0X2hhc2hfcG9saWN5PTIg bGFjcF9yYXRlPTE8YnI+CiAgICA8YnI+CiAgICBBbiB0ZWxsIHRvIHlvdXIgbmV0d29yayBhZG1p biBjb25maWd1cmUgc3dpdGNoOjxicj4KICAgICJHaXZlIG1lIGxhY3AgdGltZW91dCBzaG9ydCB3 aXRoIGNoYW5uZWwtZ3JvdXAgbW9kZSBhY3RpdmUuIEFsc28gc2V0CiAgICBwb3J0LWNoYW5uZWwg bG9hZC1iYWxhbmNlIHNyYy1kc3QtbWFjLWlwIChvcgogICAgc3JjLWRzdC1pcFxzcmMtZHN0LW1h YykiLjxicj4KICAgIDxicj4KICAgIDxkaXYgaWQ9Imd0LXJlcy1jb250ZW50Ij4KICAgICAgPGRp diBpZD0iZ3QtcmVzLWRpci1jdHIiIGRpcj0ibHRyIgogICAgICAgIGNsYXNzPSJ0cmFucy12ZXJp ZmllZC1idXR0b24tc21hbGwiPjxzcGFuIGlkPSJyZXN1bHRfYm94IgogICAgICAgICAgY2xhc3M9 IiIgbGFuZz0iZW4iPjxzcGFuIGNsYXNzPSIiPllvdSBhbHNvIG5lZWQgdG8gdW5kZXJzdGFuZAog ICAgICAgICAgICB0aGF0IExBQ1AgYmFsYW5jaW5nIHdvcmtzICdwZXIgZmxvdycuIFlvdSBjYW4g dGFrZSAyIGhvc3RzCiAgICAgICAgICAgIGFuZCBydW4gImlwZXJmIC1jIHh4eC54eHgueHh4Lnh4 eCAtaSAwLjEgLWQiLDxicj4KICAgICAgICAgICAgYW5kIG9uIG9uZSBwaHkgaW50ZXJmYWNlIHlv dSBzaG91bGQgc2VlIDFHYiBSWCwgYW5kIG9uCiAgICAgICAgICAgIGFub3RoZXIgcGh5IGludGVy ZmFjZSAxR2IgVFguPGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICA8L3NwYW4+PC9zcGFu PjwvZGl2PgogICAgPC9kaXY+CiAgICA8YmxvY2txdW90ZSB0eXBlPSJjaXRlIj4KICAgICAgPHBy ZT5IaSwKCkkgZGlzY292ZXJlZCBhbiBpc3N1ZSB3aXRoIG15IExBQ1AgY29uZmlndXJhdGlvbiBh bmQgaSBhbSBoYXZpbmcgdHJvdWJsZSAKZmlndXJpbmcgaXQgb3V0LiAgSSBhbSBydW5uaW5nIDIg RGVsbCBQb3dlcmVkIDYxMCdzIHdpdGggNCBicm9hZGNvbW0gbmljcy4gIApJIGFtIHRyeWluZyB0 byBib25kIHRoZW0gdG9nZXRoZXIsIGhvd2V2ZXIgb25seSBvbmUgb2YgdGhlIG5pY3MgZ29lcyBh Y3RpdmUgCm5vIG1hdGVyIGhvdyBtdWNoIHRyYWZmaWMgaSBwdXNoIGFjcm9zcyB0aGUgbGlua3Mu CgpJIGhhdmUgc3Bva2VuIHRvIG15IG5ldHdvcmsgYWRtaW4sIGFuZCBzYXlzIHRoYXQgdGhlIHN3 aXRjaCBwb3J0cyBhcmUgCmNvbmZpZ3VyZWQgYW5kIGNhbiBvbmx5IHNlZSBvbmUgYWN0aXZlIGxp bmsgb24gdGhlIHN3aXRjaC4KClRoYW5rcwpCcnlhbjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgog ICAgPGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS00OTRFODI0MDIzRTI3Nzky MkFGMTk5MzMtLQo= --===============8801494013874480865==--