Hi, I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links. I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch. Thanks Bryan
This is a multi-part message in MIME format. --------------494E824023E277922AF19933 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit You should configure your LAG with this options (custom mode on oVirt): mode=4 miimon=100 xmit_hash_policy=2 lacp_rate=1 An tell to your network admin configure switch: "Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)". You also need to understand that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d", and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX.
Hi,
I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links.
I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch.
Thanks Bryan
--------------494E824023E277922AF19933 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> You should configure your LAG with this options (custom mode on oVirt):<br> <br> mode=4 miimon=100 xmit_hash_policy=2 lacp_rate=1<br> <br> An tell to your network admin configure switch:<br> "Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)".<br> <br> <div id="gt-res-content"> <div id="gt-res-dir-ctr" dir="ltr" class="trans-verified-button-small"><span id="result_box" class="" lang="en"><span class="">You also need to understand that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d",<br> and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX.<br> <br> </span></span></div> </div> <blockquote type="cite"> <pre>Hi, I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links. I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch. Thanks Bryan</pre> </blockquote> <br> </body> </html> --------------494E824023E277922AF19933--
After further testing we can either get EM1 running on the bond or EM2 - EM4 running in the bond, but not EM1-EM4. We are running the Hosted Engine Appliance in our setup. In order to install the appliance, i have to point it to a physical nic during the install process. The install process creates the network bridge ovirtmgmt which is tied to interface EM1 on both servers. After i finished setting up the appliance, and both of my hosts, i went in and created my bond so i could configure LACP. It seems that is some disconnect between my network bridge, the bond and my interfaces. I would like to some how get my bond to use all 4 interfaces. On reboot, it always seems to reset consistently to EM1. -----Original Message----- From: Konstantin Shalygin <k0ste@k0ste.ru> To: users@ovirt.org, Bryan Sockel <Bryan.Sockel@altn.com> Date: Thu, 20 Apr 2017 23:43:15 +0700 Subject: Re: Re: [ovirt-users] LACP Bonding issue You should configure your LAG with this options (custom mode on oVirt): mode=4 miimon=100 xmit_hash_policy=2 lacp_rate=1 An tell to your network admin configure switch: "Give me lacp timeout short with channel-group mode active. Also set port-channel load-balance src-dst-mac-ip (or src-dst-ip\src-dst-mac)". You also need to understand that LACP balancing works 'per flow'. You can take 2 hosts and run "iperf -c xxx.xxx.xxx.xxx -i 0.1 -d", and on one phy interface you should see 1Gb RX, and on another phy interface 1Gb TX. Hi, I discovered an issue with my LACP configuration and i am having trouble figuring it out. I am running 2 Dell Powered 610's with 4 broadcomm nics. I am trying to bond them together, however only one of the nics goes active no mater how much traffic i push across the links. I have spoken to my network admin, and says that the switch ports are configured and can only see one active link on the switch. Thanks Bryan
Once upon a time, Bryan Sockel <Bryan.Sockel@altn.com> said:
It seems that is some disconnect between my network bridge, the bond and my interfaces. I would like to some how get my bond to use all 4 interfaces. On reboot, it always seems to reset consistently to EM1.
Are you sure the switch side is all the same LACP group? Sounds like one port may accidentally be in a separate group, and that happens to be em1. You might try swapping wires between em1 and another port and reboot and see which ports come up - if all but the port with the wire formerly in em1 come up, it points to the switch config. -- Chris Adams <cma@cmadams.net>
participants (3)
-
Bryan Sockel -
Chris Adams -
Konstantin Shalygin