4.4.x - VLAN-based logical network can't attach to bonds?
Hello all, New 4.4.1 hosted-engine install. Pre-deploy, the host already had bond0 and its iSCSI interfaces configured. The deploy correctly sets up the ovirtmgmt interface using the bond, and when everything finishes up it's working as expected. However, I then need to create a VLAN-based network and attach to the same bond0 interface. Editing the host networks and dragging the VLAN 102 interface to the bond alongside ovirtmgmt, then clicking "OK" results in a failure every time. The error returned is: VDSM ovirt5.domain.com command HostSetupNetworksVDS failed: Internal JSON-RPC error: {'reason': 'Unexpected failure of libnm when running the mainloop: run execution'} I can break the bond and apply this an any other VLAN-based network at will, but then it's not possible to add the interface I removed to create the bond again. That may be by design and it's not supposed to be possible to attach an interface and create a bond once you've already assigned logical networks to it. The error there is "Error while executing action HostSetupNetworks: Interface already in use". I'm just putting out feelers to see if this is a known issue that other people are hitting, or are other folks with hosted-engine 4.4.x deploys readily creating that initial bond0 interface and assigning any VLAN-based logical networks they want w/o issue? These same hosts (they still aren't in prod so I rebuild them at will) run 4.3 with no issues and setting up the exact same network configurations works flawlessly, it just becomes an issue on 4.4.1. This host was freshly installed today and has all updates. Thanks, Mark
On Wed, Jul 22, 2020 at 9:49 PM Mark R <ovirtlist@beanz.33mail.com> wrote:
Hello all,
Hi,
New 4.4.1 hosted-engine install. Pre-deploy, the host already had bond0 and its iSCSI interfaces configured. The deploy correctly sets up the ovirtmgmt interface using the bond, and when everything finishes up it's working as expected. However, I then need to create a VLAN-based network and attach to the same bond0 interface. Editing the host networks and dragging the VLAN 102 interface to the bond alongside ovirtmgmt, then clicking "OK" results in a failure every time. The error returned is:
VDSM ovirt5.domain.com command HostSetupNetworksVDS failed: Internal JSON-RPC error: {'reason': 'Unexpected failure of libnm when running the mainloop: run execution'}
can you please share supervdsm.log from the relevant host?
I can break the bond and apply this an any other VLAN-based network at will, but then it's not possible to add the interface I removed to create the bond again. That may be by design and it's not supposed to be possible to attach an interface and create a bond once you've already assigned logical networks to it. The error there is "Error while executing action HostSetupNetworks: Interface already in use".
This is in fact desired by design as we do not support having an interface under bond and at the same time have a network defined over it.
I'm just putting out feelers to see if this is a known issue that other people are hitting, or are other folks with hosted-engine 4.4.x deploys readily creating that initial bond0 interface and assigning any VLAN-based logical networks they want w/o issue? These same hosts (they still aren't in prod so I rebuild them at will) run 4.3 with no issues and setting up the exact same network configurations works flawlessly, it just becomes an issue on 4.4.1. This host was freshly installed today and has all updates.
Thanks, Mark _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XF7PANDZBAH5J7...
-- Ales Musil Software Engineer - RHV Network Red Hat EMEA <https://www.redhat.com> amusil@redhat.com IM: amusil <https://red.ht/sig>
Hello Ales,
can you please share supervdsm.log from the relevant host?
Absolutely! Here is the log from the point of opening the "Setup Host Networks" UI, as I just drag the "LegacyDMZ" network over onto the same bond that's running ovirtmgmt and click "OK". #---------8<--------------------------8<---------------------------------8<------------------------ MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,627::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call get_lldp_info with ({'devices': []},) {} MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,631::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,634::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,635::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,643::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,644::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev eno34np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,649::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,649::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev ens2f1np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,655::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,699::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eno33np0 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,706::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,706::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i eno33np0 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,712::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,713::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eno34np1 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,718::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,719::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i eno34np1 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,724::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,725::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i ens2f0np0 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,729::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,730::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i ens2f0np0 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,735::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,736::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i ens2f1np1 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,740::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,741::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i ens2f1np1 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,745::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,746::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) return get_lldp_info with {'eno33np0': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:21:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/16'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'Part of VLT LACP trunk to rack4slot15 - em3'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-A'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Add ress', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.1', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2140', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': 'unsupported'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'True', 'Aggregated Port ID': '7'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '1532'}, 'oui': 4623, 'subtype': 4}]}, 'eno34np1': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:21:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/15'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'rack4slot15 - em4 to Storage VLAN A'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-A'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.1', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2140', 'interface numbering subtype': 'Ifindex', 'interface numbering ': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': '97'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'False', 'Aggregated Port ID': '0'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '9216'}, 'oui': 4623, 'subtype': 4}]}, 'ens2f0np0': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:25:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/16'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'Part of VLT LACP trunk to rack4slot15 - p2p1'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-B'}}, {'type': 6, 'name': 'System Description', 'properties': {'system descripti on': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.2', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2540', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': 'unsupported'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'True', 'Aggregated Port ID': '7'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '1532'}, 'oui': 4623, ' subtype': 4}]}, 'ens2f1np1': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:25:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/15'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'rack4slot15 - p2p2 to Storage VLAN B'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-B'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.2', 'interface numbering subtype': 'I findex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2540', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': '98'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'False', 'Aggregated Port ID': '0'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '9216'}, 'oui': 4623, 'subtype': 4}]}, 'eno1': {'enabled': False, 'tlvs': []}, 'eno2': {'enabled': False, 'tlvs': []}} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,091::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks with ({'LegacyDMZ': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'}) {} MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,092::api::220::root::(setupNetworks) Setting up network according to configuration: networks:{'LegacyDMZ': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,099::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,101::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,102::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,110::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,111::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev eno34np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,117::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,117::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev ens2f1np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,122::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network ovirtmgmt({'bridged': True, 'stp': False, 'mtu': 1500, 'bonding': 'bond0', 'defaultRoute': True, 'bootproto': 'none', 'dhcpv6': True, 'ipv6autoconf': True, 'ipaddr': '172.17.96.55', 'netmask': '255.255.255.0', 'gateway': '172.17.96.1', 'switch': 'legacy', 'nameservers': ['192.168.1.182', '192.168.1.181']}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network iSCSI-A({'bridged': False, 'mtu': 9000, 'nic': 'eno34np1', 'defaultRoute': False, 'bootproto': 'none', 'dhcpv6': False, 'ipv6autoconf': False, 'ipaddr': '172.17.97.55', 'netmask': '255.255.255.0', 'switch': 'legacy', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network iSCSI-B({'bridged': False, 'mtu': 9000, 'nic': 'ens2f1np1', 'defaultRoute': False, 'bootproto': 'none', 'dhcpv6': False, 'ipv6autoconf': False, 'ipaddr': '172.17.98.55', 'netmask': '255.255.255.0', 'switch': 'legacy', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4 xmit_hash_policy=2', 'switch': 'legacy'}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network LegacyDMZ({'vlan': 22, 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': True, 'dhcpv6': False, 'mtu': 1500, 'switch': 'legacy', 'defaultRoute': False, 'stp': False, 'bootproto': 'none', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4 xmit_hash_policy=2', 'switch': 'legacy'}) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,169::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-63 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe (cwd None) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,455::hooks::122::root::(_runHooksDir) /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,455::configurator::195::root::(_setup_nmstate) Processing setup through nmstate MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,478::configurator::197::root::(_setup_nmstate) Desired state: {'interfaces': [{'name': 'LegacyDMZ', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, 'bridge': {'port': [{'name': 'bond0.22'}], 'options': {'stp': {'enabled': False}}}, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'bond0', 'type': 'bond', 'state': 'up', 'link-aggregation': {'slaves': ['eno33np0', 'ens2f0np0'], 'options': {'xmit_hash_policy': '2'}, 'mode': '802.3ad'}, 'mtu': 1500}, {'vlan': {'id': 22, 'base-iface': 'bond0'}, 'name': 'bond0.22', 'type': 'vlan', 'state': 'up', 'mtu': 1500, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'ovirtmgmt'}]} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,526::checkpoint::121::root::(create) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/11 created for all devices: 60 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,526::netapplier::239::root::(_add_interfaces) Adding new interfaces: ['bond0.22', 'LegacyDMZ'] MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,527::netapplier::251::root::(_edit_interfaces) Editing interfaces: ['eno33np0', 'ovirtmgmt', 'bond0', 'ens2f0np0'] MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,530::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,537::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=LegacyDMZ MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,537::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,552::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=bond0.22 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,552::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,555::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=bond0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,555::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,557::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=eno33np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,557::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,560::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ens2f0np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,560::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,562::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,562::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,564::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=LegacyDMZ, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,605::connection::301::root::(_waitfor_active_connection_callback) Connection activation succeeded: dev=LegacyDMZ, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_IP_CONFIG of type NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_MASTER | NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_MASTER_HAS_SLAVES of type NM.ActivationStateFlags> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,605::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,607::device::149::root::(_modify_callback) Device reapply succeeded: dev=bond0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,607::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,609::device::149::root::(_modify_callback) Device reapply succeeded: dev=ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,609::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,610::device::149::root::(_modify_callback) Device reapply succeeded: dev=eno33np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,610::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,611::device::149::root::(_modify_callback) Device reapply succeeded: dev=ens2f0np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,611::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,612::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=bond0.22, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/2::ERROR::2020-07-23 13:37:43,648::nmclient::200::root::(quit) NM main-loop aborted: Connection activation failed on bond0.22: reason=<enum NM_ACTIVE_CONNECTION_STATE_REASON_DEVICE_DISCONNECTED of type NM.ActiveConnectionStateReason> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,672::checkpoint::164::root::(rollback) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/11 rollback executed: dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/28'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/8'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/27'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/4'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/26'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/6'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/3'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/29'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/7'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/37'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/1'): dbus.UInt32(0 ), dbus.String('/org/freedesktop/NetworkManager/Devices/5'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/30'): dbus.UInt32(0)}, signature=dbus.Signature('su')) MainProcess|jsonrpc/2::ERROR::2020-07-23 13:37:48,679::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) Error in setupNetworks Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 95, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 241, in setupNetworks _setup_networks(networks, bondings, options, net_info) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 266, in _setup_networks networks, bondings, options, net_info, in_rollback File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 154, in setup _setup_nmstate(networks, bondings, options, in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 199, in _setup_nmstate nmstate.setup(desired_state, verify_change=not in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", line 63, in setup state_apply(desired_state, verify_change=verify_change) File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", line 40, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 96, in wrapped ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 73, in apply state.State(desired_state), verify_change, commit, rollback_timeout File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 163, in _apply_ifaces_state con_profiles=ifaces_add_configs + ifaces_edit_configs, File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 232, in _setup_providers mainloop.run(timeout=MAINLOOP_TIMEOUT) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 177, in run f"Unexpected failure of libnm when running the mainloop: {err}" libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when running the mainloop: run execution #---------8<--------------------------8<---------------------------------8<------------------------
This is in fact desired by design as we do not support having an interface under bond and at the same time have a network defined over it.
Understood, thank you for clarifying that one. My assumption there was that creating the bond would just move any configured networks from the single interface onto the bond, but that's what I get for assuming :) Regards, Mark
Hello Mark, we are highly interested in this issue. Can you please create a bug <https://bugzilla.redhat.com/enter_bug.cgi?product=vdsm> for oVirt with reproduction steps? If you have the opportunity, it would be interesting to know if the new NetworkManager 1.26 from https://copr.fedorainfracloud.org/coprs/networkmanager/NetworkManager-1.26/ would fix the problem already. Thanks Dominik On Thu, Jul 23, 2020 at 3:56 PM Mark R <ovirtlist@beanz.33mail.com> wrote:
Hello Ales,
can you please share supervdsm.log from the relevant host?
Absolutely! Here is the log from the point of opening the "Setup Host Networks" UI, as I just drag the "LegacyDMZ" network over onto the same bond that's running ovirtmgmt and click "OK".
#---------8<--------------------------8<---------------------------------8<------------------------
MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,627::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call get_lldp_info with ({'devices': []},) {} MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,631::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,634::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,635::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,643::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,644::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev eno34np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,649::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,649::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev ens2f1np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,655::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,699::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eno33np0 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,706::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,706::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i eno33np0 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,712::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,713::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i eno34np1 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,718::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,719::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i eno34np1 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,724::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,725::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i ens2f0np0 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,729::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,730::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i ens2f0np0 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,735::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,736::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-lldp -i ens2f1np1 adminStatus (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,740::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,741::cmdutils::130::root::(exec_cmd) /usr/sbin/lldptool get-tlv -n -i ens2f1np1 (cwd None) MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,745::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/4::DEBUG::2020-07-23 13:37:35,746::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) return get_lldp_info with {'eno33np0': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:21:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/16'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'Part of VLT LACP trunk to rack4slot15 - em3'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-A'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Add ress', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.1', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2140', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': 'unsupported'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'True', 'Aggregated Port ID': '7'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '1532'}, 'oui': 4623, 'subtype': 4}]}, 'eno34np1': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:21:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/15'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'rack4slot15 - em4 to Storage VLAN A'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-A'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.1', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2140', 'interface numbering subtype': 'Ifindex', 'interface numbering ': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': '97'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'False', 'Aggregated Port ID': '0'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '9216'}, 'oui': 4623, 'subtype': 4}]}, 'ens2f0np0': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:25:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/16'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'Part of VLT LACP trunk to rack4slot15 - p2p1'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-B'}}, {'type': 6, 'name': 'System Description', 'properties': {'system descripti on': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.2', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2540', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': 'unsupported'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'True', 'Aggregated Port ID': '7'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '1532'}, 'oui': 4623, ' subtype': 4}]}, 'ens2f1np1': {'enabled': True, 'tlvs': [{'type': 1, 'name': 'Chassis ID', 'properties': {'chassis ID subtype': 'MAC', 'chassis ID': '8c:04:ba:e9:25:40'}}, {'type': 2, 'name': 'Port ID', 'properties': {'port ID subtype': 'Ifname', 'port ID': 'ethernet1/1/15'}}, {'type': 3, 'name': 'Time to Live', 'properties': {'time to live': '120'}}, {'type': 4, 'name': 'Port Description', 'properties': {'port description': 'rack4slot15 - p2p2 to Storage VLAN B'}}, {'type': 5, 'name': 'System Name', 'properties': {'system name': 'TOR-4-B'}}, {'type': 6, 'name': 'System Description', 'properties': {'system description': 'Dell EMC Networking OS10 Enterprise.'}}, {'type': 7, 'name': 'System Capabilities', 'properties': {'system capabilities': 'Repeater, Bridge, Router', 'enabled capabilities': 'Repeater, Bridge, Router'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv4', 'management address': '192.168.3.2', 'interface numbering subtype': 'I findex', 'interface numbering': '9'}}, {'type': 8, 'name': 'Management Address', 'properties': {'management address subtype': 'IPv6', 'management address': 'fe80::8e04:baff:fee9:2540', 'interface numbering subtype': 'Ifindex', 'interface numbering': '9'}}, {'type': 127, 'name': 'Port VLAN ID', 'properties': {'Port VLAN ID': '98'}, 'oui': 32962, 'subtype': 1}, {'type': 127, 'name': 'Link Aggregation', 'properties': {'Aggregation capable': 'True', 'Currently aggregated': 'False', 'Aggregated Port ID': '0'}, 'oui': 32962, 'subtype': 7}, {'type': 127, 'name': 'MTU', 'properties': {'mtu': '9216'}, 'oui': 4623, 'subtype': 4}]}, 'eno1': {'enabled': False, 'tlvs': []}, 'eno2': {'enabled': False, 'tlvs': []}} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,091::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks with ({'LegacyDMZ': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'}) {} MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,092::api::220::root::(setupNetworks) Setting up network according to configuration: networks:{'LegacyDMZ': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,099::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,101::routes::115::root::(get_gateway) The gateway 172.17.96.1 is duplicated for the device ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,102::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,110::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,111::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev eno34np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,117::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,117::cmdutils::130::root::(exec_cmd) /sbin/tc class show dev ens2f1np1 classid 0:1388 (cwd None) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,122::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network ovirtmgmt({'bridged': True, 'stp': False, 'mtu': 1500, 'bonding': 'bond0', 'defaultRoute': True, 'bootproto': 'none', 'dhcpv6': True, 'ipv6autoconf': True, 'ipaddr': '172.17.96.55', 'netmask': '255.255.255.0', 'gateway': '172.17.96.1', 'switch': 'legacy', 'nameservers': ['192.168.1.182', '192.168.1.181']}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network iSCSI-A({'bridged': False, 'mtu': 9000, 'nic': 'eno34np1', 'defaultRoute': False, 'bootproto': 'none', 'dhcpv6': False, 'ipv6autoconf': False, 'ipaddr': '172.17.97.55', 'netmask': '255.255.255.0', 'switch': 'legacy', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network iSCSI-B({'bridged': False, 'mtu': 9000, 'nic': 'ens2f1np1', 'defaultRoute': False, 'bootproto': 'none', 'dhcpv6': False, 'ipv6autoconf': False, 'ipaddr': '172.17.98.55', 'netmask': '255.255.255.0', 'switch': 'legacy', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4 xmit_hash_policy=2', 'switch': 'legacy'}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::58::root::(setNetwork) Adding network LegacyDMZ({'vlan': 22, 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': True, 'dhcpv6': False, 'mtu': 1500, 'switch': 'legacy', 'defaultRoute': False, 'stp': False, 'bootproto': 'none', 'nameservers': []}) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,167::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4 xmit_hash_policy=2', 'switch': 'legacy'}) MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,169::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-63 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe (cwd None) MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,455::hooks::122::root::(_runHooksDir) /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,455::configurator::195::root::(_setup_nmstate) Processing setup through nmstate MainProcess|jsonrpc/2::INFO::2020-07-23 13:37:43,478::configurator::197::root::(_setup_nmstate) Desired state: {'interfaces': [{'name': 'LegacyDMZ', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, 'bridge': {'port': [{'name': 'bond0.22'}], 'options': {'stp': {'enabled': False}}}, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'bond0', 'type': 'bond', 'state': 'up', 'link-aggregation': {'slaves': ['eno33np0', 'ens2f0np0'], 'options': {'xmit_hash_policy': '2'}, 'mode': '802.3ad'}, 'mtu': 1500}, {'vlan': {'id': 22, 'base-iface': 'bond0'}, 'name': 'bond0.22', 'type': 'vlan', 'state': 'up', 'mtu': 1500, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'ovirtmgmt'}]} MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,526::checkpoint::121::root::(create) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/11 created for all devices: 60 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,526::netapplier::239::root::(_add_interfaces) Adding new interfaces: ['bond0.22', 'LegacyDMZ'] MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,527::netapplier::251::root::(_edit_interfaces) Editing interfaces: ['eno33np0', 'ovirtmgmt', 'bond0', 'ens2f0np0'] MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,530::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,537::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=LegacyDMZ MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,537::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,552::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=bond0.22 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,552::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,555::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=bond0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,555::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,557::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=eno33np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,557::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,560::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ens2f0np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,560::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,562::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,562::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,564::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=LegacyDMZ, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,605::connection::301::root::(_waitfor_active_connection_callback) Connection activation succeeded: dev=LegacyDMZ, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_IP_CONFIG of type NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_MASTER | NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_MASTER_HAS_SLAVES of type NM.ActivationStateFlags> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,605::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,607::device::149::root::(_modify_callback) Device reapply succeeded: dev=bond0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,607::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,609::device::149::root::(_modify_callback) Device reapply succeeded: dev=ovirtmgmt MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,609::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,610::device::149::root::(_modify_callback) Device reapply succeeded: dev=eno33np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,610::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,611::device::149::root::(_modify_callback) Device reapply succeeded: dev=ens2f0np0 MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,611::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,612::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=bond0.22, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/2::ERROR::2020-07-23 13:37:43,648::nmclient::200::root::(quit) NM main-loop aborted: Connection activation failed on bond0.22: reason=<enum NM_ACTIVE_CONNECTION_STATE_REASON_DEVICE_DISCONNECTED of type NM.ActiveConnectionStateReason> MainProcess|jsonrpc/2::DEBUG::2020-07-23 13:37:43,672::checkpoint::164::root::(rollback) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/11 rollback executed: dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/28'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/8'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/27'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/4'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/26'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/6'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/3'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/29'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/7'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/37'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/1'): dbus.UInt32(0 ), dbus.String('/org/freedesktop/NetworkManager/Devices/5'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/30'): dbus.UInt32(0)}, signature=dbus.Signature('su')) MainProcess|jsonrpc/2::ERROR::2020-07-23 13:37:48,679::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) Error in setupNetworks Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 95, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 241, in setupNetworks _setup_networks(networks, bondings, options, net_info) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 266, in _setup_networks networks, bondings, options, net_info, in_rollback File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 154, in setup _setup_nmstate(networks, bondings, options, in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 199, in _setup_nmstate nmstate.setup(desired_state, verify_change=not in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", line 63, in setup state_apply(desired_state, verify_change=verify_change) File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", line 40, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 96, in wrapped ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 73, in apply state.State(desired_state), verify_change, commit, rollback_timeout File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 163, in _apply_ifaces_state con_profiles=ifaces_add_configs + ifaces_edit_configs, File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 232, in _setup_providers mainloop.run(timeout=MAINLOOP_TIMEOUT) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 177, in run f"Unexpected failure of libnm when running the mainloop: {err}" libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when running the mainloop: run execution
#---------8<--------------------------8<---------------------------------8<------------------------
This is in fact desired by design as we do not support having an interface under bond and at the same time have a network defined over it.
Understood, thank you for clarifying that one. My assumption there was that creating the bond would just move any configured networks from the single interface onto the bond, but that's what I get for assuming :)
Regards, Mark _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/PI7TNQX7J5QCZE...
Hi Dominik,
Can you please create a bug <https://bugzilla.redhat.com/enter_bug.cgi?product=vdsm> for oVirt with reproduction steps?
Yes, I'll do so. Rebuilding the host fresh now so I have a clean slate as I go through the steps for the report. I did try NM 1.26 from the COPR repo you linked, but the issue persisted.
.. if the new NetworkManager 1.26 from ... would fix the problem already.
I installed 1.26 and tried to add the network but it failed. Thanks! Mark
Can you please create a bug <https://bugzilla.redhat.com/enter_bug.cgi?product=vdsm> for oVirt with reproduction steps?
Following up, as noted in the bug report ( https://bugzilla.redhat.com/show_bug.cgi?id=1860479 ) this doesn't appear to be oVirt / VDSM having issues. You can replicate the same inability to attach a bond to a bridge by simply booting the 8.2.2004 installation media and trying a few manual 'ip' commands. With older 8.1 or any 7.x install media, there's no problem, but starting with 8.2, you can't attach a bond to a bridge anymore. It looks like there may be some similar reports on bugzilla recently. I just wanted to note here on the list that this isn't an oVirt problem, looks to be an issue with the OS (kernel?). Thanks again! Mark
On Fri, Jul 31, 2020 at 12:54 AM Mark R <ovirtlist@beanz.33mail.com> wrote:
Following up, as noted in the bug report ( https://bugzilla.redhat.com/show_bug.cgi?id=1860479 ) this doesn't appear to be oVirt / VDSM having issues. You can replicate the same inability to attach a bond to a bridge by simply booting the 8.2.2004 installation media and trying a few manual 'ip' commands. With older 8.1 or any 7.x install media, there's no problem, but starting with 8.2, you can't attach a bond to a bridge anymore.
It looks like there may be some similar reports on bugzilla recently. I just wanted to note here on the list that this isn't an oVirt problem, looks to be an issue with the OS (kernel?).
Thanks again!
Thanks for reporting the bug, providing additional information, and this update. This is a very productive way to solve this issue.
Mark _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KUUZJTAF5CWWIU...
participants (3)
-
Ales Musil -
Dominik Holler -
Mark R