
Hi Dominik, My apologies for the delay, have been pushed to other projects this week. I just verified that our CentOS 8.2 and oVirt 4.4.0 installs are fully up to date, and tried to apply a network configuration adding a tagged VLAN to the same bridge as ovirtmgmt. Here are the logs: ``` MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,832::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks with ({'DMZ0': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'}) {} MainProcess|jsonrpc/3::INFO::2020-06-23 21:53:59,833::api::220::root::(setupNetworks) Setting up network according to configuration: networks:{'DMZ0': {'vlan': '22', 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': 'true', 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'} MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,844::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,852::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,899::vsctl::74::root::(commit) Executing commands: /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list Interface MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,899::cmdutils::130::root::(exec_cmd) /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list Interface (cwd None) MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,908::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/3::INFO::2020-06-23 21:53:59,913::netconfpersistence::58::root::(setNetwork) Adding network ovirtmgmt({'bridged': True, 'stp': False, 'mtu': 1500, 'bonding': 'bond0', 'defaultRoute': True, 'bootproto': 'none', 'dhcpv6': True, 'ipv6autoconf': True, 'ipaddr': '172.17.96.51', 'netmask': '255.255.255.0', 'gateway': '172.17.96.1', 'switch': 'legacy', 'nameservers': ['x.x.x.x <scrubbed>', 'x.x.x.x <scrubbed>']}) MainProcess|jsonrpc/3::INFO::2020-06-23 21:53:59,914::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4', 'switch': 'legacy', 'hwaddr': 'bc:97:e1:24:c5:40'}) MainProcess|jsonrpc/3::INFO::2020-06-23 21:53:59,914::netconfpersistence::58::root::(setNetwork) Adding network DMZ0({'vlan': 22, 'bonding': 'bond0', 'ipv6autoconf': False, 'bridged': True, 'dhcpv6': False, 'mtu': 1500, 'switch': 'legacy', 'defaultRoute': False, 'stp': False, 'bootproto': 'none', 'nameservers': []}) MainProcess|jsonrpc/3::INFO::2020-06-23 21:53:59,914::netconfpersistence::69::root::(setBonding) Adding bond0({'nics': ['eno33np0', 'ens2f0np0'], 'options': 'mode=4', 'switch': 'legacy', 'hwaddr': 'bc:97:e1:24:c5:40'}) MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:53:59,916::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-63 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe (cwd None) MainProcess|jsonrpc/3::INFO::2020-06-23 21:54:00,271::hooks::122::root::(_runHooksDir) /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' MainProcess|jsonrpc/3::INFO::2020-06-23 21:54:00,271::configurator::190::root::(_setup_nmstate) Processing setup through nmstate MainProcess|jsonrpc/3::INFO::2020-06-23 21:54:00,297::configurator::192::root::(_setup_nmstate) Desired state: {'interfaces': [{'name': 'DMZ0', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, 'bridge': {'port': [{'name': 'bond0.22'}], 'options': {'stp': {'enabled': False}}}, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'bond0', 'type': 'bond', 'state': 'up', 'mac-address': 'bc:97:e1:24:c5:40', 'link-aggregation': {'slaves': ['eno33np0', 'ens2f0np0'], 'options': {}, 'mode': '802.3ad'}, 'mtu': 1500}, {'vlan': {'id': 22, 'base-iface': 'bond0'}, 'name': 'bond0.22', 'type': 'vlan', 'state': 'up', 'mtu': 1500, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'ovirtmgmt'}]} MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,351::checkpoint::121::root::(create) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/1 created for all devices: 60 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,351::netapplier::239::root::(_add_interfaces) Adding new interfaces: ['DMZ0', 'bond0.22'] MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,354::netapplier::251::root::(_edit_interfaces) Editing interfaces: ['eno33np0', 'ovirtmgmt', 'bond0', 'ens2f0np0'] MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,357::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,364::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=DMZ0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,364::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,370::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=bond0.22 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,370::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,374::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=bond0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,374::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,377::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=eno33np0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,377::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,379::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ens2f0np0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,379::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,382::connection::386::root::(_commit_changes_callback) Connection update succeeded: dev=ovirtmgmt MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,382::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,385::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=DMZ0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,423::connection::301::root::(_waitfor_active_connection_callback) Connection activation succeeded: dev=DMZ0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_IP_CONFIG of type NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_MASTER | NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_MASTER_HAS_SLAVES of type NM.ActivationStateFlags> MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,424::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,426::device::149::root::(_modify_callback) Device reapply succeeded: dev=ovirtmgmt MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,426::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,429::device::149::root::(_modify_callback) Device reapply succeeded: dev=bond0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,429::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,430::device::149::root::(_modify_callback) Device reapply succeeded: dev=ens2f0np0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,430::nmclient::136::root::(execute_next_action) Executing NM action: func=_safe_modify_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,431::device::149::root::(_modify_callback) Device reapply succeeded: dev=eno33np0 MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,431::nmclient::136::root::(execute_next_action) Executing NM action: func=safe_activate_async MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,432::connection::215::root::(_active_connection_callback) Connection activation initiated: dev=bond0.22, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState> MainProcess|jsonrpc/3::ERROR::2020-06-23 21:54:00,466::nmclient::200::root::(quit) NM main-loop aborted: Connection activation failed on bond0.22: reason=<enum NM_ACTIVE_CONNECTION_STATE_REASON_DEVICE_DISCONNECTED of type NM.ActiveConnectionStateReason> MainProcess|jsonrpc/3::DEBUG::2020-06-23 21:54:00,490::checkpoint::164::root::(rollback) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/1 rollback executed: dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/19'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/3'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/10'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/11'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/1'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/9'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/5'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/7'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/6'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/18'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/8'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/2'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/4'): dbus.UInt32(0)}, signature=dbus.Signature('su')) MainProcess|jsonrpc/3::ERROR::2020-06-23 21:54:05,497::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) Error in setupNetworks Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 95, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 241, in setupNetworks _setup_networks(networks, bondings, options, net_info) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 266, in _setup_networks networks, bondings, options, net_info, in_rollback File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 154, in setup _setup_nmstate(networks, bondings, options, in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 194, in _setup_nmstate nmstate.setup(desired_state, verify_change=not in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", line 63, in setup state_apply(desired_state, verify_change=verify_change) File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", line 40, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 96, in wrapped ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 73, in apply state.State(desired_state), verify_change, commit, rollback_timeout File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 163, in _apply_ifaces_state con_profiles=ifaces_add_configs + ifaces_edit_configs, File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 232, in _setup_providers mainloop.run(timeout=MAINLOOP_TIMEOUT) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 177, in run f"Unexpected failure of libnm when running the mainloop: {err}" libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when running the mainloop: run execution ``` Regards, Mark