1:36 p.m.
Hello all,
I'm facing a strange error. I was able to add a host to a linux bridge based cluster.
However if I try adding the host to a cluster with OVS switch it is failing. I can see
that nmstate was able to create the ovirtmgmt bridge as well. At that point of time both
the ovirtmgmt and the bond0.vlan interfaces have the ip assigned. It then fails and rolls
back the config. A workaround that I found to be working was to add the host to linux
bridge cluster first and then change the cluster to OVS cluster.
Here's a background about the setup. The host is an AMD EPYC with OEL 8.6 installed.
The OLVM manager is a standalone VM at 4.4.8. We have a bond0 and ip is assigned to
bond0.1222 interface. The interfaces are in a LACP bond on the switch as well. I enabled
debug in NetworkManager in the hope of finding some clues, but couldn't.
I know 4.4 is EOL. As this is a user mailing list, I thought I'll reach out in hope if
someone has seen any similar issue.
supervdsm log
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,336::plugin::172::root::(apply_changes)
Nispor: desired network state {'name': 'bond0', 'type':
'bond', 'state': 'up', 'mac-address':
'e4:3d:1a:82:9f:c0', 'link-aggregation': {'port':
['ens10f0np0', 'ens5f0np0'], 'options':
{'ad_actor_sys_prio': 65535, 'ad_actor_system':
'00:00:00:00:00:00', 'ad_select': 'stable',
'ad_user_port_key': 0, 'all_slaves_active': 'dropped',
'arp_all_targets': 'any', 'arp_interval': 0,
'arp_validate': 'none', 'downdelay': 0, 'lacp_rate':
'slow', 'miimon': 100, 'min_links': 0, 'updelay': 0,
'use_carrier': True, 'xmit_hash_policy': 'layer2',
'arp_ip_target': ''}, 'mode': '802.3ad'}, 'ipv4':
{'enabled': False}, 'ipv6': {'enabled': False}, 'mtu':
1500, 'lldp': {'enabled': False}, 'accept-all-mac-addresses':
False, '_brport_options': {'name': 'bond0'},
'_controller': 'vdsmbr_6SMdIi3B', '_controller_type':
'ovs-bridge'}
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,336::plugin::172::root::(apply_changes)
Nispor: desired network state {'name': 'ovirtmgmt', 'type':
'ovs-interface', 'state': 'up', 'mtu': 1500,
'ipv4': {'enabled': True, 'address': [{'ip':
'10.129.221.19', 'prefix-length': 24}], 'dhcp': False,
'_dns': {'server': ['10.150.5.100', '10.229.0.60'],
'search': [], '_priority': 0}, '_routes': [{'table-id':
329647082, 'destination': '0.0.0.0/0', 'next-hop-address':
'10.129.221.1', 'next-hop-interface': 'ovirtmgmt'},
{'table-id': 329647082, 'destination': '10.129.221.0/24',
'next-hop-address': '10.129.221.19', 'next-hop-interface':
'ovirtmgmt'}, {'table-id': 254, 'destination':
'0.0.0.0/0', 'next-hop-address': '10.129.221.1',
'next-hop-interface': 'ovirtmgmt'}], '_route_rules':
[{'ip-from': '', 'ip-to': '10.129.221.0/24',
'priority': 3200, 'route-table': 329647082}, {'ip-from':
'10.129.221.0/24', 'ip-to': '', 'priority': 3200,
'route-table': 329647082}]}, 'ipv6': {'enabled': False,
'_routes':
[], '_route_rules': []}, 'mac-address': 'E4:3D:1A:82:9F:C0',
'_brport_options': {'name': 'ovirtmgmt', 'vlan':
{'mode': 'access', 'tag': 1222}}, '_controller':
'vdsmbr_6SMdIi3B', '_controller_type': 'ovs-bridge'}
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,336::plugin::172::root::(apply_changes)
Nispor: desired network state {'name': 'vdsmbr_6SMdIi3B', 'state':
'up', 'type': 'ovs-bridge', 'bridge': {'port':
[{'name': 'bond0'}, {'name': 'ovirtmgmt', 'vlan':
{'mode': 'access', 'tag': 1222}}]}, 'ipv6':
{'enabled': False}}
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,340::context::148::root::(register_async) Async action: Update profile
uuid:d8c57758-f784-44f4-a33a-c050ec50b9b9 iface:bond0 type:bond started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,340::context::148::root::(register_async) Async action: Add profile:
623b6249-7cfa-4813-9ef6-4870ec6f3a79, iface:bond0, type:ovs-port started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,340::context::148::root::(register_async) Async action: Add profile:
ed8f5cae-5400-42fd-a72e-645e1fa61a39, iface:ovirtmgmt, type:ovs-interface started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,341::context::148::root::(register_async) Async action: Add profile:
3572b137-2091-4825-b418-4d6966430cc1, iface:ovirtmgmt, type:ovs-port started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,341::context::148::root::(register_async) Async action: Add profile:
bd45447d-f241-4d14-bf5b-28c3966c011d, iface:vdsmbr_6SMdIi3B, type:ovs-bridge started
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,343::context::157::root::(finish_async)
Async action: Update profile uuid:d8c57758-f784-44f4-a33a-c050ec50b9b9 iface:bond0
type:bond finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,349::context::157::root::(finish_async)
Async action: Add profile: 623b6249-7cfa-4813-9ef6-4870ec6f3a79, iface:bond0,
type:ovs-port finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,350::context::157::root::(finish_async)
Async action: Add profile: ed8f5cae-5400-42fd-a72e-645e1fa61a39, iface:ovirtmgmt,
type:ovs-interface finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,350::context::157::root::(finish_async)
Async action: Add profile: 3572b137-2091-4825-b418-4d6966430cc1, iface:ovirtmgmt,
type:ovs-port finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,350::context::157::root::(finish_async)
Async action: Add profile: bd45447d-f241-4d14-bf5b-28c3966c011d, iface:vdsmbr_6SMdIi3B,
type:ovs-bridge finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,350::context::148::root::(register_async) Async action: Activate profile
uuid:bd45447d-f241-4d14-bf5b-28c3966c011d iface:vdsmbr_6SMdIi3B type: ovs-bridge started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,352::active_connection::201::root::(_activate_profile_callback) Connection
activation initiated: iface=vdsmbr_6SMdIi3B type=ovs-bridge con-state=<enum
NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,355::active_connection::339::root::(_activation_progress_check) Connection
activation succeeded: iface=vdsmbr_6SMdIi3B, type=ovs-bridge, con_state=<enum
NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>,
dev_state=<enum NM_DEVICE_STATE_IP_CONFIG of type NM.DeviceState>,
state_flags=<flags NM_ACTIVATION_STATE_FLAG_IS_MASTER |
NM_ACTIVATION_STATE_FLAG_LAYER2_READY of type NM.ActivationStateFlags>
MainProcess|jsonrpc/3::DEBUG::2022-05-26 14:32:25,355::context::157::root::(finish_async)
Async action: Activate profile uuid:bd45447d-f241-4d14-bf5b-28c3966c011d
iface:vdsmbr_6SMdIi3B type: ovs-bridge finished
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,355::context::148::root::(register_async) Async action: Reapply device config:
bond0 bond d8c57758-f784-44f4-a33a-c050ec50b9b9 started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,358::device::83::root::(_reapply_callback) Device reapply failed on bond0 bond:
error=nm-device-error-quark: Can't reapply changes to
'802-3-ethernet.cloned-mac-address' setting (3), Fallback to device activation
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,358::context::148::root::(register_async) Async action: Activate profile
uuid:d8c57758-f784-44f4-a33a-c050ec50b9b9 iface:bond0 type: bond started
MainProcess|jsonrpc/3::DEBUG::2022-05-26
14:32:25,360::active_connection::201::root::(_activate_profile_callback) Connection
activation initiated: iface=bond0 type=bond con-state=<enum
NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type NM.ActiveConnectionState>
Regards,
Ravi