5:29 a.m.
Hi Strahil,
there is nothing wrong with the switch other than that I don't have any
control over it so the network setup is as it is. The issue is that vdsm
breaks the network setup because it's not flexible enough.
/Sverker
Den 2020-09-03 kl. 00:47, skrev Strahil Nikolov:
> What is you switch brand & model ?
> Maybe someone more experienced in networking can help.
>
>
> Best Regards,
> Strahil Nikolov
>
>
>
>
>
>
> В сряда, 2 септември 2020 г., 23:39:57 Гринуич+3, Sverker Abrahamsson via Users
<users(a)ovirt.org> написа:
>
>
>
>
>
> Well, unforturnatly I don't have a choise since it is out of my control.
> I only have one physical network port where the external traffic is
> untagged and the internal vlan is tagged. If I could run with OVN
> instead I wouldn't need that tagged vlan, but I haven't been able to get
> that to work neither.
>
> It's perfectly possible to have both tagged and untagged traffic on the
> same switch port, issue is that vdsm tries to take control over the
> network without being able to be flexible enough.. I'm attempting now to
> have ovirtmgmt bridge created before, that used to be possible but
> according to previous mails on the list it went broken somewhere at 4.x.
>
> /Sverker
>
> Den 2020-09-02 kl. 21:39, skrev Strahil Nikolov:
>> Switchports can either be tagged or untagged.
>> I'm not sure that your setup is supported at all.
>>
>> Best Regards,
>> Strahil Nikolov
>>
>>
>>
>>
>>
>>
>> В сряда, 2 септември 2020 г., 20:41:57 Гринуич+3, Sverker Abrahamsson via Users
<users(a)ovirt.org> написа:
>>
>>
>>
>>
>>
>> Pretty formatting the "desired state" it seems that vdsm tries to
remove
>> the ip of my underlying interface, that is enp4s0:
>>
>> {
>> 'interfaces': [{
>> 'name': 'enp4s0',
>> 'state': 'up',
>> 'mtu': 1500
>> }, {
>> 'vlan': {
>> 'id': 4000,
>> 'base-iface': 'enp4s0'
>> },
>> 'name': 'enp4s0.4000',
>> 'type': 'vlan',
>> 'state': 'up',
>> 'mtu': 1500,
>> 'ipv4': {
>> 'enabled': False
>> },
>> 'ipv6': {
>> 'enabled': False
>> }
>> }, {
>> 'name': 'ovirtmgmt',
>> 'type': 'linux-bridge',
>> 'state': 'up',
>> 'mtu': 1500,
>> 'bridge': {
>> 'port': [{
>> 'name': 'enp4s0.4000'
>> }
>> ],
>> 'options': {
>> 'stp': {
>> 'enabled': False
>> }
>> }
>> },
>> 'ipv4': {
>> 'enabled': True,
>> 'address': [{
>> 'ip': '172.27.1.1',
>> 'prefix-length': 24
>> }
>> ],
>> 'dhcp': False
>> },
>> 'ipv6': {
>> 'enabled': False
>> }
>> }
>> ],
>> 'dns-resolver': {
>> 'config'
>> : {
>> 'server': ['213.133.98.98']
>> }
>> }
>> }
>>
>>
>> This is my interfaces before vdsm attemtpts to change the config:
>>
>> enp4s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
>> inet 144.76.84.73 netmask 255.255.255.255 broadcast 0.0.0.0
>> inet6 fe80::62a4:4cff:fee9:4ac prefixlen 64 scopeid
0x20<link>
>> inet6 2a01:4f8:192:1148::2 prefixlen 64 scopeid 0x0<global>
>> ether 60:a4:4c:e9:04:ac txqueuelen 1000 (Ethernet)
>> RX packets 293442 bytes 385541799 (367.6 MiB)
>> RX errors 0 dropped 0 overruns 0 frame 0
>> TX packets 91095 bytes 31160348 (29.7 MiB)
>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
>> device interrupt 17 memory 0xf7d00000-f7d20000
>>
>> enp4s0.4000: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
>> inet 172.27.1.1 netmask 255.255.255.0 broadcast 172.27.1.255
>> inet6 fe80::62a4:4cff:fee9:4ac prefixlen 64 scopeid
0x20<link>
>> ether 60:a4:4c:e9:04:ac txqueuelen 1000 (Ethernet)
>> RX packets 0 bytes 0 (0.0 B)
>> RX errors 0 dropped 0 overruns 0 frame 0
>> TX packets 13 bytes 938 (938.0 B)
>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
>>
>> I.e. enp4s0 is the external interface that must not be changed, bridge
>> must be created on the vlan interface. I would prefer to create the
>> bridge manually and not through vdsm if that is possible.
>>
>> /Sverker
>>
>> Den 2020-09-02 kl. 19:14, skrev Sverker Abrahamsson via Users:
>>> Hi,
>>> I'm attempting to install hosted engine but getting this failure:
>>>
>>> [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false,
"msg":
>>> "The host has been set in non_operational status, deployment errors:
>>> code 505: Host h1-mgmt.limetransit.com installation failed. Failed to
>>> configure management network on the host., code 1120: Failed to
>>> configure management network on host h1-mgmt.limetransit.com due to
>>> setup networks failure., code 9000: Failed to verify Power Management
>>> configuration for Host h1-mgmt.limetransit.com., code 10802: VDSM
>>> h1-mgmt.limetransit.com command HostSetupNetworksVDS failed: Internal
>>> JSON-RPC error: {'reason': 'Unexpected failure of libnm when
running
>>> the mainloop: run execution'}, fix accordingly and re-deploy."}
>>>
>>> Looking in vdsm.log I find this which I believe is the root cause:
>>>
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,897::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper)
>>> call setupNetworks with ({'ovirtmgmt': {'vlan':
'4000', 'netmask':
>>> '255.255.255.0', 'ipv6autoconf': False,
>>> 'nic': 'enp4s0', 'bridged': 'true',
'ipaddr': '172.27.1.1',
>>> 'defaultRoute': True, 'dhcpv6': False, 'STP':
'no', 'mtu': 1500,
>>> 'switch': 'legacy'}}, {}, {'connectivityTimeout':
120,
>>> 'commitOnSuccess': True, 'connectivityCh
>>> eck': 'true'}) {}
>>> MainProcess|jsonrpc/0::INFO::2020-09-02
>>> 16:38:25,897::api::220::root::(setupNetworks) Setting up network
>>> according to configuration: networks:{'ovirtmgmt': {'vlan':
'4000',
>>> 'netmask': '255.255.255.0', 'ipv6autoconf': Fal
>>> se, 'nic': 'enp4s0', 'bridged': 'true',
'ipaddr': '172.27.1.1',
>>> 'defaultRoute': True, 'dhcpv6': False, 'STP':
'no', 'mtu': 1500,
>>> 'switch': 'legacy'}}, bondings:{},
options:{'connectivityTimeout':
>>> 120, 'commitOnSuccess':
>>> True, 'connectivityCheck': 'true'}
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,902::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd
>>> None)
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,906::cmdutils::138::root::(exec_cmd) SUCCESS: <err> =
b'';
>>> <rc> = 0
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,945::vsctl::74::root::(commit) Executing commands:
>>> /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge
>>> -- list Port -- list Interface
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,945::cmdutils::130::root::(exec_cmd) /usr/bin/ovs-vsctl
>>> --timeout=5 --oneline --format=json -- list Bridge -- list Port --
>>> list Interface (cwd None)
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,952::cmdutils::138::root::(exec_cmd) SUCCESS: <err> =
b'';
>>> <rc> = 0
>>> MainProcess|jsonrpc/0::INFO::2020-09-02
>>> 16:38:25,957::netconfpersistence::58::root::(setNetwork) Adding
>>> network ovirtmgmt({'vlan': 4000, 'netmask':
'255.255.255.0',
>>> 'ipv6autoconf': False, 'nic': 'enp4s0',
'bridged': True
>>> , 'ipaddr': '172.27.1.1', 'defaultRoute': True,
'dhcpv6': False,
>>> 'mtu': 1500, 'switch': 'legacy', 'stp':
False, 'bootproto': 'none',
>>> 'nameservers': ['213.133.98.98']})
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:25,958::commands::153::common.commands::(start) /usr/bin/taskset
>>> --cpu-list 0-7 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe
>>> (cwd None)
>>> MainProcess|jsonrpc/0::INFO::2020-09-02
>>> 16:38:26,154::hooks::122::root::(_runHooksDir)
>>> /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b''
>>> MainProcess|jsonrpc/0::INFO::2020-09-02
>>> 16:38:26,155::configurator::195::root::(_setup_nmstate) Processing
>>> setup through nmstate
>>> MainProcess|jsonrpc/0::INFO::2020-09-02
>>> 16:38:26,175::configurator::197::root::(_setup_nmstate) Desired state:
>>> {'interfaces': [{'name': 'enp4s0', 'state':
'up', 'mtu': 1500},
>>> {'vlan': {'id': 4000, 'base-iface':
'enp4s0'}
>>> , 'name': 'enp4s0.4000', 'type': 'vlan',
'state': 'up', 'mtu': 1500,
>>> 'ipv4': {'enabled': False}, 'ipv6':
{'enabled': False}}, {'name':
>>> 'ovirtmgmt', 'type': 'linux-bridge', 'state':
'up', 'mtu': 1500,
>>> 'bridge': {'port': [
>>> {'name': 'enp4s0.4000'}], 'options': {'stp':
{'enabled': False}}},
>>> 'ipv4': {'enabled': True, 'address': [{'ip':
'172.27.1.1',
>>> 'prefix-length': 24}], 'dhcp': False}, 'ipv6':
{'enabled': False}}],
>>> 'dns-resolver': {'config'
>>> : {'server': ['213.133.98.98']}}}
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,217::checkpoint::121::root::(create) Checkpoint
>>> /org/freedesktop/NetworkManager/Checkpoint/1 created for all devices: 60
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,218::netapplier::239::root::(_add_interfaces) Adding new
>>> interfaces: ['ovirtmgmt']
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,221::netapplier::251::root::(_edit_interfaces) Editing
>>> interfaces: ['enp4s0.4000', 'enp4s0']
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,224::nmclient::136::root::(execute_next_action) Executing NM
>>> action: func=add_connection_async
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,231::connection::329::root::(_add_connection_callback)
>>> Connection adding succeeded: dev=ovirtmgmt
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,232::nmclient::136::root::(execute_next_action) Executing NM
>>> action: func=commit_changes_async
>>> MainProcess|jsonrpc/0::ERROR::2020-09-02
>>> 16:38:26,233::nmclient::200::root::(quit) NM main-loop aborted:
>>> Connection update failed: error=nm-connection-error-quark:
>>> ipv6.gateway: gateway cannot be set if there are no addresses
>>> configured (7), dev=enp4s0/<enum NM_DEVICE_STATE_ACTIVATED of type
>>> NM.DeviceState>
>>> MainProcess|jsonrpc/0::DEBUG::2020-09-02
>>> 16:38:26,246::checkpoint::164::root::(rollback) Checkpoint
>>> /org/freedesktop/NetworkManager/Checkpoint/1 rollback executed:
>>>
dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/6'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/7'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/8'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/9'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/3'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/2'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/4'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/1'):
>>> dbus.UInt32(0),
>>> dbus.String('/org/freedesktop/NetworkManager/Devices/5'):
>>> dbus.UInt32(0)}, signature=dbus.Signature('su'))
>>> MainProcess|jsonrpc/0::ERROR::2020-09-02
>>> 16:38:31,251::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper)
>>> Error in setupNetworks
>>> Traceback (most recent call last):
>>> File
"/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py",
>>> line 95, in wrapper
>>> res = func(*args, **kwargs)
>>> File "/usr/lib/python3.6/site-packages/vdsm/network/api.py",
line
>>> 241, in setupNetworks
>>> _setup_networks(networks, bondings, options, net_info)
>>> File "/usr/lib/python3.6/site-packages/vdsm/network/api.py",
line
>>> 266, in _setup_networks
>>> networks, bondings, options, net_info, in_rollback
>>> File
>>>
"/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py",
>>> line 154, in setup
>>> _setup_nmstate(networks, bondings, options, in_rollback)
>>> File
>>>
"/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py",
>>> line 199, in _setup_nmstate
>>> nmstate.setup(desired_state, verify_change=not in_rollback)
>>> File
"/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py",
>>> line 63, in setup
>>> state_apply(desired_state, verify_change=verify_change)
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/deprecation.py",
>>> line 40, in wrapper
>>> return func(*args, **kwargs)
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py",
>>> line 96, in wrapped
>>> ret = func(*args, **kwargs)
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/netapplier.py",
>>> line 73, in apply
>>> state.State(desired_state), verify_change, commit, rollback_timeout
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/netapplier.py",
>>> line 163, in _apply_ifaces_state
>>> con_profiles=ifaces_add_configs + ifaces_edit_configs,
>>> File "/usr/lib64/python3.6/contextlib.py", line 88, in
__exit__
>>> next(self.gen)
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/netapplier.py",
>>> line 232, in _setup_providers
>>> mainloop.run(timeout=MAINLOOP_TIMEOUT)
>>> File
"/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py",
>>> line 177, in run
>>> f"Unexpected failure of libnm when running the mainloop:
{err}"
>>> libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when
>>> running the mainloop: run execution
>>>
>>> My host have a main network interface and a vlan interface on the same
>>> physical interface which is an internal management network which
>>> should be used as management network. The vlan interface doesn't have
>>> any ipv6 interface, but nmclient fails on setting ipv6 gateway. This
>>> seems like a bug?
>>>
>>> /Sverker
>>>
>>> _______________________________________________
>>> discuss mailing list
>>> discuss(a)openvswitch.org
>>> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
>>> _______________________________________________
>>> Users mailing list -- users(a)ovirt.org
>>> To unsubscribe send an email to users-leave(a)ovirt.org
>>> Privacy Statement: https://www.ovirt.org/privacy-policy.html
>>> oVirt Code of Conduct:
>>> https://www.ovirt.org/community/about/community-guidelines/
>>> List Archives:
>>>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/R4YSTOQM7I4...
>> _______________________________________________
>> Users mailing list -- users(a)ovirt.org
>> To unsubscribe send an email to users-leave(a)ovirt.org
>> Privacy Statement: https://www.ovirt.org/privacy-policy.html
>> oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/UMXFPVLJHYO...
>>
> _______________________________________________
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/RQIPLZGVOHX...
>