[ovirt-users] Re: Hosted engine install failure: ipv6.gateway: gateway cannot be set if there are no addresses configured

Pretty formatting the "desired state" it seems that vdsm tries to remove the ip of my underlying interface, that is enp4s0: {     'interfaces': [{             'name': 'enp4s0',             'state': 'up',             'mtu': 1500         }, {             'vlan': {                 'id': 4000,                 'base-iface': 'enp4s0'             },             'name': 'enp4s0.4000',             'type': 'vlan',             'state': 'up',             'mtu': 1500,             'ipv4': {                 'enabled': False             },             'ipv6': {                 'enabled': False             }         }, {             'name': 'ovirtmgmt',             'type': 'linux-bridge',             'state': 'up',             'mtu': 1500,             'bridge': {                 'port': [{                         'name': 'enp4s0.4000'                     }                 ],                 'options': {                     'stp': {                         'enabled': False                     }                 }             },             'ipv4': {                 'enabled': True,                 'address': [{                         'ip': '172.27.1.1',                         'prefix-length': 24                     }                 ],                 'dhcp': False             },             'ipv6': {                 'enabled': False             }         }     ],     'dns-resolver': {         'config'         : {             'server': ['213.133.98.98']         }     } } This is my interfaces before vdsm attemtpts to change the config: enp4s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500         inet 144.76.84.73  netmask 255.255.255.255  broadcast 0.0.0.0         inet6 fe80::62a4:4cff:fee9:4ac  prefixlen 64  scopeid 0x20<link>         inet6 2a01:4f8:192:1148::2  prefixlen 64  scopeid 0x0<global>         ether 60:a4:4c:e9:04:ac  txqueuelen 1000  (Ethernet)         RX packets 293442  bytes 385541799 (367.6 MiB)         RX errors 0  dropped 0  overruns 0  frame 0         TX packets 91095  bytes 31160348 (29.7 MiB)         TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0         device interrupt 17  memory 0xf7d00000-f7d20000 enp4s0.4000: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500         inet 172.27.1.1  netmask 255.255.255.0  broadcast 172.27.1.255         inet6 fe80::62a4:4cff:fee9:4ac  prefixlen 64  scopeid 0x20<link>         ether 60:a4:4c:e9:04:ac  txqueuelen 1000  (Ethernet)         RX packets 0  bytes 0 (0.0 B)         RX errors 0  dropped 0  overruns 0  frame 0         TX packets 13  bytes 938 (938.0 B)         TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0 I.e. enp4s0 is the external interface that must not be changed, bridge must be created on the vlan interface. I would prefer to create the bridge manually and not through vdsm if that is possible. /Sverker Den 2020-09-02 kl. 19:14, skrev Sverker Abrahamsson via Users: > Hi, > I'm attempting to install hosted engine but getting this failure: > > [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": > "The host has been set in non_operational status, deployment errors:   > code 505: Host h1-mgmt.limetransit.com installation failed. Failed to > configure management network on the host.,    code 1120: Failed to > configure management network on host h1-mgmt.limetransit.com due to > setup networks failure., code 9000: Failed to verify Power Management > configuration for Host h1-mgmt.limetransit.com.,    code 10802: VDSM > h1-mgmt.limetransit.com command HostSetupNetworksVDS failed: Internal > JSON-RPC error: {'reason': 'Unexpected failure of libnm when running > the mainloop: run execution'},   fix accordingly and re-deploy."} > > Looking in vdsm.log I find this which I believe is the root cause: > > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,897::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) > call setupNetworks with ({'ovirtmgmt': {'vlan': '4000', 'netmask': > '255.255.255.0', 'ipv6autoconf': False, > 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', > 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, > 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, > 'commitOnSuccess': True, 'connectivityCh > eck': 'true'}) {} > MainProcess|jsonrpc/0::INFO::2020-09-02 > 16:38:25,897::api::220::root::(setupNetworks) Setting up network > according to configuration: networks:{'ovirtmgmt': {'vlan': '4000', > 'netmask': '255.255.255.0', 'ipv6autoconf': Fal > se, 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', > 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, > 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': > 120, 'commitOnSuccess': > True, 'connectivityCheck': 'true'} > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,902::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd > None) > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,906::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; > <rc> = 0 > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,945::vsctl::74::root::(commit) Executing commands: > /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge > -- list Port -- list Interface > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,945::cmdutils::130::root::(exec_cmd) /usr/bin/ovs-vsctl > --timeout=5 --oneline --format=json -- list Bridge -- list Port -- > list Interface (cwd None) > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,952::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; > <rc> = 0 > MainProcess|jsonrpc/0::INFO::2020-09-02 > 16:38:25,957::netconfpersistence::58::root::(setNetwork) Adding > network ovirtmgmt({'vlan': 4000, 'netmask': '255.255.255.0', > 'ipv6autoconf': False, 'nic': 'enp4s0', 'bridged': True > , 'ipaddr': '172.27.1.1', 'defaultRoute': True, 'dhcpv6': False, > 'mtu': 1500, 'switch': 'legacy', 'stp': False, 'bootproto': 'none', > 'nameservers': ['213.133.98.98']}) > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:25,958::commands::153::common.commands::(start) /usr/bin/taskset > --cpu-list 0-7 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe > (cwd None) > MainProcess|jsonrpc/0::INFO::2020-09-02 > 16:38:26,154::hooks::122::root::(_runHooksDir) > /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' > MainProcess|jsonrpc/0::INFO::2020-09-02 > 16:38:26,155::configurator::195::root::(_setup_nmstate) Processing > setup through nmstate > MainProcess|jsonrpc/0::INFO::2020-09-02 > 16:38:26,175::configurator::197::root::(_setup_nmstate) Desired state: > {'interfaces': [{'name': 'enp4s0', 'state': 'up', 'mtu': 1500}, > {'vlan': {'id': 4000, 'base-iface': 'enp4s0'} > , 'name': 'enp4s0.4000', 'type': 'vlan', 'state': 'up', 'mtu': 1500, > 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': > 'ovirtmgmt', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, > 'bridge': {'port': [ > {'name': 'enp4s0.4000'}], 'options': {'stp': {'enabled': False}}}, > 'ipv4': {'enabled': True, 'address': [{'ip': '172.27.1.1', > 'prefix-length': 24}], 'dhcp': False}, 'ipv6': {'enabled': False}}], > 'dns-resolver': {'config' > : {'server': ['213.133.98.98']}}} > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,217::checkpoint::121::root::(create) Checkpoint > /org/freedesktop/NetworkManager/Checkpoint/1 created for all devices: 60 > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,218::netapplier::239::root::(_add_interfaces) Adding new > interfaces: ['ovirtmgmt'] > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,221::netapplier::251::root::(_edit_interfaces) Editing > interfaces: ['enp4s0.4000', 'enp4s0'] > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,224::nmclient::136::root::(execute_next_action) Executing NM > action: func=add_connection_async > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,231::connection::329::root::(_add_connection_callback) > Connection adding succeeded: dev=ovirtmgmt > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,232::nmclient::136::root::(execute_next_action) Executing NM > action: func=commit_changes_async > MainProcess|jsonrpc/0::ERROR::2020-09-02 > 16:38:26,233::nmclient::200::root::(quit) NM main-loop aborted: > Connection update failed: error=nm-connection-error-quark: > ipv6.gateway: gateway cannot be set if there are no addresses > configured (7), dev=enp4s0/<enum NM_DEVICE_STATE_ACTIVATED of type > NM.DeviceState> > MainProcess|jsonrpc/0::DEBUG::2020-09-02 > 16:38:26,246::checkpoint::164::root::(rollback) Checkpoint > /org/freedesktop/NetworkManager/Checkpoint/1 rollback executed: > dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/6'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/7'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/8'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/9'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/3'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/2'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/4'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/1'): > dbus.UInt32(0), > dbus.String('/org/freedesktop/NetworkManager/Devices/5'): > dbus.UInt32(0)}, signature=dbus.Signature('su')) > MainProcess|jsonrpc/0::ERROR::2020-09-02 > 16:38:31,251::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) > Error in setupNetworks > Traceback (most recent call last): >   File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", > line 95, in wrapper >     res = func(*args, **kwargs) >   File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line > 241, in setupNetworks >     _setup_networks(networks, bondings, options, net_info) >   File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line > 266, in _setup_networks >     networks, bondings, options, net_info, in_rollback >   File > "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", > line 154, in setup >     _setup_nmstate(networks, bondings, options, in_rollback) >   File > "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", > line 199, in _setup_nmstate >     nmstate.setup(desired_state, verify_change=not in_rollback) >   File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", > line 63, in setup >     state_apply(desired_state, verify_change=verify_change) >   File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", > line 40, in wrapper >     return func(*args, **kwargs) >   File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", > line 96, in wrapped >     ret = func(*args, **kwargs) >   File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", > line 73, in apply >     state.State(desired_state), verify_change, commit, rollback_timeout >   File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", > line 163, in _apply_ifaces_state >     con_profiles=ifaces_add_configs + ifaces_edit_configs, >   File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ >     next(self.gen) >   File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", > line 232, in _setup_providers >     mainloop.run(timeout=MAINLOOP_TIMEOUT) >   File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", > line 177, in run >     f"Unexpected failure of libnm when running the mainloop: {err}" > libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when > running the mainloop: run execution > > My host have a main network interface and a vlan interface on the same > physical interface which is an internal management network which > should be used as management network. The vlan interface doesn't have > any ipv6 interface, but nmclient fails on setting ipv6 gateway. This > seems like a bug? > > /Sverker > > _______________________________________________ > discuss mailing list > discuss(a)openvswitch.org > https://mail.openvswitch.org/mailman/listinfo/ovs-discuss > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/R4YSTOQM7I4...