10:51 a.m.
Here it is
cat /var/log/vdsm/supervdsm.log
MainProcess|mpathhealth::DEBUG::2020-11-06
09:49:53,528::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call
dmsetup_run_status with ('multipath',) {}
MainProcess|mpathhealth::DEBUG::2020-11-06
09:49:53,528::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-23
/usr/sbin/dmsetup status --target multipath (cwd None)
MainProcess|mpathhealth::DEBUG::2020-11-06
09:49:53,559::commands::98::common.commands::(run) SUCCESS: <err> = b'';
<rc> = 0
MainProcess|mpathhealth::DEBUG::2020-11-06
09:49:53,559::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) return
dmsetup_run_status with b'ST4000NM0033-9ZM170_Z1Z8JNPX: 0 7814037168 multipath 2 0 0 0
1 1 A 0 1 2 8:16 A 0 0 1 \n'
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:49:59,880::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks
with ({}, {'bond0': {'nics': ['eno1', 'enp9s0'],
'options': 'mode=4 miimon=100 xmit_hash_policy=2', 'switch':
'legacy'}}, {'connectivityTimeout': 120, 'commitOnSuccess': True,
'connectivityCheck': 'true'}) {}
MainProcess|jsonrpc/1::INFO::2020-11-06 09:49:59,880::api::220::root::(setupNetworks)
Setting up network according to configuration: networks:{}, bondings:{'bond0':
{'nics': ['eno1', 'enp9s0'], 'options': 'mode=4
miimon=100 xmit_hash_policy=2', 'switch': 'legacy'}},
options:{'connectivityTimeout': 120, 'commitOnSuccess': True,
'connectivityCheck': 'true'}
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,887::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,888::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,889::cmdutils::130::root::(exec_cmd)
/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,896::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,897::cmdutils::130::root::(exec_cmd)
/sbin/tc class show dev enp0s29u1u1 classid 0:1388 (cwd None)
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,902::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,955::vsctl::74::root::(commit) Executing
commands: /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list
Port -- list Interface
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,955::cmdutils::130::root::(exec_cmd)
/usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list
Interface (cwd None)
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:49:59,968::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/1::INFO::2020-11-06
09:49:59,976::netconfpersistence::58::root::(setNetwork) Adding network
ovirtmgmt({'bridged': True, 'stp': False, 'mtu': 1500,
'nic': 'enp0s29u1u1', 'defaultRoute': True, 'bootproto':
'none', 'dhcpv6': False, 'ipv6autoconf': False, 'ipaddr':
'IP-ADDR126', 'netmask': '255.255.255.0', 'gateway':
'IP-ADDR1', 'ipv6addr': '2001:470:df4e:2:fe4d:d4ff:fe3e:fb86/64',
'ipv6gateway': 'fe80::250:56ff:fe8b:6e21', 'switch':
'legacy', 'nameservers': ['IP-ADDR4']})
MainProcess|jsonrpc/1::INFO::2020-11-06
09:49:59,977::netconfpersistence::69::root::(setBonding) Adding bond0({'nics':
['eno1', 'enp9s0'], 'options': 'mode=4 miimon=100
xmit_hash_policy=2', 'switch': 'legacy'})
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:49:59,979::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-23
/usr/libexec/vdsm/hooks/before_network_setup/50_fcoe (cwd None)
MainProcess|jsonrpc/1::INFO::2020-11-06 09:50:00,355::hooks::122::root::(_runHooksDir)
/usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b''
MainProcess|jsonrpc/1::INFO::2020-11-06
09:50:00,356::configurator::195::root::(_setup_nmstate) Processing setup through nmstate
MainProcess|jsonrpc/1::INFO::2020-11-06
09:50:00,384::configurator::197::root::(_setup_nmstate) Desired state:
{'interfaces': [{'name': 'bond0', 'type': 'bond',
'state': 'up', 'link-aggregation': {'slaves':
['eno1', 'enp9s0'], 'options': {'miimon': '100',
'xmit_hash_policy': '2'}, 'mode': '802.3ad'}},
{'name': 'ovirtmgmt', 'mtu': 1500}]}
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:00,439::checkpoint::121::root::(create)
Checkpoint /org/freedesktop/NetworkManager/Checkpoint/40 created for all devices: 60
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,439::netapplier::239::root::(_add_interfaces) Adding new interfaces:
['bond0']
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,442::netapplier::251::root::(_edit_interfaces) Editing interfaces:
['ovirtmgmt', 'eno1', 'enp9s0']
MainProcess|jsonrpc/1::WARNING::2020-11-06 09:50:00,443::ipv6::188::root::(_set_static)
IPv6 link local address fe80::64c3:73ff:fe2f:10d7/64 is ignored when applying desired
state
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,446::nmclient::136::root::(execute_next_action) Executing NM action:
func=add_connection_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,459::connection::329::root::(_add_connection_callback) Connection adding
succeeded: dev=bond0
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,459::nmclient::136::root::(execute_next_action) Executing NM action:
func=_safe_delete_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,472::connection::355::root::(_delete_connection_callback) Connection deletion
succeeded: dev=eno1
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,472::nmclient::136::root::(execute_next_action) Executing NM action:
func=_safe_delete_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,476::connection::355::root::(_delete_connection_callback) Connection deletion
succeeded: dev=enp9s0
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,476::nmclient::136::root::(execute_next_action) Executing NM action:
func=add_connection_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,485::connection::329::root::(_add_connection_callback) Connection adding
succeeded: dev=eno1
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,485::nmclient::136::root::(execute_next_action) Executing NM action:
func=add_connection_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,491::connection::329::root::(_add_connection_callback) Connection adding
succeeded: dev=enp9s0
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,491::nmclient::136::root::(execute_next_action) Executing NM action:
func=commit_changes_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,498::connection::386::root::(_commit_changes_callback) Connection update
succeeded: dev=ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,499::nmclient::136::root::(execute_next_action) Executing NM action:
func=safe_activate_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,508::connection::215::root::(_active_connection_callback) Connection activation
initiated: dev=bond0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type
NM.ActiveConnectionState>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,548::connection::301::root::(_waitfor_active_connection_callback) Connection
activation succeeded: dev=bond0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING
of type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_IP_CONFIG of type
NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_MASTER |
NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_MASTER_HAS_SLAVES of type
NM.ActivationStateFlags>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,549::nmclient::136::root::(execute_next_action) Executing NM action:
func=_safe_modify_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,554::device::149::root::(_modify_callback) Device reapply succeeded:
dev=ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,554::nmclient::136::root::(execute_next_action) Executing NM action:
func=_safe_modify_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:00,559::device::143::root::(_modify_callback) Device reapply failed on enp9s0:
error=nm-device-error-quark: Can't reapply changes to
'connection.autoconnect-slaves' setting (3)
Fallback to device activation
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,116::connection::215::root::(_active_connection_callback) Connection activation
initiated: dev=enp9s0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type
NM.ActiveConnectionState>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,265::connection::301::root::(_waitfor_active_connection_callback) Connection
activation succeeded: dev=enp9s0, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATED
of type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_ACTIVATED of type
NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_SLAVE |
NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_IP4_READY |
NM_ACTIVATION_STATE_FLAG_IP6_READY of type NM.ActivationStateFlags>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,266::nmclient::136::root::(execute_next_action) Executing NM action:
func=_safe_modify_async
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,269::device::143::root::(_modify_callback) Device reapply failed on eno1:
error=nm-device-error-quark: Can't reapply changes to
'connection.autoconnect-slaves' setting (3)
Fallback to device activation
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,598::connection::215::root::(_active_connection_callback) Connection activation
initiated: dev=eno1, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATING of type
NM.ActiveConnectionState>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,946::connection::301::root::(_waitfor_active_connection_callback) Connection
activation succeeded: dev=eno1, con-state=<enum NM_ACTIVE_CONNECTION_STATE_ACTIVATED of
type NM.ActiveConnectionState>, dev-state=<enum NM_DEVICE_STATE_ACTIVATED of type
NM.DeviceState>, state-flags=<flags NM_ACTIVATION_STATE_FLAG_IS_SLAVE |
NM_ACTIVATION_STATE_FLAG_LAYER2_READY | NM_ACTIVATION_STATE_FLAG_IP4_READY |
NM_ACTIVATION_STATE_FLAG_IP6_READY of type NM.ActivationStateFlags>
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:01,946::nmclient::139::root::(execute_next_action) NM action queue exhausted,
quiting mainloop
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:01,985::checkpoint::156::root::(destroy)
Checkpoint /org/freedesktop/NetworkManager/Checkpoint/40 destroyed
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:01,991::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:01,997::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:01,998::cmdutils::130::root::(exec_cmd)
/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:02,004::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:02,004::cmdutils::130::root::(exec_cmd)
/sbin/tc class show dev enp0s29u1u1 classid 0:1388 (cwd None)
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:02,010::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/1::INFO::2020-11-06
09:50:02,075::netconfpersistence::69::root::(setBonding) Adding bond0({'nics':
['eno1', 'enp9s0'], 'options': 'mode=4 miimon=100
xmit_hash_policy=2', 'switch': 'legacy'})
MainProcess|jsonrpc/1::INFO::2020-11-06
09:50:02,075::netconfpersistence::238::root::(_clearDisk) Clearing netconf:
/var/lib/vdsm/staging/netconf
MainProcess|jsonrpc/1::INFO::2020-11-06
09:50:02,078::netconfpersistence::188::root::(save) Saved new config
RunningConfig({'ovirtmgmt': {'ipv6autoconf': False, 'nic':
'eno1', 'defaultRoute': True, 'ipv6gateway':
'fe80::250:56ff:fe8b:6e21', 'mtu': 1500, 'ipv6addr':
'2001:470:df4e:2:fe4d:d4ff:fe3e:fb86/64', 'switch': 'legacy',
'netmask': '255.255.255.0', 'bridged': True, 'ipaddr':
'IP-ADDR126', 'dhcpv6': False, 'gateway': 'IP-ADDR1',
'stp': False, 'bootproto': 'none', 'nameservers':
['IP-ADDR4']}}, {'bond0': {'nics': ['eno1',
'enp9s0'], 'options': 'mode=4 miimon=100 xmit_hash_policy=2',
'switch': 'legacy'}}, {}) to
[/var/lib/vdsm/staging/netconf/nets,/var/lib/vdsm/staging/netconf/bonds,/var/lib/vdsm/staging/netconf/devices]
MainProcess|jsonrpc/1::DEBUG::2020-11-06 09:50:02,078::connectivity::47::root::(check)
Checking connectivity...
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:03,081::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-23
/usr/libexec/vdsm/hooks/after_network_setup/30_ethtool_options (cwd None)
MainProcess|jsonrpc/1::INFO::2020-11-06 09:50:03,255::hooks::122::root::(_runHooksDir)
/usr/libexec/vdsm/hooks/after_network_setup/30_ethtool_options: rc=0 err=b''
MainProcess|jsonrpc/1::DEBUG::2020-11-06
09:50:03,255::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) return
setupNetworks with None
MainProcess|jsonrpc/3::DEBUG::2020-11-06
09:50:03,419::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call network_caps
with () {}
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,426::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,431::routes::115::root::(get_gateway)
The gateway IP-ADDR1 is duplicated for the device ovirtmgmt
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,432::cmdutils::130::root::(exec_cmd)
/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,439::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,440::cmdutils::130::root::(exec_cmd)
/sbin/tc class show dev enp0s29u1u1 classid 0:1388 (cwd None)
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,446::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,510::vsctl::74::root::(commit) Executing
commands: /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list
Port -- list Interface
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,510::cmdutils::130::root::(exec_cmd)
/usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list
Interface (cwd None)
MainProcess|jsonrpc/3::DEBUG::2020-11-06 09:50:03,522::cmdutils::138::root::(exec_cmd)
SUCCESS: <err> = b''; <rc> = 0
netlink/events::DEBUG::2020-11-06 09:50:03,529::concurrent::258::root::(run) START thread
<Thread(netlink/events, started daemon 140427791193856)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7fb7e4a12828>>, args=(), kwargs={})
MainProcess|mpathhealth::DEBUG::2020-11-06
09:50:03,560::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call
dmsetup_run_status with ('multipath',) {}
MainProcess|mpathhealth::DEBUG::2020-11-06
09:50:03,560::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-23
/usr/sbin/dmsetup status --target multipath (cwd None)
MainProcess|mpathhealth::DEBUG::2020-11-06
09:50:03,591::commands::98::common.commands::(run) SUCCESS: <err> = b'';
<rc> = 0
MainProcess|mpathhealth::DEBUG::2020-11-06
09:50:03,591::supervdsm_server::100::SuperVdsm.ServerCallback::(wrapper) return
dmsetup_run_status with b'ST4000NM0033-9ZM170_Z1Z8JNPX: 0 7814037168 multipath 2 0 0 0
1 1 A 0 1 2 8:16 A 0 0 1 \n'
netlink/events::DEBUG::2020-11-06 09:50:05,529::concurrent::261::root::(run) FINISH thread
<Thread(netlink/events, stopped daemon 140427791193856)>
MainProcess|jsonrpc/3::ERROR::2020-11-06
09:50:05,533::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) Error in
network_caps
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 95, in
wrapper
res = func(*args, **kwargs)
File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 59, in
network_caps
return netswitch.configurator.netcaps(compatibility=30600)
File
"/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line
505, in netcaps
_add_speed_device_info(net_caps)
File
"/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line
546, in _add_speed_device_info
devattr['speed'] = bond.speed(devname)
TypeError: 'module' object is not callable