More old failures. 00:55:39 ====================================================================== 00:55:39 FAIL: test_events_keys (network.netlink_test.NetlinkEventMonitorTests) 00:55:39 ---------------------------------------------------------------------- 00:55:39 Traceback (most recent call last): 00:55:39 File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py", line 97, in wrapper 00:55:39 return f(*args, **kwargs) 00:55:39 File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/network/netlink_test.py", line 172, in test_events_keys 00:55:39 for d in _caught]))) 00:55:39 AssertionError: Expected events have not been caught (in the right order). 00:55:39 Expected: 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ'} 00:55:39 {'event': 'new_addr', 'address': '192.0.2.1/24'} 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ'} 00:55:39 {'event': 'new_addr', 'family': 'inet6'} 00:55:39 {'event': 'del_addr', 'family': 'inet6'} 00:55:39 {'event': 'del_addr', 'address': '192.0.2.1/24'} 00:55:39 {'destination': '192.0.2.1', 'event': 'del_route'} 00:55:39 {'event': 'del_link', 'name': 'dummy_LNacJ'}. 00:55:39 Caught: 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ', 'address': 'e2:10:19:4f:95:81'} 00:55:39 {'event': 'new_addr', 'family': 'inet', 'address': '192.0.2.1/24'} 00:55:39 {'destination': '192.0.2.1', 'event': 'new_route', 'family': 'inet'} 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ', 'address': 'e2:10:19:4f:95:81'} 00:55:39 {'destination': '192.0.2.0/24', 'event': 'new_route', 'family': 'inet'} 00:55:39 {'destination': '192.0.2.0', 'event': 'new_route', 'family': 'inet'}. 00:55:39 -------------------- >> begin captured logging << -------------------- 00:55:39 2016-11-28 00:55:02,952 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-3 /sbin/ip link add name dummy_LNacJ type dummy (cwd None) (commands:69) 00:55:39 2016-11-28 00:55:03,103 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:93) 00:55:39 2016-11-28 00:55:03,117 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-3 /sbin/ip -4 addr add dev dummy_LNacJ 192.0.2.1/24 (cwd None) (commands:69) 00:55:39 2016-11-28 00:55:03,603 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:93) 00:55:39 2016-11-28 00:55:03,610 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-3 /sbin/ip link set dev dummy_LNacJ up (cwd None) (commands:69) 00:55:59 2016-11-28 00:55:03,906 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:93) 00:55:59 2016-11-28 00:55:03,929 DEBUG (MainThread) [root] /usr/bin/taskset --cpu-list 0-3 /sbin/ip link del dev dummy_LNacJ (cwd None) (commands:69) 00:55:59 2016-11-28 00:55:04,081 DEBUG (MainThread) [root] SUCCESS: <err> = ''; <rc> = 0 (commands:93) 00:55:59 --------------------- >> end captured logging << --------------------- On Mon, Nov 28, 2016 at 2:24 AM, Nir Soffer <nsoffer(a)redhat.com&gt; wrote: > HI all, > > This test is failing randomly for few long time. > > I think it is time to mark it as broken_on_ci. > > 23:44:53 ====================================================================== > 23:44:53 FAIL: test_ip_info (network.netinfo_test.TestNetinfo) > 23:44:53 ---------------------------------------------------------------------- > 23:44:53 Traceback (most recent call last): > 23:44:53 File > "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py", > line 97, in wrapper > 23:44:53 return f(*args, **kwargs) > 23:44:53 File > "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/network/netinfo_test.py", > line 384, in test_ip_info > 23:44:53 [IPV6_ADDR_CIDR])) > 23:44:53 AssertionError: Tuples differ: ('192.0.2.2', > '255.255.255.0',... != ('192.0.2.2', '255.255.255.0',... > 23:44:53 > 23:44:53 First differing element 2: > 23:44:53 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32'] > 23:44:53 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32', '192.0.2.3/24'] > 23:44:53 > 23:44:53 ('192.0.2.2', > 23:44:53 '255.255.255.0', > 23:44:53 - ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32'], > 23:44:53 + ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32', > '192.0.2.3/24'], > 23:44:53 ? > ++++++++++++++++ > 23:44:53 > 23:44:53 ['2607:f0d0:1002:51::4/64']) > 23:44:53 -------------------- >> begin captured logging << -------------------- > 23:44:53 2016-11-27 23:44:29,240 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name dummy_zjpxS > type dummy (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,263 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,265 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev dummy_zjpxS up > (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,294 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,299 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS > 192.0.2.2/24 (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,311 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,315 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS > 192.0.2.3/24 (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,329 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,331 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS > 198.51.100.9/24 (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,341 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,345 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip -6 addr add dev dummy_zjpxS > 2607:f0d0:1002:51::4/64 (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,356 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,358 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS > 198.51.100.11/32 (cwd None) (commands:69) > 23:44:53 2016-11-27 23:44:29,370 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 2016-11-27 23:44:29,379 DEBUG (MainThread) [root] > /usr/bin/taskset --cpu-list 0-1 /sbin/ip link del dev dummy_zjpxS (cwd > None) (commands:69) > 23:44:53 2016-11-27 23:44:29,401 DEBUG (MainThread) [root] SUCCESS: > <err> = ''; <rc> = 0 (commands:93) > 23:44:53 --------------------- >> end captured logging << ---------------------