[ovirt-devel] [VDSM] Old network flaky test

Nir Soffer nsoffer at redhat.com
Mon Nov 28 01:04:53 UTC 2016


Another instance of the extra ip...

00:56:23 ======================================================================
00:56:23 FAIL: test_ip_info (network.netinfo_test.TestNetinfo)
00:56:23 ----------------------------------------------------------------------
00:56:23 Traceback (most recent call last):
00:56:23   File
"/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py",
line 97, in wrapper
00:56:23     return f(*args, **kwargs)
00:56:23   File
"/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/network/netinfo_test.py",
line 384, in test_ip_info
00:56:23     [IPV6_ADDR_CIDR]))
00:56:23 AssertionError: Tuples differ: ('192.0.2.2',
'255.255.255.0',... != ('192.0.2.2', '255.255.255.0',...
00:56:23
00:56:23 First differing element 2:
00:56:23 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32']
00:56:23 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32', '192.0.2.3/24']
00:56:23
00:56:23   ('192.0.2.2',
00:56:23    '255.255.255.0',
00:56:23 -  ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32'],
00:56:23 +  ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32',
'192.0.2.3/24'],
00:56:23 ?
++++++++++++++++
00:56:23
00:56:23    ['2607:f0d0:1002:51::4/64'])
00:56:23 -------------------- >> begin captured logging << --------------------
00:56:23 2016-11-28 00:56:01,986 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name dummy_YIm59
type dummy (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,002 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,005 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev dummy_YIm59 up
(cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,021 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,026 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_YIm59
192.0.2.2/24 (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,046 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,051 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_YIm59
192.0.2.3/24 (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,067 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,071 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_YIm59
198.51.100.9/24 (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,087 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,090 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip -6 addr add dev dummy_YIm59
2607:f0d0:1002:51::4/64 (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,104 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,107 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_YIm59
198.51.100.11/32 (cwd None) (commands:69)
00:56:23 2016-11-28 00:56:02,127 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 2016-11-28 00:56:02,135 DEBUG (MainThread) [root]
/usr/bin/taskset --cpu-list 0-1 /sbin/ip link del dev dummy_YIm59 (cwd
None) (commands:69)
00:56:23 2016-11-28 00:56:02,162 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (commands:93)
00:56:23 --------------------- >> end captured logging << ---------------------


On Mon, Nov 28, 2016 at 3:03 AM, Nir Soffer <nsoffer at redhat.com> wrote:
> More old failures.
>
> 00:55:39 ======================================================================
> 00:55:39 FAIL: test_events_keys (network.netlink_test.NetlinkEventMonitorTests)
> 00:55:39 ----------------------------------------------------------------------
> 00:55:39 Traceback (most recent call last):
> 00:55:39   File
> "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py",
> line 97, in wrapper
> 00:55:39     return f(*args, **kwargs)
> 00:55:39   File
> "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/network/netlink_test.py",
> line 172, in test_events_keys
> 00:55:39     for d in _caught])))
> 00:55:39 AssertionError: Expected events have not been caught (in the
> right order).
> 00:55:39 Expected:
> 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ'}
> 00:55:39 {'event': 'new_addr', 'address': '192.0.2.1/24'}
> 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ'}
> 00:55:39 {'event': 'new_addr', 'family': 'inet6'}
> 00:55:39 {'event': 'del_addr', 'family': 'inet6'}
> 00:55:39 {'event': 'del_addr', 'address': '192.0.2.1/24'}
> 00:55:39 {'destination': '192.0.2.1', 'event': 'del_route'}
> 00:55:39 {'event': 'del_link', 'name': 'dummy_LNacJ'}.
> 00:55:39 Caught:
> 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ', 'address':
> 'e2:10:19:4f:95:81'}
> 00:55:39 {'event': 'new_addr', 'family': 'inet', 'address': '192.0.2.1/24'}
> 00:55:39 {'destination': '192.0.2.1', 'event': 'new_route', 'family': 'inet'}
> 00:55:39 {'event': 'new_link', 'name': 'dummy_LNacJ', 'address':
> 'e2:10:19:4f:95:81'}
> 00:55:39 {'destination': '192.0.2.0/24', 'event': 'new_route', 'family': 'inet'}
> 00:55:39 {'destination': '192.0.2.0', 'event': 'new_route', 'family': 'inet'}.
> 00:55:39 -------------------- >> begin captured logging << --------------------
> 00:55:39 2016-11-28 00:55:02,952 DEBUG (MainThread) [root]
> /usr/bin/taskset --cpu-list 0-3 /sbin/ip link add name dummy_LNacJ
> type dummy (cwd None) (commands:69)
> 00:55:39 2016-11-28 00:55:03,103 DEBUG (MainThread) [root] SUCCESS:
> <err> = ''; <rc> = 0 (commands:93)
> 00:55:39 2016-11-28 00:55:03,117 DEBUG (MainThread) [root]
> /usr/bin/taskset --cpu-list 0-3 /sbin/ip -4 addr add dev dummy_LNacJ
> 192.0.2.1/24 (cwd None) (commands:69)
> 00:55:39 2016-11-28 00:55:03,603 DEBUG (MainThread) [root] SUCCESS:
> <err> = ''; <rc> = 0 (commands:93)
> 00:55:39 2016-11-28 00:55:03,610 DEBUG (MainThread) [root]
> /usr/bin/taskset --cpu-list 0-3 /sbin/ip link set dev dummy_LNacJ up
> (cwd None) (commands:69)
> 00:55:59 2016-11-28 00:55:03,906 DEBUG (MainThread) [root] SUCCESS:
> <err> = ''; <rc> = 0 (commands:93)
> 00:55:59 2016-11-28 00:55:03,929 DEBUG (MainThread) [root]
> /usr/bin/taskset --cpu-list 0-3 /sbin/ip link del dev dummy_LNacJ (cwd
> None) (commands:69)
> 00:55:59 2016-11-28 00:55:04,081 DEBUG (MainThread) [root] SUCCESS:
> <err> = ''; <rc> = 0 (commands:93)
> 00:55:59 --------------------- >> end captured logging << ---------------------
>
> On Mon, Nov 28, 2016 at 2:24 AM, Nir Soffer <nsoffer at redhat.com> wrote:
>> HI all,
>>
>> This test is failing randomly for few long time.
>>
>> I think it is time to mark it as broken_on_ci.
>>
>> 23:44:53 ======================================================================
>> 23:44:53 FAIL: test_ip_info (network.netinfo_test.TestNetinfo)
>> 23:44:53 ----------------------------------------------------------------------
>> 23:44:53 Traceback (most recent call last):
>> 23:44:53   File
>> "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py",
>> line 97, in wrapper
>> 23:44:53     return f(*args, **kwargs)
>> 23:44:53   File
>> "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/network/netinfo_test.py",
>> line 384, in test_ip_info
>> 23:44:53     [IPV6_ADDR_CIDR]))
>> 23:44:53 AssertionError: Tuples differ: ('192.0.2.2',
>> '255.255.255.0',... != ('192.0.2.2', '255.255.255.0',...
>> 23:44:53
>> 23:44:53 First differing element 2:
>> 23:44:53 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32']
>> 23:44:53 ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32', '192.0.2.3/24']
>> 23:44:53
>> 23:44:53   ('192.0.2.2',
>> 23:44:53    '255.255.255.0',
>> 23:44:53 -  ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32'],
>> 23:44:53 +  ['192.0.2.2/24', '198.51.100.9/24', '198.51.100.11/32',
>> '192.0.2.3/24'],
>> 23:44:53 ?
>> ++++++++++++++++
>> 23:44:53
>> 23:44:53    ['2607:f0d0:1002:51::4/64'])
>> 23:44:53 -------------------- >> begin captured logging << --------------------
>> 23:44:53 2016-11-27 23:44:29,240 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name dummy_zjpxS
>> type dummy (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,263 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,265 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev dummy_zjpxS up
>> (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,294 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,299 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS
>> 192.0.2.2/24 (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,311 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,315 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS
>> 192.0.2.3/24 (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,329 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,331 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS
>> 198.51.100.9/24 (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,341 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,345 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip -6 addr add dev dummy_zjpxS
>> 2607:f0d0:1002:51::4/64 (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,356 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,358 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_zjpxS
>> 198.51.100.11/32 (cwd None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,370 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 2016-11-27 23:44:29,379 DEBUG (MainThread) [root]
>> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link del dev dummy_zjpxS (cwd
>> None) (commands:69)
>> 23:44:53 2016-11-27 23:44:29,401 DEBUG (MainThread) [root] SUCCESS:
>> <err> = ''; <rc> = 0 (commands:93)
>> 23:44:53 --------------------- >> end captured logging << ---------------------



More information about the Devel mailing list