On Sun, Jan 13, 2019 at 10:34 AM Edward Haas <edwardh(a)redhat.com> wrote:
Thank you Nir.
I added an assert message to this last one.
It should not happen at all, it is very strange.
https://gerrit.ovirt.org/#/c/96849/
Thanks,
Edy.
On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
> Another network test that did not fail for long time, failed again today.
>
> Build:
>
>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
> ======================================================================
> FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
> return f(*args, **kwargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
> return f(*args, **kwargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
> self.assertEqual(2, len(ip_addrs))
> AssertionError: 2 != 4
> -------------------- >> begin captured logging << --------------------
> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name dummy_PU7TA
type dummy (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_PU7TA
up (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_PU7TA
(cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
>
>
> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>
>> We had this failure a lot in the past and it seems to be resolve, but I
>> see it again today:
>>
>> ======================================================================
>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>> ----------------------------------------------------------------------
>> Traceback (most recent call last):
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>> return f(*args, **kwargs)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>> self._assert_has_no_address(nic, ip_b)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>> self._assert_address_not_in(address_with_prefixlen, addresses)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>> self.assertNotIn(address_with_prefixlen, addresses_list)
>> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>> -------------------- >> begin captured logging <<
--------------------
>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_NKzY1 up (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_NKzY1 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> --------------------- >> end captured logging <<
---------------------
>>
>> Build:
>>
>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>
>
Another failure:
======================================================================
FAIL: test_add_delete_ipv4 (network.ip_address_test.IPAddressTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 222, in test_add_delete_ipv4
self._test_add_delete(IPV4_A_WITH_PREFIXLEN, IPV4_B_WITH_PREFIXLEN)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
self._assert_has_no_address(nic, ip_b)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
self._assert_address_not_in(address_with_prefixlen, addresses)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
self.assertNotIn(address_with_prefixlen, addresses_list)
AssertionError: '192.168.98.1/29' unexpectedly found in
['192.168.99.1/29', '192.168.98.1/29',
'fe80::4839:65ff:feec:cc6c/64']
-------------------- >> begin captured logging << --------------------
2019-01-15 00:55:50,034 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_CAZe2 type dummy (cwd None) (cmdutils:133)
2019-01-15 00:55:50,046 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,051 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 140444667229952)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7fbbe11add10>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 00:55:50,054 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_CAZe2 up (cwd None) (cmdutils:133)
2019-01-15 00:55:50,074 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,079 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 140444667229952)>
(concurrent:196)
2019-01-15 00:55:50,081 DEBUG (MainThread) [root] /sbin/ip -4 addr add
dev dummy_CAZe2 192.168.99.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,091 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,094 DEBUG (MainThread) [root] /sbin/ip -4 addr add
dev dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,102 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,107 DEBUG (MainThread) [root] /sbin/ip -4 addr del
dev dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,119 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,125 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_CAZe2 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,152 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
Build
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...