9:30 a.m.
We had this failure a lot in the past and it seems to be resolve, but I see
it again today:
======================================================================
FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
self._assert_has_no_address(nic, ip_b)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
self._assert_address_not_in(address_with_prefixlen, addresses)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
self.assertNotIn(address_with_prefixlen, addresses_list)
AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
-------------------- >> begin captured logging << --------------------
2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_NKzY1 up (cwd None) (cmdutils:133)
2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)>
(concurrent:196)
2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del
dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_NKzY1 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
11:21 p.m.
Another network test that did not fail for long time, failed again today.
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
======================================================================
FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
self.assertEqual(2, len(ip_addrs))
AssertionError: 2 != 4
-------------------- >> begin captured logging << --------------------
2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_PU7TA type dummy (cwd None) (cmdutils:133)
2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_PU7TA up (cwd None) (cmdutils:133)
2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)>
(concurrent:196)
2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_PU7TA (cwd None) (cmdutils:133)
2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
We had this failure a lot in the past and it seems to be resolve, but
I
see it again today:
======================================================================
FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
self._assert_has_no_address(nic, ip_b)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
self._assert_address_not_in(address_with_prefixlen, addresses)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
self.assertNotIn(address_with_prefixlen, addresses_list)
AssertionError: '2002:99::1/64' unexpectedly found in ['2002:99::1/64',
'2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
-------------------- >> begin captured logging << --------------------
2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name dummy_NKzY1 type
dummy (cwd None) (cmdutils:133)
2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_NKzY1 up
(cwd None) (cmdutils:133)
2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev dummy_NKzY1
2001:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev dummy_NKzY1
2002:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev dummy_NKzY1
2002:99::1/64 (cwd None) (cmdutils:133)
2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_NKzY1 (cwd
None) (cmdutils:133)
2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
12:33 a.m.
Thank you Nir.
I added an assert message to this last one.
It should not happen at all, it is very strange.
https://gerrit.ovirt.org/#/c/96849/
Thanks,
Edy.
On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
Another network test that did not fail for long time, failed again
today.
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
======================================================================
FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
return f(*args, **kwargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
self.assertEqual(2, len(ip_addrs))
AssertionError: 2 != 4
-------------------- >> begin captured logging << --------------------
2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name dummy_PU7TA type
dummy (cwd None) (cmdutils:133)
2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_PU7TA up
(cwd None) (cmdutils:133)
2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev dummy_PU7TA
2001::88/64 (cwd None) (cmdutils:133)
2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_PU7TA (cwd
None) (cmdutils:133)
2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
> We had this failure a lot in the past and it seems to be resolve, but I
> see it again today:
>
> ======================================================================
> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
> return f(*args, **kwargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
> self._assert_has_no_address(nic, ip_b)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
> self._assert_address_not_in(address_with_prefixlen, addresses)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
> self.assertNotIn(address_with_prefixlen, addresses_list)
> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
> -------------------- >> begin captured logging << --------------------
> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name dummy_NKzY1
type dummy (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_NKzY1
up (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_NKzY1
(cwd None) (cmdutils:133)
> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
> Build:
>
>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
2:56 a.m.
On Sun, Jan 13, 2019 at 10:34 AM Edward Haas <edwardh(a)redhat.com> wrote:
Thank you Nir.
I added an assert message to this last one.
It should not happen at all, it is very strange.
https://gerrit.ovirt.org/#/c/96849/
Thanks,
Edy.
On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
> Another network test that did not fail for long time, failed again today.
>
> Build:
>
>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
> ======================================================================
> FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
> return f(*args, **kwargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
> return f(*args, **kwargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
> self.assertEqual(2, len(ip_addrs))
> AssertionError: 2 != 4
> -------------------- >> begin captured logging << --------------------
> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name dummy_PU7TA
type dummy (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_PU7TA
up (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_PU7TA
(cwd None) (cmdutils:133)
> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
>
>
> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>
>> We had this failure a lot in the past and it seems to be resolve, but I
>> see it again today:
>>
>> ======================================================================
>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>> ----------------------------------------------------------------------
>> Traceback (most recent call last):
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>> return f(*args, **kwargs)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>> self._assert_has_no_address(nic, ip_b)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>> self._assert_address_not_in(address_with_prefixlen, addresses)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>> self.assertNotIn(address_with_prefixlen, addresses_list)
>> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>> -------------------- >> begin captured logging <<
--------------------
>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_NKzY1 up (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_NKzY1 (cwd None) (cmdutils:133)
>> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> --------------------- >> end captured logging <<
---------------------
>>
>> Build:
>>
>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>
>
Another failure:
======================================================================
FAIL: test_add_delete_ipv4 (network.ip_address_test.IPAddressTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 222, in test_add_delete_ipv4
self._test_add_delete(IPV4_A_WITH_PREFIXLEN, IPV4_B_WITH_PREFIXLEN)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
self._assert_has_no_address(nic, ip_b)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
self._assert_address_not_in(address_with_prefixlen, addresses)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
self.assertNotIn(address_with_prefixlen, addresses_list)
AssertionError: '192.168.98.1/29' unexpectedly found in
['192.168.99.1/29', '192.168.98.1/29',
'fe80::4839:65ff:feec:cc6c/64']
-------------------- >> begin captured logging << --------------------
2019-01-15 00:55:50,034 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_CAZe2 type dummy (cwd None) (cmdutils:133)
2019-01-15 00:55:50,046 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,051 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 140444667229952)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7fbbe11add10>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 00:55:50,054 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_CAZe2 up (cwd None) (cmdutils:133)
2019-01-15 00:55:50,074 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,079 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 140444667229952)>
(concurrent:196)
2019-01-15 00:55:50,081 DEBUG (MainThread) [root] /sbin/ip -4 addr add
dev dummy_CAZe2 192.168.99.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,091 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,094 DEBUG (MainThread) [root] /sbin/ip -4 addr add
dev dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,102 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,107 DEBUG (MainThread) [root] /sbin/ip -4 addr del
dev dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,119 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,125 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_CAZe2 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,152 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
Build
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
10:41 a.m.
On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Sun, Jan 13, 2019 at 10:34 AM Edward Haas
<edwardh(a)redhat.com> wrote:
>
> Thank you Nir.
> I added an assert message to this last one.
> It should not happen at all, it is very strange.
>
> https://gerrit.ovirt.org/#/c/96849/
>
> Thanks,
> Edy.
>
> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
>
>> Another network test that did not fail for long time, failed again today.
>>
>> Build:
>>
>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>
>> ======================================================================
>> FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
>> ----------------------------------------------------------------------
>> Traceback (most recent call last):
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>> return f(*args, **kwargs)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
>> return f(*args, **kwargs)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
>> self.assertEqual(2, len(ip_addrs))
>> AssertionError: 2 != 4
>> -------------------- >> begin captured logging <<
--------------------
>> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_PU7TA type dummy (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_PU7TA up (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
>> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_PU7TA (cwd None) (cmdutils:133)
>> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> --------------------- >> end captured logging <<
---------------------
>>
>>
>>
>> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>
>>> We had this failure a lot in the past and it seems to be resolve, but I
>>> see it again today:
>>>
>>> ======================================================================
>>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>>> ----------------------------------------------------------------------
>>> Traceback (most recent call last):
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>>> return f(*args, **kwargs)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
>>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>>> self._assert_has_no_address(nic, ip_b)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>>> self.assertNotIn(address_with_prefixlen, addresses_list)
>>> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>> -------------------- >> begin captured logging <<
--------------------
>>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_NKzY1 up (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
>>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del dev
dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_NKzY1 (cwd None) (cmdutils:133)
>>> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> --------------------- >> end captured logging <<
---------------------
>>>
>>> Build:
>>>
>>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>>
>>
Another failure:
======================================================================
FAIL: test_add_delete_ipv4 (network.ip_address_test.IPAddressTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 222, in test_add_delete_ipv4
self._test_add_delete(IPV4_A_WITH_PREFIXLEN, IPV4_B_WITH_PREFIXLEN)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
self._assert_has_no_address(nic, ip_b)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
self._assert_address_not_in(address_with_prefixlen, addresses)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
self.assertNotIn(address_with_prefixlen, addresses_list)
AssertionError: '192.168.98.1/29' unexpectedly found in
['192.168.99.1/29', '192.168.98.1/29',
'fe80::4839:65ff:feec:cc6c/64']
-------------------- >> begin captured logging << --------------------
2019-01-15 00:55:50,034 DEBUG (MainThread) [root] /sbin/ip link add name dummy_CAZe2 type
dummy (cwd None) (cmdutils:133)
2019-01-15 00:55:50,046 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,051 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 140444667229952)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7fbbe11add10>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 00:55:50,054 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_CAZe2 up
(cwd None) (cmdutils:133)
2019-01-15 00:55:50,074 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,079 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 140444667229952)> (concurrent:196)
2019-01-15 00:55:50,081 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev dummy_CAZe2
192.168.99.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,091 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,094 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev dummy_CAZe2
192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,102 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,107 DEBUG (MainThread) [root] /sbin/ip -4 addr del dev dummy_CAZe2
192.168.98.1/29 (cwd None) (cmdutils:133)
2019-01-15 00:55:50,119 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 00:55:50,125 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_CAZe2 (cwd
None) (cmdutils:133)
2019-01-15 00:55:50,152 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
Build
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
More failures from today - are they related to running f28 mock on f29
slaves?
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
======================================================================
ERROR: test_multiple_vlans (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 455, in test_multiple_vlans
self.device_name, v.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out
of range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_8M1qa', 'root',
'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,354 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_8M1qa type dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,363 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,364 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_8M1qa up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,374 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,376 DEBUG (MainThread) [root] /sbin/ip link add
link dummy_8M1qa name dummy_8M1qa.16 type vlan id 16 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,387 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,388 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_8M1qa.16 up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,401 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,402 DEBUG (MainThread) [root] /sbin/ip link add
link dummy_8M1qa name dummy_8M1qa.17 type vlan id 17 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,436 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,437 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_8M1qa.17 up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,454 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,455 DEBUG (MainThread) [root] /sbin/tc qdisc show
dev dummy_8M1qa (cwd None) (cmdutils:133)
2019-01-15 18:09:06,471 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,473 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_8M1qa root (cwd None) (cmdutils:133)
2019-01-15 18:09:06,482 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot delete qdisc with handle of zero.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,483 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_8M1qa ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,491 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot find specified qdisc on specified device.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,493 DEBUG (MainThread) [root] /sbin/tc qdisc add
dev dummy_8M1qa root handle 0x1389: hfsc default 0x1388 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,501 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,503 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f346af0fe50>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,505 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_8M1qa.17 down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,521 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,522 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)>
(concurrent:196)
2019-01-15 18:09:06,523 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_8M1qa.17 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,539 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,541 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f346af0fe90>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,543 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_8M1qa.16 down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,554 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,555 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)>
(concurrent:196)
2019-01-15 18:09:06,556 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_8M1qa.16 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,575 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_non_vlan (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 416, in test_single_non_vlan
qos.configure_outbound(HOST_QOS_OUTBOUND, self.device_name, None)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out
of range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_Sk4Nm', 'root',
'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,607 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_Sk4Nm type dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,622 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,624 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_Sk4Nm up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,633 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,635 DEBUG (MainThread) [root] /sbin/tc qdisc show
dev dummy_Sk4Nm (cwd None) (cmdutils:133)
2019-01-15 18:09:06,652 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,655 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_Sk4Nm root (cwd None) (cmdutils:133)
2019-01-15 18:09:06,664 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot delete qdisc with handle of zero.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,665 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_Sk4Nm ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,673 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot find specified qdisc on specified device.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,674 DEBUG (MainThread) [root] /sbin/tc qdisc add
dev dummy_Sk4Nm root handle 0x1389: hfsc default 0x1388 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,684 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_vlan(1) (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
vlan.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out
of range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_jvRSU', 'root',
'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,713 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_jvRSU type dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,724 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,725 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_jvRSU up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,739 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,740 DEBUG (MainThread) [root] /sbin/ip link add
link dummy_jvRSU name dummy_jvRSU.16 type vlan id 16 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,763 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,764 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_jvRSU.16 up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,775 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,776 DEBUG (MainThread) [root] /sbin/tc qdisc show
dev dummy_jvRSU (cwd None) (cmdutils:133)
2019-01-15 18:09:06,799 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,800 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_jvRSU root (cwd None) (cmdutils:133)
2019-01-15 18:09:06,810 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot delete qdisc with handle of zero.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,811 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_jvRSU ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,821 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot find specified qdisc on specified device.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,822 DEBUG (MainThread) [root] /sbin/tc qdisc add
dev dummy_jvRSU root handle 0x1389: hfsc default 0x1388 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,834 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:06,836 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f346af2e950>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,838 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_jvRSU.16 down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,849 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,852 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)>
(concurrent:196)
2019-01-15 18:09:06,852 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_jvRSU.16 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,871 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_vlan(2) (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py",
line 142, in wrapper
return f(self, *args)
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
vlan.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out
of range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_Tn7mT', 'root',
'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,898 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_Tn7mT type dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,910 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,911 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_Tn7mT up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,943 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,946 DEBUG (MainThread) [root] /sbin/ip link add
link dummy_Tn7mT name dummy_Tn7mT.16 type vlan id 16 (cwd None)
(cmdutils:133)
2019-01-15 18:09:06,959 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,962 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_Tn7mT.16 up (cwd None) (cmdutils:133)
2019-01-15 18:09:06,986 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,989 DEBUG (MainThread) [root] /sbin/tc qdisc show
dev dummy_Tn7mT (cwd None) (cmdutils:133)
2019-01-15 18:09:06,999 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:07,000 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_Tn7mT root (cwd None) (cmdutils:133)
2019-01-15 18:09:07,008 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot delete qdisc with handle of zero.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:07,009 DEBUG (MainThread) [root] /sbin/tc qdisc del
dev dummy_Tn7mT ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:07,019 DEBUG (MainThread) [root] FAILED: <err> =
'Error: Cannot find specified qdisc on specified device.\n'; <rc> = 2
(cmdutils:141)
2019-01-15 18:09:07,020 DEBUG (MainThread) [root] /sbin/tc qdisc add
dev dummy_Tn7mT root handle 0x1389: hfsc default 0x1388 (cwd None)
(cmdutils:133)
2019-01-15 18:09:07,028 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(Coverage.py warning: Module
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
imported. (module-not-imported)
cmdutils:141)
2019-01-15 18:09:07,030 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound
method Monitor._scan of <vdsm.network.netlink.monitor.Monitor object
at 0x7f346af2ead0>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:07,032 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_Tn7mT.16 down (cwd None) (cmdutils:133)
2019-01-15 18:09:07,045 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:07,046 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)>
(concurrent:196)
2019-01-15 18:09:07,047 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_Tn7mT.16 (cwd None) (cmdutils:133)
2019-01-15 18:09:07,065 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
10:42 a.m.
On Tue, Jan 15, 2019 at 8:41 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
> On Sun, Jan 13, 2019 at 10:34 AM Edward Haas <edwardh(a)redhat.com> wrote:
>
>>
>> Thank you Nir.
>> I added an assert message to this last one.
>> It should not happen at all, it is very strange.
>>
>> https://gerrit.ovirt.org/#/c/96849/
>>
>> Thanks,
>> Edy.
>>
>> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>
>>> Another network test that did not fail for long time, failed again today.
>>>
>>> Build:
>>>
>>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>>
>>> ======================================================================
>>> FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
>>> ----------------------------------------------------------------------
>>> Traceback (most recent call last):
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>>> return f(*args, **kwargs)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
>>> return f(*args, **kwargs)
>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
>>> self.assertEqual(2, len(ip_addrs))
>>> AssertionError: 2 != 4
>>> -------------------- >> begin captured logging <<
--------------------
>>> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_PU7TA type dummy (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
>>> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_PU7TA up (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
>>> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add dev
dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_PU7TA (cwd None) (cmdutils:133)
>>> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>> --------------------- >> end captured logging <<
---------------------
>>>
>>>
>>>
>>> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>>
>>>> We had this failure a lot in the past and it seems to be resolve, but
>>>> I see it again today:
>>>>
>>>> ======================================================================
>>>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>>>> ----------------------------------------------------------------------
>>>> Traceback (most recent call last):
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>>>> return f(*args, **kwargs)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
>>>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN, IPV6_B_WITH_PREFIXLEN)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>>>> self._assert_has_no_address(nic, ip_b)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>>>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>>>> self.assertNotIn(address_with_prefixlen, addresses_list)
>>>> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>>> -------------------- >> begin captured logging <<
--------------------
>>>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>>>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_NKzY1 up (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
>>>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr del
dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_NKzY1 (cwd None) (cmdutils:133)
>>>> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> --------------------- >> end captured logging <<
---------------------
>>>>
>>>> Build:
>>>>
>>>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>>>
>>>
> Another failure:
>
> ======================================================================
>
> FAIL: test_add_delete_ipv4 (network.ip_address_test.IPAddressTest)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 222, in test_add_delete_ipv4
> self._test_add_delete(IPV4_A_WITH_PREFIXLEN, IPV4_B_WITH_PREFIXLEN)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
> self._assert_has_no_address(nic, ip_b)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
> self._assert_address_not_in(address_with_prefixlen, addresses)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
> self.assertNotIn(address_with_prefixlen, addresses_list)
> AssertionError: '192.168.98.1/29' unexpectedly found in
['192.168.99.1/29', '192.168.98.1/29',
'fe80::4839:65ff:feec:cc6c/64']
> -------------------- >> begin captured logging << --------------------
> 2019-01-15 00:55:50,034 DEBUG (MainThread) [root] /sbin/ip link add name dummy_CAZe2
type dummy (cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,046 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 00:55:50,051 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 140444667229952)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7fbbe11add10>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-15 00:55:50,054 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_CAZe2
up (cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,074 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 00:55:50,079 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 140444667229952)> (concurrent:196)
> 2019-01-15 00:55:50,081 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev
dummy_CAZe2 192.168.99.1/29 (cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,091 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 00:55:50,094 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev
dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,102 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 00:55:50,107 DEBUG (MainThread) [root] /sbin/ip -4 addr del dev
dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,119 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 00:55:50,125 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_CAZe2
(cwd None) (cmdutils:133)
> 2019-01-15 00:55:50,152 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
> Build
>
>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
More failures from today - are they related to running f28 mock on f29
slaves?
Build:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
And some more here:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
======================================================================
ERROR: test_multiple_vlans (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 455, in test_multiple_vlans
self.device_name, v.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of range',
['/sbin/tc', 'qdisc', 'add', 'dev', 'dummy_8M1qa',
'root', 'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,354 DEBUG (MainThread) [root] /sbin/ip link add name dummy_8M1qa type
dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,363 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,364 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,374 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,376 DEBUG (MainThread) [root] /sbin/ip link add link dummy_8M1qa name
dummy_8M1qa.16 type vlan id 16 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,387 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,388 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa.16 up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,401 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,402 DEBUG (MainThread) [root] /sbin/ip link add link dummy_8M1qa name
dummy_8M1qa.17 type vlan id 17 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,436 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,437 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa.17 up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,454 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,455 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_8M1qa
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,471 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,473 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_8M1qa root
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,482 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,483 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_8M1qa
ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,491 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,493 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_8M1qa root
handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,501 DEBUG (MainThread) [root] FAILED: <err> = 'RTNETLINK
answers: Numerical result out of range\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,503 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af0fe50>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,505 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa.17
down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,521 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,522 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
2019-01-15 18:09:06,523 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_8M1qa.17
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,539 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,541 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af0fe90>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,543 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa.16
down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,554 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,555 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
2019-01-15 18:09:06,556 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_8M1qa.16
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,575 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_non_vlan (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 416, in test_single_non_vlan
qos.configure_outbound(HOST_QOS_OUTBOUND, self.device_name, None)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of range',
['/sbin/tc', 'qdisc', 'add', 'dev', 'dummy_Sk4Nm',
'root', 'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,607 DEBUG (MainThread) [root] /sbin/ip link add name dummy_Sk4Nm type
dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,622 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,624 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Sk4Nm up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,633 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,635 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_Sk4Nm
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,652 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,655 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Sk4Nm root
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,664 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,665 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Sk4Nm
ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,673 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,674 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_Sk4Nm root
handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,684 DEBUG (MainThread) [root] FAILED: <err> = 'RTNETLINK
answers: Numerical result out of range\n'; <rc> = 2 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_vlan(1) (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line
142, in wrapper
return f(self, *args)
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
vlan.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of range',
['/sbin/tc', 'qdisc', 'add', 'dev', 'dummy_jvRSU',
'root', 'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,713 DEBUG (MainThread) [root] /sbin/ip link add name dummy_jvRSU type
dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,724 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,725 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_jvRSU up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,739 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,740 DEBUG (MainThread) [root] /sbin/ip link add link dummy_jvRSU name
dummy_jvRSU.16 type vlan id 16 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,763 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,764 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_jvRSU.16 up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,775 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,776 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_jvRSU
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,799 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,800 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_jvRSU root
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,810 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,811 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_jvRSU
ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:06,821 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,822 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_jvRSU root
handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,834 DEBUG (MainThread) [root] FAILED: <err> = 'RTNETLINK
answers: Numerical result out of range\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:06,836 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af2e950>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:06,838 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_jvRSU.16
down (cwd None) (cmdutils:133)
2019-01-15 18:09:06,849 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,852 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
2019-01-15 18:09:06,852 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_jvRSU.16
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,871 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_single_vlan(2) (network.tc_test.TestConfigureOutbound)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line
142, in wrapper
return f(self, *args)
File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
vlan.tag)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
_fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
default='%#x' % _NON_VLANNED_ID)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
_wrapper.process_request(command)
File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
raise TrafficControlException(retcode, err, command)
TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of range',
['/sbin/tc', 'qdisc', 'add', 'dev', 'dummy_Tn7mT',
'root', 'handle', '0x1389:', 'hfsc', 'default',
'0x1388'])
-------------------- >> begin captured logging << --------------------
2019-01-15 18:09:06,898 DEBUG (MainThread) [root] /sbin/ip link add name dummy_Tn7mT type
dummy (cwd None) (cmdutils:133)
2019-01-15 18:09:06,910 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,911 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Tn7mT up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,943 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,946 DEBUG (MainThread) [root] /sbin/ip link add link dummy_Tn7mT name
dummy_Tn7mT.16 type vlan id 16 (cwd None) (cmdutils:133)
2019-01-15 18:09:06,959 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,962 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Tn7mT.16 up
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,986 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:06,989 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_Tn7mT
(cwd None) (cmdutils:133)
2019-01-15 18:09:06,999 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:07,000 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Tn7mT root
(cwd None) (cmdutils:133)
2019-01-15 18:09:07,008 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:07,009 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Tn7mT
ingress (cwd None) (cmdutils:133)
2019-01-15 18:09:07,019 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
2019-01-15 18:09:07,020 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_Tn7mT root
handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
2019-01-15 18:09:07,028 DEBUG (MainThread) [root] FAILED: <err> = 'RTNETLINK
answers: Numerical result out of range\n'; <rc> = 2 (Coverage.py warning: Module
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never imported.
(module-not-imported)
cmdutils:141)
2019-01-15 18:09:07,030 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af2ead0>>, args=(), kwargs={}) (concurrent:193)
2019-01-15 18:09:07,032 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Tn7mT.16
down (cwd None) (cmdutils:133)
2019-01-15 18:09:07,045 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
2019-01-15 18:09:07,046 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
2019-01-15 18:09:07,047 DEBUG (MainThread) [root] /sbin/ip link del dev dummy_Tn7mT.16
(cwd None) (cmdutils:133)
2019-01-15 18:09:07,065 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
--------------------- >> end captured logging << ---------------------
12:13 a.m.
On Tue, Jan 15, 2019 at 8:43 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Tue, Jan 15, 2019 at 8:41 PM Nir Soffer <nsoffer(a)redhat.com>
wrote:
>
> On Tue, Jan 15, 2019 at 12:56 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>
>> On Sun, Jan 13, 2019 at 10:34 AM Edward Haas <edwardh(a)redhat.com> wrote:
>>
>>>
>>> Thank you Nir.
>>> I added an assert message to this last one.
>>> It should not happen at all, it is very strange.
>>>
>>> https://gerrit.ovirt.org/#/c/96849/
>>>
>>> Thanks,
>>> Edy.
>>>
>>> On Sun, Jan 13, 2019 at 9:21 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>>
>>>> Another network test that did not fail for long time, failed again
today.
>>>>
>>>> Build:
>>>>
>>>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>>>
>>>> ======================================================================
>>>> FAIL: test_local_auto_with_static_address_without_ra_server
(network.netinfo_test.TestIPv6Addresses)
>>>> ----------------------------------------------------------------------
>>>> Traceback (most recent call last):
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>>>> return f(*args, **kwargs)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 194, in wrapper
>>>> return f(*args, **kwargs)
>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/netinfo_test.py",
line 399, in test_local_auto_with_static_address_without_ra_server
>>>> self.assertEqual(2, len(ip_addrs))
>>>> AssertionError: 2 != 4
>>>> -------------------- >> begin captured logging <<
--------------------
>>>> 2019-01-13 07:08:43,598 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_PU7TA type dummy (cwd None) (cmdutils:133)
>>>> 2019-01-13 07:08:43,619 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-13 07:08:43,624 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139671724091136)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f0817ca1610>>, args=(), kwargs={}) (concurrent:193)
>>>> 2019-01-13 07:08:43,627 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_PU7TA up (cwd None) (cmdutils:133)
>>>> 2019-01-13 07:08:43,647 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-13 07:08:43,653 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139671724091136)> (concurrent:196)
>>>> 2019-01-13 07:08:43,655 DEBUG (MainThread) [root] /sbin/ip -6 addr add
dev dummy_PU7TA 2001::88/64 (cwd None) (cmdutils:133)
>>>> 2019-01-13 07:08:43,669 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> 2019-01-13 07:08:43,677 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_PU7TA (cwd None) (cmdutils:133)
>>>> 2019-01-13 07:08:43,696 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>>>> --------------------- >> end captured logging <<
---------------------
>>>>
>>>>
>>>>
>>>> On Fri, Jan 4, 2019 at 7:30 PM Nir Soffer <nsoffer(a)redhat.com>
wrote:
>>>>
>>>>> We had this failure a lot in the past and it seems to be resolve,
but
>>>>> I see it again today:
>>>>>
>>>>>
======================================================================
>>>>> FAIL: test_add_delete_ipv6 (network.ip_address_test.IPAddressTest)
>>>>>
----------------------------------------------------------------------
>>>>> Traceback (most recent call last):
>>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testValidation.py",
line 333, in wrapper
>>>>> return f(*args, **kwargs)
>>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 226, in test_add_delete_ipv6
>>>>> self._test_add_delete(IPV6_A_WITH_PREFIXLEN,
IPV6_B_WITH_PREFIXLEN)
>>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>>>>> self._assert_has_no_address(nic, ip_b)
>>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>>>>> self._assert_address_not_in(address_with_prefixlen, addresses)
>>>>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>>>>> self.assertNotIn(address_with_prefixlen, addresses_list)
>>>>> AssertionError: '2002:99::1/64' unexpectedly found in
['2002:99::1/64', '2001:99::1/64', 'fe80::6:23ff:fead:ed34/64']
>>>>> -------------------- >> begin captured logging <<
--------------------
>>>>> 2019-01-04 16:01:53,543 DEBUG (MainThread) [root] /sbin/ip link add
name dummy_NKzY1 type dummy (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,559 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> 2019-01-04 16:01:53,563 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139806010234624)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f271d654cd0>>, args=(), kwargs={}) (concurrent:193)
>>>>> 2019-01-04 16:01:53,567 DEBUG (MainThread) [root] /sbin/ip link set
dev dummy_NKzY1 up (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,586 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> 2019-01-04 16:01:53,593 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139806010234624)> (concurrent:196)
>>>>> 2019-01-04 16:01:53,597 DEBUG (MainThread) [root] /sbin/ip -6 addr
add dev dummy_NKzY1 2001:99::1/64 (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,615 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> 2019-01-04 16:01:53,620 DEBUG (MainThread) [root] /sbin/ip -6 addr
add dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,632 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> 2019-01-04 16:01:53,639 DEBUG (MainThread) [root] /sbin/ip -6 addr
del dev dummy_NKzY1 2002:99::1/64 (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,656 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> 2019-01-04 16:01:53,670 DEBUG (MainThread) [root] /sbin/ip link del
dev dummy_NKzY1 (cwd None) (cmdutils:133)
>>>>> 2019-01-04 16:01:53,705 DEBUG (MainThread) [root] SUCCESS:
<err> = ''; <rc> = 0 (cmdutils:141)
>>>>> --------------------- >> end captured logging <<
---------------------
>>>>>
>>>>> Build:
>>>>>
>>>>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>>>>
>>>>
>> Another failure:
>>
>> ======================================================================
>>
>> FAIL: test_add_delete_ipv4 (network.ip_address_test.IPAddressTest)
>> ----------------------------------------------------------------------
>> Traceback (most recent call last):
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 222, in test_add_delete_ipv4
>> self._test_add_delete(IPV4_A_WITH_PREFIXLEN, IPV4_B_WITH_PREFIXLEN)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 247, in _test_add_delete
>> self._assert_has_no_address(nic, ip_b)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 344, in _assert_has_no_address
>> self._assert_address_not_in(address_with_prefixlen, addresses)
>> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/ip_address_test.py",
line 352, in _assert_address_not_in
>> self.assertNotIn(address_with_prefixlen, addresses_list)
>> AssertionError: '192.168.98.1/29' unexpectedly found in
['192.168.99.1/29', '192.168.98.1/29',
'fe80::4839:65ff:feec:cc6c/64']
>> -------------------- >> begin captured logging <<
--------------------
>> 2019-01-15 00:55:50,034 DEBUG (MainThread) [root] /sbin/ip link add name
dummy_CAZe2 type dummy (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,046 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-15 00:55:50,051 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 140444667229952)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7fbbe11add10>>, args=(), kwargs={}) (concurrent:193)
>> 2019-01-15 00:55:50,054 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_CAZe2 up (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,074 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-15 00:55:50,079 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 140444667229952)> (concurrent:196)
>> 2019-01-15 00:55:50,081 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev
dummy_CAZe2 192.168.99.1/29 (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,091 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-15 00:55:50,094 DEBUG (MainThread) [root] /sbin/ip -4 addr add dev
dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,102 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-15 00:55:50,107 DEBUG (MainThread) [root] /sbin/ip -4 addr del dev
dummy_CAZe2 192.168.98.1/29 (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,119 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> 2019-01-15 00:55:50,125 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_CAZe2 (cwd None) (cmdutils:133)
>> 2019-01-15 00:55:50,152 DEBUG (MainThread) [root] SUCCESS: <err> =
''; <rc> = 0 (cmdutils:141)
>> --------------------- >> end captured logging <<
---------------------
>>
>> Build
>>
>>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>>
>
> More failures from today - are they related to running f28 mock on f29
> slaves?
>
It started with the fc29 slaves, so I believe it is.
Lets examine this from now on (https://gerrit.ovirt.org/#/c/96921/ got
merged).
> Build:
>
>
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
And some more here:
https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
>
> ======================================================================
> ERROR: test_multiple_vlans (network.tc_test.TestConfigureOutbound)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in
patched
> return func(*args, **keywargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 455, in test_multiple_vlans
> self.device_name, v.tag)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
> _fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
> default='%#x' % _NON_VLANNED_ID)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
> _wrapper.process_request(command)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
> raise TrafficControlException(retcode, err, command)
> TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of
range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_8M1qa', 'root', 'handle', '0x1389:',
'hfsc', 'default', '0x1388'])
> -------------------- >> begin captured logging << --------------------
> 2019-01-15 18:09:06,354 DEBUG (MainThread) [root] /sbin/ip link add name dummy_8M1qa
type dummy (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,363 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,364 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_8M1qa
up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,374 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,376 DEBUG (MainThread) [root] /sbin/ip link add link dummy_8M1qa
name dummy_8M1qa.16 type vlan id 16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,387 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,388 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_8M1qa.16 up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,401 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,402 DEBUG (MainThread) [root] /sbin/ip link add link dummy_8M1qa
name dummy_8M1qa.17 type vlan id 17 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,436 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,437 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_8M1qa.17 up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,454 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,455 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_8M1qa
(cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,471 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,473 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_8M1qa
root (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,482 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,483 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_8M1qa
ingress (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,491 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,493 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_8M1qa
root handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,501 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
> 2019-01-15 18:09:06,503 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af0fe50>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-15 18:09:06,505 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_8M1qa.17 down (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,521 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,522 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
> 2019-01-15 18:09:06,523 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_8M1qa.17 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,539 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,541 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af0fe90>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-15 18:09:06,543 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_8M1qa.16 down (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,554 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,555 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
> 2019-01-15 18:09:06,556 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_8M1qa.16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,575 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: test_single_non_vlan (network.tc_test.TestConfigureOutbound)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 416, in test_single_non_vlan
> qos.configure_outbound(HOST_QOS_OUTBOUND, self.device_name, None)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
> _fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
> default='%#x' % _NON_VLANNED_ID)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
> _wrapper.process_request(command)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
> raise TrafficControlException(retcode, err, command)
> TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of
range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_Sk4Nm', 'root', 'handle', '0x1389:',
'hfsc', 'default', '0x1388'])
> -------------------- >> begin captured logging << --------------------
> 2019-01-15 18:09:06,607 DEBUG (MainThread) [root] /sbin/ip link add name dummy_Sk4Nm
type dummy (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,622 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,624 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Sk4Nm
up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,633 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,635 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_Sk4Nm
(cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,652 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,655 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Sk4Nm
root (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,664 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,665 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Sk4Nm
ingress (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,673 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,674 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_Sk4Nm
root handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,684 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: test_single_vlan(1) (network.tc_test.TestConfigureOutbound)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line
142, in wrapper
> return f(self, *args)
> File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in
patched
> return func(*args, **keywargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
> vlan.tag)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
> _fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
> default='%#x' % _NON_VLANNED_ID)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
> _wrapper.process_request(command)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
> raise TrafficControlException(retcode, err, command)
> TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of
range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_jvRSU', 'root', 'handle', '0x1389:',
'hfsc', 'default', '0x1388'])
> -------------------- >> begin captured logging << --------------------
> 2019-01-15 18:09:06,713 DEBUG (MainThread) [root] /sbin/ip link add name dummy_jvRSU
type dummy (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,724 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,725 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_jvRSU
up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,739 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,740 DEBUG (MainThread) [root] /sbin/ip link add link dummy_jvRSU
name dummy_jvRSU.16 type vlan id 16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,763 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,764 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_jvRSU.16 up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,775 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,776 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_jvRSU
(cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,799 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,800 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_jvRSU
root (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,810 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,811 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_jvRSU
ingress (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,821 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:06,822 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_jvRSU
root handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,834 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2
(cmdutils:141)
> 2019-01-15 18:09:06,836 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af2e950>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-15 18:09:06,838 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_jvRSU.16 down (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,849 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,852 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
> 2019-01-15 18:09:06,852 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_jvRSU.16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,871 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
> ======================================================================
> ERROR: test_single_vlan(2) (network.tc_test.TestConfigureOutbound)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/testlib.py", line
142, in wrapper
> return f(self, *args)
> File "/usr/lib/python2.7/site-packages/mock/mock.py", line 1305, in
patched
> return func(*args, **keywargs)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/tests/network/tc_test.py",
line 434, in test_single_vlan
> vlan.tag)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 47, in configure_outbound
> _fresh_qdisc_conf_out(device, vlan_tag, class_id, qosOutbound)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/configurators/qos.py",
line 116, in _fresh_qdisc_conf_out
> default='%#x' % _NON_VLANNED_ID)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/qdisc.py",
line 43, in add
> _wrapper.process_request(command)
> File
"/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/network/tc/_wrapper.py",
line 43, in process_request
> raise TrafficControlException(retcode, err, command)
> TrafficControlException: (34, 'RTNETLINK answers: Numerical result out of
range', ['/sbin/tc', 'qdisc', 'add', 'dev',
'dummy_Tn7mT', 'root', 'handle', '0x1389:',
'hfsc', 'default', '0x1388'])
> -------------------- >> begin captured logging << --------------------
> 2019-01-15 18:09:06,898 DEBUG (MainThread) [root] /sbin/ip link add name dummy_Tn7mT
type dummy (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,910 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,911 DEBUG (MainThread) [root] /sbin/ip link set dev dummy_Tn7mT
up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,943 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,946 DEBUG (MainThread) [root] /sbin/ip link add link dummy_Tn7mT
name dummy_Tn7mT.16 type vlan id 16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,959 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,962 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_Tn7mT.16 up (cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,986 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:06,989 DEBUG (MainThread) [root] /sbin/tc qdisc show dev dummy_Tn7mT
(cwd None) (cmdutils:133)
> 2019-01-15 18:09:06,999 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:07,000 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Tn7mT
root (cwd None) (cmdutils:133)
> 2019-01-15 18:09:07,008 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot delete qdisc with handle of zero.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:07,009 DEBUG (MainThread) [root] /sbin/tc qdisc del dev dummy_Tn7mT
ingress (cwd None) (cmdutils:133)
> 2019-01-15 18:09:07,019 DEBUG (MainThread) [root] FAILED: <err> = 'Error:
Cannot find specified qdisc on specified device.\n'; <rc> = 2 (cmdutils:141)
> 2019-01-15 18:09:07,020 DEBUG (MainThread) [root] /sbin/tc qdisc add dev dummy_Tn7mT
root handle 0x1389: hfsc default 0x1388 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:07,028 DEBUG (MainThread) [root] FAILED: <err> =
'RTNETLINK answers: Numerical result out of range\n'; <rc> = 2 (Coverage.py
warning: Module /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/vdsm was never
imported. (module-not-imported)
> cmdutils:141)
> 2019-01-15 18:09:07,030 DEBUG (netlink/events) [root] START thread
<Thread(netlink/events, started daemon 139863118571264)> (func=<bound method
Monitor._scan of <vdsm.network.netlink.monitor.Monitor object at
0x7f346af2ead0>>, args=(), kwargs={}) (concurrent:193)
> 2019-01-15 18:09:07,032 DEBUG (MainThread) [root] /sbin/ip link set dev
dummy_Tn7mT.16 down (cwd None) (cmdutils:133)
> 2019-01-15 18:09:07,045 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> 2019-01-15 18:09:07,046 DEBUG (netlink/events) [root] FINISH thread
<Thread(netlink/events, started daemon 139863118571264)> (concurrent:196)
> 2019-01-15 18:09:07,047 DEBUG (MainThread) [root] /sbin/ip link del dev
dummy_Tn7mT.16 (cwd None) (cmdutils:133)
> 2019-01-15 18:09:07,065 DEBUG (MainThread) [root] SUCCESS: <err> = '';
<rc> = 0 (cmdutils:141)
> --------------------- >> end captured logging << ---------------------
>
>
>
1927
days inactive
1939
days old
6 comments
2 participants
participants (2)
-
Edward Haas -
Nir Soffer