On Thu, Jun 2, 2016 at 10:01 AM, Edward Haas <ehaas(a)redhat.com> wrote:
On Wed, Jun 1, 2016 at 10:53 PM, Nir Soffer <nsoffer(a)redhat.com> wrote:
>
> Seems that random network test fail now in the ci. Did we change
> anything in the infrastructure that can explain this?
>
> This is the same pattern we saw in other tests, all the ip calls are
> successful,
> but the test is not happy.
>
> 18:49:09
> ======================================================================
> 18:49:09 FAIL: testDisablePromisc (network.ipwrapper_test.TestDrvinfo)
> 18:49:09
> ----------------------------------------------------------------------
> 18:49:09 Traceback (most recent call last):
> 18:49:09 File
>
>
"/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/network/ipwrapper_test.py",
> line 149, in testDisablePromisc
> 18:49:09 "Could not disable promiscuous mode.")
> 18:49:09 AssertionError: Could not disable promiscuous mode.
> 18:49:09 -------------------- >> begin captured logging <<
> --------------------
> 18:49:09 2016-06-01 18:48:58,492 DEBUG [root] (MainThread)
> /usr/bin/taskset --cpu-list 0-1 /usr/sbin/brctl show (cwd None)
> 18:49:09 2016-06-01 18:48:58,501 DEBUG [root] (MainThread) SUCCESS:
> <err> = ''; <rc> = 0
> 18:49:09 2016-06-01 18:48:58,501 DEBUG [root] (MainThread)
> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name vdsm-Cnvkvg
> type bridge (cwd None)
> 18:49:09 2016-06-01 18:48:58,510 DEBUG [root] (MainThread) SUCCESS:
> <err> = ''; <rc> = 0
> 18:49:09 2016-06-01 18:48:58,511 DEBUG [root] (MainThread)
> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev vdsm-Cnvkvg up
> (cwd None)
> 18:49:09 2016-06-01 18:48:58,522 DEBUG [root] (MainThread) SUCCESS:
> <err> = ''; <rc> = 0
> 18:49:09 2016-06-01 18:48:58,523 DEBUG [root] (MainThread)
> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev vdsm-Cnvkvg
> promisc on (cwd None)
> 18:49:09 2016-06-01 18:48:58,533 DEBUG [root] (MainThread) SUCCESS:
> <err> = ''; <rc> = 0
> 18:49:09 2016-06-01 18:48:58,533 DEBUG [root] (MainThread)
> /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev vdsm-Cnvkvg
> promisc off (cwd None)
> 18:49:09 2016-06-01 18:48:58,542 DEBUG [root] (MainThread) SUCCESS:
> <err> = ''; <rc> = 0
How often has this been seen? Is this failing on a specific platform?
I seen this test fail once - it seems that some network tests are
failing rarely, this is not a problem with specific test.
This is an integration test that should be run on a VM.
We should target for running the CI integration tests with lago and a
dedicated VDSM (for test) image.
If this failure will occur too often, we can label it such that it will not
run on CI. (but will run locally)
Do we understand why they fail randomly?
Is it possible to make them reliable in mock?
Nir