<div dir="ltr"><div>Thanks, we are tracking this.<br></div>If it starts to appear frequently, please let me know.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Sep 5, 2016 at 12:11 AM, Nir Soffer <span dir="ltr">&lt;<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">The tests passed after retriggering this build, this is probably a<br>
timing issue in the tests.<br>
<div class="HOEnZb"><div class="h5"><br>
On Sun, Sep 4, 2016 at 11:45 PM, Nir Soffer &lt;<a href="mailto:nsoffer@redhat.com">nsoffer@redhat.com</a>&gt; wrote:<br>
&gt; Hi all,<br>
&gt;<br>
&gt; These tests seems to fail unrelated builds:<br>
&gt; <a href="http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc24-x86_64/1600/console" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>vdsm_master_check-patch-fc24-<wbr>x86_64/1600/console</a><br>
&gt;<br>
&gt; Seen it once, please check.<br>
&gt;<br>
&gt; 19:43:05 ==============================<wbr>==============================<wbr>==========<br>
&gt; 19:43:05 ERROR: test_local_auto_with_dynamic_<wbr>address_from_ra<br>
&gt; (network.netinfo_test.<wbr>TestIPv6Addresses)<br>
&gt; 19:43:05 ------------------------------<wbr>------------------------------<wbr>----------<br>
&gt; 19:43:05 Traceback (most recent call last):<br>
&gt; 19:43:05   File<br>
&gt; &quot;/home/jenkins/workspace/vdsm_<wbr>master_check-patch-fc24-x86_<wbr>64/vdsm/tests/testValidation.<wbr>py&quot;,<br>
&gt; line 97, in wrapper<br>
&gt; 19:43:05     return f(*args, **kwargs)<br>
&gt; 19:43:05   File<br>
&gt; &quot;/home/jenkins/workspace/vdsm_<wbr>master_check-patch-fc24-x86_<wbr>64/vdsm/tests/network/netinfo_<wbr>test.py&quot;,<br>
&gt; line 419, in test_local_auto_with_dynamic_<wbr>address_from_ra<br>
&gt; 19:43:05     IPV6_NETPREFIX_LEN, family=6)<br>
&gt; 19:43:05   File &quot;/usr/lib64/python2.7/<wbr>contextlib.py&quot;, line 24, in __exit__<br>
&gt; 19:43:05     self.gen.next()<br>
&gt; 19:43:05   File<br>
&gt; &quot;/home/jenkins/workspace/vdsm_<wbr>master_check-patch-fc24-x86_<wbr>64/vdsm/tests/network/<wbr>nettestlib.py&quot;,<br>
&gt; line 454, in wait_for_ipv6<br>
&gt; 19:43:05     raise Exception(&#39;IPv6 addresses has not been caught within the &#39;<br>
&gt; 19:43:05 Exception: IPv6 addresses has not been caught within the given timeout.<br>
&gt; 19:43:05<br>
&gt; 19:43:05 -------------------- &gt;&gt; begin captured logging &lt;&lt; --------------------<br>
&gt; 19:43:05 2016-09-04 19:42:32,949 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name veth_hU8rsgT1oy<br>
&gt; type veth peer name veth_OgkZCPxdBp (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:32,962 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:32,965 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /usr/sbin/dnsmasq --dhcp-authoritative<br>
&gt; -p 0 --dhcp-option=3 --dhcp-option=6 -i veth_hU8rsgT1oy -I lo -d<br>
&gt; --bind-dynamic --enable-ra --dhcp-range=2001:1:1:1::,<wbr>slaac,2m (cwd<br>
&gt; None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,475 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/service iptables status (cwd<br>
&gt; None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,501 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;Redirecting to /bin/systemctl status<br>
&gt; iptables.service\nRunning in chroot, ignoring request.\n&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:33,502 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/iptables --wait -I INPUT -i<br>
&gt; veth_hU8rsgT1oy -p udp --sport 68 --dport 67 -j ACCEPT (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,514 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:33,515 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/iptables --wait -I INPUT -i<br>
&gt; veth_hU8rsgT1oy -p udp --sport 546 --dport 547 -j ACCEPT (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,523 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:33,525 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev veth_OgkZCPxdBp<br>
&gt; up (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,532 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:33,533 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev veth_hU8rsgT1oy<br>
&gt; up (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,543 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:33,543 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip -6 addr add dev<br>
&gt; veth_hU8rsgT1oy 2001:1:1:1::1/64 (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:33,550 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:53,541 DEBUG   [root] (MainThread) dnsmasq:<br>
&gt; started, version 2.76 DNS disabled<br>
&gt; 19:43:05 dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n<br>
&gt; IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect<br>
&gt; inotify<br>
&gt; 19:43:05 dnsmasq: warning: interface veth_hU8rsgT1oy does not currently exist<br>
&gt; 19:43:05 dnsmasq-dhcp: router advertisement on 2001:1:1:1::<br>
&gt; 19:43:05 dnsmasq-dhcp: IPv6 router advertisement enabled<br>
&gt; 19:43:05 dnsmasq-dhcp: RTR-ADVERT(veth_hU8rsgT1oy) 2001:1:1:1::<br>
&gt; 19:43:05 dnsmasq-dhcp: RTR-ADVERT(veth_hU8rsgT1oy) 2001:1:1:1::<br>
&gt; 19:43:05<br>
&gt; 19:43:05 2016-09-04 19:42:53,542 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/service iptables status (cwd<br>
&gt; None)<br>
&gt; 19:43:05 2016-09-04 19:42:53,589 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;Redirecting to /bin/systemctl status<br>
&gt; iptables.service\nRunning in chroot, ignoring request.\n&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:53,590 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/iptables --wait -D INPUT -i<br>
&gt; veth_hU8rsgT1oy -p udp --sport 68 --dport 67 -j ACCEPT (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:53,612 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:53,613 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/iptables --wait -D INPUT -i<br>
&gt; veth_hU8rsgT1oy -p udp --sport 546 --dport 547 -j ACCEPT (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:53,630 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:53,631 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link del dev veth_hU8rsgT1oy<br>
&gt; (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:53,669 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 --------------------- &gt;&gt; end captured logging &lt;&lt; ---------------------<br>
&gt; 19:43:05<br>
&gt; 19:43:05 ==============================<wbr>==============================<wbr>==========<br>
&gt; 19:43:05 FAIL: test_events_keys (network.netlink_test.<wbr>NetlinkEventMonitorTests)<br>
&gt; 19:43:05 ------------------------------<wbr>------------------------------<wbr>----------<br>
&gt; 19:43:05 Traceback (most recent call last):<br>
&gt; 19:43:05   File<br>
&gt; &quot;/home/jenkins/workspace/vdsm_<wbr>master_check-patch-fc24-x86_<wbr>64/vdsm/tests/testValidation.<wbr>py&quot;,<br>
&gt; line 97, in wrapper<br>
&gt; 19:43:05     return f(*args, **kwargs)<br>
&gt; 19:43:05   File<br>
&gt; &quot;/home/jenkins/workspace/vdsm_<wbr>master_check-patch-fc24-x86_<wbr>64/vdsm/tests/network/netlink_<wbr>test.py&quot;,<br>
&gt; line 173, in test_events_keys<br>
&gt; 19:43:05     for d in _caught])))<br>
&gt; 19:43:05 AssertionError: Expected events have not been caught (in the<br>
&gt; right order).<br>
&gt; 19:43:05 Expected:<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_addr&#39;, &#39;address&#39;: &#39;<a href="http://192.0.2.1/24" rel="noreferrer" target="_blank">192.0.2.1/24</a>&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_addr&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_neigh&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_addr&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_addr&#39;, &#39;address&#39;: &#39;<a href="http://192.0.2.1/24" rel="noreferrer" target="_blank">192.0.2.1/24</a>&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;192.0.2.1&#39;, &#39;event&#39;: &#39;del_route&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;}.<br>
&gt; 19:43:05 Caught:<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;, &#39;address&#39;:<br>
&gt; &#39;6e:f3:b9:80:5d:20&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_addr&#39;, &#39;family&#39;: &#39;inet&#39;, &#39;address&#39;: &#39;<a href="http://192.0.2.1/24" rel="noreferrer" target="_blank">192.0.2.1/24</a>&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;192.0.2.1&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;, &#39;address&#39;:<br>
&gt; &#39;6e:f3:b9:80:5d:20&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;<a href="http://192.0.2.0/24" rel="noreferrer" target="_blank">192.0.2.0/24</a>&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;192.0.2.0&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;192.0.2.255&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;ff00::/8&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::/64&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;, &#39;address&#39;:<br>
&gt; &#39;6e:f3:b9:80:5d:20&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_addr&#39;, &#39;family&#39;: &#39;inet6&#39;, &#39;address&#39;:<br>
&gt; &#39;fe80::6cf3:b9ff:fe80:5d20/64&#39;<wbr>}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::6cf3:b9ff:fe80:5d20&#39;, &#39;event&#39;:<br>
&gt; &#39;new_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::&#39;, &#39;event&#39;: &#39;new_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;new_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;, &#39;address&#39;:<br>
&gt; &#39;6e:f3:b9:80:5d:20&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::/64&#39;, &#39;event&#39;: &#39;del_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;ff00::/8&#39;, &#39;event&#39;: &#39;del_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_addr&#39;, &#39;family&#39;: &#39;inet6&#39;, &#39;address&#39;:<br>
&gt; &#39;fe80::6cf3:b9ff:fe80:5d20/64&#39;<wbr>}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::&#39;, &#39;event&#39;: &#39;del_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;fe80::6cf3:b9ff:fe80:5d20&#39;, &#39;event&#39;:<br>
&gt; &#39;del_route&#39;, &#39;family&#39;: &#39;inet6&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_addr&#39;, &#39;family&#39;: &#39;inet&#39;, &#39;address&#39;: &#39;<a href="http://192.0.2.1/24" rel="noreferrer" target="_blank">192.0.2.1/24</a>&#39;}<br>
&gt; 19:43:05 {&#39;destination&#39;: &#39;192.0.2.1&#39;, &#39;event&#39;: &#39;del_route&#39;, &#39;family&#39;: &#39;inet&#39;}<br>
&gt; 19:43:05 {&#39;event&#39;: &#39;del_link&#39;, &#39;name&#39;: &#39;dummy_40rKa&#39;, &#39;address&#39;:<br>
&gt; &#39;6e:f3:b9:80:5d:20&#39;}.<br>
&gt; 19:43:05 -------------------- &gt;&gt; begin captured logging &lt;&lt; --------------------<br>
&gt; 19:43:05 2016-09-04 19:42:54,605 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link add name dummy_40rKa<br>
&gt; type dummy (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:54,623 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:54,623 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip -4 addr add dev dummy_40rKa<br>
&gt; <a href="http://192.0.2.1/24" rel="noreferrer" target="_blank">192.0.2.1/24</a> (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:54,640 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:05 2016-09-04 19:42:54,642 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link set dev dummy_40rKa up<br>
&gt; (cwd None)<br>
&gt; 19:43:05 2016-09-04 19:42:54,658 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:16 2016-09-04 19:42:54,659 DEBUG   [root] (MainThread)<br>
&gt; /usr/bin/taskset --cpu-list 0-1 /sbin/ip link del dev dummy_40rKa (cwd<br>
&gt; None)<br>
&gt; 19:43:16 2016-09-04 19:42:54,684 DEBUG   [root] (MainThread) SUCCESS:<br>
&gt; &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
&gt; 19:43:16 --------------------- &gt;&gt; end captured logging &lt;&lt; ---------------------<br>
</div></div></blockquote></div><br></div>