[lago-devel] Fwd: [VDSM] check_merged failures

[David Caro]

On 03/08 16:43, Yaniv Bronheim wrote:
> I don't think someone canceled any job manually .. we don't use to touch
> those jobs directly
> 
> On Tue, Mar 8, 2016 at 4:37 PM, David Caro <dcaro at redhat.com> wrote:
> 
> > On 03/08 16:35, Yaniv Bronheim wrote:
> > > forwarding to lago devels.. shouldn't be any issues with the tests.
> > nothing
> > > changed since last time it succeeded
> >
> > That looks like leftovers on libvirt from a previous job. Did any jobs get
> > forcefully aborted skipping the cleanups?

It turns out that libvirt restart is not enough to cleanup all the
non-permanent network definitions (not sure why yet though) so I've added also
explicit cleanup of the shortened network names generated by lago:

   https://gerrit.ovirt.org/#/c/54476/


I'm cleaning up manually the slaves in the meantime

> >
> > >
> > > ---------- Forwarded message ----------
> > > From: Nir Soffer <nsoffer at redhat.com>
> > > Date: Tue, Mar 8, 2016 at 4:34 PM
> > > Subject: [VDSM] check_merged failures
> > > To: devel <devel at ovirt.org>, Yaniv Bronheim <ybronhei at redhat.com>
> > >
> > >
> > > Hi all,
> > >
> > > The new check_merged job is failing randomly. I have see this error
> > today:
> > >
> > > 14:20:16 @ Start specified VMs:
> > > 14:20:16   # Start nets:
> > > 14:20:16     * Create network vdsm_functional_tests_lago:
> > > 14:20:16 libvirt:  error : internal error: Network is already in use
> > > by interface 7f0c-bc616ef
> > > 14:20:16     * Create network vdsm_functional_tests_lago: ERROR (in
> > 0:00:00)
> > > 14:20:16   # Start nets: ERROR (in 0:00:00)
> > > 14:20:16 @ Start specified VMs: ERROR (in 0:00:00)
> > > 14:20:16 Error occured, aborting
> > > 14:20:16 Traceback (most recent call last):
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/cmd.py", line
> > > 539, in main
> > > 14:20:16     cli_plugins[args.verb].do_run(args)
> > > 14:20:16   File
> > > "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 180, in
> > > do_run
> > > 14:20:16     self._do_run(**vars(args))
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/cmd.py", line
> > > 132, in wrapper
> > > 14:20:16     return func(*args,
> > > prefix=lago_prefix.Prefix(prefix_path), **kwargs)
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/cmd.py", line
> > > 141, in wrapper
> > > 14:20:16     return func(*args, prefix=prefix, **kwargs)
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/cmd.py", line
> > > 191, in do_start
> > > 14:20:16     prefix.start(vm_names=vm_names)
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/prefix.py",
> > > line 819, in start
> > > 14:20:16     self.virt_env.start(vm_names=vm_names)
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/virt.py", line
> > > 187, in start
> > > 14:20:16     net.start()
> > > 14:20:16   File "/usr/lib/python2.7/site-packages/lago/virt.py", line
> > > 354, in start
> > > 14:20:16     self._env.libvirt_con.networkCreateXML(self._libvirt_xml())
> > > 14:20:16   File "/usr/lib64/python2.7/site-packages/libvirt.py", line
> > > 4093, in networkCreateXML
> > > 14:20:16     if ret is None:raise libvirtError('virNetworkCreateXML()
> > > failed', conn=self)
> > > 14:20:16 libvirtError: internal error: Network is already in use by
> > > interface 7f0c-bc616ef
> > >
> > > Hopefully someone is owning the infrastructure and can look into this.
> > >
> > > Nir
> > >
> > >
> > >
> > > --
> > > *Yaniv Bronhaim.*
> >
> > > _______________________________________________
> > > lago-devel mailing list
> > > lago-devel at ovirt.org
> > > http://lists.ovirt.org/mailman/listinfo/lago-devel
> >
> >
> > --
> > David Caro
> >
> > Red Hat S.L.
> > Continuous Integration Engineer - EMEA ENG Virtualization R&D
> >
> > Tel.: +420 532 294 605
> > Email: dcaro at redhat.com
> > IRC: dcaro|dcaroest@{freenode|oftc|redhat}
> > Web: www.redhat.com
> > RHT Global #: 82-62605
> >
> 
> 
> 
> -- 
> *Yaniv Bronhaim.*

-- 
David Caro

Red Hat S.L.
Continuous Integration Engineer - EMEA ENG Virtualization R&D

Tel.: +420 532 294 605
Email: dcaro at redhat.com
IRC: dcaro|dcaroest@{freenode|oftc|redhat}
Web: www.redhat.com
RHT Global #: 82-62605
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 473 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/lago-devel/attachments/20160308/9dd14a7e/attachment-0001.sig>