[ovirt-users] vdsm losing connection to libvirt

[Francesco Romani]

----- Original Message -----
> From: "Dan Kenigsberg" <danken at redhat.com>
> To: users at ovirt.org, ybronhei at redhat.com
> Sent: Tuesday, December 16, 2014 11:29:36 PM
> Subject: Re: [ovirt-users] vdsm losing connection to libvirt

> > 20:56:38,754::libvirtconnection::135::root::(wrapper) connection to
> > libvirt broken. ecode: 1 edom: 7
[...]
> > 20:56:38,755::BindingXMLRPC::1142::vds::(wrapper) libvirt error
> > Traceback (most recent call last):
> >   File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 1135, in wrapper
> >     res = f(*args, **kwargs)
> >   File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 463, in getCapabilities
> >     ret = api.getCapabilities()
> >   File "/usr/share/vdsm/API.py", line 1245, in getCapabilities
> >     c = caps.get()
> >   File "/usr/share/vdsm/caps.py", line 615, in get
> >     caps.update(netinfo.get())
> >   File "/usr/lib/python2.7/site-packages/vdsm/netinfo.py", line 812, in get
> >     nets = networks()
> >   File "/usr/lib/python2.7/site-packages/vdsm/netinfo.py", line 119, in
> >   networks
> >     allNets = ((net, net.name()) for net in conn.listAllNetworks(0))
> >   File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line
> >   129, in wrapper
> >     __connections.get(id(target)).pingLibvirt()
> >   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3642, in
> >   getLibVersion
> >     if ret == -1: raise libvirtError ('virConnectGetLibVersion() failed',
> >     conn=self)
> > libvirtError: internal error: client socket is closed
> 
> Does anything suspecious show up on libvirtd.log?
> 
> I heard a report about a libvirt segmentation fault on centos7 - could
> this be it, too? Does `ps -o stime `pgrep libvirtd`` match with reported
> libvirt "internal error"?
> 
> Would you provide the precise version of libvirt and vdsm?

Confirmed. I'm aware of these bugs in particular, which could be related
to a fair amount of mysterious libvirtd crashes:

https://bugzilla.redhat.com/show_bug.cgi?id=1162208
https://bugzilla.redhat.com/show_bug.cgi?id=1171124
https://bugzilla.redhat.com/show_bug.cgi?id=1141159

It seems *more frequent* when migrations are involved, but as last bug tells
us, it may happen on other cases as well.

-- 
Francesco Romani
RedHat Engineering Virtualization R & D
Phone: 8261328
IRC: fromani