I see frequents errors in the vdsm log on one of the gluster servers in my gluster cluster. Can anyone suggest a way to troubleshoot this, the host is fine in the ovirt console and gluster functions ok. The Gluster cluster is a replica 2, with 2 hosts. I am trying to add another host to move to replica 3 but having trouble and this error seems to cause any changes to the cluster to fail with unexpected errors in ovirt.
-Thanks, Alastair
Gluster Server VentOS 6.6:
vdsmd: vdsm-4.16.7-1.gitdb83943.el6
gluster: glusterfs-3.6.1-1.el6
ovirt host Fedora 20:
hosted ovirt-engine 3.5.0.1-1
Thread-53::DEBUG::2014-11-24 14:11:45,362::BindingXMLRPC::1132::vds::(wrapper) client [xxx.xxx.xxx.39]::call hostsList with () {}
Thread-53::ERROR::2014-11-24 14:11:45,363::BindingXMLRPC::1151::vds::(wrapper) unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 1135, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/gluster/api.py", line 54, in wrapper
rv = func(*args, **kwargs)
File "/usr/share/vdsm/gluster/api.py", line 251, in hostsList
return {'hosts': self.svdsmProxy.glusterPeerStatus()}
File "/usr/share/vdsm/supervdsm.py", line 50, in __call__
return callMethod()
File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda>
**kwargs)
File "<string>", line 2, in glusterPeerStatus
File "/usr/lib64/python2.6/multiprocessing/managers.py", line 725, in _callmethod
conn.send((self._id, methodname, args, kwds))
IOError: [Errno 32] Broken pipe
Thread-53::DEBUG::2014-11-24 14:03:08,721::BindingXMLRPC::1132::vds::(wrapper) client [xxx.xxx.xxx.39]::call volumesList with () {}
Thread-53::ERROR::2014-11-24 14:03:08,721::BindingXMLRPC::1151::vds::(wrapper) unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/rpc/BindingXMLRPC.py", line 1135, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/gluster/api.py", line 54, in wrapper
rv = func(*args, **kwargs)
File "/usr/share/vdsm/gluster/api.py", line 78, in volumesList
return {'volumes': self.svdsmProxy.glusterVolumeInfo(volumeName)}
File "/usr/share/vdsm/supervdsm.py", line 50, in __call__
return callMethod()
File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda>
**kwargs)
File "<string>", line 2, in glusterVolumeInfo
File "/usr/lib64/python2.6/multiprocessing/managers.py", line 725, in _callmethod
conn.send((self._id, methodname, args, kwds))
IOError: [Errno 32] Broken pipe