Re: [ovirt-users] method "glusterVolumesList" is not supported (Failed with error VDS_NETWORK_ERROR and code 5022)

Tuesday, 12 August 2014

This is a multi-part message in MIME format.
--------------070803020402090000070500
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 08/12/2014 03:44 PM, Sahina Bose wrote:
...
 Could you provide the vdsm and supervdsm log from the node?
 vdsm:
http://pastebin.com/edZrvnkr
(cut some repetitive loglines out to fit on pastebin)

Supervdsm:

http://pastebin.com/V8xTTMKk
...
 On 08/12/2014 07:08 PM, Jorick Astrego wrote:
> Hi,
>
> No restarting glusterfsd doesn't help. The steps in the link you gave 
> me don't help either. The node is clean installed and has never been 
> a part of a glusterfs.... Running gluster version 3.5.2
>
>     glusterfs-server-3.5.2-1.el7.x86_64
>     glusterfs-api-3.5.2-1.el7.x86_64
>     glusterfs-fuse-3.5.2-1.el7.x86_64
>     glusterfs-cli-3.5.2-1.el7.x86_64
>     vdsm-gluster-4.16.1-4.gitb2bf270.el7.noarch
>     glusterfs-libs-3.5.2-1.el7.x86_64
>     glusterfs-3.5.2-1.el7.x86_64
>     glusterfs-rdma-3.5.2-1.el7.x86_64
>
> From the log:
>
>     [2014-08-12 11:57:30.006092] W
>     [glusterfsd.c:1095:cleanup_and_exit]
>     (-->/lib64/libc.so.6(clone+0x6d) [0x7fac29bc23dd]
>     (-->/lib64/libpthread.so.0(+0x7df3) [0x7fac2a279df3]
>     (-->/usr/sbin/glusterd(glusterfs_sigwaiter+0xe5)
>     [0x7fac2b8471b5]))) 0-: received signum (15), shutting down
>     [2014-08-12 11:57:30.014919] I [glusterfsd.c:1959:main]
>     0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version
>     3.5.2 (/usr/sbin/glusterd -p /run/glusterd.pid)
>     [2014-08-12 11:57:30.018089] I [glusterd.c:1122:init]
>     0-management: Using /var/lib/glusterd as working directory
>     [2014-08-12 11:57:30.020315] I [socket.c:3561:socket_init]
>     0-socket.management: SSL support is NOT enabled
>     [2014-08-12 11:57:30.020331] I [socket.c:3576:socket_init]
>     0-socket.management: using system polling thread
>     [2014-08-12 11:57:30.021533] W [rdma.c:4194:__gf_rdma_ctx_create]
>     0-rpc-transport/rdma: rdma_cm event channel creation failed (No
>     such device)
>     [2014-08-12 11:57:30.021548] E [rdma.c:4482:init]
>     0-rdma.management: Failed to initialize IB Device
>     [2014-08-12 11:57:30.021555] E
>     [rpc-transport.c:333:rpc_transport_load] 0-rpc-transport: 'rdma'
>     initialization failed
>     [2014-08-12 11:57:30.021610] W
>     [rpcsvc.c:1535:rpcsvc_transport_create] 0-rpc-service: cannot
>     create listener, initing the transport failed
>     [2014-08-12 11:57:30.021669] I [socket.c:3561:socket_init]
>     0-socket.management: SSL support is NOT enabled
>     [2014-08-12 11:57:30.021679] I [socket.c:3576:socket_init]
>     0-socket.management: using system polling thread
>     [2014-08-12 11:57:30.022603] I
>     [glusterd.c:367:glusterd_check_gsync_present] 0-glusterd:
>     geo-replication module not installed in the system
>     *[2014-08-12 11:57:30.023046] E
>     [store.c:408:gf_store_handle_retrieve] 0-: Path corresponding to
>     /var/lib/glusterd/glusterd.info, returned error: (No such file or
>     directory)**
>     **[2014-08-12 11:57:30.023075] E
>     [store.c:408:gf_store_handle_retrieve] 0-: Path corresponding to
>     /var/lib/glusterd/glusterd.info, returned error: (No such file or
>     directory)*
>     [2014-08-12 11:57:30.023090] I
>     [glusterd-store.c:1441:glusterd_restore_op_version] 0-management:
>     Detected new install. Setting op-version to maximum : 30501
>     Final graph:
>     +------------------------------------------------------------------------------+
>       1: volume management
>       2:     type mgmt/glusterd
>       3:     option rpc-auth.auth-glusterfs on
>       4:     option rpc-auth.auth-unix on
>       5:     option rpc-auth.auth-null on
>       6:     option transport.socket.listen-backlog 128
>       7:     option transport.socket.read-fail-log off
>       8:     option transport.socket.keepalive-interval 2
>       9:     option transport.socket.keepalive-time 10
>      10:     option transport-type rdma
>      11:     option working-directory /var/lib/glusterd
>      12: end-volume
>      13:
>     +------------------------------------------------------------------------------+
>
> Jorick
>
> On 08/12/2014 02:56 PM, Maor Lipchuk wrote:
>> Hi Jorick,
>> which version of GlusterFS are you using?
>>
>> Try to restart glusterd on each of the bricks, then try to follow this link:
>>
http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-pa...
>>
>> Please tell me if this helps
>>
>> Regards,
>> Maor
>>
>> ----- Original Message -----
>> From: "Jorick Astrego&quot;&lt;j.astrego(a)netbulae.eu&gt;
>> To:users@ovirt.org
>> Sent: Tuesday, August 12, 2014 3:16:06 PM
>> Subject: [ovirt-users] method "glusterVolumesList" is not supported
(Failed with error VDS_NETWORK_ERROR and code 5022)
>>
>> Hi,
>>
>> I'm trying to test glusterfs on a couple of Centos 7 ovirt nodes with ovirt
3.5rc1.
>>
>> I've enabled glusterfs service for the cluster, created a xfs data partition
with mount point, installed "vdsm-gluster" rpm and started glusterfsd. I also
cleared the firewall rules.
>>
>> When I try to add the storage domain, I get the following error
>>
>>
>> 2014-08-12 14:07:07,346 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName =
node3.test.nu, HostId = 5bff5a65-6d3c-46b4-aa7c-d87ab25ccb3a), log id: 5d2ee913
>> 2014-08-12 14:07:07,350 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) Command GlusterVolumesListVDSCommand(HostName =
node3.test.nu, HostId = 5bff5a65-6d3c-46b4-aa7c-d87ab25ccb3a) execution failed. Exception:
VDSNetworkException: org.apache.xmlrpc.XmlRpcException: <type
'exceptions.Exception'>:method "glusterVolumesList" is not supported
>> 2014-08-12 14:07:07,350 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, log id: 5d2ee913
>> 2014-08-12 14:07:07,351 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob]
(DefaultQuartzScheduler_Worker-65) Error while refreshing Gluster lightweight data of
cluster Default!: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method
"glusterVolumesList" is not supported (Failed with error VDS_NETWORK_ERROR and
code 5022)
>> at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:116)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33)
[bll.jar:]
>> at org.ovirt.engine.core.bll.gluster.GlusterJob.runVdsCommand(GlusterJob.java:65)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:406)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:392)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshVolumeData(GlusterSyncJob.java:363)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterData(GlusterSyncJob.java:108)
[bll.jar:]
>> at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData(GlusterSyncJob.java:87)
[bll.jar:]
>> at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) [:1.7.0_65]
>> at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_65]
>> at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65]
>> at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
[scheduler.jar:]
>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:]
>> at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
[quartz.jar:]
>>
>> Anything else I need to configure?
>>
>> Kind regards,
>> Jorick Astrego
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users

--------------070803020402090000070500
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <br>
    <div class="moz-cite-prefix">On 08/12/2014 03:44 PM, Sahina Bose
      wrote:<br>
    </div>
    <blockquote cite="mid:53EA1A29.5080806@redhat.com"
type="cite">
      <meta content="text/html; charset=ISO-8859-1"
        http-equiv="Content-Type">
      Could you provide the vdsm and supervdsm log from the node?<br>
      <br>
    </blockquote>
    vdsm:<br>
    <a class="moz-txt-link-freetext"
href="http://pastebin.com/edZrvnkr">http://pastebin.com/edZr...
    (cut some repetitive loglines out to fit on pastebin)<br>
    <br>
    Supervdsm:<br>
    <br>
    <a class="moz-txt-link-freetext"
href="http://pastebin.com/V8xTTMKk">http://pastebin.com/V8xT...
    <blockquote cite="mid:53EA1A29.5080806@redhat.com"
type="cite">
      <div class="moz-cite-prefix">On 08/12/2014 07:08 PM, Jorick
        Astrego wrote:<br>
      </div>
      <blockquote cite="mid:53EA18EE.6030103@netbulae.eu"
type="cite">
        <meta content="text/html; charset=ISO-8859-1"
          http-equiv="Content-Type">
        Hi,<br>
        <br>
        No restarting glusterfsd doesn't help. The steps in the link you
        gave me don't help either. The node is clean installed and has
        never been a part of a glusterfs.... Running gluster version
        3.5.2 <br>
        <blockquote>glusterfs-server-3.5.2-1.el7.x86_64<br>
          glusterfs-api-3.5.2-1.el7.x86_64<br>
          glusterfs-fuse-3.5.2-1.el7.x86_64<br>
          glusterfs-cli-3.5.2-1.el7.x86_64<br>
          vdsm-gluster-4.16.1-4.gitb2bf270.el7.noarch<br>
          glusterfs-libs-3.5.2-1.el7.x86_64<br>
          glusterfs-3.5.2-1.el7.x86_64<br>
          glusterfs-rdma-3.5.2-1.el7.x86_64<br>
          <br>
        </blockquote>
        From the log:<br>
        <blockquote>[2014-08-12 11:57:30.006092] W
          [glusterfsd.c:1095:cleanup_and_exit]
          (--&gt;/lib64/libc.so.6(clone+0x6d) [0x7fac29bc23dd]
          (--&gt;/lib64/libpthread.so.0(+0x7df3) [0x7fac2a279df3]
          (--&gt;/usr/sbin/glusterd(glusterfs_sigwaiter+0xe5)
          [0x7fac2b8471b5]))) 0-: received signum (15), shutting down<br>
          [2014-08-12 11:57:30.014919] I [glusterfsd.c:1959:main]
          0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd
          version 3.5.2 (/usr/sbin/glusterd -p /run/glusterd.pid)<br>
          [2014-08-12 11:57:30.018089] I [glusterd.c:1122:init]
          0-management: Using /var/lib/glusterd as working directory<br>
          [2014-08-12 11:57:30.020315] I [socket.c:3561:socket_init]
          0-socket.management: SSL support is NOT enabled<br>
          [2014-08-12 11:57:30.020331] I [socket.c:3576:socket_init]
          0-socket.management: using system polling thread<br>
          [2014-08-12 11:57:30.021533] W
          [rdma.c:4194:__gf_rdma_ctx_create] 0-rpc-transport/rdma:
          rdma_cm event channel creation failed (No such device)<br>
          [2014-08-12 11:57:30.021548] E [rdma.c:4482:init]
          0-rdma.management: Failed to initialize IB Device<br>
          [2014-08-12 11:57:30.021555] E
          [rpc-transport.c:333:rpc_transport_load] 0-rpc-transport:
          'rdma' initialization failed<br>
          [2014-08-12 11:57:30.021610] W
          [rpcsvc.c:1535:rpcsvc_transport_create] 0-rpc-service: cannot
          create listener, initing the transport failed<br>
          [2014-08-12 11:57:30.021669] I [socket.c:3561:socket_init]
          0-socket.management: SSL support is NOT enabled<br>
          [2014-08-12 11:57:30.021679] I [socket.c:3576:socket_init]
          0-socket.management: using system polling thread<br>
          [2014-08-12 11:57:30.022603] I
          [glusterd.c:367:glusterd_check_gsync_present] 0-glusterd:
          geo-replication module not installed in the system<br>
          <b>[2014-08-12 11:57:30.023046] E
            [store.c:408:gf_store_handle_retrieve] 0-: Path
            corresponding to /var/lib/glusterd/glusterd.info, returned
            error: (No such file or directory)</b><b><br>
          </b><b>[2014-08-12 11:57:30.023075] E
            [store.c:408:gf_store_handle_retrieve] 0-: Path
            corresponding to /var/lib/glusterd/glusterd.info, returned
            error: (No such file or directory)</b><br>
          [2014-08-12 11:57:30.023090] I
          [glusterd-store.c:1441:glusterd_restore_op_version]
          0-management: Detected new install. Setting op-version to
          maximum : 30501<br>
          Final graph:<br>
+------------------------------------------------------------------------------+<br>
          &nbsp; 1: volume management<br>
          &nbsp; 2:&nbsp;&nbsp;&nbsp;&nbsp; type
mgmt/glusterd<br>
          &nbsp; 3:&nbsp;&nbsp;&nbsp;&nbsp; option
rpc-auth.auth-glusterfs on<br>
          &nbsp; 4:&nbsp;&nbsp;&nbsp;&nbsp; option rpc-auth.auth-unix
on<br>
          &nbsp; 5:&nbsp;&nbsp;&nbsp;&nbsp; option rpc-auth.auth-null
on<br>
          &nbsp; 6:&nbsp;&nbsp;&nbsp;&nbsp; option
transport.socket.listen-backlog 128<br>
          &nbsp; 7:&nbsp;&nbsp;&nbsp;&nbsp; option
transport.socket.read-fail-log off<br>
          &nbsp; 8:&nbsp;&nbsp;&nbsp;&nbsp; option
transport.socket.keepalive-interval 2<br>
          &nbsp; 9:&nbsp;&nbsp;&nbsp;&nbsp; option
transport.socket.keepalive-time 10<br>
          &nbsp;10:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type
rdma<br>
          &nbsp;11:&nbsp;&nbsp;&nbsp;&nbsp; option working-directory
/var/lib/glusterd<br>
          &nbsp;12: end-volume<br>
          &nbsp;13: <br>
+------------------------------------------------------------------------------+<br>
          <br>
        </blockquote>
        Jorick<br>
        <br>
        <div class="moz-cite-prefix">On 08/12/2014 02:56 PM, Maor
          Lipchuk wrote:<br>
        </div>
        <blockquote

cite="mid:1418364179.36891472.1407848205422.JavaMail.zimbra@redhat.com"
          type="cite">
          <pre wrap="">Hi Jorick,
which version of GlusterFS are you using?

Try to restart glusterd on each of the bricks, then try to follow this link:
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-part-of-a-volume/">http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-part-of-a-volume/</a>

Please tell me if this helps

Regards,
Maor

----- Original Message -----
From: "Jorick Astrego" <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:j.astrego@netbulae.eu">&lt;j.astrego@netbulae.eu&gt;</a>
To: <a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:users@ovirt.org">users@ovirt.org</a>
Sent: Tuesday, August 12, 2014 3:16:06 PM
Subject: [ovirt-users] method "glusterVolumesList" is not supported (Failed with
error VDS_NETWORK_ERROR and code 5022)

Hi, 

I'm trying to test glusterfs on a couple of Centos 7 ovirt nodes with ovirt 3.5rc1. 

I've enabled glusterfs service for the cluster, created a xfs data partition with
mount point, installed "vdsm-gluster" rpm and started glusterfsd. I also cleared
the firewall rules. 

When I try to add the storage domain, I get the following error 

2014-08-12 14:07:07,346 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName =
node3.test.nu, HostId = 5bff5a65-6d3c-46b4-aa7c-d87ab25ccb3a), log id: 5d2ee913 
2014-08-12 14:07:07,350 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) Command GlusterVolumesListVDSCommand(HostName =
node3.test.nu, HostId = 5bff5a65-6d3c-46b4-aa7c-d87ab25ccb3a) execution failed. Exception:
VDSNetworkException: org.apache.xmlrpc.XmlRpcException: &lt;type
'exceptions.Exception'&gt;:method "glusterVolumesList" is not
supported 
2014-08-12 14:07:07,350 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, log id: 5d2ee913

2014-08-12 14:07:07,351 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob]
(DefaultQuartzScheduler_Worker-65) Error while refreshing Gluster lightweight data of
cluster Default!: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
org.apache.xmlrpc.XmlRpcException: &lt;type
'exceptions.Exception'&gt;:method "glusterVolumesList" is not
supported (Failed with error VDS_NETWORK_ERROR and code 5022) 
at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:116) [bll.jar:] 
at
org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33)
[bll.jar:] 
at org.ovirt.engine.core.bll.gluster.GlusterJob.runVdsCommand(GlusterJob.java:65)
[bll.jar:] 
at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:406)
[bll.jar:] 
at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:392)
[bll.jar:] 
at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshVolumeData(GlusterSyncJob.java:363)
[bll.jar:] 
at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterData(GlusterSyncJob.java:108)
[bll.jar:] 
at
org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData(GlusterSyncJob.java:87)
[bll.jar:] 
at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) [:1.7.0_65] 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_65] 
at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] 
at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
[scheduler.jar:] 
at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] 
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
[quartz.jar:] 

Anything else I need to configure? 

Kind regards, 
Jorick Astrego 

_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
        </blockquote>
        <br>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <br>
        <pre wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
      </blockquote>
      <br>
    </blockquote>
    <br>
  </body>
</html>

--------------070803020402090000070500--

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

Re: [ovirt-users] method "glusterVolumesList" is not supported (Failed with error VDS_NETWORK_ERROR and code 5022)