... +------------------------------------------------------------------------------+ [2018-09-11 11:12:23.660837] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-engine-client-0: Connected to engine-client-0, attached to remote volume '/gluster/engine/brick'. [2018-09-11 11:12:23.660847] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-engine-client-0: Server and Client lk-version numbers are not same, reopening the fds [2018-09-11 11:12:23.660901] I [MSGID: 108005] [afr-common.c:4007:afr_notify] 0-engine-replicate-0: Subvolume 'engine-client-0' came back up; going online. [2018-09-11 11:12:23.660950] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-engine-client-0: Server lk version = 1 [2018-09-11 11:12:23.661295] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-engine-client-2: changing port to 49152 (from 0) [2018-09-11 11:12:23.663593] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-engine-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2018-09-11 11:12:23.663932] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-engine-client-1: Connected to engine-client-1, attached to remote volume '/gluster/engine/brick'. [2018-09-11 11:12:23.663944] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-engine-client-1: Server and Client lk-version numbers are not same, reopening the fds [2018-09-11 11:12:23.664098] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-engine-client-1: Server lk version = 1 [2018-09-11 11:12:23.665595] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-engine-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2018-09-11 11:12:23.666015] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-engine-client-2: Connected to engine-client-2, attached to remote volume '/gluster/engine/brick'. [2018-09-11 11:12:23.666026] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-engine-client-2: Server and Client lk-version numbers are not same, reopening the fds [2018-09-11 11:12:23.669658] I [fuse-bridge.c:5156:fuse_graph_setup] 0-fuse: switched to graph 0 [2018-09-11 11:12:23.669730] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-engine-client-2: Server lk version = 1 [2018-09-11 11:12:23.669877] I [fuse-bridge.c:4067:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22 kernel 7.22 [2018-09-11 11:12:23.671052] I [MSGID: 108031] [afr-common.c:1900:afr_local_discovery_cbk] 0-engine-replicate-0: selecting local read_child engine-client-0 [2018-09-11 11:12:58.290960] I [fuse-bridge.c:4997:fuse_thread_proc] 0-fuse: unmounting /rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine [2018-09-11 11:12:58.291759] W [glusterfsd.c:1251:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7fccc7e8bdc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fccc94f68b5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x69) [0x7fccc94f6739] ) 0-: received signum (15), shutting down [2018-09-11 11:12:58.291779] I [fuse-bridge.c:5704:fini] 0-fuse: Unmounting '/rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine'. [2018-09-11 11:12:58.916221] I [MSGID: 100030] [glusterfsd.c:2332:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.11 (args: /usr/sbin/glusterfs --volfile-server=glustermount.asterix --volfile-server=glustermount.obelix --volfile-server=glustermount.getafix --volfile-id=/engine /rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine) [2018-09-11 11:12:58.924453] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2018-09-11 11:12:58.932135] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2018-09-11 11:12:58.932749] I [MSGID: 114020] [client.c:2106:notify] 0-engine-client-0: parent translators are ready, attempting connect on transport [2018-09-11 11:12:58.934853] I [MSGID: 114020] [client.c:2106:notify] 0-engine-client-1: parent translators are ready, attempting connect on transport [2018-09-11 11:12:58.935059] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-engine-client-0: changing port to 49152 (from 0) [2018-09-11 11:12:58.936823] I [MSGID: 114020] [client.c:2106:notify] 0-engine-client-2: parent translators are ready, attempting connect on transport [2018-09-11 11:12:58.938984] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-engine-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2018-09-11 11:12:58.939206] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 0-engine-client-1: changing port to 49152 (from 0) Final graph: +------------------------------------------------------------------------------+ 1: volume engine-client-0 2: type protocol/client 3: option clnt-lk-version 1 4: option volfile-checksum 0 5: option volfile-key /engine 6: option client-version 3.7.11 7: option process-uuid asterix.csirt.ac.za-106770-2018/09/11-11:12:58:912410-engine-client-0-0-0 8: option fops-version 1298437 9: option ping-timeout 10 10: option remote-host glustermount.asterix 11: option remote-subvolume /gluster/engine/brick 12: option transport-type socket 13: option username d919e79e-3fa0-44e9-a5fa-ee8ffc3857e7 14: option password 167e6a8c-3913-438c-8ca0-2fe07c051150 15: option filter-O_DIRECT enable 16: option send-gids true 17: end-volume 18: 19: volume engine-client-1 20: type protocol/client 21: option ping-timeout 10 22: option remote-host glustermount.obelix 23: option remote-subvolume /gluster/engine/brick 24: option transport-type socket 25: option username d919e79e-3fa0-44e9-a5fa-ee8ffc3857e7 26: option password 167e6a8c-3913-438c-8ca0-2fe07c051150 27: option filter-O_DIRECT enable 28: option send-gids true 29: end-volume 30: 31: volume engine-client-2 32: type protocol/client 33: option ping-timeout 10 34: option remote-host glustermount.getafix 35: option remote-subvolume /gluster/engine/brick 36: option transport-type socket 37: option username d919e79e-3fa0-44e9-a5fa-ee8ffc3857e7 38: option password 167e6a8c-3913-438c-8ca0-2fe07c051150 39: option filter-O_DIRECT enable 40: option send-gids true 41: end-volume 42: 43: volume engine-replicate-0 44: type cluster/replicate 45: option eager-lock enable 46: option quorum-type auto 47: subvolumes engine-client-0 engine-client-1 engine-client-2 48: end-volume 49: 50: volume engine-dht 51: type cluster/distribute 52: subvolumes engine-replicate-0 53: end-volume 54: 55: volume engine-write-behind 56: type performance/write-behind 57: subvolumes engine-dht 58: end-volume 59: 60: volume engine-readdir-ahead 61: type performance/readdir-ahead 62: subvolumes engine-write-behind 63: end-volume 64: 65: volume engine-open-behind 66: type performance/open-behind 67: subvolumes engine-readdir-ahead 68: end-volume 69: 70: volume engine 71: type debug/io-stats 72: option log-level INFO 73: option latency-measurement off 74: option count-fop-hits off 75: subvolumes engine-open-behind 76: end-volume 77: 78: volume meta-autoload 79: type meta 80: subvolumes engine 81: end-volume 82: +------------------------------------------------------------------------------+ ...