Dear all, It would be great if someone will share any experience regarding the similar case, would be great to have a hint where to start investigation. Thanks again Cheers Erekle On 02/22/2018 05:05 PM, Erekle Magradze wrote:
Hello there,
I am facing the following problem from time to time one of the hypervisor (there are 3 of them)s is rebooting, I am using ovirt-release42-4.2.1-1.el7.centos.noarch and glsuter as a storage backend (glusterfs-3.12.5-2.el7.x86_64).
I am suspecting gluster because of the e.g. message bellow from one of the volumes,
Could you please help and suggest to which direction should investigation go?
Thanks in advance
Cheers
Erekle
[2018-02-22 15:36:10.011687] and [2018-02-22 15:37:10.955013] [2018-02-22 15:41:10.198701] I [MSGID: 109063] [dht-layout.c:716:dht_layout_normalize] 0-virtimages-dht: Found anomalies in (null) (gfid = 00000000-0000-0000-0000-000000000000). Holes=1 overlaps=0 [2018-02-22 15:41:10.198704] I [MSGID: 109063] [dht-layout.c:716:dht_layout_normalize] 0-virtimages-dht: Found anomalies in (null) (gfid = 00000000-0000-0000-0000-000000000000). Holes=1 overlaps=0 [2018-02-22 15:42:11.293608] I [MSGID: 109063] [dht-layout.c:716:dht_layout_normalize] 0-virtimages-dht: Found anomalies in (null) (gfid = 00000000-0000-0000-0000-000000000000). Holes=1 overlaps=0 [2018-02-22 15:53:16.245720] I [MSGID: 100030] [glusterfsd.c:2524:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.12.5 (args: /usr/sbin/glusterfs --volfile-server=10.0.0.21 --volfi le-server=10.0.0.22 --volfile-server=10.0.0.23 --volfile-id=/virtimages /rhev/data-center/mnt/glusterSD/10.0.0.21:_virtimages) [2018-02-22 15:53:16.263712] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-glusterfs: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2018-02-22 15:53:16.269595] I [MSGID: 101190] [event-epoll.c:613:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2018-02-22 15:53:16.273483] I [MSGID: 101190] [event-epoll.c:613:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2018-02-22 15:53:16.273594] W [MSGID: 101174] [graph.c:363:_log_if_unknown_option] 0-virtimages-readdir-ahead: option 'parallel-readdir' is not recognized [2018-02-22 15:53:16.273703] I [MSGID: 114020] [client.c:2360:notify] 0-virtimages-client-0: parent translators are ready, attempting connect on transport [2018-02-22 15:53:16.276455] I [MSGID: 114020] [client.c:2360:notify] 0-virtimages-client-1: parent translators are ready, attempting connect on transport [2018-02-22 15:53:16.276683] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-virtimages-client-0: changing port to 49152 (from 0) [2018-02-22 15:53:16.279191] I [MSGID: 114020] [client.c:2360:notify] 0-virtimages-client-2: parent translators are ready, attempting connect on transport [2018-02-22 15:53:16.282126] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-virtimages-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2018-02-22 15:53:16.282573] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-virtimages-client-0: Connected to virtimages-client-0, attached to remote volume '/mnt/virtimages/virtimgs'. [2018-02-22 15:53:16.282584] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-virtimages-client-0: Server and Client lk-version numbers are not same, reopening the fds [2018-02-22 15:53:16.282665] I [MSGID: 108005] [afr-common.c:4929:__afr_handle_child_up_event] 0-virtimages-replicate-0: Subvolume 'virtimages-client-0' came back up; going online. [2018-02-22 15:53:16.282877] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-virtimages-client-1: changing port to 49152 (from 0) [2018-02-22 15:53:16.282934] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-virtimages-client-0: Server lk version = 1
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Recogizer Group GmbH Dr.rer.nat. Erekle Magradze Lead Big Data Engineering & DevOps Rheinwerkallee 2, 53227 Bonn Tel: +49 228 29974555 E-Mail erekle.magradze@recogizer.de recogizer.com ----------------------------------------------------------------- Recogizer Group GmbH Geschäftsführer: Oliver Habisch, Carsten Kreutze Handelsregister: Amtsgericht Bonn HRB 20724 Sitz der Gesellschaft: Bonn; USt-ID-Nr.: DE294195993 Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und löschen Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail und der darin enthaltenen Informationen ist nicht gestattet.