From paf1 at email.cz Sat Nov 7 06:29:01 2015 Content-Type: multipart/mixed; boundary="===============3222664209074614915==" MIME-Version: 1.0 From: paf1 at email.cz To: users at ovirt.org Subject: [ovirt-users] volume parameters Date: Sat, 07 Nov 2015 12:28:57 +0100 Message-ID: <563DE079.30003@email.cz> --===============3222664209074614915== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------040806050807030204000908 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 7bit Hello, would U recommend me set of functional params for volume replica 2 ? Old ones was ( for 3.5.2 gluster version ) storage.owner-uid 36 storage.owner-gid 36 performance.io-cache off performance.read-ahead off network.remote-dio enable cluster.eager-lock enable performance.stat-prefetch off performance.quick-read off cluster.quorum-count 1 cluster.server-quorum-type none cluster.quorum-type fixed after upgrade to 3.5.7 version and setting default recommendation, = volumes became inaccessable ( permission denied - fixed by owner uid/gui = settings to 36) Why the defaults have been changed ? Just still Error / Critical messages occure ( examples follow ) *E* - list of grep etc-glusterfs-glusterd.vol.log [2015-11-07 10:49:10.883564] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument [2015-11-07 10:49:10.886152] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument [2015-11-07 10:49:15.954942] E [rpc-clnt.c:362:saved_frames_unwind] (--> = /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7fa88b014a66] (--> = /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7fa88addf9be] (--> = /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fa88addface] (--> = /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7fa88ade148c] = (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fa88ade1c98] ))))) = 0-management: forced unwinding frame type(Peer mgmt) op(--(2)) called at = 2015-11-07 10:49:10.918764 (xid=3D0x5) [2015-11-07 10:49:26.719176] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument [2015-11-07 10:54:59.738232] E [MSGID: 106243] [glusterd.c:1623:init] = 0-management: creation of 1 listeners failed, continuing with succeeded = transport [2015-11-07 10:55:01.860991] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument [2015-11-07 10:55:01.863932] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument [2015-11-07 10:55:01.866779] E [socket.c:2965:socket_connect] = 0-management: Failed to set keep-alive: Invalid argument *C* - list of grep etc-glusterfs-glusterd.vol.log [2015-11-07 10:49:16.045778] C [MSGID: 106003] = [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] = 0-management: Server quorum regained for volume 1KVM12-P4. Starting = local bricks. [2015-11-07 10:49:16.049319] C [MSGID: 106003] = [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] = 0-management: Server quorum regained for volume 1KVM12-P5. Starting = local bricks. regs.Paf1 --------------040806050807030204000908 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit Hello,
would U recommend me set of functional params for volume replica 2 ?
Old ones was=C2=A0 ( for 3.5.2 gluster version )
storage.owner-uid=C2=A0=C2=A0 36
storage.owner-gid=C2=A0=C2=A0 36
performance.io-cache=C2=A0 off
performance.read-ahead=C2=A0 off
network.remote-dio enable
cluster.eager-lock enable
performance.stat-prefetch off
performance.quick-read off
cluster.quorum-count 1
cluster.server-quorum-type none
cluster.quorum-type=C2=A0 fixed

after upgrade to 3.5.7 version and setting default recommendation, volumes became inaccessable ( permission denied - fixed by owner uid/gui settings to 36)
Why the defaults have been changed=C2=A0 ?
Just still Error / Critical messages occure=C2=A0 ( examples follow )
*E* - list of grep=C2=A0 etc-glusterfs-glusterd.vol.log
[2015-11-07 10:49:10.883564] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
[2015-11-07 10:49:10.886152] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
[2015-11-07 10:49:15.954942] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7fa88b014a66] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7fa88addf9be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fa88addface] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7fa88ade148c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fa88ade1c98] ))))) 0-management: forced unwinding frame type(Peer mgmt) op(--(2)) called at 2015-11-07 10:49:10.918764 (xid=3D0x5)
[2015-11-07 10:49:26.719176] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
[2015-11-07 10:54:59.738232] E [MSGID: 106243] [glusterd.c:1623:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
[2015-11-07 10:55:01.860991] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
[2015-11-07 10:55:01.863932] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument
[2015-11-07 10:55:01.866779] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument

*C* - list of grep=C2=A0 etc-glusterfs-glusterd.vol.log
[2015-11-07 10:49:16.045778] C [MSGID: 106003] [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] 0-management: Server quorum regained for volume 1KVM12-P4. Starting local bricks.
[2015-11-07 10:49:16.049319] C [MSGID: 106003] [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] 0-management: Server quorum regained for volume 1KVM12-P5. Starting local bricks.

regs.Paf1


--------------040806050807030204000908-- --===============3222664209074614915== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wNDA4MDYwNTA4MDcwMzAyMDQwMDA5MDgKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK CkhlbGxvLAp3b3VsZCBVIHJlY29tbWVuZCBtZSBzZXQgb2YgZnVuY3Rpb25hbCBwYXJhbXMgZm9y IHZvbHVtZSByZXBsaWNhIDIgPwpPbGQgb25lcyB3YXMgICggZm9yIDMuNS4yIGdsdXN0ZXIgdmVy c2lvbiApCnN0b3JhZ2Uub3duZXItdWlkICAgMzYKc3RvcmFnZS5vd25lci1naWQgICAzNgpwZXJm b3JtYW5jZS5pby1jYWNoZSAgb2ZmCnBlcmZvcm1hbmNlLnJlYWQtYWhlYWQgIG9mZgpuZXR3b3Jr LnJlbW90ZS1kaW8gZW5hYmxlCmNsdXN0ZXIuZWFnZXItbG9jayBlbmFibGUKcGVyZm9ybWFuY2Uu c3RhdC1wcmVmZXRjaCBvZmYKcGVyZm9ybWFuY2UucXVpY2stcmVhZCBvZmYKY2x1c3Rlci5xdW9y dW0tY291bnQgMQpjbHVzdGVyLnNlcnZlci1xdW9ydW0tdHlwZSBub25lCmNsdXN0ZXIucXVvcnVt LXR5cGUgIGZpeGVkCgphZnRlciB1cGdyYWRlIHRvIDMuNS43IHZlcnNpb24gYW5kIHNldHRpbmcg ZGVmYXVsdCByZWNvbW1lbmRhdGlvbiwgCnZvbHVtZXMgYmVjYW1lIGluYWNjZXNzYWJsZSAoIHBl cm1pc3Npb24gZGVuaWVkIC0gZml4ZWQgYnkgb3duZXIgdWlkL2d1aSAKc2V0dGluZ3MgdG8gMzYp CldoeSB0aGUgZGVmYXVsdHMgaGF2ZSBiZWVuIGNoYW5nZWQgID8KSnVzdCBzdGlsbCBFcnJvciAv IENyaXRpY2FsIG1lc3NhZ2VzIG9jY3VyZSAgKCBleGFtcGxlcyBmb2xsb3cgKQoKKkUqIC0gbGlz dCBvZiBncmVwICBldGMtZ2x1c3RlcmZzLWdsdXN0ZXJkLnZvbC5sb2cKWzIwMTUtMTEtMDcgMTA6 NDk6MTAuODgzNTY0XSBFIFtzb2NrZXQuYzoyOTY1OnNvY2tldF9jb25uZWN0XSAKMC1tYW5hZ2Vt ZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6IEludmFsaWQgYXJndW1lbnQKWzIwMTUtMTEt MDcgMTA6NDk6MTAuODg2MTUyXSBFIFtzb2NrZXQuYzoyOTY1OnNvY2tldF9jb25uZWN0XSAKMC1t YW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6IEludmFsaWQgYXJndW1lbnQKWzIw MTUtMTEtMDcgMTA6NDk6MTUuOTU0OTQyXSBFIFtycGMtY2xudC5jOjM2MjpzYXZlZF9mcmFtZXNf dW53aW5kXSAoLS0+IAovbGliNjQvbGliZ2x1c3RlcmZzLnNvLjAoX2dmX2xvZ19jYWxsaW5nZm4r MHgxOTYpWzB4N2ZhODhiMDE0YTY2XSAoLS0+IAovbGliNjQvbGliZ2ZycGMuc28uMChzYXZlZF9m cmFtZXNfdW53aW5kKzB4MWRlKVsweDdmYTg4YWRkZjliZV0gKC0tPiAKL2xpYjY0L2xpYmdmcnBj LnNvLjAoc2F2ZWRfZnJhbWVzX2Rlc3Ryb3krMHhlKVsweDdmYTg4YWRkZmFjZV0gKC0tPiAKL2xp YjY0L2xpYmdmcnBjLnNvLjAocnBjX2NsbnRfY29ubmVjdGlvbl9jbGVhbnVwKzB4OWMpWzB4N2Zh ODhhZGUxNDhjXSAKKC0tPiAvbGliNjQvbGliZ2ZycGMuc28uMChycGNfY2xudF9ub3RpZnkrMHg4 OClbMHg3ZmE4OGFkZTFjOThdICkpKSkpIAowLW1hbmFnZW1lbnQ6IGZvcmNlZCB1bndpbmRpbmcg ZnJhbWUgdHlwZShQZWVyIG1nbXQpIG9wKC0tKDIpKSBjYWxsZWQgYXQgCjIwMTUtMTEtMDcgMTA6 NDk6MTAuOTE4NzY0ICh4aWQ9MHg1KQpbMjAxNS0xMS0wNyAxMDo0OToyNi43MTkxNzZdIEUgW3Nv Y2tldC5jOjI5NjU6c29ja2V0X2Nvbm5lY3RdIAowLW1hbmFnZW1lbnQ6IEZhaWxlZCB0byBzZXQg a2VlcC1hbGl2ZTogSW52YWxpZCBhcmd1bWVudApbMjAxNS0xMS0wNyAxMDo1NDo1OS43MzgyMzJd IEUgW01TR0lEOiAxMDYyNDNdIFtnbHVzdGVyZC5jOjE2MjM6aW5pdF0gCjAtbWFuYWdlbWVudDog Y3JlYXRpb24gb2YgMSBsaXN0ZW5lcnMgZmFpbGVkLCBjb250aW51aW5nIHdpdGggc3VjY2VlZGVk IAp0cmFuc3BvcnQKWzIwMTUtMTEtMDcgMTA6NTU6MDEuODYwOTkxXSBFIFtzb2NrZXQuYzoyOTY1 OnNvY2tldF9jb25uZWN0XSAKMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6 IEludmFsaWQgYXJndW1lbnQKWzIwMTUtMTEtMDcgMTA6NTU6MDEuODYzOTMyXSBFIFtzb2NrZXQu YzoyOTY1OnNvY2tldF9jb25uZWN0XSAKMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAt YWxpdmU6IEludmFsaWQgYXJndW1lbnQKWzIwMTUtMTEtMDcgMTA6NTU6MDEuODY2Nzc5XSBFIFtz b2NrZXQuYzoyOTY1OnNvY2tldF9jb25uZWN0XSAKMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0 IGtlZXAtYWxpdmU6IEludmFsaWQgYXJndW1lbnQKCipDKiAtIGxpc3Qgb2YgZ3JlcCAgZXRjLWds dXN0ZXJmcy1nbHVzdGVyZC52b2wubG9nClsyMDE1LTExLTA3IDEwOjQ5OjE2LjA0NTc3OF0gQyBb TVNHSUQ6IDEwNjAwM10gCltnbHVzdGVyZC1zZXJ2ZXItcXVvcnVtLmM6MzQ2OmdsdXN0ZXJkX2Rv X3ZvbHVtZV9xdW9ydW1fYWN0aW9uXSAKMC1tYW5hZ2VtZW50OiBTZXJ2ZXIgcXVvcnVtIHJlZ2Fp bmVkIGZvciB2b2x1bWUgMUtWTTEyLVA0LiBTdGFydGluZyAKbG9jYWwgYnJpY2tzLgpbMjAxNS0x MS0wNyAxMDo0OToxNi4wNDkzMTldIEMgW01TR0lEOiAxMDYwMDNdIApbZ2x1c3RlcmQtc2VydmVy LXF1b3J1bS5jOjM0NjpnbHVzdGVyZF9kb192b2x1bWVfcXVvcnVtX2FjdGlvbl0gCjAtbWFuYWdl bWVudDogU2VydmVyIHF1b3J1bSByZWdhaW5lZCBmb3Igdm9sdW1lIDFLVk0xMi1QNS4gU3RhcnRp bmcgCmxvY2FsIGJyaWNrcy4KCnJlZ3MuUGFmMQoKCgotLS0tLS0tLS0tLS0tLTA0MDgwNjA1MDgw NzAzMDIwNDAwMDkwOApDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250 ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA4Yml0Cgo8aHRtbD4KICA8aGVhZD4KCiAgICA8bWV0YSBo dHRwLWVxdWl2PSJjb250ZW50LXR5cGUiIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD11dGYt OCI+CiAgPC9oZWFkPgogIDxib2R5IHRleHQ9IiMwMDAwNjYiIGJnY29sb3I9IiNGRkZGRkYiPgog ICAgSGVsbG8sIDxicj4KICAgIHdvdWxkIFUgcmVjb21tZW5kIG1lIHNldCBvZiBmdW5jdGlvbmFs IHBhcmFtcyBmb3Igdm9sdW1lIHJlcGxpY2EgMiA/PGJyPgogICAgT2xkIG9uZXMgd2FzwqAgKCBm b3IgMy41LjIgZ2x1c3RlciB2ZXJzaW9uICk8YnI+CiAgICBzdG9yYWdlLm93bmVyLXVpZMKgwqAg MzY8YnI+CiAgICBzdG9yYWdlLm93bmVyLWdpZMKgwqAgMzY8YnI+CiAgICBwZXJmb3JtYW5jZS5p by1jYWNoZcKgIG9mZjxicj4KICAgIHBlcmZvcm1hbmNlLnJlYWQtYWhlYWTCoCBvZmY8YnI+CiAg ICBuZXR3b3JrLnJlbW90ZS1kaW8gZW5hYmxlPGJyPgogICAgY2x1c3Rlci5lYWdlci1sb2NrIGVu YWJsZTxicj4KICAgIHBlcmZvcm1hbmNlLnN0YXQtcHJlZmV0Y2ggb2ZmPGJyPgogICAgcGVyZm9y bWFuY2UucXVpY2stcmVhZCBvZmY8YnI+CiAgICBjbHVzdGVyLnF1b3J1bS1jb3VudCAxPGJyPgog ICAgY2x1c3Rlci5zZXJ2ZXItcXVvcnVtLXR5cGUgbm9uZTxicj4KICAgIGNsdXN0ZXIucXVvcnVt LXR5cGXCoCBmaXhlZDxicj4KICAgIDxicj4KICAgIGFmdGVyIHVwZ3JhZGUgdG8gMy41LjcgdmVy c2lvbiBhbmQgc2V0dGluZyBkZWZhdWx0IHJlY29tbWVuZGF0aW9uLAogICAgdm9sdW1lcyBiZWNh bWUgaW5hY2Nlc3NhYmxlICggcGVybWlzc2lvbiBkZW5pZWQgLSBmaXhlZCBieSBvd25lcgogICAg dWlkL2d1aSBzZXR0aW5ncyB0byAzNik8YnI+CiAgICBXaHkgdGhlIGRlZmF1bHRzIGhhdmUgYmVl biBjaGFuZ2VkwqAgPzxicj4KICAgIEp1c3Qgc3RpbGwgRXJyb3IgLyBDcml0aWNhbCBtZXNzYWdl cyBvY2N1cmXCoCAoIGV4YW1wbGVzIGZvbGxvdyApPGJyPgogICAgPGJyPgogICAgKkUqIC0gbGlz dCBvZiBncmVwwqAgZXRjLWdsdXN0ZXJmcy1nbHVzdGVyZC52b2wubG9nPGJyPgogICAgWzIwMTUt MTEtMDcgMTA6NDk6MTAuODgzNTY0XSBFIFtzb2NrZXQuYzoyOTY1OnNvY2tldF9jb25uZWN0XQog ICAgMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6IEludmFsaWQgYXJndW1l bnQ8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo0OToxMC44ODYxNTJdIEUgW3NvY2tldC5jOjI5NjU6 c29ja2V0X2Nvbm5lY3RdCiAgICAwLW1hbmFnZW1lbnQ6IEZhaWxlZCB0byBzZXQga2VlcC1hbGl2 ZTogSW52YWxpZCBhcmd1bWVudDxicj4KICAgIFsyMDE1LTExLTA3IDEwOjQ5OjE1Ljk1NDk0Ml0g RSBbcnBjLWNsbnQuYzozNjI6c2F2ZWRfZnJhbWVzX3Vud2luZF0KICAgICgtLSZndDsKICAgIC9s aWI2NC9saWJnbHVzdGVyZnMuc28uMChfZ2ZfbG9nX2NhbGxpbmdmbisweDE5NilbMHg3ZmE4OGIw MTRhNjZdCiAgICAoLS0mZ3Q7CiAgICAvbGliNjQvbGliZ2ZycGMuc28uMChzYXZlZF9mcmFtZXNf dW53aW5kKzB4MWRlKVsweDdmYTg4YWRkZjliZV0KICAgICgtLSZndDsKICAgIC9saWI2NC9saWJn ZnJwYy5zby4wKHNhdmVkX2ZyYW1lc19kZXN0cm95KzB4ZSlbMHg3ZmE4OGFkZGZhY2VdCiAgICAo LS0mZ3Q7CiAgICAvbGliNjQvbGliZ2ZycGMuc28uMChycGNfY2xudF9jb25uZWN0aW9uX2NsZWFu dXArMHg5YylbMHg3ZmE4OGFkZTE0OGNdCiAgICAoLS0mZ3Q7IC9saWI2NC9saWJnZnJwYy5zby4w KHJwY19jbG50X25vdGlmeSsweDg4KVsweDdmYTg4YWRlMWM5OF0KICAgICkpKSkpIDAtbWFuYWdl bWVudDogZm9yY2VkIHVud2luZGluZyBmcmFtZSB0eXBlKFBlZXIgbWdtdCkgb3AoLS0oMikpCiAg ICBjYWxsZWQgYXQgMjAxNS0xMS0wNyAxMDo0OToxMC45MTg3NjQgKHhpZD0weDUpPGJyPgogICAg WzIwMTUtMTEtMDcgMTA6NDk6MjYuNzE5MTc2XSBFIFtzb2NrZXQuYzoyOTY1OnNvY2tldF9jb25u ZWN0XQogICAgMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6IEludmFsaWQg YXJndW1lbnQ8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo1NDo1OS43MzgyMzJdIEUgW01TR0lEOiAx MDYyNDNdCiAgICBbZ2x1c3RlcmQuYzoxNjIzOmluaXRdIDAtbWFuYWdlbWVudDogY3JlYXRpb24g b2YgMSBsaXN0ZW5lcnMgZmFpbGVkLAogICAgY29udGludWluZyB3aXRoIHN1Y2NlZWRlZCB0cmFu c3BvcnQ8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo1NTowMS44NjA5OTFdIEUgW3NvY2tldC5jOjI5 NjU6c29ja2V0X2Nvbm5lY3RdCiAgICAwLW1hbmFnZW1lbnQ6IEZhaWxlZCB0byBzZXQga2VlcC1h bGl2ZTogSW52YWxpZCBhcmd1bWVudDxicj4KICAgIFsyMDE1LTExLTA3IDEwOjU1OjAxLjg2Mzkz Ml0gRSBbc29ja2V0LmM6Mjk2NTpzb2NrZXRfY29ubmVjdF0KICAgIDAtbWFuYWdlbWVudDogRmFp bGVkIHRvIHNldCBrZWVwLWFsaXZlOiBJbnZhbGlkIGFyZ3VtZW50PGJyPgogICAgWzIwMTUtMTEt MDcgMTA6NTU6MDEuODY2Nzc5XSBFIFtzb2NrZXQuYzoyOTY1OnNvY2tldF9jb25uZWN0XQogICAg MC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAtYWxpdmU6IEludmFsaWQgYXJndW1lbnQ8 YnI+CiAgICA8YnI+CiAgICAqQyogLSBsaXN0IG9mIGdyZXDCoCBldGMtZ2x1c3RlcmZzLWdsdXN0 ZXJkLnZvbC5sb2c8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo0OToxNi4wNDU3NzhdIEMgW01TR0lE OiAxMDYwMDNdCiAgICBbZ2x1c3RlcmQtc2VydmVyLXF1b3J1bS5jOjM0NjpnbHVzdGVyZF9kb192 b2x1bWVfcXVvcnVtX2FjdGlvbl0KICAgIDAtbWFuYWdlbWVudDogU2VydmVyIHF1b3J1bSByZWdh aW5lZCBmb3Igdm9sdW1lIDFLVk0xMi1QNC4gU3RhcnRpbmcKICAgIGxvY2FsIGJyaWNrcy48YnI+ CiAgICBbMjAxNS0xMS0wNyAxMDo0OToxNi4wNDkzMTldIEMgW01TR0lEOiAxMDYwMDNdCiAgICBb Z2x1c3RlcmQtc2VydmVyLXF1b3J1bS5jOjM0NjpnbHVzdGVyZF9kb192b2x1bWVfcXVvcnVtX2Fj dGlvbl0KICAgIDAtbWFuYWdlbWVudDogU2VydmVyIHF1b3J1bSByZWdhaW5lZCBmb3Igdm9sdW1l IDFLVk0xMi1QNS4gU3RhcnRpbmcKICAgIGxvY2FsIGJyaWNrcy48YnI+CiAgICA8YnI+CiAgICBy ZWdzLlBhZjE8YnI+CiAgICA8YnI+CiAgICA8YnI+CiAgPC9ib2R5Pgo8L2h0bWw+CgotLS0tLS0t LS0tLS0tLTA0MDgwNjA1MDgwNzAzMDIwNDAwMDkwOC0tCg== --===============3222664209074614915==-- From sbonazzo at redhat.com Mon Nov 9 07:14:27 2015 Content-Type: multipart/mixed; boundary="===============8850650102779719096==" MIME-Version: 1.0 From: Sandro Bonazzola To: users at ovirt.org Subject: Re: [ovirt-users] volume parameters Date: Mon, 09 Nov 2015 13:14:25 +0100 Message-ID: In-Reply-To: 563DE079.30003@email.cz --===============8850650102779719096== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Sat, Nov 7, 2015 at 12:28 PM, paf1(a)email.cz wrote: > Hello, > would U recommend me set of functional params for volume replica 2 ? > If you're planning to upgrade to 3.6.z in the near future please note that by default vdsm support replica 3 only starting from 3.6.0. For allowing replica 2 to be used by vdsm you'll need to manually change vdsm configuration file. > Old ones was ( for 3.5.2 gluster version ) > storage.owner-uid 36 > storage.owner-gid 36 > performance.io-cache off > performance.read-ahead off > network.remote-dio enable > cluster.eager-lock enable > performance.stat-prefetch off > performance.quick-read off > cluster.quorum-count 1 > cluster.server-quorum-type none > cluster.quorum-type fixed > > after upgrade to 3.5.7 version and setting default recommendation, volumes > became inaccessable ( permission denied - fixed by owner uid/gui settings > to 36) > Why the defaults have been changed ? > Just still Error / Critical messages occure ( examples follow ) > > *E* - list of grep etc-glusterfs-glusterd.vol.log > [2015-11-07 10:49:10.883564] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > [2015-11-07 10:49:10.886152] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > [2015-11-07 10:49:15.954942] E [rpc-clnt.c:362:saved_frames_unwind] (--> > /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7fa88b014a66] (--> > /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7fa88addf9be] (--> > /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7fa88addface] (--> > /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7fa88ade148c] (-= -> > /lib64/libgfrpc.so.0(rpc_clnt_notify+0x88)[0x7fa88ade1c98] ))))) > 0-management: forced unwinding frame type(Peer mgmt) op(--(2)) called at > 2015-11-07 10:49:10.918764 (xid=3D0x5) > [2015-11-07 10:49:26.719176] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > [2015-11-07 10:54:59.738232] E [MSGID: 106243] [glusterd.c:1623:init] > 0-management: creation of 1 listeners failed, continuing with succeeded > transport > [2015-11-07 10:55:01.860991] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > [2015-11-07 10:55:01.863932] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > [2015-11-07 10:55:01.866779] E [socket.c:2965:socket_connect] > 0-management: Failed to set keep-alive: Invalid argument > > *C* - list of grep etc-glusterfs-glusterd.vol.log > [2015-11-07 10:49:16.045778] C [MSGID: 106003] > [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] > 0-management: Server quorum regained for volume 1KVM12-P4. Starting local > bricks. > [2015-11-07 10:49:16.049319] C [MSGID: 106003] > [glusterd-server-quorum.c:346:glusterd_do_volume_quorum_action] > 0-management: Server quorum regained for volume 1KVM12-P5. Starting local > bricks. > > regs.Paf1 > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- = Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com --===============8850650102779719096== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIFNhdCwgTm92IDcsIDIwMTUgYXQgMTI6MjggUE0sIDxhIGhyZWY9 Im1haWx0bzpwYWYxQGVtYWlsLmN6Ij5wYWYxQGVtYWlsLmN6PC9hPiA8c3BhbiBkaXI9Imx0ciI+ Jmx0OzxhIGhyZWY9Im1haWx0bzpwYWYxQGVtYWlsLmN6IiB0YXJnZXQ9Il9ibGFuayI+cGFmMUBl bWFpbC5jejwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWls X3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29s aWQ7cGFkZGluZy1sZWZ0OjFleCI+CiAgCgogICAgCiAgCiAgPGRpdiB0ZXh0PSIjMDAwMDY2IiBi Z2NvbG9yPSIjRkZGRkZGIj4KICAgIEhlbGxvLCA8YnI+CiAgICB3b3VsZCBVIHJlY29tbWVuZCBt ZSBzZXQgb2YgZnVuY3Rpb25hbCBwYXJhbXMgZm9yIHZvbHVtZSByZXBsaWNhIDIgPzxicj48L2Rp dj48L2Jsb2NrcXVvdGU+PGRpdj48YnI+PC9kaXY+PGRpdj5JZiB5b3UmIzM5O3JlIHBsYW5uaW5n IHRvIHVwZ3JhZGUgdG8gMy42LnogaW4gdGhlIG5lYXIgZnV0dXJlIHBsZWFzZSBub3RlIHRoYXQg YnkgZGVmYXVsdCB2ZHNtIHN1cHBvcnQgcmVwbGljYSAzIG9ubHkgc3RhcnRpbmcgZnJvbSAzLjYu MC48L2Rpdj48ZGl2PkZvciBhbGxvd2luZyByZXBsaWNhIDIgdG8gYmUgdXNlZCBieSB2ZHNtIHlv dSYjMzk7bGwgbmVlZCB0byBtYW51YWxseSBjaGFuZ2UgdmRzbSBjb25maWd1cmF0aW9uIGZpbGUu PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj7CoDwvZGl2PjxibG9ja3F1 b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1s ZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgdGV4dD0iIzAwMDA2NiIg Ymdjb2xvcj0iI0ZGRkZGRiI+CiAgICBPbGQgb25lcyB3YXPCoCAoIGZvciAzLjUuMiBnbHVzdGVy IHZlcnNpb24gKTxicj4KICAgIHN0b3JhZ2Uub3duZXItdWlkwqDCoCAzNjxicj4KICAgIHN0b3Jh Z2Uub3duZXItZ2lkwqDCoCAzNjxicj4KICAgIHBlcmZvcm1hbmNlLmlvLWNhY2hlwqAgb2ZmPGJy PgogICAgcGVyZm9ybWFuY2UucmVhZC1haGVhZMKgIG9mZjxicj4KICAgIG5ldHdvcmsucmVtb3Rl LWRpbyBlbmFibGU8YnI+CiAgICBjbHVzdGVyLmVhZ2VyLWxvY2sgZW5hYmxlPGJyPgogICAgcGVy Zm9ybWFuY2Uuc3RhdC1wcmVmZXRjaCBvZmY8YnI+CiAgICBwZXJmb3JtYW5jZS5xdWljay1yZWFk IG9mZjxicj4KICAgIGNsdXN0ZXIucXVvcnVtLWNvdW50IDE8YnI+CiAgICBjbHVzdGVyLnNlcnZl ci1xdW9ydW0tdHlwZSBub25lPGJyPgogICAgY2x1c3Rlci5xdW9ydW0tdHlwZcKgIGZpeGVkPGJy PgogICAgPGJyPgogICAgYWZ0ZXIgdXBncmFkZSB0byAzLjUuNyB2ZXJzaW9uIGFuZCBzZXR0aW5n IGRlZmF1bHQgcmVjb21tZW5kYXRpb24sCiAgICB2b2x1bWVzIGJlY2FtZSBpbmFjY2Vzc2FibGUg KCBwZXJtaXNzaW9uIGRlbmllZCAtIGZpeGVkIGJ5IG93bmVyCiAgICB1aWQvZ3VpIHNldHRpbmdz IHRvIDM2KTxicj4KICAgIFdoeSB0aGUgZGVmYXVsdHMgaGF2ZSBiZWVuIGNoYW5nZWTCoCA/PGJy PgogICAgSnVzdCBzdGlsbCBFcnJvciAvIENyaXRpY2FsIG1lc3NhZ2VzIG9jY3VyZcKgICggZXhh bXBsZXMgZm9sbG93ICk8YnI+CiAgICA8YnI+CiAgICAqRSogLSBsaXN0IG9mIGdyZXDCoCBldGMt Z2x1c3RlcmZzLWdsdXN0ZXJkLnZvbC5sb2c8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo0OToxMC44 ODM1NjRdIEUgW3NvY2tldC5jOjI5NjU6c29ja2V0X2Nvbm5lY3RdCiAgICAwLW1hbmFnZW1lbnQ6 IEZhaWxlZCB0byBzZXQga2VlcC1hbGl2ZTogSW52YWxpZCBhcmd1bWVudDxicj4KICAgIFsyMDE1 LTExLTA3IDEwOjQ5OjEwLjg4NjE1Ml0gRSBbc29ja2V0LmM6Mjk2NTpzb2NrZXRfY29ubmVjdF0K ICAgIDAtbWFuYWdlbWVudDogRmFpbGVkIHRvIHNldCBrZWVwLWFsaXZlOiBJbnZhbGlkIGFyZ3Vt ZW50PGJyPgogICAgWzIwMTUtMTEtMDcgMTA6NDk6MTUuOTU0OTQyXSBFIFtycGMtY2xudC5jOjM2 MjpzYXZlZF9mcmFtZXNfdW53aW5kXQogICAgKC0tJmd0OwogICAgL2xpYjY0L2xpYmdsdXN0ZXJm cy5zby4wKF9nZl9sb2dfY2FsbGluZ2ZuKzB4MTk2KVsweDdmYTg4YjAxNGE2Nl0KICAgICgtLSZn dDsKICAgIC9saWI2NC9saWJnZnJwYy5zby4wKHNhdmVkX2ZyYW1lc191bndpbmQrMHgxZGUpWzB4 N2ZhODhhZGRmOWJlXQogICAgKC0tJmd0OwogICAgL2xpYjY0L2xpYmdmcnBjLnNvLjAoc2F2ZWRf ZnJhbWVzX2Rlc3Ryb3krMHhlKVsweDdmYTg4YWRkZmFjZV0KICAgICgtLSZndDsKICAgIC9saWI2 NC9saWJnZnJwYy5zby4wKHJwY19jbG50X2Nvbm5lY3Rpb25fY2xlYW51cCsweDljKVsweDdmYTg4 YWRlMTQ4Y10KICAgICgtLSZndDsgL2xpYjY0L2xpYmdmcnBjLnNvLjAocnBjX2NsbnRfbm90aWZ5 KzB4ODgpWzB4N2ZhODhhZGUxYzk4XQogICAgKSkpKSkgMC1tYW5hZ2VtZW50OiBmb3JjZWQgdW53 aW5kaW5nIGZyYW1lIHR5cGUoUGVlciBtZ210KSBvcCgtLSgyKSkKICAgIGNhbGxlZCBhdCAyMDE1 LTExLTA3IDEwOjQ5OjEwLjkxODc2NCAoeGlkPTB4NSk8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo0 OToyNi43MTkxNzZdIEUgW3NvY2tldC5jOjI5NjU6c29ja2V0X2Nvbm5lY3RdCiAgICAwLW1hbmFn ZW1lbnQ6IEZhaWxlZCB0byBzZXQga2VlcC1hbGl2ZTogSW52YWxpZCBhcmd1bWVudDxicj4KICAg IFsyMDE1LTExLTA3IDEwOjU0OjU5LjczODIzMl0gRSBbTVNHSUQ6IDEwNjI0M10KICAgIFtnbHVz dGVyZC5jOjE2MjM6aW5pdF0gMC1tYW5hZ2VtZW50OiBjcmVhdGlvbiBvZiAxIGxpc3RlbmVycyBm YWlsZWQsCiAgICBjb250aW51aW5nIHdpdGggc3VjY2VlZGVkIHRyYW5zcG9ydDxicj4KICAgIFsy MDE1LTExLTA3IDEwOjU1OjAxLjg2MDk5MV0gRSBbc29ja2V0LmM6Mjk2NTpzb2NrZXRfY29ubmVj dF0KICAgIDAtbWFuYWdlbWVudDogRmFpbGVkIHRvIHNldCBrZWVwLWFsaXZlOiBJbnZhbGlkIGFy Z3VtZW50PGJyPgogICAgWzIwMTUtMTEtMDcgMTA6NTU6MDEuODYzOTMyXSBFIFtzb2NrZXQuYzoy OTY1OnNvY2tldF9jb25uZWN0XQogICAgMC1tYW5hZ2VtZW50OiBGYWlsZWQgdG8gc2V0IGtlZXAt YWxpdmU6IEludmFsaWQgYXJndW1lbnQ8YnI+CiAgICBbMjAxNS0xMS0wNyAxMDo1NTowMS44NjY3 NzldIEUgW3NvY2tldC5jOjI5NjU6c29ja2V0X2Nvbm5lY3RdCiAgICAwLW1hbmFnZW1lbnQ6IEZh aWxlZCB0byBzZXQga2VlcC1hbGl2ZTogSW52YWxpZCBhcmd1bWVudDxicj4KICAgIDxicj4KICAg ICpDKiAtIGxpc3Qgb2YgZ3JlcMKgIGV0Yy1nbHVzdGVyZnMtZ2x1c3RlcmQudm9sLmxvZzxicj4K ICAgIFsyMDE1LTExLTA3IDEwOjQ5OjE2LjA0NTc3OF0gQyBbTVNHSUQ6IDEwNjAwM10KICAgIFtn bHVzdGVyZC1zZXJ2ZXItcXVvcnVtLmM6MzQ2OmdsdXN0ZXJkX2RvX3ZvbHVtZV9xdW9ydW1fYWN0 aW9uXQogICAgMC1tYW5hZ2VtZW50OiBTZXJ2ZXIgcXVvcnVtIHJlZ2FpbmVkIGZvciB2b2x1bWUg MUtWTTEyLVA0LiBTdGFydGluZwogICAgbG9jYWwgYnJpY2tzLjxicj4KICAgIFsyMDE1LTExLTA3 IDEwOjQ5OjE2LjA0OTMxOV0gQyBbTVNHSUQ6IDEwNjAwM10KICAgIFtnbHVzdGVyZC1zZXJ2ZXIt cXVvcnVtLmM6MzQ2OmdsdXN0ZXJkX2RvX3ZvbHVtZV9xdW9ydW1fYWN0aW9uXQogICAgMC1tYW5h Z2VtZW50OiBTZXJ2ZXIgcXVvcnVtIHJlZ2FpbmVkIGZvciB2b2x1bWUgMUtWTTEyLVA1LiBTdGFy dGluZwogICAgbG9jYWwgYnJpY2tzLjxicj4KICAgIDxicj4KICAgIHJlZ3MuUGFmMTxicj4KICAg IDxicj4KICAgIDxicj4KICA8L2Rpdj4KCjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXzxicj4KVXNlcnMgbWFpbGluZyBsaXN0PGJyPgo8YSBocmVmPSJt YWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyPgo8YSBocmVmPSJo dHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHJlbD0ibm9yZWZl cnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby91c2VyczwvYT48YnI+Cjxicj48L2Jsb2NrcXVvdGU+PC9kaXY+PGJyPjxiciBjbGVhcj0i YWxsIj48ZGl2Pjxicj48L2Rpdj4tLSA8YnI+PGRpdiBjbGFzcz0iZ21haWxfc2lnbmF0dXJlIj48 ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPlNhbmRybyBCb25henpvbGE8YnI+QmV0 dGVyIHRlY2hub2xvZ3kuIEZhc3RlciBpbm5vdmF0aW9uLiBQb3dlcmVkIGJ5IGNvbW11bml0eSBj b2xsYWJvcmF0aW9uLjxicj5TZWUgaG93IGl0IHdvcmtzIGF0IDxhIGhyZWY9Imh0dHA6Ly9yZWRo YXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+cmVkaGF0LmNvbTwvYT48YnI+PC9kaXY+PC9kaXY+PC9k aXY+PC9kaXY+CjwvZGl2PjwvZGl2Pgo= --===============8850650102779719096==--