3:54 a.m.
This is a multi-part message in MIME format.
--------------000703070201090008010903
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
Hi,
On 02/24/2016 06:43 AM, paf1(a)email.cz wrote:
Hi,
I found the main ( maybe ) problem with IO error ( -5 ) for "ids" file
access
This file is not accessable via NFS, locally yes
How is NFS coming into the
picture? Are you not using gluster fuse mount?
.
How can I fix it ??
Can you run `gluster volume heal volname info` and `gluster
volume heal
volname info split-brain` to see if the "ids" file is in split-brain? A
file in split-brain returns EIO when accessed from the mount.
Regards,
Ravi
regs.
Pavel
# sanlock client log_dump
....
0 flags 1 timeout 0
2016-02-24 02:01:10+0100 3828 [12111]: s1316 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
2016-02-24 02:01:10+0100 3828 [12111]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire begin
88adbd49-62d6-45b1-9992-b04464a04112:1
2016-02-24 02:01:10+0100 3828 [19556]: 88adbd49 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:10+0100 3828 [19556]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire
leader_read1 error -5
2016-02-24 02:01:11+0100 3829 [12111]: s1316 add_lockspace fail result -5
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0
flags 1 timeout 0
2016-02-24 02:01:12+0100 3831 [12116]: s1317 lockspace
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire begin
7f52b697-c199-4f58-89aa-102d44327124:1
2016-02-24 02:01:12+0100 3831 [19562]: 7f52b697 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:12+0100 3831 [19562]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire
leader_read1 error -5
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0
flags 1 timeout 0
2016-02-24 02:01:13+0100 3831 [1321]: s1318 lockspace
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire begin
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1
2016-02-24 02:01:13+0100 3831 [19564]: 0fcad888 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458201000 result -5:0 match res
2016-02-24 02:01:13+0100 3831 [19564]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire
leader_read1 error -5
2016-02-24 02:01:13+0100 3832 [12116]: s1317 add_lockspace fail result -5
2016-02-24 02:01:14+0100 3832 [1321]: s1318 add_lockspace fail result -5
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0
flags 1 timeout 0
2016-02-24 02:01:19+0100 3838 [12106]: s1319 lockspace
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire begin
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1
2016-02-24 02:01:19+0100 3838 [19638]: 3da46e07 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:19+0100 3838 [19638]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire
leader_read1 error -5
2016-02-24 02:01:20+0100 3839 [12106]: s1319 add_lockspace fail result -5
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
flags 1 timeout 0
2016-02-24 02:01:20+0100 3839 [1320]: s1320 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire begin
88adbd49-62d6-45b1-9992-b04464a04112:1
2016-02-24 02:01:20+0100 3839 [19658]: 88adbd49 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:20+0100 3839 [19658]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire
leader_read1 error -5
2016-02-24 02:01:21+0100 3840 [1320]: s1320 add_lockspace fail result -5
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------000703070201090008010903
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">Hi,<br>
<br>
On 02/24/2016 06:43 AM, <a class="moz-txt-link-abbreviated"
href="mailto:paf1@email.cz">paf1@email.cz</a> wrote:<br>
</div>
<blockquote cite="mid:56CD03D7.2070308@email.cz"
type="cite">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
Hi,<br>
I found the main ( maybe ) problem with IO error ( -5 ) for "ids"
file access<br>
This file is not accessable via NFS, locally yes</blockquote>
How is NFS coming into the picture? Are you not using gluster fuse
mount?
<blockquote cite="mid:56CD03D7.2070308@email.cz"
type="cite">.<br>
How can I fix it ??<br>
</blockquote>
Can you run `gluster volume heal volname info` and `gluster volume
heal volname info split-brain` to see if the "ids" file is in
split-brain? A file in split-brain returns EIO when accessed from
the mount.<br>
Regards,<br>
Ravi<br>
<br>
<br>
<blockquote cite="mid:56CD03D7.2070308@email.cz"
type="cite"> regs.<br>
Pavel<br>
<br>
# sanlock client log_dump<br>
....<br>
0 flags 1 timeout 0<br>
2016-02-24 02:01:10+0100 3828 [12111]: s1316 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0<br>
2016-02-24 02:01:10+0100 3828 [12111]: cmd_add_lockspace 4,15
async done 0<br>
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire begin
88adbd49-62d6-45b1-9992-b04464a04112:1<br>
2016-02-24 02:01:10+0100 3828 [19556]: 88adbd49 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
2016-02-24 02:01:10+0100 3828 [19556]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids<br>
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire
leader_read1 error -5<br>
2016-02-24 02:01:11+0100 3829 [12111]: s1316 add_lockspace fail
result -5<br>
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0
flags 1 timeout 0<br>
2016-02-24 02:01:12+0100 3831 [12116]: s1317 lockspace
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0<br>
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15
async done 0<br>
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire begin
7f52b697-c199-4f58-89aa-102d44327124:1<br>
2016-02-24 02:01:12+0100 3831 [19562]: 7f52b697 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
2016-02-24 02:01:12+0100 3831 [19562]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids<br>
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire
leader_read1 error -5<br>
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0
flags 1 timeout 0<br>
2016-02-24 02:01:13+0100 3831 [1321]: s1318 lockspace
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0<br>
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15 async
done 0<br>
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire begin
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1<br>
2016-02-24 02:01:13+0100 3831 [19564]: 0fcad888 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458201000 result -5:0 match res<br>
2016-02-24 02:01:13+0100 3831 [19564]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids<br>
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire
leader_read1 error -5<br>
2016-02-24 02:01:13+0100 3832 [12116]: s1317 add_lockspace fail
result -5<br>
2016-02-24 02:01:14+0100 3832 [1321]: s1318 add_lockspace fail
result -5<br>
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0
flags 1 timeout 0<br>
2016-02-24 02:01:19+0100 3838 [12106]: s1319 lockspace
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0<br>
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15
async done 0<br>
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire begin
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1<br>
2016-02-24 02:01:19+0100 3838 [19638]: 3da46e07 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
2016-02-24 02:01:19+0100 3838 [19638]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids<br>
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire
leader_read1 error -5<br>
2016-02-24 02:01:20+0100 3839 [12106]: s1319 add_lockspace fail
result -5<br>
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
flags 1 timeout 0<br>
2016-02-24 02:01:20+0100 3839 [1320]: s1320 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0<br>
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15 async
done 0<br>
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire begin
88adbd49-62d6-45b1-9992-b04464a04112:1<br>
2016-02-24 02:01:20+0100 3839 [19658]: 88adbd49 aio collect 0
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
2016-02-24 02:01:20+0100 3839 [19658]: read_sectors delta_leader
offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids<br>
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire
leader_read1 error -5<br>
2016-02-24 02:01:21+0100 3840 [1320]: s1320 add_lockspace fail
result -5<br>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<br>
<br>
</body>
</html>
--------------000703070201090008010903--