[ovirt-users] ovirt - can't attach master domain II

Wednesday, 24 February 2016

This is a multi-part message in MIME format.
--------------090001000406070504000905
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Hi,
I found the main ( maybe ) problem with IO error ( -5 ) for "ids" file 
access
This file is not accessable via NFS, locally yes.
How can I fix it ??
regs.
Pavel

# sanlock client log_dump
....
0 flags 1 timeout 0
2016-02-24 02:01:10+0100 3828 [12111]: s1316 lockspace 
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
2016-02-24 02:01:10+0100 3828 [12111]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire begin 
88adbd49-62d6-45b1-9992-b04464a04112:1
2016-02-24 02:01:10+0100 3828 [19556]: 88adbd49 aio collect 0 
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:10+0100 3828 [19556]: read_sectors delta_leader offset 
0 rv -5 
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids
2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire leader_read1 
error -5
2016-02-24 02:01:11+0100 3829 [12111]: s1316 add_lockspace fail result -5
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15 
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0

flags 1 timeout 0
2016-02-24 02:01:12+0100 3831 [12116]: s1317 lockspace 
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0
2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire begin 
7f52b697-c199-4f58-89aa-102d44327124:1
2016-02-24 02:01:12+0100 3831 [19562]: 7f52b697 aio collect 0 
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:12+0100 3831 [19562]: read_sectors delta_leader offset 
0 rv -5 
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids
2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire leader_read1 
error -5
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15 
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0

flags 1 timeout 0
2016-02-24 02:01:13+0100 3831 [1321]: s1318 lockspace 
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0
2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire begin 
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1
2016-02-24 02:01:13+0100 3831 [19564]: 0fcad888 aio collect 0 
0x7fe4580008c0:0x7fe4580008d0:0x7fe458201000 result -5:0 match res
2016-02-24 02:01:13+0100 3831 [19564]: read_sectors delta_leader offset 
0 rv -5 
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids
2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire leader_read1 
error -5
2016-02-24 02:01:13+0100 3832 [12116]: s1317 add_lockspace fail result -5
2016-02-24 02:01:14+0100 3832 [1321]: s1318 add_lockspace fail result -5
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15 
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0

flags 1 timeout 0
2016-02-24 02:01:19+0100 3838 [12106]: s1319 lockspace 
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0
2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire begin 
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1
2016-02-24 02:01:19+0100 3838 [19638]: 3da46e07 aio collect 0 
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:19+0100 3838 [19638]: read_sectors delta_leader offset 
0 rv -5 
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids
2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire leader_read1 
error -5
2016-02-24 02:01:20+0100 3839 [12106]: s1319 add_lockspace fail result -5
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15 
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0

flags 1 timeout 0
2016-02-24 02:01:20+0100 3839 [1320]: s1320 lockspace 
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15 async done 0
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire begin 
88adbd49-62d6-45b1-9992-b04464a04112:1
2016-02-24 02:01:20+0100 3839 [19658]: 88adbd49 aio collect 0 
0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res
2016-02-24 02:01:20+0100 3839 [19658]: read_sectors delta_leader offset 
0 rv -5 
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids
2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire leader_read1 
error -5
2016-02-24 02:01:21+0100 3840 [1320]: s1320 add_lockspace fail result -5

--------------090001000406070504000905
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html;
charset=utf-8">
  </head>
  <body text="#000066" bgcolor="#FFFFFF">
    Hi,<br>
    I found the main ( maybe ) problem with IO error ( -5 ) for "ids"
    file access<br>
    This file is not accessable via NFS, locally yes.<br>
    How can I fix it ??<br>
    regs.<br>
    Pavel<br>
    <br>
    # sanlock client log_dump<br>
    ....<br>
    0 flags 1 timeout 0<br>
    2016-02-24 02:01:10+0100 3828 [12111]: s1316 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0<br>
    2016-02-24 02:01:10+0100 3828 [12111]: cmd_add_lockspace 4,15 async
    done 0<br>
    2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire begin
    88adbd49-62d6-45b1-9992-b04464a04112:1<br>
    2016-02-24 02:01:10+0100 3828 [19556]: 88adbd49 aio collect 0
    0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
    2016-02-24 02:01:10+0100 3828 [19556]: read_sectors delta_leader
    offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids<br>
    2016-02-24 02:01:10+0100 3828 [19556]: s1316 delta_acquire
    leader_read1 error -5<br>
    2016-02-24 02:01:11+0100 3829 [12111]: s1316 add_lockspace fail
    result -5<br>
    2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15

7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0
    flags 1 timeout 0<br>
    2016-02-24 02:01:12+0100 3831 [12116]: s1317 lockspace
7f52b697-c199-4f58-89aa-102d44327124:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids:0<br>
    2016-02-24 02:01:12+0100 3831 [12116]: cmd_add_lockspace 4,15 async
    done 0<br>
    2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire begin
    7f52b697-c199-4f58-89aa-102d44327124:1<br>
    2016-02-24 02:01:12+0100 3831 [19562]: 7f52b697 aio collect 0
    0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
    2016-02-24 02:01:12+0100 3831 [19562]: read_sectors delta_leader
    offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P4/7f52b697-c199-4f58-89aa-102d44327124/dom_md/ids<br>
    2016-02-24 02:01:12+0100 3831 [19562]: s1317 delta_acquire
    leader_read1 error -5<br>
    2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15

0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0
    flags 1 timeout 0<br>
    2016-02-24 02:01:13+0100 3831 [1321]: s1318 lockspace
0fcad888-d573-47be-bef3-0bc0b7a99fb7:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids:0<br>
    2016-02-24 02:01:13+0100 3831 [1321]: cmd_add_lockspace 4,15 async
    done 0<br>
    2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire begin
    0fcad888-d573-47be-bef3-0bc0b7a99fb7:1<br>
    2016-02-24 02:01:13+0100 3831 [19564]: 0fcad888 aio collect 0
    0x7fe4580008c0:0x7fe4580008d0:0x7fe458201000 result -5:0 match res<br>
    2016-02-24 02:01:13+0100 3831 [19564]: read_sectors delta_leader
    offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-BCK/0fcad888-d573-47be-bef3-0bc0b7a99fb7/dom_md/ids<br>
    2016-02-24 02:01:13+0100 3831 [19564]: s1318 delta_acquire
    leader_read1 error -5<br>
    2016-02-24 02:01:13+0100 3832 [12116]: s1317 add_lockspace fail
    result -5<br>
    2016-02-24 02:01:14+0100 3832 [1321]: s1318 add_lockspace fail
    result -5<br>
    2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15

3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0
    flags 1 timeout 0<br>
    2016-02-24 02:01:19+0100 3838 [12106]: s1319 lockspace
3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids:0<br>
    2016-02-24 02:01:19+0100 3838 [12106]: cmd_add_lockspace 4,15 async
    done 0<br>
    2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire begin
    3da46e07-d1ea-4f10-9250-6cbbb7b94d80:1<br>
    2016-02-24 02:01:19+0100 3838 [19638]: 3da46e07 aio collect 0
    0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
    2016-02-24 02:01:19+0100 3838 [19638]: read_sectors delta_leader
    offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P5/3da46e07-d1ea-4f10-9250-6cbbb7b94d80/dom_md/ids<br>
    2016-02-24 02:01:19+0100 3838 [19638]: s1319 delta_acquire
    leader_read1 error -5<br>
    2016-02-24 02:01:20+0100 3839 [12106]: s1319 add_lockspace fail
    result -5<br>
    2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15

88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0
    flags 1 timeout 0<br>
    2016-02-24 02:01:20+0100 3839 [1320]: s1320 lockspace
88adbd49-62d6-45b1-9992-b04464a04112:1:/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids:0<br>
    2016-02-24 02:01:20+0100 3839 [1320]: cmd_add_lockspace 4,15 async
    done 0<br>
    2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire begin
    88adbd49-62d6-45b1-9992-b04464a04112:1<br>
    2016-02-24 02:01:20+0100 3839 [19658]: 88adbd49 aio collect 0
    0x7fe4580008c0:0x7fe4580008d0:0x7fe458101000 result -5:0 match res<br>
    2016-02-24 02:01:20+0100 3839 [19658]: read_sectors delta_leader
    offset 0 rv -5
/rhev/data-center/mnt/glusterSD/localhost:_1KVM12-P2/88adbd49-62d6-45b1-9992-b04464a04112/dom_md/ids<br>
    2016-02-24 02:01:20+0100 3839 [19658]: s1320 delta_acquire
    leader_read1 error -5<br>
    2016-02-24 02:01:21+0100 3840 [1320]: s1320 add_lockspace fail
    result -5<br>
    <br>
  </body>
</html>

--------------090001000406070504000905--

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

[ovirt-users] ovirt - can't attach master domain II