[Users] Ovirt 3.3.2 Cannot attach POSIX (gluster) storage domain

[Nir Soffer]

----- Original Message -----
> From: "Steve Dainard" <sdainard at miovision.com>
> To: "Nir Soffer" <nsoffer at redhat.com>
> Cc: "users" <users at ovirt.org>
> Sent: Sunday, February 9, 2014 5:39:14 PM
> Subject: Re: [Users] Ovirt 3.3.2 Cannot attach POSIX (gluster) storage domain
> 
> vdsm can write to it:

Hi Steve,

There are two issues in your logs:

sanlock:

2014-02-05 09:56:24-0500 40 [5093]: sanlock daemon started 2.8 host 5d4fe362-e06e-40a8-b33a-f72dab971226.ovirt001.m
2014-02-05 10:06:39-0500 655 [5098]: s1 lockspace 020f3d8d-55f0-4552-8596-a9452227d4db:250:/rhev/data-center/mnt/10.0.10.2:_rep2/020f3d8d-55f0-4552-8596-a9452227d4db/dom_md/ids:0
2014-02-05 10:06:39-0500 655 [7358]: 020f3d8d aio collect 1 0x7f351c0008c0:0x7f351c0008d0:0x7f351c001000 result -22:0 match res
2014-02-05 10:06:39-0500 655 [7358]: write_sectors delta_leader offset 127488 rv -22 /rhev/data-center/mnt/10.0.10.2:_rep2/020f3d8d-55f0-4552-8596-a9452227d4db/dom_md/ids
2014-02-05 10:06:40-0500 656 [5098]: s1 add_lockspace fail result -22

To diagnose this error, we would like to have sanlock logs using debug level.

Please do this:

1. Edit /etc/sysconfig/sanlock and add:

  # -L 7: use debug level logging to sanlock log file
  SANLOCKOPTS="$SANLOCKOPTS -L 7"

2. Reboot the host
3. Try to add the gluster domain again
4. Send again vdsm.log, engine.log, sanlock.log and gluster log from the host with the issue.

glusterfs:

[2014-02-05 15:36:28.230837] I [afr-self-heal-data.c:655:afr_sh_data_fix] 0-rep2-replicate-0: no active sinks for performing self-heal on file /ff0e0521-a8fa-4c10-8372-7b67ac3fca31/dom_md/ids
[2014-02-05 15:36:28.246203] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-0: remote operation failed: Invalid argument
[2014-02-05 15:36:28.246418] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-1: remote operation failed: Invalid argument
[2014-02-05 15:36:28.246450] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 163: WRITE => -1 (Invalid argument)

For this error, it would be best to consult with glusterfs folks.

Thanks,
Nir