Enabled logging, logs attached. Thanks, *Steve Dainard * IT Infrastructure Manager Miovision <http://miovision.com/> | *Rethink Traffic* *Blog <http://miovision.com/blog> | **LinkedIn <https://www.linkedin.com/company/miovision-technologies> | Twitter <https://twitter.com/miovision> | Facebook <https://www.facebook.com/miovision>* ------------------------------ Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3 This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately. On Tue, Feb 11, 2014 at 7:39 AM, Nir Soffer <nsoffer@redhat.com> wrote:
----- Original Message -----
From: "Steve Dainard" <sdainard@miovision.com> To: "Nir Soffer" <nsoffer@redhat.com> Cc: "users" <users@ovirt.org> Sent: Sunday, February 9, 2014 5:39:14 PM Subject: Re: [Users] Ovirt 3.3.2 Cannot attach POSIX (gluster) storage domain
vdsm can write to it:
Hi Steve,
There are two issues in your logs:
sanlock:
2014-02-05 09:56:24-0500 40 [5093]: sanlock daemon started 2.8 host 5d4fe362-e06e-40a8-b33a-f72dab971226.ovirt001.m 2014-02-05 10:06:39-0500 655 [5098]: s1 lockspace 020f3d8d-55f0-4552-8596-a9452227d4db:250:/rhev/data-center/mnt/10.0.10.2: _rep2/020f3d8d-55f0-4552-8596-a9452227d4db/dom_md/ids:0 2014-02-05 10:06:39-0500 655 [7358]: 020f3d8d aio collect 1 0x7f351c0008c0:0x7f351c0008d0:0x7f351c001000 result -22:0 match res 2014-02-05 10:06:39-0500 655 [7358]: write_sectors delta_leader offset 127488 rv -22 /rhev/data-center/mnt/10.0.10.2: _rep2/020f3d8d-55f0-4552-8596-a9452227d4db/dom_md/ids 2014-02-05 10:06:40-0500 656 [5098]: s1 add_lockspace fail result -22
To diagnose this error, we would like to have sanlock logs using debug level.
Please do this:
1. Edit /etc/sysconfig/sanlock and add:
# -L 7: use debug level logging to sanlock log file SANLOCKOPTS="$SANLOCKOPTS -L 7"
2. Reboot the host 3. Try to add the gluster domain again 4. Send again vdsm.log, engine.log, sanlock.log and gluster log from the host with the issue.
glusterfs:
[2014-02-05 15:36:28.230837] I [afr-self-heal-data.c:655:afr_sh_data_fix] 0-rep2-replicate-0: no active sinks for performing self-heal on file /ff0e0521-a8fa-4c10-8372-7b67ac3fca31/dom_md/ids [2014-02-05 15:36:28.246203] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-0: remote operation failed: Invalid argument [2014-02-05 15:36:28.246418] W [client-rpc-fops.c:873:client3_3_writev_cbk] 0-rep2-client-1: remote operation failed: Invalid argument [2014-02-05 15:36:28.246450] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 163: WRITE => -1 (Invalid argument)
For this error, it would be best to consult with glusterfs folks.
Thanks, Nir