[Users] Add NFS Domain on Fedora 19 host fails (3.3 RC)

Markus Stockhausen stockhausen at collogia.de
Thu Sep 5 05:40:28 UTC 2013


Hello,

me again. Adding a NFS Domain to the cluster fails. It looks like the error
from http://lists.ovirt.org/pipermail/users/2013-April/014080.html but I
have a Fedora 19 host and sanlock seems to be a newer version. I wanted
to restart the setup process but ovirt-engine tells me that the storage
domain already exists on the host. How can I recover from this failed
action?

Just in case you are interested in the current situation you will find the
logs attached.

Markus

[root at colovn1 dom_md]# getsebool -a | grep virt_use_nfs
virt_use_nfs --> on

[root at colovn1 dom_md]# df
Filesystem
...
10.10.30.251:/var/nas5/ovirt 7810410496 7094904832 715505664   91% /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt

content of /var/log/sanlock
2013-09-04 15:47:04+0200 14844 [2655]: sanlock daemon started 2.8 host e35ca5ca-dfab-4521-b267-4d9b1f48ded4.colovn1.co
2013-09-04 15:58:04+0200 23 [1024]: sanlock daemon started 2.8 host b3a8ef4a-0966-4ffa-9086-e5a8c6ad7363.colovn1.co
2013-09-04 19:25:53+0200 23 [919]: sanlock daemon started 2.8 host 9654f1d0-6d87-4dd1-abdc-68c00fc4fe64.colovn1.co
2013-09-05 06:39:47+0200 25 [1173]: sanlock daemon started 2.8 host e2829012-4b8f-417f-809e-532c64108955.colovn1.co
2013-09-05 06:48:01+0200 518 [1178]: s1 lockspace 8dd2a4a5-b49f-4fef-a427-e62627fc09f7:250:/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids:0
2013-09-05 06:48:01+0200 518 [1786]: open error -13 /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
2013-09-05 06:48:01+0200 518 [1786]: s1 open_disk /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids error -13
2013-09-05 06:48:02+0200 519 [1178]: s1 add_lockspace fail result -19

permissions of file:
[root at colovn1 dom_md]# ls -al /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
-rw-rw----. 1 vdsm kvm 1048576  5. Sep 06:47 /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids

vdsm.log
Thread-186::DEBUG::2013-09-05 06:48:01,872::task::974::TaskManager.Task::(_decref) Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::ref 1 aborting False
Thread-186::INFO::2013-09-05 06:48:01,872::sp::592::Storage.StoragePool::(create) spUUID=b054727d-fe4a-41ed-8393-a81e36b8a1af poolName=Collogia master_sd=8dd2a4a5-b49f-4fef-a427-e62627fc09f7 domList=['8dd2a4a5-b49f-4fef-a427-e62627fc09f7'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5}
Thread-186::INFO::2013-09-05 06:48:01,872::fileSD::315::Storage.StorageDomain::(validate) sdUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7
Thread-186::DEBUG::2013-09-05 06:48:01,888::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular', 'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b0b0af59d3c7c6ec83dd18ca11a6c1653de9a3b6']
Thread-186::DEBUG::2013-09-05 06:48:01,898::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular', 'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=b0b0af59d3c7c6ec83dd18ca11a6c1653de9a3b6']
Thread-186::DEBUG::2013-09-05 06:48:01,899::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
Thread-186::DEBUG::2013-09-05 06:48:01,900::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
Thread-186::DEBUG::2013-09-05 06:48:01,900::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular', 'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e2dfa292d09c0cb420dc4d30ab5eed11c84a399e']
Thread-186::DEBUG::2013-09-05 06:48:01,903::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
Thread-186::INFO::2013-09-05 06:48:01,903::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 8dd2a4a5-b49f-4fef-a427-e62627fc09f7 (id: 250)
Thread-186::ERROR::2013-09-05 06:48:02,905::task::850::TaskManager.Task::(_setError) Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::Unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 857, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 960, in createStoragePool
    masterVersion, leaseParams)
  File "/usr/share/vdsm/storage/sp.py", line 617, in create
    self._acquireTemporaryClusterLock(msdUUID, leaseParams)
  File "/usr/share/vdsm/storage/sp.py", line 559, in _acquireTemporaryClusterLock
    msd.acquireHostId(self.id)
  File "/usr/share/vdsm/storage/sd.py", line 458, in acquireHostId
    self._clusterLock.acquireHostId(hostId, async)
  File "/usr/share/vdsm/storage/clusterlock.py", line 189, in acquireHostId
    raise se.AcquireHostIdFailure(self._sdUUID, e)
AcquireHostIdFailure: Cannot acquire host id: ('8dd2a4a5-b49f-4fef-a427-e62627fc09f7', SanlockException(19, 'Sanlock lockspace add failure', 'No such device'))

/var/log/messages content
Sep  5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep  5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep  5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep  5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep  5 06:48:01 colovn1 sanlock[1173]: 2013-09-05 06:48:01+0200 518 [1786]: open error -13 /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
Sep  5 06:48:01 colovn1 sanlock[1173]: 2013-09-05 06:48:01+0200 518 [1786]: s1 open_disk /rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids error -13
Sep  5 06:48:02 colovn1 sanlock[1173]: 2013-09-05 06:48:02+0200 519 [1178]: s1 add_lockspace fail result -19
Sep  5 06:48:02 colovn1 vdsm TaskManager.Task ERROR Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::Unexpected error
Sep  5 06:50:13 colovn1 su: (to root) root on none
Sep  5 06:54:23 colovn1 systemd[1]: Starting Cleanup of Temporary Directories...
Sep  5 06:54:23 colovn1 systemd[1]: Started Cleanup of Temporary Directories.
Sep  5 06:55:05 colovn1 ntpd[1241]: 0.0.0.0 c612 02 freq_set kernel -32.960 PPM
Sep  5 06:55:05 colovn1 ntpd[1241]: 0.0.0.0 c615 05 clock_sync

sanlock version
[root at colovn1 dom_md]# yum list | grep sanlock
libvirt-lock-sanlock.x86_64             1.0.5.5-1.fc19                  @updates
sanlock.x86_64                          2.8-1.fc19                      @updates
sanlock-lib.x86_64                      2.8-1.fc19                      @updates
sanlock-python.x86_64                   2.8-1.fc19                      @updates
fence-sanlock.x86_64                    2.8-1.fc19                      updates
sanlock-devel.i686                      2.8-1.fc19                      updates
sanlock-devel.x86_64                    2.8-1.fc19                      updates
sanlock-lib.i686                        2.8-1.fc19                      updates

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20130905/eadb8f7b/attachment-0001.html>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: InterScan_Disclaimer.txt
URL: <http://lists.ovirt.org/pipermail/users/attachments/20130905/eadb8f7b/attachment-0001.txt>


More information about the Users mailing list