<div dir="ltr">I should be able to provide any logs required, I&#39;ve reverted to my NFS storage domain but can move a host over to POSIX whenever necessary.</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">
<span style="font-family:arial,sans-serif;font-size:16px"><strong>Steve Dainard </strong></span><span style="font-size:12px"></span><br>
<span style="font-family:arial,sans-serif;font-size:12px">IT Infrastructure Manager<br>
<a href="http://miovision.com/" target="_blank">Miovision</a> | <em>Rethink Traffic</em><br>
519-513-2407 ex.250<br>
877-646-8476 (toll-free)<br>
<br>
<strong style="font-family:arial,sans-serif;font-size:13px;color:#999999"><a href="http://miovision.com/blog" target="_blank">Blog</a>  |  </strong><font color="#999999" style="font-family:arial,sans-serif;font-size:13px"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">LinkedIn</a>  |  <a href="https://twitter.com/miovision" target="_blank">Twitter</a>  |  <a href="https://www.facebook.com/miovision" target="_blank">Facebook</a></strong></font> </span>
<hr style="font-family:arial,sans-serif;font-size:13px;color:#333333;clear:both">
<div style="color:#999999;font-family:arial,sans-serif;font-size:13px;padding-top:5px">
        <span style="font-family:arial,sans-serif;font-size:12px">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br>
        <span style="font-family:arial,sans-serif;font-size:12px">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div>
</div></div>
<br><br><div class="gmail_quote">On Tue, Feb 4, 2014 at 10:20 AM, Elad Ben Aharon <span dir="ltr">&lt;<a href="mailto:ebenahar@redhat.com" target="_blank">ebenahar@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Nir,<br>
Can you take a look? the user gets the same Sanlock exception as reported here:  <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1046430" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1046430</a><br>
<div><div class="h5"><br>
----- Original Message -----<br>
From: &quot;Steve Dainard&quot; &lt;<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>&gt;<br>
To: &quot;users&quot; &lt;<a href="mailto:users@ovirt.org">users@ovirt.org</a>&gt;<br>
Sent: Tuesday, February 4, 2014 5:09:43 PM<br>
Subject: [Users] Ovirt 3.3.2 Cannot attach POSIX (gluster) storage domain<br>
<br>
I can successfully create a POSIX storage domain backed by gluster, but at the end of creation I get an error message &quot;failed to acquire host id&quot;.<br>
<br>
Note that I have successfully created/activated NFS DC/SD on the same ovirt/hosts.<br>
<br>
I have some logs when I tried to attach to the DC after failure:<br>
<br>
engine.log<br>
<br>
2014-02-04 09:54:04,324 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8702-3) [1dd40406] Lock Acquired to object EngineLock [ex<br>
clusiveLocks= key: 8c4e8898-c91a-4d49-98e8-b6467791a9cc value: POOL<br>
, sharedLocks= ]<br>
2014-02-04 09:54:04,473 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [1dd40406] Running command: AddStoragePoolWithStorages<br>
Command internal: false. Entities affected : ID: 8c4e8898-c91a-4d49-98e8-b6467791a9cc Type: StoragePool<br>
2014-02-04 09:54:04,673 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-6-thread-42) [3f86c31b] Running command: ConnectStorageToVdsCommand intern<br>
al: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System<br>
2014-02-04 09:54:04,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-6-thread-42) [3f86c31b] START, ConnectStorageServerVDSCommand(<br>
HostName = ovirt001, HostId = 48f13d47-8346-4ff6-81ca-4f4324069db3, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 87f9<br>
ff74-93c4-4fe5-9a56-ed5338290af9, connection: 10.0.10.3:/rep2, iqn: null, vfsType: glusterfs, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), lo<br>
g id: 332ff091<br>
2014-02-04 09:54:05,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-6-thread-42) [3f86c31b] FINISH, ConnectStorageServerVDSCommand<br>
, return: {87f9ff74-93c4-4fe5-9a56-ed5338290af9=0}, log id: 332ff091<br>
2014-02-04 09:54:05,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] START, CreateStoragePoolVDSCommand(HostNa<br>
me = ovirt001, HostId = 48f13d47-8346-4ff6-81ca-4f4324069db3, storagePoolId=8c4e8898-c91a-4d49-98e8-b6467791a9cc, storageType=POSIXFS, storagePoolName=IT, masterDomainId=471<br>
487ed-2946-4dfc-8ec3-96546006be12, domainsIdList=[471487ed-2946-4dfc-8ec3-96546006be12], masterVersion=3), log id: 1be84579<br>
2014-02-04 09:54:08,833 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorag<br>
ePoolVDSCommand] (pool-6-thread-42) [3f86c31b] Failed in CreateStoragePoolVDS method<br>
2014-02-04 09:54:08,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] Error code AcquireHostIdFailure and error message VDSGenericException: VDSErrorException: Failed to CreateStoragePoolVDS, error = Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;))<br>

2014-02-04 09:54:08,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand return value<br>

StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=661, mMessage=Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;))]]<br>

2014-02-04 09:54:08,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] HostName = ovirt001<br>
2014-02-04 09:54:08,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] Command CreateStoragePoolVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStoragePoolVDS, error = Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;))<br>

2014-02-04 09:54:08,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (pool-6-thread-42) [3f86c31b] FINISH, CreateStoragePoolVDSCommand, log id: 1be84579<br>
2014-02-04 09:54:08,841 ERROR [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [3f86c31b] Command org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStoragePoolVDS, error = Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;)) (Failed with error AcquireHostIdFailure and code 661)<br>

2014-02-04 09:54:08,867 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [3f86c31b] Command [id=373987cb-b54d-4174-b4a9-195be631f0d7]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StoragePool; snapshot: id=8c4e8898-c91a-4d49-98e8-b6467791a9cc.<br>

2014-02-04 09:54:08,871 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [3f86c31b] Command [id=373987cb-b54d-4174-b4a9-195be631f0d7]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 8c4e8898-c91a-4d49-98e8-b6467791a9cc, storageId = 471487ed-2946-4dfc-8ec3-96546006be12.<br>

2014-02-04 09:54:08,879 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [3f86c31b] Command [id=373987cb-b54d-4174-b4a9-195be631f0d7]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=471487ed-2946-4dfc-8ec3-96546006be12.<br>

2014-02-04 09:54:08,951 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-6-thread-42) [3f86c31b] Correlation ID: 1dd40406, Job ID: 07003dff-9e0e-42ae-8f88-6b055b45f797, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domains to Data Center IT. (User: admin@internal)<br>

2014-02-04 09:54:08,975 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (pool-6-thread-42) [3f86c31b] Lock freed to object EngineLock [exclusiveLocks= key: 8c4e8898-c91a-4d49-98e8-b6467791a9cc value: POOL<br>

, sharedLocks= ]<br>
<br>
vdsm.log<br>
<br>
Thread-30::DEBUG::2014-02-04 09:54:04,692::BindingXMLRPC::167::vds::(wrapper) client [10.0.10.2] flowID [3f86c31b]<br>
Thread-30::DEBUG::2014-02-04 09:54:04,692::task::579::TaskManager.Task::(_updateState) Task=`218dcde9-bbc7-4d5a-ad53-0bab556c6261`::moving from state init -&gt; state preparing<br>
Thread-30::INFO::2014-02-04 09:54:04,693::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID=&#39;00000000-0000-0000-0000-000000000000&#39;, conList=[{&#39;port&#39;: &#39;&#39;, &#39;connection&#39;: &#39;10.0.10.3:/rep2&#39;, &#39;iqn&#39;: &#39;&#39;, &#39;portal&#39;: &#39;&#39;, &#39;user&#39;: &#39;&#39;, &#39;vfs_type&#39;: &#39;glusterfs&#39;, &#39;password&#39;: &#39;******&#39;, &#39;id&#39;: &#39;87f9ff74-93c4-4fe5-9a56-ed5338290af9&#39;}], options=None)<br>

Thread-30::DEBUG::2014-02-04 09:54:04,698::mount::226::Storage.Misc.excCmd::(_runcmd) &#39;/usr/bin/sudo -n /bin/mount -t glusterfs 10.0.10.3:/rep2 /rhev/data-center/mnt/10.0.10.3:_rep2&#39; (cwd None)<br>
Thread-30::DEBUG::2014-02-04 09:54:05,067::hsm::2315::Storage.HSM::(__prefetchDomains) posix local path: /rhev/data-center/mnt/10.0.10.3:_rep2<br>
Thread-30::DEBUG::2014-02-04 09:54:05,078::hsm::2333::Storage.HSM::(__prefetchDomains) Found SD uuids: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;,)<br>
Thread-30::DEBUG::2014-02-04 09:54:05,078::hsm::2389::Storage.HSM::(connectStorageServer) knownSDs: {471487ed-2946-4dfc-8ec3-96546006be12: storage.nfsSD.findDomain}<br>
Thread-30::INFO::2014-02-04 09:54:05,078::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {&#39;statuslist&#39;: [{&#39;status&#39;: 0, &#39;id&#39;: &#39;87f9ff74-93c4-4fe5-9a56-ed5338290af9&#39;}]}<br>

Thread-30::DEBUG::2014-02-04 09:54:05,079::task::1168::TaskManager.Task::(prepare) Task=`218dcde9-bbc7-4d5a-ad53-0bab556c6261`::finished: {&#39;statuslist&#39;: [{&#39;status&#39;: 0, &#39;id&#39;: &#39;87f9ff74-93c4-4fe5-9a56-ed5338290af9&#39;}]}<br>

Thread-30::DEBUG::2014-02-04 09:54:05,079::task::579::TaskManager.Task::(_updateState) Task=`218dcde9-bbc7-4d5a-ad53-0bab556c6261`::moving from state preparing -&gt; state finished<br>
Thread-30::DEBUG::2014-02-04 09:54:05,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}<br>
Thread-30::DEBUG::2014-02-04 09:54:05,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>
Thread-30::DEBUG::2014-02-04 09:54:05,079::task::974::TaskManager.Task::(_decref) Task=`218dcde9-bbc7-4d5a-ad53-0bab556c6261`::ref 0 aborting False<br>
Thread-31::DEBUG::2014-02-04 09:54:05,098::BindingXMLRPC::167::vds::(wrapper) client [10.0.10.2] flowID [3f86c31b]<br>
Thread-31::DEBUG::2014-02-04 09:54:05,099::task::579::TaskManager.Task::(_updateState) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::moving from state init -&gt; state preparing<br>
Thread-31::INFO::2014-02-04 09:54:05,099::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID=&#39;8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;, poolName=&#39;IT&#39;, masterDom=&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, domList=[&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;], masterVersion=3, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None)<br>

Thread-31::DEBUG::2014-02-04 09:54:05,099::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)<br>
Thread-31::DEBUG::2014-02-04 09:54:05,100::misc::811::SamplingMethod::(__call__) Got in to sampling method<br>
Thread-31::DEBUG::2014-02-04 09:54:05,100::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)<br>
Thread-31::DEBUG::2014-02-04 09:54:05,100::misc::811::SamplingMethod::(__call__) Got in to sampling method<br>
Thread-31::DEBUG::2014-02-04 09:54:05,100::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) &#39;/usr/bin/sudo -n /sbin/iscsiadm -m session -R&#39; (cwd None)<br>
Thread-31::DEBUG::2014-02-04 09:54:05,114::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: &lt;err&gt; = &#39;iscsiadm: No session found.\n&#39;; &lt;rc&gt; = 21<br>
Thread-31::DEBUG::2014-02-04 09:54:05,115::misc::819::SamplingMethod::(__call__) Returning last result<br>
Thread-31::DEBUG::2014-02-04 09:54:07,144::multipath::112::Storage.Misc.excCmd::(rescan) &#39;/usr/bin/sudo -n /sbin/multipath -r&#39; (cwd None)<br>
Thread-31::DEBUG::2014-02-04 09:54:07,331::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: &lt;err&gt; = &#39;&#39;; &lt;rc&gt; = 0<br>
Thread-31::DEBUG::2014-02-04 09:54:07,332::lvm::510::OperationMutex::(_invalidateAllPvs) Operation &#39;lvm invalidate operation&#39; got the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,333::lvm::512::OperationMutex::(_invalidateAllPvs) Operation &#39;lvm invalidate operation&#39; released the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,333::lvm::521::OperationMutex::(_invalidateAllVgs) Operation &#39;lvm invalidate operation&#39; got the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,333::lvm::523::OperationMutex::(_invalidateAllVgs) Operation &#39;lvm invalidate operation&#39; released the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,333::lvm::541::OperationMutex::(_invalidateAllLvs) Operation &#39;lvm invalidate operation&#39; got the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,334::lvm::543::OperationMutex::(_invalidateAllLvs) Operation &#39;lvm invalidate operation&#39; released the operation mutex<br>
Thread-31::DEBUG::2014-02-04 09:54:07,334::misc::819::SamplingMethod::(__call__) Returning last result<br>
Thread-31::DEBUG::2014-02-04 09:54:07,499::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.0.10.3:_rep2/471487ed-2946-4dfc-8ec3-96546006be12<br>
Thread-31::DEBUG::2014-02-04 09:54:07,605::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend<br>
Thread-31::DEBUG::2014-02-04 09:54:07,647::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[&#39;CLASS=Data&#39;, &#39;DESCRIPTION=gluster-store-rep2&#39;, &#39;IOOPTIMEOUTSEC=10&#39;, &#39;LEASERETRIES=3&#39;, &#39;LEASETIMESEC=60&#39;, &#39;LOCKPOLICY=&#39;, &#39;LOCKRENEWALINTERVALSEC=5&#39;, &#39;POOL_UUID=&#39;, &#39;REMOTE_PATH=10.0.10.3:/rep2&#39;, &#39;ROLE=Regular&#39;, &#39;SDUUID=471487ed-2946-4dfc-8ec3-96546006be12&#39;, &#39;TYPE=POSIXFS&#39;, &#39;VERSION=3&#39;, &#39;_SHA_CKSUM=469191aac3fb8ef504b6a4d301b6d8be6fffece1&#39;]<br>

Thread-31::DEBUG::2014-02-04 09:54:07,683::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []<br>
Thread-31::DEBUG::2014-02-04 09:54:07,684::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace &#39;471487ed-2946-4dfc-8ec3-96546006be12_imageNS&#39;<br>
Thread-31::DEBUG::2014-02-04 09:54:07,684::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace &#39;471487ed-2946-4dfc-8ec3-96546006be12_volumeNS&#39;<br>
Thread-31::INFO::2014-02-04 09:54:07,684::fileSD::299::Storage.StorageDomain::(validate) sdUUID=471487ed-2946-4dfc-8ec3-96546006be12<br>
Thread-31::DEBUG::2014-02-04 09:54:07,692::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[&#39;CLASS=Data&#39;, &#39;DESCRIPTION=gluster-store-rep2&#39;, &#39;IOOPTIMEOUTSEC=10&#39;, &#39;LEASERETRIES=3&#39;, &#39;LEASETIMESEC=60&#39;, &#39;LOCKPOLICY=&#39;, &#39;LOCKRENEWALINTERVALSEC=5&#39;, &#39;POOL_UUID=&#39;, &#39;REMOTE_PATH=10.0.10.3:/rep2&#39;, &#39;ROLE=Regular&#39;, &#39;SDUUID=471487ed-2946-4dfc-8ec3-96546006be12&#39;, &#39;TYPE=POSIXFS&#39;, &#39;VERSION=3&#39;, &#39;_SHA_CKSUM=469191aac3fb8ef504b6a4d301b6d8be6fffece1&#39;]<br>

Thread-31::DEBUG::2014-02-04 09:54:07,693::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc`ReqID=`e0a3d477-b953-49d9-ab78-67695a6bc6d5`::Request was made in &#39;/usr/share/vdsm/storage/hsm.py&#39; line &#39;971&#39; at &#39;createStoragePool&#39;<br>

Thread-31::DEBUG::2014-02-04 09:54:07,693::resourceManager::541::ResourceManager::(registerResource) Trying to register resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39; for lock type &#39;exclusive&#39;<br>

Thread-31::DEBUG::2014-02-04 09:54:07,693::resourceManager::600::ResourceManager::(registerResource) Resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39; is free. Now locking as &#39;exclusive&#39; (1 active user)<br>

Thread-31::DEBUG::2014-02-04 09:54:07,693::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc`ReqID=`e0a3d477-b953-49d9-ab78-67695a6bc6d5`::Granted request<br>
Thread-31::DEBUG::2014-02-04 09:54:07,694::task::811::TaskManager.Task::(resourceAcquired) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::_resourcesAcquired: Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc (exclusive)<br>
Thread-31::DEBUG::2014-02-04 09:54:07,694::task::974::TaskManager.Task::(_decref) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::ref 1 aborting False<br>
Thread-31::DEBUG::2014-02-04 09:54:07,694::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.471487ed-2946-4dfc-8ec3-96546006be12`ReqID=`bc20dd7e-d351-47c5-8ed3-78b1b11d703a`::Request was made in &#39;/usr/share/vdsm/storage/hsm.py&#39; line &#39;973&#39; at &#39;createStoragePool&#39;<br>

Thread-31::DEBUG::2014-02-04 09:54:07,694::resourceManager::541::ResourceManager::(registerResource) Trying to register resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39; for lock type &#39;exclusive&#39;<br>

Thread-31::DEBUG::2014-02-04 09:54:07,695::resourceManager::600::ResourceManager::(registerResource) Resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39; is free. Now locking as &#39;exclusive&#39; (1 active user)<br>

Thread-31::DEBUG::2014-02-04 09:54:07,695::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.471487ed-2946-4dfc-8ec3-96546006be12`ReqID=`bc20dd7e-d351-47c5-8ed3-78b1b11d703a`::Granted request<br>
Thread-31::DEBUG::2014-02-04 09:54:07,695::task::811::TaskManager.Task::(resourceAcquired) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::_resourcesAcquired: Storage.471487ed-2946-4dfc-8ec3-96546006be12 (exclusive)<br>
Thread-31::DEBUG::2014-02-04 09:54:07,695::task::974::TaskManager.Task::(_decref) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::ref 1 aborting False<br>
Thread-31::INFO::2014-02-04 09:54:07,696::sp::593::Storage.StoragePool::(create) spUUID=8c4e8898-c91a-4d49-98e8-b6467791a9cc poolName=IT master_sd=471487ed-2946-4dfc-8ec3-96546006be12 domList=[&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;] masterVersion=3 {&#39;LEASETIMESEC&#39;: 60, &#39;IOOPTIMEOUTSEC&#39;: 10, &#39;LEASERETRIES&#39;: 3, &#39;LOCKRENEWALINTERVALSEC&#39;: 5}<br>

Thread-31::INFO::2014-02-04 09:54:07,696::fileSD::299::Storage.StorageDomain::(validate) sdUUID=471487ed-2946-4dfc-8ec3-96546006be12<br>
Thread-31::DEBUG::2014-02-04 09:54:07,703::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[&#39;CLASS=Data&#39;, &#39;DESCRIPTION=gluster-store-rep2&#39;, &#39;IOOPTIMEOUTSEC=10&#39;, &#39;LEASERETRIES=3&#39;, &#39;LEASETIMESEC=60&#39;, &#39;LOCKPOLICY=&#39;, &#39;LOCKRENEWALINTERVALSEC=5&#39;, &#39;POOL_UUID=&#39;, &#39;REMOTE_PATH=10.0.10.3:/rep2&#39;, &#39;ROLE=Regular&#39;, &#39;SDUUID=471487ed-2946-4dfc-8ec3-96546006be12&#39;, &#39;TYPE=POSIXFS&#39;, &#39;VERSION=3&#39;, &#39;_SHA_CKSUM=469191aac3fb8ef504b6a4d301b6d8be6fffece1&#39;]<br>

Thread-31::DEBUG::2014-02-04 09:54:07,710::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[&#39;CLASS=Data&#39;, &#39;DESCRIPTION=gluster-store-rep2&#39;, &#39;IOOPTIMEOUTSEC=10&#39;, &#39;LEASERETRIES=3&#39;, &#39;LEASETIMESEC=60&#39;, &#39;LOCKPOLICY=&#39;, &#39;LOCKRENEWALINTERVALSEC=5&#39;, &#39;POOL_UUID=&#39;, &#39;REMOTE_PATH=10.0.10.3:/rep2&#39;, &#39;ROLE=Regular&#39;, &#39;SDUUID=471487ed-2946-4dfc-8ec3-96546006be12&#39;, &#39;TYPE=POSIXFS&#39;, &#39;VERSION=3&#39;, &#39;_SHA_CKSUM=469191aac3fb8ef504b6a4d301b6d8be6fffece1&#39;]<br>

Thread-31::DEBUG::2014-02-04 09:54:07,711::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction<br>
Thread-31::DEBUG::2014-02-04 09:54:07,711::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction<br>
Thread-31::INFO::2014-02-04 09:54:07,711::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 471487ed-2946-4dfc-8ec3-96546006be12 (id: 250)<br>
Thread-31::ERROR::2014-02-04 09:54:08,722::task::850::TaskManager.Task::(_setError) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::Unexpected error<br>
Traceback (most recent call last):<br>
File &quot;/usr/share/vdsm/storage/task.py&quot;, line 857, in _run<br>
return fn(*args, **kargs)<br>
File &quot;/usr/share/vdsm/logUtils.py&quot;, line 45, in wrapper<br>
res = f(*args, **kwargs)<br>
File &quot;/usr/share/vdsm/storage/hsm.py&quot;, line 977, in createStoragePool<br>
masterVersion, leaseParams)<br>
File &quot;/usr/share/vdsm/storage/sp.py&quot;, line 618, in create<br>
self._acquireTemporaryClusterLock(msdUUID, leaseParams)<br>
File &quot;/usr/share/vdsm/storage/sp.py&quot;, line 560, in _acquireTemporaryClusterLock<br>
msd.acquireHostId( <a href="http://self.id" target="_blank">self.id</a> )<br>
File &quot;/usr/share/vdsm/storage/sd.py&quot;, line 458, in acquireHostId<br>
self._clusterLock.acquireHostId(hostId, async)<br>
File &quot;/usr/share/vdsm/storage/clusterlock.py&quot;, line 189, in acquireHostId<br>
raise se.AcquireHostIdFailure(self._sdUUID, e)<br>
AcquireHostIdFailure: Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;))<br>
Thread-31::DEBUG::2014-02-04 09:54:08,826::task::869::TaskManager.Task::(_run) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::Task._run: 66924dbf-5a1c-473e-a158-d038aae38dc3 (None, &#39;8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;, &#39;IT&#39;, &#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, [&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;], 3, None, 5, 60, 10, 3) {} failed - stopping task<br>

Thread-31::DEBUG::2014-02-04 09:54:08,826::task::1194::TaskManager.Task::(stop) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::stopping in state preparing (force False)<br>
Thread-31::DEBUG::2014-02-04 09:54:08,826::task::974::TaskManager.Task::(_decref) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::ref 1 aborting True<br>
Thread-31::INFO::2014-02-04 09:54:08,826::task::1151::TaskManager.Task::(prepare) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::aborting: Task is aborted: &#39;Cannot acquire host id&#39; - code 661<br>
Thread-31::DEBUG::2014-02-04 09:54:08,826::task::1156::TaskManager.Task::(prepare) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::Prepare: aborted: Cannot acquire host id<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::task::974::TaskManager.Task::(_decref) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::ref 0 aborting True<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::task::909::TaskManager.Task::(_doAbort) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::Task._doAbort: force False<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::task::579::TaskManager.Task::(_updateState) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::moving from state preparing -&gt; state aborting<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::task::534::TaskManager.Task::(__state_aborting) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::_aborting: recover policy none<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::task::579::TaskManager.Task::(_updateState) Task=`66924dbf-5a1c-473e-a158-d038aae38dc3`::moving from state aborting -&gt; state failed<br>
Thread-31::DEBUG::2014-02-04 09:54:08,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {&#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39;: &lt; ResourceRef &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39;, isValid: &#39;True&#39; obj: &#39;None&#39;&gt;, &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;: &lt; ResourceRef &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;, isValid: &#39;True&#39; obj: &#39;None&#39;&gt;}<br>

Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br>
Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39;<br>
Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::634::ResourceManager::(releaseResource) Released resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39; (0 active users)<br>
Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::640::ResourceManager::(releaseResource) Resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39; is free, finding out if anyone is waiting for it.<br>
Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource &#39;Storage.471487ed-2946-4dfc-8ec3-96546006be12&#39;, Clearing records.<br>
Thread-31::DEBUG::2014-02-04 09:54:08,828::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;<br>
Thread-31::DEBUG::2014-02-04 09:54:08,829::resourceManager::634::ResourceManager::(releaseResource) Released resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39; (0 active users)<br>
Thread-31::DEBUG::2014-02-04 09:54:08,829::resourceManager::640::ResourceManager::(releaseResource) Resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39; is free, finding out if anyone is waiting for it.<br>
Thread-31::DEBUG::2014-02-04 09:54:08,829::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource &#39;Storage.8c4e8898-c91a-4d49-98e8-b6467791a9cc&#39;, Clearing records.<br>
Thread-31::ERROR::2014-02-04 09:54:08,829::dispatcher::67::Storage.Dispatcher.Protect::(run) {&#39;status&#39;: {&#39;message&#39;: &quot;Cannot acquire host id: (&#39;471487ed-2946-4dfc-8ec3-96546006be12&#39;, SanlockException(22, &#39;Sanlock lockspace add failure&#39;, &#39;Invalid argument&#39;))&quot;, &#39;code&#39;: 661}}<br>

<br>
<br>
Storage domain metadata file:<br>
<br>
CLASS=Data<br>
DESCRIPTION=gluster-store-rep2<br>
IOOPTIMEOUTSEC=10<br>
LEASERETRIES=3<br>
LEASETIMESEC=60<br>
LOCKPOLICY=<br>
LOCKRENEWALINTERVALSEC=5<br>
POOL_UUID=<br>
REMOTE_PATH=10.0.10.3:/rep2<br>
ROLE=Regular<br>
SDUUID=471487ed-2946-4dfc-8ec3-96546006be12<br>
TYPE=POSIXFS<br>
VERSION=3<br>
_SHA_CKSUM=469191aac3fb8ef504b6a4d301b6d8be6fffece1<br>
<br>
<br>
<br>
Steve Dainard<br>
IT Infrastructure Manager<br>
Miovision | Rethink Traffic<br>
519-513-2407 ex.250<br>
877-646-8476 (toll-free)<br>
<br>
Blog | LinkedIn | Twitter | Facebook<br>
</div></div><div class="im">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3<br>
This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.<br>
<br>
</div>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
</blockquote></div><br></div>