[Users] Ovirt 3.1 and gluster (creation in ovirt)

зоррыч zorro at megatrone.ru
Sat Jun 16 20:03:56 UTC 2012


I have updated GlusterFS and volume successfully created

Thank you!

 

But I was not able to mount a storage domain.

Vdsm.log:

 

Thread-21025::DEBUG::2012-06-16 15:43:21,495::BindingXMLRPC::160::vds::(wrapper) [10.1.20.2]

Thread-21025::DEBUG::2012-06-16 15:43:21,495::task::588::TaskManager.Task::(_updateState) Task=`8d841c96-43e3-4d4b-b115-a36c4adf695a`::moving from state init -> state preparing

Thread-21025::INFO::2012-06-16 15:43:21,503::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': '10.1.20.7:/sd2', 'iqn': '', 'portal': '', 'user': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None)

Thread-21025::INFO::2012-06-16 15:43:21,503::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}

Thread-21025::DEBUG::2012-06-16 15:43:21,503::task::1172::TaskManager.Task::(prepare) Task=`8d841c96-43e3-4d4b-b115-a36c4adf695a`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}

Thread-21025::DEBUG::2012-06-16 15:43:21,503::task::588::TaskManager.Task::(_updateState) Task=`8d841c96-43e3-4d4b-b115-a36c4adf695a`::moving from state preparing -> state finished

Thread-21025::DEBUG::2012-06-16 15:43:21,503::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}

Thread-21025::DEBUG::2012-06-16 15:43:21,504::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}

Thread-21025::DEBUG::2012-06-16 15:43:21,504::task::978::TaskManager.Task::(_decref) Task=`8d841c96-43e3-4d4b-b115-a36c4adf695a`::ref 0 aborting False

Thread-21026::DEBUG::2012-06-16 15:43:21,526::BindingXMLRPC::160::vds::(wrapper) [10.1.20.2]

Thread-21026::DEBUG::2012-06-16 15:43:21,526::task::588::TaskManager.Task::(_updateState) Task=`2a6538e5-b961-478a-bce6-f5ded1a62bca`::moving from state init -> state preparing

Thread-21026::INFO::2012-06-16 15:43:21,527::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': '10.1.20.7:/sd2', 'iqn': '', 'portal': '', 'user': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': 'e7766e1d-f2c6-45ee-900e-00c6689649cd'}], options=None)

Thread-21026::DEBUG::2012-06-16 15:43:21,530::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21026::DEBUG::2012-06-16 15:43:21,531::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21026::DEBUG::2012-06-16 15:43:21,531::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21026::DEBUG::2012-06-16 15:43:21,531::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21026::DEBUG::2012-06-16 15:43:21,531::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21026::DEBUG::2012-06-16 15:43:21,531::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21026::INFO::2012-06-16 15:43:21,532::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'e7766e1d-f2c6-45ee-900e-00c6689649cd'}]}

Thread-21026::DEBUG::2012-06-16 15:43:21,532::task::1172::TaskManager.Task::(prepare) Task=`2a6538e5-b961-478a-bce6-f5ded1a62bca`::finished: {'statuslist': [{'status': 0, 'id': 'e7766e1d-f2c6-45ee-900e-00c6689649cd'}]}

Thread-21026::DEBUG::2012-06-16 15:43:21,532::task::588::TaskManager.Task::(_updateState) Task=`2a6538e5-b961-478a-bce6-f5ded1a62bca`::moving from state preparing -> state finished

Thread-21026::DEBUG::2012-06-16 15:43:21,532::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}

Thread-21026::DEBUG::2012-06-16 15:43:21,532::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}

Thread-21026::DEBUG::2012-06-16 15:43:21,532::task::978::TaskManager.Task::(_decref) Task=`2a6538e5-b961-478a-bce6-f5ded1a62bca`::ref 0 aborting False

Thread-21027::DEBUG::2012-06-16 15:43:21,610::BindingXMLRPC::160::vds::(wrapper) [10.1.20.2]

Thread-21027::DEBUG::2012-06-16 15:43:21,611::task::588::TaskManager.Task::(_updateState) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::moving from state init -> state preparing

Thread-21027::INFO::2012-06-16 15:43:21,611::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=6, sdUUID='711293b8-019c-4f41-8cab-df03dd843556', domainName='dfdf', typeSpecificArg='10.1.20.7:/sd2', domClass=1, domVersion='0', options=None)

Thread-21027::DEBUG::2012-06-16 15:43:21,611::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)

Thread-21027::DEBUG::2012-06-16 15:43:21,611::misc::1055::SamplingMethod::(__call__) Got in to sampling method

Thread-21027::DEBUG::2012-06-16 15:43:21,612::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)

Thread-21027::DEBUG::2012-06-16 15:43:21,612::misc::1055::SamplingMethod::(__call__) Got in to sampling method

Thread-21027::DEBUG::2012-06-16 15:43:21,612::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)

Thread-21027::DEBUG::2012-06-16 15:43:21,639::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21

Thread-21027::DEBUG::2012-06-16 15:43:21,639::misc::1063::SamplingMethod::(__call__) Returning last result

Thread-21027::DEBUG::2012-06-16 15:43:21,805::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None)

Thread-21027::DEBUG::2012-06-16 15:43:21,863::__init__::1164::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0

Thread-21027::DEBUG::2012-06-16 15:43:21,864::lvm::460::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,864::lvm::462::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,864::lvm::472::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,865::lvm::474::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,865::lvm::493::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,865::lvm::495::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,865::misc::1063::SamplingMethod::(__call__) Returning last result

Thread-21027::DEBUG::2012-06-16 15:43:21,866::lvm::352::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex

Thread-21027::DEBUG::2012-06-16 15:43:21,867::__init__::1164::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%35000c50001770ea3%\\", \\"r%.*%\\" ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 711293b8-019c-4f41-8cab-df03dd843556' (cwd None)

Thread-21027::DEBUG::2012-06-16 15:43:22,013::__init__::1164::Storage.Misc.excCmd::(_log) FAILED: <err> = '  Volume group "711293b8-019c-4f41-8cab-df03dd843556" not found\n'; <rc> = 5

Thread-21027::WARNING::2012-06-16 15:43:22,014::lvm::356::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "711293b8-019c-4f41-8cab-df03dd843556" not found']

Thread-21027::DEBUG::2012-06-16 15:43:22,016::lvm::379::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex

Thread-21027::INFO::2012-06-16 15:43:22,020::nfsSD::64::Storage.StorageDomain::(create) sdUUID=711293b8-019c-4f41-8cab-df03dd843556 domainName=dfdf remotePath=10.1.20.7:/sd2 domClass=1

Thread-21027::DEBUG::2012-06-16 15:43:22,037::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend

Thread-21027::DEBUG::2012-06-16 15:43:22,038::persistentDict::226::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[]

Thread-21027::WARNING::2012-06-16 15:43:22,038::persistentDict::248::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is

Thread-21027::DEBUG::2012-06-16 15:43:22,038::persistentDict::162::Storage.PersistentDict::(transaction) Starting transaction

Thread-21027::DEBUG::2012-06-16 15:43:22,038::persistentDict::168::Storage.PersistentDict::(transaction) Flushing changes

Thread-21027::DEBUG::2012-06-16 15:43:22,039::persistentDict::287::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=dfdf', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.1.20.7:/sd2', 'ROLE=Regular', 'SDUUID=711293b8-019c-4f41-8cab-df03dd843556', 'TYPE=SHAREDFS', 'VERSION=0', '_SHA_CKSUM=2e3c4fc88aa713dedbb0d708375966e158327797']

Thread-21027::DEBUG::2012-06-16 15:43:22,041::persistentDict::170::Storage.PersistentDict::(transaction) Finished transaction

Thread-21027::DEBUG::2012-06-16 15:43:22,042::fileSD::107::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556

Thread-21027::DEBUG::2012-06-16 15:43:22,042::persistentDict::185::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend

Thread-21027::ERROR::2012-06-16 15:43:22,043::task::853::TaskManager.Task::(_setError) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::Unexpected error

Traceback (most recent call last):

  File "/usr/share/vdsm/storage/task.py", line 861, in _run

    return fn(*args, **kargs)

  File "/usr/share/vdsm/logUtils.py", line 38, in wrapper

    res = f(*args, **kwargs)

  File "/usr/share/vdsm/storage/hsm.py", line 2136, in createStorageDomain

    typeSpecificArg, storageType, domVersion)

  File "/usr/share/vdsm/storage/nfsSD.py", line 90, in create

    fsd = cls(os.path.join(mntPoint, sdUUID))

  File "/usr/share/vdsm/storage/fileSD.py", line 113, in __init__

    sdUUID = metadata[sd.DMDK_SDUUID]

  File "/usr/share/vdsm/storage/persistentDict.py", line 85, in __getitem__

    return dec(self._dict[key])

  File "/usr/share/vdsm/storage/persistentDict.py", line 193, in __getitem__

    with self._accessWrapper():

  File "/usr/lib64/python2.6/contextlib.py", line 16, in __enter__

    return self.gen.next()

  File "/usr/share/vdsm/storage/persistentDict.py", line 147, in _accessWrapper

    self.refresh()

  File "/usr/share/vdsm/storage/persistentDict.py", line 224, in refresh

    lines = self._metaRW.readlines()

  File "/usr/share/vdsm/storage/fileSD.py", line 82, in readlines

    return misc.stripNewLines(self._oop.directReadLines(self._metafile))

  File "/usr/share/vdsm/storage/processPool.py", line 63, in wrapper

   return self.runExternally(func, *args, **kwds)

  File "/usr/share/vdsm/storage/processPool.py", line 74, in runExternally

    return self._procPool.runExternally(*args, **kwargs)

  File "/usr/share/vdsm/storage/processPool.py", line 170, in runExternally

    raise err

OSError: [Errno 22] Invalid argument: '/rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata'

Thread-21027::DEBUG::2012-06-16 15:43:22,044::task::872::TaskManager.Task::(_run) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::Task._run: fdeab954-7958-4cf3-8dd3-09e06329bf92 (6, '711293b8-019c-4f41-8cab-df03dd843556', 'dfdf', '10.1.20.7:/sd2', 1, '0') {} failed - stopping task

Thread-21027::DEBUG::2012-06-16 15:43:22,044::task::1199::TaskManager.Task::(stop) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::stopping in state preparing (force False)

Thread-21027::DEBUG::2012-06-16 15:43:22,044::task::978::TaskManager.Task::(_decref) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::ref 1 aborting True

Thread-21027::INFO::2012-06-16 15:43:22,045::task::1157::TaskManager.Task::(prepare) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::aborting: Task is aborted: u"[Errno 22] Invalid argument: '/rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata'" - code 100

Thread-21027::DEBUG::2012-06-16 15:43:22,045::task::1162::TaskManager.Task::(prepare) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::Prepare: aborted: [Errno 22] Invalid argument: '/rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata'

Thread-21027::DEBUG::2012-06-16 15:43:22,045::task::978::TaskManager.Task::(_decref) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::ref 0 aborting True

Thread-21027::DEBUG::2012-06-16 15:43:22,045::task::913::TaskManager.Task::(_doAbort) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::Task._doAbort: force False

Thread-21027::DEBUG::2012-06-16 15:43:22,045::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}

Thread-21027::DEBUG::2012-06-16 15:43:22,046::task::588::TaskManager.Task::(_updateState) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::moving from state preparing -> state aborting

Thread-21027::DEBUG::2012-06-16 15:43:22,046::task::537::TaskManager.Task::(__state_aborting) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::_aborting: recover policy none

Thread-21027::DEBUG::2012-06-16 15:43:22,046::task::588::TaskManager.Task::(_updateState) Task=`fdeab954-7958-4cf3-8dd3-09e06329bf92`::moving from state aborting -> state failed

Thread-21027::DEBUG::2012-06-16 15:43:22,046::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}

Thread-21027::DEBUG::2012-06-16 15:43:22,047::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}

Thread-21027::ERROR::2012-06-16 15:43:22,047::dispatcher::69::Storage.Dispatcher.Protect::(run) [Errno 22] Invalid argument: '/rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata'

Traceback (most recent call last):

  File "/usr/share/vdsm/storage/dispatcher.py", line 61, in run

    result = ctask.prepare(self.func, *args, **kwargs)

  File "/usr/share/vdsm/storage/task.py", line 1164, in prepare

    raise self.error

OSError: [Errno 22] Invalid argument: '/rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata'

Thread-21035::DEBUG::2012-06-16 15:43:26,510::task::588::TaskManager.Task::(_updateState) Task=`283d6276-7bdd-4c35-ad6f-6e8514c277f0`::moving from state init -> state preparing

Thread-21035::INFO::2012-06-16 15:43:26,510::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None)

Thread-21035::INFO::2012-06-16 15:43:26,511::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}

Thread-21035::DEBUG::2012-06-16 15:43:26,511::task::1172::TaskManager.Task::(prepare) Task=`283d6276-7bdd-4c35-ad6f-6e8514c277f0`::finished: {}

Thread-21035::DEBUG::2012-06-16 15:43:26,511::task::588::TaskManager.Task::(_updateState) Task=`283d6276-7bdd-4c35-ad6f-6e8514c277f0`::moving from state preparing -> state finished

Thread-21035::DEBUG::2012-06-16 15:43:26,511::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}

Thread-21035::DEBUG::2012-06-16 15:43:26,511::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}

Thread-21035::DEBUG::2012-06-16 15:43:26,511::task::978::TaskManager.Task::(_decref) Task=`283d6276-7bdd-4c35-ad6f-6e8514c277f0`::ref 0 aborting False

^C

 

 

 

[root at noc-3-synt mnt]# cat /rhev/data-center/mnt/10.1.20.7:_sd2/711293b8-019c-4f41-8cab-df03dd843556/dom_md/metadata

CLASS=Data

DESCRIPTION=dfdf

IOOPTIMEOUTSEC=1

LEASERETRIES=3

LEASETIMESEC=5

LOCKPOLICY=

LOCKRENEWALINTERVALSEC=5

POOL_UUID=

REMOTE_PATH=10.1.20.7:/sd2

ROLE=Regular

SDUUID=711293b8-019c-4f41-8cab-df03dd843556

TYPE=SHAREDFS

VERSION=0

_SHA_CKSUM=2e3c4fc88aa713dedbb0d708375966e158327797

 

 

 

From: Vijay Bellur [mailto:vbellur at redhat.com] 
Sent: Saturday, June 16, 2012 10:19 PM
To: Robert Middleswarth
Cc: зоррыч; users at ovirt.org; Daniel Paikov
Subject: Re: [Users] Ovirt 3.1 and gluster (creation in ovirt)

 



On 06/16/2012 11:08 AM, Robert Middleswarth wrote: 

I am seeing the same thing.  I also notice that glusterfs seems to die every-time I try.  I am wonder if this could be a glusterfs / f17 issue.


Are you running GlusterFS 3.2.x in Fedora 17? For this volume creation to complete successfully from oVirt, you will need GlusterFS 3.3.0. You can download Fedora RPMs for 3.3.0 from:

http://download.gluster.com/pub/gluster/glusterfs/3.3/LATEST/Fedora/


-Vijay

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20120617/0bfa1293/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: gluster-2.PNG
Type: image/png
Size: 39466 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20120617/0bfa1293/attachment.png>


More information about the Users mailing list