vdsm.log? (from 'Use Host') Possible checklist: - all the bricks of the volume should have 36:36 permission - 'Use Host' should have gluster client packages - you could try without passing any mount options(vers=3) Regards, Kanagaraj ----- Original Message ----- From: "yoshinobu.ushida" <yoshinobu.ushida(a)gmail.com&gt; To: users(a)ovirt.org Sent: Thursday, November 29, 2012 7:00:54 PM Subject: [Users] problem adding a gluster storage domain. Hi All, I have failed to create the new domain of glusterfs. After create volume, I am creating with reference to the below. http://middleswarth.net/content/installing-ovirt-31-and-glusterfs-using-e... If you have any ideas, please let me know.. engine.log : 2012-11-29 22:26:50,742 WARN [org.ovirt.engine.core.bll.GetConfigurationValueQuery] (ajp--0.0.0.0-8009-2) calling GetConfigurationValueQuery (StorageDomainNameSizeLimit) with null version, using default general for version 2012-11-29 22:26:50,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ValidateStorageServerConnectionVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 494f6442 2012-11-29 22:26:50,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=0}, log id: 494f6442 2012-11-29 22:26:50,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-10) [312d49f8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ConnectStorageServerVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 2f838360 2012-11-29 22:26:50,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ConnectStorageServerVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=477}, log id: 2f838360 2012-11-29 22:26:50,937 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-10) [312d49f8] The connection with details localhost:/data failed because of error code 477 and error message is: 477 2012-11-29 22:26:50,971 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-4) [4b06833c] The message key AddPosixFsStorageDomain is missing from bundles/ExecutionMessages 2012-11-29 22:26:50,980 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Running command: AddPosixFsStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] START, CreateStorageDomainVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@bce5367e, args=localhost:/data), log id: 72b00ef2 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Failed in CreateStorageDomainVDS method 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Error code StorageDomainFSNotMounted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Vds: node5 2012-11-29 22:26:53,481 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command CreateStorageDomainVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] FINISH, CreateStorageDomainVDSCommand, log id: 72b00ef2 2012-11-29 22:26:53,482 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,484 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_dynamic; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,485 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_static; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,487 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand. Best Regards, _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Have tried mounting the gluster volume? (to make sure problem is not there in gluster) Something like 'mount -t glusterfs localhost:/volume /tmp/volume'. You could execute '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' and see what happens. ----- Original Message ----- From: "yoshinobu.ushida" <yoshinobu.ushida(a)gmail.com&gt; To: "Kanagaraj Mayilsamy" <kmayilsa(a)redhat.com&gt; Cc: users(a)ovirt.org Sent: Thursday, November 29, 2012 8:09:33 PM Subject: Re: [Users] problem adding a gluster storage domain. Hi Kanagaraj-san, Thank you for your reply. The check list are all okay. Do you have other check list? I have created another volume. However, result is same. vdsm.log is as follows. vdsm.log Thread-3849::DEBUG::2012-11-29 07:34:11,810::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state init -> state preparing Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::1172::TaskManager.Task::(prepare) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state preparing -> state finished Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::978::TaskManager.Task::(_decref) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::ref 0 aborting False Thread-3850::DEBUG::2012-11-29 07:34:11,828::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3850::DEBUG::2012-11-29 07:34:11,828::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state init -> state preparing Thread-3850::INFO::2012-11-29 07:34:11,829::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}], options=None) Thread-3850::DEBUG::2012-11-29 07:34:11,840::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' (cwd None) Thread-3850::ERROR::2012-11-29 07:34:11,906::hsm::1932::Storage.HSM::(connectStorageServer) Could not connect to storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 179, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'unknown option vers (ignored)\nMount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log\n') Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::INFO::2012-11-29 07:34:11,909::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 477, 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}]} Thread-3850::DEBUG::2012-11-29 07:34:11,909::task::1172::TaskManager.Task::(prepare) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::finished: {'statuslist': [{'status': 477, 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}]} Thread-3850::DEBUG::2012-11-29 07:34:11,909::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state preparing -> state finished Thread-3850::DEBUG::2012-11-29 07:34:11,909::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3850::DEBUG::2012-11-29 07:34:11,910::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3850::DEBUG::2012-11-29 07:34:11,910::task::978::TaskManager.Task::(_decref) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::ref 0 aborting False Thread-3851::DEBUG::2012-11-29 07:34:11,969::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3851::DEBUG::2012-11-29 07:34:11,969::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state init -> state preparing Thread-3851::INFO::2012-11-29 07:34:11,970::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=6, sdUUID='e8bc9361-1e71-48ef-9e3f-dc4affb856f2', domainName='volume', typeSpecificArg='localhost:/volume', domClass=1, domVersion='0', options=None) Thread-3851::DEBUG::2012-11-29 07:34:11,970::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) Thread-3851::DEBUG::2012-11-29 07:34:11,970::misc::1055::SamplingMethod::(__call__) Got in to sampling method Thread-3851::DEBUG::2012-11-29 07:34:11,971::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-3851::DEBUG::2012-11-29 07:34:11,971::misc::1055::SamplingMethod::(__call__) Got in to sampling method Thread-3851::DEBUG::2012-11-29 07:34:11,971::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:11,987::__init__::1249::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 Thread-3851::DEBUG::2012-11-29 07:34:11,987::misc::1063::SamplingMethod::(__call__) Returning last result Thread-3852::DEBUG::2012-11-29 07:34:12,239::task::588::TaskManager.Task::(_updateState) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::moving from state init -> state preparing Thread-3852::INFO::2012-11-29 07:34:12,239::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-3852::INFO::2012-11-29 07:34:12,240::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} Thread-3852::DEBUG::2012-11-29 07:34:12,240::task::1172::TaskManager.Task::(prepare) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::finished: {} Thread-3852::DEBUG::2012-11-29 07:34:12,240::task::588::TaskManager.Task::(_updateState) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::moving from state preparing -> state finished Thread-3852::DEBUG::2012-11-29 07:34:12,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3852::DEBUG::2012-11-29 07:34:12,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3852::DEBUG::2012-11-29 07:34:12,241::task::978::TaskManager.Task::(_decref) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::ref 0 aborting False Thread-3851::DEBUG::2012-11-29 07:34:14,180::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:14,322::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 Thread-3851::DEBUG::2012-11-29 07:34:14,322::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::misc::1063::SamplingMethod::(__call__) Returning last result Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,325::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free e8bc9361-1e71-48ef-9e3f-dc4affb856f2' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:14,391::__init__::1249::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "e8bc9361-1e71-48ef-9e3f-dc4affb856f2" not found\n'; <rc> = 5 Thread-3851::WARNING::2012-11-29 07:34:14,392::lvm::353::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "e8bc9361-1e71-48ef-9e3f-dc4affb856f2" not found'] Thread-3851::DEBUG::2012-11-29 07:34:14,392::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-3851::INFO::2012-11-29 07:34:14,396::nfsSD::64::Storage.StorageDomain::(create) sdUUID=e8bc9361-1e71-48ef-9e3f-dc4affb856f2 domainName=volume remotePath=localhost:/volume domClass=1 Thread-3851::ERROR::2012-11-29 07:34:14,407::task::853::TaskManager.Task::(_setError) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 861, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 38, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 2136, in createStorageDomain typeSpecificArg, storageType, domVersion) File "/usr/share/vdsm/storage/nfsSD.py", line 75, in create cls._preCreateValidation(sdUUID, mntPoint, remotePath, version) File "/usr/share/vdsm/storage/nfsSD.py", line 44, in _preCreateValidation raise se.StorageDomainFSNotMounted(domPath) StorageDomainFSNotMounted: Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_volume',) Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::872::TaskManager.Task::(_run) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Task._run: 1262ec8a-3408-429c-a512-1e7bfcc9187d (6, 'e8bc9361-1e71-48ef-9e3f-dc4affb856f2', 'volume', 'localhost:/volume', 1, '0') {} failed - stopping task Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::1199::TaskManager.Task::(stop) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::stopping in state preparing (force False) Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::978::TaskManager.Task::(_decref) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::ref 1 aborting True Thread-3851::INFO::2012-11-29 07:34:14,409::task::1157::TaskManager.Task::(prepare) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::aborting: Task is aborted: 'Storage domain remote path not mounted' - code 360 Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::1162::TaskManager.Task::(prepare) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Prepare: aborted: Storage domain remote path not mounted Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::978::TaskManager.Task::(_decref) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::ref 0 aborting True Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::913::TaskManager.Task::(_doAbort) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Task._doAbort: force False Thread-3851::DEBUG::2012-11-29 07:34:14,409::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state preparing -> state aborting Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::537::TaskManager.Task::(__state_aborting) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::_aborting: recover policy none Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state aborting -> state failed Thread-3851::DEBUG::2012-11-29 07:34:14,410::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3851::DEBUG::2012-11-29 07:34:14,411::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3851::ERROR::2012-11-29 07:34:14,411::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_volume',)", 'code': 360}} Thread-3861::DEBUG::2012-11-29 07:34:22,328::task::588::TaskManager.Task::(_updateState) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::moving from state init -> state preparing Thread-3861::INFO::2012-11-29 07:34:22,328::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-3861::INFO::2012-11-29 07:34:22,328::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::1172::TaskManager.Task::(prepare) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::finished: {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::588::TaskManager.Task::(_updateState) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::moving from state preparing -> state finished Thread-3861::DEBUG::2012-11-29 07:34:22,329::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::978::TaskManager.Task::(_decref) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::ref 0 aborting False Best Regards, Ushida 2012/11/29 Kanagaraj Mayilsamy < kmayilsa(a)redhat.com > vdsm.log? (from 'Use Host') Possible checklist: - all the bricks of the volume should have 36:36 permission - 'Use Host' should have gluster client packages - you could try without passing any mount options(vers=3) Regards, Kanagaraj ----- Original Message ----- From: "yoshinobu.ushida" < yoshinobu.ushida(a)gmail.com > To: users(a)ovirt.org Sent: Thursday, November 29, 2012 7:00:54 PM Subject: [Users] problem adding a gluster storage domain. Hi All, I have failed to create the new domain of glusterfs. After create volume, I am creating with reference to the below. http://middleswarth.net/content/installing-ovirt-31-and-glusterfs-using-e... If you have any ideas, please let me know.. engine.log : 2012-11-29 22:26:50,742 WARN [org.ovirt.engine.core.bll.GetConfigurationValueQuery] (ajp--0.0.0.0-8009-2) calling GetConfigurationValueQuery (StorageDomainNameSizeLimit) with null version, using default general for version 2012-11-29 22:26:50,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ValidateStorageServerConnectionVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 494f6442 2012-11-29 22:26:50,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=0}, log id: 494f6442 2012-11-29 22:26:50,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-10) [312d49f8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ConnectStorageServerVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 2f838360 2012-11-29 22:26:50,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ConnectStorageServerVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=477}, log id: 2f838360 2012-11-29 22:26:50,937 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-10) [312d49f8] The connection with details localhost:/data failed because of error code 477 and error message is: 477 2012-11-29 22:26:50,971 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-4) [4b06833c] The message key AddPosixFsStorageDomain is missing from bundles/ExecutionMessages 2012-11-29 22:26:50,980 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Running command: AddPosixFsStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] START, CreateStorageDomainVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@bce5367e, args=localhost:/data), log id: 72b00ef2 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Failed in CreateStorageDomainVDS method 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Error code StorageDomainFSNotMounted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Vds: node5 2012-11-29 22:26:53,481 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command CreateStorageDomainVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] FINISH, CreateStorageDomainVDSCommand, log id: 72b00ef2 2012-11-29 22:26:53,482 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,484 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_dynamic; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,485 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_static; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,487 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand. Best Regards, _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users

I am not sure how you have created a gluster volume with name as 'volume'. In gluster you cannot create volume with name 'volume'. If i try to do that, gluster says '"volume" cannot be the name of a volume'. Can you replace 'volume' with actual volume name while creating storage domain and repeat the steps? something like: 192.168.77.107:/test_vol or localhost:/test_vol ----- Original Message ----- From: "yoshinobu.ushida" <yoshinobu.ushida(a)gmail.com&gt; To: "Kanagaraj Mayilsamy" <kmayilsa(a)redhat.com&gt; Cc: users(a)ovirt.org Sent: Thursday, November 29, 2012 8:57:12 PM Subject: Re: [Users] problem adding a gluster storage domain. Thank you very much. I have executed the mount. Result is below. # /usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost\:_volume unknown option vers (ignored) I can mounted when I have created using gluster's command. # gluster volume create test_vol replica 2 transport tcp 192.168.77.107:/test 192.168.77.108:/test Creation of volume test_vol has been successful. Please start the volume to access data. # gluster volume start test_vol Starting volume test_vol has been successful # mount.glusterfs localhost:/test_vol /mnt # df -h | grep test_vol localhost:/test_vol 50G 2.2G 45G 5% /mnt Regards, Ushida 2012/11/29 Kanagaraj Mayilsamy < kmayilsa(a)redhat.com > Have tried mounting the gluster volume? (to make sure problem is not there in gluster) Something like 'mount -t glusterfs localhost:/volume /tmp/volume'. You could execute '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' and see what happens. ----- Original Message ----- From: "yoshinobu.ushida" < yoshinobu.ushida(a)gmail.com > To: "Kanagaraj Mayilsamy" < kmayilsa(a)redhat.com > Cc: users(a)ovirt.org Sent: Thursday, November 29, 2012 8:09:33 PM Subject: Re: [Users] problem adding a gluster storage domain. Hi Kanagaraj-san, Thank you for your reply. The check list are all okay. Do you have other check list? I have created another volume. However, result is same. vdsm.log is as follows. vdsm.log Thread-3849::DEBUG::2012-11-29 07:34:11,810::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state init -> state preparing Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::1172::TaskManager.Task::(prepare) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state preparing -> state finished Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::978::TaskManager.Task::(_decref) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::ref 0 aborting False Thread-3850::DEBUG::2012-11-29 07:34:11,828::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3850::DEBUG::2012-11-29 07:34:11,828::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state init -> state preparing Thread-3850::INFO::2012-11-29 07:34:11,829::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}], options=None) Thread-3850::DEBUG::2012-11-29 07:34:11,840::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' (cwd None) Thread-3850::ERROR::2012-11-29 07:34:11,906::hsm::1932::Storage.HSM::(connectStorageServer) Could not connect to storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 179, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'unknown option vers (ignored)\nMount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log\n') Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3850::DEBUG::2012-11-29 07:34:11,908::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3850::INFO::2012-11-29 07:34:11,909::logUtils::39::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 477, 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}]} Thread-3850::DEBUG::2012-11-29 07:34:11,909::task::1172::TaskManager.Task::(prepare) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::finished: {'statuslist': [{'status': 477, 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}]} Thread-3850::DEBUG::2012-11-29 07:34:11,909::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state preparing -> state finished Thread-3850::DEBUG::2012-11-29 07:34:11,909::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3850::DEBUG::2012-11-29 07:34:11,910::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3850::DEBUG::2012-11-29 07:34:11,910::task::978::TaskManager.Task::(_decref) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::ref 0 aborting False Thread-3851::DEBUG::2012-11-29 07:34:11,969::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3851::DEBUG::2012-11-29 07:34:11,969::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state init -> state preparing Thread-3851::INFO::2012-11-29 07:34:11,970::logUtils::37::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=6, sdUUID='e8bc9361-1e71-48ef-9e3f-dc4affb856f2', domainName='volume', typeSpecificArg='localhost:/volume', domClass=1, domVersion='0', options=None) Thread-3851::DEBUG::2012-11-29 07:34:11,970::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) Thread-3851::DEBUG::2012-11-29 07:34:11,970::misc::1055::SamplingMethod::(__call__) Got in to sampling method Thread-3851::DEBUG::2012-11-29 07:34:11,971::misc::1053::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-3851::DEBUG::2012-11-29 07:34:11,971::misc::1055::SamplingMethod::(__call__) Got in to sampling method Thread-3851::DEBUG::2012-11-29 07:34:11,971::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:11,987::__init__::1249::Storage.Misc.excCmd::(_log) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 Thread-3851::DEBUG::2012-11-29 07:34:11,987::misc::1063::SamplingMethod::(__call__) Returning last result Thread-3852::DEBUG::2012-11-29 07:34:12,239::task::588::TaskManager.Task::(_updateState) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::moving from state init -> state preparing Thread-3852::INFO::2012-11-29 07:34:12,239::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-3852::INFO::2012-11-29 07:34:12,240::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} Thread-3852::DEBUG::2012-11-29 07:34:12,240::task::1172::TaskManager.Task::(prepare) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::finished: {} Thread-3852::DEBUG::2012-11-29 07:34:12,240::task::588::TaskManager.Task::(_updateState) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::moving from state preparing -> state finished Thread-3852::DEBUG::2012-11-29 07:34:12,240::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3852::DEBUG::2012-11-29 07:34:12,241::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3852::DEBUG::2012-11-29 07:34:12,241::task::978::TaskManager.Task::(_decref) Task=`b63dbf12-0e8c-4828-a475-7e5fa0d7dff0`::ref 0 aborting False Thread-3851::DEBUG::2012-11-29 07:34:14,180::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:14,322::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err> = ''; <rc> = 0 Thread-3851::DEBUG::2012-11-29 07:34:14,322::lvm::457::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::459::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::469::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,323::lvm::471::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::490::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::492::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,324::misc::1063::SamplingMethod::(__call__) Returning last result Thread-3851::DEBUG::2012-11-29 07:34:14,324::lvm::349::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-3851::DEBUG::2012-11-29 07:34:14,325::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free e8bc9361-1e71-48ef-9e3f-dc4affb856f2' (cwd None) Thread-3851::DEBUG::2012-11-29 07:34:14,391::__init__::1249::Storage.Misc.excCmd::(_log) FAILED: <err> = ' Volume group "e8bc9361-1e71-48ef-9e3f-dc4affb856f2" not found\n'; <rc> = 5 Thread-3851::WARNING::2012-11-29 07:34:14,392::lvm::353::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "e8bc9361-1e71-48ef-9e3f-dc4affb856f2" not found'] Thread-3851::DEBUG::2012-11-29 07:34:14,392::lvm::376::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-3851::INFO::2012-11-29 07:34:14,396::nfsSD::64::Storage.StorageDomain::(create) sdUUID=e8bc9361-1e71-48ef-9e3f-dc4affb856f2 domainName=volume remotePath=localhost:/volume domClass=1 Thread-3851::ERROR::2012-11-29 07:34:14,407::task::853::TaskManager.Task::(_setError) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 861, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 38, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 2136, in createStorageDomain typeSpecificArg, storageType, domVersion) File "/usr/share/vdsm/storage/nfsSD.py", line 75, in create cls._preCreateValidation(sdUUID, mntPoint, remotePath, version) File "/usr/share/vdsm/storage/nfsSD.py", line 44, in _preCreateValidation raise se.StorageDomainFSNotMounted(domPath) StorageDomainFSNotMounted: Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_volume',) Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::872::TaskManager.Task::(_run) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Task._run: 1262ec8a-3408-429c-a512-1e7bfcc9187d (6, 'e8bc9361-1e71-48ef-9e3f-dc4affb856f2', 'volume', 'localhost:/volume', 1, '0') {} failed - stopping task Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::1199::TaskManager.Task::(stop) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::stopping in state preparing (force False) Thread-3851::DEBUG::2012-11-29 07:34:14,408::task::978::TaskManager.Task::(_decref) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::ref 1 aborting True Thread-3851::INFO::2012-11-29 07:34:14,409::task::1157::TaskManager.Task::(prepare) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::aborting: Task is aborted: 'Storage domain remote path not mounted' - code 360 Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::1162::TaskManager.Task::(prepare) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Prepare: aborted: Storage domain remote path not mounted Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::978::TaskManager.Task::(_decref) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::ref 0 aborting True Thread-3851::DEBUG::2012-11-29 07:34:14,409::task::913::TaskManager.Task::(_doAbort) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::Task._doAbort: force False Thread-3851::DEBUG::2012-11-29 07:34:14,409::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state preparing -> state aborting Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::537::TaskManager.Task::(__state_aborting) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::_aborting: recover policy none Thread-3851::DEBUG::2012-11-29 07:34:14,410::task::588::TaskManager.Task::(_updateState) Task=`1262ec8a-3408-429c-a512-1e7bfcc9187d`::moving from state aborting -> state failed Thread-3851::DEBUG::2012-11-29 07:34:14,410::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3851::DEBUG::2012-11-29 07:34:14,411::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3851::ERROR::2012-11-29 07:34:14,411::dispatcher::66::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_volume',)", 'code': 360}} Thread-3861::DEBUG::2012-11-29 07:34:22,328::task::588::TaskManager.Task::(_updateState) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::moving from state init -> state preparing Thread-3861::INFO::2012-11-29 07:34:22,328::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-3861::INFO::2012-11-29 07:34:22,328::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::1172::TaskManager.Task::(prepare) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::finished: {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::588::TaskManager.Task::(_updateState) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::moving from state preparing -> state finished Thread-3861::DEBUG::2012-11-29 07:34:22,329::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3861::DEBUG::2012-11-29 07:34:22,329::task::978::TaskManager.Task::(_decref) Task=`56063337-848f-4f0e-8cc3-73db73b9617b`::ref 0 aborting False Best Regards, Ushida 2012/11/29 Kanagaraj Mayilsamy < kmayilsa(a)redhat.com > vdsm.log? (from 'Use Host') Possible checklist: - all the bricks of the volume should have 36:36 permission - 'Use Host' should have gluster client packages - you could try without passing any mount options(vers=3) Regards, Kanagaraj ----- Original Message ----- From: "yoshinobu.ushida" < yoshinobu.ushida(a)gmail.com > To: users(a)ovirt.org Sent: Thursday, November 29, 2012 7:00:54 PM Subject: [Users] problem adding a gluster storage domain. Hi All, I have failed to create the new domain of glusterfs. After create volume, I am creating with reference to the below. http://middleswarth.net/content/installing-ovirt-31-and-glusterfs-using-e... If you have any ideas, please let me know.. engine.log : 2012-11-29 22:26:50,742 WARN [org.ovirt.engine.core.bll.GetConfigurationValueQuery] (ajp--0.0.0.0-8009-2) calling GetConfigurationValueQuery (StorageDomainNameSizeLimit) with null version, using default general for version 2012-11-29 22:26:50,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ValidateStorageServerConnectionVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 494f6442 2012-11-29 22:26:50,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=0}, log id: 494f6442 2012-11-29 22:26:50,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-10) [312d49f8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ConnectStorageServerVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 2f838360 2012-11-29 22:26:50,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ConnectStorageServerVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=477}, log id: 2f838360 2012-11-29 22:26:50,937 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-10) [312d49f8] The connection with details localhost:/data failed because of error code 477 and error message is: 477 2012-11-29 22:26:50,971 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-4) [4b06833c] The message key AddPosixFsStorageDomain is missing from bundles/ExecutionMessages 2012-11-29 22:26:50,980 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Running command: AddPosixFsStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2012-11-29 22:26:50,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] START, CreateStorageDomainVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@bce5367e, args=localhost:/data), log id: 72b00ef2 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Failed in CreateStorageDomainVDS method 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Error code StorageDomainFSNotMounted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Vds: node5 2012-11-29 22:26:53,481 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command CreateStorageDomainVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] FINISH, CreateStorageDomainVDSCommand, log id: 72b00ef2 2012-11-29 22:26:53,482 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,484 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_dynamic; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,485 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Command [id=fd9d1745-73da-4dbd-9dad-cc35d4ec385e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.storage_domain_static; snapshot: 818ef1a5-a3f1-4c06-8215-ca6029409599. 2012-11-29 22:26:53,487 ERROR [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand. Best Regards, _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users