[Users] ovirt fails to attach gluster volume
Hi All, I have a fresh installation of ovirt 3.1 with Datacenter type posix. ovirt+ 1 node. I created a gluster volume and able to mount it locally. mount -t glusterfs fig:/vol1 /rhev/data-center/mnt/fig:_vol1 df -h gives: fig:/vol1 50G 3.9G 43G 9% /rhev/data-center/mnt/fig:_vol1 looks fine. when i try the same from ovirt GUI i receieve an error failed to add storage domain. GUI parameter passed: nodename:/volume_name VFS type:glusterfs mount options:vers=3 (tried empty also). I have reported the same one week back and I got replies like its a bug. I would like to know is there a work around . vdsm log: Thread-2474::DEBUG::2013-01-11 12:26:26,370::task::588::TaskManager.Task::(_updateState) Task=`efb3b3cc-5645-4f87-92cb-b9ecb8ccce48`::moving from state init -> state preparing Thread-2474::INFO::2013-01-11 12:26:26,371::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'fig:/vol1', 'iqn': '', 'portal': '', 'user': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) Thread-2474::INFO::2013-01-11 12:26:26,371::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-2474::DEBUG::2013-01-11 12:26:26,371::task::1172::TaskManager.Task::(prepare) Task=`efb3b3cc-5645-4f87-92cb-b9ecb8ccce48`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} Thread-2474::DEBUG::2013-01-11 12:26:26,371::task::588::TaskManager.Task::(_updateState) Task=`efb3b3cc-5645-4f87-92cb-b9ecb8ccce48`::moving from state preparing -> state finished Thread-2474::DEBUG::2013-01-11 12:26:26,372::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-2474::DEBUG::2013-01-11 12:26:26,372::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-2474::DEBUG::2013-01-11 12:26:26,372::task::978::TaskManager.Task::(_decref) Task=`efb3b3cc-5645-4f87-92cb-b9ecb8ccce48`::ref 0 aborting False Thread-2475::DEBUG::2013-01-11 12:26:26,410::BindingXMLRPC::156::vds::(wrapper) [135.250.76.71] Thread-2475::DEBUG::2013-01-11 12:26:26,411::task::588::TaskManager.Task::(_updateState) Task=`f377d9bb-c357-49f9-8aef-483f0525bec9`::moving from state init -> state preparing Thread-2475::INFO::2013-01-11 12:26:26,411::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'fig:/vol1', 'iqn': '', 'portal': '', 'user': '', 'vfs_type': 'glusterfs', 'password': '******', 'id': 'c200ffa7-a334-4d8d-b43e-3f25f3e8a84c'}], options=None) Thread-2475::DEBUG::2013-01-11 12:26:26,419::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /usr/bin/mount -t glusterfs fig:/vol1 /rhev/data-center/mnt/fig:_vol1' (cwd None) Thread-2475::ERROR::2013-01-11 12:26:26,508::hsm::1932::Storage.HSM::(connectStorageServer) Could not connect to storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 179, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'Mount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-center-mnt-fig:_vol1.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-center-mnt-fig:_vol1.log\n') engine log: 2013-01-11 12:28:21,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-4) [29437bcd] START, V alidateStorageServerConnectionVDSCommand(vdsId = ee2b26ba-5bb1-11e2-815e-e4115b978434, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = PO SIXFS, connectionList = [{ id: null, connection: fig:/vol1 };]), log id: 658913d 2013-01-11 12:28:21,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-4) [29437bcd] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 658913d 2013-01-11 12:28:21,053 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-4) [29437bcd] Running command: AddStor ageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2013-01-11 12:28:21,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-4) [29437bcd] START, ConnectStora geServerVDSCommand(vdsId = ee2b26ba-5bb1-11e2-815e-e4115b978434, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = POSIXFS, connectionList = [{ id: c200ffa7-a334-4d8d-b43e-3f25f3e8a84c, connection: fig:/vol1 };]), log id: 322d95a9 2013-01-11 12:28:21,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-4) [29437bcd] FINISH, ConnectStor ageServerVDSCommand, return: {c200ffa7-a334-4d8d-b43e-3f25f3e8a84c=477}, log id: 322d95a9 2013-01-11 12:28:21,190 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-4) [29437bcd] The connection with details fig:/vol1 failed because of error code 477 and error message is: 477 2013-01-11 12:28:21,220 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-2) [522a5ac5] The message key AddPosixFsStorageDoma in is missing from bundles/ExecutionMessages 2013-01-11 12:28:21,242 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-2) [522a5ac5] Running command: AddPosixFs StorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System 2013-01-11 12:28:21,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-2) [522a5ac5] START, CreateStorage DomainVDSCommand(vdsId = ee2b26ba-5bb1-11e2-815e-e4115b978434, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@9c3f6ce6, ar gs=fig:/vol1), log id: 6a3a31b8 2013-01-11 12:28:21,776 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-2) [522a5ac5] Failed in CreateStorageDomainVDS method 2013-01-11 12:28:21,777 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-2) [522a5ac5] Error code StorageDomainFSNotMou nted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data -center/mnt/fig:_vol1',) 2013-01-11 12:28:21,780 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-2) [522a5ac5] Command org.ovirt.engine.core.vd sbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/fig:_vol1',) Thanks, Jithin
On 01/11/2013 12:56 PM, Jithin Raju wrote:
Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 179, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'Mount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-center-mnt-fig:_vol1.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-center-mnt-fig:_vol1.log\n')
Do you have selinux in enforcing mode on the host? Thanks, Vijay
Hi Vijai, Its a fresh fedora installation and i didn't change selinux mode, so it should be enforcing. Shall I change it to permissive? or is there a particular selinux config for vdsm/gluster so that I can keep selinux in enforcing mode. I can update you the results after setting selinux to permissive tomorrow. One quick question , this storage mounting in nodes are run as vdsm user? Thanks, Jithin On Fri, Jan 11, 2013 at 10:56 PM, Vijay Bellur <vbellur@redhat.com> wrote:
On 01/11/2013 12:56 PM, Jithin Raju wrote:
Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.**py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/**storageServer.py", line 179, in connect self._mount.mount(self.**options, self._vfsType) File "/usr/share/vdsm/storage/**mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/**mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'Mount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-**center-mnt-fig:_vol1.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-**center-mnt-fig:_vol1.log\n')
Do you have selinux in enforcing mode on the host?
Thanks, Vijay
Hi Vijay, Its working now, gluster volume is attached as my data domain now, thanks. First I moved only node selinux to permissive, which didn't help got an error "Error: A Request to the Server failed with the following Status Code: 500". Then moved engine server selinux to permissive then got it working. Thanks, Jithin On Fri, Jan 11, 2013 at 10:56 PM, Vijay Bellur <vbellur@redhat.com> wrote:
On 01/11/2013 12:56 PM, Jithin Raju wrote:
Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.**py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/**storageServer.py", line 179, in connect self._mount.mount(self.**options, self._vfsType) File "/usr/share/vdsm/storage/**mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/**mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'Mount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-**center-mnt-fig:_vol1.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-**center-mnt-fig:_vol1.log\n')
Do you have selinux in enforcing mode on the host?
Thanks, Vijay
participants (2)
-
Jithin Raju -
Vijay Bellur