<html><body><div style="font-family: Times New Roman; font-size: 10pt; color: #000000"><div data-marker="__QUOTED_TEXT__"><div style="font-family: Times New Roman; font-size: 10pt; color: #000000"><div>Hi,</div><br><div>I have engine installed on one machine and host on another, running Version 4.1.7.6-1.el7.centos</div><div>Everything looks ok except the iso domain I cannot attach it to the data center. Message on the engine dashboard:</div><br><div>Failed to attach Storage Domain ISO_DOMAIN to Data Center Default. (User: admin@internal-authz)</div><div>VDSM command AttachStorageDomainVDS failed: Error in storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93, spUUID=5a0287ce-0233-0170-00a2-0000000001d8',)</div><br><div>Checking the configuration everything looks ok:</div><div>[root@engine ~]# grep iso /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf<br>OVESETUP_CONFIG/isoDomainName=str:ISO_DOMAIN<br>OVESETUP_CONFIG/isoDomainSdUuid=str:875e1af4-ba14-4255-b6ad-c3031672df93<br>OVESETUP_CONFIG/isoDomainMountPoint=str:/home/iso<br>OVESETUP_CONFIG/isoDomainExists=bool:True<br>OVESETUP_CONFIG/isoDomainStorageDir=str:/home/iso/875e1af4-ba14-4255-b6ad-c3031672df93/images/11111111-1111-1111-1111-111111111111<br></div><br><div>[root@engine ~]# ovirt-iso-uploader list<br>Please provide the REST API password for the admin@internal oVirt Engine user (CTRL+D to abort):<br>ISO Storage Domain Name | ISO Domain Status<br>ISO_DOMAIN | ok<br></div><br><div>[root@node1 ~]# vdsClient -s 0 getStorageDomainsList<br>5eed853b-09ee-430d-bde2-c37394c1ff6c<br></div><br><br><div>I can mount the export manually</div><br><br><div>Don't know where to look more. Any idea? thanks</div><br><br><div>vdsm log:</div><div>2017-11-10 10:51:00,839+0000 INFO (periodic/3) [vdsm.api] START repoStats(options=None) from=internal, task_id=f0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:46)<br>2017-11-10 10:51:00,840+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000890471', 'lastCheck': '4.8', 'valid': True}} from=internal, task_id=f0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:52)<br>2017-11-10 10:51:05,323+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:07,277+0000 INFO (jsonrpc/4) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=399705b5, task_id=998fe1bc-eff0-4ba7-942c-458906c5e1f1 (api:46)<br>2017-11-10 10:51:07,277+0000 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000844547', 'lastCheck': '1.2', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=399705b5, task_id=998fe1bc-eff0-4ba7-942c-458906c5e1f1 (api:52)<br>2017-11-10 10:51:07,285+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:07,345+0000 INFO (jsonrpc/1) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=4b670edd, task_id=a6baf012-6dbb-47d6-9f8e-457e42bbc7d7 (api:46)<br>2017-11-10 10:51:07,352+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=4b670edd, task_id=a6baf012-6dbb-47d6-9f8e-457e42bbc7d7 (api:52)<br>2017-11-10 10:51:07,352+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:08,410+0000 INFO (jsonrpc/2) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=4b670edd, task_id=4d623b87-105f-47ef-8385-7d7391378906 (api:46)<br>2017-11-10 10:51:08,421+0000 INFO (jsonrpc/2) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=4b670edd, task_id=4d623b87-105f-47ef-8385-7d7391378906 (api:52)<br>2017-11-10 10:51:08,422+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:11,159+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None) from=internal, task_id=8da65b6e-23ba-40fb-82fd-287645bb05cf (api:46)<br>2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000718255', 'lastCheck': '1.8', 'valid': True}} from=internal, task_id=8da65b6e-23ba-40fb-82fd-287645bb05cf (api:52)<br>2017-11-10 10:51:19,434+0000 INFO (jsonrpc/0) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=32cb4291, task_id=c42d1ce1-d82c-47ad-874f-6d73142e49c6 (api:46)<br>2017-11-10 10:51:19,443+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=32cb4291, task_id=c42d1ce1-d82c-47ad-874f-6d73142e49c6 (api:52)<br>2017-11-10 10:51:19,444+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:20,453+0000 INFO (jsonrpc/6) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=32cb4291, task_id=72cdacd6-5133-4554-8ecc-86f11a094064 (api:46)<br>2017-11-10 10:51:20,464+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=32cb4291, task_id=72cdacd6-5133-4554-8ecc-86f11a094064 (api:52)<br>2017-11-10 10:51:20,465+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:21,329+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:22,360+0000 INFO (jsonrpc/7) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=5eb26f2b, task_id=c4320507-69ec-457d-a51b-e898702de247 (api:46)<br>2017-11-10 10:51:22,360+0000 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000718255', 'lastCheck': '6.3', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=5eb26f2b, task_id=c4320507-69ec-457d-a51b-e898702de247 (api:52)<br>2017-11-10 10:51:22,368+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:26,178+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:30,878+0000 INFO (periodic/2) [vdsm.api] START repoStats(options=None) from=internal, task_id=f62ad6de-75ad-4a99-bb4d-2854b5ff85c6 (api:46)<br>2017-11-10 10:51:30,878+0000 INFO (periodic/2) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000956708', 'lastCheck': '4.8', 'valid': True}} from=internal, task_id=f62ad6de-75ad-4a99-bb4d-2854b5ff85c6 (api:52)<br>2017-11-10 10:51:31,436+0000 INFO (jsonrpc/1) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=11ee2968, task_id=738c51fb-387e-47b3-a1ad-03fc900f749f (api:46)<br>2017-11-10 10:51:31,444+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=11ee2968, task_id=738c51fb-387e-47b3-a1ad-03fc900f749f (api:52)<br>2017-11-10 10:51:31,445+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:32,454+0000 INFO (jsonrpc/2) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=11ee2968, task_id=4f010678-55ba-4ead-84bc-734763662964 (api:46)<br>2017-11-10 10:51:32,464+0000 INFO (jsonrpc/2) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=11ee2968, task_id=4f010678-55ba-4ead-84bc-734763662964 (api:52)<br>2017-11-10 10:51:32,465+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:33,948+0000 INFO (jsonrpc/3) [vdsm.api] START connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'id': u'ba9e9b72-cade-4e16-82fe-237ff7143b3b', u'connection': u'engine.futurcargo.com:/home/iso', u'iqn': u'', u'user': u'', u'password': '********', u'port': u''}], options=None) from=::ffff:192.168.16.9,42836, flow_id=1cccae15, task_id=37c76c14-2e74-4c12-99d7-6b3f2397348e (api:46)<br>2017-11-10 10:51:33,951+0000 INFO (jsonrpc/3) [IOProcessClient] Starting client ioprocess-706 (__init__:330)<br>2017-11-10 10:51:33,962+0000 INFO (ioprocess/20640) [IOProcess] Starting ioprocess (__init__:452)<br>2017-11-10 10:51:33,964+0000 INFO (jsonrpc/3) [vdsm.api] FINISH connectStorageServer return={'statuslist': [{'status': 0, 'id': u'ba9e9b72-cade-4e16-82fe-237ff7143b3b'}]} from=::ffff:192.168.16.9,42836, flow_id=1cccae15, task_id=37c76c14-2e74-4c12-99d7-6b3f2397348e (api:52)<br>2017-11-10 10:51:33,965+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:34,974+0000 INFO (jsonrpc/0) [vdsm.api] START attachStorageDomain(sdUUID=u'875e1af4-ba14-4255-b6ad-c3031672df93', spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=05e7dbb5-bad3-484f-b364-ca635fe1f20b, task_id=472c9bfe-0751-4240-b5c4-e867cb3d0cfb (api:46)<br>2017-11-10 10:51:34,975+0000 INFO (jsonrpc/0) [storage.StoragePool] sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93 spUUID=5a0287ce-0233-0170-00a2-0000000001d8 (sp:942)<br>2017-11-10 10:51:35,102+0000 INFO (itmap/0) [IOProcessClient] Starting client ioprocess-707 (__init__:330)<br>2017-11-10 10:51:35,113+0000 INFO (itmap/1) [IOProcessClient] Starting client ioprocess-708 (__init__:330)<br>2017-11-10 10:51:35,123+0000 INFO (ioprocess/20654) [IOProcess] Starting ioprocess (__init__:452)<br>2017-11-10 10:51:35,127+0000 INFO (jsonrpc/0) [IOProcessClient] Starting client ioprocess-709 (__init__:330)<br>2017-11-10 10:51:35,137+0000 INFO (ioprocess/20660) [IOProcess] Starting ioprocess (__init__:452)<br>2017-11-10 10:51:35,139+0000 INFO (ioprocess/20667) [IOProcess] Starting ioprocess (__init__:452)<br>2017-11-10 10:51:35,141+0000 INFO (jsonrpc/0) [vdsm.api] FINISH attachStorageDomain error='VERSION' from=::ffff:192.168.16.9,42838, flow_id=05e7dbb5-bad3-484f-b364-ca635fe1f20b, task_id=472c9bfe-0751-4240-b5c4-e867cb3d0cfb (api:50)<br>2017-11-10 10:51:35,141+0000 ERROR (jsonrpc/0) [storage.TaskManager.Task] (Task='472c9bfe-0751-4240-b5c4-e867cb3d0cfb') Unexpected error (task:872)<br>Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/task.py", line 879, in _run<br> return fn(*args, **kargs)<br> File "<string>", line 2, in attachStorageDomain<br> File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method<br> ret = func(*args, **kwargs)<br> File "/usr/share/vdsm/storage/hsm.py", line 1152, in attachStorageDomain<br> pool.attachSD(sdUUID)<br> File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper<br> return method(self, *args, **kwargs)<br> File "/usr/share/vdsm/storage/sp.py", line 949, in attachSD<br> dom = sdCache.produce(sdUUID)<br> File "/usr/share/vdsm/storage/sdc.py", line 112, in produce<br> domain.getRealDomain()<br> File "/usr/share/vdsm/storage/sdc.py", line 53, in getRealDomain<br> return self._cache._realProduce(self._sdUUID)<br> File "/usr/share/vdsm/storage/sdc.py", line 136, in _realProduce<br> domain = self._findDomain(sdUUID)<br> File "/usr/share/vdsm/storage/sdc.py", line 153, in _findDomain<br> return findMethod(sdUUID)<br> File "/usr/share/vdsm/storage/nfsSD.py", line 126, in findDomain<br> return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))<br> File "/usr/share/vdsm/storage/fileSD.py", line 364, in __init__<br> manifest = self.manifestClass(domainPath)<br> File "/usr/share/vdsm/storage/fileSD.py", line 171, in __init__<br> sd.StorageDomainManifest.__init__(self, sdUUID, domaindir, metadata)<br> File "/usr/share/vdsm/storage/sd.py", line 332, in __init__<br> self._domainLock = self._makeDomainLock()<br> File "/usr/share/vdsm/storage/sd.py", line 526, in _makeDomainLock<br> domVersion = self.getVersion()<br> File "/usr/share/vdsm/storage/sd.py", line 403, in getVersion<br> return self.getMetaParam(DMDK_VERSION)<br> File "/usr/share/vdsm/storage/sd.py", line 400, in getMetaParam<br> return self._metadata[key]<br> File "/usr/lib/python2.7/site-packages/vdsm/storage/persistent.py", line 91, in __getitem__<br> return dec(self._dict[key])<br> File "/usr/lib/python2.7/site-packages/vdsm/storage/persistent.py", line 203, in __getitem__<br> raise KeyError(key)<br>KeyError: 'VERSION'<br>2017-11-10 10:51:35,142+0000 INFO (jsonrpc/0) [storage.TaskManager.Task] (Task='472c9bfe-0751-4240-b5c4-e867cb3d0cfb') aborting: Task is aborted: u"'VERSION'" - code 100 (task:1177)<br>2017-11-10 10:51:35,143+0000 ERROR (jsonrpc/0) [storage.Dispatcher] FINISH attachStorageDomain error='VERSION' (dispatcher:85)<br>Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/dispatcher.py", line 72, in wrapper<br> result = ctask.prepare(func, *args, **kwargs)<br> File "/usr/share/vdsm/storage/task.py", line 105, in wrapper<br> return m(self, *a, **kw)<br> File "/usr/share/vdsm/storage/task.py", line 1185, in prepare<br> raise self.error<br>KeyError: 'VERSION'<br>2017-11-10 10:51:35,144+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StorageDomain.attach failed (error 350) in 0.17 seconds (__init__:539)<br>2017-11-10 10:51:37,336+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:38,387+0000 INFO (jsonrpc/5) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=564f788f, task_id=0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:46)<br>2017-11-10 10:51:38,388+0000 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000855589', 'lastCheck': '2.3', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=564f788f, task_id=0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:52)<br>2017-11-10 10:51:38,396+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:41,198+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:43,474+0000 INFO (jsonrpc/4) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=14f15c4b, task_id=63fb7235-56eb-4acd-8bf6-e04a701e8d83 (api:46)<br>2017-11-10 10:51:43,483+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=14f15c4b, task_id=63fb7235-56eb-4acd-8bf6-e04a701e8d83 (api:52)<br>2017-11-10 10:51:43,484+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:44,493+0000 INFO (jsonrpc/1) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=14f15c4b, task_id=e0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:46)<br>2017-11-10 10:51:44,504+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=14f15c4b, task_id=e0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:52)<br>2017-11-10 10:51:44,505+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:45,897+0000 INFO (periodic/1) [vdsm.api] START repoStats(options=None) from=internal, task_id=c0283b39-b3d9-4745-ae24-791e6bddde42 (api:46)<br>2017-11-10 10:51:45,897+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00066142', 'lastCheck': '1.9', 'valid': True}} from=internal, task_id=c0283b39-b3d9-4745-ae24-791e6bddde42 (api:52)<br>2017-11-10 10:51:53,342+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:54,433+0000 INFO (jsonrpc/3) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=27d75b74, task_id=cd61efd3-ec82-4de5-a83f-65e0f4ac48f6 (api:46)<br>2017-11-10 10:51:54,433+0000 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000928362', 'lastCheck': '0.4', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=27d75b74, task_id=cd61efd3-ec82-4de5-a83f-65e0f4ac48f6 (api:52)<br>2017-11-10 10:51:54,441+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:55,515+0000 INFO (jsonrpc/0) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=87d184a, task_id=045078a6-36c6-4869-9408-d1126925aad3 (api:46)<br>2017-11-10 10:51:55,523+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=87d184a, task_id=045078a6-36c6-4869-9408-d1126925aad3 (api:52)<br>2017-11-10 10:51:55,524+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:56,217+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:56,532+0000 INFO (jsonrpc/5) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=87d184a, task_id=f7efc4cc-14a7-4e50-8070-3119d1bb79b3 (api:46)<br>2017-11-10 10:51:56,543+0000 INFO (jsonrpc/5) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=87d184a, task_id=f7efc4cc-14a7-4e50-8070-3119d1bb79b3 (api:52)<br>2017-11-10 10:51:56,544+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:52:00,908+0000 INFO (periodic/1) [vdsm.api] START repoStats(options=None) from=internal, task_id=110fbcb2-6cde-4e95-a381-79881fb17ac0 (api:46)<br>2017-11-10 10:52:00,909+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000928362', 'lastCheck': '4.8', 'valid': True}} from=internal, task_id=110fbcb2-6cde-4e95-a381-79881fb17ac0 (api:52)<br>2017-11-10 10:52:07,557+0000 INFO (jsonrpc/7) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=55253850, task_id=5e78c011-2d1b-4f50-9445-62fbc4628ae1 (api:46)<br>2017-11-10 10:52:07,566+0000 INFO (jsonrpc/7) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=55253850, task_id=5e78c011-2d1b-4f50-9445-62fbc4628ae1 (api:52)<br>2017-11-10 10:52:07,567+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.02 seconds (__init__:539)<br>2017-11-10 10:52:08,576+0000 INFO (jsonrpc/4) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=55253850, task_id=6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:46)<br>2017-11-10 10:52:08,587+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=55253850, task_id=6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:52)<br>2017-11-10 10:52:08,588+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.02 seconds (__init__:539)<br>2017-11-10 10:52:09,348+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:10,460+0000 INFO (jsonrpc/2) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=3144af03, task_id=2f5a4461-b4f7-4cd6-95db-b158cd082aae (api:46)<br>2017-11-10 10:52:10,460+0000 INFO (jsonrpc/2) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00094699', 'lastCheck': '4.4', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=3144af03, task_id=2f5a4461-b4f7-4cd6-95db-b158cd082aae (api:52)<br>2017-11-10 10:52:10,468+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:52:11,240+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:15,927+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None) from=internal, task_id=f1359cba-4f75-410f-8aeb-a3297af27422 (api:46)<br>2017-11-10 10:52:15,928+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000780232', 'lastCheck': '1.9', 'valid': True}} from=internal, task_id=f1359cba-4f75-410f-8aeb-a3297af27422 (api:52)<br>2017-11-10 10:52:19,351+0000 INFO (jsonrpc/0) [vdsm.api] START getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42836, flow_id=47e88296, task_id=441cdb4e-2752-4ccf-832f-a6c295f2f793 (api:46)<br>2017-11-10 10:52:19,359+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=47e88296, task_id=441cdb4e-2752-4ccf-832f-a6c295f2f793 (api:52)<br>2017-11-10 10:52:19,359+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:52:20,367+0000 INFO (jsonrpc/6) [vdsm.api] START getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None) from=::ffff:192.168.16.9,42838, flow_id=47e88296, task_id=32a0366d-c576-4400-97e5-26bfd3b9561a (api:46)<br>2017-11-10 10:52:20,378+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active', 'diskfree': '912109731840', 'isoprefix': '', 'alerts': [], 'disktotal': '912151019520', 'version': 4}}} from=::ffff:192.168.16.9,42838, flow_id=47e88296, task_id=32a0366d-c576-4400-97e5-26bfd3b9561a (api:52)<br>2017-11-10 10:52:20,379+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.02 seconds (__init__:539)<br>2017-11-10 10:52:25,354+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:26,259+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:26,492+0000 INFO (jsonrpc/4) [vdsm.api] START repoStats(options=None) from=::ffff:192.168.16.9,42836, flow_id=47536cd8, task_id=33cbd1f4-d8b8-44da-809b-776802d6f9cd (api:46)<br>2017-11-10 10:52:26,493+0000 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000919276', 'lastCheck': '0.4', 'valid': True}} from=::ffff:192.168.16.9,42836, flow_id=47536cd8, task_id=33cbd1f4-d8b8-44da-809b-776802d6f9cd (api:52)<br>2017-11-10 10:52:26,500+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>[root@node1 vdsm]#<br></div><br><br><div>engine log:</div><div>2017-11-10 10:51:32,474Z INFO [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default task-4) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Lock Acquired to object 'EngineLock:{exclusiveLocks='[875e1af4-ba14-4255-b6ad-c3031672df93=STORAGE]', sharedLocks=''}'<br>2017-11-10 10:51:32,504Z INFO [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 875e1af4-ba14-4255-b6ad-c3031672df93 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN, ID: 5a0287ce-0233-0170-00a2-0000000001d8 Type: StoragePoolAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN<br>2017-11-10 10:51:32,520Z INFO [org.ovirt.engine.core.bll.storage.connection.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-6-thread-46) [1cccae15] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN<br>2017-11-10 10:51:32,523Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-6-thread-46) [1cccae15] START, ConnectStorageServerVDSCommand(HostName = node1, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='630b72af-880c-4d08-9e03-68fc16a6aadd', storagePoolId='00000000-0000-0000-0000-000000000000', storageType='NFS', connectionList='[StorageServerConnections:{id='ba9e9b72-cade-4e16-82fe-237ff7143b3b', connection='engine.futurcargo.com:/home/iso', iqn='null', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 67ed8236<br>2017-11-10 10:51:33,546Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-6-thread-46) [1cccae15] FINISH, ConnectStorageServerVDSCommand, return: {ba9e9b72-cade-4e16-82fe-237ff7143b3b=0}, log id: 67ed8236<br>2017-11-10 10:51:33,549Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] START, AttachStorageDomainVDSCommand( AttachStorageDomainVDSCommandParameters:{runAsync='true', storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8', ignoreFailoverLimit='false', storageDomainId='875e1af4-ba14-4255-b6ad-c3031672df93'}), log id: 2f387159<br>2017-11-10 10:51:34,725Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Failed in 'AttachStorageDomainVDS' method<br>2017-11-10 10:51:34,740Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), Correlation ID: null, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: VDSM command AttachStorageDomainVDS failed: Error in storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93, spUUID=5a0287ce-0233-0170-00a2-0000000001d8',)<br>2017-11-10 10:51:34,740Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command 'AttachStorageDomainVDSCommand( AttachStorageDomainVDSCommandParameters:{runAsync='true', storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8', ignoreFailoverLimit='false', storageDomainId='875e1af4-ba14-4255-b6ad-c3031672df93'})' execution failed: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Error in storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93, spUUID=5a0287ce-0233-0170-00a2-0000000001d8',), code = 350<br>2017-11-10 10:51:34,740Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] FINISH, AttachStorageDomainVDSCommand, log id: 2f387159<br>2017-11-10 10:51:34,740Z ERROR [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command 'org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Error in storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93, spUUID=5a0287ce-0233-0170-00a2-0000000001d8',), code = 350 (Failed with error StorageDomainActionError and code 350)<br>2017-11-10 10:51:34,741Z INFO [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command [id=a392af75-7ebe-499a-b2ed-765651834557]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: StoragePoolIsoMapId:{storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8', storageId='875e1af4-ba14-4255-b6ad-c3031672df93'}.<br>2017-11-10 10:51:34,746Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_ID: USER_ATTACH_STORAGE_DOMAIN_TO_POOL_FAILED(963), Correlation ID: 05e7dbb5-bad3-484f-b364-ca635fe1f20b, Job ID: 7f3f27ce-4d45-4b3b-a9ee-c25795658ee4, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to attach Storage Domain ISO_DOMAIN to Data Center Default. (User: admin@internal-authz)<br>2017-11-10 10:51:34,748Z INFO [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Lock freed to object 'EngineLock:{exclusiveLocks='[875e1af4-ba14-4255-b6ad-c3031672df93=STORAGE]', sharedLocks=''}'<br></div><br><div><hr style="width: 100%; height: 2px;">Jose Ferradeira<br>http://www.logicworks.pt</div></div><br></div></div></body></html>