1:01 p.m.
------=_Part_903046_834258931.1510311699782
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
Hi,
I have engine installed on one machine and host on another, running Version
4.1.7.6-1.el7.centos
Everything looks ok except the iso domain I cannot attach it to the data center. Message
on the engine dashboard:
Failed to attach Storage Domain ISO_DOMAIN to Data Center Default. (User:
admin@internal-authz)
VDSM command AttachStorageDomainVDS failed: Error in storage domain action:
(u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93,
spUUID=5a0287ce-0233-0170-00a2-0000000001d8',)
Checking the configuration everything looks ok:
[root@engine ~]# grep iso /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf
OVESETUP_CONFIG/isoDomainName=str:ISO_DOMAIN
OVESETUP_CONFIG/isoDomainSdUuid=str:875e1af4-ba14-4255-b6ad-c3031672df93
OVESETUP_CONFIG/isoDomainMountPoint=str:/home/iso
OVESETUP_CONFIG/isoDomainExists=bool:True
OVESETUP_CONFIG/isoDomainStorageDir=str:/home/iso/875e1af4-ba14-4255-b6ad-c3031672df93/images/11111111-1111-1111-1111-111111111111
[root@engine ~]# ovirt-iso-uploader list
Please provide the REST API password for the admin@internal oVirt Engine user (CTRL+D to
abort):
ISO Storage Domain Name | ISO Domain Status
ISO_DOMAIN | ok
[root@node1 ~]# vdsClient -s 0 getStorageDomainsList
5eed853b-09ee-430d-bde2-c37394c1ff6c
I can mount the export manually
Don't know where to look more. Any idea? thanks
vdsm log:
2017-11-10 10:51:00,839+0000 INFO (periodic/3) [vdsm.api] START repoStats(options=None)
from=internal, task_id=f0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:46)
2017-11-10 10:51:00,840+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000890471', 'lastCheck': '4.8', 'valid': True}}
from=internal, task_id=f0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:52)
2017-11-10 10:51:05,323+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:07,277+0000 INFO (jsonrpc/4) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=399705b5,
task_id=998fe1bc-eff0-4ba7-942c-458906c5e1f1 (api:46)
2017-11-10 10:51:07,277+0000 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000844547', 'lastCheck': '1.2', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=399705b5,
task_id=998fe1bc-eff0-4ba7-942c-458906c5e1f1 (api:52)
2017-11-10 10:51:07,285+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:07,345+0000 INFO (jsonrpc/1) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=4b670edd,
task_id=a6baf012-6dbb-47d6-9f8e-457e42bbc7d7 (api:46)
2017-11-10 10:51:07,352+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=4b670edd,
task_id=a6baf012-6dbb-47d6-9f8e-457e42bbc7d7 (api:52)
2017-11-10 10:51:07,352+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:08,410+0000 INFO (jsonrpc/2) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=4b670edd,
task_id=4d623b87-105f-47ef-8385-7d7391378906 (api:46)
2017-11-10 10:51:08,421+0000 INFO (jsonrpc/2) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=4b670edd,
task_id=4d623b87-105f-47ef-8385-7d7391378906 (api:52)
2017-11-10 10:51:08,422+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:11,159+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None)
from=internal, task_id=8da65b6e-23ba-40fb-82fd-287645bb05cf (api:46)
2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000718255', 'lastCheck': '1.8', 'valid': True}}
from=internal, task_id=8da65b6e-23ba-40fb-82fd-287645bb05cf (api:52)
2017-11-10 10:51:19,434+0000 INFO (jsonrpc/0) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=32cb4291,
task_id=c42d1ce1-d82c-47ad-874f-6d73142e49c6 (api:46)
2017-11-10 10:51:19,443+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=32cb4291,
task_id=c42d1ce1-d82c-47ad-874f-6d73142e49c6 (api:52)
2017-11-10 10:51:19,444+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:20,453+0000 INFO (jsonrpc/6) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=32cb4291,
task_id=72cdacd6-5133-4554-8ecc-86f11a094064 (api:46)
2017-11-10 10:51:20,464+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=32cb4291,
task_id=72cdacd6-5133-4554-8ecc-86f11a094064 (api:52)
2017-11-10 10:51:20,465+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:21,329+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:22,360+0000 INFO (jsonrpc/7) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=5eb26f2b,
task_id=c4320507-69ec-457d-a51b-e898702de247 (api:46)
2017-11-10 10:51:22,360+0000 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000718255', 'lastCheck': '6.3', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=5eb26f2b,
task_id=c4320507-69ec-457d-a51b-e898702de247 (api:52)
2017-11-10 10:51:22,368+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:26,178+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:30,878+0000 INFO (periodic/2) [vdsm.api] START repoStats(options=None)
from=internal, task_id=f62ad6de-75ad-4a99-bb4d-2854b5ff85c6 (api:46)
2017-11-10 10:51:30,878+0000 INFO (periodic/2) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000956708', 'lastCheck': '4.8', 'valid': True}}
from=internal, task_id=f62ad6de-75ad-4a99-bb4d-2854b5ff85c6 (api:52)
2017-11-10 10:51:31,436+0000 INFO (jsonrpc/1) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=11ee2968,
task_id=738c51fb-387e-47b3-a1ad-03fc900f749f (api:46)
2017-11-10 10:51:31,444+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=11ee2968,
task_id=738c51fb-387e-47b3-a1ad-03fc900f749f (api:52)
2017-11-10 10:51:31,445+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:32,454+0000 INFO (jsonrpc/2) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=11ee2968,
task_id=4f010678-55ba-4ead-84bc-734763662964 (api:46)
2017-11-10 10:51:32,464+0000 INFO (jsonrpc/2) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=11ee2968,
task_id=4f010678-55ba-4ead-84bc-734763662964 (api:52)
2017-11-10 10:51:32,465+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:33,948+0000 INFO (jsonrpc/3) [vdsm.api] START
connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000',
conList=[{u'id': u'ba9e9b72-cade-4e16-82fe-237ff7143b3b',
u'connection': u'engine.futurcargo.com:/home/iso', u'iqn':
u'', u'user': u'', u'password': '********',
u'port': u''}], options=None) from=::ffff:192.168.16.9,42836,
flow_id=1cccae15, task_id=37c76c14-2e74-4c12-99d7-6b3f2397348e (api:46)
2017-11-10 10:51:33,951+0000 INFO (jsonrpc/3) [IOProcessClient] Starting client
ioprocess-706 (__init__:330)
2017-11-10 10:51:33,962+0000 INFO (ioprocess/20640) [IOProcess] Starting ioprocess
(__init__:452)
2017-11-10 10:51:33,964+0000 INFO (jsonrpc/3) [vdsm.api] FINISH connectStorageServer
return={'statuslist': [{'status': 0, 'id':
u'ba9e9b72-cade-4e16-82fe-237ff7143b3b'}]} from=::ffff:192.168.16.9,42836,
flow_id=1cccae15, task_id=37c76c14-2e74-4c12-99d7-6b3f2397348e (api:52)
2017-11-10 10:51:33,965+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call
StoragePool.connectStorageServer succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:34,974+0000 INFO (jsonrpc/0) [vdsm.api] START
attachStorageDomain(sdUUID=u'875e1af4-ba14-4255-b6ad-c3031672df93',
spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=05e7dbb5-bad3-484f-b364-ca635fe1f20b,
task_id=472c9bfe-0751-4240-b5c4-e867cb3d0cfb (api:46)
2017-11-10 10:51:34,975+0000 INFO (jsonrpc/0) [storage.StoragePool]
sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93 spUUID=5a0287ce-0233-0170-00a2-0000000001d8
(sp:942)
2017-11-10 10:51:35,102+0000 INFO (itmap/0) [IOProcessClient] Starting client
ioprocess-707 (__init__:330)
2017-11-10 10:51:35,113+0000 INFO (itmap/1) [IOProcessClient] Starting client
ioprocess-708 (__init__:330)
2017-11-10 10:51:35,123+0000 INFO (ioprocess/20654) [IOProcess] Starting ioprocess
(__init__:452)
2017-11-10 10:51:35,127+0000 INFO (jsonrpc/0) [IOProcessClient] Starting client
ioprocess-709 (__init__:330)
2017-11-10 10:51:35,137+0000 INFO (ioprocess/20660) [IOProcess] Starting ioprocess
(__init__:452)
2017-11-10 10:51:35,139+0000 INFO (ioprocess/20667) [IOProcess] Starting ioprocess
(__init__:452)
2017-11-10 10:51:35,141+0000 INFO (jsonrpc/0) [vdsm.api] FINISH attachStorageDomain
error='VERSION' from=::ffff:192.168.16.9,42838,
flow_id=05e7dbb5-bad3-484f-b364-ca635fe1f20b, task_id=472c9bfe-0751-4240-b5c4-e867cb3d0cfb
(api:50)
2017-11-10 10:51:35,141+0000 ERROR (jsonrpc/0) [storage.TaskManager.Task]
(Task='472c9bfe-0751-4240-b5c4-e867cb3d0cfb') Unexpected error (task:872)
Traceback (most recent call last):
File "/usr/share/vdsm/storage/task.py", line 879, in _run
return fn(*args, **kargs)
File "<string>", line 2, in attachStorageDomain
File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
ret = func(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 1152, in attachStorageDomain
pool.attachSD(sdUUID)
File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in
wrapper
return method(self, *args, **kwargs)
File "/usr/share/vdsm/storage/sp.py", line 949, in attachSD
dom = sdCache.produce(sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 112, in produce
domain.getRealDomain()
File "/usr/share/vdsm/storage/sdc.py", line 53, in getRealDomain
return self._cache._realProduce(self._sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 136, in _realProduce
domain = self._findDomain(sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 153, in _findDomain
return findMethod(sdUUID)
File "/usr/share/vdsm/storage/nfsSD.py", line 126, in findDomain
return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
File "/usr/share/vdsm/storage/fileSD.py", line 364, in __init__
manifest = self.manifestClass(domainPath)
File "/usr/share/vdsm/storage/fileSD.py", line 171, in __init__
sd.StorageDomainManifest.__init__(self, sdUUID, domaindir, metadata)
File "/usr/share/vdsm/storage/sd.py", line 332, in __init__
self._domainLock = self._makeDomainLock()
File "/usr/share/vdsm/storage/sd.py", line 526, in _makeDomainLock
domVersion = self.getVersion()
File "/usr/share/vdsm/storage/sd.py", line 403, in getVersion
return self.getMetaParam(DMDK_VERSION)
File "/usr/share/vdsm/storage/sd.py", line 400, in getMetaParam
return self._metadata[key]
File "/usr/lib/python2.7/site-packages/vdsm/storage/persistent.py", line 91, in
__getitem__
return dec(self._dict[key])
File "/usr/lib/python2.7/site-packages/vdsm/storage/persistent.py", line 203, in
__getitem__
raise KeyError(key)
KeyError: 'VERSION'
2017-11-10 10:51:35,142+0000 INFO (jsonrpc/0) [storage.TaskManager.Task]
(Task='472c9bfe-0751-4240-b5c4-e867cb3d0cfb') aborting: Task is aborted:
u"'VERSION'" - code 100 (task:1177)
2017-11-10 10:51:35,143+0000 ERROR (jsonrpc/0) [storage.Dispatcher] FINISH
attachStorageDomain error='VERSION' (dispatcher:85)
Traceback (most recent call last):
File "/usr/share/vdsm/storage/dispatcher.py", line 72, in wrapper
result = ctask.prepare(func, *args, **kwargs)
File "/usr/share/vdsm/storage/task.py", line 105, in wrapper
return m(self, *a, **kw)
File "/usr/share/vdsm/storage/task.py", line 1185, in prepare
raise self.error
KeyError: 'VERSION'
2017-11-10 10:51:35,144+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call
StorageDomain.attach failed (error 350) in 0.17 seconds (__init__:539)
2017-11-10 10:51:37,336+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:38,387+0000 INFO (jsonrpc/5) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=564f788f,
task_id=0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:46)
2017-11-10 10:51:38,388+0000 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000855589', 'lastCheck': '2.3', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=564f788f,
task_id=0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:52)
2017-11-10 10:51:38,396+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:41,198+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:43,474+0000 INFO (jsonrpc/4) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=14f15c4b,
task_id=63fb7235-56eb-4acd-8bf6-e04a701e8d83 (api:46)
2017-11-10 10:51:43,483+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=14f15c4b,
task_id=63fb7235-56eb-4acd-8bf6-e04a701e8d83 (api:52)
2017-11-10 10:51:43,484+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:44,493+0000 INFO (jsonrpc/1) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=14f15c4b,
task_id=e0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:46)
2017-11-10 10:51:44,504+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=14f15c4b,
task_id=e0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:52)
2017-11-10 10:51:44,505+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:45,897+0000 INFO (periodic/1) [vdsm.api] START repoStats(options=None)
from=internal, task_id=c0283b39-b3d9-4745-ae24-791e6bddde42 (api:46)
2017-11-10 10:51:45,897+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.00066142', 'lastCheck': '1.9', 'valid': True}}
from=internal, task_id=c0283b39-b3d9-4745-ae24-791e6bddde42 (api:52)
2017-11-10 10:51:53,342+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:51:54,433+0000 INFO (jsonrpc/3) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=27d75b74,
task_id=cd61efd3-ec82-4de5-a83f-65e0f4ac48f6 (api:46)
2017-11-10 10:51:54,433+0000 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000928362', 'lastCheck': '0.4', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=27d75b74,
task_id=cd61efd3-ec82-4de5-a83f-65e0f4ac48f6 (api:52)
2017-11-10 10:51:54,441+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:55,515+0000 INFO (jsonrpc/0) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=87d184a,
task_id=045078a6-36c6-4869-9408-d1126925aad3 (api:46)
2017-11-10 10:51:55,523+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=87d184a,
task_id=045078a6-36c6-4869-9408-d1126925aad3 (api:52)
2017-11-10 10:51:55,524+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:56,217+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:51:56,532+0000 INFO (jsonrpc/5) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=87d184a,
task_id=f7efc4cc-14a7-4e50-8070-3119d1bb79b3 (api:46)
2017-11-10 10:51:56,543+0000 INFO (jsonrpc/5) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=87d184a,
task_id=f7efc4cc-14a7-4e50-8070-3119d1bb79b3 (api:52)
2017-11-10 10:51:56,544+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:52:00,908+0000 INFO (periodic/1) [vdsm.api] START repoStats(options=None)
from=internal, task_id=110fbcb2-6cde-4e95-a381-79881fb17ac0 (api:46)
2017-11-10 10:52:00,909+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000928362', 'lastCheck': '4.8', 'valid': True}}
from=internal, task_id=110fbcb2-6cde-4e95-a381-79881fb17ac0 (api:52)
2017-11-10 10:52:07,557+0000 INFO (jsonrpc/7) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=55253850,
task_id=5e78c011-2d1b-4f50-9445-62fbc4628ae1 (api:46)
2017-11-10 10:52:07,566+0000 INFO (jsonrpc/7) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=55253850,
task_id=5e78c011-2d1b-4f50-9445-62fbc4628ae1 (api:52)
2017-11-10 10:52:07,567+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.02 seconds (__init__:539)
2017-11-10 10:52:08,576+0000 INFO (jsonrpc/4) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=55253850,
task_id=6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:46)
2017-11-10 10:52:08,587+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=55253850,
task_id=6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:52)
2017-11-10 10:52:08,588+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.02 seconds (__init__:539)
2017-11-10 10:52:09,348+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:52:10,460+0000 INFO (jsonrpc/2) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=3144af03,
task_id=2f5a4461-b4f7-4cd6-95db-b158cd082aae (api:46)
2017-11-10 10:52:10,460+0000 INFO (jsonrpc/2) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.00094699', 'lastCheck': '4.4', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=3144af03,
task_id=2f5a4461-b4f7-4cd6-95db-b158cd082aae (api:52)
2017-11-10 10:52:10,468+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:52:11,240+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:52:15,927+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=None)
from=internal, task_id=f1359cba-4f75-410f-8aeb-a3297af27422 (api:46)
2017-11-10 10:52:15,928+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000780232', 'lastCheck': '1.9', 'valid': True}}
from=internal, task_id=f1359cba-4f75-410f-8aeb-a3297af27422 (api:52)
2017-11-10 10:52:19,351+0000 INFO (jsonrpc/0) [vdsm.api] START
getSpmStatus(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42836, flow_id=47e88296,
task_id=441cdb4e-2752-4ccf-832f-a6c295f2f793 (api:46)
2017-11-10 10:52:19,359+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus
return={'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=::ffff:192.168.16.9,42836, flow_id=47e88296,
task_id=441cdb4e-2752-4ccf-832f-a6c295f2f793 (api:52)
2017-11-10 10:52:19,359+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)
2017-11-10 10:52:20,367+0000 INFO (jsonrpc/6) [vdsm.api] START
getStoragePoolInfo(spUUID=u'5a0287ce-0233-0170-00a2-0000000001d8', options=None)
from=::ffff:192.168.16.9,42838, flow_id=47e88296,
task_id=32a0366d-c576-4400-97e5-26bfd3b9561a (api:46)
2017-11-10 10:52:20,378+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo
return={'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': 'connected', 'lver': 2L,
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version':
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '912109731840', 'isoprefix': '',
'alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=::ffff:192.168.16.9,42838, flow_id=47e88296,
task_id=32a0366d-c576-4400-97e5-26bfd3b9561a (api:52)
2017-11-10 10:52:20,379+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call
StoragePool.getInfo succeeded in 0.02 seconds (__init__:539)
2017-11-10 10:52:25,354+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:52:26,259+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call
Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)
2017-11-10 10:52:26,492+0000 INFO (jsonrpc/4) [vdsm.api] START repoStats(options=None)
from=::ffff:192.168.16.9,42836, flow_id=47536cd8,
task_id=33cbd1f4-d8b8-44da-809b-776802d6f9cd (api:46)
2017-11-10 10:52:26,493+0000 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats
return={u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000919276', 'lastCheck': '0.4', 'valid': True}}
from=::ffff:192.168.16.9,42836, flow_id=47536cd8,
task_id=33cbd1f4-d8b8-44da-809b-776802d6f9cd (api:52)
2017-11-10 10:52:26,500+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call
Host.getStats succeeded in 0.01 seconds (__init__:539)
[root@node1 vdsm]#
engine log:
2017-11-10 10:51:32,474Z INFO
[org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default
task-4) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Lock Acquired to object
'EngineLock:{exclusiveLocks='[875e1af4-ba14-4255-b6ad-c3031672df93=STORAGE]',
sharedLocks=''}'
2017-11-10 10:51:32,504Z INFO
[org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Running
command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID:
875e1af4-ba14-4255-b6ad-c3031672df93 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN
with role type ADMIN, ID: 5a0287ce-0233-0170-00a2-0000000001d8 Type: StoragePoolAction
group MANIPULATE_STORAGE_DOMAIN with role type ADMIN
2017-11-10 10:51:32,520Z INFO
[org.ovirt.engine.core.bll.storage.connection.ConnectStorageToVdsCommand]
(org.ovirt.thread.pool-6-thread-46) [1cccae15] Running command: ConnectStorageToVdsCommand
internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type:
SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN
2017-11-10 10:51:32,523Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
(org.ovirt.thread.pool-6-thread-46) [1cccae15] START,
ConnectStorageServerVDSCommand(HostName = node1,
StorageServerConnectionManagementVDSParameters:{runAsync='true',
hostId='630b72af-880c-4d08-9e03-68fc16a6aadd',
storagePoolId='00000000-0000-0000-0000-000000000000', storageType='NFS',
connectionList='[StorageServerConnections:{id='ba9e9b72-cade-4e16-82fe-237ff7143b3b',
connection='engine.futurcargo.com:/home/iso', iqn='null',
vfsType='null', mountOptions='null', nfsVersion='null',
nfsRetrans='null', nfsTimeo='null', iface='null',
netIfaceName='null'}]'}), log id: 67ed8236
2017-11-10 10:51:33,546Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
(org.ovirt.thread.pool-6-thread-46) [1cccae15] FINISH, ConnectStorageServerVDSCommand,
return: {ba9e9b72-cade-4e16-82fe-237ff7143b3b=0}, log id: 67ed8236
2017-11-10 10:51:33,549Z INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] START,
AttachStorageDomainVDSCommand(
AttachStorageDomainVDSCommandParameters:{runAsync='true',
storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8',
ignoreFailoverLimit='false',
storageDomainId='875e1af4-ba14-4255-b6ad-c3031672df93'}), log id: 2f387159
2017-11-10 10:51:34,725Z ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Failed in
'AttachStorageDomainVDS' method
2017-11-10 10:51:34,740Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_ID:
IRS_BROKER_COMMAND_FAILURE(10,803), Correlation ID: null, Call Stack: null, Custom ID:
null, Custom Event ID: -1, Message: VDSM command AttachStorageDomainVDS failed: Error in
storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93,
spUUID=5a0287ce-0233-0170-00a2-0000000001d8',)
2017-11-10 10:51:34,740Z ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command
'AttachStorageDomainVDSCommand(
AttachStorageDomainVDSCommandParameters:{runAsync='true',
storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8',
ignoreFailoverLimit='false',
storageDomainId='875e1af4-ba14-4255-b6ad-c3031672df93'})' execution failed:
IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Error in
storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93,
spUUID=5a0287ce-0233-0170-00a2-0000000001d8',), code = 350
2017-11-10 10:51:34,740Z INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] FINISH,
AttachStorageDomainVDSCommand, log id: 2f387159
2017-11-10 10:51:34,740Z ERROR
[org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command
'org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand'
failed: EngineException:
org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException:
IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Error in
storage domain action: (u'sdUUID=875e1af4-ba14-4255-b6ad-c3031672df93,
spUUID=5a0287ce-0233-0170-00a2-0000000001d8',), code = 350 (Failed with error
StorageDomainActionError and code 350)
2017-11-10 10:51:34,741Z INFO
[org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command
[id=a392af75-7ebe-499a-b2ed-765651834557]: Compensating NEW_ENTITY_ID of
org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot:
StoragePoolIsoMapId:{storagePoolId='5a0287ce-0233-0170-00a2-0000000001d8',
storageId='875e1af4-ba14-4255-b6ad-c3031672df93'}.
2017-11-10 10:51:34,746Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_ID:
USER_ATTACH_STORAGE_DOMAIN_TO_POOL_FAILED(963), Correlation ID:
05e7dbb5-bad3-484f-b364-ca635fe1f20b, Job ID: 7f3f27ce-4d45-4b3b-a9ee-c25795658ee4, Call
Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to attach Storage
Domain ISO_DOMAIN to Data Center Default. (User: admin@internal-authz)
2017-11-10 10:51:34,748Z INFO
[org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand]
(org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Lock freed to
object
'EngineLock:{exclusiveLocks='[875e1af4-ba14-4255-b6ad-c3031672df93=STORAGE]',
sharedLocks=''}'
Jose Ferradeira
http://www.logicworks.pt
------=_Part_903046_834258931.1510311699782
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"font-family: Times New Roman; font-size:
10pt; co=
lor: #000000"><div data-marker=3D"__QUOTED_TEXT__"><div
style=3D"font-famil=
y: Times New Roman; font-size: 10pt; color:
#000000"><div>Hi,</div><br><div=
I have engine installed on one machine and host on another,
running V=
ersion 4.1.7.6-1.el7.centos</div><div>Everything
looks ok except the iso do=
main I cannot attach it to the data center. Message on the engine dashboard=
:</div><br><div>Failed to attach Storage Domain ISO_DOMAIN to Data
Center D=
efault. (User: admin@internal-authz)</div><div>VDSM command AttachStorageDo=
mainVDS failed: Error in storage domain action: (u'sdUUID=3D875e1af4-ba14-4=
255-b6ad-c3031672df93, spUUID=3D5a0287ce-0233-0170-00a2-0000000001d8',)</di=
v><br><div>Checking the configuration everything looks
ok:</div><div>[root@=
engine ~]# grep iso /etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf=
<br>OVESETUP_CONFIG/isoDomainName=3Dstr:ISO_DOMAIN<br>OVESETUP_CONFIG/isoDo=
mainSdUuid=3Dstr:875e1af4-ba14-4255-b6ad-c3031672df93<br>OVESETUP_CONFIG/is=
oDomainMountPoint=3Dstr:/home/iso<br>OVESETUP_CONFIG/isoDomainExists=3Dbool=
:True<br>OVESETUP_CONFIG/isoDomainStorageDir=3Dstr:/home/iso/875e1af4-ba14-=
4255-b6ad-c3031672df93/images/11111111-1111-1111-1111-111111111111<br></div=
<br><div>[root@engine ~]# ovirt-iso-uploader
list<br>Please provide the RE=
ST API password for the admin@internal oVirt
Engine user (CTRL+D to abort):=
<br>ISO Storage Domain Name | ISO Domain Status<br>ISO_DOMAIN |
ok<br></div=
<br><div>[root@node1 ~]# vdsClient -s 0
getStorageDomainsList<br>5eed853b-=
09ee-430d-bde2-c37394c1ff6c<br></div><br><br><div>I
can mount the export ma=
nually</div><br><br><div>Don't know where to look more. Any
idea? thanks</d=
iv><br><br><div>vdsm log:</div><div>2017-11-10
10:51:00,839+0000 INFO (peri=
odic/3) [vdsm.api] START repoStats(options=3DNone) from=3Dinternal, task_id=
=3Df0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:46)<br>2017-11-10 10:51:00,840=
+0000 INFO (periodic/3) [vdsm.api] FINISH repoStats return=3D{u'5eed853b-09=
ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True,
'version': 4, 'acqu=
ired': True, 'delay': '0.000890471', 'lastCheck':
'4.8', 'valid': True}} fr=
om=3Dinternal, task_id=3Df0f5161a-b3c1-4534-a33a-cf5d17ab8c9c (api:52)<br>2=
017-11-10 10:51:05,323+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC ca=
ll Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-1=
0 10:51:07,277+0000 INFO (jsonrpc/4) [vdsm.api] START repoStats(options=3DN=
one) from=3D::ffff:192.168.16.9,42836, flow_id=3D399705b5, task_id=3D998fe1=
bc-eff0-4ba7-942c-458906c5e1f1 (api:46)<br>2017-11-10 10:51:07,277+0000 INF=
O (jsonrpc/4) [vdsm.api] FINISH repoStats return=3D{u'5eed853b-09ee-430d-bd=
e2-c37394c1ff6c': {'code': 0, 'actual': True, 'version': 4,
'acquired': Tru=
e, 'delay': '0.000844547', 'lastCheck': '1.2',
'valid': True}} from=3D::fff=
f:192.168.16.9,42836, flow_id=3D399705b5, task_id=3D998fe1bc-eff0-4ba7-942c=
-458906c5e1f1 (api:52)<br>2017-11-10 10:51:07,285+0000 INFO (jsonrpc/4) [js=
onrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__in=
it__:539)<br>2017-11-10 10:51:07,345+0000 INFO (jsonrpc/1) [vdsm.api] START=
getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=3DN=
one) from=3D::ffff:192.168.16.9,42836, flow_id=3D4b670edd, task_id=3Da6baf0=
12-6dbb-47d6-9f8e-457e42bbc7d7 (api:46)<br>2017-11-10 10:51:07,352+0000 INF=
O (jsonrpc/1) [vdsm.api] FINISH getSpmStatus return=3D{'spm_st': {'spmId':
=
1, 'spmStatus': 'SPM', 'spmLver': 2L}}
from=3D::ffff:192.168.16.9,42836, fl=
ow_id=3D4b670edd, task_id=3Da6baf012-6dbb-47d6-9f8e-457e42bbc7d7 (api:52)<b=
r>2017-11-10 10:51:07,352+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC=
call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)<br>=
2017-11-10 10:51:08,410+0000 INFO (jsonrpc/2) [vdsm.api] START getStoragePo=
olInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=3DNone) fr=
om=3D::ffff:192.168.16.9,42838, flow_id=3D4b670edd, task_id=3D4d623b87-105f=
-47ef-8385-7d7391378906 (api:46)<br>2017-11-10 10:51:08,421+0000 INFO (json=
rpc/2) [vdsm.api] FINISH getStoragePoolInfo return=3D{'info': {'name':
'No =
Description', 'isoprefix': '', 'pool_status':
'connected', 'lver': 2L, 'dom=
ains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid':
u'5ee=
d853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id':
1, 'type': 'G=
LUSTERFS', 'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1=
ff6c': {'status': u'Active', 'diskfree':
'912109731840', 'isoprefix': '', '=
alerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=3D::ffff:192=
.168.16.9,42838, flow_id=3D4b670edd, task_id=3D4d623b87-105f-47ef-8385-7d73=
91378906 (api:52)<br>2017-11-10 10:51:08,422+0000 INFO (jsonrpc/2) [jsonrpc=
.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__i=
nit__:539)<br>2017-11-10 10:51:11,159+0000 INFO (jsonrpc/3) [jsonrpc.JsonRp=
cServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:53=
9)<br>2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.api] START repoS=
tats(options=3DNone) from=3Dinternal, task_id=3D8da65b6e-23ba-40fb-82fd-287=
645bb05cf (api:46)<br>2017-11-10 10:51:15,859+0000 INFO (periodic/0) [vdsm.=
api] FINISH repoStats return=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'=
code': 0, 'actual': True, 'version': 4, 'acquired': True,
'delay': '0.00071=
8255', 'lastCheck': '1.8', 'valid': True}} from=3Dinternal,
task_id=3D8da65=
b6e-23ba-40fb-82fd-287645bb05cf (api:52)<br>2017-11-10 10:51:19,434+0000 IN=
FO (jsonrpc/0) [vdsm.api] START getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-=
00a2-0000000001d8', options=3DNone) from=3D::ffff:192.168.16.9,42836, flow_=
id=3D32cb4291, task_id=3Dc42d1ce1-d82c-47ad-874f-6d73142e49c6 (api:46)<br>2=
017-11-10 10:51:19,443+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus=
return=3D{'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=
=3D::ffff:192.168.16.9,42836, flow_id=3D32cb4291, task_id=3Dc42d1ce1-d82c-4=
7ad-874f-6d73142e49c6 (api:52)<br>2017-11-10 10:51:19,444+0000 INFO (jsonrp=
c/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in=
0.01 seconds (__init__:539)<br>2017-11-10 10:51:20,453+0000 INFO (jsonrpc/=
6) [vdsm.api] START getStoragePoolInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0=
000000001d8', options=3DNone) from=3D::ffff:192.168.16.9,42838, flow_id=3D3=
2cb4291, task_id=3D72cdacd6-5133-4554-8ecc-86f11a094064 (api:46)<br>2017-11=
-10 10:51:20,464+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo=
return=3D{'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status=
': 'connected', 'lver': 2L, 'domains':
u'5eed853b-09ee-430d-bde2-c37394c1ff=
6c:Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c',
'versio=
n': '4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo': {u'=
5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '9=
12109731840', 'isoprefix': '', 'alerts': [],
'disktotal': '912151019520', '=
version': 4}}} from=3D::ffff:192.168.16.9,42838, flow_id=3D32cb4291, task_i=
d=3D72cdacd6-5133-4554-8ecc-86f11a094064 (api:52)<br>2017-11-10 10:51:20,46=
5+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInf=
o succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:21,329+0000 =
INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succee=
ded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:22,360+0000 INFO (js=
onrpc/7) [vdsm.api] START repoStats(options=3DNone) from=3D::ffff:192.168.1=
6.9,42836, flow_id=3D5eb26f2b, task_id=3Dc4320507-69ec-457d-a51b-e898702de2=
47 (api:46)<br>2017-11-10 10:51:22,360+0000 INFO (jsonrpc/7) [vdsm.api] FIN=
ISH repoStats return=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code':
0=
, 'actual': True, 'version': 4, 'acquired': True, 'delay':
'0.000718255', '=
lastCheck': '6.3', 'valid': True}} from=3D::ffff:192.168.16.9,42836,
flow_i=
d=3D5eb26f2b, task_id=3Dc4320507-69ec-457d-a51b-e898702de247 (api:52)<br>20=
17-11-10 10:51:22,368+0000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC cal=
l Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:5=
1:26,178+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAll=
VmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:30,878=
+0000 INFO (periodic/2) [vdsm.api] START repoStats(options=3DNone) from=3Di=
nternal, task_id=3Df62ad6de-75ad-4a99-bb4d-2854b5ff85c6 (api:46)<br>2017-11=
-10 10:51:30,878+0000 INFO (periodic/2) [vdsm.api] FINISH repoStats return=
=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual':
True, 'v=
ersion': 4, 'acquired': True, 'delay': '0.000956708',
'lastCheck': '4.8', '=
valid': True}} from=3Dinternal, task_id=3Df62ad6de-75ad-4a99-bb4d-2854b5ff8=
5c6 (api:52)<br>2017-11-10 10:51:31,436+0000 INFO (jsonrpc/1) [vdsm.api] ST=
ART getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=
=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=3D11ee2968, task_id=3D73=
8c51fb-387e-47b3-a1ad-03fc900f749f (api:46)<br>2017-11-10 10:51:31,444+0000=
INFO (jsonrpc/1) [vdsm.api] FINISH getSpmStatus return=3D{'spm_st': {'spmI=
d': 1, 'spmStatus': 'SPM', 'spmLver': 2L}}
from=3D::ffff:192.168.16.9,42836=
, flow_id=3D11ee2968, task_id=3D738c51fb-387e-47b3-a1ad-03fc900f749f (api:5=
2)<br>2017-11-10 10:51:31,445+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer]=
RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:539)=
<br>2017-11-10 10:51:32,454+0000 INFO (jsonrpc/2) [vdsm.api] START getStora=
gePoolInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=3DNone=
) from=3D::ffff:192.168.16.9,42838, flow_id=3D11ee2968, task_id=3D4f010678-=
55ba-4ead-84bc-734763662964 (api:46)<br>2017-11-10 10:51:32,464+0000 INFO (=
jsonrpc/2) [vdsm.api] FINISH getStoragePoolInfo return=3D{'info': {'name':
=
'No Description', 'isoprefix': '', 'pool_status':
'connected', 'lver': 2L, =
'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_uuid': u=
'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4',
'spm_id': 1, 'type'=
: 'GLUSTERFS', 'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c373=
94c1ff6c': {'status': u'Active', 'diskfree':
'912109731840', 'isoprefix': '=
', 'alerts': [], 'disktotal': '912151019520',
'version': 4}}} from=3D::ffff=
:192.168.16.9,42838, flow_id=3D11ee2968, task_id=3D4f010678-55ba-4ead-84bc-=
734763662964 (api:52)<br>2017-11-10 10:51:32,465+0000 INFO (jsonrpc/2) [jso=
nrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds =
(__init__:539)<br>2017-11-10 10:51:33,948+0000 INFO (jsonrpc/3) [vdsm.api] =
START connectStorageServer(domType=3D1, spUUID=3Du'00000000-0000-0000-0000-=
000000000000', conList=3D[{u'id':
u'ba9e9b72-cade-4e16-82fe-237ff7143b3b', =
u'connection': u'engine.futurcargo.com:/home/iso', u'iqn':
u'', u'user': u'=
', u'password': '********', u'port': u''}],
options=3DNone) from=3D::ffff:1=
92.168.16.9,42836, flow_id=3D1cccae15, task_id=3D37c76c14-2e74-4c12-99d7-6b=
3f2397348e (api:46)<br>2017-11-10 10:51:33,951+0000 INFO (jsonrpc/3) [IOPro=
cessClient] Starting client ioprocess-706 (__init__:330)<br>2017-11-10 10:5=
1:33,962+0000 INFO (ioprocess/20640) [IOProcess] Starting ioprocess (__init=
__:452)<br>2017-11-10 10:51:33,964+0000 INFO (jsonrpc/3) [vdsm.api] FINISH =
connectStorageServer return=3D{'statuslist': [{'status': 0, 'id':
u'ba9e9b7=
2-cade-4e16-82fe-237ff7143b3b'}]} from=3D::ffff:192.168.16.9,42836, flow_id=
=3D1cccae15, task_id=3D37c76c14-2e74-4c12-99d7-6b3f2397348e (api:52)<br>201=
7-11-10 10:51:33,965+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call=
StoragePool.connectStorageServer succeeded in 0.01 seconds (__init__:539)<=
br>2017-11-10 10:51:34,974+0000 INFO (jsonrpc/0) [vdsm.api] START attachSto=
rageDomain(sdUUID=3Du'875e1af4-ba14-4255-b6ad-c3031672df93', spUUID=3Du'5a0=
287ce-0233-0170-00a2-0000000001d8', options=3DNone) from=3D::ffff:192.168.1=
6.9,42838, flow_id=3D05e7dbb5-bad3-484f-b364-ca635fe1f20b, task_id=3D472c9b=
fe-0751-4240-b5c4-e867cb3d0cfb (api:46)<br>2017-11-10 10:51:34,975+0000 INF=
O (jsonrpc/0) [storage.StoragePool] sdUUID=3D875e1af4-ba14-4255-b6ad-c30316=
72df93 spUUID=3D5a0287ce-0233-0170-00a2-0000000001d8 (sp:942)<br>2017-11-10=
10:51:35,102+0000 INFO (itmap/0) [IOProcessClient] Starting client ioproce=
ss-707 (__init__:330)<br>2017-11-10 10:51:35,113+0000 INFO (itmap/1) [IOPro=
cessClient] Starting client ioprocess-708 (__init__:330)<br>2017-11-10 10:5=
1:35,123+0000 INFO (ioprocess/20654) [IOProcess] Starting ioprocess (__init=
__:452)<br>2017-11-10 10:51:35,127+0000 INFO (jsonrpc/0) [IOProcessClient] =
Starting client ioprocess-709 (__init__:330)<br>2017-11-10 10:51:35,137+000=
0 INFO (ioprocess/20660) [IOProcess] Starting ioprocess (__init__:452)<br>2=
017-11-10 10:51:35,139+0000 INFO (ioprocess/20667) [IOProcess] Starting iop=
rocess (__init__:452)<br>2017-11-10 10:51:35,141+0000 INFO (jsonrpc/0) [vds=
m.api] FINISH attachStorageDomain error=3D'VERSION' from=3D::ffff:192.168.1=
6.9,42838, flow_id=3D05e7dbb5-bad3-484f-b364-ca635fe1f20b, task_id=3D472c9b=
fe-0751-4240-b5c4-e867cb3d0cfb (api:50)<br>2017-11-10 10:51:35,141+0000 ERR=
OR (jsonrpc/0) [storage.TaskManager.Task] (Task=3D'472c9bfe-0751-4240-b5c4-=
e867cb3d0cfb') Unexpected error (task:872)<br>Traceback (most recent call l=
ast):<br> File "/usr/share/vdsm/storage/task.py", line 879, in
_run<br> ret=
urn fn(*args, **kargs)<br> File "<string>", line 2, in
attachStorageD=
omain<br> File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line
=
48, in method<br> ret =3D func(*args, **kwargs)<br> File
"/usr/share/vdsm/s=
torage/hsm.py", line 1152, in attachStorageDomain<br> pool.attachSD(sdUUID)=
<br> File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py",
lin=
e 79, in wrapper<br> return method(self, *args, **kwargs)<br> File
"/usr/sh=
are/vdsm/storage/sp.py", line 949, in attachSD<br> dom =3D sdCache.produce(=
sdUUID)<br> File "/usr/share/vdsm/storage/sdc.py", line 112, in
produce<br>=
domain.getRealDomain()<br> File "/usr/share/vdsm/storage/sdc.py", line
53,=
in getRealDomain<br> return self._cache._realProduce(self._sdUUID)<br> Fil=
e "/usr/share/vdsm/storage/sdc.py", line 136, in _realProduce<br> domain
=
=3D self._findDomain(sdUUID)<br> File "/usr/share/vdsm/storage/sdc.py",
lin=
e 153, in _findDomain<br> return findMethod(sdUUID)<br> File
"/usr/share/vd=
sm/storage/nfsSD.py", line 126, in findDomain<br> return NfsStorageDomain(N=
fsStorageDomain.findDomainPath(sdUUID))<br> File "/usr/share/vdsm/storage/f=
ileSD.py", line 364, in __init__<br> manifest =3D self.manifestClass(domain=
Path)<br> File "/usr/share/vdsm/storage/fileSD.py", line 171, in
__init__<b=
r> sd.StorageDomainManifest.__init__(self, sdUUID, domaindir, metadata)<br>=
File "/usr/share/vdsm/storage/sd.py", line 332, in __init__<br>
self._doma=
inLock =3D self._makeDomainLock()<br> File
"/usr/share/vdsm/storage/sd.py",=
line 526, in _makeDomainLock<br> domVersion =3D self.getVersion()<br> File=
"/usr/share/vdsm/storage/sd.py", line 403, in getVersion<br> return
self.g=
etMetaParam(DMDK_VERSION)<br> File "/usr/share/vdsm/storage/sd.py", line
40=
0, in getMetaParam<br> return self._metadata[key]<br> File
"/usr/lib/python=
2.7/site-packages/vdsm/storage/persistent.py", line 91, in __getitem__<br> =
return dec(self._dict[key])<br> File "/usr/lib/python2.7/site-packages/vdsm=
/storage/persistent.py", line 203, in __getitem__<br> raise
KeyError(key)<b=
r>KeyError: 'VERSION'<br>2017-11-10 10:51:35,142+0000 INFO (jsonrpc/0)
[sto=
rage.TaskManager.Task] (Task=3D'472c9bfe-0751-4240-b5c4-e867cb3d0cfb') abor=
ting: Task is aborted: u"'VERSION'" - code 100
(task:1177)<br>2017-11-10 10=
:51:35,143+0000 ERROR (jsonrpc/0) [storage.Dispatcher] FINISH attachStorage=
Domain error=3D'VERSION' (dispatcher:85)<br>Traceback (most recent call
las=
t):<br> File "/usr/share/vdsm/storage/dispatcher.py", line 72, in
wrapper<b=
r> result =3D ctask.prepare(func, *args, **kwargs)<br> File
"/usr/share/vds=
m/storage/task.py", line 105, in wrapper<br> return m(self, *a, **kw)<br>
F=
ile "/usr/share/vdsm/storage/task.py", line 1185, in prepare<br> raise
self=
.error<br>KeyError: 'VERSION'<br>2017-11-10 10:51:35,144+0000 INFO
(jsonrpc=
/0) [jsonrpc.JsonRpcServer] RPC call StorageDomain.attach failed (error 350=
) in 0.17 seconds (__init__:539)<br>2017-11-10 10:51:37,336+0000 INFO (json=
rpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.0=
0 seconds (__init__:539)<br>2017-11-10 10:51:38,387+0000 INFO (jsonrpc/5) [=
vdsm.api] START repoStats(options=3DNone) from=3D::ffff:192.168.16.9,42836,=
flow_id=3D564f788f, task_id=3D0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:46=
)<br>2017-11-10 10:51:38,388+0000 INFO (jsonrpc/5) [vdsm.api] FINISH repoSt=
ats return=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual'=
: True, 'version': 4, 'acquired': True, 'delay':
'0.000855589', 'lastCheck'=
: '2.3', 'valid': True}} from=3D::ffff:192.168.16.9,42836,
flow_id=3D564f78=
8f, task_id=3D0c08c128-7ec8-4981-95a8-5bfeeed126d6 (api:52)<br>2017-11-10 1=
0:51:38,396+0000 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.get=
Stats succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:41,198+0=
000 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats su=
cceeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:51:43,474+0000 INFO=
(jsonrpc/4) [vdsm.api] START getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-00=
a2-0000000001d8', options=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=
=3D14f15c4b, task_id=3D63fb7235-56eb-4acd-8bf6-e04a701e8d83 (api:46)<br>201=
7-11-10 10:51:43,483+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getSpmStatus r=
eturn=3D{'spm_st': {'spmId': 1, 'spmStatus': 'SPM',
'spmLver': 2L}} from=3D=
::ffff:192.168.16.9,42836, flow_id=3D14f15c4b, task_id=3D63fb7235-56eb-4acd=
-8bf6-e04a701e8d83 (api:52)<br>2017-11-10 10:51:43,484+0000 INFO (jsonrpc/4=
) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.=
01 seconds (__init__:539)<br>2017-11-10 10:51:44,493+0000 INFO (jsonrpc/1) =
[vdsm.api] START getStoragePoolInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0000=
000001d8', options=3DNone) from=3D::ffff:192.168.16.9,42838, flow_id=3D14f1=
5c4b, task_id=3De0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:46)<br>2017-11-10=
10:51:44,504+0000 INFO (jsonrpc/1) [vdsm.api] FINISH getStoragePoolInfo re=
turn=3D{'info': {'name': 'No Description', 'isoprefix':
'', 'pool_status': =
'connected', 'lver': 2L, 'domains':
u'5eed853b-09ee-430d-bde2-c37394c1ff6c:=
Active', 'master_uuid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c',
'version':=
'4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominfo': {u'5ee=
d853b-09ee-430d-bde2-c37394c1ff6c': {'status': u'Active',
'diskfree': '9121=
09731840', 'isoprefix': '', 'alerts': [], 'disktotal':
'912151019520', 'ver=
sion': 4}}} from=3D::ffff:192.168.16.9,42838, flow_id=3D14f15c4b, task_id=
=3De0fe10ef-cc9c-4e3c-a22a-1f9ca042e75e (api:52)<br>2017-11-10 10:51:44,505=
+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo=
succeeded in 0.01 seconds (__init__:539)<br>2017-11-10 10:51:45,897+0000 I=
NFO (periodic/1) [vdsm.api] START repoStats(options=3DNone) from=3Dinternal=
, task_id=3Dc0283b39-b3d9-4745-ae24-791e6bddde42 (api:46)<br>2017-11-10 10:=
51:45,897+0000 INFO (periodic/1) [vdsm.api] FINISH repoStats return=3D{u'5e=
ed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True,
'version':=
4, 'acquired': True, 'delay': '0.00066142', 'lastCheck':
'1.9', 'valid': T=
rue}} from=3Dinternal, task_id=3Dc0283b39-b3d9-4745-ae24-791e6bddde42 (api:=
52)<br>2017-11-10 10:51:53,342+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer=
] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2=
017-11-10 10:51:54,433+0000 INFO (jsonrpc/3) [vdsm.api] START repoStats(opt=
ions=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=3D27d75b74, task_id=
=3Dcd61efd3-ec82-4de5-a83f-65e0f4ac48f6 (api:46)<br>2017-11-10 10:51:54,433=
+0000 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return=3D{u'5eed853b-09e=
e-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True,
'version': 4, 'acqui=
red': True, 'delay': '0.000928362', 'lastCheck':
'0.4', 'valid': True}} fro=
m=3D::ffff:192.168.16.9,42836, flow_id=3D27d75b74, task_id=3Dcd61efd3-ec82-=
4de5-a83f-65e0f4ac48f6 (api:52)<br>2017-11-10 10:51:54,441+0000 INFO (jsonr=
pc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seco=
nds (__init__:539)<br>2017-11-10 10:51:55,515+0000 INFO (jsonrpc/0) [vdsm.a=
pi] START getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', op=
tions=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=3D87d184a, task_id=
=3D045078a6-36c6-4869-9408-d1126925aad3 (api:46)<br>2017-11-10 10:51:55,523=
+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus return=3D{'spm_st': {=
'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}}
from=3D::ffff:192.168.16.9,=
42836, flow_id=3D87d184a, task_id=3D045078a6-36c6-4869-9408-d1126925aad3 (a=
pi:52)<br>2017-11-10 10:51:55,524+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcSer=
ver] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:=
539)<br>2017-11-10 10:51:56,217+0000 INFO (jsonrpc/6) [jsonrpc.JsonRpcServe=
r] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:539)<br>=
2017-11-10 10:51:56,532+0000 INFO (jsonrpc/5) [vdsm.api] START getStoragePo=
olInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=3DNone) fr=
om=3D::ffff:192.168.16.9,42838, flow_id=3D87d184a, task_id=3Df7efc4cc-14a7-=
4e50-8070-3119d1bb79b3 (api:46)<br>2017-11-10 10:51:56,543+0000 INFO (jsonr=
pc/5) [vdsm.api] FINISH getStoragePoolInfo return=3D{'info': {'name':
'No D=
escription', 'isoprefix': '', 'pool_status':
'connected', 'lver': 2L, 'doma=
ins': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active', 'master_uuid':
u'5eed=
853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4', 'spm_id':
1, 'type': 'GL=
USTERFS', 'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bde2-c37394c1f=
f6c': {'status': u'Active', 'diskfree':
'912109731840', 'isoprefix': '', 'a=
lerts': [], 'disktotal': '912151019520', 'version': 4}}}
from=3D::ffff:192.=
168.16.9,42838, flow_id=3D87d184a, task_id=3Df7efc4cc-14a7-4e50-8070-3119d1=
bb79b3 (api:52)<br>2017-11-10 10:51:56,544+0000 INFO (jsonrpc/5) [jsonrpc.J=
sonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__ini=
t__:539)<br>2017-11-10 10:52:00,908+0000 INFO (periodic/1) [vdsm.api] START=
repoStats(options=3DNone) from=3Dinternal, task_id=3D110fbcb2-6cde-4e95-a3=
81-79881fb17ac0 (api:46)<br>2017-11-10 10:52:00,909+0000 INFO (periodic/1) =
[vdsm.api] FINISH repoStats return=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6=
c': {'code': 0, 'actual': True, 'version': 4,
'acquired': True, 'delay': '0=
.000928362', 'lastCheck': '4.8', 'valid': True}}
from=3Dinternal, task_id=
=3D110fbcb2-6cde-4e95-a381-79881fb17ac0 (api:52)<br>2017-11-10 10:52:07,557=
+0000 INFO (jsonrpc/7) [vdsm.api] START getSpmStatus(spUUID=3Du'5a0287ce-02=
33-0170-00a2-0000000001d8', options=3DNone) from=3D::ffff:192.168.16.9,4283=
6, flow_id=3D55253850, task_id=3D5e78c011-2d1b-4f50-9445-62fbc4628ae1 (api:=
46)<br>2017-11-10 10:52:07,566+0000 INFO (jsonrpc/7) [vdsm.api] FINISH getS=
pmStatus return=3D{'spm_st': {'spmId': 1, 'spmStatus':
'SPM', 'spmLver': 2L=
}} from=3D::ffff:192.168.16.9,42836, flow_id=3D55253850, task_id=3D5e78c011=
-2d1b-4f50-9445-62fbc4628ae1 (api:52)<br>2017-11-10 10:52:07,567+0000 INFO =
(jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succe=
eded in 0.02 seconds (__init__:539)<br>2017-11-10 10:52:08,576+0000 INFO (j=
sonrpc/4) [vdsm.api] START getStoragePoolInfo(spUUID=3Du'5a0287ce-0233-0170=
-00a2-0000000001d8', options=3DNone) from=3D::ffff:192.168.16.9,42838, flow=
_id=3D55253850, task_id=3D6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:46)<br>=
2017-11-10 10:52:08,587+0000 INFO (jsonrpc/4) [vdsm.api] FINISH getStorageP=
oolInfo return=3D{'info': {'name': 'No Description',
'isoprefix': '', 'pool=
_status': 'connected', 'lver': 2L, 'domains':
u'5eed853b-09ee-430d-bde2-c37=
394c1ff6c:Active', 'master_uuid':
u'5eed853b-09ee-430d-bde2-c37394c1ff6c', =
'version': '4', 'spm_id': 1, 'type': 'GLUSTERFS',
'master_ver': 1}, 'dominf=
o': {u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'status':
u'Active', 'diskfr=
ee': '912109731840', 'isoprefix': '', 'alerts': [],
'disktotal': '912151019=
520', 'version': 4}}} from=3D::ffff:192.168.16.9,42838, flow_id=3D55253850,=
task_id=3D6a4f93ec-0ed1-4017-b808-5f246a7b55cd (api:52)<br>2017-11-10 10:5=
2:08,588+0000 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StoragePool=
.getInfo succeeded in 0.02 seconds (__init__:539)<br>2017-11-10 10:52:09,34=
8+0000 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats=
succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:10,460+0000 I=
NFO (jsonrpc/2) [vdsm.api] START repoStats(options=3DNone) from=3D::ffff:19=
2.168.16.9,42836, flow_id=3D3144af03, task_id=3D2f5a4461-b4f7-4cd6-95db-b15=
8cd082aae (api:46)<br>2017-11-10 10:52:10,460+0000 INFO (jsonrpc/2) [vdsm.a=
pi] FINISH repoStats return=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'c=
ode': 0, 'actual': True, 'version': 4, 'acquired': True,
'delay': '0.000946=
99', 'lastCheck': '4.4', 'valid': True}}
from=3D::ffff:192.168.16.9,42836, =
flow_id=3D3144af03, task_id=3D2f5a4461-b4f7-4cd6-95db-b158cd082aae (api:52)=
<br>2017-11-10 10:52:10,468+0000 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] R=
PC call Host.getStats succeeded in 0.01 seconds (__init__:539)<br>2017-11-1=
0 10:52:11,240+0000 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.=
getAllVmStats succeeded in 0.00 seconds (__init__:539)<br>2017-11-10 10:52:=
15,927+0000 INFO (periodic/0) [vdsm.api] START repoStats(options=3DNone) fr=
om=3Dinternal, task_id=3Df1359cba-4f75-410f-8aeb-a3297af27422 (api:46)<br>2=
017-11-10 10:52:15,928+0000 INFO (periodic/0) [vdsm.api] FINISH repoStats r=
eturn=3D{u'5eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0,
'actual': Tru=
e, 'version': 4, 'acquired': True, 'delay': '0.000780232',
'lastCheck': '1.=
9', 'valid': True}} from=3Dinternal, task_id=3Df1359cba-4f75-410f-8aeb-a329=
7af27422 (api:52)<br>2017-11-10 10:52:19,351+0000 INFO (jsonrpc/0) [vdsm.ap=
i] START getSpmStatus(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', opt=
ions=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=3D47e88296, task_id=
=3D441cdb4e-2752-4ccf-832f-a6c295f2f793 (api:46)<br>2017-11-10 10:52:19,359=
+0000 INFO (jsonrpc/0) [vdsm.api] FINISH getSpmStatus return=3D{'spm_st': {=
'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}}
from=3D::ffff:192.168.16.9,=
42836, flow_id=3D47e88296, task_id=3D441cdb4e-2752-4ccf-832f-a6c295f2f793 (=
api:52)<br>2017-11-10 10:52:19,359+0000 INFO (jsonrpc/0) [jsonrpc.JsonRpcSe=
rver] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__=
:539)<br>2017-11-10 10:52:20,367+0000 INFO (jsonrpc/6) [vdsm.api] START get=
StoragePoolInfo(spUUID=3Du'5a0287ce-0233-0170-00a2-0000000001d8', options=
=3DNone) from=3D::ffff:192.168.16.9,42838, flow_id=3D47e88296, task_id=3D32=
a0366d-c576-4400-97e5-26bfd3b9561a (api:46)<br>2017-11-10 10:52:20,378+0000=
INFO (jsonrpc/6) [vdsm.api] FINISH getStoragePoolInfo return=3D{'info': {'=
name': 'No Description', 'isoprefix': '',
'pool_status': 'connected', 'lver=
': 2L, 'domains': u'5eed853b-09ee-430d-bde2-c37394c1ff6c:Active',
'master_u=
uid': u'5eed853b-09ee-430d-bde2-c37394c1ff6c', 'version': '4',
'spm_id': 1,=
'type': 'GLUSTERFS', 'master_ver': 1}, 'dominfo':
{u'5eed853b-09ee-430d-bd=
e2-c37394c1ff6c': {'status': u'Active', 'diskfree':
'912109731840', 'isopre=
fix': '', 'alerts': [], 'disktotal': '912151019520',
'version': 4}}} from=
=3D::ffff:192.168.16.9,42838, flow_id=3D47e88296, task_id=3D32a0366d-c576-4=
400-97e5-26bfd3b9561a (api:52)<br>2017-11-10 10:52:20,379+0000 INFO (jsonrp=
c/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.02=
seconds (__init__:539)<br>2017-11-10 10:52:25,354+0000 INFO (jsonrpc/5) [j=
sonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds=
(__init__:539)<br>2017-11-10 10:52:26,259+0000 INFO (jsonrpc/7) [jsonrpc.J=
sonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init=
__:539)<br>2017-11-10 10:52:26,492+0000 INFO (jsonrpc/4) [vdsm.api] START r=
epoStats(options=3DNone) from=3D::ffff:192.168.16.9,42836, flow_id=3D47536c=
d8, task_id=3D33cbd1f4-d8b8-44da-809b-776802d6f9cd (api:46)<br>2017-11-10 1=
0:52:26,493+0000 INFO (jsonrpc/4) [vdsm.api] FINISH repoStats return=3D{u'5=
eed853b-09ee-430d-bde2-c37394c1ff6c': {'code': 0, 'actual': True,
'version'=
: 4, 'acquired': True, 'delay': '0.000919276',
'lastCheck': '0.4', 'valid':=
True}} from=3D::ffff:192.168.16.9,42836, flow_id=3D47536cd8, task_id=3D33c=
bd1f4-d8b8-44da-809b-776802d6f9cd (api:52)<br>2017-11-10 10:52:26,500+0000 =
INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded i=
n 0.01 seconds (__init__:539)<br>[root@node1
vdsm]#<br></div><br><br><div>e=
ngine log:</div><div>2017-11-10 10:51:32,474Z INFO [org.ovirt.engine.core.b=
ll.storage.domain.AttachStorageDomainToPoolCommand] (default task-4) [05e7d=
bb5-bad3-484f-b364-ca635fe1f20b] Lock Acquired to object 'EngineLock:{exclu=
siveLocks=3D'[875e1af4-ba14-4255-b6ad-c3031672df93=3DSTORAGE]', sharedLocks=
=3D''}'<br>2017-11-10 10:51:32,504Z INFO
[org.ovirt.engine.core.bll.storage=
.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-4=
5) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Running command: AttachStorageDom=
ainToPoolCommand internal: false. Entities affected : ID: 875e1af4-ba14-425=
5-b6ad-c3031672df93 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN wit=
h role type ADMIN, ID: 5a0287ce-0233-0170-00a2-0000000001d8 Type: StoragePo=
olAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN<br>2017-11-10=
10:51:32,520Z INFO [org.ovirt.engine.core.bll.storage.connection.ConnectSt=
orageToVdsCommand] (org.ovirt.thread.pool-6-thread-46) [1cccae15] Running c=
ommand: ConnectStorageToVdsCommand internal: true. Entities affected : ID: =
aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAG=
E_DOMAIN with role type ADMIN<br>2017-11-10 10:51:32,523Z INFO [org.ovirt.e=
ngine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.t=
hread.pool-6-thread-46) [1cccae15] START, ConnectStorageServerVDSCommand(Ho=
stName =3D node1, StorageServerConnectionManagementVDSParameters:{runAsync=
=3D'true', hostId=3D'630b72af-880c-4d08-9e03-68fc16a6aadd',
storagePoolId=
=3D'00000000-0000-0000-0000-000000000000', storageType=3D'NFS',
connectionL=
ist=3D'[StorageServerConnections:{id=3D'ba9e9b72-cade-4e16-82fe-237ff7143b3=
b', connection=3D'engine.futurcargo.com:/home/iso', iqn=3D'null',
vfsType=
=3D'null', mountOptions=3D'null', nfsVersion=3D'null',
nfsRetrans=3D'null',=
nfsTimeo=3D'null', iface=3D'null',
netIfaceName=3D'null'}]'}), log id: 67e=
d8236<br>2017-11-10 10:51:33,546Z INFO [org.ovirt.engine.core.vdsbroker.vds=
broker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-6-thread-46) =
[1cccae15] FINISH, ConnectStorageServerVDSCommand, return: {ba9e9b72-cade-4=
e16-82fe-237ff7143b3b=3D0}, log id: 67ed8236<br>2017-11-10 10:51:33,549Z IN=
FO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand=
] (org.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b=
] START, AttachStorageDomainVDSCommand( AttachStorageDomainVDSCommandParame=
ters:{runAsync=3D'true', storagePoolId=3D'5a0287ce-0233-0170-00a2-000000000=
1d8', ignoreFailoverLimit=3D'false',
storageDomainId=3D'875e1af4-ba14-4255-=
b6ad-c3031672df93'}), log id: 2f387159<br>2017-11-10 10:51:34,725Z ERROR [o=
rg.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (or=
g.ovirt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Fai=
led in 'AttachStorageDomainVDS' method<br>2017-11-10 10:51:34,740Z ERROR
[o=
rg.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.o=
virt.thread.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_=
ID: IRS_BROKER_COMMAND_FAILURE(10,803), Correlation ID: null, Call Stack: n=
ull, Custom ID: null, Custom Event ID: -1, Message: VDSM command AttachStor=
ageDomainVDS failed: Error in storage domain action: (u'sdUUID=3D875e1af4-b=
a14-4255-b6ad-c3031672df93, spUUID=3D5a0287ce-0233-0170-00a2-0000000001d8',=
)<br>2017-11-10 10:51:34,740Z ERROR [org.ovirt.engine.core.vdsbroker.irsbro=
ker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45) [05e=
7dbb5-bad3-484f-b364-ca635fe1f20b] Command 'AttachStorageDomainVDSCommand( =
AttachStorageDomainVDSCommandParameters:{runAsync=3D'true', storagePoolId=
=3D'5a0287ce-0233-0170-00a2-0000000001d8', ignoreFailoverLimit=3D'false',
s=
torageDomainId=3D'875e1af4-ba14-4255-b6ad-c3031672df93'})' execution failed=
: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS,=
error =3D Error in storage domain action: (u'sdUUID=3D875e1af4-ba14-4255-b=
6ad-c3031672df93, spUUID=3D5a0287ce-0233-0170-00a2-0000000001d8',), code =
=3D 350<br>2017-11-10 10:51:34,740Z INFO [org.ovirt.engine.core.vdsbroker.i=
rsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-6-thread-45)=
[05e7dbb5-bad3-484f-b364-ca635fe1f20b] FINISH, AttachStorageDomainVDSComma=
nd, log id: 2f387159<br>2017-11-10 10:51:34,740Z ERROR [org.ovirt.engine.co=
re.bll.storage.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.p=
ool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command 'org.ovirt.=
engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand' failed: En=
gineException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailed=
NoFailoverException: IRSGenericException: IRSErrorException: Failed to Atta=
chStorageDomainVDS, error =3D Error in storage domain action: (u'sdUUID=3D8=
75e1af4-ba14-4255-b6ad-c3031672df93, spUUID=3D5a0287ce-0233-0170-00a2-00000=
00001d8',), code =3D 350 (Failed with error StorageDomainActionError and co=
de 350)<br>2017-11-10 10:51:34,741Z INFO [org.ovirt.engine.core.bll.storage=
.domain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-4=
5) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] Command [id=3Da392af75-7ebe-499a-=
b2ed-765651834557]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.com=
mon.businessentities.StoragePoolIsoMap; snapshot: StoragePoolIsoMapId:{stor=
agePoolId=3D'5a0287ce-0233-0170-00a2-0000000001d8', storageId=3D'875e1af4-b=
a14-4255-b6ad-c3031672df93'}.<br>2017-11-10 10:51:34,746Z ERROR [org.ovirt.=
engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thre=
ad.pool-6-thread-45) [05e7dbb5-bad3-484f-b364-ca635fe1f20b] EVENT_ID: USER_=
ATTACH_STORAGE_DOMAIN_TO_POOL_FAILED(963), Correlation ID: 05e7dbb5-bad3-48=
4f-b364-ca635fe1f20b, Job ID: 7f3f27ce-4d45-4b3b-a9ee-c25795658ee4, Call St=
ack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to attach =
Storage Domain ISO_DOMAIN to Data Center Default. (User: admin@internal-aut=
hz)<br>2017-11-10 10:51:34,748Z INFO [org.ovirt.engine.core.bll.storage.dom=
ain.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-6-thread-45) [=
05e7dbb5-bad3-484f-b364-ca635fe1f20b] Lock freed to object 'EngineLock:{exc=
lusiveLocks=3D'[875e1af4-ba14-4255-b6ad-c3031672df93=3DSTORAGE]', sharedLoc=
ks=3D''}'<br></div><br><div><hr
style=3D"width: 100%; height: 2px;">Jose Fe=
rradeira<br>http://www.logicworks.pt</div></div><br></div></div></body></ht=
ml>
------=_Part_903046_834258931.1510311699782--