This is a multi-part message in MIME format.
--------------03C743F7C6DD201B410A4D35
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
On 12/20/2016 01:47 PM, Simone Tiraboschi wrote:
On Tue, Dec 20, 2016 at 7:47 AM, knarra <knarra(a)redhat.com
<mailto:knarra@redhat.com>> wrote:
Hi,
I have latest master installed and i see that Hosted Engine VM
fails to import. Below are the logs i see in the engine log. Can
some one help me understand why does this happen?
It's a change in VDSM storage APIs; look for:
[ovirt-devel] Change in VDSM API in master (VolumeInfo.lease)
Probably you are using an up-to-date vdsm against a few days old
engine-appliance (we still have some troubles re-building the engine
appliance on Centos 7.3) and so the issue.
Could you please run
yum update "ovirt-*-setup*"
engine-setup
on your engine VM to get an up to date engine?
Once up to date, the engine should be able to recover by itself.
Thanks simone. I
updated my engine as you suggested and i see that
Hosted Engine vm appears in the UI.
2016-12-20 06:46:02,291Z INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] START,
GetImageInfoVDSComman
d( GetImageInfoVDSCommandParameters:{runAsync='true',
storagePoolId='00000001-0001-0001-0001-000000000311',
ignoreFailoverLimit='false', storageDomainId='4830f5b2-5a7d-4a89-
8fc9-8911134035e4',
imageGroupId='0dec26c2-59c8-4d7f-adc0-6e4c878028ee',
imageId='e1133334-9f08-4e71-9b3a-d6a93273fbd3'}), log id: 78f8a633
2016-12-20 06:46:02,291Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] START,
GetVolumeInfoVDSComm
and(HostName = hosted_engine1,
GetVolumeInfoVDSCommandParameters:{runAsync='true',
hostId='4c4a3633-2c2a-49c9-be06-78a21a4a2584',
storagePoolId='00000001-0001-0001-0001-0000
00000311', storageDomainId='4830f5b2-5a7d-4a89-8fc9-8911134035e4',
imageGroupId='0dec26c2-59c8-4d7f-adc0-6e4c878028ee',
imageId='e1133334-9f08-4e71-9b3a-d6a93273fbd3'}), log
id: 62a0b308
2016-12-20 06:46:02,434Z ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed building
DiskImage:
No enum const
org.ovirt.engine.core.common.businessentities.LeaseState.{owners=[Ljava.lang.Object;@28beccfa,
version=2}
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Command
'org.ovirt.engine.c
ore.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand' return value '
VolumeInfoReturn:{status='Status [code=0, message=Done]'}
status = OK
domain = 4830f5b2-5a7d-4a89-8fc9-8911134035e4
voltype = LEAF
description = Hosted Engine Image
parent = 00000000-0000-0000-0000-000000000000
format = RAW
generation = 0
image = 0dec26c2-59c8-4d7f-adc0-6e4c878028ee
ctime = 1482153085
disktype = 2
legality = LEGAL
mtime = 0
apparentsize = 53687091200
children:
[]
pool =
capacity = 53687091200
uuid = e1133334-9f08-4e71-9b3a-d6a93273fbd3
truesize = 2761210368
type = SPARSE
lease:
owners:
[1]
version = 2
'
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] HostName =
hosted_engine1
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] FINISH,
GetVolumeInfoVDSCommand, log id: 62a0b308
2016-12-20 06:46:02,434Z ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed to get the
volume information, marking as FAILED
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] FINISH,
GetImageInfoVDSCommand, log id: 78f8a633
2016-12-20 06:46:02,434Z WARN
[org.ovirt.engine.core.bll.exportimport.ImportVmCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Validation of
action 'ImportVm' failed for user SYSTEM. Reasons:
VAR__ACTION__IMPORT,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IMAGE_DOES_NOT_EXIST
2016-12-20 06:46:02,435Z INFO
[org.ovirt.engine.core.bll.exportimport.ImportVmCommand]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Lock freed to
object
'EngineLock:{exclusiveLocks='[89681893-94fe-4366-be6d-15141ff2b365=<VM,
ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED$VmName HostedEngine>,
HostedEngine=<VM_NAME, ACTION_TYPE_FAILED_NAME_ALREADY_USED>]',
sharedLocks='[89681893-94fe-4366-be6d-15141ff2b365=<REMOTE_VM,
ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED$VmName HostedEngine>]'}'
2016-12-20 06:46:02,435Z ERROR
[org.ovirt.engine.core.bll.HostedEngineImporter]
(org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed importing
the Hosted Engine VM
2016-12-20 06:46:04,436Z INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand]
(DefaultQuartzScheduler4) [2d8b8a56] FINISH,
GlusterServersListVDSCommand, return: [10.70.36.79/23:CONNECTED
<
http://10.70.36.79/23:CONNECTED>, 10.70.36.80:CONNECTED,
10.70.36.81:CONNECTED], log id: 617781b7
Thanks
kasturi.
--------------03C743F7C6DD201B410A4D35
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 12/20/2016 01:47 PM, Simone
Tiraboschi wrote:<br>
</div>
<blockquote
cite="mid:CAN8-ONpPjw1B8jiKG6xP4oxVuyOVL9=5MQjQmmzDh1pTTPaaFA@mail.gmail.com"
type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Dec 20, 2016 at 7:47 AM,
knarra <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">Hi,<br>
<br>
I have latest master installed and i see that Hosted
Engine VM fails to import. Below are the logs i see in the
engine log. Can some one help me understand why does this
happen?<br>
</blockquote>
<br>
It's a change in VDSM storage APIs; look for:</div>
<div class="gmail_quote">[ovirt-devel] Change in VDSM API in
master (VolumeInfo.lease)<br>
<br>
Probably you are using an up-to-date vdsm against a few days
old engine-appliance (we still have some troubles
re-building the engine appliance on Centos 7.3) and so the
issue.<br>
Could you please run <br>
yum update "ovirt-*-setup*"</div>
<div class="gmail_quote"> engine-setup<br>
on your engine VM to get an up to date engine?</div>
<div class="gmail_quote">Once up to date, the engine should be
able to recover by itself.<br>
</div>
</div>
</div>
</blockquote>
Thanks simone. I updated my engine as you suggested and i see that
Hosted Engine vm appears in the UI.<br>
<blockquote
cite="mid:CAN8-ONpPjw1B8jiKG6xP4oxVuyOVL9=5MQjQmmzDh1pTTPaaFA@mail.gmail.com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<br>
<br>
2016-12-20 06:46:02,291Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetImageInfoVDSCo<wbr>mmand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] START,
GetImageInfoVDSComman<br>
d( GetImageInfoVDSCommandParamete<wbr>rs:{runAsync='true',
storagePoolId='00000001-0001-0<wbr>001-0001-000000000311',
ignoreFailoverLimit='false',
storageDomainId='4830f5b2-5a7d<wbr>-4a89-<br>
8fc9-8911134035e4',
imageGroupId='0dec26c2-59c8-4d<wbr>7f-adc0-6e4c878028ee',
imageId='e1133334-9f08-4e71-9b<wbr>3a-d6a93273fbd3'}), log
id: 78f8a633<br>
2016-12-20 06:46:02,291Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetVolumeInfoVDSC<wbr>ommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] START,
GetVolumeInfoVDSComm<br>
and(HostName = hosted_engine1,
GetVolumeInfoVDSCommandParamet<wbr>ers:{runAsync='true',
hostId='4c4a3633-2c2a-49c9-be0<wbr>6-78a21a4a2584',
storagePoolId='00000001-0001-0<wbr>001-0001-0000<br>
00000311',
storageDomainId='4830f5b2-5a7d<wbr>-4a89-8fc9-8911134035e4',
imageGroupId='0dec26c2-59c8-4d<wbr>7f-adc0-6e4c878028ee',
imageId='e1133334-9f08-4e71-9b<wbr>3a-d6a93273fbd3'}),
log<br>
id: 62a0b308<br>
2016-12-20 06:46:02,434Z ERROR
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetVolumeInfoVDSC<wbr>ommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] Failed
building DiskImage:<br>
No enum const
org.ovirt.engine.core.common.b<wbr>usinessentities.LeaseState.{ow<wbr>ners=[Ljava.lang.Object;@28bec<wbr>cfa,
version=2}<br>
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetVolumeInfoVDSC<wbr>ommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f]
Command 'org.ovirt.engine.c<br>
ore.vdsbroker.vdsbroker.GetVol<wbr>umeInfoVDSCommand'
return value '<br>
VolumeInfoReturn:{status='Stat<wbr>us [code=0,
message=Done]'}<br>
status = OK<br>
domain = 4830f5b2-5a7d-4a89-8fc9-891113<wbr>4035e4<br>
voltype = LEAF<br>
description = Hosted Engine Image<br>
parent = 00000000-0000-0000-0000-000000<wbr>000000<br>
format = RAW<br>
generation = 0<br>
image = 0dec26c2-59c8-4d7f-adc0-6e4c87<wbr>8028ee<br>
ctime = 1482153085<br>
disktype = 2<br>
legality = LEGAL<br>
mtime = 0<br>
apparentsize = 53687091200<br>
children:<br>
[]<br>
pool =<br>
capacity = 53687091200<br>
uuid = e1133334-9f08-4e71-9b3a-d6a932<wbr>73fbd3<br>
truesize = 2761210368<br>
type = SPARSE<br>
lease:<br>
owners:<br>
[1]<br>
version = 2<br>
<br>
'<br>
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetVolumeInfoVDSC<wbr>ommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f]
HostName = hosted_engine1<br>
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetVolumeInfoVDSC<wbr>ommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f]
FINISH, GetVolumeInfoVDSCommand, log id: 62a0b308<br>
2016-12-20 06:46:02,434Z ERROR
[org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetImageInfoVDSCo<wbr>mmand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] Failed
to get the volume information, marking as FAILED<br>
2016-12-20 06:46:02,434Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetImageInfoVDSCo<wbr>mmand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f]
FINISH, GetImageInfoVDSCommand, log id: 78f8a633<br>
2016-12-20 06:46:02,434Z WARN
[org.ovirt.engine.core.bll.exp<wbr>ortimport.ImportVmCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f]
Validation of action 'ImportVm' failed for user SYSTEM.
Reasons:
VAR__ACTION__IMPORT,VAR__TYPE_<wbr>_VM,ACTION_TYPE_FAILED_VM_IMAG<wbr>E_DOES_NOT_EXIST<br>
2016-12-20 06:46:02,435Z INFO
[org.ovirt.engine.core.bll.exp<wbr>ortimport.ImportVmCommand]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] Lock
freed to object
'EngineLock:{exclusiveLocks='[<wbr>89681893-94fe-4366-be6d-15141f<wbr>f2b365=<VM,
ACTION_TYPE_FAILED_VM_IS_BEING<wbr>_IMPORTED$VmName
HostedEngine>, HostedEngine=<VM_NAME,
ACTION_TYPE_FAILED_NAME_ALREAD<wbr>Y_USED>]',
sharedLocks='[89681893-94fe-43<wbr>66-be6d-15141ff2b365=<REMOTE_<wbr>VM,
ACTION_TYPE_FAILED_VM_IS_BEING<wbr>_IMPORTED$VmName
HostedEngine>]'}'<br>
2016-12-20 06:46:02,435Z ERROR
[org.ovirt.engine.core.bll.Hos<wbr>tedEngineImporter]
(org.ovirt.thread.pool-6-threa<wbr>d-48) [77f83e0f] Failed
importing the Hosted Engine VM<br>
2016-12-20 06:46:04,436Z INFO
[org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterServersListV<wbr>DSCommand]
(DefaultQuartzScheduler4) [2d8b8a56] FINISH,
GlusterServersListVDSCommand, return: [<a
moz-do-not-send="true"
href="http://10.70.36.79/23:CONNECTED"
rel="noreferrer"
target="_blank">10.70.36.79/23:CONNECTED</a>,
10.70.36.80:CONNECTED, 10.70.36.81:CONNECTED], log id:
617781b7<br>
<br>
Thanks<br>
<br>
kasturi.<br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<p><br>
</p>
</body>
</html>
--------------03C743F7C6DD201B410A4D35--