On Tue, Dec 20, 2016 at 7:47 AM, knarra <knarra@redhat.com> wrote:

Hi,

    I have latest master installed and i see that Hosted Engine VM fails to import. Below are the logs i see in the engine log. Can some one help me understand why does this happen?

It's a change in VDSM storage APIs; look for:

[ovirt-devel] Change in VDSM API in master (VolumeInfo.lease)

Probably you are using an up-to-date vdsm against a few days old engine-appliance (we still have some troubles re-building the engine appliance on Centos 7.3) and so the issue.
Could you please run
  yum update "ovirt-*-setup*"

  engine-setup
on your engine VM to get an up to date engine?

Once up to date, the engine should be able to recover by itself.

2016-12-20 06:46:02,291Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] START, GetImageInfoVDSComman
d( GetImageInfoVDSCommandParameters:{runAsync='true', storagePoolId='00000001-0001-0001-0001-000000000311', ignoreFailoverLimit='false', storageDomainId='4830f5b2-5a7d-4a89-
8fc9-8911134035e4', imageGroupId='0dec26c2-59c8-4d7f-adc0-6e4c878028ee', imageId='e1133334-9f08-4e71-9b3a-d6a93273fbd3'}), log id: 78f8a633
2016-12-20 06:46:02,291Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] START, GetVolumeInfoVDSComm
and(HostName = hosted_engine1, GetVolumeInfoVDSCommandParameters:{runAsync='true', hostId='4c4a3633-2c2a-49c9-be06-78a21a4a2584', storagePoolId='00000001-0001-0001-0001-0000
00000311', storageDomainId='4830f5b2-5a7d-4a89-8fc9-8911134035e4', imageGroupId='0dec26c2-59c8-4d7f-adc0-6e4c878028ee', imageId='e1133334-9f08-4e71-9b3a-d6a93273fbd3'}), log
 id: 62a0b308
2016-12-20 06:46:02,434Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed building DiskImage:
No enum const org.ovirt.engine.core.common.businessentities.LeaseState.{owners=[Ljava.lang.Object;@28beccfa, version=2}
2016-12-20 06:46:02,434Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Command 'org.ovirt.engine.c
ore.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand' return value '
VolumeInfoReturn:{status='Status [code=0, message=Done]'}
status = OK
domain = 4830f5b2-5a7d-4a89-8fc9-8911134035e4
voltype = LEAF
description = Hosted Engine Image
parent = 00000000-0000-0000-0000-000000000000
format = RAW
generation = 0
image = 0dec26c2-59c8-4d7f-adc0-6e4c878028ee
ctime = 1482153085
disktype = 2
legality = LEGAL
mtime = 0
apparentsize = 53687091200
children:
[]
pool =
capacity = 53687091200
uuid = e1133334-9f08-4e71-9b3a-d6a93273fbd3
truesize = 2761210368
type = SPARSE
lease:
owners:
[1]
version = 2

'
2016-12-20 06:46:02,434Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] HostName = hosted_engine1
2016-12-20 06:46:02,434Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVolumeInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] FINISH, GetVolumeInfoVDSCommand, log id: 62a0b308
2016-12-20 06:46:02,434Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed to get the volume information, marking as FAILED
2016-12-20 06:46:02,434Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] FINISH, GetImageInfoVDSCommand, log id: 78f8a633
2016-12-20 06:46:02,434Z WARN [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Validation of action 'ImportVm' failed for user SYSTEM. Reasons: VAR__ACTION__IMPORT,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IMAGE_DOES_NOT_EXIST
2016-12-20 06:46:02,435Z INFO [org.ovirt.engine.core.bll.exportimport.ImportVmCommand] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Lock freed to object 'EngineLock:{exclusiveLocks='[89681893-94fe-4366-be6d-15141ff2b365=<VM, ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED$VmName HostedEngine>, HostedEngine=<VM_NAME, ACTION_TYPE_FAILED_NAME_ALREADY_USED>]', sharedLocks='[89681893-94fe-4366-be6d-15141ff2b365=<REMOTE_VM, ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED$VmName HostedEngine>]'}'
2016-12-20 06:46:02,435Z ERROR [org.ovirt.engine.core.bll.HostedEngineImporter] (org.ovirt.thread.pool-6-thread-48) [77f83e0f] Failed importing the Hosted Engine VM
2016-12-20 06:46:04,436Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler4) [2d8b8a56] FINISH, GlusterServersListVDSCommand, return: [10.70.36.79/23:CONNECTED, 10.70.36.80:CONNECTED, 10.70.36.81:CONNECTED], log id: 617781b7

Thanks

kasturi.