- Users - oVirt List Archives

guests crashing during live migration(NUMA config issue)
by Balg, Andreas 14 Jun '18

14 Jun '18

Hello, during updates of our physical nodes running ovirt 4.2.3 I had to live- migrate all VMs to evacuate them from the hosts. This caused roughly 10% of guests to end up crashed /shutdown after live migration. Errors in the Logs are: 2018-05-31T15:15:51.273805Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config, ability to start up with partial NUMA mappings is obsoleted and will be removed in future 2018-05-31T15:16:54.596554Z qemu-kvm: Unknown combination of migration flags: 0 2018-05-31T15:16:54.597196Z qemu-kvm: error while loading state section id 3(ram) 2018-05-31T15:16:54.598491Z qemu-kvm: load of migration failed: Invalid argument 2018-05-31 15:16:55.010+0000: shutting down, reason=crashed is there anything I can do about this? The hardware of all nodes is 100% identical -- Andreas Balg

3 6

VM is reachable only from oVirt node
by sweettriplek＠gmail.com 14 Jun '18

14 Jun '18

VM running with centos is not reaching to any other network other than oVirt node. I tried to apply no network filer, clean-filter while creating vNIC interfaces but no luck. Setup configurations: - oVirt Engine and Node running on different machines - OVirt running on cent OS Please help me to resolve this issue, thanks in advance.

1 0

VM is reachable only from oVirt node
by sweettriplek＠gmail.com 14 Jun '18

14 Jun '18

VM running with centos is not reaching to any other network other than oVirt node. I tried to apply no network filer, clean-filter while creating vNIC interfaces but no luck. Setup configurations: - oVirt Engine and Node running on different machines - OVirt running on cent OS Please help me to resolve this issue, thanks in advance.

1 0

Hosted engine cannot migrate
by Callum Smith 14 Jun '18

14 Jun '18

Dear All, Getting an issue where the HE can't b migrated, the log is full of: "VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: Lease is held by another host." engine.log attached Regards, Callum -- Callum Smith Research Computing Core Wellcome Trust Centre for Human Genetics University of Oxford e. callum(a)well.ox.ac.uk<mailto:callum@well.ox.ac.uk>

2 6

VM hanging at boot - [drm] Initialized qxl
by Leo David 14 Jun '18

14 Jun '18

Hello everyone, I have some Centos7 vms created from template ( CentOS 7 Generic Cloud Image v1802 for x86_64 ) I have alocated planty of resources to them, but they all have this issue when starting, they hang with the following message in console about 5-7 minutes. [drm] Initialized qxl 0.1.0 20120117 for 0000:00:02:0 on mirror 0 After a while, vm eventually boots up... Running self-hosted ovirt-node 4.2 Does anyone know what could be the issue for this behavior ? Thank you ! -- Best regards, Leo David

1 1

Question re: MaxFreeMemoryforOverUtlized and MinFreeMemoryforUnderUtilized
by Alastair Neil 14 Jun '18

14 Jun '18

Can someone clarify these setting for me, I am having difficulty parsing what exactly they mean. They seem to me to be backwards. If I wish to set a threshold at which I want my host to be consider over utilized, not schedule any new VMs, and migrate VMs away, then surely I should specify a minimum threshold of free memory. I.E. if free memory drops below my threshold (OR memory use exceed a maximum threshold) migrate VM's off of this system. Conversely if a system is underutilized I should set a maximum threshold of free memory (Or minimum used memory). Thanks, --Alastair

2 3

Centos7.5 or Ovirt node for new hci build?
by Jayme 13 Jun '18

13 Jun '18

I'm about to build a 3 host Ovirt hyperconverged cluster and was wondering if it's recommended to use straight up Centos or would Ovirt node be a better choice? Thanks

2 1

trouble with hosted-engine vm.conf after upgrade to 4.2
by Reznikov Alexei 13 Jun '18

13 Jun '18

Hi list! I upgrade my ovirt test lab from 4.1.9 to 4.2.2, and i have trouble with the hosted-engine... I can not start the hosted engine with my vm.conf... /hosted-engine --vm-start --vm-conf=/root/vm.conf/ /Command VM.getStats with args {'vmID': 'a19b9120-4f87-4a04-8cb6-c3e192a98052'} failed:// //(code=1, message=Virtual machine does not exist: {'vmId': u'a19b9120-4f87-4a04-8cb6-c3e192a98052'})// / VM HE start is Ok, but without my parameter, i change emulated_machine to *pc-i440fx-rhel7.5.0* in my vm.conf, but i see this: /ps ax | grep Hosted/ /...../ /r-key.aes -machine //*pc-i440fx-rhel7.3.0*//,accel=kvm,usb=off,dump-guest-core=off -cpu Nehalem -m size=2097152k,slots=16,maxmem=8388608k -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,/ /...../ My ovirt packages: vdsm-4.20.30-1.el7.x86_64 libvirt-3.9.0-14.el7_5.5.x86_64 qemu-kvm-ev-2.10.0-21.el7_5.3.1.x86_64 Centos 7.5.1804 This is critical for me, please help fix this! Thanks, Alex. //

1 0

Failed to update VMs/Templates OVF data
by Albl, Oliver 13 Jun '18

13 Jun '18

Hi, I have a FC storage domain reporting the following messages every hour: VDSM command SetVolumeDescriptionVDS failed: Could not acquire resource. Probably resource factory threw an exception.: () Failed to update OVF disks cb04b55c-10fb-46fe-b9de-3c133a94e6a5, OVF data isn't updated on those OVF stores (Data Center VMTEST, Storage Domain VMHOST_LUN_62). Failed to update VMs/Templates OVF data for Storage Domain VMHOST_LUN_62 in Data Center VMTEST. Trying to manually update OVF results in "Error while executing action UpdateOvfStoreForStorageDomain: Internal Engine Error" I run oVirt 4.2.3.5-1.el7.centos on CentOS 7.5 (3.10.0-862.3.2.el7.x86_64) with vdsm-4.20.27.1-1.el7.centos.x86_64 Engine log: 2018-06-13 12:15:35,649+02 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (default task-12) [092d8f27-c0a4-4d78-a8cb-f4738aff71e6] The message key 'UpdateOvfStoreForStorageDomain' is missing from 'bundles/ExecutionMessages' 2018-06-13 12:15:35,655+02 INFO [org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default task-12) [092d8f27-c0a4-4d78-a8cb-f4738aff71e6] Lock Acquired to object 'EngineLock:{exclusiveLocks='[3edb5295-3797-4cd0-9b43-f46ec1ee7b14=OVF_UPDATE, 373efd46-8aea-4d0e-96cc-1da0debf72d0=STORAGE]', sharedLocks=''}' 2018-06-13 12:15:35,660+02 INFO [org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default task-12) [092d8f27-c0a4-4d78-a8cb-f4738aff71e6] Running command: UpdateOvfStoreForStorageDomainCommand internal: false. Entities affected : ID: 373efd46-8aea-4d0e-96cc-1da0debf72d0 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2018-06-13 12:15:35,670+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 3edb5295-3797-4cd0-9b43-f46ec1ee7b14 Type: StoragePool 2018-06-13 12:15:35,674+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Attempting to update VM OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,678+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Successfully updated VM OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,678+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Attempting to update template OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,678+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Successfully updated templates OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,678+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Attempting to remove unneeded template/vm OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,680+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Successfully removed unneeded template/vm OVFs in Data Center 'VMTEST' 2018-06-13 12:15:35,684+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (default task-12) [4fd5b59a] Lock freed to object 'EngineLock:{exclusiveLocks='[3edb5295-3797-4cd0-9b43-f46ec1ee7b14=OVF_UPDATE, 373efd46-8aea-4d0e-96cc-1da0debf72d0=STORAGE]', sharedLocks=''}' 2018-06-13 12:15:35,704+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (default task-12) [24485c23] Lock Acquired to object 'EngineLock:{exclusiveLocks='[]', sharedLocks='[3edb5295-3797-4cd0-9b43-f46ec1ee7b14=OVF_UPDATE]'}' 2018-06-13 12:15:35,714+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (default task-12) [24485c23] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 373efd46-8aea-4d0e-96cc-1da0debf72d0 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] START, SetVolumeDescriptionVDSCommand( SetVolumeDescriptionVDSCommandParameters:{storagePoolId='3edb5295-3797-4cd0-9b43-f46ec1ee7b14', ignoreFailoverLimit='false', storageDomainId='373efd46-8aea-4d0e-96cc-1da0debf72d0', imageGroupId='cb04b55c-10fb-46fe-b9de-3c133a94e6a5', imageId='a1e7554d-530c-4c07-a4b5-459a1c509e39'}), log id: 747d674f 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] -- executeIrsBrokerCommand: calling 'setVolumeDescription', parameters: 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] ++ spUUID=3edb5295-3797-4cd0-9b43-f46ec1ee7b14 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] ++ sdUUID=373efd46-8aea-4d0e-96cc-1da0debf72d0 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] ++ imageGroupGUID=cb04b55c-10fb-46fe-b9de-3c133a94e6a5 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] ++ volUUID=a1e7554d-530c-4c07-a4b5-459a1c509e39 2018-06-13 12:15:35,724+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] ++ description={"Updated":false,"Last Updated":"Thu May 24 12:02:22 CEST 2018","Storage Domains":[{"uuid":"373efd46-8aea-4d0e-96cc-1da0debf72d0"}],"Disk Description":"OVF_STORE"} 2018-06-13 12:15:35,827+02 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] Failed in 'SetVolumeDescriptionVDS' method 2018-06-13 12:15:35,831+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-12) [24485c23] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command SetVolumeDescriptionVDS failed: Could not acquire resource. Probably resource factory threw an exception.: () 2018-06-13 12:15:35,831+02 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] Command 'SetVolumeDescriptionVDSCommand( SetVolumeDescriptionVDSCommandParameters:{storagePoolId='3edb5295-3797-4cd0-9b43-f46ec1ee7b14', ignoreFailoverLimit='false', storageDomainId='373efd46-8aea-4d0e-96cc-1da0debf72d0', imageGroupId='cb04b55c-10fb-46fe-b9de-3c133a94e6a5', imageId='a1e7554d-530c-4c07-a4b5-459a1c509e39'})' execution failed: IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 855 2018-06-13 12:15:35,831+02 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (default task-12) [24485c23] FINISH, SetVolumeDescriptionVDSCommand, log id: 747d674f 2018-06-13 12:15:35,831+02 WARN [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (default task-12) [24485c23] failed to update domain '373efd46-8aea-4d0e-96cc-1da0debf72d0' ovf store disk 'cb04b55c-10fb-46fe-b9de-3c133a94e6a5' 2018-06-13 12:15:35,834+02 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-12) [24485c23] EVENT_ID: UPDATE_FOR_OVF_STORES_FAILED(1,016), Failed to update OVF disks cb04b55c-10fb-46fe-b9de-3c133a94e6a5, OVF data isn't updated on those OVF stores (Data Center VMTEST, Storage Domain HOST_LUN_62). 2018-06-13 12:15:35,843+02 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-12) [24485c23] EVENT_ID: UPDATE_OVF_FOR_STORAGE_DOMAIN_FAILED(190), Failed to update VMs/Templates OVF data for Storage Domain VMHOST_LUN_62 in Data Center VMTEST. 2018-06-13 12:15:35,846+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (default task-12) [24485c23] Lock freed to object 'EngineLock:{exclusiveLocks='[]', sharedLocks='[3edb5295-3797-4cd0-9b43-f46ec1ee7b14=OVF_UPDATE]'}' 2018-06-13 12:15:36,031+02 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-60) [24485c23] Command 'ProcessOvfUpdateForStorageDomain' id: 'a887910e-39a1-4120-a29b-76741ade8bf6' child commands '[]' executions were completed, status 'SUCCEEDED' 2018-06-13 12:15:37,052+02 INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-31) [24485c23] Ending command 'org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand' successfully. 2018-06-13 12:15:37,059+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-31) [24485c23] EVENT_ID: USER_UPDATE_OVF_STORE(199), OVF_STORE for domain VMHOST_LUN_62 was updated by <user>@>domain>@<DOMAIN>-authz. vdsm.log 2018-06-13 12:15:35,727+0200 INFO (jsonrpc/7) [vdsm.api] START setVolumeDescription(sdUUID=u'373efd46-8aea-4d0e-96cc-1da0debf72d0', spUUID=u'3edb5295-3797-4cd0-9b43-f46ec1ee7b14', imgUUID=u'cb04b55c-10fb-46fe-b9de-3c133a94e6a5', volUU ID=u'a1e7554d-530c-4c07-a4b5-459a1c509e39', description=u'{"Updated":false,"Last Updated":"Thu May 24 12:02:22 CEST 2018","Storage Domains":[{"uuid":"373efd46-8aea-4d0e-96cc-1da0debf72d0"}],"Disk Description":"OVF_STORE"}', options=Non e) from=::ffff:<IP>,54686, flow_id=24485c23, task_id=70941873-0296-4ed0-94c8-b51290cd6963 (api:46) 2018-06-13 12:15:35,825+0200 WARN (jsonrpc/7) [storage.ResourceManager] Resource factory failed to create resource '01_img_373efd46-8aea-4d0e-96cc-1da0debf72d0.cb04b55c-10fb-46fe-b9de-3c133a94e6a5'. Canceling request. (resourceManager :543) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceManager.py", line 539, in registerResource obj = namespaceObj.factory.createResource(name, lockType) File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceFactories.py", line 193, in createResource lockType) File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceFactories.py", line 122, in __getResourceCandidatesList imgUUID=resourceName) File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 206, in getChain if len(uuidlist) == 1 and srcVol.isShared(): File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 1434, in isShared return self._manifest.isShared() File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 141, in isShared return self.getVolType() == sc.type2name(sc.SHARED_VOL) File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 134, in getVolType self.voltype = self.getMetaParam(sc.VOLTYPE) File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 118, in getMetaParam meta = self.getMetadata() File "/usr/lib/python2.7/site-packages/vdsm/storage/blockVolume.py", line 112, in getMetadata md = VolumeMetadata.from_lines(lines) File "/usr/lib/python2.7/site-packages/vdsm/storage/volumemetadata.py", line 103, in from_lines "Missing metadata key: %s: found: %s" % (e, md)) MetaDataKeyNotFoundError: Meta Data key not found error: ("Missing metadata key: 'DOMAIN': found: {}",) 2018-06-13 12:15:35,825+0200 WARN (jsonrpc/7) [storage.ResourceManager.Request] (ResName='01_img_373efd46-8aea-4d0e-96cc-1da0debf72d0.cb04b55c-10fb-46fe-b9de-3c133a94e6a5', ReqID='dc9ebbc2-5cfa-447d-b2be-40ed2cf81992') Tried to cancel a processed request (resourceManager:187) 2018-06-13 12:15:35,825+0200 INFO (jsonrpc/7) [vdsm.api] FINISH setVolumeDescription error=Could not acquire resource. Probably resource factory threw an exception.: () from=::ffff:<IP>,54686, flow_id=24485c23, task_id=70941873 -0296-4ed0-94c8-b51290cd6963 (api:50) 2018-06-13 12:15:35,825+0200 ERROR (jsonrpc/7) [storage.TaskManager.Task] (Task='70941873-0296-4ed0-94c8-b51290cd6963') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in setVolumeDescription File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1294, in setVolumeDescription pool.setVolumeDescription(sdUUID, imgUUID, volUUID, description) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 2011, in setVolumeDescription with rm.acquireResource(img_ns, imgUUID, rm.EXCLUSIVE): File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceManager.py", line 1025, in acquireResource return _manager.acquireResource(namespace, name, lockType, timeout=timeout) File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceManager.py", line 475, in acquireResource raise se.ResourceAcqusitionFailed() ResourceAcqusitionFailed: Could not acquire resource. Probably resource factory threw an exception.: () 2018-06-13 12:15:35,826+0200 INFO (jsonrpc/7) [storage.TaskManager.Task] (Task='70941873-0296-4ed0-94c8-b51290cd6963') aborting: Task is aborted: u'Could not acquire resource. Probably resource factory threw an exception.: ()' - code 100 (task:1181) 2018-06-13 12:15:35,826+0200 ERROR (jsonrpc/7) [storage.Dispatcher] FINISH setVolumeDescription error=Could not acquire resource. Probably resource factory threw an exception.: () (dispatcher:82) 2018-06-13 12:15:35,826+0200 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Volume.setDescription failed (error 855) in 0.10 seconds (__init__:573) 2018-06-13 12:15:38,953+0200 INFO (jsonrpc/5) [api.host] START getAllVmStats() from=::ffff:<IP>,54666 (api:46) 2018-06-13 12:15:38,956+0200 INFO (jsonrpc/5) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::ffff:<IP>,54666 (api:52) 2018-06-13 12:15:38,957+0200 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:573) 2018-06-13 12:15:39,406+0200 INFO (jsonrpc/4) [vdsm.api] START getSpmStatus(spUUID=u'3edb5295-3797-4cd0-9b43-f46ec1ee7b14', options=None) from=::ffff:<IP>,54666, task_id=eabfe183-dfb0-4982-b7ea-beacca74aeef (api:46) 2018-06-13 12:15:39,410+0200 INFO (jsonrpc/4) [vdsm.api] FINISH getSpmStatus return={'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 20L}} from=::ffff:<IP>,54666, task_id=eabfe183-dfb0-4982-b7ea-beacca74aeef (api:52) 2018-06-13 12:15:39,410+0200 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.01 seconds (__init__:573) 2018-06-13 12:15:39,416+0200 INFO (jsonrpc/1) [vdsm.api] START getStoragePoolInfo(spUUID=u'3edb5295-3797-4cd0-9b43-f46ec1ee7b14', options=None) from=::ffff:<IP>,54686, task_id=b2003a6f-dd74-47ab-b4f0-95ffb54dc51d (api:46) 2018-06-13 12:15:39,420+0200 INFO (jsonrpc/1) [vdsm.api] FINISH getStoragePoolInfo return={'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 20L, 'domains': u'373efd46-8aea-4d0e-96cc-1da0debf72d0: Active,9ed4b0d2-c555-4b27-8f88-75c47a99ad98:Attached,efd78d36-c395-4e9a-a46e-6059fa53756d:Active,3675435e-851e-4236-81da-fce1cc027238:Active', 'master_uuid': 'efd78d36-c395-4e9a-a46e-6059fa53756d', 'version': '4', 'spm_id': 2, 'type': 'FCP', 'master_ver': 12}, 'dominfo': {u'373efd46-8aea-4d0e-96cc-1da0debf72d0': {'status': u'Active', 'diskfree': '8722541707264', 'isoprefix': '', 'alerts': [], 'disktotal': '8795690369024', 'version': 4}, u'9ed4b0d2-c555-4b27-8f88-75c 47a99ad98': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'efd78d36-c395-4e9a-a46e-6059fa53756d': {'status': u'Active', 'diskfree': '8718783610880', 'isoprefix': '', 'alerts': [], 'disktotal': '8795690369024', 'version': 4}, u'3675435e-851e-4236-81da-fce1cc027238': {'status': u'Active', 'diskfree': '8713280684032', 'isoprefix': '', 'alerts': [], 'disktotal': '8795690369024', 'version': 4}}} from=::ffff:<IP>,54686, task_id=b2003a6f-dd74-47ab-b4f0-95 ffb54dc51d (api:52) 2018-06-13 12:15:39,421+0200 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.01 seconds (__init__:573) All the best, Oliver

1 0

Useless disk statistics API
by Hari Prasanth Loganathan 13 Jun '18

13 Jun '18

Hi Team, I use the following API to get the disk statistics as per the oVirt rest API documentation. http://ovirt.github.io/ovirt-engine-api-model/4.2/#types/disk/links/statist… https://172.30.X.X/ovirt-engine/api/disks/f78c8adf-23f9-4f52-a29b-0de3d8446… { "statistic": [ { "kind": "gauge", "type": "decimal", "unit": "bytes_per_second", "values": { "value": [ { "datum": 0 } ] }, "disk": { "href": "/ovirt-engine/api/disks/f78c8adf-23f9-4f52-a29b-0de3d844652e", "id": "f78c8adf-23f9-4f52-a29b-0de3d844652e" }, "name": "data.current.read", "description": "Read data rate", "href": "/ovirt-engine/api/disks/f78c8adf-23f9-4f52-a29b-0de3d844652e/statistics/33b9212b-f9cb-3fd0-b364-248fb61e1272", "id": "33b9212b-f9cb-3fd0-b364-248fb61e1272" }, { "kind": "gauge", "type": "decimal", "unit": "bytes_per_second", "values": { "value": [ { "datum": 0 } ] }, "disk": { "href": "/ovirt-engine/api/disks/f78c8adf-23f9-4f52-a29b-0de3d844652e", "id": "f78c8adf-23f9-4f52-a29b-0de3d844652e" }, "name": "data.current.write", "description": "Write data rate", "href": "/ovirt-engine/api/disks/f78c8adf-23f9-4f52-a29b-0de3d844652e/statistics/2f23addd-4ebd-3d82-a449-c28778bc33eb", "id": "2f23addd-4ebd-3d82-a449-c28778bc33eb" } ] } Unfortunately, the values are always coming as '0'. *Steps to reproduce :* 1) I logged into the VM console and run the following command to copy the file and I see the write rate is 300mb/sec dd if=/dev/zero of=/dev/null 2) During this time, I am trying to execute this API and receiving as 0 always. Is this API useless? Thanks, Hari

2 9

ovirt error
by Арслан 13 Jun '18

13 Jun '18

hello. when executing the command traceback: |# hosted-engine --vm-status|| ||Traceback (most recent call last):|| || File "/usr/lib64/python2.6/runpy.py", line 122, in _run_module_as_main|| || "__main__", fname, loader, pkg_name)|| || File "/usr/lib64/python2.6/runpy.py", line 34, in _run_code|| || exec code in run_globals|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py", line 116, in <module>|| || if not status_checker.print_status():|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py", line 59, in print_status|| || all_host_stats = ha_cli.get_all_host_stats()|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 157, in get_all_host_stats|| || return self.get_all_stats(self.StatModes.HOST)|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats|| || stats = broker.get_stats_from_storage(service)|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 232, in get_stats_from_storage|| || result = self._checked_communicate(request)|| || File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 260, in _checked_communicate|| || .format(message or response))|| ||ovirt_hosted_engine_ha.lib.exceptions.RequestError: Request failed: <type 'exceptions.OSError'> what is the reason? | -- С уважением, Кубанов Арслан Инженер Департамент сетевой интеграции ЛАНИТ 129075, г. Москва, Мурманский проезд, д. 14, корп. 1 Тел.: +7 (495) 967-6650 #18287 www.lanit.ru

2 5

FC Storage
by Carlos Cesario 12 Jun '18

12 Jun '18

Hi Folks, Could someone could suggest me what is the best way to usage FC Storage with oVirt ? Is there any wayt to create DataStorage like "VMware" with Luns? Or need I usage the LUNS as VM disks!? Sorry by compare with VMware, but cyurrently Im using VMware and planning to move to oVirt solution. Regards Carlos __

4 6

Unable to create new cluster
by Michael Watters 12 Jun '18

12 Jun '18

After upgrading my engine to the 4.2 release I'm receiving an uncaught exception error when I attempt to create a new cluster. Uncaught exception occurred. Please try reloading the page. Details: (TypeError) : Cannot read property 'b' of null Please have your administrator check the UI logs The UI logs show the following error: 2018-06-12 11:52:32,706-04 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Permutation name: AEA766696E550914FBFDA5936BC98453 2018-06-12 11:52:32,707-04 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-23) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : Cannot read property 'b' of null at org.ovirt.engine.ui.uicommonweb.Linq$ServerCpuPredicate.$test(Linq.java:139) at org.ovirt.engine.ui.uicommonweb.Linq$ServerCpuPredicate.test(Linq.java:139) at java.util.stream.Stream$FilterSpliterator.$lambda$0(Stream.java:632) [:1.8.0_171] at java.util.stream.Stream$FilterSpliterator$lambda$0$Type.accept(Stream.java:632) [:1.8.0_171] at java.util.Spliterators$IteratorSpliterator.$tryAdvance(Spliterators.java:459) [rt.jar:1.8.0_171] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:459) [rt.jar:1.8.0_171] at java.util.stream.Stream$FilterSpliterator.tryAdvance(Stream.java:628) [:1.8.0_171] at java.util.stream.Stream$StreamSource.$findFirst(Stream.java:799) [:1.8.0_171] at org.ovirt.engine.ui.uicommonweb.Linq.firstOrNull(Linq.java:75) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterModel.$populateCPUList(ClusterModel.java:1895) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterModel.$lambda$19(ClusterModel.java:1733) at org.ovirt.engine.ui.uicommonweb.models.clusters.ClusterModel$lambda$19$Type.onSuccess(ClusterModel.java:1733) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) [gwt-servlet.jar:] at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) [gwt-servlet.jar:] at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) [gwt-servlet.jar:] at Unknown.eval(webadmin-0.js) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.eval(webadmin-0.js) Is there a way to resolve this or should I create a bug report?

2 2

Single node single node SelfHosted Hyperconverged
by Leo David 12 Jun '18

12 Jun '18

Hello everyone, Geetign stucked into this situation, and just wanted to know if it actually b done, or should I follow diffrent approach. I need to do this single instace deployment for a POC, with the evantual scale this setup up to 3 nodes in the future. I folowed this tuturial: https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Single_node… But when i run gdeploy, i end up with this error: TASK [Run a shell script] ********************************************************************************************************************************************** failed: [10.10.8.101] (item=/usr/share/gdeploy/scripts/blacklist_all_disks.sh) => {"changed": true, "failed_when_result": true, "item": "/usr/share/gdeploy/scripts/blacklist_all_disks.sh", "msg": "non-zero return code", "rc": 1, "stderr": "Shared connection to 10.10.8.101 closed.\r\n", "stdout": "iscsiadm: No active sessions.\r\nThis script will prevent listing iscsi devices when multipath CLI is called\r\nwithout parameters, and so no LUNs will be discovered by applications like VDSM\r\n(oVirt, RHV) which shell-out to call `/usr/sbin/multipath` after target login\r\nJun 12 14:30:48 | 3614187705c01820022b002b00c52f72e2: map in use\r\nJun 12 14:30:48 | failed to remove multipath map 3614187705c01820022b002b00c52f72e\r\n", "stdout_lines": ["iscsiadm: No active sessions.", "This script will prevent listing iscsi devices when multipath CLI is called", "without parameters, and so no LUNs will be discovered by applications like VDSM", "(oVirt, RHV) which shell-out to call `/usr/sbin/multipath` after target login", "Jun 12 14:30:48 | 3614187705c01820022b002b00c52f72e2: map in use", "Jun 12 14:30:48 | failed to remove multipath map 3614187705c01820022b002b00c52f72e"]} to retry, use: --limit @/tmp/tmpbYZBC6/run-script.retry PLAY RECAP ************************************************************************************************************************************************************* 10.10.8.101 : ok=0 changed=0 unreachable=0 failed=1 This is my gdeploy.conf : [hosts] 10.10.8.101 [script1] action=execute ignore_script_errors=no file=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 10.10.8.111 [disktype] jbod [diskcount] 12 [stripesize] 256 [service1] action=enable service=chronyd [service2] action=restart service=chronyd [shell2] action=execute command=vdsm-tool configure --force [script3] action=execute file=/usr/share/gdeploy/scripts/blacklist_all_disks.sh ignore_script_errors=no [pv] action=create devices=sdb ignore_pv_errors=no [vg1] action=create vgname=gluster_vg_sdb pvname=sdb ignore_vg_errors=no [lv1] action=create poolname=gluster_thinpool_sdb ignore_lv_errors=no vgname=gluster_vg_sdb lvtype=thinpool size=804GB poolmetadatasize=4GB [lv2] action=create lvname=gluster_lv_engine ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/engine size=100GB lvtype=thick [lv3] action=create lvname=gluster_lv_data ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/data lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=400GB [lv4] action=create lvname=gluster_lv_vmstore ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/vmstore lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=400GB [selinux] yes [service3] action=restart service=glusterd slice_setup=yes [firewalld] action=add ports=111/tcp,2049/tcp,54321/tcp,5900/tcp,5900-6923/tcp,5666/tcp,16514/tcp,54322/tcp services=glusterfs [script2] action=execute file=/usr/share/gdeploy/scripts/disable-gluster-hooks.sh [shell3] action=execute command=usermod -a -G gluster qemu [volume1] action=create volname=engine transport=tcp key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable #brick_dirs=10.10.8.111:/gluster_bricks/engine/engine brick_dirs=/gluster_bricks/engine/engine ignore_volume_errors=no [volume2] action=create volname=data transport=tcp key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable #brick_dirs=10.10.8.111:/gluster_bricks/data/data brick_dirs=/gluster_bricks/data/data ignore_volume_errors=no [volume3] action=create volname=vmstore transport=tcp key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable #brick_dirs=10.10.8.111:/gluster_bricks/vmstore/vmstore brick_dirs=/gluster_bricks/vmstore/vmstore ignore_volume_errors=no Any thoughs on this ? Scratching my head in getting this sorted out.... Thank you very much ! Have a nice day ! -- Best regards, Leo David

2 4

UEFI
by Conrad Jones 12 Jun '18

12 Jun '18

Does ovirt support UEFI yet ? I saw some code reviews in gerrit. But I couldn't find it in my 4.23 install. I'm guessing it's not finished / released yet ?

3 3

Unable to authenticate using AD accounts
by Michael Watters 12 Jun '18

12 Jun '18

I am having an issue getting users to authenticate using the Active Directory backend. I've installed the ovirt-engine-extension-aaa-ldap-setup package and ran ovirt-engine-extension-aaa-ldap-setup to configure everything however users are unable to authenticate. Testing using my own account results in a "credentials incorrect" error as shown below. 2018-06-12 14:16:55,700-04 INFO End of enabled extensions list 2018-06-12 14:16:55,700-04 INFO ======================================================================== 2018-06-12 14:16:55,701-04 INFO ============================== Execution =============================== 2018-06-12 14:16:55,701-04 INFO ======================================================================== 2018-06-12 14:16:55,702-04 INFO Iteration: 0 2018-06-12 14:16:55,704-04 INFO Profile='dartcontainer.com' authn='dartcontainer.com-authn' authz='dartcontainer.com-authz' mapping='null' 2018-06-12 14:16:55,705-04 INFO API: -->Authn.InvokeCommands.AUTHENTICATE_CREDENTIALS profile='dartcontainer.com' user='d861703' 2018-06-12 14:16:55,869-04 INFO API: <--Authn.InvokeCommands.AUTHENTICATE_CREDENTIALS profile='dartcontainer.com' result=CREDENTIALS_INCORRECT 2018-06-12 14:16:55,879-04 SEVERE Authn.Result code is: CREDENTIALS_INCORRECT Is there a way to enable more verbose logging or is there an alternative to using LDAP such as keycloak integration?

1 0

Grubx64.efi missing from boot partition
by Hanson Turner 12 Jun '18

12 Jun '18

Hi Guys, We went to physically move a node and have found the node will not boot successfully anymore. The error coming up is :failed to open/ file not found: \EFI\BOOT\grubx64.efi This file is found in \EFI\centos\grubx64.efi. I have copied it to \EFI\BOOT\ and got the machine to boot, however, it has no working networking. Modifying /etc/sysconfig/ifcfg-xyzabz123 appropriately restored networking, however, the node is not able to be resumed/activated. This is probably because the blade reports the following interfaces: eno1, eno2, eno3, eno4 When originally deployed, they were eno1,eno2, eth0, eth1. The engine still sees the host as having the eno+eth combo. Any ideas guys? Thanks!

1 0

LDAP Authentication issues
by Callum Smith 12 Jun '18

12 Jun '18

Dear All, I'm having problems getting LDAP running, login works, but I'm getting "user is not authorised to perform login" - this is even if i specify the UserRole specifically to the LDAP group the user is in. 2018-05-25 08:56:16,212+01 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-23) [] User callum@Biomedical Research Computing successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-05-25 08:56:16,391+01 INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-25) [63e60fe9] Running command: CreateUserSessionCommand internal: false. 2018-05-25 08:56:16,430+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-25) [63e60fe9] EVENT_ID: USER_VDC_LOGIN_FAILED(114), User callum@Biomedical Research Computing connecting from '192.168.65.254' failed to log in<UNKNOWN>. 2018-05-25 08:56:16,430+01 ERROR [org.ovirt.engine.core.aaa.servlet.SsoPostLoginServlet] (default task-25) [] The user callum@Biomedical Research Computing is not authorized to perform login on a side note: is it possible to assign permissions to all members of an LDAP tree where they dont have a common group membership? Regards, Callum -- Callum Smith Research Computing Core Wellcome Trust Centre for Human Genetics University of Oxford e. callum(a)well.ox.ac.uk<mailto:callum@well.ox.ac.uk>

4 23

Unable to upgrade
by Michael Watters 12 Jun '18

12 Jun '18

I am attempting to upgrade from ovirt-engine 4.1 to 4.2 however yum updates are failing due to dependency conflicts. [root@ovirt-engine yum.repos.d]# yum update "ovirt-*-setup*" Loaded plugins: fastestmirror, versionlock Loading mirror speeds from cached hostfile * ovirt-4.2: mirrors.rit.edu * ovirt-4.2-epel: mirror.steadfast.net sac-gdeploy | 3.0 kB 00:00:00 Resolving Dependencies Error: ovirt-engine-setup-plugin-ovirt-engine conflicts with ovirt-engine-4.1.1.8-1.el7.centos.noarch Is there a way to resolve this? I'm using the instructions located at https://www.ovirt.org/release/4.2.1/#install--upgrade-from-previous-versions

2 1

Re: oVirt Metrics
by Karli Sjöberg 12 Jun '18

12 Jun '18

1 0

Re: oVirt Metrics
by Karli Sjöberg 12 Jun '18

12 Jun '18

3 3

engine-setup fails to upgrade postgresql
by Michael Watters 12 Jun '18

12 Jun '18

After installing the ovirt 4.2 repository and running engine-setup the upgrade script fails with an error as shown below. [ ERROR ] Postgresql client version is '9.5.9', whereas the version on 'localhost' is '9.2.23'. Please use a PostgreSQL server of version '9.5.9'. Please note the following required changes in postgresql.conf on 'localhost': postgresql.conf is usually in /var/lib/pgsql/data, /var/opt/rh/rh-postgresql95/lib/pgsql/data, or somewhere under /etc/postgresql* . You have to restart PostgreSQL after making these changes. Engine database host []: The setup script is supposed to take care of this automatically however it fails before even attempting to upgrade postgres. Does anybody know how to work around this?

3 3

Re: oVirt Metrics
by Karli Sjöberg 11 Jun '18

11 Jun '18

2 1

Hosted Engine w Gluster - increase number of hosts
by ovirt＠fateknollogee.com 11 Jun '18

11 Jun '18

Using this as reference: https://www.ovirt.org/blog/2018/02/up-and-running-with-ovirt-4-2-and-gluste… Assuming you want to increase the number of hosts from 3 to 5 or 9. How do you add more hosts? What is best practice & any gotcha's?

7 15

gdeploy hosted engine failed but host says it is up what now?
by william.dossett＠gmail.com 11 Jun '18

11 Jun '18

Hi, Ovirt 4.2.3 I gdeplyed deployed glusterfs which seems to have gone well and then on to the hosted engine... which seemed to be going well, but then the ovirt engine did not come online... [ INFO ] TASK [Wait for the engine to come up on the target VM] [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120, "changed": true, "cmd": ["hosted-engine", "--vm-status", "--json"], "delta": "0:00:00.225200", "end": "2018-06-09 15:15:24.434531", "rc": 0, "start": "2018-06-09 15:15:24.209331", "stderr": "", "stderr_lines": [], "stdout": "{\"1\": {\"conf_on_shared_storage\": true, \"live-data\": true, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=17346 (Sat Jun 9 15:15:19 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=17346 (Sat Jun 9 15:15:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\", \"hostname\": \"usbou-rhev01.pbi.global.pvt\", \"host-id\": 1, \"engine-status\": {\"reason\": \"failed liveliness check\", \"health\": \"bad\", \"vm\": \"up\", \"detail\": \"Up\"}, \"score\": 3400, \"stopped\": false, \"maintenance\": false, \"crc32\": \"e3c31ac3\", \"local_conf_timestamp\": 17346, \"host-ts\": 17346}, \"global_maintenance\": false}", "stdout_lines": ["{\"1\": {\"conf_on_shared_storage\": true, \"live-data\": true, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=17346 (Sat Jun 9 15:15:19 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=17346 (Sat Jun 9 15:15:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStarting\\nstopped=False\\n\", \"hostname\": \"usbou-rhev01.pbi.global.pvt\", \"host-id\": 1, \"engine-status\": {\"reason\": \"failed liveliness check\", \"health\": \"bad\", \"vm\": \"up\", \"detail\": \"Up\"}, \"score\": 3400, \"stopped\": false, \"maintenance\": false, \"crc32\": \"e3c31ac3\", \"local_conf_timestamp\": 17346, \"host-ts\": 17346}, \"global_maintenance\": false}"]} When I look at the host now it says Hosted Engine is running on the host, Hosted engine is up, but I can not ping it, ssh to it or open the console on the VM. I am pretty new to this setup so would appreciate any steps I can take to move this forward. Thanks Bill

3 6