2017-02-12 10:23:26,031Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [31cd5fce] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:24:19,328Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 10:24:19,329Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6f99ed33 2017-02-12 10:24:20,369Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 6f99ed33 2017-02-12 10:24:20,369Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:25:19,549Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler9) [27e14346] Attempting to update VMs/Templates Ovf. 2017-02-12 10:25:19,552Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 10:25:19,552Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 10:25:19,553Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 10:25:19,559Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 10:25:19,564Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 10:25:19,564Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 10:25:19,564Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 10:25:19,564Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 10:25:19,565Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 10:25:19,566Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [277235f8] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 10:28:26,353Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [31cd5fce] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:30:24,600Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-1) [6e426cc7] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 20cd65c9 2017-02-12 10:30:25,669Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-1) [6e426cc7] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 20cd65c9 2017-02-12 10:30:25,678Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-1) [6e426cc7] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 10:33:26,671Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:36:55,494Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 10:36:55,495Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 120eef6b 2017-02-12 10:36:56,171Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 120eef6b 2017-02-12 10:36:56,171Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:38:26,988Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:39:18,537Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [277235f8] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 10:39:18,538Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [277235f8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:39:18,544Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [277235f8] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 5799c526 2017-02-12 10:39:18,579Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [277235f8] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@238665d4, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4541553920, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 5799c526 2017-02-12 10:39:18,582Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [277235f8] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 10:39:18,583Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [277235f8] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 10:39:18,583Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [277235f8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 10:39:19,731Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 10:39:19,733Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2a1105df 2017-02-12 10:39:20,017Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 2a1105df 2017-02-12 10:39:20,017Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 10:39:20,164Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-9) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 10:39:20,182Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-17) [e30447c] Running command: ProcessDownVmCommand internal: true. 2017-02-12 10:39:28,967Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [31cd5fce] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 10:39:28,986Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [31cd5fce] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6e2a63e3 2017-02-12 10:39:29,044Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [31cd5fce] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@5de9195b, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4637264540, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 6e2a63e3 2017-02-12 10:39:29,046Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [31cd5fce] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 10:39:29,047Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [31cd5fce] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 10:39:33,634Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [799858bf] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 10:43:27,137Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [687b471d] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:44:14,134Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 10:44:14,135Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6e80bbd5 2017-02-12 10:44:14,892Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 6e80bbd5 2017-02-12 10:44:14,892Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:48:27,418Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [31cd5fce] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:49:09,589Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 10:49:09,591Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 122b2109 2017-02-12 10:49:10,793Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 122b2109 2017-02-12 10:49:10,794Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:53:27,733Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [49838e8b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 10:55:55,229Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 10:55:55,231Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 426296db 2017-02-12 10:55:55,541Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 426296db 2017-02-12 10:55:55,541Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 10:58:27,871Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [31cd5fce] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:03:28,019Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [31cd5fce] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:03:34,641Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 11:03:34,642Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2571ff8d 2017-02-12 11:03:35,053Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 2571ff8d 2017-02-12 11:03:35,053Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:08:28,152Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [49838e8b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:08:28,761Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 11:08:28,763Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 21b8f734 2017-02-12 11:08:29,248Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 21b8f734 2017-02-12 11:08:29,248Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:08:30,966Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 11:08:30,967Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 10580e60 2017-02-12 11:08:31,937Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 10580e60 2017-02-12 11:08:31,938Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:08:35,241Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 11:08:35,242Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 197668ca 2017-02-12 11:08:35,775Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 197668ca 2017-02-12 11:08:35,775Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:13:28,468Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:18:28,787Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [687b471d] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:22:25,613Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 11:22:25,614Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7976e736 2017-02-12 11:22:25,930Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 7976e736 2017-02-12 11:22:25,930Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:23:29,103Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:25:19,568Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler8) [31cd5fce] Attempting to update VMs/Templates Ovf. 2017-02-12 11:25:19,574Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 11:25:19,574Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 11:25:19,576Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 11:25:19,588Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 11:25:19,599Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 11:25:19,599Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 11:25:19,602Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 11:25:19,602Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 11:25:19,607Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 11:25:19,608Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [61098740] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 11:28:29,281Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [77a14cdc] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:30:25,685Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-30) [687b471d] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 5bd638e3 2017-02-12 11:30:25,774Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-30) [687b471d] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 5bd638e3 2017-02-12 11:30:25,779Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-30) [687b471d] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 11:33:29,550Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [49838e8b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:33:30,030Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 11:33:30,030Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 74fa9890 2017-02-12 11:33:30,406Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 74fa9890 2017-02-12 11:33:30,406Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:38:23,594Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 11:38:23,595Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2e0c539b 2017-02-12 11:38:24,757Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 2e0c539b 2017-02-12 11:38:24,757Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:38:29,868Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:43:30,183Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [77a14cdc] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:44:48,985Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 11:44:48,987Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1824d6ce 2017-02-12 11:44:49,314Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 1824d6ce 2017-02-12 11:44:49,315Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:48:30,502Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:52:21,128Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [277235f8] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 11:52:21,130Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [277235f8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:52:21,180Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [277235f8] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 30fdddbb 2017-02-12 11:52:21,241Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [277235f8] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@500fc5bb, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4545936480, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 30fdddbb 2017-02-12 11:52:21,245Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [277235f8] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 11:52:21,245Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [277235f8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 11:52:23,409Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 11:52:23,411Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 39b67364 2017-02-12 11:52:24,538Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 39b67364 2017-02-12 11:52:24,539Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-12 11:52:31,993Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-12 11:52:32,105Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6a58cd55 2017-02-12 11:52:32,508Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@be46df5, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4641647580, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 6a58cd55 2017-02-12 11:52:32,511Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 11:52:32,512Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 11:52:36,472Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [6e426cc7] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 11:52:36,474Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler5) [6e426cc7] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1662351d 2017-02-12 11:52:37,868Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler5) [6e426cc7] FINISH, DestroyVDSCommand, log id: 1662351d 2017-02-12 11:52:37,868Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [6e426cc7] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:52:53,887Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 11:53:30,818Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [687b471d] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 11:56:12,589Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 11:56:12,590Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4875d314 2017-02-12 11:56:12,934Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 4875d314 2017-02-12 11:56:12,934Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 11:58:31,133Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:02:43,420Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 12:02:43,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 739ae42a 2017-02-12 12:02:43,878Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 739ae42a 2017-02-12 12:02:43,878Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:03:31,410Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6e426cc7] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:05:03,694Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 12:05:03,696Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6610274a 2017-02-12 12:05:04,937Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 6610274a 2017-02-12 12:05:04,937Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:08:31,730Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:10:21,531Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [61098740] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 12:10:21,532Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:10:21,539Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6ad55df7 2017-02-12 12:10:21,589Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@2e5ff651, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4547016810, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 6ad55df7 2017-02-12 12:10:21,592Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 12:10:21,592Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 12:10:21,592Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 12:10:21,628Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-12 12:10:21,646Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 3459b2f2 2017-02-12 12:10:21,748Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@17ffdb53, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4642717100, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 3459b2f2 2017-02-12 12:10:21,750Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 12:10:21,751Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 12:10:22,968Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 12:10:22,970Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7a355b24 2017-02-12 12:10:23,350Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 7a355b24 2017-02-12 12:10:23,350Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:10:36,774Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [6e426cc7] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 12:11:41,421Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Fetched 6 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 12:11:41,424Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:11:41,437Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] START, FullListVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 7cc1ce9e 2017-02-12 12:11:41,960Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@5eb8f29c, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4552956940, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 7cc1ce9e 2017-02-12 12:11:41,963Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 12:11:41,963Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 12:11:41,964Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 12:11:42,597Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 12:11:42,598Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2a2f2589 2017-02-12 12:11:43,729Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 2a2f2589 2017-02-12 12:11:43,730Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 12:11:43,878Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 12:11:43,897Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-42) [dbff71a] Running command: ProcessDownVmCommand internal: true. 2017-02-12 12:11:52,106Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [6e426cc7] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 12:11:52,127Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [6e426cc7] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: afe84c5 2017-02-12 12:11:53,242Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [6e426cc7] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@45d1e83b, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4642807580, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: afe84c5 2017-02-12 12:11:53,244Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [6e426cc7] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 12:11:53,245Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [6e426cc7] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 12:11:57,805Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [77a14cdc] Fetched 5 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 12:13:31,879Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [687b471d] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:15:35,109Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 12:15:35,110Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 418ebdf3 2017-02-12 12:15:35,730Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 418ebdf3 2017-02-12 12:15:35,730Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:18:32,197Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:19:09,007Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 12:19:09,007Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 54ad517f 2017-02-12 12:19:09,219Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 54ad517f 2017-02-12 12:19:09,219Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:23:32,514Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:24:34,063Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler10) [799858bf] Backup check started. 2017-02-12 12:24:34,070Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler10) [799858bf] Backup check completed. 2017-02-12 12:25:19,609Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler1) [77a14cdc] Attempting to update VMs/Templates Ovf. 2017-02-12 12:25:19,613Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 12:25:19,613Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 12:25:19,613Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 12:25:19,619Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 12:25:19,624Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 12:25:19,624Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 12:25:19,625Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 12:25:19,625Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 12:25:19,627Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 12:25:19,627Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler1) [564da941] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 12:28:32,840Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:30:24,037Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 12:30:24,039Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 63df91a4 2017-02-12 12:30:25,130Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 63df91a4 2017-02-12 12:30:25,130Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:30:25,788Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-36) [32f3cb5f] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 3ed7a48a 2017-02-12 12:30:25,875Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-36) [32f3cb5f] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 3ed7a48a 2017-02-12 12:30:25,881Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-36) [32f3cb5f] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 12:33:33,155Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:34:10,923Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 12:34:10,924Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c97308a 2017-02-12 12:34:11,297Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 5c97308a 2017-02-12 12:34:11,297Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:38:33,300Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:39:35,963Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-1) [1c11e8b1] Connected to host ovirt08.mgmt.ns.imm.re with SSH key fingerprint: SHA256:GVrAdW/JET4fixqvHyl+/Y78MJKg9nSAz2LafvHz0Bs 2017-02-12 12:39:35,963Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-4) [1c11e8b1] Connected to host ovirt07.mgmt.ns.imm.re with SSH key fingerprint: SHA256:y0OE0+wnX8UsX1cVjFSIuqn7lAAWc+OsxA4wKgIzOak 2017-02-12 12:39:35,965Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-5) [1c11e8b1] Connected to host ovirt01.mgmt.ns.imm.re with SSH key fingerprint: SHA256:EtSHGkg2vTLM3IWhWqZgSpfQMDrSgfPOG6uiAWDJiSE 2017-02-12 12:39:35,982Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-2) [1c11e8b1] Connected to host ovirt05.mgmt.ns.imm.re with SSH key fingerprint: SHA256:o1trtgzFEGcMWvR/d/E2iLCRaBq3Pj2Gx1gmbP8exHg 2017-02-12 12:39:35,993Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-3) [1c11e8b1] Connected to host ovirt03.mgmt.ns.imm.re with SSH key fingerprint: SHA256:xc3c2Miy7ImwEmgan2vLwAFIInEFiLF7VQgEPDLR/1I 2017-02-12 12:39:36,042Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-4) [1c11e8b1] Installation of ovirt07.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:36,043Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (pool-7-thread-4) [1c11e8b1] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-12 12:39:36,044Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-1) [1c11e8b1] Installation of ovirt08.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:36,044Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-1) [1c11e8b1] SSH execute 'root@ovirt08.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:39:36,045Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-5) [1c11e8b1] Installation of ovirt01.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:36,045Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-5) [1c11e8b1] SSH execute 'root@ovirt01.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:39:36,061Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-2) [1c11e8b1] Installation of ovirt05.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:36,061Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-2) [1c11e8b1] SSH execute 'root@ovirt05.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:39:36,066Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-4) [1c11e8b1] SSH execute 'root@ovirt07.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:39:36,073Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-3) [1c11e8b1] Installation of ovirt03.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:36,073Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-3) [1c11e8b1] SSH execute 'root@ovirt03.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:39:37,530Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:39:37,541Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:39:37,577Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:39:37,706Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:39:37,710Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:39:37,710Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:39:37,723Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:39:37,726Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:39:37,731Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:39:37,732Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:39:37,755Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:39:37,756Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:39:37,761Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:39:37,765Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:39:37,792Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:39:50,137Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:39:50,189Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:39:50,216Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123929-9l5nni.log' 2017-02-12 12:39:50,246Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:39:50,281Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:39:50,415Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:50,419Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:39:51,768Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:39:51,821Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:39:51,846Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123931-ae3t8l.log' 2017-02-12 12:39:51,885Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:39:51,924Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:39:51,987Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:39:52,038Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:39:52,048Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:39:52,068Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123928-hz38z3.log' 2017-02-12 12:39:52,073Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:39:52,081Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:52,083Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:39:52,084Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123931-8wmbyp.log' 2017-02-12 12:39:52,134Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:39:52,137Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:39:52,161Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:39:52,174Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:39:52,236Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:52,237Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:39:52,332Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:52,334Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:39:54,782Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:39:54,834Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:39:54,862Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123930-9zraip.log' 2017-02-12 12:39:54,925Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:39:54,968Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:39:55,116Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:55,118Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:39:59,300Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:39:59,304Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:39:59,372Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:39:59,376Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:39:59,386Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployPackagesUnit] (VdsDeploy) [1c11e8b1] Available packages for update: mom-0.5.8-1.el7.centos 2017-02-12 12:39:59,394Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212123959-ovirt07.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:39:59,509Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:39:59,573Z INFO [org.ovirt.engine.core.bll.host.HostUpgradeManager] (pool-7-thread-4) [1c11e8b1] There are available packages (mom-0.5.8-1.el7.centos) for host 'ovirt07.mgmt.ns.imm.re' 2017-02-12 12:39:59,579Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-4) [1c11e8b1] EVENT_ID: HOST_UPDATES_ARE_AVAILABLE_WITH_PACKAGES(843), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ovirt07.mgmt.ns.imm.re has available updates: mom. 2017-02-12 12:39:59,582Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-4) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt07.mgmt.ns.imm.re was completed successfully with message 'found updates for packages mom-0.5.8-1.el7.centos'. 2017-02-12 12:39:59,643Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-4) [1c11e8b1] Connected to host ovirt02.mgmt.ns.imm.re with SSH key fingerprint: SHA256:n+f1vjPglPQrYuCnX55/Kd8gTKEcmBYP4KUAO/7M5Ks 2017-02-12 12:39:59,723Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-4) [1c11e8b1] Installation of ovirt02.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:39:59,723Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (pool-7-thread-4) [1c11e8b1] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-12 12:39:59,760Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-4) [1c11e8b1] SSH execute 'root@ovirt02.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:40:00,103Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:00,108Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:00,174Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:00,177Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:00,197Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124000-ovirt03.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:00,253Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:00,257Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:00,312Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:00,324Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:00,327Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:00,346Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124000-ovirt05.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:00,387Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-3) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt03.mgmt.ns.imm.re was completed successfully with message 'no updates found.'. 2017-02-12 12:40:00,442Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-3) [1c11e8b1] Connected to host ovirt06.mgmt.ns.imm.re with SSH key fingerprint: SHA256:+ZOPMEOKSMmamWtS2BYitsDnGVtbvDfq99j9m0mMwh8 2017-02-12 12:40:00,454Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:00,467Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:00,473Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:00,508Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-2) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt05.mgmt.ns.imm.re was completed successfully with message 'no updates found.'. 2017-02-12 12:40:00,523Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-3) [1c11e8b1] Installation of ovirt06.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:40:00,523Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-3) [1c11e8b1] SSH execute 'root@ovirt06.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:40:00,542Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:00,545Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:00,556Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployPackagesUnit] (VdsDeploy) [1c11e8b1] Available packages for update: mom-0.5.8-1.el7.centos 2017-02-12 12:40:00,564Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124000-ovirt01.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:00,582Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-2) [1c11e8b1] Connected to host ovirt04.mgmt.ns.imm.re with SSH key fingerprint: SHA256:/WKpKfZqem9JmANBrGX3x78LCnP7xEaNNRx2tucstl0 2017-02-12 12:40:00,662Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-7-thread-2) [1c11e8b1] Installation of ovirt04.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-12 12:40:00,662Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-7-thread-2) [1c11e8b1] SSH execute 'root@ovirt04.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-12 12:40:00,682Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:00,732Z INFO [org.ovirt.engine.core.bll.host.HostUpgradeManager] (pool-7-thread-5) [1c11e8b1] There are available packages (mom-0.5.8-1.el7.centos) for host 'ovirt01.mgmt.ns.imm.re' 2017-02-12 12:40:00,742Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-5) [1c11e8b1] EVENT_ID: HOST_UPDATES_ARE_AVAILABLE_WITH_PACKAGES(843), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re has available updates: mom. 2017-02-12 12:40:00,747Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-5) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt01.mgmt.ns.imm.re was completed successfully with message 'found updates for packages mom-0.5.8-1.el7.centos'. 2017-02-12 12:40:01,045Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:40:01,067Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:40:01,104Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:40:01,184Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:40:01,208Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:40:01,242Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:40:02,279Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Initializing 2017-02-12 12:40:02,287Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment setup 2017-02-12 12:40:02,320Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment packages setup 2017-02-12 12:40:02,666Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:02,671Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:02,746Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:02,749Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:02,769Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124002-ovirt08.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:02,878Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:02,929Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-1) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt08.mgmt.ns.imm.re was completed successfully with message 'no updates found.'. 2017-02-12 12:40:08,054Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:40:08,104Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:40:08,132Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123953-ccx7s7.log' 2017-02-12 12:40:08,195Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:40:08,218Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:40:08,294Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:08,294Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:40:11,327Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:40:11,360Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:40:11,392Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123957-90ehem.log' 2017-02-12 12:40:11,420Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:40:11,453Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:40:11,588Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:11,589Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:40:11,852Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Programs detection 2017-02-12 12:40:11,888Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Environment customization 2017-02-12 12:40:11,910Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Logs at host located at: '/tmp/ovirt-host-mgmt-20170212123953-ia4qon.log' 2017-02-12 12:40:11,965Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Setup validation 2017-02-12 12:40:11,990Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction setup 2017-02-12 12:40:12,063Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:12,064Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Package installation 2017-02-12 12:40:15,763Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:15,768Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:15,840Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:15,844Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:15,863Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124015-ovirt02.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:15,974Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:16,037Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-4) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt02.mgmt.ns.imm.re was completed successfully with message 'no updates found.'. 2017-02-12 12:40:19,667Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:19,673Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:19,740Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:19,744Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:19,761Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124019-ovirt06.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:19,843Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:19,885Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-3) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt06.mgmt.ns.imm.re was completed successfully with message 'no updates found.'. 2017-02-12 12:40:20,273Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Misc configuration 2017-02-12 12:40:20,278Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Transaction commit 2017-02-12 12:40:20,345Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Closing up 2017-02-12 12:40:20,349Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Pre-termination 2017-02-12 12:40:20,361Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployPackagesUnit] (VdsDeploy) [1c11e8b1] Available packages for update: mom-0.5.8-1.el7.centos 2017-02-12 12:40:20,370Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170212124020-ovirt04.mgmt.ns.imm.re-1c11e8b1.log' 2017-02-12 12:40:20,486Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [1c11e8b1] Stage: Termination 2017-02-12 12:40:20,537Z INFO [org.ovirt.engine.core.bll.host.HostUpgradeManager] (pool-7-thread-2) [1c11e8b1] There are available packages (mom-0.5.8-1.el7.centos) for host 'ovirt04.mgmt.ns.imm.re' 2017-02-12 12:40:20,548Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-2) [1c11e8b1] EVENT_ID: HOST_UPDATES_ARE_AVAILABLE_WITH_PACKAGES(843), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ovirt04.mgmt.ns.imm.re has available updates: mom. 2017-02-12 12:40:20,555Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-2) [1c11e8b1] EVENT_ID: HOST_AVAILABLE_UPDATES_FINISHED(885), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Check for available updates on host ovirt04.mgmt.ns.imm.re was completed successfully with message 'found updates for packages mom-0.5.8-1.el7.centos'. 2017-02-12 12:43:02,288Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 12:43:02,289Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 45b4b6a 2017-02-12 12:43:02,647Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 45b4b6a 2017-02-12 12:43:02,647Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:43:33,622Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:45:21,630Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 12:45:21,631Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 71e90850 2017-02-12 12:45:22,839Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 71e90850 2017-02-12 12:45:22,840Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:48:33,939Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:53:34,255Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6e426cc7] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 12:54:30,454Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 12:54:30,455Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4e3b67b0 2017-02-12 12:54:30,750Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 4e3b67b0 2017-02-12 12:54:30,750Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:54:36,411Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 12:54:36,412Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2f79dccd 2017-02-12 12:54:36,527Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [277235f8] Fetched 6 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 12:54:36,809Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 2f79dccd 2017-02-12 12:54:36,809Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:54:51,574Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [6e426cc7] Fetched 5 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 12:55:53,932Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 12:55:53,933Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c43cf15 2017-02-12 12:55:54,269Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 5c43cf15 2017-02-12 12:55:54,270Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 12:58:34,572Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [687b471d] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:01:08,166Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Fetched 12 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 13:01:08,170Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:01:08,192Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] START, FullListVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6400634f 2017-02-12 13:01:08,310Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@67229d5d, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4555907260, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 6400634f 2017-02-12 13:01:08,312Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 13:01:08,312Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 13:01:08,312Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 13:01:09,952Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 13:01:09,953Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 117cd55a 2017-02-12 13:01:10,786Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 117cd55a 2017-02-12 13:01:10,786Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 13:01:10,858Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-2) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 13:01:10,868Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-23) [1c6bcf8c] Running command: ProcessDownVmCommand internal: true. 2017-02-12 13:01:20,433Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [687b471d] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 13:01:20,453Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [687b471d] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 39ca0c3b 2017-02-12 13:01:20,519Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [687b471d] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@2ecbdb10, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4645775850, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 39ca0c3b 2017-02-12 13:01:20,521Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [687b471d] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 13:01:20,522Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [687b471d] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 13:01:23,361Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [61098740] Fetched 11 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 13:03:34,862Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:05:56,372Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 13:05:56,374Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 21a6e945 2017-02-12 13:05:57,579Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 21a6e945 2017-02-12 13:05:57,579Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:08:35,181Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:13:35,491Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:13:38,640Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 13:13:38,641Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6a9ed109 2017-02-12 13:13:39,080Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 6a9ed109 2017-02-12 13:13:39,080Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:18:35,632Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:21:07,204Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 13:21:07,205Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6be7aeb 2017-02-12 13:21:07,590Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 6be7aeb 2017-02-12 13:21:07,590Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:21:10,337Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [799858bf] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 13:21:10,338Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:21:10,344Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 2c0bd062 2017-02-12 13:21:10,403Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@5bf7070a, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4551265540, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 2c0bd062 2017-02-12 13:21:10,406Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 13:21:10,406Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 13:21:10,407Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 13:21:10,412Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler3) [49838e8b] skipping VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-12 13:21:10,428Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler3) [49838e8b] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 37d2789 2017-02-12 13:21:10,487Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler3) [49838e8b] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@60bcb5a1, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4646965800, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 37d2789 2017-02-12 13:21:10,489Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler3) [49838e8b] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 13:21:10,490Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler3) [49838e8b] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 13:21:11,486Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 13:21:11,487Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1a65002e 2017-02-12 13:21:11,776Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 1a65002e 2017-02-12 13:21:11,776Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 13:21:11,927Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-1) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 13:21:11,946Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-11) [51727f77] Running command: ProcessDownVmCommand internal: true. 2017-02-12 13:21:25,512Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 13:21:25,552Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [277235f8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 13:23:35,948Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6e426cc7] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:25:19,630Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler7) [687b471d] Attempting to update VMs/Templates Ovf. 2017-02-12 13:25:19,637Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 13:25:19,637Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 13:25:19,639Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 13:25:19,652Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 13:25:19,664Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 13:25:19,664Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 13:25:19,666Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 13:25:19,666Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 13:25:19,670Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 13:25:19,671Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [7f03a626] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 13:27:25,930Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 13:27:25,932Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5048afd7 2017-02-12 13:27:26,351Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 5048afd7 2017-02-12 13:27:26,351Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:28:36,265Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:30:25,890Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-41) [3ea979a5] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 72f27b57 2017-02-12 13:30:26,006Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-41) [3ea979a5] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 72f27b57 2017-02-12 13:30:26,011Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-41) [3ea979a5] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 13:31:05,728Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 13:31:05,730Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4ea75330 2017-02-12 13:31:06,123Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 4ea75330 2017-02-12 13:31:06,123Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:33:36,546Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:38:31,228Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 13:38:31,229Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5bece64a 2017-02-12 13:38:31,525Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 5bece64a 2017-02-12 13:38:31,525Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:38:36,699Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:43:37,014Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:48:37,334Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:51:14,776Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 13:51:14,777Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4d089d3e 2017-02-12 13:51:16,029Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 4d089d3e 2017-02-12 13:51:16,030Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:53:34,560Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 13:53:34,561Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4efce61d 2017-02-12 13:53:35,779Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 4efce61d 2017-02-12 13:53:35,780Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:53:37,649Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:53:46,596Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 13:53:46,597Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 115d02aa 2017-02-12 13:53:47,885Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 115d02aa 2017-02-12 13:53:47,886Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:56:09,336Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 13:56:09,337Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 43fcef2e 2017-02-12 13:56:09,688Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 43fcef2e 2017-02-12 13:56:09,688Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 13:58:37,970Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 13:58:56,472Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 13:58:56,474Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6b3f7fc8 2017-02-12 13:58:56,765Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 6b3f7fc8 2017-02-12 13:58:56,765Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:03:38,288Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:06:33,935Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 14:06:33,936Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7297863 2017-02-12 14:06:34,834Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 7297863 2017-02-12 14:06:34,834Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:08:38,605Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [49838e8b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:12:43,430Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 14:12:43,431Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6ce9bfdd 2017-02-12 14:12:43,779Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 6ce9bfdd 2017-02-12 14:12:43,779Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:13:38,732Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:18:39,032Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6e426cc7] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:18:58,765Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 14:18:58,766Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2f68ee62 2017-02-12 14:18:59,139Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 2f68ee62 2017-02-12 14:18:59,139Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:18:59,741Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 14:18:59,742Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3fdbe9fa 2017-02-12 14:19:00,403Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 3fdbe9fa 2017-02-12 14:19:00,403Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:23:39,354Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:25:19,673Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler5) [6e426cc7] Attempting to update VMs/Templates Ovf. 2017-02-12 14:25:19,680Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 14:25:19,680Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 14:25:19,682Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 14:25:19,694Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 14:25:19,705Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 14:25:19,705Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 14:25:19,708Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 14:25:19,708Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 14:25:19,711Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 14:25:19,712Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [6519a91] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 14:28:09,974Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 14:28:09,975Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 31792c55 2017-02-12 14:28:10,752Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 31792c55 2017-02-12 14:28:10,752Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:28:39,655Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:30:26,020Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [32f3cb5f] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 68c2a908 2017-02-12 14:30:26,655Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [32f3cb5f] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 68c2a908 2017-02-12 14:30:26,661Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-33) [32f3cb5f] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 14:31:45,908Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 14:31:45,910Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 328a1870 2017-02-12 14:31:46,301Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 328a1870 2017-02-12 14:31:46,302Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:33:39,939Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:38:40,255Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6519a91] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:41:44,669Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 14:41:44,670Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 61c9db5f 2017-02-12 14:41:44,766Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [564da941] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 14:41:45,063Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 61c9db5f 2017-02-12 14:41:45,063Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:41:50,596Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 14:41:50,597Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7332a5df 2017-02-12 14:41:50,996Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 7332a5df 2017-02-12 14:41:50,997Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:41:59,868Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 14:43:40,537Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6519a91] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:45:22,934Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 14:45:22,936Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6e611afc 2017-02-12 14:45:23,207Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 6e611afc 2017-02-12 14:45:23,207Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:48:40,858Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:53:41,176Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 14:55:42,624Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 14:55:42,625Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 242967c6 2017-02-12 14:55:43,160Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 242967c6 2017-02-12 14:55:43,160Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 14:58:41,457Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:03:20,322Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 15:03:20,323Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 77c7d8ce 2017-02-12 15:03:20,469Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [277235f8] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 15:03:20,813Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 77c7d8ce 2017-02-12 15:03:20,813Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:03:31,609Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 15:03:31,611Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: f722097 2017-02-12 15:03:32,869Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: f722097 2017-02-12 15:03:32,869Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:03:35,520Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [6519a91] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 15:03:41,738Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6519a91] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:07:21,577Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 15:07:21,578Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 9ddee54 2017-02-12 15:07:22,309Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 9ddee54 2017-02-12 15:07:22,309Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:07:30,420Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 15:07:30,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3589ec59 2017-02-12 15:07:30,899Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 3589ec59 2017-02-12 15:07:30,899Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:08:30,108Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 15:08:30,109Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 31016c7d 2017-02-12 15:08:31,551Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 31016c7d 2017-02-12 15:08:31,551Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:08:41,952Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6519a91] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:11:15,492Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 15:11:15,494Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 53b5e50a 2017-02-12 15:11:17,293Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 53b5e50a 2017-02-12 15:11:17,293Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:13:42,232Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:18:42,548Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:23:42,866Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:25:19,715Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler3) [49838e8b] Attempting to update VMs/Templates Ovf. 2017-02-12 15:25:19,721Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 15:25:19,721Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 15:25:19,723Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 15:25:19,735Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 15:25:19,746Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 15:25:19,746Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 15:25:19,747Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 15:25:19,747Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 15:25:19,749Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 15:25:19,750Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [5835e29b] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 15:26:15,592Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 15:26:15,594Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 21a39399 2017-02-12 15:26:16,768Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 21a39399 2017-02-12 15:26:16,768Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:28:43,039Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [277235f8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:30:26,669Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-8) [7f03a626] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 6c84efb1 2017-02-12 15:30:27,429Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-8) [7f03a626] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 6c84efb1 2017-02-12 15:30:27,432Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-8) [7f03a626] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 15:33:43,358Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:36:09,745Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 15:36:09,746Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7e375def 2017-02-12 15:36:10,681Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 7e375def 2017-02-12 15:36:10,681Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:38:43,672Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:39:58,020Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 15:39:58,022Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4666b2f8 2017-02-12 15:39:58,396Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 4666b2f8 2017-02-12 15:39:58,396Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:43:43,989Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:48:44,318Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:51:16,489Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 15:51:16,492Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1e012646 2017-02-12 15:51:17,196Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 1e012646 2017-02-12 15:51:17,196Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:52:25,704Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 15:52:25,705Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5e056765 2017-02-12 15:52:26,607Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 5e056765 2017-02-12 15:52:26,607Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:53:44,634Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 15:55:23,500Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-12 15:55:23,502Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 61021f80 2017-02-12 15:55:24,337Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 61021f80 2017-02-12 15:55:24,337Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:56:36,478Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Fetched 6 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 15:56:36,482Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:56:36,495Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] START, FullListVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: c68a34 2017-02-12 15:56:36,817Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@4d12e232, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4566451770, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: c68a34 2017-02-12 15:56:36,820Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 15:56:36,820Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 15:56:36,820Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 15:56:37,858Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 15:56:37,858Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7ecf9627 2017-02-12 15:56:38,157Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 7ecf9627 2017-02-12 15:56:38,157Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 15:56:38,237Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-12) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 15:56:38,247Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-28) [466531c4] Running command: ProcessDownVmCommand internal: true. 2017-02-12 15:56:48,904Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 15:56:48,923Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 3fd6882a 2017-02-12 15:56:49,426Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@b3cbc81, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4656304120, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 3fd6882a 2017-02-12 15:56:49,429Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 15:56:49,430Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 15:56:52,866Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 5 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 15:57:45,987Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 15:57:45,989Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6ccab986 2017-02-12 15:57:47,975Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 6ccab986 2017-02-12 15:57:47,975Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 15:58:44,950Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:02:47,669Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 16:02:47,670Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: b154b1e 2017-02-12 16:02:49,026Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: b154b1e 2017-02-12 16:02:49,027Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:03:45,268Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:08:45,582Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:13:45,897Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:15:19,048Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 16:15:19,050Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 77fd25dc 2017-02-12 16:15:19,402Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 77fd25dc 2017-02-12 16:15:19,403Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:15:27,803Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 16:15:27,804Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3b765541 2017-02-12 16:15:29,061Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 3b765541 2017-02-12 16:15:29,061Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:17:51,426Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 16:17:51,427Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 63ca9643 2017-02-12 16:17:51,791Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 63ca9643 2017-02-12 16:17:51,791Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:18:46,213Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:23:46,529Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:25:19,752Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler9) [277235f8] Attempting to update VMs/Templates Ovf. 2017-02-12 16:25:19,759Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 16:25:19,759Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 16:25:19,761Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 16:25:19,773Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 16:25:19,784Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 16:25:19,784Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 16:25:19,785Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 16:25:19,785Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 16:25:19,787Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 16:25:19,788Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [4dea63a] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 16:28:46,844Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:30:27,442Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-45) [4dea63a] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: b356aea 2017-02-12 16:30:28,290Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-45) [4dea63a] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: b356aea 2017-02-12 16:30:28,296Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-45) [4dea63a] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 16:32:56,441Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 16:32:56,442Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 29348406 2017-02-12 16:32:56,847Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 29348406 2017-02-12 16:32:56,848Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:33:47,161Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:38:47,306Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:41:37,773Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 16:41:37,774Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 377a8d04 2017-02-12 16:41:38,064Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 377a8d04 2017-02-12 16:41:38,065Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:42:45,138Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 16:42:45,139Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3ac5918a 2017-02-12 16:42:46,341Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 3ac5918a 2017-02-12 16:42:46,341Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:43:47,543Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:48:47,858Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:50:10,804Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 16:50:10,805Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3aa70381 2017-02-12 16:50:11,450Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 3aa70381 2017-02-12 16:50:11,450Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:53:48,172Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 16:55:50,482Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 16:55:50,483Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 26db1110 2017-02-12 16:55:50,687Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler3) [5835e29b] Fetched 6 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 16:55:51,773Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 26db1110 2017-02-12 16:55:51,773Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:56:05,748Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 5 VMs from VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc' 2017-02-12 16:57:06,030Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 12 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 16:57:06,034Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:57:06,051Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, FullListVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 76f8f124 2017-02-12 16:57:06,105Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@6953969c, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4570064800, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 76f8f124 2017-02-12 16:57:06,107Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 16:57:06,107Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 16:57:06,107Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 16:57:06,941Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 16:57:06,943Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 70d64e44 2017-02-12 16:57:08,211Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 70d64e44 2017-02-12 16:57:08,211Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 16:57:08,360Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 16:57:08,380Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-50) [29bba7af] Running command: ProcessDownVmCommand internal: true. 2017-02-12 16:57:19,079Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 16:57:19,087Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 1e66d4d5 2017-02-12 16:57:19,405Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler8) [61098740] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@3ca2ca0f, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4659934210, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 1e66d4d5 2017-02-12 16:57:19,406Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 16:57:19,406Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler8) [61098740] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 16:57:21,159Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [61098740] Fetched 11 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 16:58:16,413Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 16:58:16,414Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 43287f55 2017-02-12 16:58:16,703Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 43287f55 2017-02-12 16:58:16,703Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 16:58:48,494Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:03:48,812Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:04:22,717Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 17:04:22,718Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c7b0ddc 2017-02-12 17:04:22,781Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [799858bf] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 17:04:22,936Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 5c7b0ddc 2017-02-12 17:04:22,937Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:04:37,802Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler3) [5835e29b] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-12 17:08:29,557Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 17:08:29,559Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 69bcebde 2017-02-12 17:08:30,305Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 69bcebde 2017-02-12 17:08:30,306Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:08:48,963Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:13:49,283Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:14:30,425Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 17:14:30,426Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: ef2248f 2017-02-12 17:14:30,991Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: ef2248f 2017-02-12 17:14:30,991Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:18:49,543Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:21:59,262Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 17:21:59,263Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4ebc08a7 2017-02-12 17:22:00,326Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 4ebc08a7 2017-02-12 17:22:00,326Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:23:49,698Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:25:19,790Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler6) [c104467c-c044-4349-923f-164b7820627f] Attempting to update VMs/Templates Ovf. 2017-02-12 17:25:19,797Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 17:25:19,797Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 17:25:19,799Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 17:25:19,811Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 17:25:19,821Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 17:25:19,821Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 17:25:19,822Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 17:25:19,822Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 17:25:19,824Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 17:25:19,825Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [2d031f0a] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 17:28:50,015Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:30:28,299Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-8) [7f03a626] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 317bb260 2017-02-12 17:30:29,138Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-8) [7f03a626] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 317bb260 2017-02-12 17:30:29,144Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-8) [7f03a626] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 17:30:33,350Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 17:30:33,352Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5fe7b522 2017-02-12 17:30:33,655Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 5fe7b522 2017-02-12 17:30:33,655Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:33:50,168Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:38:50,484Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:43:50,801Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:45:29,922Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 17:45:29,923Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4c9980bc 2017-02-12 17:45:30,180Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 4c9980bc 2017-02-12 17:45:30,181Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:46:55,273Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 17:46:55,274Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c0e2667 2017-02-12 17:46:55,671Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 5c0e2667 2017-02-12 17:46:55,671Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:48:51,122Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:53:51,438Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 17:54:36,590Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 17:54:36,592Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2a8dfa42 2017-02-12 17:54:36,876Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 2a8dfa42 2017-02-12 17:54:36,876Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:57:18,624Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 17:57:18,625Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2f257f6b 2017-02-12 17:57:19,487Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 2f257f6b 2017-02-12 17:57:19,487Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:57:24,813Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 17:57:24,814Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2ce8b7f2 2017-02-12 17:57:25,237Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 2ce8b7f2 2017-02-12 17:57:25,238Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 17:58:51,754Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [4dea63a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:03:34,563Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 18:03:34,565Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 37f047cf 2017-02-12 18:03:34,568Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [61098740] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 18:03:35,316Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 37f047cf 2017-02-12 18:03:35,316Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:03:49,642Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [7f03a626] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 18:03:52,071Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [61098740] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:04:57,879Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 18:04:57,881Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 17927b26 2017-02-12 18:04:58,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 17927b26 2017-02-12 18:04:58,422Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:08:34,366Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 18:08:34,367Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3cd40c68 2017-02-12 18:08:35,612Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 3cd40c68 2017-02-12 18:08:35,612Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:08:52,387Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [6519a91] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:13:52,524Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:17:31,043Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 18:17:31,044Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 20c420d 2017-02-12 18:17:32,254Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 20c420d 2017-02-12 18:17:32,254Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:18:52,840Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:20:06,106Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 18:20:06,108Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6017e78 2017-02-12 18:20:06,531Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 6017e78 2017-02-12 18:20:06,531Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:23:52,993Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:24:34,070Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler2) [32f3cb5f] Backup check started. 2017-02-12 18:24:34,073Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler2) [32f3cb5f] Backup check completed. 2017-02-12 18:25:19,826Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler8) [61098740] Attempting to update VMs/Templates Ovf. 2017-02-12 18:25:19,833Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 18:25:19,833Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 18:25:19,835Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 18:25:19,847Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 18:25:19,858Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 18:25:19,858Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 18:25:19,859Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 18:25:19,859Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 18:25:19,860Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 18:25:19,862Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [6e4b8a44] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 18:28:53,309Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:30:29,148Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-49) [2d031f0a] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 1f78e016 2017-02-12 18:30:31,729Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-49) [2d031f0a] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 1f78e016 2017-02-12 18:30:31,734Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-49) [2d031f0a] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 18:33:53,626Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:38:53,945Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:39:52,430Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 18:39:52,432Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 54c9d76 2017-02-12 18:39:53,367Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 54c9d76 2017-02-12 18:39:53,367Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:43:54,079Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:47:21,039Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 18:47:21,040Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4335d202 2017-02-12 18:47:21,627Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 4335d202 2017-02-12 18:47:21,627Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:48:54,400Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:51:10,192Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 18:51:10,194Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7e91df00 2017-02-12 18:51:10,745Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 7e91df00 2017-02-12 18:51:10,745Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:51:16,981Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 18:51:16,983Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 34893cf6 2017-02-12 18:51:17,439Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 34893cf6 2017-02-12 18:51:17,439Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:51:19,225Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 18:51:19,227Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 18:51:19,229Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 78c47b77 2017-02-12 18:51:20,590Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, DestroyVDSCommand, log id: 78c47b77 2017-02-12 18:51:20,590Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:51:35,818Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [2d031f0a] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 18:53:54,722Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 18:54:58,569Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 18:54:58,570Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1975b37e 2017-02-12 18:54:58,954Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 1975b37e 2017-02-12 18:54:58,954Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 18:58:55,002Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:03:55,317Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:08:55,626Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:10:07,370Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 19:10:07,371Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 64fdc743 2017-02-12 19:10:07,943Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 64fdc743 2017-02-12 19:10:07,943Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:11:22,767Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 19:11:22,769Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 40795139 2017-02-12 19:11:23,313Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 40795139 2017-02-12 19:11:23,313Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:13:55,941Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:18:56,258Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:22:36,865Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 19:22:36,866Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 792d632 2017-02-12 19:22:37,169Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 792d632 2017-02-12 19:22:37,169Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:23:56,575Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:25:19,864Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler5) [6519a91] Attempting to update VMs/Templates Ovf. 2017-02-12 19:25:19,871Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 19:25:19,871Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 19:25:19,873Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 19:25:19,885Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 19:25:19,897Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 19:25:19,897Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 19:25:19,897Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 19:25:19,897Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 19:25:19,899Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 19:25:19,901Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [18f2b403] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 19:26:29,900Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 19:26:29,902Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 793e4f7d 2017-02-12 19:26:31,167Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 793e4f7d 2017-02-12 19:26:31,168Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:28:56,891Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:30:31,742Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-42) [799858bf] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 670fcbe3 2017-02-12 19:30:34,123Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-42) [799858bf] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 670fcbe3 2017-02-12 19:30:34,128Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-42) [799858bf] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 19:33:57,174Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:35:04,784Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 19:35:04,785Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 32eb92ae 2017-02-12 19:35:05,189Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 32eb92ae 2017-02-12 19:35:05,189Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:35:07,668Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 19:35:07,669Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6e411337 2017-02-12 19:35:08,300Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 6e411337 2017-02-12 19:35:08,300Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:36:30,177Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 19:36:30,180Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:36:30,194Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, FullListVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 2e5758d1 2017-02-12 19:36:30,224Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@7c6d5246, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4579587060, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 2e5758d1 2017-02-12 19:36:30,226Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 19:36:30,226Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 19:36:30,227Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 19:36:31,356Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 19:36:31,358Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1400697d 2017-02-12 19:36:31,887Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 1400697d 2017-02-12 19:36:31,888Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 19:36:31,983Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-11) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 19:36:31,996Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-28) [36a62139] Running command: ProcessDownVmCommand internal: true. 2017-02-12 19:36:41,702Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [4dea63a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 19:36:41,721Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [4dea63a] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 5744ca87 2017-02-12 19:36:42,744Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [4dea63a] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@cf8df62, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4669496670, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 5744ca87 2017-02-12 19:36:42,745Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [4dea63a] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 19:36:42,746Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [4dea63a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 19:36:45,296Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [4dea63a] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 19:37:38,267Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 19:37:38,268Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 37603a73 2017-02-12 19:37:39,583Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 37603a73 2017-02-12 19:37:39,583Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:38:57,497Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [4dea63a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:43:57,728Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:48:58,045Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:48:58,413Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 19:48:58,414Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4cfac482 2017-02-12 19:48:58,720Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 4cfac482 2017-02-12 19:48:58,720Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:52:40,208Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 19:52:40,209Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 449f94c9 2017-02-12 19:52:41,314Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 449f94c9 2017-02-12 19:52:41,315Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:53:58,326Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:53:59,246Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 19:53:59,247Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 66a1867e 2017-02-12 19:54:00,495Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 66a1867e 2017-02-12 19:54:00,495Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:56:50,034Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 3 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-12 19:56:50,036Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 19:56:50,047Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] START, FullListVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 41b061ca 2017-02-12 19:56:50,146Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@3c2c480, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4670724120, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 41b061ca 2017-02-12 19:56:50,149Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 19:56:50,149Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 19:56:50,150Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 19:56:51,557Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-12 19:56:51,558Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 238d6484 2017-02-12 19:56:52,279Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 238d6484 2017-02-12 19:56:52,280Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 19:56:52,426Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-5) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 19:56:52,445Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-28) [75ee2ab3] Running command: ProcessDownVmCommand internal: true. 2017-02-12 19:57:02,455Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [4dea63a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 19:57:02,474Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [4dea63a] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 59bd3938 2017-02-12 19:57:02,548Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [4dea63a] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@1fd975db, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4670717400, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 59bd3938 2017-02-12 19:57:02,551Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [4dea63a] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 19:57:02,551Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [4dea63a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 19:57:05,461Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [18f2b403] Fetched 2 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-12 19:58:58,650Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [4dea63a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 19:59:02,884Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 19:59:02,885Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 541dfda2 2017-02-12 19:59:03,942Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 541dfda2 2017-02-12 19:59:03,942Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:03:58,931Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [18f2b403] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:08:59,252Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:13:03,341Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 20:13:03,343Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2c2c5c07 2017-02-12 20:13:04,761Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 2c2c5c07 2017-02-12 20:13:04,761Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:13:59,568Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [18f2b403] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:14:23,947Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 20:14:23,949Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 350b277 2017-02-12 20:14:24,224Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 350b277 2017-02-12 20:14:24,224Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:18:59,883Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:21:40,888Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 20:21:40,889Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 77a035c1 2017-02-12 20:21:41,022Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [564da941] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-12 20:21:41,107Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 77a035c1 2017-02-12 20:21:41,107Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:21:56,072Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [18f2b403] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-12 20:23:07,435Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 20:23:07,437Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3aee6cbe 2017-02-12 20:23:08,295Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 3aee6cbe 2017-02-12 20:23:08,295Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:23:08,644Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 20:23:08,644Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4552138f 2017-02-12 20:23:09,955Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 4552138f 2017-02-12 20:23:09,955Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:24:00,206Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:24:13,336Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 20:24:13,337Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6ce76ac7 2017-02-12 20:24:13,965Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 6ce76ac7 2017-02-12 20:24:13,965Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:25:19,902Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler5) [18f2b403] Attempting to update VMs/Templates Ovf. 2017-02-12 20:25:19,909Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 20:25:19,909Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 20:25:19,911Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 20:25:19,924Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 20:25:19,934Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 20:25:19,934Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 20:25:19,935Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 20:25:19,935Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 20:25:19,937Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 20:25:19,938Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler5) [534a3237] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 20:29:00,525Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:30:34,136Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-49) [799858bf] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 25920d74 2017-02-12 20:30:34,290Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-49) [799858bf] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 25920d74 2017-02-12 20:30:34,296Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-49) [799858bf] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 20:34:00,768Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:39:01,086Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:39:03,286Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 20:39:03,287Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2257c4ee 2017-02-12 20:39:04,526Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 2257c4ee 2017-02-12 20:39:04,526Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:44:01,365Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:46:35,714Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 20:46:35,716Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 61fe76b 2017-02-12 20:46:36,090Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 61fe76b 2017-02-12 20:46:36,090Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:48:00,048Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 20:48:00,049Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 74328ebf 2017-02-12 20:48:01,667Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 74328ebf 2017-02-12 20:48:01,667Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:49:01,687Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:51:38,060Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 20:51:38,062Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 10261585 2017-02-12 20:51:39,040Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 10261585 2017-02-12 20:51:39,040Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:54:02,007Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 20:54:09,767Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 20:54:09,769Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3a1ef528 2017-02-12 20:54:11,290Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 3a1ef528 2017-02-12 20:54:11,290Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 20:59:02,152Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:04:02,306Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:09:02,558Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:13:21,726Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 21:13:21,727Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5f0f6950 2017-02-12 21:13:22,251Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 5f0f6950 2017-02-12 21:13:22,251Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:14:02,848Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [4dea63a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:14:32,628Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 21:14:32,630Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 50af7b25 2017-02-12 21:14:32,942Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 50af7b25 2017-02-12 21:14:32,942Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:19:03,165Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:19:36,172Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 21:19:36,173Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6a2953ea 2017-02-12 21:19:36,571Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 6a2953ea 2017-02-12 21:19:36,571Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:24:03,380Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:24:48,450Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 21:24:48,451Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: dc8aee5 2017-02-12 21:24:48,874Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: dc8aee5 2017-02-12 21:24:48,874Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:25:19,941Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler9) [4dea63a] Attempting to update VMs/Templates Ovf. 2017-02-12 21:25:19,948Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 21:25:19,948Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 21:25:19,950Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 21:25:19,962Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 21:25:19,972Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 21:25:19,972Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 21:25:19,973Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 21:25:19,973Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 21:25:19,975Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 21:25:19,977Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [62417052] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 21:28:29,312Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 21:28:29,314Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: fcc608e 2017-02-12 21:28:30,633Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: fcc608e 2017-02-12 21:28:30,633Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:29:03,663Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:30:34,304Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [5835e29b] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 12a7b9e5 2017-02-12 21:30:34,766Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [5835e29b] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 12a7b9e5 2017-02-12 21:30:34,770Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-33) [5835e29b] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 21:34:03,931Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [62417052] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:39:04,253Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:42:06,713Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 21:42:06,715Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2aa19343 2017-02-12 21:42:07,900Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 2aa19343 2017-02-12 21:42:07,900Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:44:04,402Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:48:23,509Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 21:48:23,510Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 37e87981 2017-02-12 21:48:23,862Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 37e87981 2017-02-12 21:48:23,862Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:49:04,556Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [7f03a626] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:49:43,854Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 21:49:43,856Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:49:43,862Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 1cd76121 2017-02-12 21:49:43,883Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@3b0d54e1, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4581778460, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 1cd76121 2017-02-12 21:49:43,887Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 21:49:43,887Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 21:49:43,942Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-12 21:49:43,952Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 7f8591b8 2017-02-12 21:49:44,384Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@18410c81, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4677478750, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 7f8591b8 2017-02-12 21:49:44,386Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 21:49:44,386Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 21:49:45,389Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 21:49:45,391Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: defad74 2017-02-12 21:49:46,887Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: defad74 2017-02-12 21:49:46,887Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:49:58,934Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [6e4b8a44] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 21:51:10,626Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 21:51:10,627Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7ddba80b 2017-02-12 21:51:11,290Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 7ddba80b 2017-02-12 21:51:11,290Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:53:43,220Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 21:53:43,222Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 78a66c35 2017-02-12 21:53:43,662Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 78a66c35 2017-02-12 21:53:43,662Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:54:04,706Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [62417052] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:58:55,595Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 21:58:55,597Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c5465de 2017-02-12 21:58:56,052Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 5c5465de 2017-02-12 21:58:56,053Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:59:01,402Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-12 21:59:01,403Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 26bdf2dd 2017-02-12 21:59:01,524Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [7f03a626] Fetched 3 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-12 21:59:02,658Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 26bdf2dd 2017-02-12 21:59:02,658Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 21:59:04,864Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 21:59:16,580Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [7f03a626] Fetched 2 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-12 22:03:47,400Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 22:03:47,402Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 35a285c4 2017-02-12 22:03:47,610Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 35a285c4 2017-02-12 22:03:47,610Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:04:05,165Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:09:05,325Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:12:35,176Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 22:12:35,178Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 612e3afe 2017-02-12 22:12:36,417Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 612e3afe 2017-02-12 22:12:36,417Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:14:05,643Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:19:05,960Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:24:06,281Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [62417052] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:25:19,979Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler7) [7f03a626] Attempting to update VMs/Templates Ovf. 2017-02-12 22:25:19,986Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 22:25:19,986Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 22:25:19,988Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 22:25:20,002Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 22:25:20,014Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 22:25:20,014Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 22:25:20,017Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 22:25:20,017Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 22:25:20,022Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 22:25:20,024Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [12115dfe] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 22:26:23,627Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [2d031f0a] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 22:26:23,628Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [2d031f0a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:26:23,634Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [2d031f0a] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 20855fd0 2017-02-12 22:26:23,666Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler6) [2d031f0a] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@49b9a84f, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4583978190, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 20855fd0 2017-02-12 22:26:23,670Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [2d031f0a] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 22:26:23,670Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler6) [2d031f0a] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 22:26:23,702Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-12 22:26:23,717Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 47f52772 2017-02-12 22:26:24,757Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [799858bf] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@6535b25b, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4679678480, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 47f52772 2017-02-12 22:26:24,759Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 22:26:24,759Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [799858bf] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 22:26:25,087Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 22:26:25,089Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 499155dd 2017-02-12 22:26:25,461Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 499155dd 2017-02-12 22:26:25,461Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:26:38,729Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-12 22:29:06,561Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:30:02,994Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 22:30:02,995Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3940e0d6 2017-02-12 22:30:03,309Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 3940e0d6 2017-02-12 22:30:03,309Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:30:34,774Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-31) [3ea979a5] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 7074063d 2017-02-12 22:30:35,792Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-31) [3ea979a5] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 7074063d 2017-02-12 22:30:35,800Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-31) [3ea979a5] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 22:34:06,709Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:39:06,854Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:41:25,101Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 22:41:25,103Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1d14bbef 2017-02-12 22:41:25,548Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 1d14bbef 2017-02-12 22:41:25,548Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:44:07,173Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [62417052] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:49:07,392Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:50:04,981Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 22:50:04,982Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 19423d16 2017-02-12 22:50:05,640Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 19423d16 2017-02-12 22:50:05,640Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:50:10,826Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 22:50:10,827Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4476ff69 2017-02-12 22:50:11,100Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 4476ff69 2017-02-12 22:50:11,101Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:50:16,031Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 22:50:16,032Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 645508dd 2017-02-12 22:50:17,308Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 645508dd 2017-02-12 22:50:17,309Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:50:17,815Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [6e4b8a44] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 22:50:17,817Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [6e4b8a44] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 22:50:17,819Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler8) [6e4b8a44] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 40248e 2017-02-12 22:50:19,083Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler8) [6e4b8a44] FINISH, DestroyVDSCommand, log id: 40248e 2017-02-12 22:50:19,084Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [6e4b8a44] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:50:34,617Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [62417052] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 22:54:07,712Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 22:55:13,247Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 22:55:13,248Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 783199e1 2017-02-12 22:55:13,465Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 783199e1 2017-02-12 22:55:13,465Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 22:59:08,005Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:04:08,320Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:05:36,545Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 23:05:36,546Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6a0cf16e 2017-02-12 23:05:36,687Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [2d031f0a] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-12 23:05:36,852Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 6a0cf16e 2017-02-12 23:05:36,852Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:05:40,566Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 23:05:40,568Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 61f95197 2017-02-12 23:05:41,825Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 61f95197 2017-02-12 23:05:41,825Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:05:51,787Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-12 23:08:17,878Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 23:08:17,880Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 735e34e7 2017-02-12 23:08:18,195Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 735e34e7 2017-02-12 23:08:18,196Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:09:08,634Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:13:21,784Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 23:13:21,786Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:13:21,799Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] START, FullListVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 72a81bf7 2017-02-12 23:13:21,873Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [32f3cb5f] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@1c7f8043, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4592598430, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 72a81bf7 2017-02-12 23:13:21,876Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-12 23:13:21,877Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-12 23:13:21,877Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [32f3cb5f] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 23:13:21,882Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler7) [12115dfe] skipping VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-12 23:13:21,901Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 3bc9b29d 2017-02-12 23:13:22,128Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@5a15096d, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4682496610, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 3bc9b29d 2017-02-12 23:13:22,130Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-12 23:13:22,131Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-12 23:13:22,921Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 23:13:22,923Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 74781d1 2017-02-12 23:13:23,367Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 74781d1 2017-02-12 23:13:23,367Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-12 23:13:23,517Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-14) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-12 23:13:23,537Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-45) [28d1e881] Running command: ProcessDownVmCommand internal: true. 2017-02-12 23:13:37,157Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [62417052] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-12 23:13:37,214Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-12 23:14:08,781Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:14:29,526Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 23:14:29,528Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5dd5f158 2017-02-12 23:14:30,110Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 5dd5f158 2017-02-12 23:14:30,111Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:19:09,078Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [62417052] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:20:55,531Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-12 23:20:55,532Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 104d3175 2017-02-12 23:20:55,730Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [62417052] Fetched 12 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 23:20:55,972Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 104d3175 2017-02-12 23:20:55,972Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:21:10,808Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [564da941] Fetched 11 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-12 23:24:09,393Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:25:20,026Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler9) [62417052] Attempting to update VMs/Templates Ovf. 2017-02-12 23:25:20,033Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 23:25:20,033Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 23:25:20,035Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-12 23:25:20,047Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Attempting to update VM OVFs in Data Center 'Default' 2017-02-12 23:25:20,057Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Successfully updated VM OVFs in Data Center 'Default' 2017-02-12 23:25:20,057Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Attempting to update template OVFs in Data Center 'Default' 2017-02-12 23:25:20,058Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Successfully updated templates OVFs in Data Center 'Default' 2017-02-12 23:25:20,058Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 23:25:20,060Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-12 23:25:20,061Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler9) [505db1b8] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-12 23:29:09,712Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:29:39,262Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 23:29:39,264Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2ba845a7 2017-02-12 23:29:40,518Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 2ba845a7 2017-02-12 23:29:40,519Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:30:35,807Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-21) [6e4b8a44] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 1af83ac2 2017-02-12 23:30:36,690Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-21) [6e4b8a44] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 1af83ac2 2017-02-12 23:30:36,695Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-21) [6e4b8a44] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-12 23:34:10,032Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:35:48,814Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 23:35:48,816Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: cadf9b6 2017-02-12 23:35:49,824Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: cadf9b6 2017-02-12 23:35:49,824Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:39:10,349Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:39:29,047Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-12 23:39:29,048Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 40bc7f92 2017-02-12 23:39:29,352Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 40bc7f92 2017-02-12 23:39:29,353Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:44:10,616Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:49:10,931Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:50:45,465Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-12 23:50:45,467Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5846230d 2017-02-12 23:50:46,158Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 5846230d 2017-02-12 23:50:46,159Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:52:09,887Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-12 23:52:09,888Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 313feb8a 2017-02-12 23:52:12,394Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 313feb8a 2017-02-12 23:52:12,394Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:54:11,247Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-12 23:56:09,404Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-12 23:56:09,406Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4b9b327d 2017-02-12 23:56:10,669Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 4b9b327d 2017-02-12 23:56:10,669Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:56:11,663Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-12 23:56:11,664Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 52f40238 2017-02-12 23:56:12,105Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 52f40238 2017-02-12 23:56:12,105Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-12 23:59:11,468Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:01:14,715Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 00:01:14,716Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3fcdda9f 2017-02-13 00:01:17,026Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 3fcdda9f 2017-02-13 00:01:17,026Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:04:11,783Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:08:49,480Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 00:08:49,481Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 382f7f87 2017-02-13 00:08:49,828Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 382f7f87 2017-02-13 00:08:49,828Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:09:12,102Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:12:38,098Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 00:12:38,100Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3e39412e 2017-02-13 00:12:38,232Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [534a3237] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 00:12:38,337Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 3e39412e 2017-02-13 00:12:38,337Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:12:45,349Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 00:12:45,350Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 618f6a72 2017-02-13 00:12:45,752Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 618f6a72 2017-02-13 00:12:45,753Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:12:53,310Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [32f3cb5f] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 00:14:12,239Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:19:12,383Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:23:00,690Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 00:23:00,691Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4405c05a 2017-02-13 00:23:01,259Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 4405c05a 2017-02-13 00:23:01,259Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:24:06,583Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 00:24:06,584Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 508e1062 2017-02-13 00:24:06,852Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 508e1062 2017-02-13 00:24:06,852Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:24:10,036Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 00:24:10,037Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 00:24:10,039Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6fa584b 2017-02-13 00:24:10,457Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, DestroyVDSCommand, log id: 6fa584b 2017-02-13 00:24:10,457Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:24:12,699Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [6e4b8a44] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:24:25,584Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [799858bf] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 00:24:34,073Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler7) [12115dfe] Backup check started. 2017-02-13 00:24:34,079Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler7) [12115dfe] Backup check completed. 2017-02-13 00:25:20,061Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler8) [6e4b8a44] Attempting to update VMs/Templates Ovf. 2017-02-13 00:25:20,068Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 00:25:20,068Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 00:25:20,070Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 00:25:20,082Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 00:25:20,093Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 00:25:20,093Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 00:25:20,093Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 00:25:20,094Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 00:25:20,095Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 00:25:20,097Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler8) [709d25bd] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 00:29:12,981Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:29:20,933Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 00:29:20,934Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 352f93b0 2017-02-13 00:29:21,283Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 352f93b0 2017-02-13 00:29:21,283Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:30:36,703Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-47) [12115dfe] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 678b961c 2017-02-13 00:30:37,717Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-47) [12115dfe] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 678b961c 2017-02-13 00:30:37,722Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-47) [12115dfe] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 00:34:13,300Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:39:13,618Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:39:18,751Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 00:39:18,752Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: d8e162e 2017-02-13 00:39:19,099Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: d8e162e 2017-02-13 00:39:19,099Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:44:13,933Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:49:14,210Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:49:15,115Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 00:49:15,117Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 69df282e 2017-02-13 00:49:15,787Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 69df282e 2017-02-13 00:49:15,788Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:49:21,452Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 00:49:21,453Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 574c7316 2017-02-13 00:49:22,613Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 574c7316 2017-02-13 00:49:22,613Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:50:46,022Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 00:50:46,023Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 525fed48 2017-02-13 00:50:46,181Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [709d25bd] Fetched 3 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 00:50:46,436Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 525fed48 2017-02-13 00:50:46,437Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 00:51:01,250Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [2d031f0a] Fetched 2 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 00:54:14,494Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 00:59:14,811Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:01:01,923Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 01:01:01,924Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4c239c61 2017-02-13 01:01:02,604Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 4c239c61 2017-02-13 01:01:02,604Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:01:03,734Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 01:01:03,736Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 23f24db1 2017-02-13 01:01:04,289Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 23f24db1 2017-02-13 01:01:04,289Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:02:24,681Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 01:02:24,683Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 62a7e21d 2017-02-13 01:02:25,981Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 62a7e21d 2017-02-13 01:02:25,981Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:04:15,128Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:04:44,646Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 01:04:44,647Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4990861 2017-02-13 01:04:44,936Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 4990861 2017-02-13 01:04:44,936Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:04:48,700Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 01:04:48,701Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: ce60bec 2017-02-13 01:04:49,639Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: ce60bec 2017-02-13 01:04:49,639Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:09:15,281Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:10:59,942Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 01:10:59,943Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 13726872 2017-02-13 01:11:00,417Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 13726872 2017-02-13 01:11:00,418Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:14:15,514Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:19:15,829Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [799858bf] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:24:15,964Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [32f3cb5f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:25:20,099Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler2) [32f3cb5f] Attempting to update VMs/Templates Ovf. 2017-02-13 01:25:20,106Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 01:25:20,106Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 01:25:20,108Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 01:25:20,120Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 01:25:20,131Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 01:25:20,131Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 01:25:20,131Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 01:25:20,131Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 01:25:20,133Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 01:25:20,135Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [38a59508] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 01:29:16,133Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [38a59508] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:30:37,726Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-32) [534a3237] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 155aced7 2017-02-13 01:30:38,739Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-32) [534a3237] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 155aced7 2017-02-13 01:30:38,744Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-32) [534a3237] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 01:31:06,683Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 01:31:06,685Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 518c2b69 2017-02-13 01:31:07,336Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 518c2b69 2017-02-13 01:31:07,336Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:34:16,450Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:37:10,797Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 01:37:10,799Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2c85ae94 2017-02-13 01:37:11,128Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 2c85ae94 2017-02-13 01:37:11,128Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:37:14,205Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [38a59508] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 01:37:14,206Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [38a59508] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 01:37:14,208Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler2) [38a59508] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 57412508 2017-02-13 01:37:15,617Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler2) [38a59508] FINISH, DestroyVDSCommand, log id: 57412508 2017-02-13 01:37:15,618Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [38a59508] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:37:31,630Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [709d25bd] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 01:39:16,759Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:44:17,090Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:49:17,406Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:49:43,467Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 01:49:43,469Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: c14f9f 2017-02-13 01:49:44,725Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: c14f9f 2017-02-13 01:49:44,725Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:52:18,141Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 01:52:18,143Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:52:18,152Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] START, FullListVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 7a6993e8 2017-02-13 01:52:18,259Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@47f14a11, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4602134610, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 7a6993e8 2017-02-13 01:52:18,261Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-13 01:52:18,261Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 01:52:18,261Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 01:52:19,347Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 01:52:19,349Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 48cacbac 2017-02-13 01:52:20,083Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 48cacbac 2017-02-13 01:52:20,083Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-13 01:52:20,182Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-2) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-13 01:52:20,268Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-50) [3c2b8d3a] Running command: ProcessDownVmCommand internal: true. 2017-02-13 01:52:32,188Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-13 01:52:32,206Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 4aff4153 2017-02-13 01:52:32,264Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@1f76471, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4692046730, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 4aff4153 2017-02-13 01:52:32,267Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 01:52:32,268Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 01:52:33,451Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [799858bf] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 01:54:17,729Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 01:54:54,994Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 01:54:54,996Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 57c327c7 2017-02-13 01:54:55,694Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 57c327c7 2017-02-13 01:54:55,694Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 01:59:18,045Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:00:07,757Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 02:00:07,759Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 169264c3 2017-02-13 02:00:08,961Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 169264c3 2017-02-13 02:00:08,961Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:01:15,849Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 02:01:15,850Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 477da878 2017-02-13 02:01:17,073Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 477da878 2017-02-13 02:01:17,073Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:04:18,296Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:09:18,613Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:11:31,290Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 02:11:31,291Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 772efb74 2017-02-13 02:11:31,566Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 772efb74 2017-02-13 02:11:31,566Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:14:18,927Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:15:15,498Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 02:15:15,500Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 63e1cd41 2017-02-13 02:15:16,295Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 63e1cd41 2017-02-13 02:15:16,296Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:19:19,244Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:24:19,393Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:25:20,136Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler10) [799858bf] Attempting to update VMs/Templates Ovf. 2017-02-13 02:25:20,143Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 02:25:20,143Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 02:25:20,145Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 02:25:20,157Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 02:25:20,168Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 02:25:20,168Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 02:25:20,169Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 02:25:20,169Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 02:25:20,170Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 02:25:20,172Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [6a60c961] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 02:27:36,920Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 02:27:36,921Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2e10b912 2017-02-13 02:27:37,914Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 2e10b912 2017-02-13 02:27:37,914Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:29:19,708Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:30:38,749Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-5) [38a59508] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 311a1313 2017-02-13 02:30:39,516Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-5) [38a59508] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 311a1313 2017-02-13 02:30:39,521Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-5) [38a59508] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 02:32:40,059Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 02:32:40,061Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 29e26a72 2017-02-13 02:32:40,610Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 29e26a72 2017-02-13 02:32:40,610Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:32:47,880Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 02:32:47,882Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4c5e53d0 2017-02-13 02:32:48,224Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 4c5e53d0 2017-02-13 02:32:48,224Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:34:20,026Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:39:20,343Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:42:49,347Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 02:42:49,349Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3bf39f21 2017-02-13 02:42:51,556Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 3bf39f21 2017-02-13 02:42:51,556Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:44:20,661Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [38a59508] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:48:59,825Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 02:48:59,826Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 40b2ac01 2017-02-13 02:49:00,063Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 40b2ac01 2017-02-13 02:49:00,063Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:49:20,977Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:51:36,093Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 02:51:36,094Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2acb9cf6 2017-02-13 02:51:36,429Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 2acb9cf6 2017-02-13 02:51:36,429Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:54:21,294Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 02:55:39,735Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 02:55:39,737Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1654bdb9 2017-02-13 02:55:40,686Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 1654bdb9 2017-02-13 02:55:40,687Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:56:57,731Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 02:56:57,732Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7609a21 2017-02-13 02:56:58,424Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 7609a21 2017-02-13 02:56:58,424Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 02:59:21,611Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [6a60c961] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:00:48,675Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 03:00:48,677Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7811c6d1 2017-02-13 03:00:49,200Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 7811c6d1 2017-02-13 03:00:49,200Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:02:05,339Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 03:02:05,340Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 448e04a2 2017-02-13 03:02:05,520Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [564da941] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 03:02:05,796Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 448e04a2 2017-02-13 03:02:05,796Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:02:20,576Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 03:04:21,927Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:09:22,243Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:12:07,643Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [564da941] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 03:12:07,644Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [564da941] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:12:07,651Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 5da7ee85 2017-02-13 03:12:07,699Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@2aae0ae6, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4591746930, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 5da7ee85 2017-02-13 03:12:07,702Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 03:12:07,702Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 03:12:09,214Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 03:12:09,216Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 34d7384c 2017-02-13 03:12:10,501Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 34d7384c 2017-02-13 03:12:10,501Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-13 03:12:10,651Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-13 03:12:10,670Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-16) [5e3c2633] Running command: ProcessDownVmCommand internal: true. 2017-02-13 03:12:21,573Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-13 03:12:21,590Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 797e5c09 2017-02-13 03:12:22,039Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@2cb21340, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4696836060, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 797e5c09 2017-02-13 03:12:22,042Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 03:12:22,042Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 03:12:22,771Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [2d031f0a] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 03:13:18,049Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 03:13:18,050Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 792293af 2017-02-13 03:13:18,264Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 792293af 2017-02-13 03:13:18,264Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:14:22,565Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:19:22,739Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:19:53,025Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 03:19:53,026Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 552a79ba 2017-02-13 03:19:53,369Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, DestroyVDSCommand, log id: 552a79ba 2017-02-13 03:19:53,369Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:22:29,131Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 03:22:29,132Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 34ba6aeb 2017-02-13 03:22:30,257Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-6) [] FINISH, DestroyVDSCommand, log id: 34ba6aeb 2017-02-13 03:22:30,257Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-6) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:24:23,039Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [2d031f0a] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:25:20,174Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler6) [2d031f0a] Attempting to update VMs/Templates Ovf. 2017-02-13 03:25:20,180Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 03:25:20,180Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 03:25:20,183Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 03:25:20,195Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 03:25:20,206Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 03:25:20,206Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 03:25:20,206Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 03:25:20,206Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 03:25:20,208Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 03:25:20,210Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler6) [19aed080] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 03:29:23,257Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [6a60c961] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:30:39,528Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-20) [12115dfe] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 7526369d 2017-02-13 03:30:40,534Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-20) [12115dfe] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 7526369d 2017-02-13 03:30:40,539Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-20) [12115dfe] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 03:34:23,573Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [6a60c961] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:35:35,001Z INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler8) [709d25bd] Start deleteAgedOutAuditLogs 2017-02-13 03:35:35,001Z INFO [org.ovirt.engine.core.bll.CommandEntityCleanupManager] (DefaultQuartzScheduler2) [38a59508] Start deleteAgedOutCommandEntities 2017-02-13 03:35:35,003Z INFO [org.ovirt.engine.core.bll.CommandEntityCleanupManager] (DefaultQuartzScheduler2) [38a59508] Finished deleteAgedOutCommandEntities 2017-02-13 03:35:35,013Z INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler8) [709d25bd] Finished deleteAgedOutAuditLogs 2017-02-13 03:37:14,310Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [3ea979a5] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 03:37:14,311Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:37:14,318Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 779ef8e8 2017-02-13 03:37:14,347Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler4) [3ea979a5] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@64f71f96, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4593253560, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 779ef8e8 2017-02-13 03:37:14,350Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 03:37:14,350Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler4) [3ea979a5] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 03:37:15,581Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 03:37:15,582Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4e80e120 2017-02-13 03:37:16,517Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 4e80e120 2017-02-13 03:37:16,517Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 03:37:27,960Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 03:37:27,979Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 47d03032 2017-02-13 03:37:28,241Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@36c7e63, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4698342380, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 47d03032 2017-02-13 03:37:28,242Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 03:37:28,243Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 03:37:29,413Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [709d25bd] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 03:37:29,414Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler8) [709d25bd] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 468af8c 2017-02-13 03:37:30,246Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler8) [709d25bd] FINISH, DestroyVDSCommand, log id: 468af8c 2017-02-13 03:37:30,246Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [709d25bd] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:37:46,257Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [534a3237] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 03:39:23,745Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:44:24,061Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:49:24,377Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:50:59,811Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 03:50:59,813Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3cfe4277 2017-02-13 03:51:01,064Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 3cfe4277 2017-02-13 03:51:01,064Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:54:24,677Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 03:55:04,331Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 03:55:04,333Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: a146fa2 2017-02-13 03:55:04,547Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 03:55:05,686Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: a146fa2 2017-02-13 03:55:05,686Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:55:19,627Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [709d25bd] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 03:58:52,865Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 03:58:52,867Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7f0216e0 2017-02-13 03:58:54,076Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 7f0216e0 2017-02-13 03:58:54,076Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 03:59:25,000Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:00:08,480Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 04:00:08,480Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5d87a45c 2017-02-13 04:00:08,769Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 5d87a45c 2017-02-13 04:00:08,769Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:01:29,715Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 04:01:29,717Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 30282277 2017-02-13 04:01:30,081Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 30282277 2017-02-13 04:01:30,082Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:04:25,317Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:07:44,099Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 04:07:44,100Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 23a1cf67 2017-02-13 04:07:45,754Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 23a1cf67 2017-02-13 04:07:45,754Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:09:25,592Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:14:25,827Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:15:13,803Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 04:15:13,804Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 69e529fb 2017-02-13 04:15:15,157Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 69e529fb 2017-02-13 04:15:15,157Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:19:25,981Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [6a60c961] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:24:26,282Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:25:20,211Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler2) [38a59508] Attempting to update VMs/Templates Ovf. 2017-02-13 04:25:20,218Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 04:25:20,218Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 04:25:20,220Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 04:25:20,232Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 04:25:20,243Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 04:25:20,243Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 04:25:20,245Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 04:25:20,246Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 04:25:20,249Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 04:25:20,250Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler2) [28a60b8f] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 04:26:24,602Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [534a3237] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 04:26:24,604Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:26:24,611Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] START, FullListVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 1dc543fc 2017-02-13 04:26:24,652Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@50b226f, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4605538200, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 1dc543fc 2017-02-13 04:26:24,655Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 04:26:24,655Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 04:26:24,687Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [6a60c961] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on '921245cb-5b54-411f-8e94-8c2302c2f9b4') 2017-02-13 04:26:24,706Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [6a60c961] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6f505847 2017-02-13 04:26:24,976Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler10) [6a60c961] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@4f3c5b55, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4701279050, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 6f505847 2017-02-13 04:26:24,979Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [6a60c961] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 04:26:24,979Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler10) [6a60c961] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 04:26:27,030Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 04:26:27,031Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5f0eaa94 2017-02-13 04:26:28,092Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 5f0eaa94 2017-02-13 04:26:28,092Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:26:39,783Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [19aed080] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 04:29:26,597Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:30:10,731Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 04:30:10,731Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:30:10,735Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 5655e512 2017-02-13 04:30:10,775Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@4823d749, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4596429900, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 5655e512 2017-02-13 04:30:10,777Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-13 04:30:10,777Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 04:30:10,777Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 04:30:10,795Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 04:30:10,805Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 7747389a 2017-02-13 04:30:11,097Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler5) [534a3237] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@7b596e8b, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4701505140, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 7747389a 2017-02-13 04:30:11,099Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 04:30:11,099Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler5) [534a3237] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 04:30:12,467Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 04:30:12,469Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 77492b19 2017-02-13 04:30:12,996Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 77492b19 2017-02-13 04:30:12,996Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:30:25,997Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [534a3237] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 04:30:40,543Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [19aed080] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 8a1b4d5 2017-02-13 04:30:40,797Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-33) [19aed080] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 8a1b4d5 2017-02-13 04:30:40,802Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-33) [19aed080] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 04:34:26,916Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [6a60c961] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:36:30,146Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 04:36:30,147Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 362806cd 2017-02-13 04:36:30,728Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 362806cd 2017-02-13 04:36:30,728Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:37:42,072Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 04:37:42,073Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4af8f8fe 2017-02-13 04:37:42,497Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 4af8f8fe 2017-02-13 04:37:42,498Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:39:27,210Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:44:27,527Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:49:27,826Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:51:33,266Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 04:51:33,268Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3b7ff5fb 2017-02-13 04:51:33,762Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 3b7ff5fb 2017-02-13 04:51:33,762Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:51:33,963Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 04:51:33,965Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 79d5b2a3 2017-02-13 04:51:34,416Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 79d5b2a3 2017-02-13 04:51:34,416Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:51:46,022Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 04:51:46,023Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3c985966 2017-02-13 04:51:46,347Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 3c985966 2017-02-13 04:51:46,348Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:54:28,143Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:55:34,727Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 04:55:34,728Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 30b835 2017-02-13 04:55:35,818Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 30b835 2017-02-13 04:55:35,818Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:58:09,604Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 04:58:09,605Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: c39f143 2017-02-13 04:58:09,973Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: c39f143 2017-02-13 04:58:09,973Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 04:59:28,458Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 04:59:33,045Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 04:59:33,046Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 735b63d4 2017-02-13 04:59:34,154Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 735b63d4 2017-02-13 04:59:34,154Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:04:28,742Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:09:29,058Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:10:54,935Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 05:10:54,936Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2a86be12 2017-02-13 05:10:55,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 2a86be12 2017-02-13 05:10:55,422Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:13:34,369Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 05:13:34,370Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 18c796de 2017-02-13 05:13:34,711Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 18c796de 2017-02-13 05:13:34,711Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:14:29,378Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:17:20,798Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 05:17:20,799Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 239b40a3 2017-02-13 05:17:21,120Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 239b40a3 2017-02-13 05:17:21,121Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:19:29,701Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:19:42,713Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 05:19:42,714Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 59ee4fa3 2017-02-13 05:19:42,998Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 59ee4fa3 2017-02-13 05:19:42,998Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:24:30,018Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:25:20,252Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler10) [6a60c961] Attempting to update VMs/Templates Ovf. 2017-02-13 05:25:20,258Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 05:25:20,258Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 05:25:20,260Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 05:25:20,271Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 05:25:20,281Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 05:25:20,281Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 05:25:20,282Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 05:25:20,282Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 05:25:20,283Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 05:25:20,285Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler10) [18cb8f8e] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 05:29:30,339Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:30:40,806Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-26) [28a60b8f] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 4cb8a9e9 2017-02-13 05:30:41,825Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-26) [28a60b8f] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 4cb8a9e9 2017-02-13 05:30:41,830Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-26) [28a60b8f] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 05:34:30,656Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:34:41,368Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 05:34:41,369Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:34:41,377Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 7df2bcf1 2017-02-13 05:34:41,403Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@52478ba0, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4600300460, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 7df2bcf1 2017-02-13 05:34:41,405Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 05:34:41,406Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 05:34:41,421Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler9) [505db1b8] skipping VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 05:34:41,438Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 10d81247 2017-02-13 05:34:42,505Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@34e6e528, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4705375720, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 10d81247 2017-02-13 05:34:42,507Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 05:34:42,508Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 05:34:43,803Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 05:34:43,805Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 316b638e 2017-02-13 05:34:45,038Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 316b638e 2017-02-13 05:34:45,039Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-13 05:34:45,188Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-9) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-13 05:34:45,208Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-35) [11d0b2f] Running command: ProcessDownVmCommand internal: true. 2017-02-13 05:34:56,584Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 05:34:57,609Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [5835e29b] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-13 05:35:55,437Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 05:35:55,439Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3f168b5 2017-02-13 05:35:56,125Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 3f168b5 2017-02-13 05:35:56,126Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:39:30,959Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:44:31,274Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [3ea979a5] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:47:11,755Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 05:47:11,756Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 74830056 2017-02-13 05:47:12,154Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 74830056 2017-02-13 05:47:12,154Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:49:31,596Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [505db1b8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:51:04,733Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 05:51:04,734Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 200c5905 2017-02-13 05:51:05,574Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 200c5905 2017-02-13 05:51:05,574Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:52:30,486Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 05:52:30,487Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: e60f34c 2017-02-13 05:52:31,292Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: e60f34c 2017-02-13 05:52:31,292Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:54:31,876Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:58:53,189Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 05:58:53,190Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 69cbfeae 2017-02-13 05:58:53,346Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 6 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 05:58:53,456Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 69cbfeae 2017-02-13 05:58:53,456Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 05:59:08,398Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler3) [5835e29b] Fetched 5 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 05:59:32,193Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 05:59:54,732Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 05:59:54,734Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6553434e 2017-02-13 05:59:55,940Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 6553434e 2017-02-13 05:59:55,940Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:01:11,681Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 06:01:11,682Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 233c1060 2017-02-13 06:01:12,576Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 233c1060 2017-02-13 06:01:12,576Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:01:19,213Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 06:01:19,215Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1124f05c 2017-02-13 06:01:20,250Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 1124f05c 2017-02-13 06:01:20,250Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:04:32,511Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [5835e29b] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:06:17,462Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 06:06:17,464Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 57d8bb6 2017-02-13 06:06:17,781Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 57d8bb6 2017-02-13 06:06:17,782Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:09:32,801Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:14:33,121Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:16:16,096Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 06:16:16,097Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5bd72ef0 2017-02-13 06:16:17,536Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 5bd72ef0 2017-02-13 06:16:17,536Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:19:33,440Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:24:33,754Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:24:34,079Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler3) [5835e29b] Backup check started. 2017-02-13 06:24:34,085Z INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (DefaultQuartzScheduler3) [5835e29b] Backup check completed. 2017-02-13 06:24:57,703Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 06:24:57,704Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5355c6ff 2017-02-13 06:24:58,893Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 5355c6ff 2017-02-13 06:24:58,893Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:25:20,287Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler3) [5835e29b] Attempting to update VMs/Templates Ovf. 2017-02-13 06:25:20,293Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 06:25:20,293Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 06:25:20,295Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 06:25:20,307Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 06:25:20,318Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 06:25:20,318Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 06:25:20,321Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 06:25:20,321Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 06:25:20,324Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 06:25:20,325Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler3) [1472dd6f] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 06:29:34,074Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:30:41,834Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-18) [18cb8f8e] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 1fc5bd21 2017-02-13 06:30:42,308Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-18) [18cb8f8e] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 1fc5bd21 2017-02-13 06:30:42,311Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-18) [18cb8f8e] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 06:32:26,069Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 06:32:26,070Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 624de877 2017-02-13 06:32:26,251Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [709d25bd] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 06:32:26,618Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 624de877 2017-02-13 06:32:26,618Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:32:29,136Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 06:32:29,137Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: a4306bb 2017-02-13 06:32:30,150Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: a4306bb 2017-02-13 06:32:30,150Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:32:41,282Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [19aed080] Fetched 0 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 06:34:34,345Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:39:34,625Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:43:52,382Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 06:43:52,384Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1563d6f4 2017-02-13 06:43:53,281Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 1563d6f4 2017-02-13 06:43:53,281Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:44:34,938Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [1472dd6f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:47:31,446Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 06:47:31,447Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 11e4fe91 2017-02-13 06:47:31,846Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 11e4fe91 2017-02-13 06:47:31,846Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:49:35,252Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:51:15,608Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [12115dfe] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 06:51:15,609Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:51:15,616Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] START, FullListVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 61d0f442 2017-02-13 06:51:15,651Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [12115dfe] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@2d84e08d, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4614229140, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 61d0f442 2017-02-13 06:51:15,653Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon} 2017-02-13 06:51:15,653Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 06:51:15,654Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 06:51:15,662Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler1) [564da941] skipping VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 06:51:15,675Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 79dcc424 2017-02-13 06:51:16,296Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@6351f41, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4709969860, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 79dcc424 2017-02-13 06:51:16,298Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 06:51:16,299Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 06:51:17,137Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 06:51:17,138Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1995b4a4 2017-02-13 06:51:17,556Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 1995b4a4 2017-02-13 06:51:17,557Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-13 06:51:17,704Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-5) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-13 06:51:17,723Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-36) [42700e1d] Running command: ProcessDownVmCommand internal: true. 2017-02-13 06:51:30,683Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 06:51:31,412Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [12115dfe] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-13 06:52:42,741Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 06:52:42,743Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6b30bb87 2017-02-13 06:52:43,107Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 6b30bb87 2017-02-13 06:52:43,107Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:54:35,568Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 06:59:06,980Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 06:59:06,982Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 22edea5e 2017-02-13 06:59:08,027Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 22edea5e 2017-02-13 06:59:08,027Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 06:59:35,889Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:02:59,079Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 07:02:59,080Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4007a6c7 2017-02-13 07:02:59,746Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 4007a6c7 2017-02-13 07:02:59,746Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:03:14,652Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 07:03:14,653Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 676f7079 2017-02-13 07:03:15,922Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 676f7079 2017-02-13 07:03:15,922Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:04:36,039Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [12115dfe] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:08:18,409Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 07:08:18,411Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 46d5c777 2017-02-13 07:08:19,681Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 46d5c777 2017-02-13 07:08:19,681Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:09:30,962Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 07:09:30,963Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7f55e4aa 2017-02-13 07:09:31,214Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 7f55e4aa 2017-02-13 07:09:31,215Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:09:36,367Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [1472dd6f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:09:38,795Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 07:09:38,797Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 37714f5d 2017-02-13 07:09:39,151Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-12) [] FINISH, DestroyVDSCommand, log id: 37714f5d 2017-02-13 07:09:39,151Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-12) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:14:36,683Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:19:36,983Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:23:28,633Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 07:23:28,634Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 318c8bf0 2017-02-13 07:23:29,296Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 318c8bf0 2017-02-13 07:23:29,296Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:24:37,305Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:25:20,326Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler7) [12115dfe] Attempting to update VMs/Templates Ovf. 2017-02-13 07:25:20,333Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 07:25:20,333Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 07:25:20,335Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 07:25:20,347Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 07:25:20,358Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 07:25:20,358Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 07:25:20,360Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 07:25:20,360Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 07:25:20,363Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 07:25:20,365Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [5b2e9e77] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 07:29:37,585Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:30:42,319Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-31) [18cb8f8e] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 23c7f0bd 2017-02-13 07:30:42,727Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-31) [18cb8f8e] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 23c7f0bd 2017-02-13 07:30:42,732Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-31) [18cb8f8e] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 07:32:19,369Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 07:32:19,370Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 38291490 2017-02-13 07:32:21,524Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 38291490 2017-02-13 07:32:21,524Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:34:37,901Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:35:48,896Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 07:35:48,897Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 20e059c1 2017-02-13 07:35:49,270Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 20e059c1 2017-02-13 07:35:49,270Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:39:38,219Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:44:38,451Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [5b2e9e77] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:48:49,439Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 07:48:49,441Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 65cfcd7c 2017-02-13 07:48:49,843Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 65cfcd7c 2017-02-13 07:48:49,843Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:49:38,766Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:51:04,284Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 07:51:04,285Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 49615451 2017-02-13 07:51:04,838Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 49615451 2017-02-13 07:51:04,838Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:51:12,701Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 07:51:12,702Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 276c9209 2017-02-13 07:51:14,449Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-8) [] FINISH, DestroyVDSCommand, log id: 276c9209 2017-02-13 07:51:14,449Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-8) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:52:21,547Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [505db1b8] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 07:52:21,549Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'WaitForLaunch' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:52:21,555Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 9f79812 2017-02-13 07:52:21,579Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] FINISH, FullListVDSCommand, return: [{status=WaitForLaunch, emulatedMachine=pc-i440fx-rhel7.3.0, guestDiskMapping={}, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, pid=0, devices=[Ljava.lang.Object;@62b9ef3b, smp=8, vmType=kvm, display=vnc, memSize=16384, cpuType=SandyBridge, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, statusTime=4617935450, vmName=HostedEngine, clientIp=, maxVCpus=16}], log id: 9f79812 2017-02-13 07:52:21,583Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] Received a virtio Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=virtio, specParams={source=urandom}, model=virtio, type=rng} 2017-02-13 07:52:21,583Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 07:52:24,018Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 07:52:24,020Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 411a8f42 2017-02-13 07:52:24,807Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 411a8f42 2017-02-13 07:52:24,807Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) moved from 'WaitForLaunch' --> 'Down' 2017-02-13 07:52:24,880Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-1) [] EVENT_ID: VM_DOWN_ERROR(119), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down with error. Exit message: resource busy: Failed to acquire lock: error -243. 2017-02-13 07:52:24,899Z INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-6-thread-12) [58b253f0] Running command: ProcessDownVmCommand internal: true. 2017-02-13 07:52:31,303Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [564da941] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Up' on VDS 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e'(ovirt07.mgmt.ns.imm.re) (expected on 'null') 2017-02-13 07:52:31,322Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] START, FullListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', vmIds='[696dcc9c-1c68-4546-8010-b0c697b62ff7]'}), log id: 6c108f9b 2017-02-13 07:52:31,504Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [564da941] FINISH, FullListVDSCommand, return: [{status=Up, kvmEnable=true, emulatedMachine=pc-i440fx-rhel7.3.0, afterMigrationStatus=, pid=16769, vmId=696dcc9c-1c68-4546-8010-b0c697b62ff7, devices=[Ljava.lang.Object;@309be5db, guestDiskMapping={dbf2386b-6abd-40cd-a={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, smp=8, memSize=16384, cpuType=SandyBridge, clientIp=, statusTime=4713645450, vmName=HostedEngine, display=vnc, maxVCpus=16}], log id: 6c108f9b 2017-02-13 07:52:31,507Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] Received a memballoon Device without an address when processing VM 696dcc9c-1c68-4546-8010-b0c697b62ff7 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=16777216, alias=balloon0} 2017-02-13 07:52:31,508Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [564da941] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' managed non pluggable device was removed unexpectedly from libvirt: 'VmDevice:{id='VmDeviceId:{deviceId='43733992-aab9-4c9a-b16d-e633a405f353', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7'}', device='cdrom', type='DISK', bootOrder='0', specParams='[path=]', address='', managed='true', plugged='false', readOnly='true', deviceAlias='', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}' 2017-02-13 07:52:34,458Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 07:52:34,459Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 60c7fa04 2017-02-13 07:52:34,866Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 60c7fa04 2017-02-13 07:52:34,867Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:52:36,629Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [534a3237] Fetched 0 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 07:54:39,081Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 07:57:32,173Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 07:57:32,174Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1be4398a 2017-02-13 07:57:32,624Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 1be4398a 2017-02-13 07:57:32,625Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 07:59:39,235Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:04:39,384Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [5b2e9e77] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:09:09,049Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 08:09:09,050Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4098e584 2017-02-13 08:09:09,379Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 4098e584 2017-02-13 08:09:09,379Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:09:15,124Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 08:09:15,126Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7ae16547 2017-02-13 08:09:16,405Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 7ae16547 2017-02-13 08:09:16,405Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:09:39,546Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:14:39,863Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:15:21,293Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 08:15:21,294Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 121a8f26 2017-02-13 08:15:21,645Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 121a8f26 2017-02-13 08:15:21,645Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:15:36,813Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 08:15:36,813Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 74b94091 2017-02-13 08:15:37,126Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, DestroyVDSCommand, log id: 74b94091 2017-02-13 08:15:37,126Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:15:37,136Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler4) [3ea979a5] skipping VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 08:16:05,975Z INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-103) [1259cb0a] Running command: CreateUserSessionCommand internal: false. 2017-02-13 08:16:56,834Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 08:16:56,835Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6079df74 2017-02-13 08:16:57,975Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 6079df74 2017-02-13 08:16:57,975Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:19:40,184Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [5b2e9e77] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:20:28,945Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 08:20:28,947Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6fd3d321 2017-02-13 08:20:29,216Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 6fd3d321 2017-02-13 08:20:29,216Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:24:40,457Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:25:20,366Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler4) [3ea979a5] Attempting to update VMs/Templates Ovf. 2017-02-13 08:25:20,373Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 08:25:20,373Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 08:25:20,375Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 08:25:20,388Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 08:25:20,398Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 08:25:20,399Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 08:25:20,401Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 08:25:20,401Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 08:25:20,404Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 08:25:20,405Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [601be296] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 08:29:40,744Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:30:22,576Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 08:30:22,577Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: d01092a 2017-02-13 08:30:23,181Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: d01092a 2017-02-13 08:30:23,181Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:30:42,742Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-18) [601be296] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 46f1fb90 2017-02-13 08:30:43,033Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-18) [601be296] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 46f1fb90 2017-02-13 08:30:43,038Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-18) [601be296] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 08:31:41,407Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 08:31:41,410Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7bb868ad 2017-02-13 08:31:42,239Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 7bb868ad 2017-02-13 08:31:42,240Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:33:01,965Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 08:33:01,967Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6bb3a785 2017-02-13 08:33:02,425Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 6bb3a785 2017-02-13 08:33:02,425Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:34:40,899Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [601be296] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:39:41,215Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [1472dd6f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:44:41,532Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:49:06,210Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 08:49:06,210Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 67aa9d2c 2017-02-13 08:49:06,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 67aa9d2c 2017-02-13 08:49:06,422Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:49:41,848Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler7) [5b2e9e77] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:53:12,347Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 08:53:12,348Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 26542dd7 2017-02-13 08:53:13,355Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 26542dd7 2017-02-13 08:53:13,355Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:54:42,164Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 08:55:45,093Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 08:55:45,095Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 1f2b4bc0 2017-02-13 08:55:46,329Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 1f2b4bc0 2017-02-13 08:55:46,330Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 08:56:34,192Z INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-13) [4c9ea38d] Running command: CreateUserSessionCommand internal: false. 2017-02-13 08:59:28,366Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] START, GetDeviceListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', storageType='ISCSI', checkStatus='false', lunIds='null'}), log id: 121a6bd1 2017-02-13 08:59:29,243Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] FINISH, GetDeviceListVDSCommand, return: [LUNs:{id='360fff12a9d329023998715010000c0f7', physicalVolumeId='cVU2aw-nQqw-cdUp-v6Xa-N187-ugeD-ocMZxc', volumeGroupId='7SivZu-C1fl-8fFz-WAH0-BRGh-MFzp-EwDEKu', serial='SEQLOGIC_100E-00_60FFF12A9D329023998715010000C0F7', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdb=true, sdc=true]', pathsCapacity='[sdb=5120, sdc=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}, LUNs:{id='360fff12a9d32f0c5d3874501000080ff', physicalVolumeId='xIRXYN-g3EH-Zzwy-t0A5-zw4j-tjgi-nA7H7F', volumeGroupId='Mvx9Mr-BIFB-mI17-zU8N-3bb1-aMgg-OQMQjG', serial='SEQLOGIC_100E-00_60FFF12A9D32F0C5D3874501000080FF', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdd=true]', pathsCapacity='[sdd=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}], log id: 121a6bd1 2017-02-13 08:59:29,384Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] START, GetDeviceListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', storageType='ISCSI', checkStatus='false', lunIds='null'}), log id: 69a18c18 2017-02-13 08:59:30,255Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] FINISH, GetDeviceListVDSCommand, return: [LUNs:{id='360fff12a9d329023998715010000c0f7', physicalVolumeId='cVU2aw-nQqw-cdUp-v6Xa-N187-ugeD-ocMZxc', volumeGroupId='7SivZu-C1fl-8fFz-WAH0-BRGh-MFzp-EwDEKu', serial='SEQLOGIC_100E-00_60FFF12A9D329023998715010000C0F7', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdb=true, sdc=true]', pathsCapacity='[sdb=5120, sdc=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}, LUNs:{id='360fff12a9d32f0c5d3874501000080ff', physicalVolumeId='xIRXYN-g3EH-Zzwy-t0A5-zw4j-tjgi-nA7H7F', volumeGroupId='Mvx9Mr-BIFB-mI17-zU8N-3bb1-aMgg-OQMQjG', serial='SEQLOGIC_100E-00_60FFF12A9D32F0C5D3874501000080FF', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdd=true]', pathsCapacity='[sdd=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}], log id: 69a18c18 2017-02-13 08:59:30,263Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] START, GetDeviceListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', storageType='ISCSI', checkStatus='false', lunIds='null'}), log id: 76ad4ccd 2017-02-13 08:59:31,192Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] FINISH, GetDeviceListVDSCommand, return: [LUNs:{id='360fff12a9d329023998715010000c0f7', physicalVolumeId='cVU2aw-nQqw-cdUp-v6Xa-N187-ugeD-ocMZxc', volumeGroupId='7SivZu-C1fl-8fFz-WAH0-BRGh-MFzp-EwDEKu', serial='SEQLOGIC_100E-00_60FFF12A9D329023998715010000C0F7', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdb=true, sdc=true]', pathsCapacity='[sdb=5120, sdc=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}, LUNs:{id='360fff12a9d32f0c5d3874501000080ff', physicalVolumeId='xIRXYN-g3EH-Zzwy-t0A5-zw4j-tjgi-nA7H7F', volumeGroupId='Mvx9Mr-BIFB-mI17-zU8N-3bb1-aMgg-OQMQjG', serial='SEQLOGIC_100E-00_60FFF12A9D32F0C5D3874501000080FF', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdd=true]', pathsCapacity='[sdd=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}], log id: 76ad4ccd 2017-02-13 08:59:31,253Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] START, GetDeviceListVDSCommand(HostName = ovirt07.mgmt.ns.imm.re, GetDeviceListVDSCommandParameters:{runAsync='true', hostId='d90e3320-8f50-43f4-ba5a-5f45be3cb90e', storageType='ISCSI', checkStatus='false', lunIds='null'}), log id: 2a95530f 2017-02-13 08:59:32,579Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (default task-40) [fd5ad1ea-9a03-4f2f-8660-5292faefedf6] FINISH, GetDeviceListVDSCommand, return: [LUNs:{id='360fff12a9d329023998715010000c0f7', physicalVolumeId='cVU2aw-nQqw-cdUp-v6Xa-N187-ugeD-ocMZxc', volumeGroupId='7SivZu-C1fl-8fFz-WAH0-BRGh-MFzp-EwDEKu', serial='SEQLOGIC_100E-00_60FFF12A9D329023998715010000C0F7', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdb=true, sdc=true]', pathsCapacity='[sdb=5120, sdc=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}, LUNs:{id='360fff12a9d32f0c5d3874501000080ff', physicalVolumeId='xIRXYN-g3EH-Zzwy-t0A5-zw4j-tjgi-nA7H7F', volumeGroupId='Mvx9Mr-BIFB-mI17-zU8N-3bb1-aMgg-OQMQjG', serial='SEQLOGIC_100E-00_60FFF12A9D32F0C5D3874501000080FF', lunMapping='0', vendorId='EQLOGIC', productId='100E-00', lunConnections='[StorageServerConnections:{id='null', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='5120', pvSize='5119', peCount='null', peAllocatedCount='null', vendorName='EQLOGIC', pathsDictionary='[sdd=true]', pathsCapacity='[sdd=5120]', lunType='ISCSI', status='Unknown', diskId='null', diskAlias='null', storageDomainId='null', storageDomainName='null', discardMaxSize='15728640', discardZeroesData='true'}], log id: 2a95530f 2017-02-13 08:59:42,478Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:01:07,027Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 09:01:07,028Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 151aeb8a 2017-02-13 09:01:07,677Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 151aeb8a 2017-02-13 09:01:07,678Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:01:15,410Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 09:01:15,411Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 743418ac 2017-02-13 09:01:16,179Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-2) [] FINISH, DestroyVDSCommand, log id: 743418ac 2017-02-13 09:01:16,179Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-2) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:04:42,604Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:07:21,028Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 09:07:21,030Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 10cbf62d 2017-02-13 09:07:21,033Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [709d25bd] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 09:07:21,520Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 10cbf62d 2017-02-13 09:07:21,520Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:07:36,187Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 09:09:42,746Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [1472dd6f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:11:05,060Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 09:11:05,062Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 162bdd05 2017-02-13 09:11:05,466Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-13) [] FINISH, DestroyVDSCommand, log id: 162bdd05 2017-02-13 09:11:05,466Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-13) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:14:43,065Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:19:43,382Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:22:16,743Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 09:22:16,745Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 451060b8 2017-02-13 09:22:17,081Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-15) [] FINISH, DestroyVDSCommand, log id: 451060b8 2017-02-13 09:22:17,081Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-15) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:23:13,501Z INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-89) [] User stringaro@Immobiliare successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2017-02-13 09:23:13,656Z INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-93) [6e0e64a2] Running command: CreateUserSessionCommand internal: false. 2017-02-13 09:24:43,701Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler6) [19aed080] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:25:20,408Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler7) [5b2e9e77] Attempting to update VMs/Templates Ovf. 2017-02-13 09:25:20,414Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 09:25:20,414Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 09:25:20,416Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 09:25:20,428Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 09:25:20,439Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 09:25:20,439Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 09:25:20,440Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 09:25:20,440Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 09:25:20,442Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 09:25:20,443Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler7) [70f81652] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 09:29:44,026Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [601be296] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:30:43,042Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-9) [19aed080] START, GetFileStatsVDSCommand( GetFileStatsParameters:{runAsync='true', storagePoolId='587906e2-00d5-022c-016c-000000000358', ignoreFailoverLimit='false'}), log id: 667bfe8a 2017-02-13 09:30:43,082Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-6-thread-9) [19aed080] FINISH, GetFileStatsVDSCommand, return: {7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso={status=0, ctime=1485771384.0, size=3166840832}}, log id: 667bfe8a 2017-02-13 09:30:43,084Z INFO [org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer] (org.ovirt.thread.pool-6-thread-9) [19aed080] Finished automatic refresh process for 'ISO' file type with success, for storage domain id 'a525f108-2a4d-4aa3-9eb8-f3b200fdba40'. 2017-02-13 09:34:44,346Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:34:48,128Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 09:34:48,129Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 43509342 2017-02-13 09:34:48,367Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 43509342 2017-02-13 09:34:48,367Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:34:51,054Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 09:34:51,056Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 2d44984d 2017-02-13 09:34:52,313Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-10) [] FINISH, DestroyVDSCommand, log id: 2d44984d 2017-02-13 09:34:52,313Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-10) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:35:00,660Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) 2017-02-13 09:35:00,662Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: abbb700 2017-02-13 09:35:00,980Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: abbb700 2017-02-13 09:35:00,980Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:39:44,662Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:44:44,978Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler1) [564da941] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:47:40,145Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 09:47:40,147Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4947c5d 2017-02-13 09:47:41,421Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-3) [] FINISH, DestroyVDSCommand, log id: 4947c5d 2017-02-13 09:47:41,422Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:48:48,943Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) 2017-02-13 09:48:48,943Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 26b25050 2017-02-13 09:48:49,655Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 26b25050 2017-02-13 09:48:49,655Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:49:45,296Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler5) [534a3237] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:50:12,691Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 09:50:12,692Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 19528b7d 2017-02-13 09:50:13,071Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, DestroyVDSCommand, log id: 19528b7d 2017-02-13 09:50:13,071Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:53:58,861Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) 2017-02-13 09:53:58,863Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] START, DestroyVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5061ab05 2017-02-13 09:54:01,237Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-9) [] FINISH, DestroyVDSCommand, log id: 5061ab05 2017-02-13 09:54:01,238Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:54:45,613Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler8) [709d25bd] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 09:56:29,211Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 09:56:29,212Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 685c0f8f 2017-02-13 09:56:29,540Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [] FINISH, DestroyVDSCommand, log id: 685c0f8f 2017-02-13 09:56:29,540Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 09:57:13,981Z INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 09:57:14,015Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] START, SetVdsStatusVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', status='PreparingForMaintenance', nonOperationalReason='NONE', stopSpmFailureLogged='true', maintenanceReason='null'}), log id: 21d0b6d3 2017-02-13 09:57:14,020Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] FINISH, SetVdsStatusVDSCommand, log id: 21d0b6d3 2017-02-13 09:57:14,181Z INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDS 2017-02-13 09:57:14,276Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] START, SetHaMaintenanceModeVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, SetHaMaintenanceModeVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4'}), log id: 1c31b735 2017-02-13 09:57:15,283Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] FINISH, SetHaMaintenanceModeVDSCommand, log id: 1c31b735 2017-02-13 09:57:15,293Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-34) [eafd4c9a-f096-46ad-8268-09e6fac76027] EVENT_ID: USER_VDS_MAINTENANCE_WITHOUT_REASON(620), Correlation ID: eafd4c9a-f096-46ad-8268-09e6fac76027, Job ID: 18f2cc08-6561-4c4b-98d4-f44995c04f68, Call Stack: null, Custom Event ID: -1, Message: Host ovirt06.mgmt.ns.imm.re was switched to Maintenance mode by fagiani@Immobiliare-authz. 2017-02-13 09:57:17,029Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler1) [564da941] Updated host status from 'Preparing for Maintenance' to 'Maintenance' in database, host 'ovirt06.mgmt.ns.imm.re'(921245cb-5b54-411f-8e94-8c2302c2f9b4) 2017-02-13 09:57:17,037Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-8) [] Clearing cache of pool: '587906e2-00d5-022c-016c-000000000358' for problematic entities of VDS: 'ovirt06.mgmt.ns.imm.re'. 2017-02-13 09:57:17,037Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-8) [] Removing vds '[921245cb-5b54-411f-8e94-8c2302c2f9b4]' from the domain in maintenance cache 2017-02-13 09:57:17,037Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-8) [] Removing host(s) '[921245cb-5b54-411f-8e94-8c2302c2f9b4]' from hosts unseen domain report cache 2017-02-13 09:57:17,038Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler1) [564da941] START, DisconnectStoragePoolVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DisconnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', vds_spm_id='6'}), log id: 233e2043 2017-02-13 09:57:20,414Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler1) [564da941] FINISH, DisconnectStoragePoolVDSCommand, log id: 233e2043 2017-02-13 09:57:20,422Z INFO [org.ovirt.engine.core.bll.storage.pool.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler1) [587718ab] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 09:57:20,459Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [587718ab] START, DisconnectStorageServerVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 5b838d11 2017-02-13 09:57:21,916Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [587718ab] FINISH, DisconnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 5b838d11 2017-02-13 09:57:21,918Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [587718ab] START, DisconnectStorageServerVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 2166738d 2017-02-13 09:57:22,567Z INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 09:57:22,585Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] START, SetVdsStatusVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', status='PreparingForMaintenance', nonOperationalReason='NONE', stopSpmFailureLogged='true', maintenanceReason='null'}), log id: 51fbe2e6 2017-02-13 09:57:22,588Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] FINISH, SetVdsStatusVDSCommand, log id: 51fbe2e6 2017-02-13 09:57:22,695Z INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 09:57:22,750Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] START, SetHaMaintenanceModeVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, SetHaMaintenanceModeVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec'}), log id: 13ae28e 2017-02-13 09:57:22,752Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [587718ab] FINISH, DisconnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 2166738d 2017-02-13 09:57:23,760Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] FINISH, SetHaMaintenanceModeVDSCommand, log id: 13ae28e 2017-02-13 09:57:23,796Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-65) [2183269c-e88f-4b56-81e6-386278aac543] EVENT_ID: USER_VDS_MAINTENANCE_WITHOUT_REASON(620), Correlation ID: 2183269c-e88f-4b56-81e6-386278aac543, Job ID: 3677bd44-ffa9-4a23-b344-025a060c5713, Call Stack: null, Custom Event ID: -1, Message: Host ovirt05.mgmt.ns.imm.re was switched to Maintenance mode by fagiani@Immobiliare-authz. 2017-02-13 09:57:26,813Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler1) [587718ab] Updated host status from 'Preparing for Maintenance' to 'Maintenance' in database, host 'ovirt05.mgmt.ns.imm.re'(ecef3dab-8795-48d3-a108-81ad29527bec) 2017-02-13 09:57:26,829Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-46) [] Clearing cache of pool: '587906e2-00d5-022c-016c-000000000358' for problematic entities of VDS: 'ovirt05.mgmt.ns.imm.re'. 2017-02-13 09:57:26,829Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-46) [] Removing vds '[ecef3dab-8795-48d3-a108-81ad29527bec]' from the domain in maintenance cache 2017-02-13 09:57:26,829Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-46) [] Removing host(s) '[ecef3dab-8795-48d3-a108-81ad29527bec]' from hosts unseen domain report cache 2017-02-13 09:57:26,832Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler1) [587718ab] START, DisconnectStoragePoolVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, DisconnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', vds_spm_id='5'}), log id: a271e4f 2017-02-13 09:57:30,745Z INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 09:57:30,780Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] START, SetVdsStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', status='PreparingForMaintenance', nonOperationalReason='NONE', stopSpmFailureLogged='true', maintenanceReason='null'}), log id: 49e5ec93 2017-02-13 09:57:30,865Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] FINISH, SetVdsStatusVDSCommand, log id: 49e5ec93 2017-02-13 09:57:31,061Z INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 09:57:31,172Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] START, SetHaMaintenanceModeVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetHaMaintenanceModeVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8'}), log id: 3e6b527 2017-02-13 09:57:31,190Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] FINISH, SetHaMaintenanceModeVDSCommand, log id: 3e6b527 2017-02-13 09:57:31,198Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-77) [2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e] EVENT_ID: USER_VDS_MAINTENANCE_WITHOUT_REASON(620), Correlation ID: 2a6f206e-1230-44dd-8eb9-2ae4bf99ae4e, Job ID: 0ebf26f0-a94c-4622-b44e-bf028104071c, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re was switched to Maintenance mode by fagiani@Immobiliare-authz. 2017-02-13 09:57:31,584Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler5) [534a3237] Updated host status from 'Preparing for Maintenance' to 'Maintenance' in database, host 'ovirt01.mgmt.ns.imm.re'(1b1f2260-2de7-4fe1-9969-d2ac556340d8) 2017-02-13 09:57:31,692Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-13) [] Clearing cache of pool: '587906e2-00d5-022c-016c-000000000358' for problematic entities of VDS: 'ovirt01.mgmt.ns.imm.re'. 2017-02-13 09:57:31,692Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-13) [] Removing vds '[1b1f2260-2de7-4fe1-9969-d2ac556340d8]' from the domain in maintenance cache 2017-02-13 09:57:31,692Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-13) [] Removing host(s) '[1b1f2260-2de7-4fe1-9969-d2ac556340d8]' from hosts unseen domain report cache 2017-02-13 09:57:31,696Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler5) [534a3237] START, DisconnectStoragePoolVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, DisconnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', vds_spm_id='2'}), log id: 2e9e9bab 2017-02-13 09:57:31,700Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler1) [587718ab] FINISH, DisconnectStoragePoolVDSCommand, log id: a271e4f 2017-02-13 09:57:31,708Z INFO [org.ovirt.engine.core.bll.storage.pool.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler1) [841e74e] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 09:57:31,733Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [841e74e] START, DisconnectStorageServerVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 2a76eb94 2017-02-13 09:57:33,265Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [841e74e] FINISH, DisconnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 2a76eb94 2017-02-13 09:57:33,267Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [841e74e] START, DisconnectStorageServerVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 16e1a8ee 2017-02-13 09:57:33,657Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler1) [841e74e] FINISH, DisconnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 16e1a8ee 2017-02-13 09:57:37,511Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler5) [534a3237] FINISH, DisconnectStoragePoolVDSCommand, log id: 2e9e9bab 2017-02-13 09:57:37,515Z INFO [org.ovirt.engine.core.bll.storage.pool.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler5) [343f79c2] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 09:57:37,538Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler5) [343f79c2] START, DisconnectStorageServerVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 5a5a8bf3 2017-02-13 09:57:38,990Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler5) [343f79c2] FINISH, DisconnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 5a5a8bf3 2017-02-13 09:57:38,992Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler5) [343f79c2] START, DisconnectStorageServerVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: e3af4af 2017-02-13 09:57:39,562Z INFO [org.ovirt.engine.core.bll.hostdeploy.UpgradeHostCommand] (default task-125) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Running command: UpgradeHostCommand internal: false. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 09:57:39,575Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-125) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: HOST_UPGRADE_STARTED(840), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re upgrade was started (User: fagiani@Immobiliare-authz). 2017-02-13 09:57:40,317Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler5) [343f79c2] FINISH, DisconnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: e3af4af 2017-02-13 09:57:40,518Z INFO [org.ovirt.engine.core.bll.hostdeploy.HostUpgradeCallback] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Host 'ovirt01.mgmt.ns.imm.re' is on maintenance mode. Proceeding with Upgrade process. 2017-02-13 09:57:40,741Z INFO [org.ovirt.engine.core.bll.hostdeploy.UpgradeHostInternalCommand] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Running command: UpgradeHostInternalCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 09:57:40,762Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] START, SetVdsStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4d2903ce 2017-02-13 09:57:40,766Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] FINISH, SetVdsStatusVDSCommand, log id: 4d2903ce 2017-02-13 09:57:40,847Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Connected to host ovirt01.mgmt.ns.imm.re with SSH key fingerprint: SHA256:EtSHGkg2vTLM3IWhWqZgSpfQMDrSgfPOG6uiAWDJiSE. 2017-02-13 09:57:40,902Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Installation of ovirt01.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 09:57:40,903Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 09:57:40,926Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] SSH execute 'root@ovirt01.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-mgmt DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 09:57:42,523Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 09:57:42,544Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 09:57:42,567Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 09:57:55,576Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 09:57:55,629Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 09:57:55,679Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-mgmt-20170213095734-tb5g5d.log'. 2017-02-13 09:57:55,789Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 09:57:55,833Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 09:57:55,990Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 09:57:56,034Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 09:58:02,447Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Status: Downloading Packages. 2017-02-13 09:58:02,642Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Download/Verify: mom-0.5.8-1.el7.centos.noarch. 2017-02-13 09:58:02,686Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Status: Check Package Signatures. 2017-02-13 09:58:02,728Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Status: Running Test Transaction. 2017-02-13 09:58:02,924Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Status: Running Transaction. 2017-02-13 09:58:03,088Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum update: 1/2: mom-0.5.8-1.el7.centos.noarch. 2017-02-13 09:58:03,409Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum updated: 2/2: mom. 2017-02-13 09:58:03,651Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Verify: 1/2: mom.noarch 0:0.5.8-1.el7.centos - u. 2017-02-13 09:58:03,696Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Yum Verify: 2/2: mom.noarch 0:0.5.8-1.el7 - ud. 2017-02-13 09:58:03,837Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 09:58:03,881Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 09:58:04,034Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 09:58:04,078Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Pre-termination. 2017-02-13 09:58:04,144Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-mgmt-20170213095804-ovirt01.mgmt.ns.imm.re-697d3927-2ab0-447c-b934-b5a0fbcaa2a8.log'. 2017-02-13 09:58:04,421Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Termination. 2017-02-13 09:58:05,475Z INFO [org.ovirt.engine.core.bll.host.HostConnectivityChecker] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Engine managed to communicate with VDSM agent on host 'ovirt01.mgmt.ns.imm.re' with address 'ovirt01.mgmt.ns.imm.re' ('1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 09:58:05,514Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] START, SetVdsStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', status='Maintenance', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 47a160f0 2017-02-13 09:58:05,519Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] FINISH, SetVdsStatusVDSCommand, log id: 47a160f0 2017-02-13 09:58:05,755Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-2) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] EVENT_ID: HOST_UPGRADE_FINISHED(842), Correlation ID: 697d3927-2ab0-447c-b934-b5a0fbcaa2a8, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re upgrade was completed successfully. 2017-02-13 09:58:11,870Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] Running command: InstallVdsCommand internal: false. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 09:58:11,964Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[ecef3dab-8795-48d3-a108-81ad29527bec=]', sharedLocks='null'}' 2017-02-13 09:58:12,002Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 09:58:12,002Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Before Installation host ecef3dab-8795-48d3-a108-81ad29527bec, ovirt05.mgmt.ns.imm.re 2017-02-13 09:58:12,028Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] START, SetVdsStatusVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4c5b52e7 2017-02-13 09:58:12,030Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] FINISH, SetVdsStatusVDSCommand, log id: 4c5b52e7 2017-02-13 09:58:12,104Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Connected to host ovirt05.mgmt.ns.imm.re with SSH key fingerprint: SHA256:o1trtgzFEGcMWvR/d/E2iLCRaBq3Pj2Gx1gmbP8exHg. 2017-02-13 09:58:12,160Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Installation of ovirt05.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 09:58:12,161Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 09:58:12,184Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] SSH execute 'root@ovirt05.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 09:58:12,209Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt05.mgmt.ns.imm.re using Proxy Host ovirt04.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.221 . 2017-02-13 09:58:12,210Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] START, FenceVdsVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', targetVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', action='STATUS', agent='FenceAgent:{id='05345553-80f9-4e61-8047-a851f4506466', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', order='1', type='ipmilan', ip='192.168.128.221 ', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 6865a921 2017-02-13 09:58:12,665Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 6865a921 2017-02-13 09:58:12,675Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-21) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: USER_UPDATE_VDS(43), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Host ovirt05.mgmt.ns.imm.re configuration was updated by fagiani@Immobiliare-authz. 2017-02-13 09:58:14,424Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 09:58:14,502Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 09:58:14,582Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 09:58:27,649Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 09:58:27,684Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 09:58:28,199Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Kdump supported. 2017-02-13 09:58:28,599Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-deploy-20170213095805-tu59m8.log'. 2017-02-13 09:58:28,660Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] Host ovirt05.mgmt.ns.imm.re reports unique id 4C4C4544-0052-3110-8051-B8C04F42354A 2017-02-13 09:58:28,748Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] Assigning unique id 4C4C4544-0052-3110-8051-B8C04F42354A to Host ovirt05.mgmt.ns.imm.re 2017-02-13 09:58:28,985Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 09:58:29,200Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Hardware supports virtualization. 2017-02-13 09:58:29,577Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 09:58:29,683Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 09:58:29,726Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 09:58:44,333Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 09:58:44,356Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Setting time. 2017-02-13 09:58:47,195Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Enrolling certificate. 2017-02-13 09:58:48,333Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Enrolling serial console certificate. 2017-02-13 09:58:50,375Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 09:58:50,514Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Setting kernel arguments. 2017-02-13 09:58:50,747Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 09:58:53,787Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Restarting kdump. 2017-02-13 09:59:45,803Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:00:06,614Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stopping libvirtd. 2017-02-13 10:00:06,663Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Starting vdsm. 2017-02-13 10:00:13,244Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Starting ovirt-vmconsole-host-sshd. 2017-02-13 10:00:13,532Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Pre-termination. 2017-02-13 10:00:13,591Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20170213100013-ovirt05.mgmt.ns.imm.re-940f0be7-92f7-4137-9181-917f78104e0a.log'. 2017-02-13 10:00:14,301Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt05.mgmt.ns.imm.re. Stage: Termination. 2017-02-13 10:00:14,355Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt05.mgmt.ns.imm.re/192.168.128.176 2017-02-13 10:00:15,957Z INFO [org.ovirt.engine.core.bll.host.HostConnectivityChecker] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Engine managed to communicate with VDSM agent on host 'ovirt05.mgmt.ns.imm.re' with address 'ovirt05.mgmt.ns.imm.re' ('ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 10:00:17,651Z INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] The management network 'ovirtmgmt' is already configured on host 'ovirt05.mgmt.ns.imm.re' 2017-02-13 10:00:17,687Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] START, SetVdsStatusVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', status='Initializing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4c6e00c8 2017-02-13 10:00:17,691Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] FINISH, SetVdsStatusVDSCommand, log id: 4c6e00c8 2017-02-13 10:00:17,691Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] After Installation host ovirt05.mgmt.ns.imm.re, VDS 2017-02-13 10:00:17,699Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] EVENT_ID: VDS_INSTALL(504), Correlation ID: 940f0be7-92f7-4137-9181-917f78104e0a, Call Stack: null, Custom Event ID: -1, Message: Host ovirt05.mgmt.ns.imm.re installed 2017-02-13 10:00:17,702Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-48) [940f0be7-92f7-4137-9181-917f78104e0a] Lock freed to object 'EngineLock:{exclusiveLocks='[ecef3dab-8795-48d3-a108-81ad29527bec=]', sharedLocks='null'}' 2017-02-13 10:00:21,582Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler3) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] START, GetHardwareInfoVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vds='Host[ovirt05.mgmt.ns.imm.re,ecef3dab-8795-48d3-a108-81ad29527bec]'}), log id: 2bf5f29c 2017-02-13 10:00:22,540Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler3) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] FINISH, GetHardwareInfoVDSCommand, log id: 2bf5f29c 2017-02-13 10:00:22,763Z INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler3) [49641278] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 10:00:22,821Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [49641278] START, GlusterServersListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec'}), log id: 5cb11f9f 2017-02-13 10:00:23,957Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [49641278] FINISH, GlusterServersListVDSCommand, return: [10.10.10.105/24:CONNECTED], log id: 5cb11f9f 2017-02-13 10:00:23,965Z INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler3) [347ced96] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:00:23,983Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler3) [796ed3b1] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:00:24,018Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] START, ConnectStorageServerVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 3aa7a3b0 2017-02-13 10:00:26,531Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] FINISH, ConnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 3aa7a3b0 2017-02-13 10:00:26,533Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] START, ConnectStorageServerVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 43a4b49d 2017-02-13 10:00:27,106Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] FINISH, ConnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 43a4b49d 2017-02-13 10:00:27,116Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler3) [796ed3b1] Host 'ovirt05.mgmt.ns.imm.re' storage connection was succeeded 2017-02-13 10:00:27,139Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-24) [] START, ConnectStoragePoolVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vdsId='ecef3dab-8795-48d3-a108-81ad29527bec', storagePoolId='587906e2-00d5-022c-016c-000000000358', masterVersion='4'}), log id: 51099df5 2017-02-13 10:00:27,139Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-24) [] Executing with domain map: {bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f=active, a525f108-2a4d-4aa3-9eb8-f3b200fdba40=active, 95e50e3d-1624-4480-9b96-418d52b77abb=active, 93c77d46-60d2-4dfa-a250-a235ac21c011=active} 2017-02-13 10:00:29,372Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-24) [] FINISH, ConnectStoragePoolVDSCommand, log id: 51099df5 2017-02-13 10:00:30,344Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [796ed3b1] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt05.mgmt.ns.imm.re using Proxy Host ovirt03.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.221 . 2017-02-13 10:00:30,345Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] START, FenceVdsVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', targetVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', action='STATUS', agent='FenceAgent:{id='05345553-80f9-4e61-8047-a851f4506466', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', order='1', type='ipmilan', ip='192.168.128.221 ', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 41782a6d 2017-02-13 10:00:31,168Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 41782a6d 2017-02-13 10:00:31,205Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] START, SetMOMPolicyParametersVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, MomPolicyVDSParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec'}), log id: 2f438005 2017-02-13 10:00:31,676Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler3) [796ed3b1] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2f438005 2017-02-13 10:00:31,722Z INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (DefaultQuartzScheduler3) [24f6b397] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:00:32,194Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [24f6b397] EVENT_ID: VDS_DETECTED(13), Correlation ID: 347ced96, Call Stack: null, Custom Event ID: -1, Message: Status of host ovirt05.mgmt.ns.imm.re was set to Up. 2017-02-13 10:00:32,199Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [24f6b397] EVENT_ID: VDS_FENCE_STATUS(496), Correlation ID: 347ced96, Call Stack: null, Custom Event ID: -1, Message: Host ovirt05.mgmt.ns.imm.re power management was verified successfully. 2017-02-13 10:00:32,257Z INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler3) [233f11ee] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 10:01:55,148Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Running command: InstallVdsCommand internal: false. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 10:01:55,238Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Lock Acquired to object 'EngineLock:{exclusiveLocks='[1b1f2260-2de7-4fe1-9969-d2ac556340d8=]', sharedLocks='null'}' 2017-02-13 10:01:55,275Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 10:01:55,275Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Before Installation host 1b1f2260-2de7-4fe1-9969-d2ac556340d8, ovirt01.mgmt.ns.imm.re 2017-02-13 10:01:55,325Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] START, SetVdsStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 62ad8d37 2017-02-13 10:01:55,329Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] FINISH, SetVdsStatusVDSCommand, log id: 62ad8d37 2017-02-13 10:01:55,428Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Connected to host ovirt01.mgmt.ns.imm.re with SSH key fingerprint: SHA256:EtSHGkg2vTLM3IWhWqZgSpfQMDrSgfPOG6uiAWDJiSE. 2017-02-13 10:01:55,469Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Installation of ovirt01.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 10:01:55,469Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 10:01:55,515Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] SSH execute 'root@ovirt01.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 10:01:55,701Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt01.mgmt.ns.imm.re using Proxy Host ovirt05.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.217. 2017-02-13 10:01:55,702Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] START, FenceVdsVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', targetVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', action='STATUS', agent='FenceAgent:{id='abc92f4f-da3d-48e9-a146-be2917e0105f', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', order='1', type='ipmilan', ip='192.168.128.217', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 7b76496e 2017-02-13 10:01:56,952Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 7b76496e 2017-02-13 10:01:56,999Z WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: KDUMP_DETECTION_NOT_CONFIGURED_ON_VDS(617), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Kdump integration is enabled for host ovirt01.mgmt.ns.imm.re, but kdump is not configured properly on host. 2017-02-13 10:01:57,009Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-120) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: USER_UPDATE_VDS(43), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re configuration was updated by fagiani@Immobiliare-authz. 2017-02-13 10:01:57,528Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 10:01:57,630Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 10:01:57,687Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 10:02:06,413Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 10:02:06,456Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 10:02:07,096Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Kdump supported. 2017-02-13 10:02:07,433Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-deploy-20170213100149-m2bfrl.log'. 2017-02-13 10:02:07,500Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Host ovirt01.mgmt.ns.imm.re reports unique id 4C4C4544-005A-4710-8051-B6C04F42354A 2017-02-13 10:02:07,585Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Assigning unique id 4C4C4544-005A-4710-8051-B6C04F42354A to Host ovirt01.mgmt.ns.imm.re 2017-02-13 10:02:07,840Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 10:02:08,079Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Hardware supports virtualization. 2017-02-13 10:02:08,430Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 10:02:08,506Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:02:08,529Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 10:02:19,960Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:02:19,990Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Setting time. 2017-02-13 10:02:24,928Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Enrolling certificate. 2017-02-13 10:02:26,173Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Enrolling serial console certificate. 2017-02-13 10:02:28,247Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 10:02:28,388Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Setting kernel arguments. 2017-02-13 10:02:28,658Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 10:02:31,875Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Restarting kdump. 2017-02-13 10:03:54,607Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stopping libvirtd. 2017-02-13 10:03:54,653Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Starting vdsm. 2017-02-13 10:04:02,425Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Starting ovirt-vmconsole-host-sshd. 2017-02-13 10:04:02,736Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Pre-termination. 2017-02-13 10:04:02,795Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20170213100402-ovirt01.mgmt.ns.imm.re-5e4533ab-4687-48b8-9f69-2a8db17e5dce.log'. 2017-02-13 10:04:03,478Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt01.mgmt.ns.imm.re. Stage: Termination. 2017-02-13 10:04:03,503Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt01.mgmt.ns.imm.re/192.168.128.172 2017-02-13 10:04:04,194Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Error: Recovering from crash or Initializing 2017-02-13 10:04:04,194Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:42) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand.proceedProxyReturnValue(PollVDSCommand.java:31) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.FutureVDSCommand.get(FutureVDSCommand.java:70) [vdsbroker.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworkPoller.getValue(HostSetupNetworkPoller.java:56) [bll.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworkPoller.poll(HostSetupNetworkPoller.java:41) [bll.jar:] at org.ovirt.engine.core.bll.host.HostConnectivityChecker.check(HostConnectivityChecker.java:21) [bll.jar:] at org.ovirt.engine.core.bll.network.NetworkConfigurator.awaitVdsmResponse(NetworkConfigurator.java:123) [bll.jar:] at org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand.configureManagementNetwork(InstallVdsInternalCommand.java:210) [bll.jar:] at org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand.installHost(InstallVdsInternalCommand.java:181) [bll.jar:] at org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand.executeCommand(InstallVdsInternalCommand.java:87) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1251) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1391) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:2055) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1451) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:397) [bll.jar:] at org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.executeValidatedCommand(PrevalidatingMultipleActionsRunner.java:204) [bll.jar:] at org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.runCommands(PrevalidatingMultipleActionsRunner.java:176) [bll.jar:] at org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.lambda$invokeCommands$3(PrevalidatingMultipleActionsRunner.java:182) [bll.jar:] at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:92) [utils.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_121] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_121] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_121] 2017-02-13 10:04:04,195Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Command 'PollVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8'})' execution failed: Recovering from crash or Initializing 2017-02-13 10:04:04,705Z INFO [org.ovirt.engine.core.bll.host.HostConnectivityChecker] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Engine managed to communicate with VDSM agent on host 'ovirt01.mgmt.ns.imm.re' with address 'ovirt01.mgmt.ns.imm.re' ('1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 10:04:05,524Z INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] The management network 'ovirtmgmt' is already configured on host 'ovirt01.mgmt.ns.imm.re' 2017-02-13 10:04:05,561Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] START, SetVdsStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', status='Initializing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: c3999fa 2017-02-13 10:04:05,565Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] FINISH, SetVdsStatusVDSCommand, log id: c3999fa 2017-02-13 10:04:05,565Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] After Installation host ovirt01.mgmt.ns.imm.re, VDS 2017-02-13 10:04:05,573Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] EVENT_ID: VDS_INSTALL(504), Correlation ID: 5e4533ab-4687-48b8-9f69-2a8db17e5dce, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re installed 2017-02-13 10:04:05,575Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-25) [5e4533ab-4687-48b8-9f69-2a8db17e5dce] Lock freed to object 'EngineLock:{exclusiveLocks='[1b1f2260-2de7-4fe1-9969-d2ac556340d8=]', sharedLocks='null'}' 2017-02-13 10:04:08,939Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler7) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] START, GetHardwareInfoVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vds='Host[ovirt01.mgmt.ns.imm.re,1b1f2260-2de7-4fe1-9969-d2ac556340d8]'}), log id: 5ea2352d 2017-02-13 10:04:09,005Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler7) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] FINISH, GetHardwareInfoVDSCommand, log id: 5ea2352d 2017-02-13 10:04:09,183Z INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler7) [2665831f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 10:04:09,228Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler7) [2665831f] START, GlusterServersListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8'}), log id: 100787bf 2017-02-13 10:04:10,213Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler7) [2665831f] FINISH, GlusterServersListVDSCommand, return: [10.10.10.101/24:CONNECTED], log id: 100787bf 2017-02-13 10:04:10,221Z INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler7) [6f84a0bf] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:04:10,236Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler7) [7e0ead80] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:04:10,280Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] START, ConnectStorageServerVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 33bdc7a7 2017-02-13 10:04:12,430Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] FINISH, ConnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 33bdc7a7 2017-02-13 10:04:12,431Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] START, ConnectStorageServerVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 80d6317 2017-02-13 10:04:13,624Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] FINISH, ConnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 80d6317 2017-02-13 10:04:13,635Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler7) [7e0ead80] Host 'ovirt01.mgmt.ns.imm.re' storage connection was succeeded 2017-02-13 10:04:13,658Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-31) [] START, ConnectStoragePoolVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', storagePoolId='587906e2-00d5-022c-016c-000000000358', masterVersion='4'}), log id: 1de6b33c 2017-02-13 10:04:13,659Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-31) [] Executing with domain map: {bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f=active, a525f108-2a4d-4aa3-9eb8-f3b200fdba40=active, 95e50e3d-1624-4480-9b96-418d52b77abb=active, 93c77d46-60d2-4dfa-a250-a235ac21c011=active} 2017-02-13 10:04:15,248Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-31) [] FINISH, ConnectStoragePoolVDSCommand, log id: 1de6b33c 2017-02-13 10:04:15,542Z WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-31) [] Domain 'bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f:Datastore01' report isn't an actual report 2017-02-13 10:04:16,192Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [7e0ead80] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt01.mgmt.ns.imm.re using Proxy Host ovirt02.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.217. 2017-02-13 10:04:16,193Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] START, FenceVdsVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', targetVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', action='STATUS', agent='FenceAgent:{id='abc92f4f-da3d-48e9-a146-be2917e0105f', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', order='1', type='ipmilan', ip='192.168.128.217', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 57cad34b 2017-02-13 10:04:16,505Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 57cad34b 2017-02-13 10:04:16,541Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] START, SetMOMPolicyParametersVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, MomPolicyVDSParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8'}), log id: 370ac01f 2017-02-13 10:04:16,953Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler7) [7e0ead80] FINISH, SetMOMPolicyParametersVDSCommand, log id: 370ac01f 2017-02-13 10:04:16,999Z INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (DefaultQuartzScheduler7) [7d3e37bb] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:04:17,449Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [7d3e37bb] EVENT_ID: VDS_DETECTED(13), Correlation ID: 6f84a0bf, Call Stack: null, Custom Event ID: -1, Message: Status of host ovirt01.mgmt.ns.imm.re was set to Up. 2017-02-13 10:04:17,454Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [7d3e37bb] EVENT_ID: VDS_FENCE_STATUS(496), Correlation ID: 6f84a0bf, Call Stack: null, Custom Event ID: -1, Message: Host ovirt01.mgmt.ns.imm.re power management was verified successfully. 2017-02-13 10:04:17,512Z INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler7) [286f4732] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 10:04:17,520Z WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (DefaultQuartzScheduler7) [286f4732] Domain 'bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f:Datastore01' report isn't an actual report 2017-02-13 10:04:20,068Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 10:04:20,069Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 64e9b229 2017-02-13 10:04:20,111Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Fetched 3 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 10:04:21,539Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-1) [] FINISH, DestroyVDSCommand, log id: 64e9b229 2017-02-13 10:04:21,539Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 10:04:35,165Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [19aed080] Fetched 2 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 10:04:46,089Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:04:52,526Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Running command: InstallVdsCommand internal: false. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 10:04:52,613Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Lock Acquired to object 'EngineLock:{exclusiveLocks='[921245cb-5b54-411f-8e94-8c2302c2f9b4=]', sharedLocks='null'}' 2017-02-13 10:04:52,650Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDS 2017-02-13 10:04:52,650Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Before Installation host 921245cb-5b54-411f-8e94-8c2302c2f9b4, ovirt06.mgmt.ns.imm.re 2017-02-13 10:04:52,700Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] START, SetVdsStatusVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 49c3640b 2017-02-13 10:04:52,704Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] FINISH, SetVdsStatusVDSCommand, log id: 49c3640b 2017-02-13 10:04:52,787Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Connected to host ovirt06.mgmt.ns.imm.re with SSH key fingerprint: SHA256:+ZOPMEOKSMmamWtS2BYitsDnGVtbvDfq99j9m0mMwh8. 2017-02-13 10:04:52,815Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Installation of ovirt06.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 10:04:52,816Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 10:04:52,864Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] SSH execute 'root@ovirt06.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 10:04:53,003Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt06.mgmt.ns.imm.re using Proxy Host ovirt01.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.222. 2017-02-13 10:04:53,005Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] START, FenceVdsVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', targetVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', action='STATUS', agent='FenceAgent:{id='3eceb6fb-628d-48d5-91b7-12733e564933', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', order='1', type='ipmilan', ip='192.168.128.222', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 2e991a0e 2017-02-13 10:04:53,763Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 2e991a0e 2017-02-13 10:04:53,778Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-81) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: USER_UPDATE_VDS(43), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Host ovirt06.mgmt.ns.imm.re configuration was updated by fagiani@Immobiliare-authz. 2017-02-13 10:04:53,823Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 10:04:53,919Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 10:04:53,963Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 10:05:04,557Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 10:05:04,591Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 10:05:05,357Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Kdump supported. 2017-02-13 10:05:05,681Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-deploy-20170213100449-ilvjoc.log'. 2017-02-13 10:05:05,749Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Host ovirt06.mgmt.ns.imm.re reports unique id 4C4C4544-0032-4310-8052-B8C04F42354A 2017-02-13 10:05:05,838Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Assigning unique id 4C4C4544-0032-4310-8052-B8C04F42354A to Host ovirt06.mgmt.ns.imm.re 2017-02-13 10:05:06,044Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 10:05:06,276Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Hardware supports virtualization. 2017-02-13 10:05:06,624Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 10:05:06,791Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:05:06,812Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 10:05:18,841Z ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages Connection reset by peer 2017-02-13 10:05:20,753Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:05:20,797Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Setting time. 2017-02-13 10:05:24,001Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Enrolling certificate. 2017-02-13 10:05:25,335Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Enrolling serial console certificate. 2017-02-13 10:05:27,409Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 10:05:27,488Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Setting kernel arguments. 2017-02-13 10:05:27,751Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 10:05:30,279Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Restarting kdump. 2017-02-13 10:06:53,835Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stopping libvirtd. 2017-02-13 10:06:53,879Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Starting vdsm. 2017-02-13 10:07:01,016Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Starting ovirt-vmconsole-host-sshd. 2017-02-13 10:07:01,231Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Pre-termination. 2017-02-13 10:07:01,291Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20170213100701-ovirt06.mgmt.ns.imm.re-adcfadc8-3a80-4732-84f9-06f9c31ab405.log'. 2017-02-13 10:07:02,034Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt06.mgmt.ns.imm.re. Stage: Termination. 2017-02-13 10:07:02,040Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt06.mgmt.ns.imm.re/192.168.128.177 2017-02-13 10:07:04,070Z INFO [org.ovirt.engine.core.bll.host.HostConnectivityChecker] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Engine managed to communicate with VDSM agent on host 'ovirt06.mgmt.ns.imm.re' with address 'ovirt06.mgmt.ns.imm.re' ('921245cb-5b54-411f-8e94-8c2302c2f9b4') 2017-02-13 10:07:04,766Z INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] The management network 'ovirtmgmt' is already configured on host 'ovirt06.mgmt.ns.imm.re' 2017-02-13 10:07:04,785Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] START, SetVdsStatusVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', status='Initializing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 5dd72e27 2017-02-13 10:07:04,788Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] FINISH, SetVdsStatusVDSCommand, log id: 5dd72e27 2017-02-13 10:07:04,788Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] After Installation host ovirt06.mgmt.ns.imm.re, VDS 2017-02-13 10:07:04,792Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] EVENT_ID: VDS_INSTALL(504), Correlation ID: adcfadc8-3a80-4732-84f9-06f9c31ab405, Call Stack: null, Custom Event ID: -1, Message: Host ovirt06.mgmt.ns.imm.re installed 2017-02-13 10:07:04,793Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-33) [adcfadc8-3a80-4732-84f9-06f9c31ab405] Lock freed to object 'EngineLock:{exclusiveLocks='[921245cb-5b54-411f-8e94-8c2302c2f9b4=]', sharedLocks='null'}' 2017-02-13 10:07:05,105Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler3) [233f11ee] START, GetHardwareInfoVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vds='Host[ovirt06.mgmt.ns.imm.re,921245cb-5b54-411f-8e94-8c2302c2f9b4]'}), log id: 77924b98 2017-02-13 10:07:05,682Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler3) [233f11ee] FINISH, GetHardwareInfoVDSCommand, log id: 77924b98 2017-02-13 10:07:05,727Z WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [233f11ee] EVENT_ID: VDS_NO_SELINUX_ENFORCEMENT(25), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ovirt06.mgmt.ns.imm.re does not enforce SELinux. Current status: DISABLED 2017-02-13 10:07:05,727Z WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler3) [233f11ee] Host 'ovirt06.mgmt.ns.imm.re' is running with SELinux in 'DISABLED' mode 2017-02-13 10:07:05,953Z INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler3) [4432d7fe] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDS 2017-02-13 10:07:06,012Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [4432d7fe] START, GlusterServersListVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4'}), log id: 16bff595 2017-02-13 10:07:07,416Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [4432d7fe] FINISH, GlusterServersListVDSCommand, return: [10.10.10.106/24:CONNECTED], log id: 16bff595 2017-02-13 10:07:07,424Z INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler3) [1c98a3f1] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:07:07,439Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler3) [60760bd2] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:07:07,488Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [60760bd2] START, ConnectStorageServerVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 6a652ee9 2017-02-13 10:07:09,475Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [60760bd2] FINISH, ConnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 6a652ee9 2017-02-13 10:07:09,477Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [60760bd2] START, ConnectStorageServerVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 4a49c492 2017-02-13 10:07:10,644Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler3) [60760bd2] FINISH, ConnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 4a49c492 2017-02-13 10:07:10,649Z INFO [org.ovirt.engine.core.bll.storage.pool.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler3) [60760bd2] Host 'ovirt06.mgmt.ns.imm.re' storage connection was succeeded 2017-02-13 10:07:10,654Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-19) [] START, ConnectStoragePoolVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', storagePoolId='587906e2-00d5-022c-016c-000000000358', masterVersion='4'}), log id: 398ce2dd 2017-02-13 10:07:10,654Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-19) [] Executing with domain map: {bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f=active, a525f108-2a4d-4aa3-9eb8-f3b200fdba40=active, 95e50e3d-1624-4480-9b96-418d52b77abb=active, 93c77d46-60d2-4dfa-a250-a235ac21c011=active} 2017-02-13 10:07:12,090Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-6-thread-19) [] FINISH, ConnectStoragePoolVDSCommand, log id: 398ce2dd 2017-02-13 10:07:12,273Z WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-19) [] Domain 'bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f:Datastore01' report isn't an actual report 2017-02-13 10:07:12,723Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [60760bd2] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt06.mgmt.ns.imm.re using Proxy Host ovirt04.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.222. 2017-02-13 10:07:12,724Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler3) [60760bd2] START, FenceVdsVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', targetVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', action='STATUS', agent='FenceAgent:{id='3eceb6fb-628d-48d5-91b7-12733e564933', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', order='1', type='ipmilan', ip='192.168.128.222', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 301406ed 2017-02-13 10:07:13,503Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler3) [60760bd2] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 301406ed 2017-02-13 10:07:13,539Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler3) [60760bd2] START, SetMOMPolicyParametersVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, MomPolicyVDSParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4'}), log id: 19ede017 2017-02-13 10:07:13,868Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler3) [60760bd2] FINISH, SetMOMPolicyParametersVDSCommand, log id: 19ede017 2017-02-13 10:07:13,914Z INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (DefaultQuartzScheduler3) [6fc11b81] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:07:14,308Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [6fc11b81] EVENT_ID: VDS_DETECTED(13), Correlation ID: 1c98a3f1, Call Stack: null, Custom Event ID: -1, Message: Status of host ovirt06.mgmt.ns.imm.re was set to Up. 2017-02-13 10:07:14,312Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler3) [6fc11b81] EVENT_ID: VDS_FENCE_STATUS(496), Correlation ID: 1c98a3f1, Call Stack: null, Custom Event ID: -1, Message: Host ovirt06.mgmt.ns.imm.re power management was verified successfully. 2017-02-13 10:07:14,356Z INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler3) [645a8e21] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 921245cb-5b54-411f-8e94-8c2302c2f9b4 Type: VDS 2017-02-13 10:07:14,362Z WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (DefaultQuartzScheduler3) [645a8e21] Domain 'bf0f4d7e-bf42-41ca-a5ce-6ad4e24efa1f:Datastore01' report isn't an actual report 2017-02-13 10:09:46,410Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler3) [645a8e21] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:14:46,696Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler2) [28a60b8f] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:19:47,012Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler10) [18cb8f8e] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:22:20,748Z INFO [org.ovirt.engine.core.bll.network.host.RefreshHostCommand] (org.ovirt.thread.pool-6-thread-19) [8004d858-b1ce-4455-83c3-59437a2ae50e] Running command: RefreshHostCommand internal: false. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:22:20,755Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] Lock Acquired to object 'EngineLock:{exclusiveLocks='[1b1f2260-2de7-4fe1-9969-d2ac556340d8=, HOST_NETWORK1b1f2260-2de7-4fe1-9969-d2ac556340d8=]', sharedLocks='null'}' 2017-02-13 10:22:20,784Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] Running command: RefreshHostCapabilitiesCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:22:20,785Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] Before acquiring lock in order to prevent monitoring for host 'ovirt01.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:22:20,785Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] Lock acquired, from now a monitoring of host will be skipped for host 'ovirt01.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:22:22,171Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] START, GetHardwareInfoVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vds='Host[ovirt01.mgmt.ns.imm.re,1b1f2260-2de7-4fe1-9969-d2ac556340d8]'}), log id: 27c8566a 2017-02-13 10:22:23,179Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] FINISH, GetHardwareInfoVDSCommand, log id: 27c8566a 2017-02-13 10:22:23,409Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] START, GlusterServersListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8'}), log id: 39edd9e3 2017-02-13 10:22:24,437Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] FINISH, GlusterServersListVDSCommand, return: [10.10.10.101/24:CONNECTED], log id: 39edd9e3 2017-02-13 10:22:24,467Z INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (org.ovirt.thread.pool-6-thread-19) [7f1bec70] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 10:22:24,491Z INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (org.ovirt.thread.pool-6-thread-19) [12d1aff7] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDS 2017-02-13 10:22:24,493Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [12d1aff7] Refresh host capabilities finished. Lock released. Monitoring can run now for host 'ovirt01.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:22:24,498Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-19) [12d1aff7] EVENT_ID: HOST_REFRESHED_CAPABILITIES(606), Correlation ID: 473cc051, Call Stack: null, Custom Event ID: -1, Message: Successfully refreshed the capabilities of host ovirt01.mgmt.ns.imm.re. 2017-02-13 10:22:24,499Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-19) [12d1aff7] Lock freed to object 'EngineLock:{exclusiveLocks='[1b1f2260-2de7-4fe1-9969-d2ac556340d8=, HOST_NETWORK1b1f2260-2de7-4fe1-9969-d2ac556340d8=]', sharedLocks='null'}' 2017-02-13 10:22:24,521Z INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (org.ovirt.thread.pool-6-thread-19) [473cc051] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: 1b1f2260-2de7-4fe1-9969-d2ac556340d8 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:22:58,927Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:22:58,929Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: d46ff3b 2017-02-13 10:23:00,025Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: d46ff3b 2017-02-13 10:23:00,025Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 10:23:01,184Z INFO [org.ovirt.engine.core.bll.network.host.RefreshHostCommand] (org.ovirt.thread.pool-6-thread-14) [0f77e0e0-a8f6-4c46-a6bf-e7200440a981] Running command: RefreshHostCommand internal: false. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:23:01,196Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] Lock Acquired to object 'EngineLock:{exclusiveLocks='[HOST_NETWORKecef3dab-8795-48d3-a108-81ad29527bec=, ecef3dab-8795-48d3-a108-81ad29527bec=]', sharedLocks='null'}' 2017-02-13 10:23:01,234Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] Running command: RefreshHostCapabilitiesCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:23:01,235Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] Before acquiring lock in order to prevent monitoring for host 'ovirt05.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:23:01,235Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] Lock acquired, from now a monitoring of host will be skipped for host 'ovirt05.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:23:01,758Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] START, GetHardwareInfoVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vds='Host[ovirt05.mgmt.ns.imm.re,ecef3dab-8795-48d3-a108-81ad29527bec]'}), log id: 54347866 2017-02-13 10:23:02,141Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] FINISH, GetHardwareInfoVDSCommand, log id: 54347866 2017-02-13 10:23:02,267Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] START, GlusterServersListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec'}), log id: 68d90681 2017-02-13 10:23:02,268Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7' was reported as Down on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) 2017-02-13 10:23:02,269Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', vmId='696dcc9c-1c68-4546-8010-b0c697b62ff7', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6eaab5cc 2017-02-13 10:23:02,704Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 6eaab5cc 2017-02-13 10:23:02,704Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '696dcc9c-1c68-4546-8010-b0c697b62ff7'(HostedEngine) was unexpectedly detected as 'Down' on VDS 'a6b68006-cde8-4891-95a5-56d1d92605fc'(ovirt08.mgmt.ns.imm.re) (expected on 'd90e3320-8f50-43f4-ba5a-5f45be3cb90e') 2017-02-13 10:23:03,067Z INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] FINISH, GlusterServersListVDSCommand, return: [10.10.10.105/24:CONNECTED], log id: 68d90681 2017-02-13 10:23:03,131Z INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (org.ovirt.thread.pool-6-thread-14) [6cfa09fd] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 10:23:03,181Z INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (org.ovirt.thread.pool-6-thread-14) [4afe9551] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDS 2017-02-13 10:23:03,187Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [4afe9551] Refresh host capabilities finished. Lock released. Monitoring can run now for host 'ovirt05.mgmt.ns.imm.re' from data-center 'Default' 2017-02-13 10:23:03,195Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-14) [4afe9551] EVENT_ID: HOST_REFRESHED_CAPABILITIES(606), Correlation ID: 301fcbc1, Call Stack: null, Custom Event ID: -1, Message: Successfully refreshed the capabilities of host ovirt05.mgmt.ns.imm.re. 2017-02-13 10:23:03,196Z INFO [org.ovirt.engine.core.bll.RefreshHostCapabilitiesCommand] (org.ovirt.thread.pool-6-thread-14) [4afe9551] Lock freed to object 'EngineLock:{exclusiveLocks='[HOST_NETWORKecef3dab-8795-48d3-a108-81ad29527bec=, ecef3dab-8795-48d3-a108-81ad29527bec=]', sharedLocks='null'}' 2017-02-13 10:23:03,242Z INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (org.ovirt.thread.pool-6-thread-14) [301fcbc1] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: ecef3dab-8795-48d3-a108-81ad29527bec Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:23:21,020Z INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: bca50b60-f7df-4407-be28-556a3d50e091 Type: VDSAction group MANIPULATE_HOST with role type ADMIN, ID: 6957c3be-b9bc-4a35-a5ef-df6ec258c5f7 Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-13 10:23:21,042Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] START, SetVdsStatusVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', status='PreparingForMaintenance', nonOperationalReason='NONE', stopSpmFailureLogged='true', maintenanceReason='null'}), log id: 39e13a94 2017-02-13 10:23:21,044Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] FINISH, SetVdsStatusVDSCommand, log id: 39e13a94 2017-02-13 10:23:21,061Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] START, SetVdsStatusVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', status='PreparingForMaintenance', nonOperationalReason='NONE', stopSpmFailureLogged='true', maintenanceReason='null'}), log id: d23ee24 2017-02-13 10:23:21,063Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] FINISH, SetVdsStatusVDSCommand, log id: d23ee24 2017-02-13 10:23:21,115Z INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: bca50b60-f7df-4407-be28-556a3d50e091 Type: VDS 2017-02-13 10:23:21,133Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] START, SetHaMaintenanceModeVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, SetHaMaintenanceModeVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091'}), log id: 7a68910a 2017-02-13 10:23:21,505Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] FINISH, SetHaMaintenanceModeVDSCommand, log id: 7a68910a 2017-02-13 10:23:21,684Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [6a6929f6] Lock Acquired to object 'EngineLock:{exclusiveLocks='[ab6e9885-21ff-45f6-9caa-5316f0564790=]', sharedLocks='null'}' 2017-02-13 10:23:22,074Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [6a6929f6] Running command: MigrateVmCommand internal: true. Entities affected : ID: ab6e9885-21ff-45f6-9caa-5316f0564790 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:22,409Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [6a6929f6] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', dstHost='ovirt06.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 66bc3b7d 2017-02-13 10:23:22,410Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [6a6929f6] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', dstHost='ovirt06.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 3a052fb6 2017-02-13 10:23:23,219Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [6a6929f6] FINISH, MigrateBrokerVDSCommand, log id: 3a052fb6 2017-02-13 10:23:23,234Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [6a6929f6] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 66bc3b7d 2017-02-13 10:23:23,263Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [6a6929f6] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 6a6929f6, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: pm.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt06.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:23,395Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [4fbee81f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[1dc9fdb2-5fb0-4596-9b88-980fd5c49dff=]', sharedLocks='null'}' 2017-02-13 10:23:23,885Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [4fbee81f] Running command: MigrateVmCommand internal: true. Entities affected : ID: 1dc9fdb2-5fb0-4596-9b88-980fd5c49dff Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:24,288Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [4fbee81f] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='1dc9fdb2-5fb0-4596-9b88-980fd5c49dff', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 4184a2ef 2017-02-13 10:23:24,289Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [4fbee81f] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='1dc9fdb2-5fb0-4596-9b88-980fd5c49dff', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 5bca3fe8 2017-02-13 10:23:24,787Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [4fbee81f] FINISH, MigrateBrokerVDSCommand, log id: 5bca3fe8 2017-02-13 10:23:24,791Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [4fbee81f] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4184a2ef 2017-02-13 10:23:24,798Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [4fbee81f] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 4fbee81f, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: dev-updatews, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:24,830Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Fetched 1 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 10:23:24,830Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:24,831Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' is migrating to VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:23:24,865Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [20910993] Lock Acquired to object 'EngineLock:{exclusiveLocks='[85c13fe5-9cb3-4a85-926c-371b3b248dc9=]', sharedLocks='null'}' 2017-02-13 10:23:25,070Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [20910993] Running command: MigrateVmCommand internal: true. Entities affected : ID: 85c13fe5-9cb3-4a85-926c-371b3b248dc9 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:25,266Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [20910993] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='85c13fe5-9cb3-4a85-926c-371b3b248dc9', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', dstHost='ovirt05.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 5d03c817 2017-02-13 10:23:25,266Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [20910993] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='85c13fe5-9cb3-4a85-926c-371b3b248dc9', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', dstHost='ovirt05.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 50b1ddd7 2017-02-13 10:23:25,268Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 10:23:25,268Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 60ee0734 2017-02-13 10:23:25,421Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] Failed to destroy VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' because VM does not exist, ignoring 2017-02-13 10:23:25,421Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 60ee0734 2017-02-13 10:23:25,421Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:25,422Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [20910993] FINISH, MigrateBrokerVDSCommand, log id: 50b1ddd7 2017-02-13 10:23:25,424Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [20910993] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5d03c817 2017-02-13 10:23:25,430Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [20910993] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 20910993, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: dev-script1.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt05.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:25,444Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [5490faea] Lock Acquired to object 'EngineLock:{exclusiveLocks='[873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8=]', sharedLocks='null'}' 2017-02-13 10:23:25,749Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [5490faea] Running command: MigrateVmCommand internal: true. Entities affected : ID: 873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:26,140Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [5490faea] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', dstHost='ovirt05.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 160e3e3a 2017-02-13 10:23:26,141Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [5490faea] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='ecef3dab-8795-48d3-a108-81ad29527bec', dstHost='ovirt05.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 172b047b 2017-02-13 10:23:27,180Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [5490faea] FINISH, MigrateBrokerVDSCommand, log id: 172b047b 2017-02-13 10:23:27,183Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [5490faea] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 160e3e3a 2017-02-13 10:23:27,188Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [5490faea] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 5490faea, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: dev-solr.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt05.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:27,201Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [3e8dabb5] Lock Acquired to object 'EngineLock:{exclusiveLocks='[a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2=]', sharedLocks='null'}' 2017-02-13 10:23:27,377Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [3e8dabb5] Running command: MigrateVmCommand internal: true. Entities affected : ID: a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:27,577Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [3e8dabb5] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 651211d5 2017-02-13 10:23:27,578Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [3e8dabb5] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 226d53f4 2017-02-13 10:23:28,777Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [3e8dabb5] FINISH, MigrateBrokerVDSCommand, log id: 226d53f4 2017-02-13 10:23:28,782Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [3e8dabb5] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 651211d5 2017-02-13 10:23:28,792Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [3e8dabb5] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 3e8dabb5, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: dev-pm.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:28,802Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [3e8dabb5] EVENT_ID: USER_VDS_MAINTENANCE_WITHOUT_REASON(620), Correlation ID: 083e38e0-e913-4fd5-8232-38e2cdda951c, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Host ovirt02.mgmt.ns.imm.re was switched to Maintenance mode by fagiani@Immobiliare-authz. 2017-02-13 10:23:28,905Z INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 6957c3be-b9bc-4a35-a5ef-df6ec258c5f7 Type: VDS 2017-02-13 10:23:28,945Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] START, SetHaMaintenanceModeVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, SetHaMaintenanceModeVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'}), log id: 3fc68965 2017-02-13 10:23:29,808Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (default task-123) [083e38e0-e913-4fd5-8232-38e2cdda951c] FINISH, SetHaMaintenanceModeVDSCommand, log id: 3fc68965 2017-02-13 10:23:29,830Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [231cb74c] Lock Acquired to object 'EngineLock:{exclusiveLocks='[d2cff305-80d7-4c21-82e8-2c0e1af58b4f=]', sharedLocks='null'}' 2017-02-13 10:23:30,187Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [841e74e] Fetched 1 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 10:23:30,188Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'(dev-updatews) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:30,188Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:23:30,213Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [231cb74c] Running command: MigrateVmCommand internal: true. Entities affected : ID: d2cff305-80d7-4c21-82e8-2c0e1af58b4f Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:30,241Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [18cb8f8e] Fetched 1 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 10:23:30,242Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9'(dev-script1.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:30,242Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:23:30,345Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) moved from 'MigratingFrom' --> 'Up' 2017-02-13 10:23:30,346Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] Adding VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) to re-run list 2017-02-13 10:23:30,356Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler9) [505db1b8] Rerun VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'. Called from VDS 'ovirt02.mgmt.ns.imm.re' 2017-02-13 10:23:30,364Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] START, MigrateStatusVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790'}), log id: 6fcff68f 2017-02-13 10:23:30,384Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] FINISH, MigrateStatusVDSCommand, log id: 6fcff68f 2017-02-13 10:23:30,496Z WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-34) [505db1b8] EVENT_ID: VM_MIGRATION_TRYING_RERUN(128), Correlation ID: 6a6929f6, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Failed to migrate VM pm.rete.loc to Host ovirt06.mgmt.ns.imm.re . Trying to migrate to another Host. 2017-02-13 10:23:30,597Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [231cb74c] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', dstHost='ovirt06.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 5eed5eae 2017-02-13 10:23:30,599Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [231cb74c] START, MigrateBrokerVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='921245cb-5b54-411f-8e94-8c2302c2f9b4', dstHost='ovirt06.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 4c68d5db 2017-02-13 10:23:30,802Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] Running command: MigrateVmCommand internal: true. Entities affected : ID: ab6e9885-21ff-45f6-9caa-5316f0564790 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:31,124Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 370f4e4f 2017-02-13 10:23:31,128Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] START, MigrateBrokerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', srcHost='ovirt02.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 7b2e52fb 2017-02-13 10:23:31,147Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [231cb74c] FINISH, MigrateBrokerVDSCommand, log id: 4c68d5db 2017-02-13 10:23:31,154Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [231cb74c] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5eed5eae 2017-02-13 10:23:31,165Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [231cb74c] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 231cb74c, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: win01.mgmt.ns.imm.re, Source: ovirt03.mgmt.ns.imm.re, Destination: ovirt06.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:31,190Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [7a4584a8] Lock Acquired to object 'EngineLock:{exclusiveLocks='[46aa4119-6589-4583-9424-1090ce149492=]', sharedLocks='null'}' 2017-02-13 10:23:31,555Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (default task-123) [7a4584a8] Running command: MigrateVmCommand internal: true. Entities affected : ID: 46aa4119-6589-4583-9424-1090ce149492 Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:31,695Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] FINISH, MigrateBrokerVDSCommand, log id: 7b2e52fb 2017-02-13 10:23:31,699Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-6-thread-34) [505db1b8] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 370f4e4f 2017-02-13 10:23:31,704Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-34) [505db1b8] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 6a6929f6, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: pm.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:33,059Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' was reported as Down on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) 2017-02-13 10:23:33,060Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 3bd39edb 2017-02-13 10:23:34,066Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] Failed to destroy VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' because VM does not exist, ignoring 2017-02-13 10:23:34,067Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 3bd39edb 2017-02-13 10:23:34,067Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'Down' on VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4'(ovirt06.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:23:35,044Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [7a4584a8] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='46aa4119-6589-4583-9424-1090ce149492', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 65f42d23 2017-02-13 10:23:35,045Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [7a4584a8] START, MigrateBrokerVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='46aa4119-6589-4583-9424-1090ce149492', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', dstHost='ovirt01.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 432a2621 2017-02-13 10:23:35,316Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (default task-123) [7a4584a8] FINISH, MigrateBrokerVDSCommand, log id: 432a2621 2017-02-13 10:23:35,321Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-123) [7a4584a8] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 65f42d23 2017-02-13 10:23:35,332Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [7a4584a8] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 7a4584a8, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: foreman.mgmt.ns.imm.re, Source: ovirt03.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:35,341Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-123) [7a4584a8] EVENT_ID: USER_VDS_MAINTENANCE_WITHOUT_REASON(620), Correlation ID: 083e38e0-e913-4fd5-8232-38e2cdda951c, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Host ovirt03.mgmt.ns.imm.re was switched to Maintenance mode by fagiani@Immobiliare-authz. 2017-02-13 10:23:39,911Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [18cb8f8e] Fetched 0 VMs from VDS '921245cb-5b54-411f-8e94-8c2302c2f9b4' 2017-02-13 10:23:45,194Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) moved from 'MigratingFrom' --> 'Up' 2017-02-13 10:23:45,194Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] Adding VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) to re-run list 2017-02-13 10:23:45,205Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler3) [645a8e21] Rerun VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'. Called from VDS 'ovirt03.mgmt.ns.imm.re' 2017-02-13 10:23:45,212Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] START, MigrateStatusVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}), log id: 68fbad9a 2017-02-13 10:23:45,213Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [286f4732] Fetched 2 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 10:23:45,214Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'(dev-updatews) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:45,214Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:23:45,214Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler7) [286f4732] skipping VM '46aa4119-6589-4583-9424-1090ce149492' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 10:23:45,246Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] FINISH, MigrateStatusVDSCommand, log id: 68fbad9a 2017-02-13 10:23:45,254Z WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-10) [645a8e21] EVENT_ID: VM_MIGRATION_TRYING_RERUN(128), Correlation ID: 231cb74c, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Failed to migrate VM win01.mgmt.ns.imm.re to Host ovirt06.mgmt.ns.imm.re . Trying to migrate to another Host. 2017-02-13 10:23:45,293Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9'(dev-script1.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:45,293Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:23:45,600Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] Running command: MigrateVmCommand internal: true. Entities affected : ID: d2cff305-80d7-4c21-82e8-2c0e1af58b4f Type: VMAction group MIGRATE_VM with role type USER 2017-02-13 10:23:45,953Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] START, MigrateVDSCommand( MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', dstHost='ovirt04.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 5375df5a 2017-02-13 10:23:45,955Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] START, MigrateBrokerVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, MigrateVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', srcHost='ovirt03.mgmt.ns.imm.re', dstVdsId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', dstHost='ovirt04.mgmt.ns.imm.re:54321', migrationMethod='ONLINE', tunnelMigration='false', migrationDowntime='0', autoConverge='true', migrateCompressed='false', consoleAddress='null', maxBandwidth='null', enableGuestEvents='true', maxIncomingMigrations='2', maxOutgoingMigrations='2', convergenceSchedule='[init=[{name=setDowntime, params=[100]}], stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, action={name=setDowntime, params=[200]}}, {limit=3, action={name=setDowntime, params=[300]}}, {limit=4, action={name=setDowntime, params=[400]}}, {limit=6, action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, params=[]}}]]'}), log id: 16087d67 2017-02-13 10:23:46,766Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] FINISH, MigrateBrokerVDSCommand, log id: 16087d67 2017-02-13 10:23:46,770Z INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-6-thread-10) [645a8e21] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5375df5a 2017-02-13 10:23:46,776Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-10) [645a8e21] EVENT_ID: VM_MIGRATION_START_SYSTEM_INITIATED(67), Correlation ID: 231cb74c, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Migration initiated by system (VM: win01.mgmt.ns.imm.re, Source: ovirt03.mgmt.ns.imm.re, Destination: ovirt04.mgmt.ns.imm.re, Reason: Host preparing for maintenance). 2017-02-13 10:23:48,979Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9'(dev-script1.rete.loc) was unexpectedly detected as 'Up' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:23:48,982Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [] START, MigrateStatusVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='85c13fe5-9cb3-4a85-926c-371b3b248dc9'}), log id: 6ef56bb8 2017-02-13 10:23:48,991Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [] FINISH, MigrateStatusVDSCommand, log id: 6ef56bb8 2017-02-13 10:23:49,001Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-7) [6fd8722f] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:23:49,006Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-7) [6fd8722f] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 20910993, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dev-script1.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt05.mgmt.ns.imm.re, Duration: 23 seconds, Total: 23 seconds, Actual downtime: (N/A)) 2017-02-13 10:23:49,007Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-7) [6fd8722f] Lock freed to object 'EngineLock:{exclusiveLocks='[85c13fe5-9cb3-4a85-926c-371b3b248dc9=]', sharedLocks='null'}' 2017-02-13 10:23:49,008Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[85c13fe5-9cb3-4a85-926c-371b3b248dc9]'}), log id: 345d3fa2 2017-02-13 10:23:49,009Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:23:49,010Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='85c13fe5-9cb3-4a85-926c-371b3b248dc9', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 25a6958b 2017-02-13 10:23:49,286Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=85c13fe5-9cb3-4a85-926c-371b3b248dc9, memGuaranteedSize=1024, transparentHugePages=true, displayPort=-1, displaySecurePort=5906, timeOffset=0, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@75aa47d9, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=dev-script1.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=26068, displayIp=192.168.128.176, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@5aa4c48a, display=qxl, maxVCpus=16, clientIp=, statusTime=4617647730, maxMemSlots=16}], log id: 345d3fa2 2017-02-13 10:23:49,288Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-7) [6fd8722f] Received a memballoon Device without an address when processing VM 85c13fe5-9cb3-4a85-926c-371b3b248dc9 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=1048576, alias=balloon0} 2017-02-13 10:23:49,289Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-7) [6fd8722f] Received a spice Device without an address when processing VM 85c13fe5-9cb3-4a85-926c-371b3b248dc9 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.176, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=acf5745d-2d4f-46ce-8e56-2938bb95ed5e, tlsPort=5900} 2017-02-13 10:23:49,650Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-14) [] FINISH, DestroyVDSCommand, log id: 25a6958b 2017-02-13 10:23:49,650Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-14) [] VM '85c13fe5-9cb3-4a85-926c-371b3b248dc9'(dev-script1.rete.loc) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 10:24:00,298Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'(dev-updatews) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:00,298Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:00,298Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] skipping VM '46aa4119-6589-4583-9424-1090ce149492' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 10:24:00,331Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [841e74e] Fetched 2 VMs from VDS 'ecef3dab-8795-48d3-a108-81ad29527bec' 2017-02-13 10:24:00,332Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:00,332Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:00,342Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [841e74e] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[85c13fe5-9cb3-4a85-926c-371b3b248dc9]'}), log id: b1f006c 2017-02-13 10:24:00,415Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler1) [841e74e] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=85c13fe5-9cb3-4a85-926c-371b3b248dc9, memGuaranteedSize=1024, transparentHugePages=true, displayPort=-1, displaySecurePort=5906, timeOffset=0, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@398d4120, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=dev-script1.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=26068, displayIp=192.168.128.176, smpThreadsPerCore=1, guestDiskMapping={b8a49e6f-9db0-4811-9={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@7bcb5045, display=qxl, maxVCpus=16, clientIp=, statusTime=4617659050, maxMemSlots=16}], log id: b1f006c 2017-02-13 10:24:00,417Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [841e74e] Received a memballoon Device without an address when processing VM 85c13fe5-9cb3-4a85-926c-371b3b248dc9 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=1048576, alias=balloon0} 2017-02-13 10:24:00,417Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler1) [841e74e] Received a spice Device without an address when processing VM 85c13fe5-9cb3-4a85-926c-371b3b248dc9 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.176, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=acf5745d-2d4f-46ce-8e56-2938bb95ed5e, tlsPort=5900} 2017-02-13 10:24:00,454Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 4 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 10:24:00,485Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler3) [645a8e21] Fetched 12 VMs from VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32' 2017-02-13 10:24:00,486Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:00,486Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:07,571Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'(dev-updatews) was unexpectedly detected as 'Up' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:07,575Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [] START, MigrateStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'}), log id: 70d1d527 2017-02-13 10:24:07,872Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [] FINISH, MigrateStatusVDSCommand, log id: 70d1d527 2017-02-13 10:24:07,887Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:24:07,898Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [46c5d7a0] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 4fbee81f, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dev-updatews, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Duration: 43 seconds, Total: 43 seconds, Actual downtime: (N/A)) 2017-02-13 10:24:07,900Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] Lock freed to object 'EngineLock:{exclusiveLocks='[1dc9fdb2-5fb0-4596-9b88-980fd5c49dff=]', sharedLocks='null'}' 2017-02-13 10:24:07,902Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[1dc9fdb2-5fb0-4596-9b88-980fd5c49dff]'}), log id: 1c7db490 2017-02-13 10:24:07,962Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=1dc9fdb2-5fb0-4596-9b88-980fd5c49dff, memGuaranteedSize=2048, transparentHugePages=true, displayPort=-1, displaySecurePort=5915, timeOffset=0, cpuType=SandyBridge, smp=2, guestNumaNodes=[Ljava.lang.Object;@6d4e7271, smartcardEnable=false, custom={}, vmType=kvm, memSize=2048, smpCoresPerSocket=1, vmName=dev-updatews, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=15665, displayIp=192.168.128.176, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@27b74c1c, display=qxl, maxVCpus=16, clientIp=, statusTime=4627041620, maxMemSlots=16}], log id: 1c7db490 2017-02-13 10:24:07,964Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-0) [46c5d7a0] Received a memballoon Device without an address when processing VM 1dc9fdb2-5fb0-4596-9b88-980fd5c49dff devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=2097152, alias=balloon0} 2017-02-13 10:24:07,965Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-0) [46c5d7a0] Received a spice Device without an address when processing VM 1dc9fdb2-5fb0-4596-9b88-980fd5c49dff devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=611bb19a-712b-4bb9-9a8b-d28a4e287c8e, tlsPort=5900} 2017-02-13 10:24:08,286Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [6fd8722f] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:24:08,287Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='1dc9fdb2-5fb0-4596-9b88-980fd5c49dff', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5c4467b0 2017-02-13 10:24:08,622Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] FINISH, DestroyVDSCommand, log id: 5c4467b0 2017-02-13 10:24:08,622Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [6fd8722f] VM '1dc9fdb2-5fb0-4596-9b88-980fd5c49dff'(dev-updatews) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 10:24:15,396Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [505db1b8] Fetched 3 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 10:24:15,397Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM 'a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2'(dev-pm.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:15,397Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM 'a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:15,397Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler9) [505db1b8] skipping VM '46aa4119-6589-4583-9424-1090ce149492' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 10:24:15,408Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[1dc9fdb2-5fb0-4596-9b88-980fd5c49dff]'}), log id: 3428230f 2017-02-13 10:24:15,447Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler9) [505db1b8] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=1dc9fdb2-5fb0-4596-9b88-980fd5c49dff, memGuaranteedSize=2048, transparentHugePages=true, displayPort=-1, displaySecurePort=5915, timeOffset=0, cpuType=SandyBridge, smp=2, guestNumaNodes=[Ljava.lang.Object;@1cf19851, smartcardEnable=false, custom={}, vmType=kvm, memSize=2048, smpCoresPerSocket=1, vmName=dev-updatews, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=15665, displayIp=192.168.128.176, smpThreadsPerCore=1, guestDiskMapping={a0c361ea-2ea9-4558-8={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@40ece147, display=qxl, maxVCpus=16, clientIp=, statusTime=4627049130, maxMemSlots=16}], log id: 3428230f 2017-02-13 10:24:15,451Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] Received a memballoon Device without an address when processing VM 1dc9fdb2-5fb0-4596-9b88-980fd5c49dff devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=2097152, alias=balloon0} 2017-02-13 10:24:15,451Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler9) [505db1b8] Received a spice Device without an address when processing VM 1dc9fdb2-5fb0-4596-9b88-980fd5c49dff devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=611bb19a-712b-4bb9-9a8b-d28a4e287c8e, tlsPort=5900} 2017-02-13 10:24:15,470Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:15,470Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:15,497Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [286f4732] Fetched 3 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 10:24:15,499Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler7) [286f4732] skipping VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 10:24:15,543Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:15,543Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:16,189Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [6fd8722f] VM 'a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2'(dev-pm.rete.loc) was unexpectedly detected as 'Up' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:16,193Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] START, MigrateStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2'}), log id: 15c81212 2017-02-13 10:24:16,304Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [6fd8722f] FINISH, MigrateStatusVDSCommand, log id: 15c81212 2017-02-13 10:24:16,321Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-7) [35dba82b] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:24:16,329Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-7) [35dba82b] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 3e8dabb5, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dev-pm.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Duration: 48 seconds, Total: 48 seconds, Actual downtime: (N/A)) 2017-02-13 10:24:16,332Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-7) [35dba82b] Lock freed to object 'EngineLock:{exclusiveLocks='[a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2=]', sharedLocks='null'}' 2017-02-13 10:24:16,333Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2]'}), log id: 76d70b40 2017-02-13 10:24:16,346Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [46c5d7a0] VM 'a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:24:16,348Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 7094ceda 2017-02-13 10:24:16,730Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2, memGuaranteedSize=2048, transparentHugePages=true, displayPort=-1, displaySecurePort=5910, timeOffset=0, cpuType=SandyBridge, smp=2, guestNumaNodes=[Ljava.lang.Object;@69479b55, smartcardEnable=false, custom={}, vmType=kvm, memSize=2048, smpCoresPerSocket=1, vmName=dev-pm.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=17628, displayIp=192.168.128.177, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@72740b7a, display=qxl, maxVCpus=16, clientIp=, statusTime=4627050050, maxMemSlots=16}], log id: 76d70b40 2017-02-13 10:24:16,732Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-7) [35dba82b] Received a memballoon Device without an address when processing VM a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=2097152, alias=balloon0} 2017-02-13 10:24:16,732Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-7) [35dba82b] Received a spice Device without an address when processing VM a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=c49ceabd-a19e-47e8-af06-0cc46b2ab3b9, tlsPort=5902} 2017-02-13 10:24:16,885Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] FINISH, DestroyVDSCommand, log id: 7094ceda 2017-02-13 10:24:16,886Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [46c5d7a0] VM 'a9c50f8d-32a9-4c5b-88cb-b6b40f0124c2'(dev-pm.rete.loc) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 10:24:30,487Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:30,487Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:30,508Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [18cb8f8e] Fetched 4 VMs from VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8' 2017-02-13 10:24:30,509Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:30,509Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:30,510Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM '46aa4119-6589-4583-9424-1090ce149492'(foreman.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:30,510Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler10) [18cb8f8e] VM '46aa4119-6589-4583-9424-1090ce149492' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:30,569Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [841e74e] Fetched 2 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 10:24:30,569Z WARN [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (DefaultQuartzScheduler1) [841e74e] skipping VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' from this monitoring cycle - the VM data has changed since fetching the data 2017-02-13 10:24:30,602Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:30,602Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:45,475Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [46c5d7a0] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) was unexpectedly detected as 'Up' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:45,480Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] START, MigrateStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790'}), log id: a7fc0a3 2017-02-13 10:24:45,502Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:24:45,502Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:45,514Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [46c5d7a0] FINISH, MigrateStatusVDSCommand, log id: a7fc0a3 2017-02-13 10:24:45,580Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '46aa4119-6589-4583-9424-1090ce149492'(foreman.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:45,580Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '46aa4119-6589-4583-9424-1090ce149492' is migrating to VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:45,588Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [286f4732] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[ab6e9885-21ff-45f6-9caa-5316f0564790]'}), log id: 5417a3b9 2017-02-13 10:24:45,627Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-0) [63b4e34d] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:24:45,637Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [63b4e34d] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 6a6929f6, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: pm.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Duration: 1 minute 14 seconds, Total: 1 minute 14 seconds, Actual downtime: (N/A)) 2017-02-13 10:24:45,639Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-0) [63b4e34d] Lock freed to object 'EngineLock:{exclusiveLocks='[ab6e9885-21ff-45f6-9caa-5316f0564790=]', sharedLocks='null'}' 2017-02-13 10:24:45,653Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [286f4732] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=ab6e9885-21ff-45f6-9caa-5316f0564790, memGuaranteedSize=3072, transparentHugePages=true, displayPort=-1, displaySecurePort=5907, timeOffset=0, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@644f628f, smartcardEnable=false, custom={}, vmType=kvm, memSize=3072, smpCoresPerSocket=1, vmName=pm.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=17825, displayIp=192.168.128.177, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@4021bec8, display=qxl, maxVCpus=16, clientIp=, statusTime=4627079330, maxMemSlots=16}], log id: 5417a3b9 2017-02-13 10:24:45,655Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [286f4732] Received a memballoon Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=3145728, alias=balloon0} 2017-02-13 10:24:45,655Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [286f4732] Received a spice Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=1cf72d10-5eac-4ca6-a3a2-05bdf3d710d1, tlsPort=5903} 2017-02-13 10:24:45,661Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:45,662Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:24:45,675Z INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-6-thread-8) [63b4e34d] START, FailedToRunVmVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, FailedToRunVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4'}), log id: 25e6af12 2017-02-13 10:24:45,675Z INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-6-thread-8) [63b4e34d] FINISH, FailedToRunVmVDSCommand, log id: 25e6af12 2017-02-13 10:24:45,676Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [28a60b8f] START, FullListVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmIds='[ab6e9885-21ff-45f6-9caa-5316f0564790]'}), log id: 4a068d0d 2017-02-13 10:24:45,836Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [28a60b8f] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=ab6e9885-21ff-45f6-9caa-5316f0564790, memGuaranteedSize=3072, transparentHugePages=true, displaySecurePort=5907, timeOffset=0, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@528c7c4d, custom={}, vmType=kvm, smpThreadsPerCore=1, memSize=3072, smpCoresPerSocket=1, vmName=pm.rete.loc, nice=0, status=Migration Source, maxMemSize=4194304, bootMenuEnable=false, guestDiskMapping={}, pid=34025, displayIp=192.168.128.177, displayPort=-1, smartcardEnable=false, maxMemSlots=16, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@299a899e, maxVCpus=16, clientIp=, statusTime=4632881580, display=qxl}], log id: 4a068d0d 2017-02-13 10:24:45,840Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [28a60b8f] Received a memballoon Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=3145728, alias=balloon0} 2017-02-13 10:24:45,841Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [28a60b8f] Received a spice Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.173, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=1cf72d10-5eac-4ca6-a3a2-05bdf3d710d1, tlsPort=5903} 2017-02-13 10:24:46,213Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [35dba82b] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:24:46,214Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='ab6e9885-21ff-45f6-9caa-5316f0564790', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 6810330 2017-02-13 10:24:47,264Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:24:47,463Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] FINISH, DestroyVDSCommand, log id: 6810330 2017-02-13 10:24:47,463Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [35dba82b] VM 'ab6e9885-21ff-45f6-9caa-5316f0564790'(pm.rete.loc) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 10:24:55,676Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [63b4e34d] VM '46aa4119-6589-4583-9424-1090ce149492'(foreman.mgmt.ns.imm.re) was unexpectedly detected as 'Up' on VDS '1b1f2260-2de7-4fe1-9969-d2ac556340d8'(ovirt01.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:24:55,680Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [63b4e34d] START, MigrateStatusVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmId='46aa4119-6589-4583-9424-1090ce149492'}), log id: 5e94af84 2017-02-13 10:24:55,693Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-0) [63b4e34d] FINISH, MigrateStatusVDSCommand, log id: 5e94af84 2017-02-13 10:24:55,788Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-0) [484d8498] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:24:56,622Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-0) [484d8498] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 7a4584a8, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: foreman.mgmt.ns.imm.re, Source: ovirt03.mgmt.ns.imm.re, Destination: ovirt01.mgmt.ns.imm.re, Duration: 1 minute 21 seconds, Total: 1 minute 21 seconds, Actual downtime: (N/A)) 2017-02-13 10:24:56,625Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-0) [484d8498] Lock freed to object 'EngineLock:{exclusiveLocks='[46aa4119-6589-4583-9424-1090ce149492=]', sharedLocks='null'}' 2017-02-13 10:24:56,626Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-0) [484d8498] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[46aa4119-6589-4583-9424-1090ce149492]'}), log id: 5fefb11d 2017-02-13 10:24:56,922Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-0) [484d8498] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=46aa4119-6589-4583-9424-1090ce149492, memGuaranteedSize=4096, transparentHugePages=true, displaySecurePort=5911, timeOffset=0, cpuType=SandyBridge, smp=2, guestNumaNodes=[Ljava.lang.Object;@17688074, custom={}, vmType=kvm, smpThreadsPerCore=1, memSize=4096, smpCoresPerSocket=1, vmName=foreman01.mgmt.ns.imm.re, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, guestDiskMapping={}, pid=16333, displayIp=192.168.128.176, displayPort=-1, smartcardEnable=false, maxMemSlots=16, nicModel=rtl8139,pv, kvmEnable=true, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@2e407033, maxVCpus=16, clientIp=, statusTime=4627090350, display=qxl}], log id: 5fefb11d 2017-02-13 10:24:56,925Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-0) [484d8498] Received a spice Device without an address when processing VM 46aa4119-6589-4583-9424-1090ce149492 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=085fc0ee-641f-4012-abf2-fc4aab346558, tlsPort=5901} 2017-02-13 10:25:00,520Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:25:00,520Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:00,522Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM '46aa4119-6589-4583-9424-1090ce149492' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 10:25:00,523Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler3) [645a8e21] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='46aa4119-6589-4583-9424-1090ce149492', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 5d59052d 2017-02-13 10:25:00,726Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [286f4732] START, FullListVDSCommand(HostName = ovirt01.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='1b1f2260-2de7-4fe1-9969-d2ac556340d8', vmIds='[ab6e9885-21ff-45f6-9caa-5316f0564790, 46aa4119-6589-4583-9424-1090ce149492]'}), log id: 3ebf1b3 2017-02-13 10:25:00,835Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler7) [286f4732] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=ab6e9885-21ff-45f6-9caa-5316f0564790, memGuaranteedSize=3072, transparentHugePages=true, displayPort=-1, displaySecurePort=5907, timeOffset=0, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@a8bb47f, smartcardEnable=false, custom={}, vmType=kvm, memSize=3072, smpCoresPerSocket=1, vmName=pm.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=17825, displayIp=192.168.128.177, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@7907bc33, display=qxl, maxVCpus=16, clientIp=, statusTime=4627094450, maxMemSlots=16}, {acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=46aa4119-6589-4583-9424-1090ce149492, memGuaranteedSize=4096, transparentHugePages=true, displaySecurePort=5911, timeOffset=0, cpuType=SandyBridge, smp=2, guestNumaNodes=[Ljava.lang.Object;@5dac440f, custom={}, vmType=kvm, smpThreadsPerCore=1, memSize=4096, smpCoresPerSocket=1, vmName=foreman01.mgmt.ns.imm.re, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, guestDiskMapping={QEMU_DVD-ROM_QM00004={name=/dev/sr1}, be6d4a07-14eb-44ed-b={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, pid=16333, displayIp=192.168.128.176, displayPort=-1, smartcardEnable=false, maxMemSlots=16, nicModel=rtl8139,pv, kvmEnable=true, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@1165060, maxVCpus=16, clientIp=, statusTime=4627094450, display=qxl}], log id: 3ebf1b3 2017-02-13 10:25:00,838Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [286f4732] Received a memballoon Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=3145728, alias=balloon0} 2017-02-13 10:25:00,839Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [286f4732] Received a spice Device without an address when processing VM ab6e9885-21ff-45f6-9caa-5316f0564790 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=1cf72d10-5eac-4ca6-a3a2-05bdf3d710d1, tlsPort=5903} 2017-02-13 10:25:00,841Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler7) [286f4732] Received a spice Device without an address when processing VM 46aa4119-6589-4583-9424-1090ce149492 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.172, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=085fc0ee-641f-4012-abf2-fc4aab346558, tlsPort=5901} 2017-02-13 10:25:00,863Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler3) [645a8e21] FINISH, DestroyVDSCommand, log id: 5d59052d 2017-02-13 10:25:00,863Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [645a8e21] VM '46aa4119-6589-4583-9424-1090ce149492'(foreman.mgmt.ns.imm.re) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on '1b1f2260-2de7-4fe1-9969-d2ac556340d8') 2017-02-13 10:25:01,047Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 1 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 10:25:15,708Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:25:15,708Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler5) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:15,778Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:25:15,779Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:16,060Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Fetched 1 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 10:25:20,445Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (DefaultQuartzScheduler4) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Attempting to update VMs/Templates Ovf. 2017-02-13 10:25:20,448Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 10:25:20,448Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 10:25:20,449Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:25:20,455Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Attempting to update VM OVFs in Data Center 'Default' 2017-02-13 10:25:20,459Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Successfully updated VM OVFs in Data Center 'Default' 2017-02-13 10:25:20,459Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Attempting to update template OVFs in Data Center 'Default' 2017-02-13 10:25:20,460Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Successfully updated templates OVFs in Data Center 'Default' 2017-02-13 10:25:20,460Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Attempting to remove unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 10:25:20,460Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Successfully removed unneeded template/vm OVFs in Data Center 'Default' 2017-02-13 10:25:20,461Z INFO [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler4) [41037ed4] Lock freed to object 'EngineLock:{exclusiveLocks='[587906e2-00d5-022c-016c-000000000358=]', sharedLocks='null'}' 2017-02-13 10:25:30,762Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:25:30,762Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler2) [28a60b8f] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:30,837Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:25:30,837Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:45,823Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:25:45,823Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler6) [19aed080] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:45,900Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'MigratingTo' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:25:45,900Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' is migrating to VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:25:48,249Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-7) [35dba82b] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'Up' on VDS 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32'(ovirt04.mgmt.ns.imm.re) (expected on '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7') 2017-02-13 10:25:48,253Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] START, MigrateStatusVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}), log id: 1047bc08 2017-02-13 10:25:48,274Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-7) [35dba82b] FINISH, MigrateStatusVDSCommand, log id: 1047bc08 2017-02-13 10:25:48,305Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-7) [66d4cc21] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:25:48,315Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-7) [66d4cc21] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 231cb74c, Job ID: 249aeaeb-643e-421b-8511-3ef5d7a8fe0a, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: win01.mgmt.ns.imm.re, Source: ovirt03.mgmt.ns.imm.re, Destination: ovirt04.mgmt.ns.imm.re, Duration: 2 minutes 2 seconds, Total: 2 minutes 2 seconds, Actual downtime: (N/A)) 2017-02-13 10:25:48,317Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-7) [66d4cc21] Lock freed to object 'EngineLock:{exclusiveLocks='[d2cff305-80d7-4c21-82e8-2c0e1af58b4f=]', sharedLocks='null'}' 2017-02-13 10:25:48,319Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [66d4cc21] START, FullListVDSCommand(HostName = ovirt04.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='e9bc05a5-1c8e-4b55-bd53-89ec318d9b32', vmIds='[d2cff305-80d7-4c21-82e8-2c0e1af58b4f]'}), log id: 2adb2ee5 2017-02-13 10:25:48,355Z INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-6-thread-3) [66d4cc21] START, FailedToRunVmVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, FailedToRunVmVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4'}), log id: 503d84f2 2017-02-13 10:25:48,357Z INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-6-thread-3) [66d4cc21] FINISH, FailedToRunVmVDSCommand, log id: 503d84f2 2017-02-13 10:25:48,526Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-7) [66d4cc21] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=d2cff305-80d7-4c21-82e8-2c0e1af58b4f, memGuaranteedSize=4096, transparentHugePages=true, displayPort=-1, displaySecurePort=5907, timeOffset=10848, cpuType=SandyBridge, smp=4, guestNumaNodes=[Ljava.lang.Object;@7bb0211, smartcardEnable=false, hypervEnable=true, custom={device_a5f1f979-6bf0-4c43-b271-8377a9cec988device_d84aad16-4509-4792-827c-917add28f264=VmDevice:{id='VmDeviceId:{deviceId='d84aad16-4509-4792-827c-917add28f264', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}', device='unix', type='CHANNEL', bootOrder='0', specParams='[]', address='{bus=0, controller=0, type=virtio-serial, port=1}', managed='false', plugged='true', readOnly='false', deviceAlias='channel0', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false', hostDevice='null'}, device_a5f1f979-6bf0-4c43-b271-8377a9cec988device_d84aad16-4509-4792-827c-917add28f264device_5093d825-fcaa-4fd3-961e-f5c8c0f8a421=VmDevice:{id='VmDeviceId:{deviceId='5093d825-fcaa-4fd3-961e-f5c8c0f8a421', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}', device='unix', type='CHANNEL', bootOrder='0', specParams='[]', address='{bus=0, controller=0, type=virtio-serial, port=2}', managed='false', plugged='true', readOnly='false', deviceAlias='channel1', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false', hostDevice='null'}, device_a5f1f979-6bf0-4c43-b271-8377a9cec988=VmDevice:{id='VmDeviceId:{deviceId='a5f1f979-6bf0-4c43-b271-8377a9cec988', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}', device='ide', type='CONTROLLER', bootOrder='0', specParams='[]', address='{slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}', managed='false', plugged='true', readOnly='false', deviceAlias='ide', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false', hostDevice='null'}, device_a5f1f979-6bf0-4c43-b271-8377a9cec988device_d84aad16-4509-4792-827c-917add28f264device_5093d825-fcaa-4fd3-961e-f5c8c0f8a421device_da4cbbd4-7461-4141-99cb-770252e16775=VmDevice:{id='VmDeviceId:{deviceId='da4cbbd4-7461-4141-99cb-770252e16775', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f'}', device='spicevmc', type='CHANNEL', bootOrder='0', specParams='[]', address='{bus=0, controller=0, type=virtio-serial, port=3}', managed='false', plugged='true', readOnly='false', deviceAlias='channel2', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false', hostDevice='null'}}, vmType=kvm, memSize=16384, smpCoresPerSocket=1, vmName=win01.mgmt.ns.imm.re, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=43638, displayIp=192.168.128.176, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@32062234, display=qxl, maxVCpus=16, clientIp=, statusTime=4632985680, maxMemSlots=16}], log id: 2adb2ee5 2017-02-13 10:25:48,529Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-7) [66d4cc21] Received a spice Device without an address when processing VM d2cff305-80d7-4c21-82e8-2c0e1af58b4f devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.175, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=ad541478-0f2f-48b9-b435-b89962272711, tlsPort=5911} 2017-02-13 10:25:48,912Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [66d4cc21] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f' was reported as Down on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) 2017-02-13 10:25:48,912Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [66d4cc21] START, DestroyVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', vmId='d2cff305-80d7-4c21-82e8-2c0e1af58b4f', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 4bfecd72 2017-02-13 10:25:49,166Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-11) [66d4cc21] FINISH, DestroyVDSCommand, log id: 4bfecd72 2017-02-13 10:25:49,166Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-11) [66d4cc21] VM 'd2cff305-80d7-4c21-82e8-2c0e1af58b4f'(win01.mgmt.ns.imm.re) was unexpectedly detected as 'Down' on VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7'(ovirt03.mgmt.ns.imm.re) (expected on 'e9bc05a5-1c8e-4b55-bd53-89ec318d9b32') 2017-02-13 10:25:52,671Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] Updated host status from 'Preparing for Maintenance' to 'Maintenance' in database, host 'ovirt03.mgmt.ns.imm.re'(6957c3be-b9bc-4a35-a5ef-df6ec258c5f7) 2017-02-13 10:25:52,683Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-31) [] Clearing cache of pool: '587906e2-00d5-022c-016c-000000000358' for problematic entities of VDS: 'ovirt03.mgmt.ns.imm.re'. 2017-02-13 10:25:52,683Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-31) [] Removing vds '[6957c3be-b9bc-4a35-a5ef-df6ec258c5f7]' from the domain in maintenance cache 2017-02-13 10:25:52,683Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-31) [] Removing host(s) '[6957c3be-b9bc-4a35-a5ef-df6ec258c5f7]' from hosts unseen domain report cache 2017-02-13 10:25:52,685Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] START, DisconnectStoragePoolVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, DisconnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', storagePoolId='587906e2-00d5-022c-016c-000000000358', vds_spm_id='3'}), log id: 4bf9ba2f 2017-02-13 10:25:58,009Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler8) [697d3927-2ab0-447c-b934-b5a0fbcaa2a8] FINISH, DisconnectStoragePoolVDSCommand, log id: 4bf9ba2f 2017-02-13 10:25:58,017Z INFO [org.ovirt.engine.core.bll.storage.pool.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler8) [c47133e] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:25:58,063Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler8) [c47133e] START, DisconnectStorageServerVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 752a90b4 2017-02-13 10:25:58,739Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler8) [c47133e] FINISH, DisconnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 752a90b4 2017-02-13 10:25:58,741Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler8) [c47133e] START, DisconnectStorageServerVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 260311c9 2017-02-13 10:25:59,441Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler8) [c47133e] FINISH, DisconnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 260311c9 2017-02-13 10:26:00,880Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [41037ed4] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:26:00,880Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler4) [41037ed4] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:26:01,593Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [18cb8f8e] Fetched 0 VMs from VDS '6957c3be-b9bc-4a35-a5ef-df6ec258c5f7' 2017-02-13 10:26:15,937Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [c47133e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:26:15,937Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [c47133e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:26:30,990Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [c47133e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:26:30,990Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler8) [c47133e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:26:46,052Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:26:46,052Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [841e74e] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:27:01,093Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:27:01,093Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler7) [286f4732] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:27:16,160Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:27:16,160Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:27:31,218Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'MigratingTo' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:27:31,219Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler9) [505db1b8] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' is migrating to VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) ignoring it in the refresh until migration is done 2017-02-13 10:27:45,194Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'Up' on VDS 'ecef3dab-8795-48d3-a108-81ad29527bec'(ovirt05.mgmt.ns.imm.re) (expected on 'bca50b60-f7df-4407-be28-556a3d50e091') 2017-02-13 10:27:45,198Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-4) [] START, MigrateStatusVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, MigrateStatusVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmId='873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'}), log id: 2a6237df 2017-02-13 10:27:45,361Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (ForkJoinPool-1-worker-4) [] FINISH, MigrateStatusVDSCommand, log id: 2a6237df 2017-02-13 10:27:45,475Z WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (ForkJoinPool-1-worker-4) [2e2ce914] Validation of action 'ChangeVMCluster' failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-13 10:27:45,484Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-4) [2e2ce914] EVENT_ID: VM_MIGRATION_DONE(63), Correlation ID: 5490faea, Job ID: d899c4a2-ac8f-4ac2-96b2-f4a74c4a1b13, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dev-solr.rete.loc, Source: ovirt02.mgmt.ns.imm.re, Destination: ovirt05.mgmt.ns.imm.re, Duration: 4 minutes 19 seconds, Total: 4 minutes 19 seconds, Actual downtime: (N/A)) 2017-02-13 10:27:45,487Z INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ForkJoinPool-1-worker-4) [2e2ce914] Lock freed to object 'EngineLock:{exclusiveLocks='[873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8=]', sharedLocks='null'}' 2017-02-13 10:27:45,488Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-4) [2e2ce914] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8]'}), log id: 105056bd 2017-02-13 10:27:45,531Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (ForkJoinPool-1-worker-4) [2e2ce914] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8, memGuaranteedSize=12288, transparentHugePages=true, displayPort=-1, displaySecurePort=5913, timeOffset=0, cpuType=SandyBridge, smp=8, guestNumaNodes=[Ljava.lang.Object;@5278b1bd, smartcardEnable=false, custom={}, vmType=kvm, memSize=12288, smpCoresPerSocket=1, vmName=dev-solr.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=27080, displayIp=192.168.128.177, smpThreadsPerCore=1, guestDiskMapping={}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@2b20c68f, display=qxl, maxVCpus=16, clientIp=, statusTime=4617884190, maxMemSlots=16}], log id: 105056bd 2017-02-13 10:27:45,534Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-4) [2e2ce914] Received a memballoon Device without an address when processing VM 873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=12582912, alias=balloon0} 2017-02-13 10:27:45,534Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (ForkJoinPool-1-worker-4) [2e2ce914] Received a spice Device without an address when processing VM 873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.176, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=0404878e-9a4a-46e0-80d6-fc6f6f71e28a, tlsPort=5901} 2017-02-13 10:27:46,228Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [2e2ce914] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8' was reported as Down on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) 2017-02-13 10:27:46,228Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [2e2ce914] START, DestroyVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DestroyVmVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', vmId='873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8', force='false', secondsToWait='0', gracefully='false', reason='', ignoreNoVm='true'}), log id: 13ea169d 2017-02-13 10:27:47,188Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-4) [2e2ce914] FINISH, DestroyVDSCommand, log id: 13ea169d 2017-02-13 10:27:47,188Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [2e2ce914] VM '873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8'(dev-solr.rete.loc) was unexpectedly detected as 'Down' on VDS 'bca50b60-f7df-4407-be28-556a3d50e091'(ovirt02.mgmt.ns.imm.re) (expected on 'ecef3dab-8795-48d3-a108-81ad29527bec') 2017-02-13 10:27:48,509Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler9) [505db1b8] Updated host status from 'Preparing for Maintenance' to 'Maintenance' in database, host 'ovirt02.mgmt.ns.imm.re'(bca50b60-f7df-4407-be28-556a3d50e091) 2017-02-13 10:27:48,522Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-39) [] Clearing cache of pool: '587906e2-00d5-022c-016c-000000000358' for problematic entities of VDS: 'ovirt02.mgmt.ns.imm.re'. 2017-02-13 10:27:48,522Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-39) [] Removing vds '[bca50b60-f7df-4407-be28-556a3d50e091]' from the domain in maintenance cache 2017-02-13 10:27:48,522Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxy] (org.ovirt.thread.pool-6-thread-39) [] Removing host(s) '[bca50b60-f7df-4407-be28-556a3d50e091]' from hosts unseen domain report cache 2017-02-13 10:27:48,524Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler9) [505db1b8] START, DisconnectStoragePoolVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, DisconnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', storagePoolId='587906e2-00d5-022c-016c-000000000358', vds_spm_id='1'}), log id: 50551594 2017-02-13 10:27:51,701Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [28a60b8f] Fetched 0 VMs from VDS 'bca50b60-f7df-4407-be28-556a3d50e091' 2017-02-13 10:27:53,048Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler9) [505db1b8] FINISH, DisconnectStoragePoolVDSCommand, log id: 50551594 2017-02-13 10:27:53,056Z INFO [org.ovirt.engine.core.bll.storage.pool.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler9) [78c03a06] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 587906e2-00d5-022c-016c-000000000358 Type: StoragePool 2017-02-13 10:27:53,098Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler9) [78c03a06] START, DisconnectStorageServerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='ISCSI', connectionList='[StorageServerConnections:{id='68ba519d-1a0d-45c3-a7b3-2041d708cf53', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-2390329d2-f7c0000001158799-ovirtds01', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}, StorageServerConnections:{id='274eaebb-4fe8-4a46-8f14-029d970411b6', connection='10.10.10.10', iqn='iqn.2001-05.com.equallogic:0-af1ff6-c5f0329d2-ff800000014587d3-ovirtds02', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='bond0.1010', netIfaceName='bond0.1010'}]'}), log id: 1823f46f 2017-02-13 10:27:54,630Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler9) [78c03a06] FINISH, DisconnectStorageServerVDSCommand, return: {68ba519d-1a0d-45c3-a7b3-2041d708cf53=0, 274eaebb-4fe8-4a46-8f14-029d970411b6=0}, log id: 1823f46f 2017-02-13 10:27:54,632Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler9) [78c03a06] START, DisconnectStorageServerVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', storagePoolId='587906e2-00d5-022c-016c-000000000358', storageType='NFS', connectionList='[StorageServerConnections:{id='cdf10ebb-4ed1-470a-b677-2166385bbe3c', connection='192.168.128.182:/data', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='12c0cd5d-a75c-4c34-aee9-2b9186854e85', connection='192.168.128.182:/data/ISO', iqn='null', vfsType='null', mountOptions='null', nfsVersion='V3', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]'}), log id: 5bfca8d1 2017-02-13 10:27:55,623Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler9) [78c03a06] FINISH, DisconnectStorageServerVDSCommand, return: {12c0cd5d-a75c-4c34-aee9-2b9186854e85=0, cdf10ebb-4ed1-470a-b677-2166385bbe3c=0}, log id: 5bfca8d1 2017-02-13 10:28:01,386Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [28a60b8f] START, FullListVDSCommand(HostName = ovirt05.mgmt.ns.imm.re, FullListVDSCommandParameters:{runAsync='true', hostId='ecef3dab-8795-48d3-a108-81ad29527bec', vmIds='[873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8]'}), log id: 1be85fd9 2017-02-13 10:28:01,442Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler2) [28a60b8f] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, vmId=873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8, memGuaranteedSize=12288, transparentHugePages=true, displayPort=-1, displaySecurePort=5913, timeOffset=0, cpuType=SandyBridge, smp=8, guestNumaNodes=[Ljava.lang.Object;@5673b768, smartcardEnable=false, custom={}, vmType=kvm, memSize=12288, smpCoresPerSocket=1, vmName=dev-solr.rete.loc, nice=0, status=Up, maxMemSize=4194304, bootMenuEnable=false, pid=27080, displayIp=192.168.128.177, smpThreadsPerCore=1, guestDiskMapping={d9cc0e7c-c66f-4778-8={name=/dev/vda}, QEMU_DVD-ROM_QM00003={name=/dev/sr0}}, nicModel=rtl8139,pv, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@7d3b303, display=qxl, maxVCpus=16, clientIp=, statusTime=4617900090, maxMemSlots=16}], log id: 1be85fd9 2017-02-13 10:28:01,445Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [28a60b8f] Received a memballoon Device without an address when processing VM 873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8 devices, skipping device: {device=memballoon, specParams={model=none}, type=balloon, target=12582912, alias=balloon0} 2017-02-13 10:28:01,445Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmDevicesMonitoring] (DefaultQuartzScheduler2) [28a60b8f] Received a spice Device without an address when processing VM 873f1f5e-d6ae-4dc1-bdd9-4d4eb8bf24a8 devices, skipping device: {device=spice, specParams={fileTransferEnable=true, displayNetwork=ovirtmgmt, displayIp=192.168.128.176, spiceSslCipherSuite=DEFAULT, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,ssmartcard,susbredir, copyPasteEnable=true}, type=graphics, deviceId=0404878e-9a4a-46e0-80d6-fc6f6f71e28a, tlsPort=5901} 2017-02-13 10:29:08,844Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] Running command: InstallVdsCommand internal: false. Entities affected : ID: bca50b60-f7df-4407-be28-556a3d50e091 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 10:29:08,914Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] Lock Acquired to object 'EngineLock:{exclusiveLocks='[bca50b60-f7df-4407-be28-556a3d50e091=]', sharedLocks='null'}' 2017-02-13 10:29:08,941Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: bca50b60-f7df-4407-be28-556a3d50e091 Type: VDS 2017-02-13 10:29:08,941Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] Before Installation host bca50b60-f7df-4407-be28-556a3d50e091, ovirt02.mgmt.ns.imm.re 2017-02-13 10:29:08,976Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] START, SetVdsStatusVDSCommand(HostName = ovirt02.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='bca50b60-f7df-4407-be28-556a3d50e091', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 79918ee6 2017-02-13 10:29:08,980Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] FINISH, SetVdsStatusVDSCommand, log id: 79918ee6 2017-02-13 10:29:09,078Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Connected to host ovirt02.mgmt.ns.imm.re with SSH key fingerprint: SHA256:n+f1vjPglPQrYuCnX55/Kd8gTKEcmBYP4KUAO/7M5Ks. 2017-02-13 10:29:09,117Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] Installation of ovirt02.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 10:29:09,117Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 10:29:09,164Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-49) [a7d87154-f715-4a40-885e-33e9493dda44] SSH execute 'root@ovirt02.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 10:29:09,343Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt02.mgmt.ns.imm.re using Proxy Host ovirt08.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.218. 2017-02-13 10:29:09,345Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] START, FenceVdsVDSCommand(HostName = ovirt08.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='a6b68006-cde8-4891-95a5-56d1d92605fc', targetVdsId='bca50b60-f7df-4407-be28-556a3d50e091', action='STATUS', agent='FenceAgent:{id='fcb5bb9b-0d41-4575-84b3-8458c8ab3715', hostId='bca50b60-f7df-4407-be28-556a3d50e091', order='1', type='ipmilan', ip='192.168.128.218', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 66a5b8a0 2017-02-13 10:29:10,123Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 66a5b8a0 2017-02-13 10:29:10,134Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-66) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: USER_UPDATE_VDS(43), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Host ovirt02.mgmt.ns.imm.re configuration was updated by fagiani@Immobiliare-authz. 2017-02-13 10:29:11,394Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 10:29:11,495Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 10:29:11,550Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 10:29:24,010Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 10:29:24,068Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 10:29:24,249Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Running command: InstallVdsCommand internal: false. Entities affected : ID: 6957c3be-b9bc-4a35-a5ef-df6ec258c5f7 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-13 10:29:24,336Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Lock Acquired to object 'EngineLock:{exclusiveLocks='[6957c3be-b9bc-4a35-a5ef-df6ec258c5f7=]', sharedLocks='null'}' 2017-02-13 10:29:24,374Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 6957c3be-b9bc-4a35-a5ef-df6ec258c5f7 Type: VDS 2017-02-13 10:29:24,374Z INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Before Installation host 6957c3be-b9bc-4a35-a5ef-df6ec258c5f7, ovirt03.mgmt.ns.imm.re 2017-02-13 10:29:24,423Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] START, SetVdsStatusVDSCommand(HostName = ovirt03.mgmt.ns.imm.re, SetVdsStatusVDSCommandParameters:{runAsync='true', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 45922e39 2017-02-13 10:29:24,428Z INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] FINISH, SetVdsStatusVDSCommand, log id: 45922e39 2017-02-13 10:29:24,524Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Connected to host ovirt03.mgmt.ns.imm.re with SSH key fingerprint: SHA256:xc3c2Miy7ImwEmgan2vLwAFIInEFiLF7VQgEPDLR/1I. 2017-02-13 10:29:24,562Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Installation of ovirt03.mgmt.ns.imm.re. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-13 10:29:24,562Z INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-13 10:29:24,602Z INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-6-thread-45) [280d6645-d8f9-4c9f-8d8e-742199c1737c] SSH execute 'root@ovirt03.mgmt.ns.imm.re' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-13 10:29:24,701Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: FENCE_OPERATION_USING_AGENT_AND_PROXY_STARTED(9,020), Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host ovirt03.mgmt.ns.imm.re using Proxy Host ovirt06.mgmt.ns.imm.re and Fence Agent ipmilan:192.168.128.219. 2017-02-13 10:29:24,703Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] START, FenceVdsVDSCommand(HostName = ovirt06.mgmt.ns.imm.re, FenceVdsVDSCommandParameters:{runAsync='true', hostId='921245cb-5b54-411f-8e94-8c2302c2f9b4', targetVdsId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', action='STATUS', agent='FenceAgent:{id='ae64f67b-368e-4dc1-91da-9ec9fc7213f9', hostId='6957c3be-b9bc-4a35-a5ef-df6ec258c5f7', order='1', type='ipmilan', ip='192.168.128.219', port='null', user='root', password='***', encryptOptions='false', options='privlvl=OPERATOR delay=10 lanplus=1'}', policy='null'}), log id: 207c75f0 2017-02-13 10:29:24,703Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Kdump supported. 2017-02-13 10:29:25,022Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-deploy-20170213102902-crmty3.log'. 2017-02-13 10:29:25,090Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] Host ovirt02.mgmt.ns.imm.re reports unique id 4C4C4544-0057-5310-8052-C3C04F42354A 2017-02-13 10:29:25,179Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] Assigning unique id 4C4C4544-0057-5310-8052-C3C04F42354A to Host ovirt02.mgmt.ns.imm.re 2017-02-13 10:29:25,419Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 10:29:25,659Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Hardware supports virtualization. 2017-02-13 10:29:25,968Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 207c75f0 2017-02-13 10:29:25,981Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-85) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: USER_UPDATE_VDS(43), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Host ovirt03.mgmt.ns.imm.re configuration was updated by fagiani@Immobiliare-authz. 2017-02-13 10:29:26,033Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 10:29:26,195Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:29:26,238Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 10:29:26,711Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Initializing. 2017-02-13 10:29:26,789Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Environment setup. 2017-02-13 10:29:26,844Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Environment packages setup. 2017-02-13 10:29:34,896Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:29:34,922Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Setting time. 2017-02-13 10:29:37,423Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Programs detection. 2017-02-13 10:29:37,455Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Environment customization. 2017-02-13 10:29:38,025Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Kdump supported. 2017-02-13 10:29:38,347Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Logs at host located at: '/tmp/ovirt-host-deploy-20170213102915-xh3gho.log'. 2017-02-13 10:29:38,379Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Host ovirt03.mgmt.ns.imm.re reports unique id 4C4C4544-0052-3110-8051-B3C04F42354A 2017-02-13 10:29:38,422Z INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployVdsmUnit] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] Assigning unique id 4C4C4544-0052-3110-8051-B3C04F42354A to Host ovirt03.mgmt.ns.imm.re 2017-02-13 10:29:38,518Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Setup validation. 2017-02-13 10:29:38,631Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Hardware supports virtualization. 2017-02-13 10:29:38,801Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Transaction setup. 2017-02-13 10:29:38,932Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:29:38,954Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Package installation. 2017-02-13 10:29:39,458Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Enrolling certificate. 2017-02-13 10:29:40,867Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Enrolling serial console certificate. 2017-02-13 10:29:42,914Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 10:29:43,053Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Setting kernel arguments. 2017-02-13 10:29:43,333Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 10:29:45,959Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [a7d87154-f715-4a40-885e-33e9493dda44] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: a7d87154-f715-4a40-885e-33e9493dda44, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt02.mgmt.ns.imm.re. Restarting kdump. 2017-02-13 10:29:47,380Z INFO [org.ovirt.engine.core.bll.scheduling.HaReservationHandling] (DefaultQuartzScheduler9) [78c03a06] HA reservation status for cluster 'Default' is 'OK' 2017-02-13 10:29:48,658Z ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages Connection reset by peer 2017-02-13 10:29:50,393Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Misc configuration. 2017-02-13 10:29:50,413Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Setting time. 2017-02-13 10:29:50,964Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Removing hosted-engine configuration. 2017-02-13 10:29:52,871Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Enrolling certificate. 2017-02-13 10:29:54,286Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Enrolling serial console certificate. 2017-02-13 10:29:56,327Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Transaction commit. 2017-02-13 10:29:56,462Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Setting kernel arguments. 2017-02-13 10:29:56,763Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Stage: Closing up. 2017-02-13 10:30:00,913Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [280d6645-d8f9-4c9f-8d8e-742199c1737c] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Correlation ID: 280d6645-d8f9-4c9f-8d8e-742199c1737c, Call Stack: null, Custom Event ID: -1, Message: Installing Host ovirt03.mgmt.ns.imm.re. Restarting kdump.