Sep 11 13:12:20 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Engine vm is running on host getafix.csirt.ac.za (id 3)
Sep 11 13:12:20 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Initializing VDSM
Sep 11 13:12:20 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Connecting the storage
Sep 11 13:12:20 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting storage server
Sep 11 13:12:22 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Failed to stop monitoring domain (sd_uuid=ff8ce693-5a52-47df-8e06-3443b4dc98a4): Error 900 from stopMonitoringDomain: Storage domain is member of pool: 'domain=ff8ce693-5a52-47df-8e06-3443b4dc98a4'
Sep 11 13:12:22 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.image.Image:Teardown images
Sep 11 13:12:22 asterix ovirt-ha-agent: WARNING:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Disconnecting the storage
Sep 11 13:12:22 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Disconnecting storage server
Sep 11 13:12:23 asterix kernel: device-mapper: table: 253:6: multipath: error getting device
Sep 11 13:12:23 asterix kernel: device-mapper: ioctl: error adding target to table
Sep 11 13:12:23 asterix multipathd: dm-6: remove map (uevent)
Sep 11 13:12:23 asterix multipathd: dm-6: remove map (uevent)
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.upgrade.StorageServer:Fixing storage path in conf file
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.upgrade.StorageServer:Reading conf file: hosted-engine.conf
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.upgrade.StorageServer:Successfully fixed path in conf file
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting storage server
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting storage server
Sep 11 13:12:23 asterix systemd: Started /usr/bin/mount -t glusterfs -o backup-volfile-servers=glustermount.obelix:glustermount.getafix glustermount.asterix:/engine /rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine.
Sep 11 13:12:23 asterix systemd: Starting /usr/bin/mount -t glusterfs -o backup-volfile-servers=glustermount.obelix:glustermount.getafix glustermount.asterix:/engine /rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine.
Sep 11 13:12:23 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Refreshing the storage domain
Sep 11 13:12:23 asterix kernel: device-mapper: table: 253:6: multipath: error getting device
Sep 11 13:12:23 asterix kernel: device-mapper: ioctl: error adding target to table
Sep 11 13:12:23 asterix multipathd: dm-6: remove map (uevent)
Sep 11 13:12:23 asterix multipathd: dm-6: remove map (uevent)
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Preparing images
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.image.Image:Preparing images
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Reloading vm.conf from the shared storage domain
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config:Trying to get a fresher copy of vm configuration from the OVF_STORE
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore:Found OVF_STORE: imgUUID:231722f8-98ce-4535-9d13-87f589d9cb08, volUUID:68b1e297-c5af-452a-9cf8-d0f9cd85a97b
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore:Found OVF_STORE: imgUUID:a39ce8b0-77df-4021-8412-d8a130512c8a, volUUID:e9abc2d8-281d-4e56-a83b-27651966030a
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore:Extracting Engine VM OVF from the OVF_STORE
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore:OVF_STORE volume path: /rhev/data-center/mnt/glusterSD/glustermount.asterix:_engine/ff8ce693-5a52-47df-8e06-3443b4dc98a4/images/a39ce8b0-77df-4021-8412-d8a130512c8a/e9abc2d8-281d-4e56-a83b-27651966030a
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config:Found an OVF for HE VM, trying to convert
Sep 11 13:12:24 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config:Got vm.conf from OVF_STORE
Sep 11 13:12:28 asterix ovirt-ha-broker: WARNING:ping.Ping:Failed to ping 192.168.0.10
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:29 asterix ovirt-ha-broker: INFO:mem_free.MemFree:memFree: 88709
Sep 11 13:12:30 asterix ovirt-ha-broker: INFO:mgmt_bridge.MgmtBridge:Found bridge ovirtmgmt with ports
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:31 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:36 asterix ovirt-ha-broker: INFO:cpu_load_no_engine.EngineHealth:VM not on this host
Sep 11 13:12:36 asterix ovirt-ha-broker: INFO:cpu_load_no_engine.EngineHealth:System load total=0.0242, engine=0.0000, non-engine=0.0242
Sep 11 13:12:38 asterix ovirt-ha-broker: WARNING:ping.Ping:Failed to ping 192.168.0.10
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:39 asterix ovirt-ha-broker: INFO:mem_free.MemFree:memFree: 88707
Sep 11 13:12:45 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Acquired lock on host id 1
Sep 11 13:12:45 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Current state EngineDown (score: 1800)
Sep 11 13:12:45 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Best remote host obelix.csirt.ac.za (id: 2, score: 1800)
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:46 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:48 asterix ovirt-ha-broker: WARNING:ping.Ping:Failed to ping 192.168.0.10
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection established
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:ovirt_hosted_engine_ha.broker.listener.ConnectionHandler:Connection closed
Sep 11 13:12:50 asterix ovirt-ha-broker: INFO:mem_free.MemFree:memFree: 88706
Sep 11 13:12:55 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Initializing VDSM
Sep 11 13:12:55 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Connecting the storage
Sep 11 13:12:55 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Connecting storage server
Sep 11 13:12:57 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Failed to stop monitoring domain (sd_uuid=ff8ce693-5a52-47df-8e06-3443b4dc98a4): Error 900 from stopMonitoringDomain: Storage domain is member of pool: 'domain=ff8ce693-5a52-47df-8e06-3443b4dc98a4'
Sep 11 13:12:58 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.image.Image:Teardown images
Sep 11 13:12:58 asterix ovirt-ha-agent: WARNING:ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine:Disconnecting the storage
Sep 11 13:12:58 asterix ovirt-ha-agent: INFO:ovirt_hosted_engine_ha.lib.storage_server.StorageServer:Disconnecting storage server