[Users] Hosted Engine recovery failure of all HA - nodes
Daniel Helgenberger
daniel.helgenberger at m-box.de
Wed Apr 9 11:32:12 UTC 2014
Thanks everyone for shedding some light into this issue and pointing out
Bugzilla.
Maybe I was a little inpatient when I tried it yesterday; I will do
another run today.
I also attached the relevant log data, covering about 20min yesterday,
15:53 (boot) to 16:10; on the host witch I started the engine manually
in the end.
Helge
On Mi, 2014-04-09 at 09:18 +0200, Jiri Moskovcak wrote:
> On 04/08/2014 06:09 PM, Daniel Helgenberger wrote:
> > Hello,
> >
> > I have an oVirt 3.4 hosted engine lab setup witch I am evaluating for
> > production use.
> >
> > I "simulated" an ungraceful shutdown of all HA nodes (powercut) while
> > the engine was running. After powering up, the system did not recover
> > itself (it seemed).
> > I had to restart the ovirt-hosted-ha service (witch was in a locked
> > state) and then manually run 'hosted-engine --vm-start'.
> >
> > What is the supposed procedure after a shutdown (graceful / ungraceful)
> > of Hosted-Engine HA nodes? Should the engine recover by itself? Should
> > the running VM's be restarted automatically?
>
> When this happens the agent should start the engine VM and the engine
> should take care of restarting the VMs which were running on that
> restarted host and are marked as HA. Can you please provide contents ov
> /var/log/ovirt* from the host after the powercut when the engine VM
> doesn't come up?
>
> Thanks,
> Jirka
>
> >
> > Thanks,
> > Daniel
> >
> >
> >
> >
> >
> >
> >
> > _______________________________________________
> > Users mailing list
> > Users at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> >
>
--
Daniel Helgenberger
m box bewegtbild GmbH
P: +49/30/2408781-22
F: +49/30/2408781-10
ACKERSTR. 19
D-10115 BERLIN
www.m-box.de www.monkeymen.tv
Geschäftsführer: Martin Retschitzegger / Michaela Göllner
Handeslregister: Amtsgericht Charlottenburg / HRB 112767
-------------- next part --------------
/var/log/ovirt-hosted-engine-ha/agent.log:MainTMainThread::INFO::2014-04-08 15:53:33,862::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:33,936::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 192.168.50.201
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:33,937::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:33,937::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '192.168.50.1'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:33,939::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700911299600
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:33,939::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,013::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700911300304
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,013::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,015::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700911300112
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,015::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'e68a11c8-1251-4c13-9e3b-3847bbb4fa3d', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,018::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700911300240
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,018::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'e68a11c8-1251-4c13-9e3b-3847bbb4fa3d', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,024::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700723857104
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,024::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:53:34,312::hosted_engine::430::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_cond_start_service) Starting vdsmd
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::CRITICAL::2014-04-08 15:53:34,442::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,698::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,737::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 192.168.50.201
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,738::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,745::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '192.168.50.1'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,749::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 33513360
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,749::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,755::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 33510096
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,755::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,758::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 33729808
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,758::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'e68a11c8-1251-4c13-9e3b-3847bbb4fa3d', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,760::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139700911299664
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,760::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'e68a11c8-1251-4c13-9e3b-3847bbb4fa3d', 'address': '0'}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,763::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 33510160
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:16,763::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 15:59:18,356::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /rhev/data-center/mnt/192.168.50.11:_volumes_tank_ovirt-vdsmd/bcfa7ec4-5278-44d8-9f31-682f2d9de91d/ha_agent/hosted-engine.lockspace)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:39,388::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:39,458::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: NONE
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:39,524::hosted_engine::511::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_domain_monitor) Started VDSM domain monitor for bcfa7ec4-5278-44d8-9f31-682f2d9de91d
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:39,581::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:44,640::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:49,702::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:54,762::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:03:59,823::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:04,884::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:09,945::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:15,005::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:20,066::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:25,126::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:30,187::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:35,247::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:40,307::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:45,367::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:50,428::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:04:55,493::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:00,554::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:05,614::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:10,674::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:15,734::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:20,794::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:25,855::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:30,916::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:35,976::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:41,037::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:46,097::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:51,156::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:05:56,216::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:01,277::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:06,337::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:11,398::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:16,458::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:21,518::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:26,578::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:31,706::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:31,707::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 192.168.50.202 (id 2): {'live-data': False, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1396965009 (Tue Apr 8 15:50:09 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '192.168.50.202', 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1396965009}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:31,707::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'bad vm status', 'health': 'bad', 'vm': 'down', 'detail': 'down'}, 'bridge': True, 'mem-free': 19523.0, 'maintenance': False, 'cpu-load': 0.002, 'gateway': True}
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:31,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396965991.71 type=state_transition detail=StartState-ReinitializeFSM hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:31,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:32,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:42,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966002.33 type=state_transition detail=ReinitializeFSM-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:42,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:42,683::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:52,714::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:52,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966012.72 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:52,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:06:53,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:03,151::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:03,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966023.15 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:03,152::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:03,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:13,526::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:13,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966033.53 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:13,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:13,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:23,915::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:23,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966043.92 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:23,917::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:24,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:34,302::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:34,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966054.3 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:34,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:34,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:34,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:44,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966064.69 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:44,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:45,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:45,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:55,071::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966075.07 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:55,072::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:55,428::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:07:55,428::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:05,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966085.46 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:05,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:05,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:05,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:15,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966095.85 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:15,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:16,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:16,183::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:26,221::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966106.22 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:26,222::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:26,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:26,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:36,605::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:36,607::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966116.61 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:36,608::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:36,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:36,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:46,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966127.0 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:46,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:47,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:47,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:57,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966137.38 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:57,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:57,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:08:57,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:07,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966147.77 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:07,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:08,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:08,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:18,157::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966158.16 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:18,158::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:18,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:18,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:28,538::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966168.54 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:28,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:28,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:28,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:38,892::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:38,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966178.9 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:38,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:39,222::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:39,222::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:49,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966189.25 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:49,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:49,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:49,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:59,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1396966199.62 type=state_transition detail=EngineDown-EngineDown hostname='nodehv01.lab.mbox.loc'
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:59,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:59,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
/var/log/ovirt-hosted-engine-ha/agent.log:MainThread::INFO::2014-04-08 16:09:59,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 192.168.50.202 (id: 2, score: 2400)
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,254::broker::57::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 1.1.2-1 started
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,300::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/submonitors
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,310::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor ping
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,813::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,822::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,823::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,826::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,827::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-load
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,833::monitor::48::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,833::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,833::listener::41::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) Initializing SocketServer
/var/log/ovirt-hosted-engine-ha/broker.log:MainThread::INFO::2014-04-08 15:53:33,840::listener::56::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) SocketServer ready
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:33,937::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:33,938::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor ping
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:33,939::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor ping, id 139700911299600
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:33,941::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor mgmt-bridge
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,012::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor mgmt-bridge, id 139700911300304
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-2::INFO::2014-04-08 15:53:34,012::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,013::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor mem-free
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,015::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor mem-free, id 139700911300112
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,016::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor cpu-load-no-engine
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,018::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor cpu-load-no-engine, id 139700911300240
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,019::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor engine-health
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,024::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor engine-health, id 139700723857104
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,501::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,501::monitor::89::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopping submonitor ping, id 139700911299600
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,501::monitor::98::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopped submonitor ping, id 139700911299600
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,501::monitor::89::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopping submonitor mgmt-bridge, id 139700911300304
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::98::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopped submonitor mgmt-bridge, id 139700911300304
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::89::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopping submonitor mem-free, id 139700911300112
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::98::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopped submonitor mem-free, id 139700911300112
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::89::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopping submonitor cpu-load-no-engine, id 139700911300240
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::98::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopped submonitor cpu-load-no-engine, id 139700911300240
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,502::monitor::89::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopping submonitor engine-health, id 139700723857104
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-1::INFO::2014-04-08 15:53:34,503::monitor::98::ovirt_hosted_engine_ha.broker.monitor.Monitor::(stop_submonitor) Stopped submonitor engine-health, id 139700723857104
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-4::ERROR::2014-04-08 15:53:37,041::mem_free::47::mem_free.MemFree::(action) Failed to getVdsStats: VDSM initialization timeout
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-6::ERROR::2014-04-08 15:53:37,041::engine_health::68::engine_health.CpuLoadNoEngine::(action) Failed to getVmStats: VDSM initialization timeout
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-5::ERROR::2014-04-08 15:53:37,041::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: VDSM initialization timeout
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-3::ERROR::2014-04-08 15:53:37,041::mgmt_bridge::51::mgmt_bridge.MgmtBridge::(action) Failed to getVdsCapabilities: VDSM initialization timeout
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-5::INFO::2014-04-08 15:53:47,297::cpu_load_no_engine::153::cpu_load_no_engine.EngineHealth::(update_stat_file) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-5::INFO::2014-04-08 15:53:47,297::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0293, engine=0.0000, non-engine=0.0293
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-7::INFO::2014-04-08 15:55:10,185::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-7::INFO::2014-04-08 15:55:10,212::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-8::INFO::2014-04-08 15:55:13,907::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-8::INFO::2014-04-08 15:55:13,908::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-9::INFO::2014-04-08 15:56:21,739::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-9::INFO::2014-04-08 15:56:21,741::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-10::INFO::2014-04-08 15:56:22,659::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-10::INFO::2014-04-08 15:56:22,661::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,748::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,748::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor ping
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,749::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor ping, id 33513360
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,750::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor mgmt-bridge
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,755::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor mgmt-bridge, id 33510096
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,756::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor mem-free
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,757::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor mem-free, id 33729808
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,758::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor cpu-load-no-engine
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,760::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor cpu-load-no-engine, id 139700911299664
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 15:59:16,760::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,761::monitor::65::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Starting submonitor engine-health
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-11::INFO::2014-04-08 15:59:16,762::monitor::78::ovirt_hosted_engine_ha.broker.monitor.Monitor::(start_submonitor) Started submonitor engine-health, id 33510160
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-17::INFO::2014-04-08 15:59:16,844::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 15:59:16,862::cpu_load_no_engine::153::cpu_load_no_engine.EngineHealth::(update_stat_file) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 15:59:16,863::engine_health::62::engine_health.CpuLoadNoEngine::(action) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-17::INFO::2014-04-08 15:59:16,897::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 15:59:16,902::mem_free::53::mem_free.MemFree::(action) memFree: 19577
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 15:59:17,395::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-18::INFO::2014-04-08 15:59:26,862::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 15:59:26,949::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0078, engine=0.0000, non-engine=0.0078
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-19::INFO::2014-04-08 16:00:13,469::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:00:16,815::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:00:16,881::engine_health::62::engine_health.CpuLoadNoEngine::(action) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:00:26,968::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:00:27,062::cpu_load_no_engine::153::cpu_load_no_engine.EngineHealth::(update_stat_file) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:00:27,063::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0015, engine=0.0000, non-engine=0.0015
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-18::INFO::2014-04-08 16:00:58,868::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-19::INFO::2014-04-08 16:00:58,876::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:00:58,882::mem_free::53::mem_free.MemFree::(action) memFree: 19555
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-20::INFO::2014-04-08 16:00:58,936::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-20::INFO::2014-04-08 16:00:58,940::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:00:58,952::mem_free::53::mem_free.MemFree::(action) memFree: 19556
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-21::INFO::2014-04-08 16:01:08,951::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-21::INFO::2014-04-08 16:01:08,963::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:01:08,975::mem_free::53::mem_free.MemFree::(action) memFree: 19554
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:01:16,869::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:01:16,939::engine_health::62::engine_health.CpuLoadNoEngine::(action) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-22::INFO::2014-04-08 16:01:18,956::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-22::INFO::2014-04-08 16:01:18,961::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:01:18,973::mem_free::53::mem_free.MemFree::(action) memFree: 19555
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:01:27,031::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:01:27,123::cpu_load_no_engine::153::cpu_load_no_engine.EngineHealth::(update_stat_file) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:01:27,124::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0017, engine=0.0000, non-engine=0.0017
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-23::INFO::2014-04-08 16:01:28,966::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-23::INFO::2014-04-08 16:01:28,971::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-24::INFO::2014-04-08 16:01:34,437::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-24::INFO::2014-04-08 16:01:34,443::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-25::INFO::2014-04-08 16:01:34,444::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-25::INFO::2014-04-08 16:01:34,449::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-26::INFO::2014-04-08 16:01:38,975::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-26::INFO::2014-04-08 16:01:38,981::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:01:38,992::mem_free::53::mem_free.MemFree::(action) memFree: 19554
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-27::INFO::2014-04-08 16:01:41,810::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-27::INFO::2014-04-08 16:01:41,816::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-28::INFO::2014-04-08 16:01:41,817::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-28::INFO::2014-04-08 16:01:41,822::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-29::INFO::2014-04-08 16:01:48,986::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-29::INFO::2014-04-08 16:01:48,991::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:01:49,003::mem_free::53::mem_free.MemFree::(action) memFree: 19555
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-30::INFO::2014-04-08 16:01:51,498::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-30::INFO::2014-04-08 16:01:51,503::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-31::INFO::2014-04-08 16:01:51,504::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-31::INFO::2014-04-08 16:01:51,509::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-32::INFO::2014-04-08 16:01:58,997::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-32::INFO::2014-04-08 16:01:59,003::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-33::INFO::2014-04-08 16:02:09,006::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-33::INFO::2014-04-08 16:02:09,012::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-34::INFO::2014-04-08 16:02:14,658::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-34::INFO::2014-04-08 16:02:14,664::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-35::INFO::2014-04-08 16:02:14,665::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-35::INFO::2014-04-08 16:02:14,670::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-36::INFO::2014-04-08 16:02:15,562::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-36::INFO::2014-04-08 16:02:15,567::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-37::INFO::2014-04-08 16:02:15,568::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-37::INFO::2014-04-08 16:02:15,573::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:02:16,880::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:02:16,997::engine_health::62::engine_health.CpuLoadNoEngine::(action) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-38::INFO::2014-04-08 16:02:19,017::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-38::INFO::2014-04-08 16:02:19,022::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:02:19,034::mem_free::53::mem_free.MemFree::(action) memFree: 19554
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-39::INFO::2014-04-08 16:02:20,282::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-39::INFO::2014-04-08 16:02:20,287::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-40::INFO::2014-04-08 16:02:20,288::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-40::INFO::2014-04-08 16:02:20,293::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:02:27,090::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:02:27,185::cpu_load_no_engine::153::cpu_load_no_engine.EngineHealth::(update_stat_file) VM not on this host
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:02:27,185::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0019, engine=0.0000, non-engine=0.0019
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-41::INFO::2014-04-08 16:02:29,027::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-41::INFO::2014-04-08 16:02:29,032::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:02:29,044::mem_free::53::mem_free.MemFree::(action) memFree: 19555
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-42::INFO::2014-04-08 16:02:32,762::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-42::INFO::2014-04-08 16:02:32,768::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-43::INFO::2014-04-08 16:02:32,768::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-43::INFO::2014-04-08 16:02:32,773::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-44::INFO::2014-04-08 16:02:36,730::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-44::INFO::2014-04-08 16:02:36,735::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-45::INFO::2014-04-08 16:02:36,736::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-45::INFO::2014-04-08 16:02:36,741::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-46::INFO::2014-04-08 16:02:39,037::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-46::INFO::2014-04-08 16:02:39,042::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:02:39,054::mem_free::53::mem_free.MemFree::(action) memFree: 19552
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:02:47,035::engine_health::83::engine_health.CpuLoadNoEngine::(action) VM status: waitforlaunch
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-47::INFO::2014-04-08 16:02:49,053::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-47::INFO::2014-04-08 16:02:49,059::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:02:49,071::mem_free::53::mem_free.MemFree::(action) memFree: 19522
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:02:57,043::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-48::INFO::2014-04-08 16:02:59,058::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-48::INFO::2014-04-08 16:02:59,065::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-49::INFO::2014-04-08 16:03:09,067::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-49::INFO::2014-04-08 16:03:09,072::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:03:09,084::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-50::INFO::2014-04-08 16:03:14,505::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-50::INFO::2014-04-08 16:03:14,510::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-51::INFO::2014-04-08 16:03:14,511::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-51::INFO::2014-04-08 16:03:14,516::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:03:16,918::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-52::INFO::2014-04-08 16:03:19,077::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-52::INFO::2014-04-08 16:03:19,082::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:03:19,094::mem_free::53::mem_free.MemFree::(action) memFree: 19526
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-53::INFO::2014-04-08 16:03:19,458::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-53::INFO::2014-04-08 16:03:19,463::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-54::INFO::2014-04-08 16:03:19,464::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-54::INFO::2014-04-08 16:03:19,469::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-55::INFO::2014-04-08 16:03:26,266::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-55::INFO::2014-04-08 16:03:26,272::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-56::INFO::2014-04-08 16:03:26,272::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-56::INFO::2014-04-08 16:03:26,278::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:03:27,146::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:03:27,246::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:03:27,250::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0049, engine=0.0000, non-engine=0.0049
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-57::INFO::2014-04-08 16:03:29,087::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-57::INFO::2014-04-08 16:03:29,092::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:03:29,104::mem_free::53::mem_free.MemFree::(action) memFree: 19528
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-58::INFO::2014-04-08 16:03:36,586::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-58::INFO::2014-04-08 16:03:36,592::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-59::INFO::2014-04-08 16:03:36,592::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-59::INFO::2014-04-08 16:03:36,598::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-60::INFO::2014-04-08 16:03:38,482::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-60::INFO::2014-04-08 16:03:38,488::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-61::INFO::2014-04-08 16:03:38,488::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-61::INFO::2014-04-08 16:03:38,494::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-62::INFO::2014-04-08 16:03:39,098::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-62::INFO::2014-04-08 16:03:39,103::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-63::INFO::2014-04-08 16:03:49,112::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-63::INFO::2014-04-08 16:03:49,118::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:03:49,130::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:03:57,102::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-64::INFO::2014-04-08 16:03:59,118::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-64::INFO::2014-04-08 16:03:59,124::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:03:59,136::mem_free::53::mem_free.MemFree::(action) memFree: 19525
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-65::INFO::2014-04-08 16:04:09,128::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-65::INFO::2014-04-08 16:04:09,134::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:04:09,146::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:04:16,978::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-66::INFO::2014-04-08 16:04:19,129::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-66::INFO::2014-04-08 16:04:19,134::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:04:19,146::mem_free::53::mem_free.MemFree::(action) memFree: 19525
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-67::INFO::2014-04-08 16:04:26,590::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-67::INFO::2014-04-08 16:04:26,596::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-68::INFO::2014-04-08 16:04:26,597::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-68::INFO::2014-04-08 16:04:26,602::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:04:27,217::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:04:27,307::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:04:27,307::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0021, engine=0.0000, non-engine=0.0021
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-69::INFO::2014-04-08 16:04:27,610::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-69::INFO::2014-04-08 16:04:27,616::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-70::INFO::2014-04-08 16:04:27,616::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-70::INFO::2014-04-08 16:04:27,621::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-71::INFO::2014-04-08 16:04:29,140::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-71::INFO::2014-04-08 16:04:29,145::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:04:29,156::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-72::INFO::2014-04-08 16:04:39,150::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-72::INFO::2014-04-08 16:04:39,156::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:04:39,167::mem_free::53::mem_free.MemFree::(action) memFree: 19525
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-73::INFO::2014-04-08 16:04:49,160::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-73::INFO::2014-04-08 16:04:49,166::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-74::INFO::2014-04-08 16:04:51,834::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-74::INFO::2014-04-08 16:04:51,839::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-75::INFO::2014-04-08 16:04:51,840::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-75::INFO::2014-04-08 16:04:51,845::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:04:57,161::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-76::INFO::2014-04-08 16:04:59,170::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-76::INFO::2014-04-08 16:04:59,176::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:04:59,187::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-77::INFO::2014-04-08 16:05:09,180::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-77::INFO::2014-04-08 16:05:09,185::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:05:17,039::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-78::INFO::2014-04-08 16:05:19,190::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-78::INFO::2014-04-08 16:05:19,196::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:05:19,207::mem_free::53::mem_free.MemFree::(action) memFree: 19525
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:05:27,269::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:05:27,368::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:05:27,368::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0021, engine=0.0000, non-engine=0.0021
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-79::INFO::2014-04-08 16:05:29,200::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-79::INFO::2014-04-08 16:05:29,206::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:05:29,217::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-80::INFO::2014-04-08 16:05:39,209::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-80::INFO::2014-04-08 16:05:39,226::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-81::INFO::2014-04-08 16:05:49,219::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-81::INFO::2014-04-08 16:05:49,224::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:05:49,235::mem_free::53::mem_free.MemFree::(action) memFree: 19523
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:05:57,224::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-82::INFO::2014-04-08 16:05:59,230::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-82::INFO::2014-04-08 16:05:59,235::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:05:59,247::mem_free::53::mem_free.MemFree::(action) memFree: 19524
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-83::INFO::2014-04-08 16:06:09,240::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-83::INFO::2014-04-08 16:06:09,245::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:06:17,100::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-84::INFO::2014-04-08 16:06:17,577::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-84::INFO::2014-04-08 16:06:17,582::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-85::INFO::2014-04-08 16:06:17,583::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-85::INFO::2014-04-08 16:06:17,588::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-86::INFO::2014-04-08 16:06:19,250::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-86::INFO::2014-04-08 16:06:19,256::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:06:19,266::mem_free::53::mem_free.MemFree::(action) memFree: 19525
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:06:27,332::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:06:27,429::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:06:27,429::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0020, engine=0.0000, non-engine=0.0020
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-87::INFO::2014-04-08 16:06:29,261::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-87::INFO::2014-04-08 16:06:29,266::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:06:29,277::mem_free::53::mem_free.MemFree::(action) memFree: 19523
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-88::INFO::2014-04-08 16:06:39,271::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-88::INFO::2014-04-08 16:06:39,283::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:06:39,294::mem_free::53::mem_free.MemFree::(action) memFree: 19516
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-89::INFO::2014-04-08 16:06:49,281::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-89::INFO::2014-04-08 16:06:49,286::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-90::INFO::2014-04-08 16:06:56,526::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-90::INFO::2014-04-08 16:06:56,537::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-91::INFO::2014-04-08 16:06:56,537::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-91::INFO::2014-04-08 16:06:56,543::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:06:57,283::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-92::INFO::2014-04-08 16:06:59,291::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-92::INFO::2014-04-08 16:06:59,296::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:06:59,308::mem_free::53::mem_free.MemFree::(action) memFree: 19513
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-93::INFO::2014-04-08 16:07:09,306::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-93::INFO::2014-04-08 16:07:09,311::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:07:09,322::mem_free::53::mem_free.MemFree::(action) memFree: 19512
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:07:17,164::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-94::INFO::2014-04-08 16:07:19,312::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-94::INFO::2014-04-08 16:07:19,318::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:07:19,328::mem_free::53::mem_free.MemFree::(action) memFree: 19511
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:07:27,391::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:07:27,490::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:07:27,495::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0057, engine=0.0000, non-engine=0.0057
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-95::INFO::2014-04-08 16:07:27,789::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-95::INFO::2014-04-08 16:07:27,795::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-96::INFO::2014-04-08 16:07:27,796::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-96::INFO::2014-04-08 16:07:27,801::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-97::INFO::2014-04-08 16:07:29,332::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-97::INFO::2014-04-08 16:07:29,337::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:07:29,348::mem_free::53::mem_free.MemFree::(action) memFree: 19510
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-98::INFO::2014-04-08 16:07:39,332::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-98::INFO::2014-04-08 16:07:39,338::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:07:39,348::mem_free::53::mem_free.MemFree::(action) memFree: 19509
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-99::INFO::2014-04-08 16:07:49,341::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-99::INFO::2014-04-08 16:07:49,348::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:07:57,343::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-100::INFO::2014-04-08 16:07:58,341::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-100::INFO::2014-04-08 16:07:58,347::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-101::INFO::2014-04-08 16:07:58,348::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-101::INFO::2014-04-08 16:07:58,353::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-102::INFO::2014-04-08 16:07:59,357::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-102::INFO::2014-04-08 16:07:59,364::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-103::INFO::2014-04-08 16:08:09,361::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-103::INFO::2014-04-08 16:08:09,367::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-104::INFO::2014-04-08 16:08:15,766::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-104::INFO::2014-04-08 16:08:15,772::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-105::INFO::2014-04-08 16:08:15,773::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-105::INFO::2014-04-08 16:08:15,778::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:08:17,223::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-106::INFO::2014-04-08 16:08:19,368::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-106::INFO::2014-04-08 16:08:19,374::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:08:19,385::mem_free::53::mem_free.MemFree::(action) memFree: 19512
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:08:27,463::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:08:27,552::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:08:27,557::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0059, engine=0.0000, non-engine=0.0059
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-107::INFO::2014-04-08 16:08:29,379::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-107::INFO::2014-04-08 16:08:29,385::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:08:29,396::mem_free::53::mem_free.MemFree::(action) memFree: 19511
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-108::INFO::2014-04-08 16:08:39,382::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-108::INFO::2014-04-08 16:08:39,394::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:08:39,405::mem_free::53::mem_free.MemFree::(action) memFree: 19512
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-109::INFO::2014-04-08 16:08:43,734::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-109::INFO::2014-04-08 16:08:43,740::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-110::INFO::2014-04-08 16:08:43,741::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-110::INFO::2014-04-08 16:08:43,746::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-111::INFO::2014-04-08 16:08:49,394::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-111::INFO::2014-04-08 16:08:49,400::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-112::INFO::2014-04-08 16:08:54,095::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-112::INFO::2014-04-08 16:08:54,101::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-113::INFO::2014-04-08 16:08:54,102::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-113::INFO::2014-04-08 16:08:54,107::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:08:57,405::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-114::INFO::2014-04-08 16:08:59,411::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-114::INFO::2014-04-08 16:08:59,417::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-115::INFO::2014-04-08 16:09:09,420::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-115::INFO::2014-04-08 16:09:09,429::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:09,440::mem_free::53::mem_free.MemFree::(action) memFree: 19511
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-12::INFO::2014-04-08 16:09:17,282::ping::52::ping.Ping::(action) Successfully pinged 192.168.50.1
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-116::INFO::2014-04-08 16:09:19,423::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-116::INFO::2014-04-08 16:09:19,428::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:19,439::mem_free::53::mem_free.MemFree::(action) memFree: 19510
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-13::INFO::2014-04-08 16:09:27,522::mgmt_bridge::59::mgmt_bridge.MgmtBridge::(action) Found bridge ovirtmgmt
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::ERROR::2014-04-08 16:09:27,613::cpu_load_no_engine::156::cpu_load_no_engine.EngineHealth::(update_stat_file) Failed to getVmStats: 'pid'
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-15::INFO::2014-04-08 16:09:27,618::cpu_load_no_engine::121::cpu_load_no_engine.EngineHealth::(calculate_load) System load total=0.0059, engine=0.0000, non-engine=0.0059
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-117::INFO::2014-04-08 16:09:29,435::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-117::INFO::2014-04-08 16:09:29,440::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:29,451::mem_free::53::mem_free.MemFree::(action) memFree: 19509
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-118::INFO::2014-04-08 16:09:39,443::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-118::INFO::2014-04-08 16:09:39,448::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:39,459::mem_free::53::mem_free.MemFree::(action) memFree: 19510
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-119::INFO::2014-04-08 16:09:49,460::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-119::INFO::2014-04-08 16:09:49,470::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:49,481::mem_free::53::mem_free.MemFree::(action) memFree: 19500
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-16::INFO::2014-04-08 16:09:57,466::engine_health::90::engine_health.CpuLoadNoEngine::(action) VM not running on this host, status down
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-120::INFO::2014-04-08 16:09:59,464::listener::134::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(setup) Connection established
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-120::INFO::2014-04-08 16:09:59,469::listener::184::ovirt_hosted_engine_ha.broker.listener.ConnectionHandler::(handle) Connection closed
/var/log/ovirt-hosted-engine-ha/broker.log:Thread-14::INFO::2014-04-08 16:09:59,481::mem_free::53::mem_free.MemFree::(action) memFree: 19512
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 4380 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140409/1aa69bd7/attachment-0001.bin>
More information about the Users
mailing list