<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div style="-webkit-text-size-adjust: auto;"><span></span></div>
<div style="-webkit-text-size-adjust: auto;"><span>I disabled local maintenance mode for all hosts, and then only set the host where HE VM is there to local maintenance mode. The logs are as follows. During the migration of HE VM , it shows some fatal error
happen. By the way, also HE VM can not work with live migration. Instead, other VMs can do live migration.
</span><br>
<span></span><br>
<span></span>---</div>
<div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">[root@compute2-3 ~]# hosted-engine --set-maintenance --mode=local<br>
You have new mail in /var/spool/mail/root<br>
[root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log<br>
MainThread::INFO::2014-12-29<br>
13:16:12,435::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.92 (id: 3, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:22,711::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state EngineUp (score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:22,711::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.92 (id: 3, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:32,978::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state EngineUp (score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:32,978::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:43,272::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state EngineUp (score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:43,272::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:53,316::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)<br>
Engine vm running on localhost<br>
MainThread::INFO::2014-12-29<br>
13:16:53,562::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state EngineUp (score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:16:53,562::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:17:03,600::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-29<br>
13:17:03,611::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Trying: notify time=1419877023.61 type=state_transition<br>
detail=EngineUp-LocalMaintenanceMigrateVm hostname='compute2-3'<br>
MainThread::INFO::2014-12-29<br>
13:17:03,672::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Success, was notification of state_transition<br>
(EngineUp-LocalMaintenanceMigrateVm) sent? sent<br>
MainThread::INFO::2014-12-29<br>
13:17:03,911::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)<br>
Score is 0 due to local maintenance mode<br>
MainThread::INFO::2014-12-29<br>
13:17:03,912::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenanceMigrateVm (score: 0)<br>
MainThread::INFO::2014-12-29<br>
13:17:03,912::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:17:03,960::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Trying: notify time=1419877023.96 type=state_transition<br>
detail=LocalMaintenanceMigrateVm-EngineMigratingAway<br>
hostname='compute2-3'<br>
MainThread::INFO::2014-12-29<br>
13:17:03,980::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Success, was notification of state_transition<br>
(LocalMaintenanceMigrateVm-EngineMigratingAway) sent? sent<br>
MainThread::INFO::2014-12-29<br>
13:17:04,218::states::66::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_penalize_memory)<br>
Penalizing score by 400 due to low free memory<br>
MainThread::INFO::2014-12-29<br>
13:17:04,218::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state EngineMigratingAway (score: 2000)<br>
MainThread::INFO::2014-12-29<br>
13:17:04,219::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::ERROR::2014-12-29<br>
13:17:14,251::hosted_engine::867::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_monitor_migration)<br>
Failed to migrate<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",<br>
line 863, in _monitor_migration<br>
vm_id,<br>
File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/vds_client.py",<br>
line 85, in run_vds_client_cmd<br>
response['status']['message'])<br>
DetailedError: Error 12 from migrateStatus: Fatal error during migration<br>
MainThread::INFO::2014-12-29<br>
13:17:14,262::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Trying: notify time=1419877034.26 type=state_transition<br>
detail=EngineMigratingAway-ReinitializeFSM hostname='compute2-3'<br>
MainThread::INFO::2014-12-29<br>
13:17:14,263::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Success, was notification of state_transition<br>
(EngineMigratingAway-ReinitializeFSM) sent? ignored<br>
MainThread::INFO::2014-12-29<br>
13:17:14,496::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state ReinitializeFSM (score: 0)<br>
MainThread::INFO::2014-12-29<br>
13:17:14,496::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:17:24,536::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-29<br>
13:17:24,547::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Trying: notify time=1419877044.55 type=state_transition<br>
detail=ReinitializeFSM-LocalMaintenance hostname='compute2-3'<br>
MainThread::INFO::2014-12-29<br>
13:17:24,574::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)<br>
Success, was notification of state_transition<br>
(ReinitializeFSM-LocalMaintenance) sent? sent<br>
MainThread::INFO::2014-12-29<br>
13:17:24,812::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-29<br>
13:17:24,812::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:17:34,851::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-29<br>
13:17:35,095::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-29<br>
13:17:35,095::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
MainThread::INFO::2014-12-29<br>
13:17:45,130::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)<br>
Local maintenance detected<br>
MainThread::INFO::2014-12-29<br>
13:17:45,368::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Current state LocalMaintenance (score: 0)<br>
MainThread::INFO::2014-12-29<br>
13:17:45,368::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)<br>
Best remote host 10.0.0.93 (id: 2, score: 2400)<br>
^C<br>
[root@compute2-3 ~]#<br>
<br>
<br>
[root@compute2-3 ~]# hosted-engine --vm-status<br>
<br>
<br>
--== Host 1 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.94<br>
Host ID : 1<br>
Engine status : {"health": "good", "vm": "up",<br>
"detail": "up"}<br>
Score : 0<br>
Local maintenance : True<br>
Host timestamp : <a href="tel:1014956" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="86">1014956</a><br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=<a href="tel:1014956" x-apple-data-detectors="true" x-apple-data-detectors-type="telephone" x-apple-data-detectors-result="87">1014956</a> (Mon Dec 29 13:20:19 2014)<br>
host-id=1<br>
score=0<br>
maintenance=True<br>
state=LocalMaintenance<br>
<br>
<br>
--== Host 2 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.93<br>
Host ID : 2<br>
Engine status : {"reason": "vm not running on<br>
this host", "health": "bad", "vm": "down", "detail": "unknown"}<br>
Score : 2400<br>
Local maintenance : False<br>
Host timestamp : 866019<br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=866019 (Mon Dec 29 10:19:45 2014)<br>
host-id=2<br>
score=2400<br>
maintenance=False<br>
state=EngineDown<br>
<br>
<br>
--== Host 3 status ==--<br>
<br>
Status up-to-date : True<br>
Hostname : 10.0.0.92<br>
Host ID : 3<br>
Engine status : {"reason": "vm not running on<br>
this host", "health": "bad", "vm": "down", "detail": "unknown"}<br>
Score : 2400<br>
Local maintenance : False<br>
Host timestamp : 860493<br>
Extra metadata (valid at timestamp):<br>
metadata_parse_version=1<br>
metadata_feature_version=1<br>
timestamp=860493 (Mon Dec 29 10:20:35 2014)<br>
host-id=3<br>
score=2400<br>
maintenance=False<br>
state=EngineDown<br>
[root@compute2-3 ~]#</span></div>
<div><span style="-webkit-text-size-adjust: auto;">---</span></div>
<div><span style="-webkit-text-size-adjust: auto;">Thanks,</span></div>
<div><span style="-webkit-text-size-adjust: auto;">Cong</span></div>
<div><span style="-webkit-text-size-adjust: auto;"><br>
</span><br>
<span style="-webkit-text-size-adjust: auto;"></span><br>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>On 2014/12/29, at 8:43, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a>> wrote:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>I see that HE vm run on host with ip 10.0.0.94, and two another hosts in "Local Maintenance" state, so vm will not migrate to any of them, can you try disable local maintenance on all hosts
in HE environment and after enable "local maintenance" on host where HE vm run, and provide also output of hosted-engine --vm-status.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Failover works in next way:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>1) if host where run HE vm have score less by 800 that some other host in HE environment, HE vm will migrate on host with best score</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>2) if something happen to vm(kernel panic, crash of service...), agent will restart HE vm on another host in HE environment with positive score</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>3) if put to local maintenance host with HE vm, vm will migrate to another host with positive score</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cc: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a>>,
<a href="mailto:users@ovirt.org">users@ovirt.org</a></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Monday, December 29, 2014 6:30:42 PM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks and the --vm-status log is as follows:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]# hosted-engine --vm-status</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 1 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.94</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"health": "good", "vm": "up",</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>"detail": "up"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 1008087</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=1008087<tel:1008087> (Mon Dec 29 11:25:51 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineUp</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 2 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.93</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 859142</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=859142 (Mon Dec 29 08:25:08 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=LocalMaintenance</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 3 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.92</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 853615</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=853615 (Mon Dec 29 08:25:57 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=LocalMaintenance</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>You have new mail in /var/spool/mail/root</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]#</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Could you please explain how VM failover works inside ovirt? Is there any other debug option I can enable to check the problem?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>On 2014/12/29, at 1:39, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a><<a href="mailto:alukiano@redhat.com">mailto:alukiano@redhat.com</a>>> wrote:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Can you also provide output of hosted-engine --vm-status please, previous time it was useful, because I do not see something unusual.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a><<a href="mailto:alukiano@redhat.com">mailto:alukiano@redhat.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cc: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>>,
<a href="mailto:users@ovirt.org">users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Monday, December 29, 2014 7:15:24 AM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Also I change the maintenance mode to local in another host. But also the VM in this host can not be migrated. The logs are as follows.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]# hosted-engine --set-maintenance --mode=local</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:04,184::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:14,603::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:14,603::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:24,903::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:24,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:35,026::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine vm is running on host 10.0.0.94 (id 1)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:35,236::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:35,236::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:45,604::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:45,604::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,691::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,701::brokerlink::111::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Trying: notify time=1419829795.7 type=state_transition</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>detail=EngineDown-LocalMaintenance hostname='compute2-2'</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,761::brokerlink::120::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Success, was notification of state_transition</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>(EngineDown-LocalMaintenance) sent? sent</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,990::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score is 0 due to local maintenance mode</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,990::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>21:09:55,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>^C</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>You have new mail in /var/spool/mail/root</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]# ps -ef | grep qemu</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>root 18420 2777 0 21:10<x-apple-data-detectors://39> pts/0 00:00:00<x-apple-data-detectors://40> grep --color=auto qemu</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>qemu 29809 1 0 Dec19 ? 01:17:20 /usr/libexec/qemu-kvm</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-name testvm2-2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-m 500 -realtime mlock=off -smp</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>1,maxcpus=16,sockets=16,cores=1,threads=1 -uuid</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>c31e97d0-135e-42da-9954-162b5228dce3 -smbios</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>type=1,manufacturer=oVirt,product=oVirt</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0059-3610-8033-B4C04F395931,uuid=c31e97d0-135e-42da-9954-162b5228dce3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-no-user-config -nodefaults -chardev</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2-2.monitor,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-mon chardev=charmonitor,id=monitor,mode=control -rtc</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>base=2014-12-19T20:17:17<x-apple-data-detectors://42>,driftfix=slew -no-kvm-pit-reinjection</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-no-hpet -no-shutdown -boot strict=on -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial=</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-drive file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/5cbeb8c9-4f04-48d0-a5eb-78c49187c550/a0570e8c-9867-4ec4-818f-11e102fc4f9b,if=none,id=drive-virtio-disk0,format=qcow2,serial=5cbeb8c9-4f04-48d0-a5eb-78c49187c550,cache=none,werror=stop,rerror=stop,aio=threads</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:00,bus=pci.0,addr=0x3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.com.redhat.rhevm.vdsm,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/c31e97d0-135e-42da-9954-162b5228dce3.org.qemu.guest_agent.0,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev spicevmc,id=charchannel2,name=vdagent -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-spice tls-port=5901,addr=10.0.0.93,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]#</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>On 2014/12/28, at 20:53, "Yue, Cong" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>>
wrote:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>I checked it again and confirmed there is one guest VM is running on the top of this host. The log is as follows:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-1 vdsm]# ps -ef | grep qemu</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>qemu 2983 846 0 Dec19 ? 00:00:00<x-apple-data-detectors://0> [supervdsmServer] <defunct></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>root 5489 3053 0 20:49<x-apple-data-detectors://1> pts/0 00:00:00<x-apple-data-detectors://2> grep --color=auto qemu</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>qemu 26128 1 0 Dec19 ? 01:09:19 /usr/libexec/qemu-kvm</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-name testvm2 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Nehalem -m</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>500 -realtime mlock=off -smp 1,maxcpus=16,sockets=16,cores=1,threads=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-uuid e46bca87-4df5-4287-844b-90a26fccef33 -smbios</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>type=1,manufacturer=oVirt,product=oVirt</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Node,version=7-0.1406.el7.centos.2.5,serial=4C4C4544-0030-3310-8059-B8C04F585231,uuid=e46bca87-4df5-4287-844b-90a26fccef33</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-no-user-config -nodefaults -chardev</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>socket,id=charmonitor,path=/var/lib/libvirt/qemu/testvm2.monitor,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-mon chardev=charmonitor,id=monitor,mode=control -rtc</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>base=2014-12-19T20:18:01<x-apple-data-detectors://4>,driftfix=slew -no-kvm-pit-reinjection</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-no-hpet -no-shutdown -boot strict=on -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-drive if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial=</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-drive file=/rhev/data-center/00000002-0002-0002-0002-0000000001e4/1dc71096-27c4-4256-b2ac-bd7265525c69/images/b4b5426b-95e3-41af-b286-da245891cdaf/0f688d49-97e3-4f1d-84d4-ac1432d903b3,if=none,id=drive-virtio-disk0,format=qcow2,serial=b4b5426b-95e3-41af-b286-da245891cdaf,cache=none,werror=stop,rerror=stop,aio=threads</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:db:94:01,bus=pci.0,addr=0x3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.com.redhat.rhevm.vdsm,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/e46bca87-4df5-4287-844b-90a26fccef33.org.qemu.guest_agent.0,server,nowait</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-chardev spicevmc,id=charchannel2,name=vdagent -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-spice tls-port=5900,addr=10.0.0.92,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-k en-us -vga qxl -global qxl-vga.ram_size=67108864<tel:67108864> -global</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>qxl-vga.vram_size=33554432<tel:33554432> -incoming tcp:[::]:49152 -device</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:27,315::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:27,646::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:27,646::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:37,732::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:37,961::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:37,961::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:48,048::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:48,319::states::208::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score is 0 due to local maintenance mode</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:48,319::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-28</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>20:49:48,319::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>On 2014/12/28, at 3:46, "Artyom Lukianov" <<a href="mailto:alukiano@redhat.com">alukiano@redhat.com</a><<a href="mailto:alukiano@redhat.com">mailto:alukiano@redhat.com</a>><<a href="mailto:alukiano@redhat.com">mailto:alukiano@redhat.com</a>>>
wrote:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>I see that you set local maintenance on host3 that do not have engine vm on it, so it nothing to migrate from this host.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>If you set local maintenance on host1, vm must migrate to another host with positive score.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cc: <a href="mailto:users@ovirt.org">
users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Saturday, December 27, 2014 6:58:32 PM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hi</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>I had a try with "hosted-engine --set-maintence --mode=local" on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>compute2-1, which is host 3 in my cluster. From the log, it shows</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintence mode is dectected, but migration does not happen.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>The logs are as follows. Is there any other config I need to check?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-1 vdsm]# hosted-engine --vm-status</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 1 status ==-</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.94</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"health": "good", "vm": "up",</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>"detail": "up"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 836296</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=836296 (Sat Dec 27 11:42:39 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineUp</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 2 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.93</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 687358</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=687358 (Sat Dec 27 08:42:04 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineDown</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 3 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.92</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 681827</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=681827 (Sat Dec 27 08:42:40 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=0</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=LocalMaintenance</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-1 vdsm]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:42:41,109::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:42:51,198::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:42:51,420::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:42:51,420::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:01,507::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:01,773::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:01,773::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:11,859::state_decorators::124::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance detected</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:12,072::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state LocalMaintenance (score: 0)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:43:12,072::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-3 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:28,855::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:39,130::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:39,130::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:49,449::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:49,449::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:59,739::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:36:59,739::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:37:09,779::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine vm running on localhost</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:37:10,026::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:37:10,026::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:37:20,331::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>11:37:20,331::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>[root@compute2-2 ~]# tail -f /var/log/ovirt-hosted-engine-ha/agent.log</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:12,462::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:22,797::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:22,798::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:32,876::states::437::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine vm is running on host 10.0.0.94 (id 1)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:33,169::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:33,169::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:43,567::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:43,567::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:53,858::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:36:53,858::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,028::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Global metadata: {'maintenance': False}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host 10.0.0.94 (id 1): {'extra':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=835987</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>(Sat Dec 27 11:37:30</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n',</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'hostname': '10.0.0.94', 'alive': True, 'host-id': 1, 'engine-status':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>{'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'maintenance': False, 'host-ts': 835987}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,028::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host 10.0.0.92 (id 3): {'extra':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=681528</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>(Sat Dec 27 08:37:41</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>2014)\nhost-id=3\nscore=0\nmaintenance=True\nstate=LocalMaintenance\n',</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'down', 'detail': 'unknown'}, 'score': 0, 'maintenance': True,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'host-ts': 681528}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,028::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local (id 2): {'engine-health': {'reason': 'vm not running on this</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>True, 'mem-free': 15300.0, 'maintenance': False, 'cpu-load': 0.0215,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'gateway': True}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,265::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-27</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>08:37:04,265::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>On 2014/12/22, at 5:29, "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>>
wrote:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: "Simone Tiraboschi" <<a href="mailto:stirabos@redhat.com">stirabos@redhat.com</a><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>><<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cc: <a href="mailto:users@ovirt.org">
users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Friday, December 19, 2014 7:22:10 PM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: RE: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks for the information. This is the log for my three ovirt nodes.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From the output of hosted-engine --vm-status, it shows the engine state for</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>my 2nd and 3rd ovirt node is DOWN.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Is this the reason why VM failover not work in my environment?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>No, they looks ok: you can run the engine VM on single host at a time.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>How can I make</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>also engine works for my 2nd and 3rd ovit nodes?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>If you put the host 1 in local maintenance mode ( hosted-engine --set-maintenance --mode=local ) the VM should migrate to host 2; if you reactivate host 1 ( hosted-engine --set-maintenance
--mode=none ) and put host 2 in local maintenance mode the VM should migrate again.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Can you please try that and post the logs if something is going bad?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 1 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.94</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"health": "good", "vm": "up",</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>"detail": "up"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 150475</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=150475 (Fri Dec 19 13:12:18 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineUp</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 2 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : True</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.93</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : {"reason": "vm not running on</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>this host", "health": "bad", "vm": "down", "detail": "unknown"}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 1572</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=1572 (Fri Dec 19 10:12:18 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=2</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineDown</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--== Host 3 status ==--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Status up-to-date : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hostname : 10.0.0.92</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host ID : 3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine status : unknown stale-data</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Score : 2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local maintenance : False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host timestamp : 987</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Extra metadata (valid at timestamp):</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_parse_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>metadata_feature_version=1</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>timestamp=987 (Fri Dec 19 10:09:58 2014)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-id=3</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>score=2400</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>maintenance=False</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>state=EngineDown</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>And the /var/log/ovirt-hosted-engine-ha/agent.log for three ovirt nodes are</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>as follows:</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10.0.0.94(hosted-engine-1)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>---</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:33,716::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:33,716::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:44,017::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:44,017::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:54,303::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:09:54,303::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:04,342::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine vm running on localhost</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:04,617::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:04,617::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,657::state_machine::160::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Global metadata: {'maintenance': False}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host 10.0.0.93 (id 2): {'extra':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1448</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>(Fri Dec 19 10:10:14</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'hostname': '10.0.0.93', 'alive': True, 'host-id': 2, 'engine-status':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'host-ts': 1448}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,657::state_machine::165::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Host 10.0.0.92 (id 3): {'extra':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=987</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>(Fri Dec 19 10:09:58</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>2014)\nhost-id=3\nscore=2400\nmaintenance=False\nstate=EngineDown\n',</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'hostname': '10.0.0.92', 'alive': True, 'host-id': 3, 'engine-status':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>{'reason': 'vm not running on this host', 'health': 'bad', 'vm':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'down', 'detail': 'unknown'}, 'score': 2400, 'maintenance': False,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'host-ts': 987}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,658::state_machine::168::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up',</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>'detail': 'up'}, 'bridge': True, 'mem-free': 1079.0, 'maintenance':</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>False, 'cpu-load': 0.0269, 'gateway': True}</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,904::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:14,904::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:25,210::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:25,210::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:35,499::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:35,499::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:45,784::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:45,785::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:56,070::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:10:56,070::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:06,109::states::394::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Engine vm running on localhost</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:06,359::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:06,359::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:16,658::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:16,658::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:26,991::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:26,991::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:37,341::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineUp (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>13:11:37,341::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.93 (id: 2, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10.0.0.93 (hosted-engine-2)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:18,339::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:18,339::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:28,651::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:28,652::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:39,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:39,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:49,338::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:49,338::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:59,642::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:12:59,642::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:13:10,010::hosted_engine::327::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Current state EngineDown (score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>MainThread::INFO::2014-12-19</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10:13:10,010::hosted_engine::332::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Best remote host 10.0.0.94 (id: 1, score: 2400)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>10.0.0.92(hosted-engine-3)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>same as 10.0.0.93</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>--</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>-----Original Message-----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: Simone Tiraboschi [<a href="mailto:stirabos@redhat.com">mailto:stirabos@redhat.com</a>]</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Friday, December 19, 2014 12:28 AM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: Yue, Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cc: <a href="mailto:users@ovirt.org">
users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: Re: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>----- Original Message -----</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>From: "Cong Yue" <<a href="mailto:Cong_Yue@alliedtelesis.com">Cong_Yue@alliedtelesis.com</a><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>><<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>To: <a href="mailto:users@ovirt.org">
users@ovirt.org</a><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>><<a href="mailto:users@ovirt.org">mailto:users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sent: Friday, December 19, 2014 2:14:33 AM</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Subject: [ovirt-users] VM failover with ovirt3.5</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Hi</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>In my environment, I have 3 ovirt nodes as one cluster. And on top of</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>host-1, there is one vm to host ovirt engine.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Also I have one external storage for the cluster to use as data domain</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>of engine and data.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>I confirmed live migration works well in my environment.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>But it seems very buggy for VM failover if I try to force to shut down</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>one ovirt node. Sometimes the VM in the node which is shutdown can</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>migrate to other host, but it take more than several minutes.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Sometimes, it can not migrate at all. Sometimes, only when the host is</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>back, the VM is beginning to move.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Can you please check or share the logs under /var/log/ovirt-hosted-engine-ha/</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Is there some documentation to explain how VM failover is working? And</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>is there some bugs reported related with this?</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span><a href="http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram">http://www.ovirt.org/Features/Self_Hosted_Engine#Agent_State_Diagram</a></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Thanks in advance,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Cong</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>This e-mail message is for the sole use of the intended recipient(s)</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>and may contain confidential and privileged information. Any</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>unauthorized review, use, disclosure or distribution is prohibited. If</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>you are not the intended recipient, please contact the sender by reply</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>e-mail and destroy all copies of the original message. If you are the</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>intended recipient, please be advised that the content of this message</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>is subject to access, review and disclosure by the sender's e-mail System</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Administrator.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>_______________________________________________</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Users mailing list</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>This e-mail message is for the sole use of the intended recipient(s) and may</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>contain confidential and privileged information. Any unauthorized review,</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>use, disclosure or distribution is prohibited. If you are not the intended</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>recipient, please contact the sender by reply e-mail and destroy all copies</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>of the original message. If you are the intended recipient, please be</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>advised that the content of this message is subject to access, review and</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>disclosure by the sender's e-mail System Administrator.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure
by the sender's e-mail System Administrator.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>_______________________________________________</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>Users mailing list</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span><a href="mailto:Users@ovirt.org">Users@ovirt.org</a><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>><<a href="mailto:Users@ovirt.org">mailto:Users@ovirt.org</a>></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>________________________________</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure
by the sender's e-mail System Administrator.</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span></span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>________________________________</span><br>
</blockquote>
<blockquote type="cite" style="-webkit-text-size-adjust: auto;"><span>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure
by the sender's e-mail System Administrator.</span><br>
</blockquote>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1">This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's
e-mail System Administrator.<br>
</font>
</body>
</html>